[MCOL-549] Sync schema created mysql-bin.xxxxxx files for data replication. It should be for schema only Created: 2017-02-07  Updated: 2019-07-10  Resolved: 2019-07-10

Status: Closed
Project: MariaDB ColumnStore
Component/s: installation
Affects Version/s: 1.0.7
Fix Version/s: Icebox

Type: Bug Priority: Major
Reporter: Daniel Lee (Inactive) Assignee: Andrew Hutchings (Inactive)
Resolution: Not a Bug Votes: 1
Labels: None
Environment:

2-node combo stack on AWS, using d2.8xlarge instance type


Issue Links:
Duplicate
is duplicated by MCOL-967 Binlog DML recording should be blocked Closed
Sprint: 2017-20

 Description   

Build tested: 1.0.7-1, on AWS

I cpimported a 1TB dbt3 database, then insert..select all 8 tables to another database. There are mysql-bin files totaling 303 gb. This affects disk utilization and performance. We should setup replication for schema sync only.

rw-rw--- 1 mariadb-user mariadb-user 10920 Feb 6 15:38 mysql-bin.000001
rw-rw--- 1 mariadb-user mariadb-user 346 Feb 6 15:46 mysql-bin.000002
rw-rw--- 1 mariadb-user mariadb-user 1465 Feb 6 15:46 mysql-bin.000003
rw-rw--- 1 mariadb-user mariadb-user 8352 Feb 6 17:49 mysql-bin.000004
rw-rw--- 1 mariadb-user mariadb-user 346 Feb 6 17:50 mysql-bin.000005
rw-rw--- 1 mariadb-user mariadb-user 24669057129 Feb 6 21:33 mysql-bin.000006
rw-rw--- 1 mariadb-user mariadb-user 154527553064 Feb 7 00:23 mysql-bin.000007
rw-rw--- 1 mariadb-user mariadb-user 1437982903 Feb 7 00:24 mysql-bin.000008
rw-rw--- 1 mariadb-user mariadb-user 118352065576 Feb 7 01:36 mysql-bin.000009
rw-rw--- 1 mariadb-user mariadb-user 24508258169 Feb 7 02:02 mysql-bin.000010
rw-rw--- 1 mariadb-user mariadb-user 510 Feb 7 15:54 mysql-bin.000011
rw-rw--- 1 mariadb-user mariadb-user 346 Feb 7 15:56 mysql-bin.000012
rw-rw--- 1 mariadb-user mariadb-user 1361 Feb 7 16:11 mysql-bin.000013



 Comments   
Comment by Daniel Lee (Inactive) [ 2017-02-07 ]

BTW, the 1TB insert...select test was from ColumnsStore table to ColumnStore table. ColumnStore should not be replicating these data. Replication should only apply to non-columnstore data.

Comment by Andrew Hutchings (Inactive) [ 2017-10-20 ]

Re-assigned to me. Not certain on whether we will change this or keep it as part of server integration

Comment by Andrew Hutchings (Inactive) [ 2019-07-10 ]

This stuff will be very different in 1.4

Generated at Thu Feb 08 02:21:55 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.