[MXS-565] Binlog Router doesn't handle 16MB larger transmissions Created: 2016-02-05  Updated: 2016-02-19  Resolved: 2016-02-16

Status: Closed
Project: MariaDB MaxScale
Component/s: binlogrouter
Affects Version/s: 1.1.0
Fix Version/s: 1.4.0

Type: Bug Priority: Major
Reporter: Massimiliano Pinto (Inactive) Assignee: Massimiliano Pinto (Inactive)
Resolution: Fixed Votes: 1
Labels: None

Sprint: 1.4.0-2, 2016-3

 Description   

Currently binlog router is not handling data tramission of more than 16MBytes that is split across multiple network packets



 Comments   
Comment by Massimiliano Pinto (Inactive) [ 2016-02-05 ]

Now working on maxscale to slave event sending, when maxscale stored binlog contains events larger than 16MB.

Binlog has been copied from master to maxscale binlogdir.

Master events receiving would be final step.

Comment by Massimiliano Pinto (Inactive) [ 2016-02-05 ]

Current work is based on 1.2.1-binlog_router_trx branch.

Slave is now able to receive larger events from maxscale.

Tests are in progress in order to verify all possible corner cases.

When this part is done the fix on master start will begin.

Comment by Massimiliano Pinto (Inactive) [ 2016-02-08 ]

Started working in the master part.
2 main aspects

  • Handle chunked data and store data in the right way (this is the working on one)
  • Distribute events to up to data slaves
Comment by Massimiliano Pinto (Inactive) [ 2016-02-09 ]

Master part is now able to download and store events.

Now working on a solution for distribute events to "up to date" slaves

Comment by Massimiliano Pinto (Inactive) [ 2016-02-11 ]

current code in "1.2.1-binlog_router_trx_16mb" branch is being tested

Comment by Massimiliano Pinto (Inactive) [ 2016-02-11 ]

Tests are running with 12 mysql 5.6 slaves and transaction safety on

Comment by Massimiliano Pinto (Inactive) [ 2016-02-11 ]

Current solution is not doing checksum verification for events larger than 16MB

Comment by Massimiliano Pinto (Inactive) [ 2016-02-12 ]

Testing large event distribution without transaction safety.
Testing crc32 checksum validation for large packets

Comment by Massimiliano Pinto (Inactive) [ 2016-02-12 ]

Some crc32 issues found when sent data is exactly 16MB.

Working on a fix for it

Comment by Massimiliano Pinto (Inactive) [ 2016-02-12 ]

Testing the system with event equal to 16MB, and and a few bytes around it.

Checksum tests are running for event equal to 16MB, and and a few bytes around it.

Generated at Thu Feb 08 04:00:17 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.