Details
-
Bug
-
Status: Closed (View Workflow)
-
Major
-
Resolution: Cannot Reproduce
-
2.2.0
-
None
-
centos7 3.10.0-693.5.2.el7.x86_64
Description
when we start the binlog router we always end up in the same situation. It starts connecting to the master, it reads some info and then times-out. On a reconnect it says that there is an error in the binlog.
2017-12-22 10:56:08 notice : (928002) [binlogrouter] BinlogSVC: 'CHANGE MASTER TO executed'. Previous state MASTER_HOST='_none_', MASTER_PORT=3306, MASTER_LOG_FILE='', MASTER_LOG_POS=0, MASTER_USER='repl'. New state is MASTER_HOST='10.255.10.32', MASTER_PORT=3306, MASTER_LOG_FILE='', MASTER_LOG_POS=4, MASTER_USER='repl', MASTER_USE_GTID=Slave_pos
|
2017-12-22 10:56:11 notice : (928002) [binlogrouter] BinlogSVC: START SLAVE executed by maxscale@138.203.16.242. Trying connection to master [10.255.10.32]:3306, binlog , pos 4, transaction safe pos 4
|
2017-12-22 10:56:11 notice : [binlogrouter] BinlogSVC: attempting to connect to master server [10.255.10.32]:3306, binlog='', pos=4, GTID=0-1-22539224966
|
2017-12-22 10:56:11 notice : (928121) [binlogrouter] BinlogSVC: identity seen by the master: Server_id: 9, Slave_UUID: f12fcb7f-b97b-11e3-bc5e-0401152c4c22, Host: maxscale-blr-1
|
2017-12-22 10:56:11 notice : (928121) [binlogrouter] BinlogSVC: identity seen by the slaves: server_id: 999, uuid: x-f-cc-common, hostname: harvey, MySQL version: 5.6.19-common
|
2017-12-22 10:56:12 notice : (928002) [MySQLAuth] [BinlogSVC] Loaded 121 MySQL users for listener BinlogLIST.
|
2017-12-22 10:56:36 notice : [binlogrouter] BinlogSVC: Slave 138.203.16.242, server id 0, disconnected after 55 seconds. 6 SQL commands
|
2017-12-22 10:57:21 error : [binlogrouter] No event received from master [10.255.10.32]:3306 in heartbeat period (30 seconds), last event (Transaction ID Event (2 Phase Commit) 16) received 60 seconds ago. Assuming connection is dead and reconnecting.
|
2017-12-22 10:57:29 error : (928121) [binlogrouter] BinlogSVC: failed to connect to master server 'binlog_router_master_host', retrying in 10 seconds
|
2017-12-22 10:57:39 notice : [binlogrouter] BinlogSVC: attempting to connect to master server [10.255.10.32]:3306, binlog='mysql-bin.000036', pos=749450152, GTID=0-1-1064389133
|
2017-12-22 10:57:39 notice : (929418) [binlogrouter] BinlogSVC: Request binlog records from mysql-bin.000036 at position 749450152 from master server [10.255.10.32]:3306
|
2017-12-22 10:57:39 notice : (929418) [binlogrouter] BinlogSVC: identity seen by the master: Server_id: 9, Slave_UUID: f12fcb7f-b97b-11e3-bc5e-0401152c4c22, Host: maxscale-blr-1
|
2017-12-22 10:57:39 notice : (929418) [binlogrouter] BinlogSVC: identity seen by the slaves: server_id: 999, uuid: x-f-cc-common, hostname: harvey, MySQL version: 5.6.19-common
|
2017-12-22 10:57:42 error : (929418) [binlogrouter] Error packet in binlog stream.mysql-bin.000030 @ 4423.
|
2017-12-22 10:57:42 notice : (929418) [binlogrouter] BinlogSVC: Master 10.255.10.32 disconnected after 3 seconds. 6 events read.
|
2017-12-22 10:57:59 notice : [binlogrouter] BinlogSVC: Slave 138.203.16.242, server id 0, disconnected after 20 seconds. 3 SQL commands
|
Config for the binlog router:
[BinlogSVC]
|
type=service
|
router=binlogrouter
|
version_string=5.6.17-log
|
user=XXXXXXX
|
passwd=XXXXXXX
|
router_options=uuid=f12fcb7f-b97b-11e3-bc5e-0401152c4c22,
|
server_id=9,
|
user=XXXXXXX,
|
password=XXXXXXX,
|
heartbeat=30,
|
binlogdir=/binlogs,
|
transaction_safety=1,
|
master_version=5.6.19-common,
|
master_hostname=harvey,
|
master_uuid=x-f-cc-common,
|
master_id=999,
|
mariadb10-compatibility=1,
|
semisync=0,
|
mariadb10_slave_gtid=1,
|
mariadb10_master_gtid=1,
|
binlog_structure=tree,
|
slave_hostname=maxscale-blr-1,
|
master_retry_count=1000,
|
connect_retry=60
|
master is running: Server version: 10.1.29-MariaDB MariaDB Server
The moment this happens maxscale is not accepting any new connections on any listeners. Existing connections are still working