MariaDB Corporation MaxScale /var/log/maxscale/maxscale1.log Thu Jan 26 11:54:13 2017 ----------------------------------------------------------------------- 2017-01-26 11:54:13 notice : Working directory: /var/log/maxscale 2017-01-26 11:54:13 notice : MariaDB MaxScale 2.0.3 started 2017-01-26 11:54:13 notice : MaxScale is running in process 10873 2017-01-26 11:54:13 notice : Configuration file: /etc/maxscale.cnf 2017-01-26 11:54:13 notice : Log directory: /var/log/maxscale 2017-01-26 11:54:13 notice : Data directory: /var/lib/maxscale 2017-01-26 11:54:13 notice : Module directory: /usr/lib64/maxscale 2017-01-26 11:54:13 notice : Service cache: /var/cache/maxscale 2017-01-26 11:54:13 notice : The logging of informational messages has been enabled. 2017-01-26 11:54:13 notice : Initialized avrorouter module V1.0.0. 2017-01-26 11:54:13 notice : Loaded module avrorouter: V1.0.0 from /usr/lib64/maxscale/libavrorouter.so 2017-01-26 11:54:13 notice : Initialise binlog router module V2.0.0. 2017-01-26 11:54:13 notice : Loaded module binlogrouter: V2.0.0 from /usr/lib64/maxscale/libbinlogrouter.so 2017-01-26 11:54:13 notice : Initialise CLI router module V1.0.0. 2017-01-26 11:54:13 notice : Loaded module cli: V1.0.0 from /usr/lib64/maxscale/libcli.so 2017-01-26 11:54:13 notice : Initializing statemend-based read/write split router module. 2017-01-26 11:54:13 notice : Loaded module readwritesplit: V1.1.0 from /usr/lib64/maxscale/libreadwritesplit.so 2017-01-26 11:54:13 notice : Initialise the MySQL Monitor module V1.4.0. 2017-01-26 11:54:13 notice : Loaded module mysqlmon: V1.4.0 from /usr/lib64/maxscale/libmysqlmon.so 2017-01-26 11:54:13 notice : Monitor 'Replication Monitor' is missing the 'monitor_interval' parameter, using default value of 10000 milliseconds. 2017-01-26 11:54:13 notice : No query classifier specified, using default 'qc_sqlite'. 2017-01-26 11:54:13 notice : Loaded module qc_sqlite: V1.0.0 from /usr/lib64/maxscale/libqc_sqlite.so 2017-01-26 11:54:13 info : qc_sqlite loaded. 2017-01-26 11:54:13 info : qc_sqlite: In-memory sqlite database successfully opened for thread 139659946637280. 2017-01-26 11:54:13 notice : Encrypted password file /var/lib/maxscale/.secrets can't be accessed (No such file or directory). Password encryption is not used. 2017-01-26 11:54:13 info : Notification service feedback is not enabled. 2017-01-26 11:54:13 info : Splitter Service: User XXXXX for database no XXXXX added to service user table. ... ... ... 2017-01-26 11:54:13 info : Splitter Service: User XXXXX for database XXXXX added to service user table. 2017-01-26 11:54:13 notice : Loaded 102 MySQL Users for service [Splitter Service]. 2017-01-26 11:54:13 notice : Loaded module MySQLClient: V1.1.0 from /usr/lib64/maxscale/libMySQLClient.so 2017-01-26 11:54:13 notice : Listening connections at 0.0.0.0:3306 with protocol MySQL 2017-01-26 11:54:13 info : Started session [0] for Splitter Service service 2017-01-26 11:54:13 notice : Listening connections at /tmp/ClusterMaster with protocol MySQL 2017-01-26 11:54:13 info : Started session [0] for Splitter Service service 2017-01-26 11:54:13 info : Initialise MaxScaled Protocol module. 2017-01-26 11:54:13 notice : Loaded module maxscaled: V2.0.0 from /usr/lib64/maxscale/libmaxscaled.so 2017-01-26 11:54:13 notice : Listening connections at localhost:6603 with protocol MaxScale Admin 2017-01-26 11:54:13 info : Started session [0] for CLI service 2017-01-26 11:54:13 info : replication-service: /var/lib/maxscale/binlog//master.ini parse result is 0 2017-01-26 11:54:13 notice : Server changed state: XX-XX-03[192.168.80.XX:3306]: new_master. [Running] -> [Master, Running] 2017-01-26 11:54:13 notice : Server changed state: XX-XX-04[192.168.80.YY:3306]: new_slave. [Running] -> [Slave, Running] 2017-01-26 11:54:13 notice : A Master Server is now available: 192.168.80.XX:3306 2017-01-26 11:54:16 error : Failure loading users data from backend [192.168.80.YY:3306] for service [replication-service]. MySQL error 2013, Lost connection to MySQL server at 'handshake: waiting for inital communication packet', system error: 110 2017-01-26 11:54:16 error : Unable to get user data from backend database for service [replication-service]. Failed to connect to any of the backend databases. 2017-01-26 11:54:16 error : Unable to load users for service replication-service 2017-01-26 11:54:16 error : Service replication-service, Using cached credential information file /var/lib/maxscale/binlog//cache/dbusers. 2017-01-26 11:54:16 notice : Validating binlog file 'mariadb-bin.000057' ... 2017-01-26 11:54:16 info : Current binlog file is mariadb-bin.000057, current pos is 0 2017-01-26 11:54:16 info : Started session [0] for replication-service service 2017-01-26 11:54:16 notice : Loaded module MySQLBackend: V2.0.0 from /usr/lib64/maxscale/libMySQLBackend.so 2017-01-26 11:54:16 notice : replication-service: attempting to connect to master server 192.168.80.YY:3306, binlog mariadb-bin.000057, pos 120462274 2017-01-26 11:54:16 notice : Listening connections at 0.0.0.0:4000 with protocol MySQL 2017-01-26 11:54:16 info : Started session [0] for replication-service service 2017-01-26 11:54:16 notice : [avro-service] Using configuration options from service 'replication-service'. 2017-01-26 11:54:16 info : Reading MySQL binlog files from /var/lib/maxscale/binlog/ 2017-01-26 11:54:16 info : Reading MySQL binlog files from /var/lib/maxscale/binlog/ 2017-01-26 11:54:16 info : AVRO files stored in /var/lib/maxscale/avro/ 2017-01-26 11:54:16 notice : [avro-service] Avro files stored at: /var/lib/maxscale/avro/ 2017-01-26 11:54:16 notice : [avro-service] Using existing GTID index: //var/lib/maxscale/avro//avro.index 2017-01-26 11:54:16 notice : [avro-service] Loading stored conversion state: /var/lib/maxscale/avro//avro-conversion.ini 2017-01-26 11:54:16 notice : Loaded stored binary log conversion state: File: [mariadb-bin.000032] Position: [526] GTID: [0-38-45225:2] 2017-01-26 11:54:16 info : AVRO: current MySQL binlog file is mariadb-bin.000032, pos is 526 2017-01-26 11:54:16 notice : Loaded module CDC: V1.0.0 from /usr/lib64/maxscale/libCDC.so 2017-01-26 11:54:16 notice : Listening connections at 0.0.0.0:4001 with protocol CDC 2017-01-26 11:54:16 info : Started session [0] for avro-service service 2017-01-26 11:54:16 notice : Started MaxScale log flusher. 2017-01-26 11:54:16 notice : MaxScale started with 2 server threads. 2017-01-26 11:54:16 notice : Loaded module MySQLAuth: V1.0.0 from /usr/lib64/maxscale/libMySQLAuth.so 2017-01-26 11:54:16 info : Servers and router connection counts: 2017-01-26 11:54:16 info : current operations : 0 in 192.168.80.XX:3306 RUNNING MASTER 2017-01-26 11:54:16 info : current operations : 0 in 192.168.80.ZZ:3306 RUNNING SLAVE 2017-01-26 11:54:16 info : Selected RUNNING MASTER in 192.168.80.XX:3306 2017-01-26 11:54:16 info : Selected RUNNING SLAVE in 192.168.80.ZZ:3306 2017-01-26 11:54:16 info : Started Splitter Service client session [0] for 'maxscale_user' from 192.168.80.YY 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_READ, stmt: SELECT UNIX_TIMESTAMP() 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_SYSVAR_READ, stmt: SHOW VARIABLES LIKE 'SERVER_ID' 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_USERVAR_WRITE, stmt: SET @master_heartbeat_period = 300000000000 2017-01-26 11:54:16 [7] info : Session write, routing to all servers. 2017-01-26 11:54:16 [7] info : Route query to master 192.168.80.XX:3306 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : Slave 'XX-XX-04' responded before master to a session command. Result: 0 2017-01-26 11:54:16 [7] info : Server 'XX-XX-03' responded to a session command, sending the response to the client. 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_USERVAR_WRITE, stmt: SET @master_binlog_checksum = @@global.binlog_checksum 2017-01-26 11:54:16 [7] info : Session write, routing to all servers. 2017-01-26 11:54:16 [7] info : Route query to master 192.168.80.XX:3306 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : Server 'XX-XX-03' responded to a session command, sending the response to the client. 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_READ|QUERY_TYPE_USERVAR_READ, stmt: SELECT @master_binlog_checksum 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_USERVAR_WRITE, stmt: SET @mariadb_slave_capability=4 2017-01-26 11:54:16 [7] info : Session write, routing to all servers. 2017-01-26 11:54:16 [7] info : Route query to master 192.168.80.XX:3306 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : Server 'XX-XX-03' responded to a session command, sending the response to the client. 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_SYSVAR_READ, stmt: SHOW VARIABLES LIKE 'SERVER_UUID' 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_USERVAR_WRITE, stmt: SET @slave_uuid='c6159a3a-e3b5-11e6-b10b-0050569bd68b' 2017-01-26 11:54:16 [7] info : Session write, routing to all servers. 2017-01-26 11:54:16 [7] info : Route query to master 192.168.80.XX:3306 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : Server 'XX-XX-03' responded to a session command, sending the response to the client. 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_GSYSVAR_WRITE, stmt: SET NAMES latin1 2017-01-26 11:54:16 [7] info : Session write, routing to all servers. 2017-01-26 11:54:16 [7] info : Route query to master 192.168.80.XX:3306 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : Slave 'XX-XX-04' responded before master to a session command. Result: 0 2017-01-26 11:54:16 [7] info : Server 'XX-XX-03' responded to a session command, sending the response to the client. 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_GSYSVAR_WRITE, stmt: SET NAMES utf8 2017-01-26 11:54:16 [7] info : Session write, routing to all servers. 2017-01-26 11:54:16 [7] info : Route query to master 192.168.80.XX:3306 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : Server 'XX-XX-03' responded to a session command, sending the response to the client. 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_READ, stmt: SELECT 1 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_READ, stmt: SELECT VERSION() 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_READ|QUERY_TYPE_SYSVAR_READ, stmt: SELECT @@version_comment limit 1 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_READ|QUERY_TYPE_SYSVAR_READ, stmt: SELECT @@hostname 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: COM_QUERY, type: QUERY_TYPE_READ|QUERY_TYPE_SYSVAR_READ, stmt: SELECT @@max_allowed_packet 2017-01-26 11:54:16 [7] info : Route query to slave 192.168.80.ZZ:3306 < 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: UNKNOWN MYSQL PACKET TYPE, type: N/A, stmt: ▒ 2017-01-26 11:54:16 [7] info : Route query to master 192.168.80.XX:3306 < 2017-01-26 11:54:16 notice : replication-service: Request binlog records from mariadb-bin.000057 at position 120462274 from master server 192.168.80.YY:3306 2017-01-26 11:54:16 notice : replication-service: identity seen by the master: server_id: 4000, uuid: c6159a3a-e3b5-11e6-b10b-0050569bd68b 2017-01-26 11:54:16 notice : replication-service: identity seen by the slaves: server_id: 3000, hostname: XX-XX-04, MySQL version: 10.0.25-MariaDB-wsrep 2017-01-26 11:54:16 [7] info : > Autocommit: [enabled], trx is [not open], cmd: UNKNOWN MYSQL PACKET TYPE, type: N/A, stmt: ▒ 017-01-26 11:54:16 [7] info : Route query to master 192.168.80.XX:3306 < 2017-01-26 11:54:16 info : qc_sqlite: In-memory sqlite database successfully opened for thread 139659709507328. 2017-01-26 11:54:17 error : Failed to initialize avrofile. 2017-01-26 11:54:17 error : Fatal: MaxScale 2.0.3 received fatal signal 11. Attempting backtrace. 2017-01-26 11:54:17 error : Commit ID: 9e27e6c002b297d6ddbdbdb34c3de849069a9d7c System name: Linux Release string: CentOS release 6.7 (Final) 2017-01-26 11:54:17 error : /usr/bin/maxscale() [0x403b9c] 2017-01-26 11:54:17 error : /lib64/libpthread.so.0(+0xf7e0) [0x7f051ca517e0] 2017-01-26 11:54:17 error : /usr/lib64/maxscale/libavrorouter.so(maxavro_file_open+0x25f) [0x7f051760b395] 2017-01-26 11:54:17 error : /usr/lib64/maxscale/libavrorouter.so(avro_index_file+0x29) [0x7f05175d53c0] 2017-01-26 11:54:17 error : /usr/lib64/maxscale/libavrorouter.so(avro_update_index+0x97) [0x7f05175d58e3] 2017-01-26 11:54:17 error : /usr/lib64/maxscale/libavrorouter.so(avro_flush_all_tables+0x90) [0x7f05175d4bbb] 2017-01-26 11:54:17 error : /usr/lib64/maxscale/libavrorouter.so(avro_read_all_events+0xb06) [0x7f05175d463b] 2017-01-26 11:54:17 error : /usr/lib64/maxscale/libavrorouter.so(converter_func+0x69) [0x7f05175cbc00] 2017-01-26 11:54:17 error : /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(+0x3b8a2) [0x7f051d35c8a2] 2017-01-26 11:54:17 error : /lib64/libpthread.so.0(+0x7aa1) [0x7f051ca49aa1] 2017-01-26 11:54:17 error : /lib64/libc.so.6(clone+0x6d) [0x7f051b5cfaad] 2017-01-26 11:54:17 info : Starting log flushing to disk.