[MXS-2254]  maxscale takes high cpu usage even if after restarting maxscale with appermaxscale-cdc-adapter Created: 2019-01-10  Updated: 2019-09-23  Resolved: 2019-09-23

Status: Closed
Project: MariaDB MaxScale
Component/s: N/A
Affects Version/s: 2.3.2
Fix Version/s: N/A

Type: Bug Priority: Major
Reporter: Zdravelina Sokolovska (Inactive) Assignee: markus makela
Resolution: Cannot Reproduce Votes: 0
Labels: need_feedback
Environment:

mariaDB-AX -maxscale&&maxscale-connector;cdc-adapter-MariaDB-TX
CentOS 7.5
mariadb-columnstore-data-adapters-maxscale-cdc-adapter-1.2.2
mariadb-columnstore-api-cpp-1.2.2-1.
maxscale-cdc-connector-2.2.17
maxscale-2.3.1
mariadb-columnstore-server-1.2.2
MariaDB-server-10.3.11


Attachments: File BIN.7z     File mariadb-bin.000001     File maxscale.cnf    

 Description   

maxscale takes high cpu usage even if after restarting maxscale with appermaxscale-cdc-adapter

the problem is that after restarting the maxscale service the CPU usage become again 100%
and cannot connect mysql in order to restart Slave

last received Errors before the occurrence of the 100% CPU usage in maxscale process:
localhost.localdomain maxscale[12791]: No event received from master [172.20.3.11]:3306 in heartbeat period (300 seconds), last event (Query Event 2) received 309 seconds ago. Assuming connection is dead and reconnecting.
localhost.localdomain maxscale[12791]: replication-router: failed to connect to master server 'binlog_router_master_host', retrying in 10 seconds

[root@localhost 12791]# top -bH -d 5 -n 1 -p 12791
top - 12:53:52 up 44 days, 23:52,  2 users,  load average: 2.00, 1.98, 1.95
Threads:   3 total,   1 running,   2 sleeping,   0 stopped,   0 zombie
%Cpu(s): 51.6 us,  0.0 sy,  0.0 ni, 48.4 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem :  2495632 total,   119740 free,   575516 used,  1800376 buff/cache
KiB Swap:  1048572 total,  1043932 free,     4640 used.  1593792 avail Mem
 
  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
12791 maxscale  20   0  721036 451336   5048 R 99.9 18.1   8693:33 maxscale
12792 maxscale  20   0  721036 451336   5048 S  0.0 18.1  13:12.90 maxscale
12793 maxscale  20   0  721036 451336   5048 S  0.0 18.1   0:00.00 MHD-single
 

[root@localhost ~]# service  maxscale status
Redirecting to /bin/systemctl status maxscale.service
● maxscale.service - MariaDB MaxScale Database Proxy
   Loaded: loaded (/usr/lib/systemd/system/maxscale.service; disabled; vendor preset: disabled)
   Active: active (running) since Thu 2018-12-20 17:16:59 EET; 2 weeks 6 days ago
  Process: 12789 ExecStart=/usr/bin/maxscale (code=exited, status=0/SUCCESS)
  Process: 12788 ExecStartPre=/usr/bin/install -d /var/run/maxscale -o maxscale -g maxscale (code=exited, status=0/SUCCESS)
 Main PID: 12791 (maxscale)
   CGroup: /system.slice/maxscale.service
           └─12791 /usr/bin/maxscale
 
Dec 21 15:32:41 localhost.localdomain maxscale[12791]: (2) avro-router: new connection from [::ffff:172.20.2.237]
Dec 21 15:33:37 localhost.localdomain maxscale[12791]: (2) avro-router: new connection from [::ffff:172.20.2.237]
Dec 21 15:46:11 localhost.localdomain maxscale[12791]: (2) avro-router: new connection from [::ffff:127.0.0.1]
Dec 21 15:46:11 localhost.localdomain maxscale[12791]: (2) avro-router: new connection from [::ffff:127.0.0.1]
Dec 21 15:46:32 localhost.localdomain maxscale[12791]: (2) avro-router: new connection from [::ffff:127.0.0.1]
Dec 21 15:46:32 localhost.localdomain maxscale[12791]: (2) avro-router: new connection from [::ffff:127.0.0.1]
Dec 21 15:49:32 localhost.localdomain maxscale[12791]: (2) avro-router: new connection from [::ffff:127.0.0.1]
Dec 21 15:49:32 localhost.localdomain maxscale[12791]: (2) avro-router: new connection from [::ffff:127.0.0.1]
Jan 04 12:12:54 localhost.localdomain maxscale[12791]: No event received from master [172.20.3.11]:3306 in heartbeat period (300 seconds), last event (Query Event 2) received 309 seconds ago. Assuming connection is dead and reconnecting.
Jan 04 12:12:54 localhost.localdomain maxscale[12791]: replication-router: failed to connect to master server 'binlog_router_master_host', retrying in 10 seconds

  1. systemctl restart maxscale

     
    MariaDB MaxScale  /var/log/maxscale/maxscale.log  Thu Jan 10 14:51:55 2019
    ----------------------------------------------------------------------------
    2019-01-10 14:51:55   notice : syslog logging is enabled.
    2019-01-10 14:51:55   notice : maxlog logging is enabled.
    2019-01-10 14:51:55   notice : Using up to 974.86MiB of memory for query classifier cache
    2019-01-10 14:51:55   notice : Working directory: /var/log/maxscale
    2019-01-10 14:51:55   notice : The collection of SQLite memory allocation statistics turned off.
    2019-01-10 14:51:55   notice : Threading mode of SQLite set to Multi-thread.
    2019-01-10 14:51:55   notice : MariaDB MaxScale 2.3.1 started (Commit: c552845fd1264ba0d18ecbf8d6a7aa3c1b09a1b0)
    2019-01-10 14:51:55   notice : MaxScale is running in process 31203
    2019-01-10 14:51:55   notice : Configuration file: /etc/maxscale.cnf
    2019-01-10 14:51:55   notice : Log directory: /var/log/maxscale
    2019-01-10 14:51:55   notice : Data directory: /var/lib/maxscale
    2019-01-10 14:51:55   notice : Module directory: /usr/lib64/maxscale
    2019-01-10 14:51:55   notice : Service cache: /var/cache/maxscale
    2019-01-10 14:51:55   notice : No query classifier specified, using default 'qc_sqlite'.
    2019-01-10 14:51:55   notice : Loaded module qc_sqlite: V1.0.0 from /usr/lib64/maxscale/libqc_sqlite.so
    2019-01-10 14:51:55   notice : Query classification results are cached and reused. Memory used per thread: 974.86MiB
    2019-01-10 14:51:55   notice : Loading /etc/maxscale.cnf.
    2019-01-10 14:51:55   notice : /etc/maxscale.cnf.d does not exist, not reading.
    2019-01-10 14:51:55   notice : Loaded module cdc: V1.0.0 from /usr/lib64/maxscale/libcdc.so
    2019-01-10 14:51:55   notice : Loaded module avrorouter: V1.0.0 from /usr/lib64/maxscale/libavrorouter.so
    2019-01-10 14:51:55   warning: Protocol module 'mysqlclient' has been deprecated, use 'mariadbclient' instead.
    2019-01-10 14:51:55   notice : Loaded module mariadbclient: V1.1.0 from /usr/lib64/maxscale/libmariadbclient.so
    2019-01-10 14:51:55   notice : Initialise binlog router module.
    2019-01-10 14:51:55   notice : Loaded module binlogrouter: V2.1.0 from /usr/lib64/maxscale/libbinlogrouter.so
    2019-01-10 14:51:55   warning: The parameter 'passwd' is deprecated: use 'password' instead
    2019-01-10 14:51:55   notice : replication-router: storing binlog files in 'flat' mode
    2019-01-10 14:51:55   notice : replication-router: Service has MariaDB GTID otion set to ON
    2019-01-10 14:51:55   notice : Loaded module MySQLBackendAuth: V1.0.0 from /usr/lib64/maxscale/libmysqlbackendauth.so
    2019-01-10 14:51:55   notice : Validating last binlog file 'mariadb-bin.000002' ...
    2019-01-10 14:51:55   notice : 1546970120 @ 256, GTID List Event, (Tue Jan  8 19:55:20 2019), First EventTime
    2019-01-10 14:51:55   notice : 1547063835 @ 18947317, Write Rows Event (v1), (Wed Jan  9 21:57:15 2019), Last EventTime
    2019-01-10 14:51:55   notice : Transaction Summary for binlog 'mariadb-bin.000002'
                            Description                    Total          Average              Max
                            No. of Transactions              601
                            No. of Events                   1106              1.8                8
                            No. of Bytes                   18.1M            30.8k           342.2k
    2019-01-10 14:51:55   warning: Binlog file mariadb-bin.000002 contains a previous Opened Transaction @ 18750360. This pos is safe for slaves
    2019-01-10 14:51:55   error  : Binlog 'mariadb-bin.000002' ends at position 19012892 and has an incomplete transaction at 18750360.
    2019-01-10 14:51:55   notice : Loaded module MySQLAuth: V1.1.0 from /usr/lib64/maxscale/libmysqlauth.so
    2019-01-10 14:51:55   notice : Reading MySQL binlog files from /var/lib/maxscale
    2019-01-10 14:51:55   notice : Avro files stored at: /var/lib/maxscale
    2019-01-10 14:51:55   notice : First binlog is: mariadb-bin.000001
    2019-01-10 14:51:55   notice : [avro-router] Loading stored conversion state: /var/lib/maxscale/avro-conversion.ini
    2019-01-10 14:51:55   notice : Loaded stored binary log conversion state: File: [mariadb-bin.000001] Position: [158752] GTID: [0-1-635:0]
    2019-01-10 14:51:55   notice : Loaded module CDCPlainAuth: V1.1.0 from /usr/lib64/maxscale/libcdcplainauth.so
    2019-01-10 14:51:55   notice : Housekeeper thread started.
    2019-01-10 14:51:55   notice : Starting a total of 2 services...
    2019-01-10 14:51:55   notice : Encrypted password file /var/lib/maxscale/.secrets can't be accessed (No such file or directory). Password encryption is not used.
    2019-01-10 14:51:55   notice : [replication-router] Loaded 4 MySQL users for listener replication-listener.
    2019-01-10 14:51:55   notice : Listening for connections at [::]:6603 with protocol MySQL
    2019-01-10 14:51:55   notice : Service 'replication-router' started (1/2)
    2019-01-10 14:51:55   notice : Listening for connections at [::]:4001 with protocol CDC
    2019-01-10 14:51:55   notice : Service 'avro-router' started (2/2)
    2019-01-10 14:51:55   notice : Started REST API on [127.0.0.1]:8989
    2019-01-10 14:51:55   notice : MaxScale started with 1 worker threads, each with a stack size of 8388608 bytes.
    2019-01-10 14:51:55   warning: Protocol module 'mysqlbackend' has been deprecated, use 'mariadbbackend' instead.
    2019-01-10 14:51:55   notice : Loaded module mariadbbackend: V2.0.0 from /usr/lib64/maxscale/libmariadbbackend.so
    2019-01-10 14:51:55   notice : replication-router: attempting to connect to master server [172.20.3.11]:3306, binlog='mariadb-bin.000002', pos=19012892
    2019-01-10 14:51:55   notice : (3) replication-router: Request binlog records from mariadb-bin.000002 at position 19012892 from master server [172.20.3.11]:3306
    2019-01-10 14:51:55   notice : (3) replication-router: identity seen by the master: Server_id: 2, Slave_UUID: 829380de-14d6-11e9-bb36-001a4a16016b, Host: not set
    2019-01-10 14:51:55   notice : (3) replication-router: identity seen by the slaves: server_id: 1, hostname: tx-ref, MySQL version: 10.3.10-MariaDB-log
    2019-01-10 14:51:55   error  : (3) Error packet in binlog stream (mariadb-bin.000002@19012892): Could not find first log file name in binary log index file
    2019-01-10 14:51:55   notice : (3) replication-router: Master 172.20.3.11 disconnected after 0 seconds. 1 events read.
    
    

[root@localhost ~]# top
top - 14:57:27 up 45 days,  1:56,  4 users,  load average: 2.00, 1.97, 1.95
Tasks: 118 total,   2 running, 111 sleeping,   5 stopped,   0 zombie
%Cpu(s): 50.0 us,  0.2 sy,  0.0 ni, 49.8 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem :  2495632 total,   530240 free,   145956 used,  1819436 buff/cache
KiB Swap:  1048572 total,  1043932 free,     4640 used.  2023116 avail Mem
 
  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
31203 maxscale  20   0  242960  10256   4240 R 100.0  0.4   5:30.79 maxscale
16005 root      20   0       0      0      0 S   0.3  0.0   5:56.37 kworker/1:1
    1 root      20   0   51688   3620   2380 S   0.0  0.1   6:44.61 systemd
    2 root      20   0       0      0      0 S   0.0  0.0   0:00.24 kthreadd
    3 root      20   0       0      0      0 S   0.0  0.0   0:02.16 ksoftirqd/0
    5 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 kworker/0:0H
    7 root      rt   0       0      0      0 S   0.0  0.0   0:24.84 migration/0
    8 root      20   0       0      0      0 S   0.0  0.0   0:00.00 rcu_bh
    9 root      20   0       0      0      0 S   0.0  0.0   2:58.60 rcu_sched
   10 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 lru-add-drain
   11 root      rt   0       0      0      0 S   0.0  0.0   0:14.98 watchdog/0
   12 root      rt   0       0      0      0 S   0.0  0.0   0:13.55 watchdog/1
   13 root      rt   0       0      0      0 S   0.0  0.0   0:25.42 migration/1
   14 root      20   0       0      0      0 S   0.0  0.0   0:02.10 ksoftirqd/1
   16 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 kworker/1:0H
   18 root      20   0       0      0      0 S   0.0  0.0   0:00.00 kdevtmpfs
   19 root       0 -20       0      0      0 S   0.0  0.0   0:00.00 netns
[root@localhost ~]# top -bH -d 5 -n 10 -p 31203
top - 14:57:39 up 45 days,  1:56,  4 users,  load average: 1.92, 1.96, 1.95
Threads:   3 total,   1 running,   2 sleeping,   0 stopped,   0 zombie
%Cpu(s): 50.0 us,  0.0 sy,  0.0 ni, 50.0 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem :  2495632 total,   530116 free,   146080 used,  1819436 buff/cache
KiB Swap:  1048572 total,  1043932 free,     4640 used.  2022992 avail Mem
 
  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
31203 maxscale  20   0  242960  10256   4240 R 99.9  0.4   5:42.15 maxscale
31204 maxscale  20   0  242960  10256   4240 S  0.0  0.4   0:00.03 maxscale
31205 maxscale  20   0  242960  10256   4240 S  0.0  0.4   0:00.00 MHD-single
 
top - 14:57:44 up 45 days,  1:56,  4 users,  load average: 1.93, 1.96, 1.95
Threads:   3 total,   1 running,   2 sleeping,   0 stopped,   0 zombie
%Cpu(s): 50.0 us,  0.1 sy,  0.0 ni, 49.9 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem :  2495632 total,   529992 free,   146204 used,  1819436 buff/cache
KiB Swap:  1048572 total,  1043932 free,     4640 used.  2022868 avail Mem
 
  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND
31203 maxscale  20   0  242960  10256   4240 R 99.8  0.4   5:47.15 maxscale
31204 maxscale  20   0  242960  10256   4240 S  0.0  0.4   0:00.03 maxscale
31205 maxscale  20   0  242960  10256   4240 S  0.0  0.4   0:00.00 MHD-single



 Comments   
Comment by markus makela [ 2019-01-10 ]

There appear to be two MaxScale processes running. If you have the chance, please try to capture the output of the following command:

gdb -batch -ex 'thr a a bt' -p=$(pgrep maxscale)

If you have multiple maxscale processes, repeat the call but replace $(pgrep maxscale) with the PID of the process.

Comment by Zdravelina Sokolovska (Inactive) [ 2019-01-11 ]
  1. pgrep maxscale
    2626
  2. gdb -batch -ex 'thr a a bt' -p=$(pgrep maxscale)
    [New LWP 2628]
    [New LWP 2627]
    [Thread debugging using libthread_db enabled]
    Using host libthread_db library "/lib64/libthread_db.so.1".
    read_table_identifier (db=0x7ffdfdb73a00 "a", sql=0x1a8a8ef "(`a` int(11) DEFAULT NULL, `b` int(11) DEFAULT NULL )", end=<optimized out>, dest=0x7ffdfdb73a70 "\240ݨ\001", size=194) at /home/vagrant/Ma xScale/server/modules/routing/avrorouter/rpl.cc:1140
    1140 /home/vagrant/MaxScale/server/modules/routing/avrorouter/rpl.cc: No such file or directory.

Thread 3 (Thread 0x7fac1f30e700 (LWP 2627)):
#0 0x00007fac24261e2d in nanosleep () from /lib64/libc.so.6
#1 0x00007fac24292704 in usleep () from /lib64/libc.so.6
#2 0x00007fac269f18b4 in sleep_for<long, std::ratio<1l, 1000l> > (__rtime=...) at /usr/include/c++/4.8.2/thread:281
#3 run (this=0x1a6b540) at /home/vagrant/MaxScale/server/core/housekeeper.cc:170
#4 hkthread (res=<optimized out>) at /home/vagrant/MaxScale/server/core/housekeeper.cc:297
#5 0x00007fac252f6070 in ?? () from /lib64/libstdc++.so.6
#6 0x00007fac262badd5 in start_thread () from /lib64/libpthread.so.0
#7 0x00007fac2429aead in clone () from /lib64/libc.so.6

Thread 2 (Thread 0x7fac1eb0d700 (LWP 2628)):
#0 0x00007fac2429b483 in epoll_wait () from /lib64/libc.so.6
#1 0x00007fac26aecb3a in MHD_epoll (daemon=daemon@entry=0x1a92b60, may_block=may_block@entry=1) at daemon.c:4267
#2 0x00007fac26aee012 in MHD_select_thread (cls=0x1a92b60) at daemon.c:4544
#3 0x00007fac262badd5 in start_thread () from /lib64/libpthread.so.0
#4 0x00007fac2429aead in clone () from /lib64/libc.so.6

Thread 1 (Thread 0x7fac26f68080 (LWP 2626)):
#0 read_table_identifier (db=0x7ffdfdb73a00 "a", sql=0x1a8a8ef "(`a` int(11) DEFAULT NULL, `b` int(11) DEFAULT NULL )", end=<optimized out>, dest=0x7ffdfdb73a70 "\240ݨ\001", size=194) at /home/vagran t/MaxScale/server/modules/routing/avrorouter/rpl.cc:1140
#1 0x00007fac2019dcc8 in Rpl::handle_query_event (this=this@entry=0x1a8de00, hdr=hdr@entry=0x7ffdfdb73bd0, ptr=<optimized out>) at /home/vagrant/MaxScale/server/modules/routing/avrorouter/avro_rbr.cc:9 15
#2 0x00007fac2019e31f in Rpl::handle_event (this=this@entry=0x1a8de00, hdr=..., ptr=<optimized out>) at /home/vagrant/MaxScale/server/modules/routing/avrorouter/avro_rbr.cc:999
#3 0x00007fac201a023c in avro_read_all_events (router=0x1a8dda0) at /home/vagrant/MaxScale/server/modules/routing/avrorouter/avro_file.cc:609
#4 0x00007fac203fbf68 in converter_func (action=<optimized out>, router=0x1a8dda0) at /home/vagrant/MaxScale/server/modules/routing/avrorouter/avro_main.cc:277
#5 0x00007fac26a47bc6 in call (action=maxbase::Worker::Call::EXECUTE, this=0x1a9bfc0) at /home/vagrant/MaxScale/maxutils/maxbase/include/maxbase/worker.hh:772
#6 maxbase::Worker::tick (this=0x1a6cd70) at /home/vagrant/MaxScale/maxutils/maxbase/src/worker.cc:909
#7 0x00007fac26a46366 in maxbase::WorkerTimer::handle (this=0x1a6cbe0, pWorker=<optimized out>, events=<optimized out>) at /home/vagrant/MaxScale/maxutils/maxbase/src/worker.cc:253
#8 0x00007fac26a46d65 in maxbase::Worker::poll_waitevents (this=this@entry=0x1a6cd70) at /home/vagrant/MaxScale/maxutils/maxbase/src/worker.cc:842
#9 0x00007fac26a46f61 in maxbase::Worker::run (this=0x1a6cd70, pSem=pSem@entry=0x0) at /home/vagrant/MaxScale/maxutils/maxbase/src/worker.cc:541
#10 0x00000000004087f9 in run (this=<optimized out>) at /home/vagrant/MaxScale/maxutils/maxbase/include/maxbase/worker.hh:409
#11 main (argc=<optimized out>, argv=<optimized out>) at /home/vagrant/MaxScale/server/core/gateway.cc:2257

Comment by markus makela [ 2019-01-11 ]

Can you provide the SQL that reproduces this problem? I guess it might be something in the SQL processing that gets caught up.

Comment by Zdravelina Sokolovska (Inactive) [ 2019-01-14 ]

last command on adapter side was :
#mxs_adapter -c /etc/Columnstore.xml -u cdcuser -p cdcpassword -h 127.0.0.1 -P 4001 -r 2 -d -n -f stream-table-list
]# cat stream-table-list
testA t03
testA t04

[root@localhost ~]# mysqlbinlog /var/lib/maxscale/mariadb-bin.000001 | grep t3
CREATE TABLE `t3` (
TsEbXBcBAAAAKgAAACAkAAAAABUAAAAAAAEAAv/8AwAAABoAAACt30aa
#Q> insert into testA.t3 values(3,1)
#181220 18:38:21 server id 1  end_log_pos 15527 CRC32 0x90a5d42b        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,2)
#181220 18:38:21 server id 1  end_log_pos 15744 CRC32 0xa758dc33        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,3)
#181220 18:38:21 server id 1  end_log_pos 15961 CRC32 0x5fe86c8f        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,4)
#181220 18:38:21 server id 1  end_log_pos 16178 CRC32 0xb92100ff        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,5)
#181220 18:38:21 server id 1  end_log_pos 16395 CRC32 0x5620da76        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,6)
#181220 18:38:21 server id 1  end_log_pos 16612 CRC32 0x13ee0f90        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,7)
#181220 18:38:21 server id 1  end_log_pos 16829 CRC32 0x1cd2e1f6        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,8)
#181220 18:38:21 server id 1  end_log_pos 17046 CRC32 0x24d5c987        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,9)
#181220 18:38:21 server id 1  end_log_pos 17263 CRC32 0xfbb2b377        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,10)
#181220 18:38:21 server id 1  end_log_pos 17481 CRC32 0x614e88fe        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,11)
#181220 18:38:21 server id 1  end_log_pos 17699 CRC32 0xbbe70786        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,12)
#181220 18:38:21 server id 1  end_log_pos 17917 CRC32 0x537d756e        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,13)
#181220 18:38:21 server id 1  end_log_pos 18135 CRC32 0x571abe17        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,14)
#181220 18:38:21 server id 1  end_log_pos 18353 CRC32 0x4446a34e        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,15)
#181220 18:38:21 server id 1  end_log_pos 18571 CRC32 0xc97ff346        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,16)
#181220 18:38:21 server id 1  end_log_pos 18789 CRC32 0xd3d61c8c        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,17)
#181220 18:38:21 server id 1  end_log_pos 19007 CRC32 0x5e4465ba        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,18)
#181220 18:38:21 server id 1  end_log_pos 19225 CRC32 0x55d98eaa        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,19)
#181220 18:38:21 server id 1  end_log_pos 19443 CRC32 0xddf43464        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,20)
#181220 18:38:21 server id 1  end_log_pos 19661 CRC32 0x0f922dee        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,21)
#181220 18:38:21 server id 1  end_log_pos 19879 CRC32 0xd53ba296        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,22)
#181220 18:38:21 server id 1  end_log_pos 20097 CRC32 0x18a9fbce        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,23)
#181220 18:38:21 server id 1  end_log_pos 20315 CRC32 0x62b7dc22        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,24)
#181220 18:38:21 server id 1  end_log_pos 20533 CRC32 0xf0e84744        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,25)
#181220 18:38:21 server id 1  end_log_pos 20751 CRC32 0x426c0277        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,26)
#181220 18:38:21 server id 1  end_log_pos 20969 CRC32 0x03b42a98        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,27)
#181220 18:38:21 server id 1  end_log_pos 21187 CRC32 0x07d3e1e1        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,28)
#181220 18:38:21 server id 1  end_log_pos 21405 CRC32 0xbdcda6bf        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,29)
#181220 18:38:21 server id 1  end_log_pos 21623 CRC32 0xc78615cc        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,30)
#181220 18:38:21 server id 1  end_log_pos 21841 CRC32 0xcc1bfedc        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,31)
#181220 18:38:21 server id 1  end_log_pos 22059 CRC32 0xa051ffee        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,32)
#181220 18:38:21 server id 1  end_log_pos 22277 CRC32 0x93ba0aff        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,33)
#181220 18:38:21 server id 1  end_log_pos 22495 CRC32 0x8aa3f437        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,34)
#181220 18:38:21 server id 1  end_log_pos 22713 CRC32 0xa642fc55        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,35)
#181220 18:38:21 server id 1  end_log_pos 22931 CRC32 0x642a8564        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,36)
#181220 18:38:21 server id 1  end_log_pos 23149 CRC32 0xc860e4e4        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,37)
#181220 18:38:21 server id 1  end_log_pos 23367 CRC32 0x0a089dd5        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,38)
#181220 18:38:21 server id 1  end_log_pos 23585 CRC32 0x88355015        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,39)
#181220 18:38:21 server id 1  end_log_pos 23803 CRC32 0x912caedd        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,40)
#181220 18:38:21 server id 1  end_log_pos 24021 CRC32 0xa2c75bcc        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,41)
#181220 18:38:21 server id 1  end_log_pos 24239 CRC32 0xce8d5afe        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,42)
#181220 18:38:21 server id 1  end_log_pos 24457 CRC32 0xc510b1ee        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,43)
#181220 18:38:21 server id 1  end_log_pos 24675 CRC32 0x41af5671        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,44)
#181220 18:38:21 server id 1  end_log_pos 24893 CRC32 0xfbb1112f        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,45)
#181220 18:38:21 server id 1  end_log_pos 25111 CRC32 0xffd6da56        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,46)
#181220 18:38:21 server id 1  end_log_pos 25329 CRC32 0xbe0ef2b9        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,47)
#181220 18:38:21 server id 1  end_log_pos 25547 CRC32 0x0c8ab78a        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,48)
#181220 18:38:21 server id 1  end_log_pos 25765 CRC32 0xb6c1644b        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,49)
#181220 18:38:21 server id 1  end_log_pos 25983 CRC32 0xccdf43a7        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,50)
#181220 18:38:21 server id 1  end_log_pos 26201 CRC32 0x014d1aff        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,51)
#181220 18:38:21 server id 1  end_log_pos 26419 CRC32 0xdbe49587        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,52)
#181220 18:38:21 server id 1  end_log_pos 26637 CRC32 0xa75e49af        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,53)
#181220 18:38:21 server id 1  end_log_pos 26855 CRC32 0x2f73f361        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,54)
#181220 18:38:21 server id 1  end_log_pos 27073 CRC32 0x24ee1871        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,55)
#181220 18:38:21 server id 1  end_log_pos 27291 CRC32 0xa97c6147        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,56)
#181220 18:38:21 server id 1  end_log_pos 27509 CRC32 0xb3d58e8d        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,57)
#181220 18:38:21 server id 1  end_log_pos 27727 CRC32 0x90301b27        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,58)
#181220 18:38:21 server id 1  end_log_pos 27945 CRC32 0x836c067e        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,59)
#181220 18:38:21 server id 1  end_log_pos 28163 CRC32 0x870bcd07        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,60)
#181220 18:38:21 server id 1  end_log_pos 28381 CRC32 0x6f91bfef        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,61)
#181220 18:38:21 server id 1  end_log_pos 28599 CRC32 0xb5383097        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,62)
#181220 18:38:21 server id 1  end_log_pos 28817 CRC32 0x07d043b9        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,63)
#181220 18:38:21 server id 1  end_log_pos 29035 CRC32 0x9c161c51        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,64)
#181220 18:38:21 server id 1  end_log_pos 29253 CRC32 0x69f25b08        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,65)
#181220 18:38:21 server id 1  end_log_pos 29471 CRC32 0x226f9076        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,66)
#181220 18:38:21 server id 1  end_log_pos 29689 CRC32 0x63b7b899        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,67)
#181220 18:38:21 server id 1  end_log_pos 29907 CRC32 0x30be1131        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,68)
#181220 18:38:21 server id 1  end_log_pos 30125 CRC32 0x6b782e6b        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,69)
#181220 18:38:21 server id 1  end_log_pos 30343 CRC32 0x6f1fe512        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,70)
#181220 18:38:21 server id 1  end_log_pos 30561 CRC32 0x4dc014d9        Table_map: `testA`.`t3` mapped to number 22
fcUbXBcBAAAAKgAAAIt3AAAAABYAAAAAAAEAAv/8AwAAAEYAAAAb2p2b
#Q> insert into testA.t3 values(3,71)
#181220 18:38:21 server id 1  end_log_pos 30779 CRC32 0x39e0ca9c        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,72)
#181220 18:38:21 server id 1  end_log_pos 30997 CRC32 0x0a0b3f8d        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,73)
#181220 18:38:21 server id 1  end_log_pos 31215 CRC32 0xf2cab941        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,74)
#181220 18:38:21 server id 1  end_log_pos 31433 CRC32 0x3f58e019        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,75)
#181220 18:38:21 server id 1  end_log_pos 31651 CRC32 0xe5f16f61        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,76)
#181220 18:38:21 server id 1  end_log_pos 31869 CRC32 0xff0d1434        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,77)
#181220 18:38:21 server id 1  end_log_pos 32087 CRC32 0x3d656d05        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,78)
#181220 18:38:21 server id 1  end_log_pos 32305 CRC32 0xe836c214        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,79)
#181220 18:38:21 server id 1  end_log_pos 32523 CRC32 0x5ab28727        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,80)
#181220 18:38:21 server id 1  end_log_pos 32741 CRC32 0x231cb1c9        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,81)
#181220 18:38:21 server id 1  end_log_pos 32959 CRC32 0x9cc7bdbb        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,82)
#181220 18:38:21 server id 1  end_log_pos 33177 CRC32 0x975a56ab        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,83)
#181220 18:38:21 server id 1  end_log_pos 33395 CRC32 0xba7f8709        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,84)
#181220 18:38:21 server id 1  end_log_pos 33613 CRC32 0xf9784e1a        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,85)
#181220 18:38:21 server id 1  end_log_pos 33831 CRC32 0xb2b011fb        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,86)
#181220 18:38:21 server id 1  end_log_pos 34049 CRC32 0xb92dfaeb        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,87)
#181220 18:38:21 server id 1  end_log_pos 34267 CRC32 0xa0340423        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,88)
#181220 18:38:21 server id 1  end_log_pos 34485 CRC32 0x4d11b533        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,89)
#181220 18:38:22 server id 1  end_log_pos 34703 CRC32 0x36a1eb0d        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,90)
#181220 18:38:22 server id 1  end_log_pos 34921 CRC32 0x2bc30ffd        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,91)
#181220 18:38:22 server id 1  end_log_pos 35139 CRC32 0xe9ab76cc        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,92)
#181220 18:38:22 server id 1  end_log_pos 35357 CRC32 0x95ba83da        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,93)
#181220 18:38:22 server id 1  end_log_pos 35575 CRC32 0x1d973914        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,94)
#181220 18:38:22 server id 1  end_log_pos 35793 CRC32 0x160ad204        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,95)
#181220 18:38:22 server id 1  end_log_pos 36011 CRC32 0x2d2eb1e7        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,96)
 
attached also maridb binary  from the maxscale connector side
#181220 18:38:22 server id 1  end_log_pos 36229 CRC32 0x1ec544f6        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,97)
#181220 18:38:22 server id 1  end_log_pos 36447 CRC32 0xa2d4d152        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,98)
#181220 18:38:22 server id 1  end_log_pos 36665 CRC32 0xb188cc0b        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,99)
#181220 18:38:22 server id 1  end_log_pos 36883 CRC32 0xca952d04        Table_map: `testA`.`t3` mapped to number 22
#Q> insert into testA.t3 values(3,100)
#181220 18:38:22 server id 1  end_log_pos 37102 CRC32 0x877602f0        Table_map: `testA`.`t3` mapped to number 22
DROP TABLE `testA`.`t3` /* generated by server */
CREATE TABLE `t3` (   `b` int(11) DEFAULT NULL,   `c` int(11) DEFAULT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
DROP TABLE `t3` /* generated by server */
CREATE TABLE `t3` (   `c` int(11) DEFAULT NULL,   `d` int(11) DEFAULT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
DROP TABLE `t3` /* generated by server */
CREATE TABLE `t3` (   `b` int(11) DEFAULT NULL,   `c` int(11) DEFAULT NULL ) ENGINE=InnoDB DEFAULT CHARSET=latin1
truncate table  testA.t3
truncate table  testA.t3
create table testA.t5 like testA.t3
create table testA.t7 like testA.t3
create table t02 like t3
Uj8uXBMBAAAAOgAAAATKAQAAAGwAAAAAAAEABm15dGVzdAAIanNvbnRlc3QAAwMP/AMsAQIHFOt3
MSwyXX19GwB7ImtleTEiOnsiYSI6MSwgImIiOlsxLDJdfX1eVWt3
[root@localhost ~]# cat stream-table-list
testA   t03
testA   t04
[root@localhost ~]# mysqlbinlog /var/lib/maxscale/mariadb-bin.000001 | grep t4
fcUbXBMBAAAALwAAADt4AAAAABYAAAAAAAEABXRlc3RBAAJ0MwACAwMAA5zK4Dk=
create table testA.t4 like testA.t2
#Q> insert into testA.t4 values(1,1)
#181220 19:25:27 server id 1  end_log_pos 42477 CRC32 0x73df3ba9        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(1,2)
#181220 19:25:27 server id 1  end_log_pos 42694 CRC32 0x4bd813d8        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(1,3)
#181220 19:25:27 server id 1  end_log_pos 42911 CRC32 0x44e4fdbe        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(1,4)
#181220 19:25:27 server id 1  end_log_pos 43128 CRC32 0x65e6fa46        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(1,5)
#181220 19:25:27 server id 1  end_log_pos 43345 CRC32 0xe32fa66f        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(1,6)
#181220 19:25:27 server id 1  end_log_pos 43562 CRC32 0xb3054455        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(1,7)
#181220 19:25:27 server id 1  end_log_pos 43779 CRC32 0x35cc187c        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(1,8)
#181220 19:25:27 server id 1  end_log_pos 43996 CRC32 0xe136899c        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(1,9)
#181220 19:25:27 server id 1  end_log_pos 44213 CRC32 0xee5ff365        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(1,10)
#181220 19:25:27 server id 1  end_log_pos 44431 CRC32 0x5cdbb656        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(1,11)
#181220 19:25:27 server id 1  end_log_pos 44649 CRC32 0xb80bf5d5        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(2,11)
#181220 19:29:25 server id 1  end_log_pos 44867 CRC32 0xe54d4d8b        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(2,12)
#181220 19:29:25 server id 1  end_log_pos 45085 CRC32 0xe62692eb        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(2,13)
#181220 19:29:25 server id 1  end_log_pos 45303 CRC32 0x6e0b2825        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(2,14)
#181220 19:29:25 server id 1  end_log_pos 45521 CRC32 0x6596c335        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(3,101)
#181220 19:32:49 server id 1  end_log_pos 45740 CRC32 0x66a1b5fa        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(3,102)
#181220 19:32:49 server id 1  end_log_pos 45959 CRC32 0x98a92fc3        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(3,103)
#181220 19:32:49 server id 1  end_log_pos 46178 CRC32 0x6fb62b89        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(3,104)
#181220 19:32:49 server id 1  end_log_pos 46397 CRC32 0xe9c88fdf        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(3,105)
#181220 19:32:49 server id 1  end_log_pos 46616 CRC32 0x60fbf39f        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(3,106)
#181220 19:32:49 server id 1  end_log_pos 46835 CRC32 0xd4b6aa59        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(3,107)
#181220 19:32:49 server id 1  end_log_pos 47054 CRC32 0xd3104652        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(3,108)
#181220 19:32:49 server id 1  end_log_pos 47273 CRC32 0xc391ad38        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(3,109)
#181220 19:32:49 server id 1  end_log_pos 47492 CRC32 0xb4db7d31        Table_map: `testA`.`t4` mapped to number 34
#Q> insert into testA.t4 values(3,110)
#181220 19:32:49 server id 1  end_log_pos 47711 CRC32 0x34aa0b9d        Table_map: `testA`.`t4` mapped to number 34
XD8uXBMBAAAAOgAAACPeAQAAAHwAAAAAAAEABm15dGVzdAAIanNvbnRlc3QAAwMP/AMsAQIH7t4M

attached also maridb binary from maxscale connector side

Comment by markus makela [ 2019-06-24 ]

Can you try this with the latest maxscale and mxs_adapter?

Comment by markus makela [ 2019-07-02 ]

winstone any updates?

Comment by Zdravelina Sokolovska (Inactive) [ 2019-07-08 ]

markus makela, dleeyh is probably now testing data steaming with columnstore ?

Comment by markus makela [ 2019-07-08 ]

dleeyh Any idea if this is still relevant?

Comment by markus makela [ 2019-09-23 ]

Closing this until we can confirm that it is a problem with the latest releases.

Generated at Thu Feb 08 04:12:47 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.