[MXS-1323] Maxscale2.1.3 coredump Created: 2017-07-24  Updated: 2017-08-16  Resolved: 2017-07-27

Status: Closed
Project: MariaDB MaxScale
Component/s: mariadbbackend, readwritesplit
Affects Version/s: 2.1.3
Fix Version/s: 2.1.5

Type: Bug Priority: Critical
Reporter: make Yuan Assignee: markus makela
Resolution: Fixed Votes: 0
Labels: coredump
Environment:

CentOS release 6.7 (Final)
kernel:
Linux sz-4PG5S62-143.233.juanpi.com 2.6.32-573.22.1.el6.x86_64 #1 SMP Wed Mar 23 03:35:39 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux

Sprint: 2017-38

 Description   

[ part of configure]
..............................
[server1]
type=server
address=192.168.143.233
port=3310
protocol=MySQLBackend
persistpoolmax=120
persistmaxtime=1000
serv_weight=2

[server2]
type=server
address=192.168.143.233
port=3309
protocol=MySQLBackend
serv_weight=1
persistpoolmax=120
persistmaxtime=1000
...............................

when I test Persistent Connections
github.com doc
************************************************
Starting with the 2.1 version of MariaDB MaxScale, when a MySQL protocol persistent connection is taken from the persistent connection pool, the state of the MySQL session will be reset when the the connection is used for the first time. This allows persistent connections to be used with no functional limitations and makes them behave like normal MySQL connections.
*************************************************

eg:
mysql -u juanpi -pxx -h127.0.0.1 -P 4006 test -e "select * from a1 limit 1"
mysql -u juanpi -pxx -h127.0.0.1 -P 4006 make -e "select * from student limit 1"
mysql -u juanpi -pxx -h127.0.0.1 -P 4006 test -e "select * from a1 limit 1" – will blocking until coredump

gdb with coredump file:

(gdb) thread apply all bt
 
 
 
Thread 35 (Thread 0x7f9dc97fb700 (LWP 6352)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x11) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 34 (Thread 0x7f9dacdfa700 (LWP 6359)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x18) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 33 (Thread 0x7f9dfebfd700 (LWP 6338)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x3) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 32 (Thread 0x7f9dcbfff700 (LWP 6348)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0xd) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 31 (Thread 0x7f9dfffff700 (LWP 6336)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x1) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 30 (Thread 0x7f9d93fff700 (LWP 6360)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x19) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 29 (Thread 0x7f9dcabfd700 (LWP 6350)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
---Type <return> to continue, or q <return> to quit---
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0xf) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 28 (Thread 0x7f9daffff700 (LWP 6354)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x13) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 27 (Thread 0x7f9dff5fe700 (LWP 6337)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x2) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 26 (Thread 0x7f9dc8dfa700 (LWP 6353)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x12) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 25 (Thread 0x7f9d935fe700 (LWP 6361)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x1a) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 24 (Thread 0x7f9de21fc700 (LWP 6345)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0xa) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 23 (Thread 0x7f9dfe1fc700 (LWP 6339)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x4) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
---Type <return> to continue, or q <return> to quit---
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 22 (Thread 0x7f9dae1fc700 (LWP 6357)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x16) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 21 (Thread 0x7f9dcb5fe700 (LWP 6349)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0xe) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 20 (Thread 0x7f9dfd7fb700 (LWP 6340)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x5) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 19 (Thread 0x7f9dca1fc700 (LWP 6351)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x10) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 18 (Thread 0x7f9de17fb700 (LWP 6346)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0xb) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 17 (Thread 0x7f9de0dfa700 (LWP 6347)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0xc) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 16 (Thread 0x7f9daebfd700 (LWP 6356)):
 
---Type <return> to continue, or q <return> to quit---
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x15) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 15 (Thread 0x7f9e05e5a700 (LWP 6333)):
 
#0  0x0000003933c0f00d in nanosleep () from /lib64/libpthread.so.0
 
#1  0x00007f9e08a4686e in thread_millisleep (ms=<value optimized out>) at /home/vagrant/workspace/server/core/thread.c:69
 
#2  0x00007f9e077b2f86 in monitorMain (arg=<value optimized out>) at /home/vagrant/workspace/server/modules/monitor/mysqlmon/mysql_mon.c:1085
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 14 (Thread 0x7f9daf5fe700 (LWP 6355)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x14) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 13 (Thread 0x7f9e089dba00 (LWP 6331)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004079fc in main (argc=<value optimized out>, argv=<value optimized out>) at /home/vagrant/workspace/server/core/gateway.cc:2035
 
 
 
Thread 12 (Thread 0x7f9d92bfd700 (LWP 6362)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x1b) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 11 (Thread 0x7f9de35fe700 (LWP 6343)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x8) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 10 (Thread 0x7f9de2bfd700 (LWP 6344)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x9) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
---Type <return> to continue, or q <return> to quit---
 
 
 
Thread 9 (Thread 0x7f9e05459700 (LWP 6334)):
 
#0  0x0000003933c0f00d in nanosleep () from /lib64/libpthread.so.0
 
#1  0x0000000000403f4f in log_flush_cb (arg=<value optimized out>) at /home/vagrant/workspace/server/core/gateway.cc:2157
 
#2  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#3  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 8 (Thread 0x7f9d90dfa700 (LWP 6365)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x1e) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 7 (Thread 0x7f9d917fb700 (LWP 6364)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x1d) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 6 (Thread 0x7f9e04a58700 (LWP 6335)):
 
#0  0x0000003933c0f00d in nanosleep () from /lib64/libpthread.so.0
 
#1  0x00007f9e08a4686e in thread_millisleep (ms=<value optimized out>) at /home/vagrant/workspace/server/core/thread.c:69
 
#2  0x00007f9e08a3259e in hkthread (data=<value optimized out>) at /home/vagrant/workspace/server/core/housekeeper.c:269
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 5 (Thread 0x7f9de3fff700 (LWP 6342)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x7) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 4 (Thread 0x7f9dfcdfa700 (LWP 6341)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x6) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 3 (Thread 0x7f9dad7fb700 (LWP 6358)):
 
#0  0x00000039330e90a3 in epoll_wait () from /lib64/libc.so.6
 
#1  0x00007f9e08a3d83b in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:709
 
---Type <return> to continue, or q <return> to quit---
 
#2  0x00000000004046f8 in worker_thread_main (arg=0x17) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 2 (Thread 0x7f9e089d8700 (LWP 6332)):
 
#0  0x0000003933c0b68c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
 
#1  0x00007f9e08a48a31 in skygw_message_wait (mes=0x1416f20) at /home/vagrant/workspace/server/core/skygw_utils.cc:792
 
#2  0x00007f9e08a36449 in thr_filewriter_fun (data=0x141b4a0) at /home/vagrant/workspace/server/core/log_manager.cc:2326
 
#3  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#4  0x00000039330e8aad in clone () from /lib64/libc.so.6
 
 
 
Thread 1 (Thread 0x7f9d921fc700 (LWP 6363)):
 
#0  0x00007f9e08a23422 in atomic_add (variable=0x8, value=-1) at /home/vagrant/workspace/server/core/atomic.c:22
 
#1  0x00007f9e08a239c9 in gwbuf_free_one (buf=0x7f9d7c011b10) at /home/vagrant/workspace/server/core/buffer.c:257
 
#2  0x00007f9e08a23cd9 in gwbuf_free (buf=<value optimized out>) at /home/vagrant/workspace/server/core/buffer.c:241
 
#3  0x00007f9e07bbedf2 in handle_error_new_connection (instance=0x146baf0, router_session=0x7f9d7c0128b0, errmsgbuf=0x7f9d7c022b10, problem_dcb=0x7f9d7c022790, 
    action=<value optimized out>, succp=0x7f9d921f8b9f) at /home/vagrant/workspace/server/modules/routing/readwritesplit/readwritesplit.c:1555
 
#4  handleError (instance=0x146baf0, router_session=0x7f9d7c0128b0, errmsgbuf=0x7f9d7c022b10, problem_dcb=0x7f9d7c022790, action=<value optimized out>, succp=0x7f9d921f8b9f)
 
    at /home/vagrant/workspace/server/modules/routing/readwritesplit/readwritesplit.c:1365
 
#5  0x00007f9e071a3bd0 in gw_backend_hangup (dcb=0x7f9d7c022790) at /home/vagrant/workspace/server/modules/protocol/MySQL/MySQLBackend/mysql_backend.c:1208
 
#6  0x00007f9e08a3d5a0 in process_pollq (thread_id=28, event=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:1069
 
#7  0x00007f9e08a3da4d in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:799
 
#8  0x00000000004046f8 in worker_thread_main (arg=0x1c) at /home/vagrant/workspace/server/core/gateway.cc:985
 
#9  0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
 
#10 0x00000039330e8aad in clone () from /lib64/libc.so.6
 
(gdb)



 Comments   
Comment by markus makela [ 2017-07-24 ]

This appears to be in the part of the code that deals with the functionality of retry_failed_reads. Can you try adding retry_failed_reads=false to the service configuration? This will disable the retrying of failed reads and will send an error to the client instead.

Comment by make Yuan [ 2017-07-25 ]

Crash it again!!!
when I sysbench it ~
sysbench --mysql-ignore-errors=all --mysql-host=192.168.143.233 --mysql-port=4006 --mysql-user=max --time=60 --mysql-password=maxscale --threads=80 --skip_trx=on --db-driver=mysql --mysql-db=sbtest --db-ps-mode=disable /usr/share/sysbench/oltp_read_write.lua run

my maxscale.cnf:
**********************************
[RW test]
type=service
router=readwritesplit
servers=server1,server2
user=maxopt
passwd=06B65119699B323CEAC99134D694B4CE
max_slave_connections=100%
max_slave_replication_lag= 100
router_options=slave_selection_criteria=LEAST_ROUTER_CONNECTIONS
router_options=master_failure_mode=fail_on_write,retry_failed_reads=false
filters=Hint
**************************
Thread 1 (Thread 0x7f02e35fe700 (LWP 57735)):
#0 0x00007f02ec7b4422 in atomic_add (variable=0x48ffffb5e0e808f4, value=-1) at /home/vagrant/workspace/server/core/atomic.c:22
#1 0x00007f02ec7b49c9 in gwbuf_free_one (buf=0x7f02ec7b4cd9) at /home/vagrant/workspace/server/core/buffer.c:257
#2 0x00007f02ec7b4cd9 in gwbuf_free (buf=<value optimized out>) at /home/vagrant/workspace/server/core/buffer.c:241
--Type <return> to continue, or q <return> to quit--
#3 0x00007f02eb94fdf2 in handle_error_new_connection (instance=0xe24b80, router_session=0x7f02d4012ad0, errmsgbuf=0x7f02d403f610, problem_dcb=0x7f02d40301a0, action=<value optimized out>,
succp=0x7f02e35fab9f) at /home/vagrant/workspace/server/modules/routing/readwritesplit/readwritesplit.c:1555
#4 handleError (instance=0xe24b80, router_session=0x7f02d4012ad0, errmsgbuf=0x7f02d403f610, problem_dcb=0x7f02d40301a0, action=<value optimized out>, succp=0x7f02e35fab9f)
at /home/vagrant/workspace/server/modules/routing/readwritesplit/readwritesplit.c:1365
#5 0x00007f02eaf34bd0 in gw_backend_hangup (dcb=0x7f02d40301a0) at /home/vagrant/workspace/server/modules/protocol/MySQL/MySQLBackend/mysql_backend.c:1208
#6 0x00007f02ec7ce5a0 in process_pollq (thread_id=1, event=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:1069
#7 0x00007f02ec7cea4d in poll_waitevents (arg=<value optimized out>) at /home/vagrant/workspace/server/core/poll.c:799
#8 0x00000000004046f8 in worker_thread_main (arg=0x1) at /home/vagrant/workspace/server/core/gateway.cc:985
#9 0x0000003933c07aa1 in start_thread () from /lib64/libpthread.so.0
#10 0x00000039330e8aad in clone () from /lib64/libc.so.6g

Comment by markus makela [ 2017-07-25 ]

I've managed to reproduce this by executing SET @a = (SELECT SLEEP(1)) queries while blocking a slave server.

Comment by markus makela [ 2017-07-25 ]

We've built packages from commit f78332efbfd67617c4a7e0126a63286e83e702aa with a fix that should prevent the crash. You can find the packages here: http://max-tst-01.mariadb.com/ci-repository/fix-build-scripts-jul25/mariadb-maxscale/

If you can test and confirm that this fixes the problem, we'd be very grateful.

Comment by make Yuan [ 2017-07-25 ]

Got pkg Wrong ?
http://max-tst-01.mariadb.com/ci-repository/fix-build-scripts-jul25/mariadb-maxscale/centos/6Server/x86_64/

Try it!
mysql -u juanpi -pjuanpi -h127.0.0.1 -P 4007 make -e "select * from student limit 1"
Warning: Using a password on the command line interface can be insecure.
ERROR 2013 (HY000) at line 1: Lost connection to MySQL server during query

debug log
*******************
2017-07-25 16:36:25.046 error : [MySQLBackend] Invalid authentication message from backend 'server1'. Error code: 1045, Msg : #28000Access denied for user 'pi'@'192.168.143.233' (using password: YES)
2017-07-25 16:36:25.046 debug : 140317644809984 [poll_waitevents] EPOLLRDHUP on dcb 0x7f9e200127d0, fd 46. Errno 0, Success.
what's the pi?

Comment by markus makela [ 2017-07-25 ]

Does MaxScale crash anymore? If not, I think this is a new issue.

Please upload the MaxScale log and configuration files with all sensitive information removed.

I would also like to ask you to test it without the persistent connections. I suspect the problem might be there and verifying that by commenting out the persistent connection parameter would be very helpful.

Comment by make Yuan [ 2017-07-25 ]

Firstly ,I can't sysbench it, so No Crash it

***************my-maxscale.cnf***************

[maxscale]
 
threads=auto
 
auth_connect_timeout = 3
 
auth_read_timeout = 1
 
auth_write_timeout = 2
 
#<ms_timestamp = 0|1> 日志精确时间
 
ms_timestamp=1
 
logdir=/data/maxscale-fix/log
 
datadir=/data/maxscale-fix/data
 
cachedir=/data/maxscale-fix
 
piddir=/data/maxscale-fix
 
libdir=/usr/local/maxscale-2.1.3/lib/maxscale
 
 
 
[Filter]
 
type=filter
 
module=qlafilter
 
options=ignorecase,extended
 
filebase=/data/maxscale-fix/log/sqlQuery.log
 
source=192.168.143.233
 
match=select.*from.*
 
exclude=where.*
 
 
 
[Hint]
 
type=filter
 
module=hintfilter
 
 
 
[server1]
 
type=server
 
address=192.168.143.233
 
port=3310
 
protocol=MySQLBackend
 
persistpoolmax=6000
 
persistmaxtime=2
 
serv_weight=2
 
 
 
[server2]
 
type=server
 
address=192.168.143.233
 
port=3309
 
protocol=MySQLBackend
 
serv_weight=1
 
persistpoolmax=6000
 
persistmaxtime=2
 
 
 
[MySQL Monitor]
 
type=monitor
 
module=mysqlmon
 
servers=server1,server2
 
user=maxscale
 
passwd=xx
 
monitor_interval=2500
 
 
 
[LoadBlance Service]
 
type=service
 
router=readconnroute
 
servers=server2,server1
 
user=maxopt
 
passwd=xx
 
router_options=slave
 
#filters=DBfirewall
 
 
 
 
 
[RW test]
 
type=service
 
router=readwritesplit
 
servers=server1,server2
 
user=maxopt
 
passwd=06B65119699B323CEAC99134D694B4CE
 
max_slave_connections=100%
 
max_slave_replication_lag= 100
 
router_options=slave_selection_criteria=LEAST_ROUTER_CONNECTIONS
 
router_options=master_failure_mode=fail_on_write,retry_failed_reads=false
 
filters=Hint
 
 
 
[MaxAdmin Service]
 
type=service
 
router=cli
 
 
 
[Read-Only Listener]
 
type=listener
 
service=LoadBlance Service
 
address=0.0.0.0  
protocol=MySQLClient
 
port=4009
 
 
 
[Read-Write Listener]
 
type=listener
 
service=RW test
 
address=0.0.0.0 
protocol=MySQLClient
 
port=4007
 
 
 
[MaxAdmin Listener]
 
type=listener
 
service=MaxAdmin Service
 
protocol=maxscaled
 
socket=default

****************************maxscale log ***********************

MariaDB MaxScale  /data/maxscale-fix/log/maxscale.log  Tue Jul 25 16:33:39 2017
 
---------------------------------------------------------------------------------
 
2017-07-25 16:33:39   notice : Working directory: /data/maxscale-fix/log
 
2017-07-25 16:33:39   notice : MariaDB MaxScale 2.1.4 started
 
2017-07-25 16:33:39   notice : MaxScale is running in process 62068
 
2017-07-25 16:33:39   notice : Commit: f78332efbfd67617c4a7e0126a63286e83e702aa
 
2017-07-25 16:33:39   notice : Configuration file: /usr/local/maxscale-2.1.4/etc/maxscale.cnf
 
2017-07-25 16:33:39   notice : Log directory: /data/maxscale-fix/log
 
2017-07-25 16:33:39   notice : Data directory: /data/maxscale-fix/data
 
2017-07-25 16:33:39   notice : Module directory: /usr/local/maxscale-2.1.3/lib/maxscale
 
2017-07-25 16:33:39   notice : Service cache: /data/maxscale-fix
 
2017-07-25 16:33:39   notice : Loading /usr/local/maxscale-2.1.4/etc/maxscale.cnf.
 
2017-07-25 16:33:39.045   notice : highprecision logging is enabled.
 
2017-07-25 16:33:39.045   notice : /usr/local/maxscale-2.1.4/etc/maxscale.cnf.d does not exist, not reading.
 
2017-07-25 16:33:39.046   notice : [cli] Initialise CLI router module
 
2017-07-25 16:33:39.049   notice : Loaded module cli: V1.0.0 from /usr/local/maxscale-2.1.3/lib/maxscale/libcli.so
 
2017-07-25 16:33:39.050   notice : [readwritesplit] Initializing statement-based read/write split router module.
 
2017-07-25 16:33:39.050   notice : Loaded module readwritesplit: V1.1.0 from /usr/local/maxscale-2.1.3/lib/maxscale/libreadwritesplit.so
 
2017-07-25 16:33:39.050   notice : [readconnroute] Initialise readconnroute router module.
 
2017-07-25 16:33:39.050   notice : Loaded module readconnroute: V1.1.0 from /usr/local/maxscale-2.1.3/lib/maxscale/libreadconnroute.so
 
2017-07-25 16:33:39.050   notice : [mysqlmon] Initialise the MySQL Monitor module.
 
2017-07-25 16:33:39.050   notice : Loaded module mysqlmon: V1.5.0 from /usr/local/maxscale-2.1.3/lib/maxscale/libmysqlmon.so
 
2017-07-25 16:33:39.050   notice : Loaded module hintfilter: V1.0.0 from /usr/local/maxscale-2.1.3/lib/maxscale/libhintfilter.so
 
2017-07-25 16:33:39.050   notice : Loaded module qlafilter: V1.1.1 from /usr/local/maxscale-2.1.3/lib/maxscale/libqlafilter.so
 
2017-07-25 16:33:39.051   notice : Loaded module MySQLBackend: V2.0.0 from /usr/local/maxscale-2.1.3/lib/maxscale/libMySQLBackend.so
 
2017-07-25 16:33:39.051   notice : Loaded module MySQLBackendAuth: V1.0.0 from /usr/local/maxscale-2.1.3/lib/maxscale/libMySQLBackendAuth.so
 
2017-07-25 16:33:39.051   notice : Loaded module maxscaled: V2.0.0 from /usr/local/maxscale-2.1.3/lib/maxscale/libmaxscaled.so
 
2017-07-25 16:33:39.051   notice : Loaded module MaxAdminAuth: V2.1.0 from /usr/local/maxscale-2.1.3/lib/maxscale/libMaxAdminAuth.so
 
2017-07-25 16:33:39.051   notice : Loaded module MySQLClient: V1.1.0 from /usr/local/maxscale-2.1.3/lib/maxscale/libMySQLClient.so
 
2017-07-25 16:33:39.052   notice : Loaded module MySQLAuth: V1.1.0 from /usr/local/maxscale-2.1.3/lib/maxscale/libMySQLAuth.so
 
2017-07-25 16:33:39.052   notice : No query classifier specified, using default 'qc_sqlite'.
 
2017-07-25 16:33:39.052   notice : Loaded module qc_sqlite: V1.0.0 from /usr/local/maxscale-2.1.3/lib/maxscale/libqc_sqlite.so
 
2017-07-25 16:33:39.058   notice : Using encrypted passwords. Encryption key: '/data/maxscale-fix/data/.secrets'.
 
2017-07-25 16:33:39.159   notice : Server changed state: server1[192.168.143.233:3310]: new_slave. [Running] -> [Slave, Running]
 
2017-07-25 16:33:39.159   notice : Server changed state: server2[192.168.143.233:3309]: new_master. [Running] -> [Master, Running]
 
2017-07-25 16:33:39.160   notice : [mysqlmon] A Master Server is now available: 192.168.143.233:3309
 
2017-07-25 16:33:41.759   notice : [MySQLAuth] [LoadBlance Service] Loaded 56 MySQL users for listener Read-Only Listener.
 
2017-07-25 16:33:41.759   notice : Listening for connections at [0.0.0.0]:4009 with protocol MySQL
 
2017-07-25 16:33:41.759   warning: [readwritesplit] Router options for readwritesplit are deprecated.
 
2017-07-25 16:33:44.686   notice : [MySQLAuth] [RW test] Loaded 56 MySQL users for listener Read-Write Listener.
 
2017-07-25 16:33:44.687   notice : Listening for connections at [0.0.0.0]:4007 with protocol MySQL
 
2017-07-25 16:33:44.687   notice : Listening for connections at [/tmp/maxadmin.sock]:0 with protocol MaxScale Admin
 
2017-07-25 16:33:44.687   notice : Started MaxScale log flusher.
 
2017-07-25 16:33:44.865   notice : MaxScale started with 31 server threads.
 
2017-07-25 16:34:17.172   error  : [MySQLBackend] Invalid authentication message from backend 'server2'. Error code: 1045, Msg : #28000Access denied for user 'pi'@'192.168.143.233' (using password: YES)
 
2017-07-25 16:34:18.902   notice : [MySQLAuth] [RW test] Loaded 56 MySQL users for listener Read-Write Listener.
 
2017-07-25 16:34:18.909   error  : [MySQLBackend] Invalid authentication message from backend 'server1'. Error code: 1045, Msg : #28000Access denied for user 'pi'@'192.168.143.233' (using password: YES)
 
2017-07-25 16:35:16.637   notice : maxlog logging is enabled.
 
2017-07-25 16:35:28.340   notice : syslog logging is enabled.
 
2017-07-25 16:35:38.719   notice : The logging of debug messages has been enabled.
 
2017-07-25 16:35:38.726   debug  : 140317655299840 [dcb_write] Append to writequeue. 178 writes buffered for dcb 0x7f9dac011b10 in state DCB_STATE_POLLING fd 4
 
2017-07-25 16:35:38.726   debug  : 140317655299840 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:35:38.726   debug  : 140317655299840 [poll_waitevents] event 4 dcb 0x7f9dac011b10 role DCB_ROLE_CLIENT_HANDLER
 
2017-07-25 16:35:39.910   debug  : 140317655299840 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:35:39.910   debug  : 140317655299840 [poll_waitevents] event 8213 dcb 0x7f9dac011b10 role DCB_ROLE_CLIENT_HANDLER
 
2017-07-25 16:35:39.910   debug  : 140317655299840 [poll_waitevents] Read in dcb 0x7f9dac011b10 fd 4
 
2017-07-25 16:35:39.910   debug  : 140317655299840 [poll_waitevents] EPOLLHUP on dcb 0x7f9dac011b10, fd 4. Errno 0, Success.
 
2017-07-25 16:35:39.910   debug  : 140317655299840 [poll_waitevents] EPOLLRDHUP on dcb 0x7f9dac011b10, fd 4. Errno 0, Success.
 
2017-07-25 16:35:39.910   debug  : 140317655299840 [dcb_process_victim_queue] Closed socket -1 on dcb 0x7f9dac011b10.
 
2017-07-25 16:36:23.755   debug  : 140315621054208 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.755   debug  : 140315631544064 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.755   debug  : 140315621054208 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.755   debug  : 140316101306112 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.755   debug  : 140316111795968 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.755   debug  : 140316059346688 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.755   debug  : 140316581558016 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140316069836544 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140315642033920 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140316529108736 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140316539598592 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140316090816256 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140316984211200 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140317602850560 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140317623830272 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140316080326400 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140316963231488 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140317644809984 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140316973721344 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140316550088448 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140317634320128 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140315631544064 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140317740504832 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140317613340416 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140315642033920 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316571068160 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140316931761920 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140316963231488 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316942251776 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140317840718336 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140316581558016 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140317761484544 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140316560578304 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140316952741632 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140317623830272 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316571068160 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316571068160 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140316942251776 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316571068160 [gw_MySQLAccept] Accepted fd 4.
 
2017-07-25 16:36:23.756   debug  : 140316539598592 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316539598592 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140316571068160 [dcb_write] Append to writequeue. 1 writes buffered for dcb 0x7f9df0011b10 in state DCB_STATE_ALLOC fd 4
 
2017-07-25 16:36:23.756   debug  : 140316571068160 [poll_add_dcb] Added dcb 0x7f9df0011b10 in state DCB_STATE_POLLING to poll set.
 
2017-07-25 16:36:23.756   debug  : 140316111795968 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316111795968 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140316090816256 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316090816256 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140317602850560 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140317602850560 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140316080326400 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316080326400 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140316984211200 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316984211200 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140317644809984 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140317644809984 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140316101306112 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316101306112 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140317644809984 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.756   debug  : 140317644809984 [poll_waitevents] event 5 dcb 0x7f9df0011b10 role DCB_ROLE_CLIENT_HANDLER
 
2017-07-25 16:36:23.756   debug  : 140317740504832 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140317644809984 [poll_waitevents] Read in dcb 0x7f9df0011b10 fd 4
 
2017-07-25 16:36:23.756   debug  : 140317740504832 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140317644809984 [dcb_read] Read 91 bytes from dcb 0x7f9df0011b10 in state DCB_STATE_POLLING fd 4.
 
2017-07-25 16:36:23.756   debug  : 140316973721344 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316059346688 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316059346688 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140315631544064 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140317613340416 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140317613340416 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140316931761920 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316931761920 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140317840718336 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140317840718336 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140316529108736 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316529108736 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140316581558016 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140317761484544 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316952741632 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.756   debug  : 140316952741632 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.756   debug  : 140317623830272 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.761   debug  : 140316560578304 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.761   debug  : 140315621054208 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.761   debug  : 140316560578304 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.761   debug  : 140316069836544 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.761   debug  : 140316942251776 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.761   debug  : 140316973721344 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.761   debug  : 140317634320128 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.761   debug  : 140316069836544 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.761   debug  : 140315642033920 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.761   debug  : 140317634320128 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.761   debug  : 140316550088448 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.761   debug  : 140316550088448 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.761   debug  : 140317644809984 [dcb_connect] Failed to find a reusable persistent connection. 
2017-07-25 16:36:23.761   debug  : 140317655299840 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.761   debug  : 140317644809984 [dcb_connect] Connected to server [192.168.143.233]:3309, from backend dcb 0x7f9e20011f90, client dcp 0x7f9df0011b10 fd 4.
 
2017-07-25 16:36:23.761   debug  : 140317655299840 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.761   debug  : 140317644809984 [poll_add_dcb] Added dcb 0x7f9e20011f90 in state DCB_STATE_POLLING to poll set.
 
2017-07-25 16:36:23.761   debug  : 140317644809984 [dcb_connect] Looking for persistent connection DCB user juanpi protocol MySQLBackend 
2017-07-25 16:36:23.761   debug  : 140317644809984 [dcb_connect] Failed to find a reusable persistent connection. 
2017-07-25 16:36:23.761   debug  : 140317644809984 [dcb_connect] Connected to server [192.168.143.233]:3310, from backend dcb 0x7f9e200127d0, client dcp 0x7f9df0011b10 fd 4.
 
2017-07-25 16:36:23.761   debug  : 140317644809984 [poll_add_dcb] Added dcb 0x7f9e200127d0 in state DCB_STATE_POLLING to poll set.
 
2017-07-25 16:36:23.761   debug  : 140317644809984 [dcb_write] Append to writequeue. 2 writes buffered for dcb 0x7f9df0011b10 in state DCB_STATE_POLLING fd 4
 
2017-07-25 16:36:23.761   debug  : 140317644809984 [poll_waitevents] epoll_wait found 2 fds
 
2017-07-25 16:36:23.761   debug  : 140317644809984 [poll_waitevents] event 4 dcb 0x7f9e20011f90 role DCB_ROLE_BACKEND_HANDLER
 
2017-07-25 16:36:23.761   debug  : 140317644809984 [poll_waitevents] event 4 dcb 0x7f9e200127d0 role DCB_ROLE_BACKEND_HANDLER
 
2017-07-25 16:36:23.761   debug  : 140317644809984 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.761   debug  : 140317644809984 [poll_waitevents] event 5 dcb 0x7f9e20011f90 role DCB_ROLE_BACKEND_HANDLER
 
2017-07-25 16:36:23.761   debug  : 140317644809984 [poll_waitevents] Read in dcb 0x7f9e20011f90 fd 45
 
2017-07-25 16:36:23.761   debug  : 140317644809984 [dcb_read] Read 87 bytes from dcb 0x7f9e20011f90 in state DCB_STATE_POLLING fd 45.
 
2017-07-25 16:36:23.767   debug  : 140317750994688 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.767   debug  : 140317750994688 [poll_waitevents] event 1 dcb 0x1a04060 role DCB_ROLE_SERVICE_LISTENER
 
2017-07-25 16:36:23.767   debug  : 140317750994688 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.771   debug  : 140317644809984 [dcb_write] Append to writequeue. 1 writes buffered for dcb 0x7f9e20011f90 in state DCB_STATE_POLLING fd 45
 
2017-07-25 16:36:23.771   debug  : 140317644809984 [poll_waitevents] epoll_wait found 2 fds
 
2017-07-25 16:36:23.771   debug  : 140317644809984 [poll_waitevents] event 5 dcb 0x7f9df0011b10 role DCB_ROLE_CLIENT_HANDLER
 
2017-07-25 16:36:23.771   debug  : 140317644809984 [poll_waitevents] Read in dcb 0x7f9df0011b10 fd 4
 
2017-07-25 16:36:23.771   debug  : 140317644809984 [dcb_read] Read 37 bytes from dcb 0x7f9df0011b10 in state DCB_STATE_POLLING fd 4.
 
2017-07-25 16:36:23.771   debug  : 140317644809984 [poll_waitevents] event 5 dcb 0x7f9e200127d0 role DCB_ROLE_BACKEND_HANDLER
 
2017-07-25 16:36:23.771   debug  : 140317644809984 [poll_waitevents] Read in dcb 0x7f9e200127d0 fd 46
 
2017-07-25 16:36:23.771   debug  : 140317644809984 [dcb_read] Read 87 bytes from dcb 0x7f9e200127d0 in state DCB_STATE_POLLING fd 46.
 
2017-07-25 16:36:23.771   debug  : 140317644809984 [dcb_write] Append to writequeue. 1 writes buffered for dcb 0x7f9e200127d0 in state DCB_STATE_POLLING fd 46
 
2017-07-25 16:36:23.771   debug  : 140317644809984 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:23.771   debug  : 140317644809984 [poll_waitevents] event 8197 dcb 0x7f9e20011f90 role DCB_ROLE_BACKEND_HANDLER
 
2017-07-25 16:36:23.771   debug  : 140317644809984 [poll_waitevents] Read in dcb 0x7f9e20011f90 fd 45
 
2017-07-25 16:36:23.771   debug  : 140317644809984 [dcb_read] Read 80 bytes from dcb 0x7f9e20011f90 in state DCB_STATE_POLLING fd 45.
 
2017-07-25 16:36:23.771   error  : [MySQLBackend] Invalid authentication message from backend 'server2'. Error code: 1045, Msg : #28000Access denied for user 'pi'@'192.168.143.233' (using password: YES)
 
2017-07-25 16:36:23.761   debug  : 140317761484544 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.761   debug  : 140316963231488 [poll_waitevents] Accept in fd 43
 
2017-07-25 16:36:23.761   debug  : 140317644809984 [dcb_connect] Looking for persistent connection DCB user juanpi protocol MySQLBackend 
2017-07-25 16:36:23.761   debug  : 140317655299840 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:25.046   notice : [MySQLAuth] [RW test] Loaded 56 MySQL users for listener Read-Write Listener.
 
2017-07-25 16:36:25.046   debug  : 140317644809984 [dcb_write] Append to writequeue. 3 writes buffered for dcb 0x7f9df0011b10 in state DCB_STATE_POLLING fd 4
 
2017-07-25 16:36:25.046   debug  : 140317644809984 [poll_waitevents] EPOLLRDHUP on dcb 0x7f9e20011f90, fd 45. Errno 0, Success.
 
2017-07-25 16:36:25.046   debug  : 140317644809984 [dcb_maybe_add_persistent] Not adding DCB 0x7f9e20011f90 to persistent pool, user juanpi, max for pool 6000, error handle called true, hung flag true, server status 3, pool count 0. 
2017-07-25 16:36:25.046   debug  : 140317644809984 [poll_waitevents] epoll_wait found 1 fds
 
2017-07-25 16:36:25.046   debug  : 140317644809984 [poll_waitevents] event 8197 dcb 0x7f9e200127d0 role DCB_ROLE_BACKEND_HANDLER
 
2017-07-25 16:36:25.046   debug  : 140317644809984 [poll_waitevents] Read in dcb 0x7f9e200127d0 fd 46
 
2017-07-25 16:36:25.046   debug  : 140317644809984 [dcb_read] Read 80 bytes from dcb 0x7f9e200127d0 in state DCB_STATE_POLLING fd 46.
 
2017-07-25 16:36:25.046   error  : [MySQLBackend] Invalid authentication message from backend 'server1'. Error code: 1045, Msg : #28000Access denied for user 'pi'@'192.168.143.233' (using password: YES)
 
2017-07-25 16:36:25.046   debug  : 140317644809984 [poll_waitevents] EPOLLRDHUP on dcb 0x7f9e200127d0, fd 46. Errno 0, Success.
 
2017-07-25 16:36:25.046   debug  : 140317644809984 [dcb_maybe_add_persistent] Not adding DCB 0x7f9e200127d0 to persistent pool, user juanpi, max for pool 6000, error handle called true, hung flag true, server status 8197, pool count 0. 
2017-07-25 16:36:25.046   debug  : 140317644809984 [dcb_process_victim_queue] Closed socket -1 on dcb 0x7f9e20011f90.
 
2017-07-25 16:36:25.046   debug  : 140317644809984 [dcb_process_victim_queue] Closed socket -1 on dcb 0x7f9df0011b10.
 
2017-07-25 16:36:25.046   debug  : 140317644809984 [dcb_process_victim_queue] Closed socket -1 on dcb 0x7f9e200127d0.

Comment by markus makela [ 2017-07-25 ]

I would recommend that you enable the info log level and disable the debug log level. This way all authentication related information is shown in the log file. You can enable the info log level by adding log_info=true under the maxscale section.

There should be no changes to any of the authentication related code between 2.1.3 and the packages we built so it should work. The only change was the change of the default SQL_MODE for internal connections in MaxScale. Downgrading to 2.1.3 and testing if it works would prove that something is wrong with the current 2.1 code that breaks authentication for you.

Comment by make Yuan [ 2017-07-25 ]

mysql -u juanpi -pjuanpi -h127.0.0.1 -P 4007 make -e "select * from student limit 1"
Warning: Using a password on the command line interface can be insecure.
ERROR 2013 (HY000) at line 1: Lost connection to MySQL server during query

*************info log ******************************

2017-07-25 18:23:19.641 info : [readwritesplit] > Autocommit: [enabled], trx is [not open], cmd: (0x03) MYSQL_COM_QUERY, type: QUERY_TYPE_READ|QUERY_TYPE_SYSVAR_READ, stmt: select @@version_comment limit 1
2017-07-25 18:23:19.641 info : [readwritesplit] Route query to slave [192.168.143.233]:3310 <
2017-07-25 18:23:19.648 error : [MySQLBackend] Invalid authentication message from backend 'server1'. Error code: 1045, Msg : #28000Access denied for user 'pi'@'192.168.143.233' (using password: YES)
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('dbbackup', 'localhost', NULL, 0, 'D58EA70993D5E50D1E3EBE77CB3E0F8B60CF460D')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('juanpi', '%', 'js_order', 1, '87424BDC9D43F9CDEB974CB3D3A15B14DBE4EEAD')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('js_xiudang', '%', 'js_cart', 1, '372A84F05AA66FC73637E4371C59B13861F3E19E')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('js_xiudang', '%', 'js_logs', 1, '372A84F05AA66FC73637E4371C59B13861F3E19E')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('js_xiudang', '%', 'js_order', 1, '372A84F05AA66FC73637E4371C59B13861F3E19E')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('js_xiudang', '%', 'js_report_manage', 1, '372A84F05AA66FC73637E4371C59B13861F3E19E')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('js_xiudang', '%', 'js_xiudang', 1, '372A84F05AA66FC73637E4371C59B13861F3E19E')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('js_xiudang', '%', 'js_member', 1, '372A84F05AA66FC73637E4371C59B13861F3E19E')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('js_xiudang', '%', 'js_sample', 1, '372A84F05AA66FC73637E4371C59B13861F3E19E')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('js_xiudang', '%', 'js_sku', 1, '372A84F05AA66FC73637E4371C59B13861F3E19E')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('js_xiudang', '%', 'rp_juanpi', 1, '372A84F05AA66FC73637E4371C59B13861F3E19E')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('dbajuanpi', '%', NULL, 1, 'CCB3DD38FA822362C715D3CBDC48876C0A3590D0')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('zabbix', '%', 'zabbix', 0, 'DEEF4D7D88CD046ECA02A80393B7780A63E7E789')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('replic', '%', NULL, 1, 'EF01EAA70195CDB1D997B6FB40CE300E7D6810AA')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('test', '192.168.143.233', NULL, 0, '676243218923905CF94CB52A3C9D3EB30CE8E20D')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('solr_test', '%', 'js_order', 0, '999A62E53B56123D5EB0CA65279B694A741807C1')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('packagist', '%', 'packagist', 0, '932173058EBFC6CBDD96E8E29F373F775839F9BE')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('mysync', '%', NULL, 0, '04C7F5153E5A8E8AFF512D6EB0815B61A0151AB2')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('xiean', '%', NULL, 1, '8D12568D65FE0D1FFFF93E8290F56B3F107D69AB')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('jp_b2b_test', '%', 'jp_b2b', 0, '1B484BD3D629F82430439DE75C5B42B24E3655A3')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('world_test', '%', 'jp_world', 0, '51360214AD8D701A27F29BB6666980591D4AFECD')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('yida', '%', NULL, 1, '5609EC13769B48D0502D0948932C4641D41B3291')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('im_mycat_test', '%', 'js_im', 0, 'ADB39D6E5AF3078A151E6C53E129917E225BF58E')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('szxiean', '%', 'xatest', 1, 'A8085989716A140A18203CAB4DA08E2BEBD6EDE7')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('repl', '%', NULL, 0, 'A424E797037BF97C19A2E88CF7891C5C2038C039')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('autodb', '%', 'no_dba', 0, 'A2226CB73DA6F7B82D6A67352BE1E9294BCBC29E')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('dmp_dev', '%', 'dmp', 0, '7DB20ECA801FA1024D154B1AB1F2C833CAAB4CB2')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('test_11', '%', NULL, 0, 'FD571203974BA9AFE270FE62151AE967ECA5E0AA')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('test_22', '%', 'test', 0, 'FD571203974BA9AFE270FE62151AE967ECA5E0AA')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('mpm', '%', NULL, 1, NULL)
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('db_auto', '%', 'db_automation', 0, 'B3D89DE1BB8073C2BBFCD11A35523D0E60CD37DF')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('confluence', '%', 'confluence', 0, 'C6EA735C38C4CB54DF9D2EB170B2EC314DF751BB')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('make', '127.0.0.1', NULL, 1, '9CE968FFCB0A8CFD9AE9AD890EB68340BE6C940E')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('maxscale', '192.%', 'mysql', 0, '53E5D0C7885BD540911663B04133F20C94AD4306')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('maxopt', '192.%', NULL, 1, '53E5D0C7885BD540911663B04133F20C94AD4306')
2017-07-25 18:23:19.687 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('repl', '192.%', NULL, 0, 'A424E797037BF97C19A2E88CF7891C5C2038C039')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('maxopt', '192.168.%', 'mysql', 0, '6443D2F688DDE2940589D641035C0FB7DCBFB8B3')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('maxscale', '192.168.%', NULL, 0, '53E5D0C7885BD540911663B04133F20C94AD4306')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('max', '192.%', NULL, 1, '53E5D0C7885BD540911663B04133F20C94AD4306')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('juanpi', '%', NULL, 1, '87424BDC9D43F9CDEB974CB3D3A15B14DBE4EEAD')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('js_xiudang', '%', NULL, 1, '372A84F05AA66FC73637E4371C59B13861F3E19E')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('zabbix', '%', NULL, 0, 'DEEF4D7D88CD046ECA02A80393B7780A63E7E789')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('solr_test', '%', NULL, 0, '999A62E53B56123D5EB0CA65279B694A741807C1')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('packagist', '%', NULL, 0, '932173058EBFC6CBDD96E8E29F373F775839F9BE')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('jp_b2b_test', '%', NULL, 0, '1B484BD3D629F82430439DE75C5B42B24E3655A3')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('world_test', '%', NULL, 0, '51360214AD8D701A27F29BB6666980591D4AFECD')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('im_mycat_test', '%', NULL, 0, 'ADB39D6E5AF3078A151E6C53E129917E225BF58E')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('szxiean', '%', NULL, 1, 'A8085989716A140A18203CAB4DA08E2BEBD6EDE7')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('autodb', '%', NULL, 0, 'A2226CB73DA6F7B82D6A67352BE1E9294BCBC29E')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('dmp_dev', '%', NULL, 0, '7DB20ECA801FA1024D154B1AB1F2C833CAAB4CB2')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('test_11', '%', 'test', 0, 'FD571203974BA9AFE270FE62151AE967ECA5E0AA')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('test_11', '%', 'wandou', 0, 'FD571203974BA9AFE270FE62151AE967ECA5E0AA')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('test_22', '%', NULL, 0, 'FD571203974BA9AFE270FE62151AE967ECA5E0AA')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('db_auto', '%', NULL, 0, 'B3D89DE1BB8073C2BBFCD11A35523D0E60CD37DF')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('confluence', '%', NULL, 0, 'C6EA735C38C4CB54DF9D2EB170B2EC314DF751BB')
2017-07-25 18:23:19.688 info : [MySQLAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('maxscale', '192.%', NULL, 0, '53E5D0C7885BD540911663B04133F20C94AD4306')
2017-07-25 18:23:21.349 notice : [MySQLAuth] [RW test] Loaded 56 MySQL users for listener Read-Write Listener.
2017-07-25 18:23:21.349 error : [MySQLBackend] Invalid authentication message from backend 'server2'. Error code: 1045, Msg : #28000Access denied for user 'pi'@'192.168.143.233' (using password: YES)
2017-07-25 18:23:21.349 info : Stopped RW test client session [4]

Comment by markus makela [ 2017-07-27 ]

The authentication error seems to be related to a different problem. I'll close this bug as fixed in 2.1.5 and if the same problem persists even in 2.1.5, you can reopen this bug or create a new one.

Also if you could try to upgrade to 2.1.4 and see if the authentication problems occur. If they do, please open a bug request so we can get it fixed ASAP.

Generated at Thu Feb 08 04:05:52 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.