[MXS-2609] Maxscale crash in RWSplitSession::retry_master_query() Created: 2019-07-19  Updated: 2020-08-25  Resolved: 2019-08-13

Status: Closed
Project: MariaDB MaxScale
Component/s: readwritesplit
Affects Version/s: 2.3.9
Fix Version/s: 2.3.12

Type: Bug Priority: Major
Reporter: Hartmut Holzgraefe Assignee: markus makela
Resolution: Fixed Votes: 0
Labels: None

Sprint: MXS-SPRINT-87

 Description   

2019-07-19 03:15:06 notice : Server changed state: db1[62.218.60.193:3306]: lost_master. [Master, Synced, Running] -> [Running]
2019-07-19 03:15:06 notice : Server changed state: db2[62.218.60.194:3306]: new_master. [Slave, Synced, Running] -> [Master, Synced, Running]
*** Error in `/usr/bin/maxscale': double free or corruption (out): 0x00007f962c3b40c0 ***
======= Backtrace: =========
/lib64/libc.so.6(+0x81609)[0x7f9654636609]
/usr/lib64/maxscale/libreadwritesplit.so(_ZN14RWSplitSession18retry_master_queryERSt10shared_ptrIN8maxscale9RWBackendEE+0x81)[0x7f964c1a1e81]
/usr/lib64/maxscale/libreadwritesplit.so(_ZN14RWSplitSession11handleErrorEP5gwbufP3dcb12error_actionPb+0x627)[0x7f964c1a55a7]
/usr/lib64/maxscale/libreadwritesplit.so(_ZN8maxscale6RouterI7RWSplit14RWSplitSessionE11handleErrorEP10mxs_routerP18mxs_router_sessionP5gwbufP3dcb12error_actionPb+0x2a)[0x7f964c19fb8a]
/usr/lib64/maxscale/libmariadbbackend.so(+0x23d5)[0x7f964bb753d5]
/usr/lib64/maxscale/libmariadbbackend.so(+0x24e1)[0x7f964bb754e1]
/usr/lib64/maxscale/libmaxscale-common.so.1.0.0(+0x7a826)[0x7f9656e05826]
/usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN7maxbase12MessageQueue18handle_poll_eventsEPNS_6WorkerEj+0x11f)[0x7f9656e6770f]
/usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN7maxbase6Worker15poll_waiteventsEv+0x1b5)[0x7f9656e65215]
/usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN7maxbase6Worker3runEPNS_9SemaphoreE+0x51)[0x7f9656e65411]
/lib64/libstdc++.so.6(+0xb5070)[0x7f965570e070]
/lib64/libpthread.so.0(+0x7dd5)[0x7f96566d3dd5]
/lib64/libc.so.6(clone+0x6d)[0x7f96546b302d]
======= Memory map: ========
00400000-00412000 r-xp 00000000 fd:00 50344753 /usr/bin/maxscale
00611000-00612000 r--p 00011000 fd:00 50344753 /usr/bin/maxscale
00612000-00613000 rw-p 00012000 fd:00 50344753 /usr/bin/maxscale
00613000-00615000 rw-p 00000000 00:00 0
010b5000-010f7000 rw-p 00000000 00:00 0 [heap]
010f7000-03126000 rw-p 00000000 00:00 0 [heap]
7f9618000000-7f961844b000 rw-p 00000000 00:00 0
7f961844b000-7f961c000000 ---p 00000000 00:00 0
7f961c000000-7f961c021000 rw-p 00000000 00:00 0
7f961c021000-7f9620000000 ---p 00000000 00:00 0
7f9620000000-7f96204d9000 rw-p 00000000 00:00 0
7f96204d9000-7f9624000000 ---p 00000000 00:00 0
7f9624000000-7f9624415000 rw-p 00000000 00:00 0
7f9624415000-7f9628000000 ---p 00000000 00:00 0
7f9628000000-7f9628449000 rw-p 00000000 00:00 0
7f9628449000-7f962c000000 ---p 00000000 00:00 0
7f962c000000-7f962c4e5000 rw-p 00000000 00:00 0
7f962c4e5000-7f9630000000 ---p 00000000 00:00 0
7f96317fb000-7f96317fc000 ---p 00000000 00:00 0
7f96317fc000-7f9631ffc000 rw-p 00000000 00:00 0
7f9631ffc000-7f9631ffd000 ---p 00000000 00:00 0
7f9631ffd000-7f96327fd000 rw-p 00000000 00:00 0
7f96327fd000-7f96327fe000 ---p 00000000 00:00 0
7f96327fe000-7f9632ffe000 rw-p 00000000 00:00 0
7f9632ffe000-7f9632fff000 ---p 00000000 00:00 0
7f9632fff000-7f96337ff000 rw-p 00000000 00:00 0
7f96337ff000-7f9633800000 ---p 00000000 00:00 0
7f9633800000-7f9634000000 rw-p 00000000 00:00 0
7f9634000000-7f9634451000 rw-p 00000000 00:00 0
7f9634451000-7f9638000000 ---p 00000000 00:00 0
7f9638000000-7f9638468000 rw-p 00000000 00:00 0
7f9638468000-7f963c000000 ---p 00000000 00:00 0
7f963c000000-7f963c021000 rw-p 00000000 00:00 0
7f963c021000-7f9640000000 ---p 00000000 00:00 0
7f9640000000-7f9640021000 rw-p 00000000 00:00 0
7f9640021000-7f9644000000 ---p 00000000 00:00 0
7f9644000000-7f9644024000 rw-p 00000000 00:00 0
7f9644024000-7f9648000000 ---p 00000000 00:00 0
7f964855e000-7f964855f000 ---p 00000000 00:00 0
7f964855f000-7f9648d5f000 rw-p 00000000 00:00 0
7f9648d5f000-7f9648d60000 ---p 00000000 00:00 0
7f9648d60000-7f9649560000 rw-p 00000000 00:00 0
7f9649560000-7f9649561000 ---p 00000000 00:00 0
7f9649561000-7f9649d61000 rw-p 00000000 00:00 0
7f9649d61000-7f9649d62000 ---p 00000000 00:00 0
7f9649d62000-7f964a562000 rw-p 00000000 00:00 0
7f964a562000-7f964a563000 ---p 00000000 00:00 0
7f964a563000-7f964ad63000 rw-p 00000000 00:00 0
7f964ad63000-7f964ad64000 ---p 00000000 00:00 0
7f964ad64000-7f964b564000 rw-p 00000000 00:00 0
7f964b564000-7f964b565000 r-xp 00000000 fd:00 106171 /usr/lib64/maxscale/libmaxadminauth.so.1.0.0
7f964b565000-7f964b764000 ---p 00001000 fd:00 106171 /usr/lib64/maxscale/libmaxadminauth.so.1.0.0
7f964b764000-7f964b765000 r--p 00000000 fd:00 106171 /usr/lib64/maxscale/libmaxadminauth.so.1.0.0
7f964b765000-7f964b766000 rw-p 00001000 fd:00 106171 /usr/lib64/maxscale/libmaxadminauth.so.1.0.0
7f964b766000-7f964b767000 r-xp 00000000 fd:00 106192 /usr/lib64/maxscale/libmysqlbackendauth.so.1.0.0
7f964b767000-7f964b967000 ---p 00001000 fd:00 106192 /usr/lib64/maxscale/libmysqlbackendauth.so.1.0.0
7f964b967000-7f964b968000 r--p 00001000 fd:00 106192 /usr/lib64/maxscale/libmysqlbackendauth.so.1.0.0
7f964b968000-7f964b969000 rw-p 00002000 fd:00 106192 /usr/lib64/maxscale/libmysqlbackendauth.so.1.0.0
7f964b969000-7f964b972000 r-xp 00000000 fd:00 106190 /usr/lib64/maxscale/libmysqlauth.so.1.0.0
7f964b972000-7f964bb71000 ---p 00009000 fd:00 106190 /usr/lib64/maxscale/libmysqlauth.so.1.0.0
7f964bb71000-7f964bb72000 r--p 00008000 fd:00 106190 /usr/lib64/maxscale/libmysqlauth.so.1.0.0
7f964bb72000-7f964bb73000 rw-p 00009000 fd:00 106190 /usr/lib64/maxscale/libmysqlauth.so.1.0.0
7f964bb73000-7f964bb79000 r-xp 00000000 fd:00 106163 /usr/lib64/maxscale/libmariadbbackend.so.2.0.0
7f964bb79000-7f964bd78000 ---p 00006000 fd:00 106163 /usr/lib64/maxscale/libmariadbbackend.so.2.0.0
7f964bd78000-7f964bd79000 r--p 00005000 fd:00 106163 /usr/lib64/maxscale/libmariadbbackend.so.2.0.0
7f964bd79000-7f964bd7a000 rw-p 00006000 fd:00 106163 /usr/lib64/maxscale/libmariadbbackend.so.2.0.0
7f964bd7a000-7f964bd80000 r-xp 00000000 fd:00 91444 /usr/lib64/maxscale/libgaleramon.so.2.0.0
7f964bd80000-7f964bf80000 ---p 00006000 fd:00 91444 /usr/lib64/maxscale/libgaleramon.so.2.0.0
7f964bf80000-7f964bf81000 r--p 00006000 fd:00 91444 /usr/lib64/maxscale/libgaleramon.so.2.0.0
7f964bf81000-7f964bf82000 rw-p 00007000 fd:00 91444 /usr/lib64/maxscale/libgaleramon.so.2.0.0
7f964bf82000-7f964bf8d000 r-xp 00000000 fd:00 106199 /usr/lib64/maxscale/libnamedserverfilter.so.1.1.0
7f964bf8d000-7f964c18c000 ---p 0000b000 fd:00 106199 /usr/lib64/maxscale/libnamedserverfilter.so.1.1.0
7f964c18c000-7f964c18d000 r--p 0000a000 fd:00 106199 /usr/lib64/maxscale/libnamedserverfilter.so.1.1.0
7f964c18d000-7f964c18e000 rw-p 0000b000 fd:00 106199 /usr/lib64/maxscale/libnamedserverfilter.so.1.1.0
7f964c18e000-7f964c1b9000 r-xp 00000000 fd:00 107787 /usr/lib64/maxscale/libreadwritesplit.so.1.0.2
7f964c1b9000-7f964c3b8000 ---p 0002b000 fd:00 107787 /usr/lib64/maxscale/libreadwritesplit.so.1.0.2
7f964c3b8000-7f964c3b9000 r--p 0002a000 fd:00 107787 /usr/lib64/maxscale/libreadwritesplit.so.1.0.2
7f964c3b9000-7f964c3bb000 rw-p 0002b000 fd:00 107787 /usr/lib64/maxscale/libreadwritesplit.so.1.0.2
7f964c3bb000-7f964c3bc000 rw-p 00000000 00:00 0
7f964c3bc000-7f964c3ca000 r-xp 00000000 fd:00 106195 /usr/lib64/maxscale/libmysqlcommon.so.2.0.0
7f964c3ca000-7f964c5ca000 ---p 0000e000 fd:00 106195 /usr/lib64/maxscale/libmysqlcommon.so.2.0.0
7f964c5ca000-7f964c5cb000 r--p 0000e000 fd:00 106195 /usr/lib64/maxscale/libmysqlcommon.so.2.0.0
7f964c5cb000-7f964c5cc000 rw-p 0000f000 fd:00 106195 /usr/lib64/maxscale/libmysqlcommon.so.2.0.0
7f964c5cc000-7f964c5d7000 r-xp 00000000 fd:00 106165 /usr/lib64/maxscale/libmariadbclient.so.1.0.0
7f964c5d7000-7f964c7d6000 ---p 0000b000 fd:00 106165 /usr/lib64/maxscale/libmariadbclient.so.1.0.0
7f964c7d6000-7f964c7d7000 r--p 0000a000 fd:00 106165 /usr/lib64/maxscale/libmariadbclient.so.1.0.0
7f964c7d7000-7f964c7d8000 rw-p 0000b000 fd:00 106165 /usr/lib64/maxscale/libmariadbclient.so.1.0.0
7f964c7d8000-7f964c7e6000 r-xp 00000000 fd:00 7830 /usr/lib64/maxscale/libcli.so.1.0.0
7f964c7e6000-7f964c9e6000 ---p 0000e000 fd:00 7830 /usr/lib64/maxscale/libcli.so.1.0.0
7f964c9e6000-7f964c9e7000 r--p 0000e000 fd:00 7830 /usr/lib64/maxscale/libcli.so.1.0.0
7f964c9e7000-7f964c9eb000 rw-p 0000f000 fd:00 7830 /usr/lib64/maxscale/libcli.so.1.0.0
7f964c9eb000-7f964c9ed000 r-xp 00000000 fd:00 106182 /usr/lib64/maxscale/libmaxscaled.so.1.0.0
7f964c9ed000-7f964cbed000 ---p 00002000 fd:00 106182 /usr/lib64/maxscale/libmaxscaled.so.1.0.0
7f964cbed000-7f964cbee000 r--p 00002000 fd:00 106182 /usr/lib64/maxscale/libmaxscaled.so.1.0.0
7f964cbee000-7f964cbef000 rw-p 00003000 fd:00 106182 /usr/lib64/maxscale/libmaxscaled.so.1.0.0
7f964cbef000-7f964cbf0000 ---p 00000000 00:00 0
7f964cbf0000-7f964d3f0000 rw-p 00000000 00:00 0
7f964d3f0000-7f964d3f1000 ---p 00000000 00:00 0
7f964d3f1000-7f964dbf1000 rw-p 00000000 00:00 0
7f964dbf1000-7f964dbf2000 ---p 00000000 00:00 0
7f964dbf2000-7f964e3f2000 rw-p 00000000 00:00 0
7f964e3f2000-7f964e3f3000 ---p 00000000 00:00 0
7f964e3f3000-7f964ebf3000 rw-p 00000000 00:00 0
7f964ebf3000-7f964ebf4000 ---p 00000000 00:00 0
7f964ebf4000-7f964f3f4000 rw-p 00000000 00:00 0
7f964f3f4000-7f964f3f5000 ---p 00000000 00:00 0
7f964f3f5000-7f964fbf5000 rw-p 00000000 00:00 0
7f964fbf5000-7f964fbf6000 ---p 00000000 00:00 0
7f964fbf6000-7f96503f6000 rw-p 00000000 00:00 0
7f96503f6000-7f96503f7000 ---p 00000000 00:00 0
7f96503f7000-7f9650bf7000 rw-p 00000000 00:00 0
7f9650bf7000-7f9650c9b000 r-xp 00000000 fd:00 3900 /usr/lib64/maxscale/libqc_sqlite.so.1.0.0
7f9650c9b000-7f9650e9b000 ---p 000a4000 fd:00 3900 /usr/lib64/maxscale/libqc_sqlite.so.1.0.0
7f9650e9b000-7f9650e9d000 r--p 000a4000 fd:00 3900 /usr/lib64/maxscale/libqc_sqlite.so.1.0.0
7f9650e9d000-7f9650ea1000 rw-p 000a6000 fd:00 3900 /usr/lib64/maxscale/libqc_sqlite.so.1.0.0
7f9650ea1000-7f9650ead000 r-xp 00000000 fd:00 99048 /usr/lib64/libnss_files-2.17.so
7f9650ead000-7f96510ac000 ---p 0000c000 fd:00 99048 /usr/lib64/libnss_files-2.17.so
7f96510ac000-7f96510ad000 r--p 0000b000 fd:00 99048 /usr/lib64/libnss_files-2.17.so
7f96510ad000-7f96510ae000 rw-p 0000c000 fd:00 99048 /usr/lib64/libnss_files-2.17.so
7f96510ae000-7f96510b4000 rw-p 00000000 00:00 0
7f96510b4000-7f96510bb000 r-xp 00000000 fd:00 1538 /usr/lib64/libffi.so.6.0.1
7f96510bb000-7f96512ba000 ---p 00007000 fd:00 1538 /usr/lib64/libffi.so.6.0.1
7f96512ba000-7f96512bb000 r--p 00006000 fd:00 1538 /usr/lib64/libffi.so.6.0.1
7f96512bb000-7f96512bc000 rw-p 00007000 fd:00 1538 /usr/lib64/libffi.so.6.0.1
7f96512bc000-7f96512bf000 r-xp 00000000 fd:00 1896 /usr/lib64/libkeyutils.so.1.5
7f96512bf000-7f96514be000 ---p 00003000 fd:00 1896 /usr/lib64/libkeyutils.so.1.5
7f96514be000-7f96514bf000 r--p 00002000 fd:00 1896 /usr/lib64/libkeyutils.so.1.5
7f96514bf000-7f96514c0000 rw-p 00003000 fd:00 1896 /usr/lib64/libkeyutils.so.1.5
7f96514c0000-7f96514ce000 r-xp 00000000 fd:00 1146 /usr/lib64/libkrb5support.so.0.1
7f96514ce000-7f96516ce000 ---p 0000e000 fd:00 1146 /usr/lib64/libkrb5support.so.0.1
7f96516ce000-7f96516cf000 r--p 0000e000 fd:00 1146 /usr/lib64/libkrb5support.so.0.1
7f96516cf000-7f96516d0000 rw-p 0000f000 fd:00 1146 /usr/lib64/libkrb5support.so.0.1
7f96516d0000-7f96516df000 r-xp 00000000 fd:00 1432 /usr/lib64/libbz2.so.1.0.6
7f96516df000-7f96518de000 ---p 0000f000 fd:00 1432 /usr/lib64/libbz2.so.1.0.6
7f96518de000-7f96518df000 r--p 0000e000 fd:00 1432 /usr/lib64/libbz2.so.1.0.6
7f96518df000-7f96518e0000 rw-p 0000f000 fd:00 1432 /usr/lib64/libbz2.so.1.0.6
7f96518e0000-7f96518f7000 r-xp 00000000 fd:00 2522 /usr/lib64/libelf-0.172.so
7f96518f7000-7f9651af6000 ---p 00017000 fd:00 2522 /usr/lib64/libelf-0.172.so
7f9651af6000-7f9651af7000 r--p 00016000 fd:00 2522 /usr/lib64/libelf-0.172.so
7f9651af7000-7f9651af8000 rw-p 00017000 fd:00 2522 /usr/lib64/libelf-0.172.so
7f9651af8000-7f9651b58000 r-xp 00000000 fd:00 1308 /usr/lib64/libpcre.so.1.2.0
7f9651b58000-7f9651d58000 ---p 00060000 fd:00 1308 /usr/lib64/libpcre.so.1.2.0
7f9651d58000-7f9651d59000 r--p 00060000 fd:00 1308 /usr/lib64/libpcre.so.1.2.0
7f9651d59000-7f9651d5a000 rw-p 00061000 fd:00 1308 /usr/lib64/libpcre.so.1.2.0
7f9651d5a000-7f9651d5e000 r-xp 00000000 fd:00 1555 /usr/lib64/libattr.so.1.1.0
7f9651d5e000-7f9651f5d000 ---p 00004000 fd:00 1555 /usr/lib64/libattr.so.1.1.0
7f9651f5d000-7f9651f5e000 r--p 00003000 fd:00 1555 /usr/lib64/libattr.so.1.1.0
7f9651f5e000-7f9651f5f000 rw-p 00004000 fd:00 1555 /usr/lib64/libattr.so.1.1.0
7f9651f5f000-7f9651fd5000 r-xp 00000000 fd:00 1586 /usr/lib64/libgmp.so.10.2.0
7f9651fd5000-7f96521d4000 ---p 00076000 fd:00 1586 /usr/lib64/libgmp.so.10.2.0
7f96521d4000-7f96521d6000 r--p 00075000 fd:00 1586 /usr/lib64/libgmp.so.10.2.0
7f96521d6000-7f96521d7000 rw-p 00077000 fd:00 1586 /usr/lib64/libgmp.so.10.2.0
7f96521d7000-7f96521fd000 r-xp 00000000 fd:00 2103 /usr/lib64/libhogweed.so.2.5
7f96521fd000-7f96523fc000 ---p 00026000 fd:00 2103 /usr/lib64/libhogweed.so.2.5
7f96523fc000-7f96523fd000 r--p 00025000 fd:00 2103 /usr/lib64/libhogweed.so.2.5
7f96523fd000-7f96523fe000 rw-p 00026000 fd:00 2103 /usr/lib64/libhogweed.so.2.5
7f96523fe000-7f965242d000 r-xp 00000000 fd:00 2105 /usr/lib64/libnettle.so.4.7
7f965242d000-7f965262d000 ---p 0002f000 fd:00 2105 /usr/lib64/libnettle.so.4.7
7f965262d000-7f965262e000 r--p 0002f000 fd:00 2105 /usr/lib64/libnettle.so.4.7
7f965262e000-7f965262f000 rw-p 00030000 fd:00 2105 /usr/lib64/libnettle.so.4.7
7f965262f000-7f9652640000 r-xp 00000000 fd:00 7805 /usr/lib64/libtasn1.so.6.5.3
7f9652640000-7f9652840000 ---p 00011000 fd:00 7805 /usr/lib64/libtasn1.so.6.5.3
7f9652840000-7f9652841000 r--p 00011000 fd:00 7805 /usr/lib64/libtasn1.so.6.5.3
7f9652841000-7f9652842000 rw-p 00012000 fd:00 7805 /usr/lib64/libtasn1.so.6.5.3
7f9652842000-7f965295c000 r-xp 00000000 fd:00 1601 /usr/lib64/libp11-kit.so.0.3.0
7f965295c000-7f9652b5c000 ---p 0011a000 fd:00 1601 /usr/lib64/libp11-kit.so.0.3.0
7f9652b5c000-7f9652b66000 r--p 0011a000 fd:00 1601 /usr/lib64/libp11-kit.so.0.3.0
7f9652b66000-7f9652b70000 rw-p 00124000 fd:00 1601 /usr/lib64/libp11-kit.so.0.3.0
7f9652b70000-7f9652b71000 rw-p 00000000 00:00 0
7f9652b71000-7f9652b73000 r-xp 00000000 fd:00 1231 /usr/lib64/libfreebl3.so
7f9652b73000-7f9652d72000 ---p 00002000 fd:00 1231 /usr/lib64/libfreebl3.so
7f9652d72000-7f9652d73000 r--p 00001000 fd:00 1231 /usr/lib64/libfreebl3.so
7f9652d73000-7f9652d74000 rw-p 00002000 fd:00 1231 /usr/lib64/libfreebl3.so
7f9652d74000-7f9652da5000 r-xp 00000000 fd:00 1138 /usr/lib64/libk5crypto.so.3.1
7f9652da5000-7f9652fa4000 ---p 00031000 fd:00 1138 /usr/lib64/libk5crypto.so.3.1
7f9652fa4000-7f9652fa6000 r--p 00030000 fd:00 1138 /usr/lib64/libk5crypto.so.3.1
7f9652fa6000-7f9652fa7000 rw-p 00032000 fd:00 1138 /usr/lib64/libk5crypto.so.3.1
7f9652fa7000-7f9652faa000 r-xp 00000000 fd:00 117028 /usr/lib64/libcom_err.so.2.1
7f9652faa000-7f96531a9000 ---p 00003000 fd:00 117028 /usr/lib64/libcom_err.so.2.1
7f96531a9000-7f96531aa000 r--p 00002000 fd:00 117028 /usr/lib64/libcom_err.so.2.1
7f96531aa000-7f96531ab000 rw-p 00003000 fd:00 117028 /usr/lib64/libcom_err.so.2.1
7f96531ab000-7f9653284000 r-xp 00000000 fd:00 1144 /usr/lib64/libkrb5.so.3.3
7f9653284000-7f9653483000 ---p 000d9000 fd:00 1144 /usr/lib64/libkrb5.so.3.3
7f9653483000-7f9653491000 r--p 000d8000 fd:00 1144 /usr/lib64/libkrb5.so.3.3
7f9653491000-7f9653494000 rw-p 000e6000 fd:00 1144 /usr/lib64/libkrb5.so.3.3
7f9653494000-7f96534de000 r-xp 00000000 fd:00 1134 /usr/lib64/libgssapi_krb5.so.2.2
7f96534de000-7f96536de000 ---p 0004a000 fd:00 1134 /usr/lib64/libgssapi_krb5.so.2.2
7f96536de000-7f96536df000 r--p 0004a000 fd:00 1134 /usr/lib64/libgssapi_krb5.so.2.2
7f96536df000-7f96536e1000 rw-p 0004b000 fd:00 1134 /usr/lib64/libgssapi_krb5.so.2.2
7f96536e1000-7f965372d000 r-xp 00000000 fd:00 83493 /usr/lib64/libdw-0.172.so
7f965372d000-7f965392d000 ---p 0004c000 fd:00 83493 /usr/lib64/libdw-0.172.so
7f965392d000-7f965392f000 r--p 0004c000 fd:00 83493 /usr/lib64/libdw-0.172.so
7f965392f000-7f9653930000 rw-p 0004e000 fd:00 83493 /usr/lib64/libdw-0.172.so
7f9653930000-7f9653946000 r-xp 00000000 fd:00 99058 /usr/lib64/libresolv-2.17.so
7f9653946000-7f9653b45000 ---p 00016000 fd:00 99058 /usr/lib64/libresolv-2.17.so
7f9653b45000-7f9653b46000 r--p 00015000 fd:00 99058 /usr/lib64/libresolv-2.17.so
7f9653b46000-7f9653b47000 rw-p 00016000 fd:00 99058 /usr/lib64/libresolv-2.17.so
7f9653b47000-7f9653b49000 rw-p 00000000 00:00 0
7f9653b49000-7f9653b4d000 r-xp 00000000 fd:00 1539 /usr/lib64/libgpg-error.so.0.10.0
7f9653b4d000-7f9653d4c000 ---p 00004000 fd:00 1539 /usr/lib64/libgpg-error.so.0.10.0
7f9653d4c000-7f9653d4d000 r--p 00003000 fd:00 1539 /usr/lib64/libgpg-error.so.0.10.0
7f9653d4d000-7f9653d4e000 rw-p 00004000 fd:00 1539 /usr/lib64/libgpg-error.so.0.10.0
7f9653d4e000-7f9653d62000 r-xp 00000000 fd:00 253864 /usr/lib64/liblz4.so.1.7.5
7f9653d62000-7f9653f61000 ---p 00014000 fd:00 253864 /usr/lib64/liblz4.so.1.7.5
7f9653f61000-7f9653f62000 r--p 00013000 fd:00 253864 /usr/lib64/liblz4.so.1.7.5
7f9653f62000-7f9653f63000 rw-p 00014000 fd:00 253864 /usr/lib64/liblz4.so.1.7.5
7f9653f63000-7f9653f88000 r-xp 00000000 fd:00 1300 /usr/lib64/liblzma.so.5.2.2
7f9653f88000-7f9654187000 ---p 00025000 fd:00 1300 /usr/lib64/liblzma.so.5.2.2
7f9654187000-7f9654188000 r--p 00024000 fd:00 1300 /usr/lib64/liblzma.so.5.2.2
7f9654188000-7f9654189000 rw-p 00025000 fd:00 1300 /usr/lib64/liblzma.so.5.2.2
7f9654189000-7f96541ad000 r-xp 00000000 fd:00 75284 /usr/lib64/libselinux.so.1
7f96541ad000-7f96543ac000 ---p 00024000 fd:00 75284 /usr/lib64/libselinux.so.1
7f96543ac000-7f96543ad000 r--p 00023000 fd:00 75284 /usr/lib64/libselinux.so.1
7f96543ad000-7f96543ae000 rw-p 00024000 fd:00 75284 /usr/lib64/libselinux.so.1
7f96543ae000-7f96543b0000 rw-p 00000000 00:00 0
7f96543b0000-7f96543b4000 r-xp 00000000 fd:00 1352 /usr/lib64/libcap.so.2.22
7f96543b4000-7f96545b3000 ---p 00004000 fd:00 1352 /usr/lib64/libcap.so.2.22
7f96545b3000-7f96545b4000 r--p 00003000 fd:00 1352 /usr/lib64/libcap.so.2.22
7f96545b4000-7f96545b5000 rw-p 00004000 fd:00 1352 /usr/lib64/libcap.so.2.22
7f96545b5000-7f9654777000 r-xp 00000000 fd:00 960 /usr/lib64/libc-2.17.so
7f9654777000-7f9654977000 ---p 001c2000 fd:00 960 /usr/lib64/libc-2.17.so
7f9654977000-7f965497b000 r--p 001c2000 fd:00 960 /usr/lib64/libc-2.17.so
7f965497b000-7f965497d000 rw-p 001c6000 fd:00 960 /usr/lib64/libc-2.17.so
7f965497d000-7f9654982000 rw-p 00000000 00:00 0
7f9654982000-7f9654997000 r-xp 00000000 fd:00 2382 /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f9654997000-7f9654b96000 ---p 00015000 fd:00 2382 /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f9654b96000-7f9654b97000 r--p 00014000 fd:00 2382 /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f9654b97000-7f9654b98000 rw-p 00015000 fd:00 2382 /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f9654b98000-7f9654c99000 r-xp 00000000 fd:00 41365 /usr/lib64/libm-2.17.so
7f9654c99000-7f9654e98000 ---p 00101000 fd:00 41365 /usr/lib64/libm-2.17.so
7f9654e98000-7f9654e99000 r--p 00100000 fd:00 41365 /usr/lib64/libm-2.17.so
7f9654e99000-7f9654e9a000 rw-p 00101000 fd:00 41365 /usr/lib64/libm-2.17.so
7f9654e9a000-7f9654e9c000 r-xp 00000000 fd:00 39905 /usr/lib64/libdl-2.17.so
7f9654e9c000-7f965509c000 ---p 00002000 fd:00 39905 /usr/lib64/libdl-2.17.so
7f965509c000-7f965509d000 r--p 00002000 fd:00 39905 /usr/lib64/libdl-2.17.so
7f965509d000-7f965509e000 rw-p 00003000 fd:00 39905 /usr/lib64/libdl-2.17.so
7f965509e000-7f965511b000 r-xp 00000000 fd:00 1495 /usr/lib64/libgcrypt.so.11.8.2
7f965511b000-7f965531a000 ---p 0007d000 fd:00 1495 /usr/lib64/libgcrypt.so.11.8.2
7f965531a000-7f965531b000 r--p 0007c000 fd:00 1495 /usr/lib64/libgcrypt.so.11.8.2
7f965531b000-7f965531e000 rw-p 0007d000 fd:00 1495 /usr/lib64/libgcrypt.so.11.8.2
7f965531e000-7f965531f000 rw-p 00000000 00:00 0
7f965531f000-7f965544d000 r-xp 00000000 fd:00 66334 /usr/lib64/libgnutls.so.28.43.3
7f965544d000-7f965564c000 ---p 0012e000 fd:00 66334 /usr/lib64/libgnutls.so.28.43.3
7f965564c000-7f9655656000 r--p 0012d000 fd:00 66334 /usr/lib64/libgnutls.so.28.43.3
7f9655656000-7f9655658000 rw-p 00137000 fd:00 66334 /usr/lib64/libgnutls.so.28.43.3
7f9655658000-7f9655659000 rw-p 00000000 00:00 0
7f9655659000-7f9655742000 r-xp 00000000 fd:00 1178 /usr/lib64/libstdc++.so.6.0.19
7f9655742000-7f9655941000 ---p 000e9000 fd:00 1178 /usr/lib64/libstdc++.so.6.0.19
7f9655941000-7f9655949000 r--p 000e8000 fd:00 1178 /usr/lib64/libstdc++.so.6.0.19
7f9655949000-7f965594b000 rw-p 000f0000 fd:00 1178 /usr/lib64/libstdc++.so.6.0.19
7f965594b000-7f9655960000 rw-p 00000000 00:00 0
7f9655960000-7f9655a11000 r-xp 00000000 fd:00 1637 /usr/lib64/libsqlite3.so.0.8.6
7f9655a11000-7f9655c10000 ---p 000b1000 fd:00 1637 /usr/lib64/libsqlite3.so.0.8.6
7f9655c10000-7f9655c12000 r--p 000b0000 fd:00 1637 /usr/lib64/libsqlite3.so.0.8.6
7f9655c12000-7f9655c15000 rw-p 000b2000 fd:00 1637 /usr/lib64/libsqlite3.so.0.8.6
7f9655c15000-7f9655c1c000 r-xp 00000000 fd:00 99060 /usr/lib64/librt-2.17.so
7f9655c1c000-7f9655e1b000 ---p 00007000 fd:00 99060 /usr/lib64/librt-2.17.so
7f9655e1b000-7f9655e1c000 r--p 00006000 fd:00 99060 /usr/lib64/librt-2.17.so
7f9655e1c000-7f9655e1d000 rw-p 00007000 fd:00 99060 /usr/lib64/librt-2.17.so
7f9655e1d000-7f9655e32000 r-xp 00000000 fd:00 1380 /usr/lib64/libz.so.1.2.7
7f9655e32000-7f9656031000 ---p 00015000 fd:00 1380 /usr/lib64/libz.so.1.2.7
7f9656031000-7f9656032000 r--p 00014000 fd:00 1380 /usr/lib64/libz.so.1.2.7
7f9656032000-7f9656033000 rw-p 00015000 fd:00 1380 /usr/lib64/libz.so.1.2.7
7f9656033000-7f9656268000 r-xp 00000000 fd:00 1153 /usr/lib64/libcrypto.so.1.0.2k
7f9656268000-7f9656468000 ---p 00235000 fd:00 1153 /usr/lib64/libcrypto.so.1.0.2k
7f9656468000-7f9656484000 r--p 00235000 fd:00 1153 /usr/lib64/libcrypto.so.1.0.2k
7f9656484000-7f9656491000 rw-p 00251000 fd:00 1153 /usr/lib64/libcrypto.so.1.0.2k
7f9656491000-7f9656495000 rw-p 00000000 00:00 0
7f9656495000-7f965649d000 r-xp 00000000 fd:00 964 /usr/lib64/libcrypt-2.17.so
7f965649d000-7f965669c000 ---p 00008000 fd:00 964 /usr/lib64/libcrypt-2.17.so
7f965669c000-7f965669d000 r--p 00007000 fd:00 964 /usr/lib64/libcrypt-2.17.so
7f965669d000-7f965669e000 rw-p 00008000 fd:00 964 /usr/lib64/libcrypt-2.17.so
7f965669e000-7f96566cc000 rw-p 00000000 00:00 0
7f96566cc000-7f96566e3000 r-xp 00000000 fd:00 99056 /usr/lib64/libpthread-2.17.so
7f96566e3000-7f96568e2000 ---p 00017000 fd:00 99056 /usr/lib64/libpthread-2.17.so
7f96568e2000-7f96568e3000 r--p 00016000 fd:00 99056 /usr/lib64/libpthread-2.17.so
7f96568e3000-7f96568e4000 rw-p 00017000 fd:00 99056 /usr/lib64/libpthread-2.17.so
7f96568e4000-7f96568e8000 rw-p 00000000 00:00 0
7f96568e8000-7f965694f000 r-xp 00000000 fd:00 1155 /usr/lib64/libssl.so.1.0.2k
7f965694f000-7f9656b4f000 ---p 00067000 fd:00 1155 /usr/lib64/libssl.so.1.0.2k
7f9656b4f000-7f9656b53000 r--p 00067000 fd:00 1155 /usr/lib64/libssl.so.1.0.2k
7f9656b53000-7f9656b5a000 rw-p 0006b000 fd:00 1155 /usr/lib64/libssl.so.1.0.2k
7f9656b5a000-7f9656b89000 r-xp 00000000 fd:00 1166 /usr/lib64/libsystemd.so.0.6.0
7f9656b89000-7f9656d89000 ---p 0002f000 fd:00 1166 /usr/lib64/libsystemd.so.0.6.0
7f9656d89000-7f9656d8a000 r--p 0002f000 fd:00 1166 /usr/lib64/libsystemd.so.0.6.0
7f9656d8a000-7f9656d8b000 rw-p 00030000 fd:00 1166 /usr/lib64/libsystemd.so.0.6.0
7f9656d8b000-7f9656f71000 r-xp 00000000 fd:00 106179 /usr/lib64/maxscale/libmaxscale-common.so.1.0.0
7f9656f71000-7f9657171000 ---p 001e6000 fd:00 106179 /usr/lib64/maxscale/libmaxscale-common.so.1.0.0
7f9657171000-7f965717b000 r--p 001e6000 fd:00 106179 /usr/lib64/maxscale/libmaxscale-common.so.1.0.0
7f965717b000-7f9657181000 rw-p 001f0000 fd:00 106179 /usr/lib64/maxscale/libmaxscale-common.so.1.0.0
7f9657181000-7f965718a000 rw-p 00000000 00:00 0
7f965718a000-7f96571ac000 r-xp 00000000 fd:00 953 /usr/lib64/ld-2.17.so
7f9657376000-7f9657386000 rwxp 00000000 00:00 0
7f9657386000-7f965739d000 rw-p 00000000 00:00 0
7f96573a9000-7f96573aa000 rw-p 00000000 00:00 0
7f96573aa000-7f96573ab000 rw-p 00000000 00:00 0
7f96573ab000-7f96573ac000 r--p 00021000 fd:00 953 /usr/lib64/ld-2.17.so
7f96573ac000-7f96573ad000 rw-p 00022000 fd:00 953 /usr/lib64/ld-2.17.so
7f96573ad000-7f96573ae000 rw-p 00000000 00:00 0
7ffd4a3cd000-7ffd4a3ee000 rw-p 00000000 00:00 0 [stack]
7ffd4a3fb000-7ffd4a3fd000 r-xp 00000000 00:00 0 [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]
2019-07-19 03:15:06 alert : Fatal: MaxScale 2.3.9 received fatal signal 6. Attempting backtrace.
2019-07-19 03:15:06 alert : Commit ID: 66d6ce6fa598a43b20af052ef6c9f637a3279fa1 System name: Linux Release string: NAME="CentOS Linux"
2019-07-19 03:15:06 alert : /usr/bin/maxscale(_ZN7maxbase15dump_stacktraceESt8functionIFvPKcS2_EE+0x2b) [0x40cb5b]: /home/vagrant/MaxScale/maxutils/maxbase/src/stacktrace.cc:130<http://stacktrace.cc:130>
2019-07-19 03:15:06 alert : /usr/bin/maxscale(_ZN7maxbase15dump_stacktraceEPFvPKcS1_E+0x4e) [0x40cebe]: /usr/include/c++/4.8.2/functional:2029
2019-07-19 03:15:06 alert : /usr/bin/maxscale() [0x409569]: ??:0
2019-07-19 03:15:06 alert : /lib64/libpthread.so.0(+0xf5d0) [0x7f96566db5d0]: sigaction.c:?
2019-07-19 03:15:06 alert : /lib64/libc.so.6(gsignal+0x37) [0x7f96545eb2c7]: :?
2019-07-19 03:15:06 alert : /lib64/libc.so.6(abort+0x148) [0x7f96545ec9b8]: :?
2019-07-19 03:15:06 alert : /lib64/libc.so.6(+0x78e17) [0x7f965462de17]: :?
2019-07-19 03:15:06 alert : /lib64/libc.so.6(+0x81609) [0x7f9654636609]: malloc.c:?
2019-07-19 03:15:06 alert : /usr/lib64/maxscale/libreadwritesplit.so(_ZN14RWSplitSession18retry_master_queryERSt10shared_ptrIN8maxscale9RWBackendEE+0x81) [0x7f964c1a1e81]: /home/vagrant/MaxScale/server/modules/routing/readwritesplit/rwsplitsession.cc:903<http://rwsplitsession.cc:903>
2019-07-19 03:15:06 alert : /usr/lib64/maxscale/libreadwritesplit.so(_ZN14RWSplitSession11handleErrorEP5gwbufP3dcb12error_actionPb+0x627) [0x7f964c1a55a7]: /home/vagrant/MaxScale/server/modules/routing/readwritesplit/rwsplitsession.cc:1001<http://rwsplitsession.cc:1001>
2019-07-19 03:15:06 alert : /usr/lib64/maxscale/libreadwritesplit.so(_ZN8maxscale6RouterI7RWSplit14RWSplitSessionE11handleErrorEP10mxs_routerP18mxs_router_sessionP5gwbufP3dcb12error_actionPb+0x2a) [0x7f964c19fb8a]: /home/vagrant/MaxScale/include/maxscale/router.hh:218
2019-07-19 03:15:06 alert : /usr/lib64/maxscale/libmariadbbackend.so(+0x23d5) [0x7f964bb753d5]: /home/vagrant/MaxScale/server/modules/protocol/MySQL/mariadbbackend/mysql_backend.cc:607<http://mysql_backend.cc:607>
2019-07-19 03:15:06 alert : /usr/lib64/maxscale/libmariadbbackend.so(+0x24e1) [0x7f964bb754e1]: /home/vagrant/MaxScale/server/modules/protocol/MySQL/mariadbbackend/mysql_backend.cc:1387<http://mysql_backend.cc:1387>
2019-07-19 03:15:06 alert : /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(+0x7a826) [0x7f9656e05826]: /home/vagrant/MaxScale/server/core/dcb.cc:2050<http://dcb.cc:2050>
2019-07-19 03:15:06 alert : /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN7maxbase12MessageQueue18handle_poll_eventsEPNS_6WorkerEj+0x11f) [0x7f9656e6770f]: /home/vagrant/MaxScale/maxutils/maxbase/src/messagequeue.cc:291<http://messagequeue.cc:291>
2019-07-19 03:15:06 alert : /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN7maxbase6Worker15poll_waiteventsEv+0x1b5) [0x7f9656e65215]: /home/vagrant/MaxScale/maxutils/maxbase/src/worker.cc:854<http://worker.cc:854>
2019-07-19 03:15:06 alert : /usr/lib64/maxscale/libmaxscale-common.so.1.0.0(_ZN7maxbase6Worker3runEPNS_9SemaphoreE+0x51) [0x7f9656e65411]: /home/vagrant/MaxScale/maxutils/maxbase/src/worker.cc:555<http://worker.cc:555>
2019-07-19 03:15:06 alert : /lib64/libstdc++.so.6(+0xb5070) [0x7f965570e070]: ??:?
2019-07-19 03:15:06 alert : /lib64/libpthread.so.0(+0x7dd5) [0x7f96566d3dd5]: pthread_create.c:?
2019-07-19 03:15:06 alert : /lib64/libc.so.6(clone+0x6d) [0x7f96546b302d]: ??:?



 Comments   
Comment by markus makela [ 2019-08-13 ]

I couldn't reproduce the exact same crash but I did find a few places where some odd behavior would occur. I've added a few checks that should prevent a crash in case the logic is still inconsistent with the router's state.

I'll close this as fixed in 2.3.12 but if it still happens even after we've released it, feel free to reopen this.

Generated at Thu Feb 08 04:15:23 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.