[MDEV-20793] Server crash, Assertion `other.state() == s_committed || other.state() == s_aborted' failed Created: 2019-10-10  Updated: 2021-12-10  Resolved: 2019-12-31

Status: Closed
Project: MariaDB Server
Component/s: Galera, Server
Affects Version/s: 10.4.8
Fix Version/s: 10.4.12

Type: Bug Priority: Major
Reporter: Oren Bissick (Inactive) Assignee: Jan Lindström (Inactive)
Resolution: Fixed Votes: 3
Labels: None
Environment:

CentOS 7

Issue Links:
Duplicate
is duplicated by MDEV-21111 Random crash: [ERROR] mysqld got sign... Closed
Relates
relates to MDEV-20222 Update or clarify documentation regar... Closed

 Description    

mysqld: /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.4.8/wsrep-lib/src/transaction.cpp:951: void wsrep::transaction::after_replay(const wsrep::transaction&): Assertion `other.state() == s_committed || other.state() == s_aborted' failed.
 
191009 19:51:09 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.4.8-MariaDB
 
key_buffer_size=52428800
 
read_buffer_size=131072
 
max_used_connections=37
 
max_threads=502
 
thread_count=49
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 25115760 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x7f2d9c0f79a8
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x7f331c282cc0 thread_stack 0x49000
 
*** buffer overflow detected ***: /usr/sbin/mysqld terminated
 
======= Backtrace: =========
 
/lib64/libc.so.6(__fortify_fail+0x37)[0x7f337c20c527]
 
/lib64/libc.so.6(+0x1166a2)[0x7f337c20a6a2]
 
/lib64/libc.so.6(+0x118487)[0x7f337c20c487]
 
/usr/sbin/mysqld(my_addr_resolve+0xda)[0x55b6063b225a]
 
/usr/sbin/mysqld(my_print_stacktrace+0x1c2)[0x55b60639a9d2]
 
/usr/sbin/mysqld(handle_fatal_signal+0x30f)[0x55b605e30e0f]
 
/lib64/libpthread.so.0(+0xf5f0)[0x7f337de595f0]
 
/lib64/libc.so.6(gsignal+0x37)[0x7f337c12a337]
 
/lib64/libc.so.6(abort+0x148)[0x7f337c12ba28]
 
/lib64/libc.so.6(+0x2f156)[0x7f337c123156]
 
/lib64/libc.so.6(+0x2f202)[0x7f337c123202]
 
/usr/sbin/mysqld(+0xe9ea98)[0x55b60642aa98]
 
/usr/sbin/mysqld(_ZN22Wsrep_replayer_serviceD2Ev+0x60)[0x55b605d8a8b0]
 
/usr/sbin/mysqld(_ZN20Wsrep_client_service6replayEv+0x105)[0x55b605d893a5]
 
/usr/sbin/mysqld(_ZN5wsrep11transaction15after_statementEv+0xd5)[0x55b606430895]
 
/usr/sbin/mysqld(_ZN5wsrep12client_state15after_statementEv+0x7d)[0x55b60641cd1d]
 
/usr/sbin/mysqld(+0x69ff70)[0x55b605c2bf70]
 
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0x2b69)[0x55b605c2f2c9]
 
/usr/sbin/mysqld(_Z10do_commandP3THD+0x11c)[0x55b605c2faac]
 
/usr/sbin/mysqld(_Z24do_handle_one_connectionP7CONNECT+0x221)[0x55b605d0d1b1]
 
/usr/sbin/mysqld(handle_one_connection+0x3d)[0x55b605d0d26d]
 
/usr/sbin/mysqld(+0xdc124d)[0x55b60634d24d]
 
/lib64/libpthread.so.0(+0x7e65)[0x7f337de51e65]
 
/lib64/libc.so.6(clone+0x6d)[0x7f337c1f288d]
 
======= Memory map: ========
 
55b60558c000-55b6069d4000 r-xp 00000000 fd:00 201846599                  /usr/sbin/mysqld
 
55b606bd4000-55b606cff000 r--p 01448000 fd:00 201846599                  /usr/sbin/mysqld
 
55b606cff000-55b606db9000 rw-p 01573000 fd:00 201846599                  /usr/sbin/mysqld
 
55b606db9000-55b607668000 rw-p 00000000 00:00 0 
55b607d11000-55b623e33000 rw-p 00000000 00:00 0                          [heap]
 
7f2d40000000-7f2d40493000 rw-p 00000000 00:00 0 
7f2d40493000-7f2d44000000 ---p 00000000 00:00 0 
7f2d48000000-7f2d4830d000 rw-p 00000000 00:00 0 
7f2d4830d000-7f2d4c000000 ---p 00000000 00:00 0 
7f2d4c000000-7f2d4c0a6000 rw-p 00000000 00:00 0 
7f2d4c0a6000-7f2d50000000 ---p 00000000 00:00 0 
7f2d50000000-7f2d5007a000 rw-p 00000000 00:00 0 
7f2d5007a000-7f2d54000000 ---p 00000000 00:00 0 
7f2d54000000-7f2d54117000 rw-p 00000000 00:00 0 
7f2d54117000-7f2d58000000 ---p 00000000 00:00 0 
7f2d58000000-7f2d582ce000 rw-p 00000000 00:00 0 
7f2d582ce000-7f2d5c000000 ---p 00000000 00:00 0 
7f2d5c000000-7f2d5c327000 rw-p 00000000 00:00 0 
7f2d5c327000-7f2d60000000 ---p 00000000 00:00 0 
7f2d60000000-7f2d60396000 rw-p 00000000 00:00 0 
7f2d60396000-7f2d64000000 ---p 00000000 00:00 0 
7f2d64000000-7f2d6431c000 rw-p 00000000 00:00 0 
7f2d6431c000-7f2d68000000 ---p 00000000 00:00 0 
7f2d68000000-7f2d682fd000 rw-p 00000000 00:00 0 
7f2d682fd000-7f2d6c000000 ---p 00000000 00:00 0 
7f2d6c000000-7f2d6c40b000 rw-p 00000000 00:00 0 
7f2d6c40b000-7f2d70000000 ---p 00000000 00:00 0 
7f2d70000000-7f2d7008d000 rw-p 00000000 00:00 0 
7f2d7008d000-7f2d74000000 ---p 00000000 00:00 0 
7f2d74000000-7f2d74383000 rw-p 00000000 00:00 0 
7f2d74383000-7f2d78000000 ---p 00000000 00:00 0 
7f2d78000000-7f2d78301000 rw-p 00000000 00:00 0 
7f2d78301000-7f2d7c000000 ---p 00000000 00:00 0 
7f2d7c000000-7f2d7c090000 rw-p 00000000 00:00 0 
7f2d7c090000-7f2d80000000 ---p 00000000 00:00 0 
7f2d80000000-7f2d800a6000 rw-p 00000000 00:00 0 
7f2d800a6000-7f2d84000000 ---p 00000000 00:00 0 
7f2d84000000-7f2d84093000 rw-p 00000000 00:00 0 
7f2d84093000-7f2d88000000 ---p 00000000 00:00 0 
7f2d88000000-7f2d886e9000 rw-p 00000000 00:00 0 
7f2d886e9000-7f2d8c000000 ---p 00000000 00:00 0 
7f2d8c000000-7f2d8c3bd000 rw-p 00000000 00:00 0 
7f2d8c3bd000-7f2d90000000 ---p 00000000 00:00 0 
7f2d90000000-7f2d902ee000 rw-p 00000000 00:00 0 
7f2d902ee000-7f2d94000000 ---p 00000000 00:00 0 
7f2d94000000-7f2d942ef000 rw-p 00000000 00:00 0 
7f2d942ef000-7f2d98000000 ---p 00000000 00:00 0 
7f2d98000000-7f2d98021000 rw-p 00000000 00:00 0 
7f2d98021000-7f2d9c000000 ---p 00000000 00:00 0 
7f2d9c000000-7f2d9c266000 rw-p 00000000 00:00 0 
7f2d9c266000-7f2da0000000 ---p 00000000 00:00 0 
7f2da0000000-7f2da097e000 rw-p 00000000 00:00 0 
7f2da097e000-7f2da4000000 ---p 00000000 00:00 0 
7f2da4000000-7f2da430f000 rw-p 00000000 00:00 0 
7f2da430f000-7f2da8000000 ---p 00000000 00:00 0 
7f2da8000000-7f2da8021000 rw-p 00000000 00:00 0 
7f2da8021000-7f2dac000000 ---p 00000000 00:00 0 
7f2dac000000-7f2dac394000 rw-p 00000000 00:00 0 
7f2dac394000-7f2db0000000 ---p 00000000 00:00 0 
7f2db0000000-7f2db0397000 rw-p 00000000 00:00 0 
7f2db0397000-7f2db4000000 ---p 00000000 00:00 0 
7f2db4000000-7f2db4085000 rw-p 00000000 00:00 0 
7f2db4085000-7f2db8000000 ---p 00000000 00:00 0 
7f2db8000000-7f2db8021000 rw-p 00000000 00:00 0 
7f2db8021000-7f2dbc000000 ---p 00000000 00:00 0 
7f2dbc000000-7f2dbc13d000 rw-p 00000000 00:00 0 
7f2dbc13d000-7f2dc0000000 ---p 00000000 00:00 0 
7f2dc0000000-7f2dc0021000 rw-p 00000000 00:00 0 
7f2dc0021000-7f2dc4000000 ---p 00000000 00:00 0 
7f2dc4000000-7f2dc4021000 rw-p 00000000 00:00 0 
7f2dc4021000-7f2dc8000000 ---p 00000000 00:00 0 
7f2dc8000000-7f2dc8021000 rw-p 00000000 00:00 0 
7f2dc8021000-7f2dcc000000 ---p 00000000 00:00 0 
7f2dcc000000-7f2dcc047000 rw-p 00000000 00:00 0 
7f2dcc047000-7f2dd0000000 ---p 00000000 00:00 0 
7f2dd0000000-7f2dd0317000 rw-p 00000000 00:00 0 
7f2dd0317000-7f2dd4000000 ---p 00000000 00:00 0 
7f2dd4000000-7f2dd4643000 rw-p 00000000 00:00 0 
7f2dd4643000-7f2dd8000000 ---p 00000000 00:00 0 
7f2dd8000000-7f2dd8387000 rw-p 00000000 00:00 0 
7f2dd8387000-7f2ddc000000 ---p 00000000 00:00 0 
7f2de0000000-7f2de0021000 rw-p 00000000 00:00 0 
7f2de0021000-7f2de4000000 ---p 00000000 00:00 0 
7f2de4000000-7f2de4021000 rw-p 00000000 00:00 0 
7f2de4021000-7f2de8000000 ---p 00000000 00:00 0 
7f2de8000000-7f2deae13000 rw-p 00000000 00:00 0 
7f2deae13000-7f2dec000000 ---p 00000000 00:00 0 
7f2dec000000-7f2dec021000 rw-p 00000000 00:00 0 
7f2dec021000-7f2df0000000 ---p 00000000 00:00 0 
7f2df0000000-7f2df0034000 rw-p 00000000 00:00 0 
7f2df0034000-7f2df4000000 ---p 00000000 00:00 0 
7f2df4000000-7f2df4033000 rw-p 00000000 00:00 0 
7f2df4033000-7f2df8000000 ---p 00000000 00:00 0 
7f2df8000000-7f2df8035000 rw-p 00000000 00:00 0 
7f2df8035000-7f2dfc000000 ---p 00000000 00:00 0 
7f2dfc000000-7f2dfc089000 rw-p 00000000 00:00 0 
7f2dfc089000-7f2e00000000 ---p 00000000 00:00 0 
7f2e0197e000-7f2e04000000 rw-p 00000000 00:00 0 
7f2e04000000-7f2e0448e000 rw-p 00000000 00:00 0 
7f2e0448e000-7f2e08000000 ---p 00000000 00:00 0 
7f2e0997e000-7f2e0c000000 rw-p 00000000 00:00 0 
7f2e0c000000-7f2e0c021000 rw-p 00000000 00:00 0 
7f2e0c021000-7f2e10000000 ---p 00000000 00:00 0 
7f2e1017b000-7f2e1017c000 ---p 00000000 00:00 0 
7f2e1017c000-7f2e12ffe000 rw-p 00000000 00:00 0 
7f2e12ffe000-7f2e12fff000 ---p 00000000 00:00 0 
7f2e12fff000-7f2e137ff000 rw-p 00000000 00:00 0 
7f2e137ff000-7f2e13800000 ---p 00000000 00:00 0 
7f2e13800000-7f2e14000000 rw-p 00000000 00:00 0 
7f2e14000000-7f2e14021000 rw-p 00000000 00:00 0 
7f2e14021000-7f2e18000000 ---p 00000000 00:00 0 
7f2e18000000-7f2e18021000 rw-p 00000000 00:00 0 
7f2e18021000-7f2e1c000000 ---p 00000000 00:00 0 
7f2e1c000000-7f2e1c021000 rw-p 00000000 00:00 0 
7f2e1c021000-7f2e20000000 ---p 00000000 00:00 0 
7f2e20775000-7f2e20776000 ---p 00000000 00:00 0 
7f2e20776000-7f2e20f76000 rw-p 00000000 00:00 0 
7f2e20f76000-7f2e20f77000 ---p 00000000 00:00 0 
7f2e20f77000-7f2e21777000 rw-p 00000000 00:00 0 
7f2e21777000-7f2e21778000 ---p 00000000 00:00 0 
7f2e21778000-7f2e21f78000 rw-p 00000000 00:00 0 
7f2e21f78000-7f2e21f79000 ---p 00000000 00:00 0 
7f2e21f79000-7f2e22779000 rw-p 00000000 00:00 0 
7f2e22779000-7f2e2277a000 ---p 00000000 00:00 0 
7f2e2277a000-7f2e22f7a000 rw-p 00000000 00:00 0 
7f2e22f7a000-7f2e22f7b000 ---p 00000000 00:00 0 
7f2e22f7b000-7f2e2377b000 rw-p 00000000 00:00 0 
7f2e2377b000-7f2e2377c000 ---p 00000000 00:00 0 
7f2e2377c000-7f2e23f7c000 rw-p 00000000 00:00 0 
7f2e23f7c000-7f2e23f7d000 ---p 00000000 00:00 0 
7f2e23f7d000-7f2e2477d000 rw-p 00000000 00:00 0 
7f2e2477d000-7f2e2477e000 ---p 00000000 00:00 0 
7f2e2477e000-7f2e24f7e000 rw-p 00000000 00:00 0 
7f2e24f7e000-7f2e24f7f000 ---p 00000000 00:00 0 
7f2e24f7f000-7f2e2577f000 rw-p 00000000 00:00 0 
7f2e2577f000-7f2e25780000 ---p 00000000 00:00 0 
7f2e25780000-7f2e25f80000 rw-p 00000000 00:00 0 
7f2e25f80000-7f2e25f81000 ---p 00000000 00:00 0 
7f2e25f81000-7f2e2f7e7000 rw-p 00000000 00:00 0 
7f2e2f7ff000-7f2e2f800000 ---p 00000000 00:00 0 
7f2e2f800000-7f2e30000000 rw-p 00000000 00:00 0 
7f2e30000000-7f2e30021000 rw-p 00000000 00:00 0 
7f2e30021000-7f2e34000000 ---p 00000000 00:00 0 
7f2e34000000-7f2e34029000 rw-p 00000000 00:00 0 
7f2e34029000-7f2e38000000 ---p 00000000 00:00 0 
7f2e38637000-7f2e38638000 ---p 00000000 00:00 0 
7f2e38638000-7f2e38682000 rw-p 00000000 00:00 0 
7f2e38682000-7f2e38683000 ---p 00000000 00:00 0 
7f2e38683000-7f2e386cd000 rw-p 00000000 00:00 0 
7f2e386cd000-7f2e386ce000 ---p 00000000 00:00 0 
7f2e386ce000-7f2e38718000 rw-p 00000000 00:00 0 
7f2e38718000-7f2e38719000 ---p 00000000 00:00 0 
7f2e38719000-7f2e38763000 rw-p 00000000 00:00 0 
7f2e38763000-7f2e38764000 ---p 00000000 00:00 0 
7f2e38764000-7f2e387ae000 rw-p 00000000 00:00 0 
7f2e387ae000-7f2e387af000 ---p 00000000 00:00 0 
7f2e387af000-7f2e387f9000 rw-p 00000000 00:00 0 
7f2e387f9000-7f2e387fa000 ---p 00000000 00:00 0 
7f2e387fa000-7f2e38ffa000 rw-p 00000000 00:00 0 
7f2e38ffa000-7f2e38ffb000 ---p 00000000 00:00 0 
7f2e38ffb000-7f2e397fb000 rw-p 00000000 00:00 0 
7f2e397fb000-7f2e397fc000 ---p 00000000 00:00 0 
7f2e397fc000-7f2e39ffc000 rw-p 00000000 00:00 0 
7f2e39ffc000-7f2e39ffd000 ---p 00000000 00:00 0 
7f2e39ffd000-7f2e3a7fd000 rw-p 00000000 00:00 0 
7f2e3a7fd000-7f2e3a7fe000 ---p 00000000 00:00 0 
7f2e3a7fe000-7f2e3affe000 rw-p 00000000 00:00 0 
7f2e3affe000-7f2e3afff000 ---p 00000000 00:00 0 
7f2e3afff000-7f2e3b7ff000 rw-p 00000000 00:00 0 
7f2e3b7ff000-7f2e3b800000 ---p 00000000 00:00 0 
7f2e3b800000-7f2e3c000000 rw-p 00000000 00:00 0 
7f2e3c000000-7f2e3c021000 rw-p 00000000 00:00 0 
7f2e3c021000-7f2e40000000 ---p 00000000 00:00 0 
7f2e4001c000-7f2e4001d000 ---p 00000000 00:00 0 
7f2e4001d000-7f2e40067000 rw-p 00000000 00:00 0 
7f2e40067000-7f2e40068000 ---p 00000000 00:00 0 
7f2e40068000-7f2e400b2000 rw-p 00000000 00:00 0 
7f2e400b2000-7f2e400b3000 ---p 00000000 00:00 0 
7f2e400b3000-7f2e400fd000 rw-p 00000000 00:00 0 
7f2e400fd000-7f2e400fe000 ---p 00000000 00:00 0 
7f2e400fe000-7f2e40148000 rw-p 00000000 00:00 0 
7f2e40148000-7f2e40149000 ---p 00000000 00:00 0 
7f2e40149000-7f2e40193000 rw-p 00000000 00:00 0 
7f2e40193000-7f2e40194000 ---p 00000000 00:00 0 
7f2e40194000-7f2e401de000 rw-p 00000000 00:00 0 
7f2e401de000-7f2e401df000 ---p 00000000 00:00 0 
7f2e401df000-7f2e40229000 rw-p 00000000 00:00 0 
7f2e40229000-7f2e4022a000 ---p 00000000 00:00 0 
7f2e4022a000-7f2e40274000 rw-p 00000000 00:00 0 
7f2e40274000-7f2e40275000 ---p 00000000 00:00 0 
7f2e40275000-7f2e402bf000 rw-p 00000000 00:00 0 
7f2e402bf000-7f2e402c0000 ---p 00000000 00:00 0 
7f2e402c0000-7f2e4030a000 rw-p 00000000 00:00 0 
7f2e4030a000-7f2e4030b000 ---p 00000000 00:00 0 
7f2e4030b000-7f2e40355000 rw-p 00000000 00:00 0 
7f2e40355000-7f2e40356000 ---p 00000000 00:00 0 
7f2e40356000-7f2e403a0000 rw-p 00000000 00:00 0 
7f2e403a0000-7f2e403a1000 ---p 00000000 00:00 0 
7f2e403a1000-7f2e403eb000 rw-p 00000000 00:00 0 
7f2e403eb000-7f2e403ec000 ---p 00000000 00:00 0 
7f2e403ec000-7f2e40bec000 rw-p 00000000 00:00 0 
7f2e40bec000-7f2e40bed000 ---p 00000000 00:00 0 
7f2e40bed000-7f2e413ed000 rw-p 00000000 00:00 0 
7f2e413ed000-7f2e413ee000 ---p 00000000 00:00 0 
7f2e413ee000-7f2e41bee000 rw-p 00000000 00:00 0 
7f2e41bee000-7f2e41bef000 ---p 00000000 00:00 0 
7f2e41bef000-7f2e423ef000 rw-p 00000000 00:00 0 
7f2e423ef000-7f2e423f0000 ---p 00000000 00:00 0 
7f2e423f0000-7f2e42bf0000 rw-p 00000000 00:00 0 
7f2e42bf0000-7f2e44bf0000 rw-p 00000000 00:00 0 
7f2e44bf0000-7f2e58000000 rw-p 00000000 00:00 0 
7f2e58000000-7f3318000000 rw-p 00000000 00:00 0 
7f3318000000-7f3318021000 rw-p 00000000 00:00 0 
7f3318021000-7f331c000000 ---p 00000000 00:00 0 
7f331c02c000-7f331c02d000 ---p 00000000 00:00 0 
7f331c02d000-7f331c077000 rw-p 00000000 00:00 0 
7f331c077000-7f331c078000 ---p 00000000 00:00 0 
7f331c078000-7f331c0c2000 rw-p 00000000 00:00 0 
7f331c0c2000-7f331c0c3000 ---p 00000000 00:00 0 
7f331c0c3000-7f331c10d000 rw-p 00000000 00:00 0 
7f331c10d000-7f331c10e000 ---p 00000000 00:00 0 
7f331c10e000-7f331c158000 rw-p 00000000 00:00 0 
7f331c158000-7f331c159000 ---p 00000000 00:00 0 
7f331c159000-7f331c1a3000 rw-p 00000000 00:00 0 
7f331c1a3000-7f331c1a4000 ---p 00000000 00:00 0 
7f331c1a4000-7f331c1ee000 rw-p 00000000 00:00 0 
7f331c1ee000-7f331c1ef000 ---p 00000000 00:00 0 
7f331c1ef000-7f331c239000 rw-p 00000000 00:00 0 
7f331c239000-7f331c23a000 ---p 00000000 00:00 0 
7f331c23a000-7f331c284000 rw-p 00000000 00:00 0 
7f331c284000-7f331c291000 r-xp 00000000 fd:00 67130362                   /usr/lib64/mysql/plugin/server_audit.so
 
7f331c291000-7f331c490000 ---p 0000d000 fd:00 67130362                   /usr/lib64/mysql/plugin/server_audit.so
 
7f331c490000-7f331c491000 r--p 0000c000 fd:00 67130362                   /usr/lib64/mysql/plugin/server_audit.so
 
7f331c491000-7f331c493000 rw-p 0000d000 fd:00 67130362                   /usr/lib64/mysql/plugin/server_audit.so
 
7f331c493000-7f331c69a000 rw-p 00000000 00:00 0 
7f331c69a000-7f331c69b000 ---p 00000000 00:00 0 
7f331c69b000-7f331ce9b000 rw-p 00000000 00:00 0 
7f331ced9000-7f331ceda000 ---p 00000000 00:00 0 
7f331ceda000-7f331cf24000 rw-p 00000000 00:00 0 
7f331cf24000-7f331cf25000 ---p 00000000 00:00 0 
7f331cf25000-7f331cf6f000 rw-p 00000000 00:00 0 
7f331cf6f000-7f331cf70000 ---p 00000000 00:00 0 
7f331cf70000-7f331cfba000 rw-p 00000000 00:00 0 
7f331cfba000-7f331cfbb000 ---p 00000000 00:00 0 
7f331cfbb000-7f331d005000 rw-p 00000000 00:00 0 
7f331d005000-7f331d006000 ---p 00000000 00:00 0 
7f331d006000-7f331d050000 rw-p 00000000 00:00 0 
7f331d050000-7f331d051000 ---p 00000000 00:00 0 
7f331d051000-7f331d49c000 rw-p 00000000 00:00 0 
7f331d49c000-7f331d49d000 ---p 00000000 00:00 0 
7f331d49d000-7f3328000000 rw-p 00000000 00:00 0 
7f3328000000-7f3328021000 rw-p 00000000 00:00 0 
7f3328021000-7f332c000000 ---p 00000000 00:00 0 
7f332c000000-7f332c038000 rw-p 00000000 00:00 0 
7f332c038000-7f3330000000 ---p 00000000 00:00 0 
7f3330000000-7f333051e000 rw-p 00000000 00:00 0 
7f333051e000-7f3334000000 ---p 00000000 00:00 0 
7f3334000000-7f333419e000 rw-p 00000000 00:00 0 
7f333419e000-7f3338000000 ---p 00000000 00:00 0 
7f3338000000-7f333803b000 rw-p 00000000 00:00 0 
7f333803b000-7f333c000000 ---p 00000000 00:00 0 
7f333c000000-7f333c021000 rw-p 00000000 00:00 0 
7f333c021000-7f3340000000 ---p 00000000 00:00 0 
7f3340000000-7f334003e000 rw-p 00000000 00:00 0 
7f334003e000-7f3344000000 ---p 00000000 00:00 0 
7f3344043000-7f3344044000 ---p 00000000 00:00 0 
7f3344044000-7f334408e000 rw-p 00000000 00:00 0 
7f334408e000-7f334408f000 ---p 00000000 00:00 0 
7f334408f000-7f3344ff9000 rw-p 00000000 00:00 0 
7f3344ff9000-7f3344ffa000 ---p 00000000 00:00 0 
7f3344ffa000-7f33457fa000 rw-p 00000000 00:00 0 
7f33457fa000-7f33457fb000 ---p 00000000 00:00 0 
7f33457fb000-7f3345ffb000 rw-p 00000000 00:00 0 
7f3345ffb000-7f3345ffc000 ---p 00000000 00:00 0 
7f3345ffc000-7f33467fc000 rw-p 00000000 00:00 0 
7f33467fc000-7f33467fd000 ---p 00000000 00:00 0 
7f33467fd000-7f3347fff000 rw-p 00000000 00:00 0 
7f3347fff000-7f3350000000 rw-s 00000000 fd:00 67246224                   /var/lib/mysql/galera.cache
 
7f3350000000-7f3350021000 rw-p 00000000 00:00 0 
7f3350021000-7f3354000000 ---p 00000000 00:00 0 
7f3354030000-7f3354036000 rw-s 00000000 fd:00 67308003                   /var/lib/mysql/tc.log
 
7f3354037000-7f3354038000 rw-s 00000000 00:0b 39524822                   /[aio] (deleted)
 
7f3354038000-7f335403b000 rw-s 00000000 00:0b 39524821                   /[aio] (deleted)
 
7f335403b000-7f335403e000 rw-s 00000000 00:0b 39524820                   /[aio] (deleted)
 
7f335403e000-7f3354041000 rw-s 00000000 00:0b 39524819                   /[aio] (deleted)
 
7f3354041000-7f3354044000 rw-s 00000000 00:0b 39524818                   /[aio] (deleted)
 
7f3354044000-7f3354047000 rw-s 00000000 00:0b 39524817                   /[aio] (deleted)
 
7f3354047000-7f335404a000 rw-s 00000000 00:0b 39524816                   /[aio] (deleted)
 
7f335404a000-7f335404d000 rw-s 00000000 00:0b 39524815                   /[aio] (deleted)
 
7f335404d000-7f3354236000 rw-p 00000000 00:00 0 
7f3354261000-7f3354262000 rw-p 00000000 00:00 0 
7f3354263000-7f3354264000 ---p 00000000 00:00 0 
7f3354264000-7f33542ae000 rw-p 00000000 00:00 0 
7f33542ae000-7f33542af000 ---p 00000000 00:00 0 
7f33542af000-7f33542f9000 rw-p 00000000 00:00 0 
7f33542f9000-7f33542fa000 ---p 00000000 00:00 0 
7f33542fa000-7f3354344000 rw-p 00000000 00:00 0 
7f3354344000-7f3354345000 ---p 00000000 00:00 0 
7f3354345000-7f335438f000 rw-p 00000000 00:00 0 
7f335438f000-7f3354390000 ---p 00000000 00:00 0 
7f3354390000-7f33543da000 rw-p 00000000 00:00 0 
7f33543da000-7f33543db000 ---p 00000000 00:00 0 
7f33543db000-7f3354425000 rw-p 00000000 00:00 0 
7f3354425000-7f3354426000 ---p 00000000 00:00 0 
7f3354426000-7f3354470000 rw-p 00000000 00:00 0 
7f3354470000-7f3354471000 ---p 00000000 00:00 0 
7f3354471000-7f33544bb000 rw-p 00000000 00:00 0 
7f33544bb000-7f33544bc000 ---p 00000000 00:00 0 
7f33544bc000-7f3354d07000 rw-p 00000000 00:00 0 
7f3354d07000-7f3354d08000 ---p 00000000 00:00 0 
7f3354d08000-7f335566b000 rw-p 00000000 00:00 0 
7f335566b000-7f33558d0000 r-xp 00000000 fd:00 134316641                  /usr/lib64/galera-4/libgalera_smm.so
 
7f33558d0000-7f3355acf000 ---p 00265000 fd:00 134316641                  /usr/lib64/galera-4/libgalera_smm.so
 
7f3355acf000-7f3355ad7000 r--p 00264000 fd:00 134316641                  /usr/lib64/galera-4/libgalera_smm.so
 
7f3355ad7000-7f3355ad9000 rw-p 0026c000 fd:00 134316641                  /usr/lib64/galera-4/libgalera_smm.so
 
7f3355ad9000-7f3355adb000 rw-p 00000000 00:00 0 
7f3355adb000-7f3355adc000 ---p 00000000 00:00 0 
7f3355adc000-7f33594d8000 rw-p 00000000 00:00 0 
7f33594d8000-7f3359ec5000 r--s 00000000 fd:00 268455619                  /var/lib/sss/mc/initgroups
 
7f3359ec5000-7f3359ecd000 r-xp 00000000 fd:00 201459392                  /usr/lib64/libnss_sss.so.2
 
7f3359ecd000-7f335a0cc000 ---p 00008000 fd:00 201459392                  /usr/lib64/libnss_sss.so.2
 
7f335a0cc000-7f335a0cd000 r--p 00007000 fd:00 201459392                  /usr/lib64/libnss_sss.so.2
 
7f335a0cd000-7f335a0ce000 rw-p 00008000 fd:00 201459392                  /usr/lib64/libnss_sss.so.2
 
7f335a0ce000-7f335a0da000 r-xp 00000000 fd:00 201465039                  /usr/lib64/libnss_files-2.17.so
 
7f335a0da000-7f335a2d9000 ---p 0000c000 fd:00 201465039                  /usr/lib64/libnss_files-2.17.so
 
7f335a2d9000-7f335a2da000 r--p 0000b000 fd:00 201465039                  /usr/lib64/libnss_files-2.17.so
 
7f335a2da000-7f335a2db000 rw-p 0000c000 fd:00 201465039                  /usr/lib64/libnss_files-2.17.so
 
7f335a2db000-7f3379592000 rw-p 00000000 00:00 0 
7f3379592000-7f3379595000 r-xp 00000000 fd:00 201458977                  /usr/lib64/libkeyutils.so.1.5
 
7f3379595000-7f3379794000 ---p 00003000 fd:00 201458977                  /usr/lib64/libkeyutils.so.1.5
 
7f3379794000-7f3379795000 r--p 00002000 fd:00 201458977                  /usr/lib64/libkeyutils.so.1.5
 
7f3379795000-7f3379796000 rw-p 00003000 fd:00 201458977                  /usr/lib64/libkeyutils.so.1.5
 
7f3379796000-7f33797a4000 r-xp 00000000 fd:00 201415009                  /usr/lib64/libkrb5support.so.0.1
 
7f33797a4000-7f33799a4000 ---p 0000e000 fd:00 201415009                  /usr/lib64/libkrb5support.so.0.1
 
7f33799a4000-7f33799a5000 r--p 0000e000 fd:00 201415009                  /usr/lib64/libkrb5support.so.0.1
 
7f33799a5000-7f33799a6000 rw-p 0000f000 fd:00 201415009                  /usr/lib64/libkrb5support.so.0.1
 
7f33799a6000-7f33799b5000 r-xp 00000000 fd:00 201384837                  /usr/lib64/libbz2.so.1.0.6
 
7f33799b5000-7f3379bb4000 ---p 0000f000 fd:00 201384837                  /usr/lib64/libbz2.so.1.0.6
 
7f3379bb4000-7f3379bb5000 r--p 0000e000 fd:00 201384837                  /usr/lib64/libbz2.so.1.0.6
 
7f3379bb5000-7f3379bb6000 rw-p 0000f000 fd:00 201384837                  /usr/lib64/libbz2.so.1.0.6
 
7f3379bb6000-7f3379bcd000 r-xp 00000000 fd:00 201418603                  /usr/lib64/libelf-0.176.so
 
7f3379bcd000-7f3379dcc000 ---p 00017000 fd:00 201418603                  /usr/lib64/libelf-0.176.so
 
7f3379dcc000-7f3379dcd000 r--p 00016000 fd:00 201418603                  /usr/lib64/libelf-0.176.so
 
7f3379dcd000-7f3379dce000 rw-p 00017000 fd:00 201418603                  /usr/lib64/libelf-0.176.so
 
7f3379dce000-7f3379e2e000 r-xp 00000000 fd:00 201478156                  /usr/lib64/libpcre.so.1.2.0
 
7f3379e2e000-7f337a02e000 ---p 00060000 fd:00 201478156                  /usr/lib64/libpcre.so.1.2.0
 
7f337a02e000-7f337a02f000 r--p 00060000 fd:00 201478156                  /usr/lib64/libpcre.so.1.2.0
 
7f337a02f000-7f337a030000 rw-p 00061000 fd:00 201478156                  /usr/lib64/libpcre.so.1.2.0
 
7f337a030000-7f337a034000 r-xp 00000000 fd:00 201385064                  /usr/lib64/libattr.so.1.1.0
 
7f337a034000-7f337a233000 ---p 00004000 fd:00 201385064                  /usr/lib64/libattr.so.1.1.0
 
7f337a233000-7f337a234000 r--p 00003000 fd:00 201385064                  /usr/lib64/libattr.so.1.1.0
 
7f337a234000-7f337a235000 rw-p 00004000 fd:00 201385064                  /usr/lib64/libattr.so.1.1.0
 
7f337a235000-7f337a266000 r-xp 00000000 fd:00 201413170                  /usr/lib64/libk5crypto.so.3.1
 
7f337a266000-7f337a465000 ---p 00031000 fd:00 201413170                  /usr/lib64/libk5crypto.so.3.1
 
7f337a465000-7f337a467000 r--p 00030000 fd:00 201413170                  /usr/lib64/libk5crypto.so.3.1
 
7f337a467000-7f337a468000 rw-p 00032000 fd:00 201413170                  /usr/lib64/libk5crypto.so.3.1
 
7f337a468000-7f337a46b000 r-xp 00000000 fd:00 201384898                  /usr/lib64/libcom_err.so.2.1
 
7f337a46b000-7f337a66a000 ---p 00003000 fd:00 201384898                  /usr/lib64/libcom_err.so.2.1
 
7f337a66a000-7f337a66b000 r--p 00002000 fd:00 201384898                  /usr/lib64/libcom_err.so.2.1
 
7f337a66b000-7f337a66c000 rw-p 00003000 fd:00 201384898                  /usr/lib64/libcom_err.so.2.1
 
7f337a66c000-7f337a745000 r-xp 00000000 fd:00 201415003                  /usr/lib64/libkrb5.so.3.3
 
7f337a745000-7f337a944000 ---p 000d9000 fd:00 201415003                  /usr/lib64/libkrb5.so.3.3
 
7f337a944000-7f337a952000 r--p 000d8000 fd:00 201415003                  /usr/lib64/libkrb5.so.3.3
 
7f337a952000-7f337a955000 rw-p 000e6000 fd:00 201415003                  /usr/lib64/libkrb5.so.3.3
 
7f337a955000-7f337a99f000 r-xp 00000000 fd:00 201413166                  /usr/lib64/libgssapi_krb5.so.2.2
 
7f337a99f000-7f337ab9f000 ---p 0004a000 fd:00 201413166                  /usr/lib64/libgssapi_krb5.so.2.2
 
7f337ab9f000-7f337aba0000 r--p 0004a000 fd:00 201413166                  /usr/lib64/libgssapi_krb5.so.2.2
 
7f337aba0000-7f337aba2000 rw-p 0004b000 fd:00 201413166                  /usr/lib64/libgssapi_krb5.so.2.2
 
7f337aba2000-7f337abb7000 r-xp 00000000 fd:00 201458880                  /usr/lib64/libgcc_s-4.8.5-20150702.so.1
 
7f337abb7000-7f337adb6000 ---p 00015000 fd:00 201458880                  /usr/lib64/libgcc_s-4.8.5-20150702.so.1
 
7f337adb6000-7f337adb7000 r--p 00014000 fd:00 201458880                  /usr/lib64/libgcc_s-4.8.5-20150702.so.1
 
7f337adb7000-7f337adb8000 rw-p 00015000 fd:00 201458880                  /usr/lib64/libgcc_s-4.8.5-20150702.so.1
 
7f337adb8000-7f337ae06000 r-xp 00000000 fd:00 201385026                  /usr/lib64/libdw-0.176.so
 
7f337ae06000-7f337b006000 ---p 0004e000 fd:00 201385026                  /usr/lib64/libdw-0.176.so
 
7f337b006000-7f337b008000 r--p 0004e000 fd:00 201385026                  /usr/lib64/libdw-0.176.so
 
7f337b008000-7f337b009000 rw-p 00050000 fd:00 201385026                  /usr/lib64/libdw-0.176.so
 
7f337b009000-7f337b01f000 r-xp 00000000 fd:00 201467904                  /usr/lib64/libresolv-2.17.so
 
7f337b01f000-7f337b21e000 ---p 00016000 fd:00 201467904                  /usr/lib64/libresolv-2.17.so
 
7f337b21e000-7f337b21f000 r--p 00015000 fd:00 201467904                  /usr/lib64/libresolv-2.17.so
 
7f337b21f000-7f337b220000 rw-p 00016000 fd:00 201467904                  /usr/lib64/libresolv-2.17.so
 
7f337b220000-7f337b222000 rw-p 00000000 00:00 0 
7f337b222000-7f337b226000 r-xp 00000000 fd:00 201385057                  /usr/lib64/libgpg-error.so.0.10.0
 
7f337b226000-7f337b425000 ---p 00004000 fd:00 201385057                  /usr/lib64/libgpg-error.so.0.10.0
 
7f337b425000-7f337b426000 r--p 00003000 fd:00 201385057                  /usr/lib64/libgpg-error.so.0.10.0
 
7f337b426000-7f337b427000 rw-p 00004000 fd:00 201385057                  /usr/lib64/libgpg-error.so.0.10.0
 
7f337b427000-7f337b4a4000 r-xp 00000000 fd:00 201384846                  /usr/lib64/libgcrypt.so.11.8.2
 
7f337b4a4000-7f337b6a3000 ---p 0007d000 fd:00 201384846                  /usr/lib64/libgcrypt.so.11.8.2
 
7f337b6a3000-7f337b6a4000 r--p 0007c000 fd:00 201384846                  /usr/lib64/libgcrypt.so.11.8.2
 
7f337b6a4000-7f337b6a7000 rw-p 0007d000 fd:00 201384846                  /usr/lib64/libgcrypt.so.11.8.2
 
7f337b6a7000-7f337b6a8000 rw-p 00000000 00:00 0 
7f337b6a8000-7f337b6bc000 r-xp 00000000 fd:00 201458760                  /usr/lib64/liblz4.so.1.7.5
 
7f337b6bc000-7f337b8bb000 ---p 00014000 fd:00 201458760                  /usr/lib64/liblz4.so.1.7.5
 
7f337b8bb000-7f337b8bc000 r--p 00013000 fd:00 201458760                  /usr/lib64/liblz4.so.1.7.5
 
7f337b8bc000-7f337b8bd000 rw-p 00014000 fd:00 201458760                  /usr/lib64/liblz4.so.1.7.5
 
7f337b8bd000-7f337b8e1000 r-xp 00000000 fd:00 201459977                  /usr/lib64/libselinux.so.1
 
7f337b8e1000-7f337bae0000 ---p 00024000 fd:00 201459977                  /usr/lib64/libselinux.so.1
 
7f337bae0000-7f337bae1000 r--p 00023000 fd:00 201459977                  /usr/lib64/libselinux.so.1
 
7f337bae1000-7f337bae2000 rw-p 00024000 fd:00 201459977                  /usr/lib64/libselinux.so.1
 
7f337bae2000-7f337bae4000 rw-p 00000000 00:00 0 
7f337bae4000-7f337baeb000 r-xp 00000000 fd:00 201467910                  /usr/lib64/librt-2.17.so
 
7f337baeb000-7f337bcea000 ---p 00007000 fd:00 201467910                  /usr/lib64/librt-2.17.so
 
7f337bcea000-7f337bceb000 r--p 00006000 fd:00 201467910                  /usr/lib64/librt-2.17.so
 
7f337bceb000-7f337bcec000 rw-p 00007000 fd:00 201467910                  /usr/lib64/librt-2.17.so
 
7f337bcec000-7f337bcf0000 r-xp 00000000 fd:00 201413152                  /usr/lib64/libcap.so.2.22
 
7f337bcf0000-7f337beef000 ---p 00004000 fd:00 201413152                  /usr/lib64/libcap.so.2.22
 
7f337beef000-7f337bef0000 r--p 00003000 fd:00 201413152                  /usr/lib64/libcap.so.2.22
 
7f337bef0000-7f337bef1000 rw-p 00004000 fd:00 201413152                  /usr/lib64/libcap.so.2.22
 
7f337bef1000-7f337bef3000 r-xp 00000000 fd:00 201451285                  /usr/lib64/libfreebl3.so
 
7f337bef3000-7f337c0f2000 ---p 00002000 fd:00 201451285                  /usr/lib64/libfreebl3.so
 
7f337c0f2000-7f337c0f3000 r--p 00001000 fd:00 201451285                  /usr/lib64/libfreebl3.so
 
7f337c0f3000-7f337c0f4000 rw-p 00002000 fd:00 201451285                  /usr/lib64/libfreebl3.so
 
7f337c0f4000-7f337c2b7000 r-xp 00000000 fd:00 201328496                  /usr/lib64/libc-2.17.so
 
7f337c2b7000-7f337c4b7000 ---p 001c3000 fd:00 201328496                  /usr/lib64/libc-2.17.so
 
7f337c4b7000-7f337c4bb000 r--p 001c3000 fd:00 201328496                  /usr/lib64/libc-2.17.so
 
7f337c4bb000-7f337c4bd000 rw-p 001c7000 fd:00 201328496                  /usr/lib64/libc-2.17.so
 
7f337c4bd000-7f337c4c2000 rw-p 00000000 00:00 0 
7f337c4c2000-7f337c5c3000 r-xp 00000000 fd:00 201465002                  /usr/lib64/libm-2.17.so
 
7f337c5c3000-7f337c7c2000 ---p 00101000 fd:00 201465002                  /usr/lib64/libm-2.17.so
 
7f337c7c2000-7f337c7c3000 r--p 00100000 fd:00 201465002                  /usr/lib64/libm-2.17.so
 
7f337c7c3000-7f337c7c4000 rw-p 00101000 fd:00 201465002                  /usr/lib64/libm-2.17.so
 
7f337c7c4000-7f337c8ad000 r-xp 00000000 fd:00 201467670                  /usr/lib64/libstdc++.so.6.0.19
 
7f337c8ad000-7f337caac000 ---p 000e9000 fd:00 201467670                  /usr/lib64/libstdc++.so.6.0.19
 
7f337caac000-7f337cab4000 r--p 000e8000 fd:00 201467670                  /usr/lib64/libstdc++.so.6.0.19
 
7f337cab4000-7f337cab6000 rw-p 000f0000 fd:00 201467670                  /usr/lib64/libstdc++.so.6.0.19
 
7f337cab6000-7f337cacb000 rw-p 00000000 00:00 0 
7f337cacb000-7f337cacd000 r-xp 00000000 fd:00 201460300                  /usr/lib64/libdl-2.17.so
 
7f337cacd000-7f337cccd000 ---p 00002000 fd:00 201460300                  /usr/lib64/libdl-2.17.so
 
7f337cccd000-7f337ccce000 r--p 00002000 fd:00 201460300                  /usr/lib64/libdl-2.17.so
 
7f337ccce000-7f337cccf000 rw-p 00003000 fd:00 201460300                  /usr/lib64/libdl-2.17.so
 
7f337cccf000-7f337cf05000 r-xp 00000000 fd:00 201413160                  /usr/lib64/libcrypto.so.1.0.2k
 
7f337cf05000-7f337d105000 ---p 00236000 fd:00 201413160                  /usr/lib64/libcrypto.so.1.0.2k
 
7f337d105000-7f337d121000 r--p 00236000 fd:00 201413160                  /usr/lib64/libcrypto.so.1.0.2k
 
7f337d121000-7f337d12e000 rw-p 00252000 fd:00 201413160                  /usr/lib64/libcrypto.so.1.0.2k
 
7f337d12e000-7f337d132000 rw-p 00000000 00:00 0 
7f337d132000-7f337d199000 r-xp 00000000 fd:00 201413162                  /usr/lib64/libssl.so.1.0.2k
 
7f337d199000-7f337d399000 ---p 00067000 fd:00 201413162                  /usr/lib64/libssl.so.1.0.2k
 
7f337d399000-7f337d39d000 r--p 00067000 fd:00 201413162                  /usr/lib64/libssl.so.1.0.2k
 
7f337d39d000-7f337d3a4000 rw-p 0006b000 fd:00 201413162                  /usr/lib64/libssl.so.1.0.2k
 
7f337d3a4000-7f337d3d3000 r-xp 00000000 fd:00 201460191                  /usr/lib64/libsystemd.so.0.6.0
 
7f337d3d3000-7f337d5d3000 ---p 0002f000 fd:00 201460191                  /usr/lib64/libsystemd.so.0.6.0
 
7f337d5d3000-7f337d5d4000 r--p 0002f000 fd:00 201460191                  /usr/lib64/libsystemd.so.0.6.0
 
7f337d5d4000-7f337d5d5000 rw-p 00030000 fd:00 201460191                  /usr/lib64/libsystemd.so.0.6.0
 
7f337d5d5000-7f337d5dd000 r-xp 00000000 fd:00 201459630                  /usr/lib64/libcrypt-2.17.so
 
7f337d5dd000-7f337d7dc000 ---p 00008000 fd:00 201459630                  /usr/lib64/libcrypt-2.17.so
 
7f337d7dc000-7f337d7dd000 r--p 00007000 fd:00 201459630                  /usr/lib64/libcrypt-2.17.so
 
7f337d7dd000-7f337d7de000 rw-p 00008000 fd:00 201459630                  /usr/lib64/libcrypt-2.17.so
 
7f337d7de000-7f337d80c000 rw-p 00000000 00:00 0 
7f337d80c000-7f337d821000 r-xp 00000000 fd:00 201328627                  /usr/lib64/libz.so.1.2.7
 
7f337d821000-7f337da20000 ---p 00015000 fd:00 201328627                  /usr/lib64/libz.so.1.2.7
 
7f337da20000-7f337da21000 r--p 00014000 fd:00 201328627                  /usr/lib64/libz.so.1.2.7
 
7f337da21000-7f337da22000 rw-p 00015000 fd:00 201328627                  /usr/lib64/libz.so.1.2.7
 
7f337da22000-7f337da23000 r-xp 00000000 fd:00 201579862                  /usr/lib64/libaio.so.1.0.1
 
7f337da23000-7f337dc22000 ---p 00001000 fd:00 201579862                  /usr/lib64/libaio.so.1.0.1
 
7f337dc22000-7f337dc23000 r--p 00000000 fd:00 201579862                  /usr/lib64/libaio.so.1.0.1
 
7f337dc23000-7f337dc24000 rw-p 00001000 fd:00 201579862                  /usr/lib64/libaio.so.1.0.1
 
7f337dc24000-7f337dc49000 r-xp 00000000 fd:00 201328632                  /usr/lib64/liblzma.so.5.2.2
 
7f337dc49000-7f337de48000 ---p 00025000 fd:00 201328632                  /usr/lib64/liblzma.so.5.2.2
 
7f337de48000-7f337de49000 r--p 00024000 fd:00 201328632                  /usr/lib64/liblzma.so.5.2.2
 
7f337de49000-7f337de4a000 rw-p 00025000 fd:00 201328632                  /usr/lib64/liblzma.so.5.2.2
 
7f337de4a000-7f337de61000 r-xp 00000000 fd:00 201467798                  /usr/lib64/libpthread-2.17.so
 
7f337de61000-7f337e060000 ---p 00017000 fd:00 201467798                  /usr/lib64/libpthread-2.17.so
 
7f337e060000-7f337e061000 r--p 00016000 fd:00 201467798                  /usr/lib64/libpthread-2.17.so
 
7f337e061000-7f337e062000 rw-p 00017000 fd:00 201467798                  /usr/lib64/libpthread-2.17.so
 
7f337e062000-7f337e066000 rw-p 00000000 00:00 0 
7f337e066000-7f337e088000 r-xp 00000000 fd:00 201459534                  /usr/lib64/ld-2.17.so
 
7f337e088000-7f337e08b000 rw-s 00000000 00:0b 39524814                   /[aio] (deleted)
 
7f337e08b000-7f337e27e000 rw-p 00000000 00:00 0 
7f337e27e000-7f337e281000 rw-s 00000000 00:0b 39524813                   /[aio] (deleted)
 
7f337e281000-7f337e284000 rw-s 00000000 00:0b 39524812                   /[aio] (deleted)
 
7f337e284000-7f337e285000 rw-s 00000000 00:0b 39524811                   /[aio] (deleted)
 
7f337e285000-7f337e287000 rw-p 00000000 00:00 0 
7f337e287000-7f337e288000 r--p 00021000 fd:00 201459534                  /usr/lib64/ld-2.17.so
 
7f337e288000-7f337e289000 rw-p 00022000 fd:00 201459534                  /usr/lib64/ld-2.17.so
 
7f337e289000-7f337e28a000 rw-p 00000000 00:00 0 
7ffcc02aa000-7ffcc02cb000 rw-p 00000000 00:00 0                          [stack]
 
7ffcc0336000-7ffcc0338000 r-xp 00000000 00:00 0                          [vdso]
 
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]



 Comments   
Comment by Alice Sherepa [ 2019-10-10 ]

Thanks for reporting the issue!
Did you recently upgrade the server? There is a bug MDEV-20222, which claims that assertion happened on servers, where mysql_upgrade hadn't completed properly

Comment by Oren Bissick (Inactive) [ 2019-10-10 ]

Yes the server was recently upgraded from 10.3

Comment by Elena Stepanova [ 2019-10-28 ]

However, MDEV-20222 was filed as a documentation issue. I suppose the crash itself still needs to be looked at.

Comment by Ian Gilfillan [ 2019-11-20 ]

jplindst It should not be necessary for the Unix user running mysql_upgrade to have write permission to the mysql data directory, correct? So MDEV-20222 isn't a documentation bug, but is probably related to this.

Comment by Laurent Gougeon [ 2019-11-27 ]

I had the same issue today on CentOS 7 but I did not do a mysql_upgrade:

2019-11-27 12:02:25 32 [Note] WSREP: Wsrep_rollback_local
mysqld: /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.4.10/wsrep-lib/src/transaction.cpp:1038:
void wsrep::transaction::after_replay(const wsrep::transaction&): Assertion `other.state() == s_committed || other.state() == s_aborted' failed.
191127 12:02:28 [ERROR] mysqld got signal 6 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.

To report this bug, see https://mariadb.com/kb/en/reporting-bugs

We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.

Server version: 10.4.10-MariaDB
key_buffer_size=134217728
read_buffer_size=131072
max_used_connections=16
max_threads=192
thread_count=25
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 1733209 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.

Thread pointer: 0x7f6a780511d8
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0x7f7db4090cc0 thread_stack 0x49000
/usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x557ff69fcf2e]
/usr/sbin/mysqld(handle_fatal_signal+0x30f)[0x557ff64933af]
/lib64/libpthread.so.0(+0xf5d0)[0x7f7dd152d5d0]
/lib64/libc.so.6(gsignal+0x37)[0x7f7dcf801207]
/lib64/libc.so.6(abort+0x148)[0x7f7dcf8028f8]
/lib64/libc.so.6(+0x2f026)[0x7f7dcf7fa026]
/lib64/libc.so.6(+0x2f0d2)[0x7f7dcf7fa0d2]
/usr/sbin/mysqld(+0xea1a58)[0x557ff6a8da58]
/usr/sbin/mysqld(_ZN22Wsrep_replayer_serviceD2Ev+0x60)[0x557ff63ed710]
/usr/sbin/mysqld(_ZN20Wsrep_client_service6replayEv+0x105)[0x557ff63ec205]
/usr/sbin/mysqld(_ZN5wsrep11transaction15after_statementEv+0xde)[0x557ff6a946de]
/usr/sbin/mysqld(_ZN5wsrep12client_state15after_statementEv+0x7d)[0x557ff6a7f4ad]
/usr/sbin/mysqld(+0x6a253d)[0x557ff628e53d]
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0x2b2e)[0x557ff62918be]
/usr/sbin/mysqld(_Z10do_commandP3THD+0x11c)[0x557ff629207c]
/usr/sbin/mysqld(_Z24do_handle_one_connectionP7CONNECT+0x1fa)[0x557ff636dafa]
/usr/sbin/mysqld(handle_one_connection+0x3d)[0x557ff636dbdd]
/usr/sbin/mysqld(+0xdc26ad)[0x557ff69ae6ad]
/lib64/libpthread.so.0(+0x7dd5)[0x7f7dd1525dd5]
/lib64/libc.so.6(clone+0x6d)[0x7f7dcf8c8ead]

Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (0x0):
Connection ID (thread ID): 1
Status: NOT_KILLED

Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,
derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,
mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,
extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on

The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
information that should help you find out what is causing the crash.
Writing a core file...
Working directory at /var/lib/mysql
Resource Limits:
Limit Soft Limit Hard Limit Units
Max cpu time unlimited unlimited seconds
Max file size unlimited unlimited bytes
Max data size unlimited unlimited bytes
Max stack size 8388608 unlimited bytes
Max core file size 0 unlimited bytes
Max resident set unlimited unlimited bytes
Max processes 514863 514863 processes
Max open files 16364 16364 files
Max locked memory 65536 65536 bytes
Max address space unlimited unlimited bytes
Max file locks unlimited unlimited locks
Max pending signals 514863 514863 signals
Max msgqueue size 819200 819200 bytes
Max nice priority 0 0
Max realtime priority 0 0
Max realtime timeout unlimited unlimited us
Core pattern: core

Comment by Boris [ 2019-12-04 ]

This was not resolved in mariadb version 10.4.10
this problem got out as well:

Dec 4 04:07:51 mysql1 mysqld: mysqld: /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.4.10/wsrep-lib/src/transaction.cpp:1038: void wsrep::transaction::after_replay(const wsrep::transaction&): Assertion `other.state() == s_committed || other.state() == s_aborted' failed.
Dec 4 04:07:51 mysql1 mysqld: 191204 4:07:51 [ERROR] mysqld got signal 6 ;

After the error, mysql itself restarted and connected to the cluster, but its status changed to:

wsrep_local_state_comment Joining: receiving State Transfer

we did not update from old versions
originally built the cluster on version 10.4.10

there are no other errors preceding this failure.

it is not clear how to repeat the problem
since at the time of the problem no special actions with the cluster and specifically with this node were done

Comment by Hoggins! [ 2019-12-24 ]

Exact same issue here with a MariaDB-server-10.4.11 package from official MariaDB for Fedora. I had to reset some failing nodes and so I lost their logs, but it will happen again (has done so for a couple of weeks) so I will provide them. But that's the exact same message as the ones aforementioned.

Comment by Hoggins! [ 2019-12-26 ]

There! I knew I wouldn't have to wait for too long:

mysqld: /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.4.11/wsrep-lib/src/transaction.cpp:1038: void wsrep::transaction::after_replay(const wsrep::transaction&): Assertion `oth
 
er.state() == s_committed || other.state() == s_aborted' failed.
 
191226 12:02:53 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.4.11-MariaDB-log
 
key_buffer_size=134217728
 
read_buffer_size=131072
 
max_used_connections=129
 
max_threads=302
 
thread_count=141
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 795643 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x7fb2a43d40c8
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x7fb1062b5dd8 thread_stack 0x49000
 
/usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x556902698ede]
 
/usr/sbin/mysqld(handle_fatal_signal+0x54d)[0x55690213ed6d]
 
sigaction.c:0(__restore_rt)[0x7fb3f5f6eb20]
 
:0(__GI_raise)[0x7fb3f5541625]
 
:0(__GI_abort)[0x7fb3f552a8d9]
 
loadmsgcat.c:0(_nl_load_domain.cold)[0x7fb3f552a7a9]
 
assert.c:0(.annobin_assert.c_end)[0x7fb3f5539a66]
 
/usr/sbin/mysqld(+0xe6b6c6)[0x5569027086c6]
 
/usr/sbin/mysqld(_ZN22Wsrep_replayer_serviceD2Ev+0x5f)[0x5569020a18bf]
 
/usr/sbin/mysqld(_ZN20Wsrep_client_service6replayEv+0x10d)[0x55690209f81d]
 
/usr/sbin/mysqld(_ZN5wsrep11transaction15after_statementEv+0x316)[0x55690270fe66]
 
/usr/sbin/mysqld(_ZN5wsrep12client_state15after_statementEv+0xcf)[0x5569026faa9f]
 
/usr/sbin/mysqld(+0x68c6f3)[0x556901f296f3]
 
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0x2fa1)[0x556901f2cf61]
 
/usr/sbin/mysqld(_Z10do_commandP3THD+0x15e)[0x556901f2da0e]
 
/usr/sbin/mysqld(_Z24do_handle_one_connectionP7CONNECT+0x21e)[0x55690201a6ee]
 
/usr/sbin/mysqld(handle_one_connection+0x3b)[0x55690201a80b]
 
pthread_create.c:0(start_thread)[0x7fb3f5f634e2]
 
:0(__GI___clone)[0x7fb3f5606693]
 
 
 
Trying to get some variables.
 
Some pointers may be invalid and cause the dump to abort.
 
Query (0x0): 
Connection ID (thread ID): 1
 
Status: NOT_KILLED
 
 
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on
 
 
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
Writing a core file...
 
Working directory at /var/lib/mysql_root/mysql
 
Resource Limits:
 
Limit                     Soft Limit           Hard Limit           Units     
Max cpu time              unlimited            unlimited            seconds   
Max file size             unlimited            unlimited            bytes     
Max data size             unlimited            unlimited            bytes     
Max stack size            8388608              unlimited            bytes     
Max core file size        unlimited            unlimited            bytes     
Max resident set          unlimited            unlimited            bytes     
Max processes             23641                23641                processes 
Max open files            16364                16364                files     
Max locked memory         65536                65536                bytes     
Max address space         unlimited            unlimited            bytes     
Max file locks            unlimited            unlimited            locks     
Max pending signals       23641                23641                signals   
Max msgqueue size         819200               819200               bytes     
Max nice priority         0                    0                    
Max realtime priority     0                    0                    
Max realtime timeout      unlimited            unlimited            us        
Core pattern: |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h

Comment by Mark Hughes [ 2019-12-26 ]

We're still suffering from the same problem - sometimes a couple of times a day. There are a few things I've noticed:
1 - It has only occurred on virtual machines / VPS's - never on our bare-metal dedicated server
2 - It only seems to occur on nodes that have writes going to them. I've had two nodes that fail consistently not go down for the last couple of days as they are only part of the cluster - but not receiving direct writes

Generated at Thu Feb 08 09:02:13 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.