Details
-
Bug
-
Status: Closed (View Workflow)
-
Blocker
-
Resolution: Fixed
-
10.4.18, 10.5.9
-
None
-
Ubuntu 20.04.2 LTS
Description
Was unable to run 10.5.8 in multi master due to locking issues (MDEV-23328?) and upgraded to 10.5.9 hoping for resolution.
Unfortunately, it is now even more unstable with the following error appearing on nodes within a few minutes of uptime.
mariadbd: /home/buildbot/buildbot/build/mariadb-10.5.9/wsrep-lib/include/wsrep/client_state.hpp:508: int wsrep::client_state::ordered_commit(): Assertion `owning_thread_id_ == wsrep::this_thread::get_id()' failed.
210222 16:39:07 [ERROR] mysqld got signal 6 ;
Attachments
- log_other_node.txt
- 16 kB
Issue Links
- is duplicated by
-
MDEV-24991 mariadb-10.5.9/wsrep-lib/include/wsrep/client_state.hpp:508: int wsrep::client_state::ordered_commit(): Assertion `owning_thread_id_ == wsrep::this_thread::get_id()' failed
-
- Closed
-
Activity
I have seen similar issue in current 10.6 development HEAD, and it has a tentative fix in testing now. However, I thought that the issue should not reproducible in 10.5 and earlier.
@Steve Hunger Do you have log_slave_updates in your configuration? (you should)
Traditional MariaDB Replication isn't used, therfore log_slave_update was off. I enabled it on all nodes and was able to upgrade the same node from 10.4.15 to 10.4.18 without any crash. I will let this node sit around for some time and report back if it's stable now.
- Repeated similar assertion with galera_bf_kill_debug test case
Program terminated with signal SIGABRT, Aborted.
#0 __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:54
54 ../sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.
[Current thread is 1 (Thread 0x7fec18714640 (LWP 1628044))]
#0 __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:54
#1 0x000055cca3ae6ddf in my_write_core (sig=6) at /home/jan/mysql/10.5/mysys/stacktrace.c:424
#2 0x000055cca31c4907 in handle_fatal_signal (sig=6) at /home/jan/mysql/10.5/sql/signal_handler.cc:331
#3 <signal handler called>
#4 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:49
#5 0x00007fec447c1864 in __GI_abort () at abort.c:79
#6 0x00007fec447c1749 in __assert_fail_base (fmt=0x7fec4494d458 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=0x55cca419e770 "wsrep::this_thread::get_id() == owning_thread_id_", file=0x55cca419e660 "/home/jan/mysql/10.5/wsrep-lib/src/client_state.cpp", line=832, function=<optimized out>) at assert.c:92
#7 0x00007fec447d3a96 in __GI___assert_fail (assertion=0x55cca419e770 "wsrep::this_thread::get_id() == owning_thread_id_", file=0x55cca419e660 "/home/jan/mysql/10.5/wsrep-lib/src/client_state.cpp", line=832, function=0x55cca419f8d0 "void wsrep::client_state::state(wsrep::unique_lock<wsrep::mutex>&, wsrep::client_state::state)") at assert.c:101
#8 0x000055cca3b84290 in wsrep::client_state::state (this=0x7fec0c0089c8, lock=..., state=wsrep::client_state::s_quitting) at /home/jan/mysql/10.5/wsrep-lib/src/client_state.cpp:832
#9 0x000055cca3b80d4b in wsrep::client_state::close (this=0x7fec0c0089c8) at /home/jan/mysql/10.5/wsrep-lib/src/client_state.cpp:52
#10 0x000055cca3000b8e in wsrep_close (thd=0x7fec0c002548) at /home/jan/mysql/10.5/sql/wsrep_trans_observer.h:462
#11 0x000055cca3003a48 in end_connection (thd=0x7fec0c002548) at /home/jan/mysql/10.5/sql/sql_connect.cc:1192
#12 0x000055cca300420e in do_handle_one_connection (connect=0x55cca763c938, put_in_cache=true) at /home/jan/mysql/10.5/sql/sql_connect.cc:1413
#13 0x000055cca3003f5e in handle_one_connection (arg=0x55cca763c938) at /home/jan/mysql/10.5/sql/sql_connect.cc:1312
#14 0x000055cca3522f65 in pfs_spawn_thread (arg=0x55cca763bd08) at /home/jan/mysql/10.5/storage/perfschema/pfs.cc:2201
#15 0x00007fec44ce1590 in start_thread (arg=0x7fec18714640) at pthread_create.c:463
#16 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 32 (Thread 0x7febeffff640 (LWP 1627956)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7febefffeaf0, clockid=-268441104, expected=0, futex_word=0x55cca70af8fc) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7febefffeaf0, clockid=-268441104, mutex=0x55cca70a0040, cond=0x55cca70af8d0) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70af8d0, mutex=0x55cca70a0040, abstime=0x7febefffeaf0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70af8d0, __mutex=0x55cca70a0040, __abs_timeout=0x7febefffeaf0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af8d0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af8d0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70af8d0, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70af8d0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70af8d0, t=0x7febefffec58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70af8d0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf8001538: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf8001530: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf8001538: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf8001528) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf8001528) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf8001520) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7febeffff640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 31 (Thread 0x7febecff9640 (LWP 1627962)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7febecff8af0, clockid=-318797328, expected=0, futex_word=0x55cca70af5fc) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7febecff8af0, clockid=-318797328, mutex=0x55cca70a0040, cond=0x55cca70af5d0) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70af5d0, mutex=0x55cca70a0040, abstime=0x7febecff8af0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70af5d0, __mutex=0x55cca70a0040, __abs_timeout=0x7febecff8af0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af5d0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af5d0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70af5d0, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70af5d0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70af5d0, t=0x7febecff8c58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70af5d0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf8001ef8: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf8001ef0: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf8001ef8: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf8001ee8) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf8001ee8) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf8001ee0) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7febecff9640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 30 (Thread 0x7febd77fe640 (LWP 1627964)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7febd77fdaf0, clockid=-679486992, expected=0, futex_word=0x55cca70af4fc) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7febd77fdaf0, clockid=-679486992, mutex=0x55cca70a0040, cond=0x55cca70af4d0) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70af4d0, mutex=0x55cca70a0040, abstime=0x7febd77fdaf0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70af4d0, __mutex=0x55cca70a0040, __abs_timeout=0x7febd77fdaf0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af4d0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af4d0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70af4d0, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70af4d0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70af4d0, t=0x7febd77fdc58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70af4d0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf8002238: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf8002230: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf8002238: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf8002228) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf8002228) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf8002220) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7febd77fe640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 29 (Thread 0x7febed7fa640 (LWP 1627961)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7febed7f9af0, clockid=-310404624, expected=0, futex_word=0x55cca70af67c) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7febed7f9af0, clockid=-310404624, mutex=0x55cca70a0040, cond=0x55cca70af650) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70af650, mutex=0x55cca70a0040, abstime=0x7febed7f9af0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70af650, __mutex=0x55cca70a0040, __abs_timeout=0x7febed7f9af0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af650, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af650, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70af650, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70af650) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70af650, t=0x7febed7f9c58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70af650) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf8001d58: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf8001d50: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf8001d58: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf8001d48) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf8001d48) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf8001d40) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7febed7fa640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 28 (Thread 0x7febee7fc640 (LWP 1627959)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7febee7fbaf0, clockid=-293619216, expected=0, futex_word=0x55cca70af77c) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7febee7fbaf0, clockid=-293619216, mutex=0x55cca70a0040, cond=0x55cca70af750) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70af750, mutex=0x55cca70a0040, abstime=0x7febee7fbaf0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70af750, __mutex=0x55cca70a0040, __abs_timeout=0x7febee7fbaf0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af750, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af750, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70af750, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70af750) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70af750, t=0x7febee7fbc58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70af750) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf8001a18: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf8001a10: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf8001a18: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf8001a08) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf8001a08) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf8001a00) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7febee7fc640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 27 (Thread 0x7fec097fa640 (LWP 1627941)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fec097f9af0, clockid=159357424, expected=0, futex_word=0x55cca70af9f8) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7fec097f9af0, clockid=159357424, mutex=0x55cca70a0040, cond=0x55cca70af9d0) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70af9d0, mutex=0x55cca70a0040, abstime=0x7fec097f9af0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70af9d0, __mutex=0x55cca70a0040, __abs_timeout=0x7fec097f9af0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af9d0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af9d0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70af9d0, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70af9d0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70af9d0, t=0x7fec097f9c58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70af9d0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf80011f8: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf80011f0: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf80011f8: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf80011e8) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf80011e8) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf80011e0) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7fec097fa640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 26 (Thread 0x7fec1875f640 (LWP 1627975)):
#0 __lll_lock_wait (futex=futex@entry=0x7fec0c0042c0, private=0) at lowlevellock.c:52
#1 0x00007fec44ce3a95 in __GI___pthread_mutex_lock (mutex=0x7fec0c0042c0) at ../nptl/pthread_mutex_lock.c:135
#2 0x000055cca3aebba3 in safe_mutex_lock (mp=0x7fec0c004298, my_flags=0, file=0x55cca3ec0b00 "/home/jan/mysql/10.5/sql/wsrep_mysqld.cc", line=2481) at /home/jan/mysql/10.5/mysys/thr_mutex.c:290
#3 0x000055cca35b8e42 in inline_mysql_mutex_lock (that=0x7fec0c004298, src_file=0x55cca3ec0b00 "/home/jan/mysql/10.5/sql/wsrep_mysqld.cc", src_line=2481) at /home/jan/mysql/10.5/include/mysql/psi/mysql_thread.h:750
#4 0x000055cca35c0bcd in wsrep_handle_mdl_conflict (requestor_ctx=0x7fec10002258, ticket=0x7fec0c001630, key=0x7fec10166688) at /home/jan/mysql/10.5/sql/wsrep_mysqld.cc:2481
#5 0x000055cca3013c87 in MDL_lock::can_grant_lock (this=0x7fec10166688, type_arg=MDL_EXCLUSIVE, requestor_ctx=0x7fec10002258, ignore_lock_priority=false) at /home/jan/mysql/10.5/sql/mdl.cc:1752
#6 0x000055cca30146c4 in MDL_context::try_acquire_lock_impl (this=0x7fec10002258, mdl_request=0x7fec10015aa8, out_ticket=0x7fec1875d6f0) at /home/jan/mysql/10.5/sql/mdl.cc:2090
#7 0x000055cca3014bdb in MDL_context::acquire_lock (this=0x7fec10002258, mdl_request=0x7fec10015aa8, lock_wait_timeout=86400) at /home/jan/mysql/10.5/sql/mdl.cc:2248
#8 0x000055cca30156ac in MDL_context::acquire_locks (this=0x7fec10002258, mdl_requests=0x7fec1875d8a0, lock_wait_timeout=86400) at /home/jan/mysql/10.5/sql/mdl.cc:2459
#9 0x000055cca2db3d30 in lock_table_names (thd=0x7fec10002138, options=..., tables_start=0x7fec10015660, tables_end=0x0, lock_wait_timeout=86400, flags=0) at /home/jan/mysql/10.5/sql/sql_base.cc:4039
#10 0x000055cca2f47b6d in lock_table_names (thd=0x7fec10002138, table_list=0x7fec10015660, table_list_end=0x0, lock_wait_timeout=86400, flags=0) at /home/jan/mysql/10.5/sql/sql_base.h:252
#11 0x000055cca2f4d42c in mysql_rm_table (thd=0x7fec10002138, tables=0x7fec10015660, if_exists=false, drop_temporary=false, drop_sequence=false, dont_log_query=false) at /home/jan/mysql/10.5/sql/sql_table.cc:2082
#12 0x000055cca2e612b9 in mysql_execute_command (thd=0x7fec10002138) at /home/jan/mysql/10.5/sql/sql_parse.cc:5007
#13 0x000055cca2e6b3fc in mysql_parse (thd=0x7fec10002138, rawbuf=0x7fec100155b0 "drop table t1", length=13, parser_state=0x7fec1875e3f0, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.5/sql/sql_parse.cc:8089
#14 0x000055cca2e6aaff in wsrep_mysql_parse (thd=0x7fec10002138, rawbuf=0x7fec100155b0 "drop table t1", length=13, parser_state=0x7fec1875e3f0, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.5/sql/sql_parse.cc:7892
#15 0x000055cca2e571e0 in dispatch_command (command=COM_QUERY, thd=0x7fec10002138, packet=0x7fec1000b869 "drop table t1", packet_length=13, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.5/sql/sql_parse.cc:1875
#16 0x000055cca2e55acf in do_command (thd=0x7fec10002138) at /home/jan/mysql/10.5/sql/sql_parse.cc:1370
#17 0x000055cca30041fb in do_handle_one_connection (connect=0x55cca763d278, put_in_cache=true) at /home/jan/mysql/10.5/sql/sql_connect.cc:1410
#18 0x000055cca3003f5e in handle_one_connection (arg=0x55cca7606fb8) at /home/jan/mysql/10.5/sql/sql_connect.cc:1312
#19 0x000055cca3522f65 in pfs_spawn_thread (arg=0x55cca6fab3f8) at /home/jan/mysql/10.5/storage/perfschema/pfs.cc:2201
#20 0x00007fec44ce1590 in start_thread (arg=0x7fec1875f640) at pthread_create.c:463
#21 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 25 (Thread 0x7fec186c9640 (LWP 1628045)):
#0 0x00007fec448a866f in __GI___poll (fds=0x7fec186c89d8, nfds=1, timeout=28800000) at ../sysdeps/unix/sysv/linux/poll.c:29
#1 0x000055cca3414bd9 in vio_io_wait (vio=0x7fec1400c5d8, event=VIO_IO_EVENT_READ, timeout=28800000) at /home/jan/mysql/10.5/vio/viosocket.c:1000
#2 0x000055cca34130d4 in vio_socket_io_wait (vio=0x7fec1400c5d8, event=VIO_IO_EVENT_READ) at /home/jan/mysql/10.5/vio/viosocket.c:118
#3 0x000055cca34132e0 in vio_read (vio=0x7fec1400c5d8, buf=0x7fec1400c868 "\a", size=4) at /home/jan/mysql/10.5/vio/viosocket.c:199
#4 0x000055cca336205d in my_real_read (net=0x7fec14002380, complen=0x7fec186c8bf0, header=1 '\001') at /home/jan/mysql/10.5/sql/net_serv.cc:979
#5 0x000055cca336296b in my_net_read_packet_reallen (net=0x7fec14002380, read_from_server=1 '\001', reallen=0x7fec186c8c58) at /home/jan/mysql/10.5/sql/net_serv.cc:1260
#6 0x000055cca336291b in my_net_read_packet (net=0x7fec14002380, read_from_server=1 '\001') at /home/jan/mysql/10.5/sql/net_serv.cc:1244
#7 0x000055cca2e5540e in do_command (thd=0x7fec14002078) at /home/jan/mysql/10.5/sql/sql_parse.cc:1234
#8 0x000055cca30041fb in do_handle_one_connection (connect=0x55cca761a558, put_in_cache=true) at /home/jan/mysql/10.5/sql/sql_connect.cc:1410
#9 0x000055cca3003f5e in handle_one_connection (arg=0x55cca761a558) at /home/jan/mysql/10.5/sql/sql_connect.cc:1312
#10 0x000055cca3522f65 in pfs_spawn_thread (arg=0x55cca7638138) at /home/jan/mysql/10.5/storage/perfschema/pfs.cc:2201
#11 0x00007fec44ce1590 in start_thread (arg=0x7fec186c9640) at pthread_create.c:463
#12 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 24 (Thread 0x7fec45263640 (LWP 1627721)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fec45262d30, clockid=1160129216, expected=0, futex_word=0x55cca507c968 <COND_timer+40>) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7fec45262d30, clockid=1160129216, mutex=0x55cca507c8a8 <LOCK_timer+40>, cond=0x55cca507c940 <COND_timer>) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca507c940 <COND_timer>, mutex=0x55cca507c8a8 <LOCK_timer+40>, abstime=0x7fec45262d30) at pthread_cond_wait.c:656
#3 0x000055cca3aec8e4 in safe_cond_timedwait (cond=0x55cca507c940 <COND_timer>, mp=0x55cca507c880 <LOCK_timer>, abstime=0x7fec45262d30, file=0x55cca404c2e0 "/home/jan/mysql/10.5/include/mysql/psi/mysql_thread.h", line=1259) at /home/jan/mysql/10.5/mysys/thr_mutex.c:546
#4 0x000055cca3aed968 in inline_mysql_cond_timedwait (that=0x55cca507c940 <COND_timer>, mutex=0x55cca507c880 <LOCK_timer>, abstime=0x7fec45262d30, src_file=0x55cca404c318 "/home/jan/mysql/10.5/mysys/thr_timer.c", src_line=321) at /home/jan/mysql/10.5/include/mysql/psi/mysql_thread.h:1259
#5 0x000055cca3aee66b in timer_handler (arg=0x0) at /home/jan/mysql/10.5/mysys/thr_timer.c:321
#6 0x000055cca3522f65 in pfs_spawn_thread (arg=0x55cca6f43b48) at /home/jan/mysql/10.5/storage/perfschema/pfs.cc:2201
#7 0x00007fec44ce1590 in start_thread (arg=0x7fec45263640) at pthread_create.c:463
#8 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 23 (Thread 0x7febedffb640 (LWP 1627960)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7febedffaaf0, clockid=-302011920, expected=0, futex_word=0x55cca70af6f8) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7febedffaaf0, clockid=-302011920, mutex=0x55cca70a0040, cond=0x55cca70af6d0) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70af6d0, mutex=0x55cca70a0040, abstime=0x7febedffaaf0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70af6d0, __mutex=0x55cca70a0040, __abs_timeout=0x7febedffaaf0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af6d0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af6d0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70af6d0, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70af6d0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70af6d0, t=0x7febedffac58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70af6d0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf8001bb8: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf8001bb0: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf8001bb8: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf8001ba8) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf8001ba8) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf8001ba0) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7febedffb640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 22 (Thread 0x7febd6ffd640 (LWP 1627965)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7febd6ffcaf0, clockid=-687879696, expected=0, futex_word=0x55cca70af47c) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7febd6ffcaf0, clockid=-687879696, mutex=0x55cca70a0040, cond=0x55cca70af450) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70af450, mutex=0x55cca70a0040, abstime=0x7febd6ffcaf0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70af450, __mutex=0x55cca70a0040, __abs_timeout=0x7febd6ffcaf0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af450, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af450, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70af450, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70af450) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70af450, t=0x7febd6ffcc58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70af450) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf80023d8: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf80023d0: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf80023d8: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf80023c8) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf80023c8) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf80023c0) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7febd6ffd640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 21 (Thread 0x7fec0bfff640 (LWP 1627936)):
#0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55cca45d4fe8 <buf_pool+1128>) at ../sysdeps/nptl/futex-internal.h:183
#1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x55cca45d4ee8 <buf_pool+872>, cond=0x55cca45d4fc0 <buf_pool+1088>) at pthread_cond_wait.c:508
#2 __pthread_cond_wait (cond=0x55cca45d4fc0 <buf_pool+1088>, mutex=0x55cca45d4ee8 <buf_pool+872>) at pthread_cond_wait.c:638
#3 0x000055cca3aec522 in safe_cond_wait (cond=0x55cca45d4fc0 <buf_pool+1088>, mp=0x55cca45d4ec0 <buf_pool+832>, file=0x55cca3fda1c0 "/home/jan/mysql/10.5/storage/innobase/buf/buf0flu.cc", line=2133) at /home/jan/mysql/10.5/mysys/thr_mutex.c:492
#4 0x000055cca393a753 in buf_flush_page_cleaner () at /home/jan/mysql/10.5/storage/innobase/buf/buf0flu.cc:2133
#5 0x00007fec44ce1590 in start_thread (arg=0x7fec0bfff640) at pthread_create.c:463
#6 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 20 (Thread 0x7febd67fc640 (LWP 1627966)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7febd67fbaf0, clockid=-696272400, expected=0, futex_word=0x55cca70af3f8) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7febd67fbaf0, clockid=-696272400, mutex=0x55cca70a0040, cond=0x55cca70af3d0) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70af3d0, mutex=0x55cca70a0040, abstime=0x7febd67fbaf0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70af3d0, __mutex=0x55cca70a0040, __abs_timeout=0x7febd67fbaf0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af3d0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af3d0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70af3d0, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70af3d0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70af3d0, t=0x7febd67fbc58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70af3d0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf8002578: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf8002570: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf8002578: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf8002568) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf8002568) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf8002560) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7febd67fc640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 19 (Thread 0x7fec09ffb640 (LWP 1627940)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fec09ffaaf0, clockid=167750128, expected=0, futex_word=0x55cca70afa78) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7fec09ffaaf0, clockid=167750128, mutex=0x55cca70a0040, cond=0x55cca70afa50) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70afa50, mutex=0x55cca70a0040, abstime=0x7fec09ffaaf0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70afa50, __mutex=0x55cca70a0040, __abs_timeout=0x7fec09ffaaf0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70afa50, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70afa50, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70afa50, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70afa50) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70afa50, t=0x7fec09ffac58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70afa50) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf8001058: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf8001050: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf8001058: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf8001048) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf8001048) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf8001040) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7fec09ffb640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 18 (Thread 0x7febef7fe640 (LWP 1627957)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7febef7fdaf0, clockid=-276833808, expected=0, futex_word=0x55cca70af878) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7febef7fdaf0, clockid=-276833808, mutex=0x55cca70a0040, cond=0x55cca70af850) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70af850, mutex=0x55cca70a0040, abstime=0x7febef7fdaf0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70af850, __mutex=0x55cca70a0040, __abs_timeout=0x7febef7fdaf0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af850, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af850, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70af850, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70af850) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70af850, t=0x7febef7fdc58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70af850) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf80016d8: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf80016d0: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf80016d8: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf80016c8) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf80016c8) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf80016c0) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7febef7fe640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 17 (Thread 0x7fec1a5f8640 (LWP 1627934)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fec1a5f7c80, clockid=442464816, expected=0, futex_word=0x55cca4fd4428 <COND_checkpoint+40>) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7fec1a5f7c80, clockid=442464816, mutex=0x55cca4fd4368 <LOCK_checkpoint+40>, cond=0x55cca4fd4400 <COND_checkpoint>) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca4fd4400 <COND_checkpoint>, mutex=0x55cca4fd4368 <LOCK_checkpoint+40>, abstime=0x7fec1a5f7c80) at pthread_cond_wait.c:656
#3 0x000055cca3aec8e4 in safe_cond_timedwait (cond=0x55cca4fd4400 <COND_checkpoint>, mp=0x55cca4fd4340 <LOCK_checkpoint>, abstime=0x7fec1a5f7c80, file=0x55cca3e48610 "/home/jan/mysql/10.5/include/mysql/psi/mysql_thread.h", line=1259) at /home/jan/mysql/10.5/mysys/thr_mutex.c:546
#4 0x000055cca34719d7 in inline_mysql_cond_timedwait (that=0x55cca4fd4400 <COND_checkpoint>, mutex=0x55cca4fd4340 <LOCK_checkpoint>, abstime=0x7fec1a5f7c80, src_file=0x55cca3e48648 "/home/jan/mysql/10.5/storage/maria/ma_servicethread.c", src_line=115) at /home/jan/mysql/10.5/include/mysql/psi/mysql_thread.h:1259
#5 0x000055cca3471f28 in my_service_thread_sleep (control=0x55cca45c52c0 <checkpoint_control>, sleep_time=29000000000) at /home/jan/mysql/10.5/storage/maria/ma_servicethread.c:115
#6 0x000055cca3465a15 in ma_checkpoint_background (arg=0x1e) at /home/jan/mysql/10.5/storage/maria/ma_checkpoint.c:707
#7 0x000055cca3522f65 in pfs_spawn_thread (arg=0x55cca7084a08) at /home/jan/mysql/10.5/storage/perfschema/pfs.cc:2201
#8 0x00007fec44ce1590 in start_thread (arg=0x7fec1a5f8640) at pthread_create.c:463
#9 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 16 (Thread 0x7febeeffd640 (LWP 1627958)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7febeeffcaf0, clockid=-285226512, expected=0, futex_word=0x55cca70af7fc) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7febeeffcaf0, clockid=-285226512, mutex=0x55cca70a0040, cond=0x55cca70af7d0) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70af7d0, mutex=0x55cca70a0040, abstime=0x7febeeffcaf0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70af7d0, __mutex=0x55cca70a0040, __abs_timeout=0x7febeeffcaf0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af7d0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af7d0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70af7d0, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70af7d0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70af7d0, t=0x7febeeffcc58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70af7d0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf8001878: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf8001870: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf8001878: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf8001868) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf8001868) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf8001860) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7febeeffd640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 15 (Thread 0x7fec401b3640 (LWP 1627739)):
#0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7fec403000e4) at ../sysdeps/nptl/futex-internal.h:183
#1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x7fec40300090, cond=0x7fec403000b8) at pthread_cond_wait.c:508
#2 __pthread_cond_wait (cond=0x7fec403000b8, mutex=0x7fec40300090) at pthread_cond_wait.c:638
#3 0x00007fec3bede5d0 in fifo_lock_get (q=0x7fec40300010) at /home/jan/mysql/mariadb-galeralib/galerautils/src/gu_fifo.c:262
#4 0x00007fec3bede81d in gu_fifo_get_head (q=0x7fec40300010, err=0x7fec401b274c) at /home/jan/mysql/mariadb-galeralib/galerautils/src/gu_fifo.c:330
#5 0x00007fec3bd5a8f4 in gcs_recv (conn=0x55cca6f90cf0, action=0x7fec401b27f0) at /home/jan/mysql/mariadb-galeralib/gcs/src/gcs.cpp:2047
#6 0x00007fec3bcf8943 in galera::Gcs::recv (this=0x55cca6f87b08, act=...) at /home/jan/mysql/mariadb-galeralib/galera/src/galera_gcs.hpp:120
#7 0x00007fec3bd3a5b1 in galera::GcsActionSource::process (this=0x55cca6fb9500, recv_ctx=0x7fec401b2c60, exit_loop=@0x7fec401b29da: false) at /home/jan/mysql/mariadb-galeralib/galera/src/gcs_action_source.cpp:162
#8 0x00007fec3bce18ea in galera::ReplicatorSMM::async_recv (this=0x55cca6f87340, recv_ctx=0x7fec401b2c60) at /home/jan/mysql/mariadb-galeralib/galera/src/replicator_smm.cpp:390
#9 0x00007fec3bcb9738 in galera_recv (gh=0x55cca6f541a0, recv_ctx=0x7fec401b2c60) at /home/jan/mysql/mariadb-galeralib/galera/src/wsrep_provider.cpp:236
#10 0x000055cca3ba6c3e in wsrep::wsrep_provider_v26::run_applier (this=0x55cca6e40460, applier_ctx=0x7fec401b2c60) at /home/jan/mysql/10.5/wsrep-lib/src/wsrep_provider_v26.cpp:743
#11 0x000055cca35d2eda in wsrep_replication_process (thd=0x7fec1c000ff8, arg=0x55cca6f21240) at /home/jan/mysql/10.5/sql/wsrep_thd.cc:57
#12 0x000055cca35c2e1e in start_wsrep_THD (arg=0x55cca6f21240) at /home/jan/mysql/10.5/sql/wsrep_mysqld.cc:3050
#13 0x000055cca3522f65 in pfs_spawn_thread (arg=0x55cca6fab3f8) at /home/jan/mysql/10.5/storage/perfschema/pfs.cc:2201
#14 0x00007fec44ce1590 in start_thread (arg=0x7fec401b3640) at pthread_create.c:463
#15 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 14 (Thread 0x7fec0b7fe640 (LWP 1627937)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fec0b7fdaf0, clockid=192928240, expected=0, futex_word=0x55cca70afbf8) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7fec0b7fdaf0, clockid=192928240, mutex=0x55cca70a0040, cond=0x55cca70afbd0) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70afbd0, mutex=0x55cca70a0040, abstime=0x7fec0b7fdaf0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70afbd0, __mutex=0x55cca70a0040, __abs_timeout=0x7fec0b7fdaf0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70afbd0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70afbd0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70afbd0, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70afbd0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70afbd0, t=0x7fec0b7fdc58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70afbd0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf8000b78: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf8000b70: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf8000b78: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf8000b68) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf8000b68) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf8000b60) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7fec0b7fe640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 13 (Thread 0x7febd7fff640 (LWP 1627963)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7febd7ffeaf0, clockid=-671094288, expected=0, futex_word=0x55cca70af57c) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7febd7ffeaf0, clockid=-671094288, mutex=0x55cca70a0040, cond=0x55cca70af550) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70af550, mutex=0x55cca70a0040, abstime=0x7febd7ffeaf0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70af550, __mutex=0x55cca70a0040, __abs_timeout=0x7febd7ffeaf0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af550, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af550, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70af550, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70af550) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70af550, t=0x7febd7ffec58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70af550) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf8002098: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf8002090: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf8002098: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf8002088) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf8002088) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf8002080) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7febd7fff640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 12 (Thread 0x7fec187f5640 (LWP 1627968)):
#0 0x00007fec447dd6c2 in __GI___sigtimedwait (set=0x7fec187f4cb0, info=0x7fec187f4bd0, timeout=0x0) at ../sysdeps/unix/sysv/linux/sigtimedwait.c:29
#1 0x000055cca2d04a19 in my_sigwait (set=0x7fec187f4cb0, sig=0x7fec187f4c74, code=0x7fec187f4c78) at /home/jan/mysql/10.5/include/my_pthread.h:196
#2 0x000055cca2d0a6f5 in signal_hand (arg=0x0) at /home/jan/mysql/10.5/sql/mysqld.cc:2965
#3 0x000055cca3522f65 in pfs_spawn_thread (arg=0x55cca7085d38) at /home/jan/mysql/10.5/storage/perfschema/pfs.cc:2201
#4 0x00007fec44ce1590 in start_thread (arg=0x7fec187f5640) at pthread_create.c:463
#5 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 11 (Thread 0x7fec3101b640 (LWP 1627737)):
#0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55cca6fbf6fc) at ../sysdeps/nptl/futex-internal.h:183
#1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x55cca6fbf698, cond=0x55cca6fbf6d0) at pthread_cond_wait.c:508
#2 __pthread_cond_wait (cond=0x55cca6fbf6d0, mutex=0x55cca6fbf698) at pthread_cond_wait.c:638
#3 0x00007fec3bcf6750 in gu::Lock::wait (this=0x7fec3101a930, cond=...) at /home/jan/mysql/mariadb-galeralib/galerautils/src/gu_lock.hpp:46
#4 0x00007fec3bd7bbce in RecvBuf::front (this=0x55cca6fbf698, timeout=...) at /home/jan/mysql/mariadb-galeralib/gcs/src/gcs_gcomm.cpp:114
#5 0x00007fec3bd76f04 in gcomm_recv (backend=0x55cca6f91130, msg=0x55cca6f90fd0, timeout=9223372035999999999) at /home/jan/mysql/mariadb-galeralib/gcs/src/gcs_gcomm.cpp:608
#6 0x00007fec3bd6075f in core_msg_recv (backend=0x55cca6f91130, recv_msg=0x55cca6f90fd0, timeout=9223372035999999999) at /home/jan/mysql/mariadb-galeralib/gcs/src/gcs_core.cpp:480
#7 0x00007fec3bd62d58 in gcs_core_recv (conn=0x55cca6f90f70, recv_act=0x7fec3101ad00, timeout=9223372035999999999) at /home/jan/mysql/mariadb-galeralib/gcs/src/gcs_core.cpp:1201
#8 0x00007fec3bd58442 in gcs_recv_thread (arg=0x55cca6f90cf0) at /home/jan/mysql/mariadb-galeralib/gcs/src/gcs.cpp:1413
#9 0x00007fec44ce1590 in start_thread (arg=0x7fec3101b640) at pthread_create.c:463
#10 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 10 (Thread 0x7fec0a7fc640 (LWP 1627939)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fec0a7fbaf0, clockid=176142832, expected=0, futex_word=0x55cca70afaf8) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7fec0a7fbaf0, clockid=176142832, mutex=0x55cca70a0040, cond=0x55cca70afad0) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70afad0, mutex=0x55cca70a0040, abstime=0x7fec0a7fbaf0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70afad0, __mutex=0x55cca70a0040, __abs_timeout=0x7fec0a7fbaf0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70afad0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70afad0, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70afad0, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70afad0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70afad0, t=0x7fec0a7fbc58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70afad0) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf8000eb8: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf8000eb0: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf8000eb8: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf8000ea8) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf8000ea8) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf8000ea0) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7fec0a7fc640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 9 (Thread 0x7fec0affd640 (LWP 1627938)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fec0affcaf0, clockid=184535536, expected=0, futex_word=0x55cca70afb78) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7fec0affcaf0, clockid=184535536, mutex=0x55cca70a0040, cond=0x55cca70afb50) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70afb50, mutex=0x55cca70a0040, abstime=0x7fec0affcaf0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70afb50, __mutex=0x55cca70a0040, __abs_timeout=0x7fec0affcaf0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70afb50, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70afb50, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70afb50, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70afb50) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70afb50, t=0x7fec0affcc58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70afb50) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf8000d18: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf8000d10: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf8000d18: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf8000d08) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf8000d08) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf8000d00) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7fec0affd640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 8 (Thread 0x7fec187aa640 (LWP 1627970)):
#0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55cca479be6c <COND_manager+44>) at ../sysdeps/nptl/futex-internal.h:183
#1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x55cca479bda8 <LOCK_manager+40>, cond=0x55cca479be40 <COND_manager>) at pthread_cond_wait.c:508
#2 __pthread_cond_wait (cond=0x55cca479be40 <COND_manager>, mutex=0x55cca479bda8 <LOCK_manager+40>) at pthread_cond_wait.c:638
#3 0x000055cca3aec522 in safe_cond_wait (cond=0x55cca479be40 <COND_manager>, mp=0x55cca479bd80 <LOCK_manager>, file=0x55cca3bf5810 "/home/jan/mysql/10.5/include/mysql/psi/mysql_thread.h", line=1222) at /home/jan/mysql/10.5/mysys/thr_mutex.c:492
#4 0x000055cca2e50a0c in inline_mysql_cond_wait (that=0x55cca479be40 <COND_manager>, mutex=0x55cca479bd80 <LOCK_manager>, src_file=0x55cca3bf5e60 "/home/jan/mysql/10.5/sql/sql_manager.cc", src_line=103) at /home/jan/mysql/10.5/include/mysql/psi/mysql_thread.h:1222
#5 0x000055cca2e50ee1 in handle_manager (arg=0x0) at /home/jan/mysql/10.5/sql/sql_manager.cc:103
#6 0x000055cca3522f65 in pfs_spawn_thread (arg=0x55cca75445b8) at /home/jan/mysql/10.5/storage/perfschema/pfs.cc:2201
#7 0x00007fec44ce1590 in start_thread (arg=0x7fec187aa640) at pthread_create.c:463
#8 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 7 (Thread 0x7fec33ca0640 (LWP 1627722)):
#0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x55cca6f87b94) at ../sysdeps/nptl/futex-internal.h:183
#1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x55cca6f87b30, cond=0x55cca6f87b68) at pthread_cond_wait.c:508
#2 __pthread_cond_wait (cond=0x55cca6f87b68, mutex=0x55cca6f87b30) at pthread_cond_wait.c:638
#3 0x00007fec3bcf6750 in gu::Lock::wait (this=0x7fec33c9fb90, cond=...) at /home/jan/mysql/mariadb-galeralib/galerautils/src/gu_lock.hpp:46
#4 0x00007fec3bd3582e in galera::ServiceThd::thd_func (arg=0x55cca6f87b18) at /home/jan/mysql/mariadb-galeralib/galera/src/galera_service_thd.cpp:30
#5 0x00007fec44ce1590 in start_thread (arg=0x7fec33ca0640) at pthread_create.c:463
#6 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 6 (Thread 0x7fec4454cd40 (LWP 1627720)):
#0 0x00007fec448a866f in __GI___poll (fds=0x7ffd3f96a3b0, nfds=2, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
#1 0x000055cca2d10a5d in handle_connections_sockets () at /home/jan/mysql/10.5/sql/mysqld.cc:6209
#2 0x000055cca2d0fee3 in mysqld_main (argc=181, argv=0x55cca6e2cae0) at /home/jan/mysql/10.5/sql/mysqld.cc:5658
#3 0x000055cca2d0497d in main (argc=23, argv=0x7ffd3f96a6c8) at /home/jan/mysql/10.5/sql/main.cc:25
Thread 5 (Thread 0x7fec3181c640 (LWP 1627723)):
#0 0x00007fec448b456e in epoll_wait (epfd=6, events=0x7fec3181b2d0, maxevents=128, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30
#1 0x00007fec3bea0ab7 in asio::detail::epoll_reactor::run (this=0x55cca6f80ba0, block=true, ops=...) at /home/jan/mysql/mariadb-galeralib/asio/asio/detail/impl/epoll_reactor.ipp:391
#2 0x00007fec3bea1e3d in asio::detail::task_io_service::do_run_one (this=0x55cca6fbc4c0, lock=..., this_thread=..., ec=...) at /home/jan/mysql/mariadb-galeralib/asio/asio/detail/impl/task_io_service.ipp:355
#3 0x00007fec3bea175f in asio::detail::task_io_service::run (this=0x55cca6fbc4c0, ec=...) at /home/jan/mysql/mariadb-galeralib/asio/asio/detail/impl/task_io_service.ipp:148
#4 0x00007fec3bea21a4 in asio::io_service::run (this=0x55cca6fbf3d0) at /home/jan/mysql/mariadb-galeralib/asio/asio/impl/io_service.ipp:58
#5 0x00007fec3be9be70 in gu::AsioIoService::run (this=0x55cca6f89c48) at /home/jan/mysql/mariadb-galeralib/galerautils/src/gu_asio.cpp:634
#6 0x00007fec3bd93422 in gcomm::AsioProtonet::event_loop (this=0x55cca6f89b90, period=...) at /home/jan/mysql/mariadb-galeralib/gcomm/src/asio_protonet.cpp:103
#7 0x00007fec3bd7608e in GCommConn::run (this=0x55cca6fbf490) at /home/jan/mysql/mariadb-galeralib/gcs/src/gcs_gcomm.cpp:433
#8 0x00007fec3bd7c29c in GCommConn::run_fn (arg=0x55cca6fbf490) at /home/jan/mysql/mariadb-galeralib/gcs/src/gcs_gcomm.cpp:174
#9 0x00007fec44ce1590 in start_thread (arg=0x7fec3181c640) at pthread_create.c:463
#10 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 4 (Thread 0x7fec08ff9640 (LWP 1627942)):
#0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7fec08ff8af0, clockid=150964720, expected=0, futex_word=0x55cca70af978) at ../sysdeps/nptl/futex-internal.h:320
#1 __pthread_cond_wait_common (abstime=0x7fec08ff8af0, clockid=150964720, mutex=0x55cca70a0040, cond=0x55cca70af950) at pthread_cond_wait.c:520
#2 __pthread_cond_timedwait (cond=0x55cca70af950, mutex=0x55cca70a0040, abstime=0x7fec08ff8af0) at pthread_cond_wait.c:656
#3 0x000055cca3a40c3b in __gthread_cond_timedwait (__cond=0x55cca70af950, __mutex=0x55cca70a0040, __abs_timeout=0x7fec08ff8af0) at /usr/include/x86_64-linux-gnu/c++/9/bits/gthr-default.h:872
#4 0x000055cca3a43bc9 in std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af950, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:188
#5 0x000055cca3a42bf3 in std::condition_variable::wait_until<std::chrono::_V2::steady_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (this=0x55cca70af950, __lock=..., __atime=...) at /usr/include/c++/9/condition_variable:121
#6 0x000055cca3a41e8e in std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (this=0x55cca70af950, __lock=..., __rtime=...) at /usr/include/c++/9/condition_variable:152
#7 0x000055cca3a3f3c3 in tpool::thread_pool_generic::wait_for_tasks (this=0x55cca709ff30, lk=..., thread_data=0x55cca70af950) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:446
#8 0x000055cca3a3f5d3 in tpool::thread_pool_generic::get_task (this=0x55cca709ff30, thread_var=0x55cca70af950, t=0x7fec08ff8c58) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:499
#9 0x000055cca3a3f86d in tpool::thread_pool_generic::worker_main (this=0x55cca709ff30, thread_var=0x55cca70af950) at /home/jan/mysql/10.5/tpool/tpool_generic.cc:544
#10 0x000055cca3a46d66 in std::__invoke_impl<void, void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__f=@0x7febf8001398: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>, __t=@0x7febf8001390: 0x55cca709ff30) at /usr/include/c++/9/bits/invoke.h:73
#11 0x000055cca3a46c48 in std::__invoke<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> (__fn=@0x7febf8001398: (void (tpool::thread_pool_generic::*)(class tpool::thread_pool_generic * const, struct tpool::worker_data *)) 0x55cca3a3f808 <tpool::thread_pool_generic::worker_main(tpool::worker_data*)>) at /usr/include/c++/9/bits/invoke.h:95
#12 0x000055cca3a46b67 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::_M_invoke<0ul, 1ul, 2ul> (this=0x7febf8001388) at /usr/include/c++/9/thread:244
#13 0x000055cca3a46b02 in std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> >::operator() (this=0x7febf8001388) at /usr/include/c++/9/thread:251
#14 0x000055cca3a46ae2 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (tpool::thread_pool_generic::*)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*> > >::_M_run (this=0x7febf8001380) at /usr/include/c++/9/thread:195
#15 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#16 0x00007fec44ce1590 in start_thread (arg=0x7fec08ff9640) at pthread_create.c:463
#17 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 3 (Thread 0x7fec401fe640 (LWP 1627738)):
#0 __lll_lock_wait (futex=futex@entry=0x7fec0c0042c0, private=0) at lowlevellock.c:52
#1 0x00007fec44ce3a95 in __GI___pthread_mutex_lock (mutex=0x7fec0c0042c0) at ../nptl/pthread_mutex_lock.c:135
#2 0x000055cca3aebba3 in safe_mutex_lock (mp=0x7fec0c004298, my_flags=0, file=0x55cca3be16f0 "/home/jan/mysql/10.5/sql/wsrep_mutex.h", line=34) at /home/jan/mysql/10.5/mysys/thr_mutex.c:290
#3 0x000055cca2dd77ff in inline_mysql_mutex_lock (that=0x7fec0c004298, src_file=0x55cca3be16f0 "/home/jan/mysql/10.5/sql/wsrep_mutex.h", src_line=34) at /home/jan/mysql/10.5/include/mysql/psi/mysql_thread.h:750
#4 0x000055cca2deff0e in Wsrep_mutex::lock (this=0x7fec0c008990) at /home/jan/mysql/10.5/sql/wsrep_mutex.h:34
#5 0x000055cca2d19a91 in std::unique_lock<wsrep::mutex>::lock (this=0x7fec401fda10) at /usr/include/c++/9/bits/unique_lock.h:141
#6 0x000055cca2d18ff9 in std::unique_lock<wsrep::mutex>::unique_lock (this=0x7fec401fda10, __m=...) at /usr/include/c++/9/bits/unique_lock.h:71
#7 0x000055cca3b98d4e in wsrep::transaction::after_rollback (this=0x7fec0c008a30) at /home/jan/mysql/10.5/wsrep-lib/src/transaction.cpp:744
#8 0x000055cca2dc2c67 in wsrep::client_state::after_rollback (this=0x7fec0c0089c8) at /home/jan/mysql/10.5/wsrep-lib/include/wsrep/client_state.hpp:537
#9 0x000055cca31c6cc7 in wsrep_after_rollback (thd=0x7fec0c002548, all=true) at /home/jan/mysql/10.5/sql/wsrep_trans_observer.h:409
#10 0x000055cca31cb95c in ha_rollback_trans (thd=0x7fec0c002548, all=true) at /home/jan/mysql/10.5/sql/handler.cc:2080
#11 0x000055cca301fec2 in trans_rollback (thd=0x7fec0c002548) at /home/jan/mysql/10.5/sql/transaction.cc:372
#12 0x000055cca35add5e in Wsrep_client_service::bf_rollback (this=0x7fec0c0089b0) at /home/jan/mysql/10.5/sql/wsrep_client_service.cc:330
#13 0x000055cca35d3ac9 in wsrep_rollback_local (thd=0x7fec0c002548, rollbacker=0x7fec240022b8) at /home/jan/mysql/10.5/sql/wsrep_thd.cc:214
#14 0x000055cca35d3de2 in wsrep_rollback_process (rollbacker=0x7fec240022b8, arg=0x55cca6fbe630) at /home/jan/mysql/10.5/sql/wsrep_thd.cc:265
#15 0x000055cca35c2e1e in start_wsrep_THD (arg=0x55cca6fbe630) at /home/jan/mysql/10.5/sql/wsrep_mysqld.cc:3050
#16 0x000055cca3522f65 in pfs_spawn_thread (arg=0x55cca6fa94a8) at /home/jan/mysql/10.5/storage/perfschema/pfs.cc:2201
#17 0x00007fec44ce1590 in start_thread (arg=0x7fec401fe640) at pthread_create.c:463
#18 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 2 (Thread 0x7fec199f6640 (LWP 1627935)):
#0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38
#1 0x000055cca3a47832 in my_getevents (ctx=0x7fec30009000, min_nr=1, nr=256, ev=0x7fec199f3c80) at /home/jan/mysql/10.5/tpool/aio_linux.cc:63
#2 0x000055cca3a479fd in tpool::aio_linux::getevent_thread_routine (aio=0x55cca6fcdd80) at /home/jan/mysql/10.5/tpool/aio_linux.cc:107
#3 0x000055cca3a484e4 in std::__invoke_impl<void, void (*)(tpool::aio_linux*), tpool::aio_linux*> (__f=@0x55cca71083d0: 0x55cca3a479a1 <tpool::aio_linux::getevent_thread_routine(tpool::aio_linux*)>) at /usr/include/c++/9/bits/invoke.h:60
#4 0x000055cca3a48444 in std::__invoke<void (*)(tpool::aio_linux*), tpool::aio_linux*> (__fn=@0x55cca71083d0: 0x55cca3a479a1 <tpool::aio_linux::getevent_thread_routine(tpool::aio_linux*)>) at /usr/include/c++/9/bits/invoke.h:95
#5 0x000055cca3a483a3 in std::thread::_Invoker<std::tuple<void (*)(tpool::aio_linux*), tpool::aio_linux*> >::_M_invoke<0ul, 1ul> (this=0x55cca71083c8) at /usr/include/c++/9/thread:244
#6 0x000055cca3a4835a in std::thread::_Invoker<std::tuple<void (*)(tpool::aio_linux*), tpool::aio_linux*> >::operator() (this=0x55cca71083c8) at /usr/include/c++/9/thread:251
#7 0x000055cca3a4833a in std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (*)(tpool::aio_linux*), tpool::aio_linux*> > >::_M_run (this=0x55cca71083c0) at /usr/include/c++/9/thread:195
#8 0x00007fec44bc5d84 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
#9 0x00007fec44ce1590 in start_thread (arg=0x7fec199f6640) at pthread_create.c:463
#10 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
Thread 1 (Thread 0x7fec18714640 (LWP 1628044)):
#0 __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:54
#1 0x000055cca3ae6ddf in my_write_core (sig=6) at /home/jan/mysql/10.5/mysys/stacktrace.c:424
#2 0x000055cca31c4907 in handle_fatal_signal (sig=6) at /home/jan/mysql/10.5/sql/signal_handler.cc:331
#3 <signal handler called>
#4 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:49
#5 0x00007fec447c1864 in __GI_abort () at abort.c:79
#6 0x00007fec447c1749 in __assert_fail_base (fmt=0x7fec4494d458 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=0x55cca419e770 "wsrep::this_thread::get_id() == owning_thread_id_", file=0x55cca419e660 "/home/jan/mysql/10.5/wsrep-lib/src/client_state.cpp", line=832, function=<optimized out>) at assert.c:92
#7 0x00007fec447d3a96 in __GI___assert_fail (assertion=0x55cca419e770 "wsrep::this_thread::get_id() == owning_thread_id_", file=0x55cca419e660 "/home/jan/mysql/10.5/wsrep-lib/src/client_state.cpp", line=832, function=0x55cca419f8d0 "void wsrep::client_state::state(wsrep::unique_lock<wsrep::mutex>&, wsrep::client_state::state)") at assert.c:101
#8 0x000055cca3b84290 in wsrep::client_state::state (this=0x7fec0c0089c8, lock=..., state=wsrep::client_state::s_quitting) at /home/jan/mysql/10.5/wsrep-lib/src/client_state.cpp:832
#9 0x000055cca3b80d4b in wsrep::client_state::close (this=0x7fec0c0089c8) at /home/jan/mysql/10.5/wsrep-lib/src/client_state.cpp:52
#10 0x000055cca3000b8e in wsrep_close (thd=0x7fec0c002548) at /home/jan/mysql/10.5/sql/wsrep_trans_observer.h:462
#11 0x000055cca3003a48 in end_connection (thd=0x7fec0c002548) at /home/jan/mysql/10.5/sql/sql_connect.cc:1192
#12 0x000055cca300420e in do_handle_one_connection (connect=0x55cca763c938, put_in_cache=true) at /home/jan/mysql/10.5/sql/sql_connect.cc:1413
#13 0x000055cca3003f5e in handle_one_connection (arg=0x55cca763c938) at /home/jan/mysql/10.5/sql/sql_connect.cc:1312
#14 0x000055cca3522f65 in pfs_spawn_thread (arg=0x55cca763bd08) at /home/jan/mysql/10.5/storage/perfschema/pfs.cc:2201
#15 0x00007fec44ce1590 in start_thread (arg=0x7fec18714640) at pthread_create.c:463
#16 0x00007fec448b4223 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
- saving '/home/jan/mysql/10.5/mysql-test/var/log/galera.galera_bf_kill_debug-innodb/' to '/home/jan/mysql/10.5/mysql-test/var/log/galera.galera_bf_kill_debug-innodb/'
Since enabling log_slave_update the node did not crash again because of this issue. There were 2 other crashes, but they are likely related to MDEV-24322 (Failing assertion: UT_LIST_GET_LEN(lock.trx_locks) == 0), so i attached the logs there.
Yes, this is an official build. The mirror used is http://ftp.hosteurope.de/mirror/mariadb.org/repo/10.4/debian
root@srv3 ~ # nm /usr/sbin/mysqld | grep assert
nm: /usr/sbin/mysqld: no symbols
root@srv3 ~ # nm -D /usr/sbin/mysqld | grep assert
U __assert_fail
00000000015c1194 B debug_assert_if_crashed_table
00000000015c1192 B debug_assert_on_not_freed_memory
0000000001e5370c B my_assert_on_error