[MDEV-21739] galera.galera_insert_multi MTR failed: Program terminated with signal SIGABRT Created: 2020-02-14  Updated: 2020-03-16  Resolved: 2020-03-16

Status: Closed
Project: MariaDB Server
Component/s: Galera, Tests
Affects Version/s: 10.4.13
Fix Version/s: N/A

Type: Bug Priority: Major
Reporter: Stepan Patryshev (Inactive) Assignee: Stepan Patryshev (Inactive)
Resolution: Cannot Reproduce Votes: 0
Labels: None
Environment:

kvm-deb-xenial-x86



 Description   

galera.galera_insert_multi failed on bb: Program terminated with signal SIGABRT.

stdio.log:

10.4.13 c400a73d7a722f009b16a3ffddccf7f052abba31

galera.galera_insert_multi 'innodb'      w2 [ fail ]  timeout after 900 seconds
        Test ended at 2020-02-13 11:25:17
 
Test case timeout after 900 seconds
 
== /dev/shm/var/2/log/galera_insert_multi.log == 
COUNT(*) = 0
1
connection node_2;
SELECT COUNT(*) = 0 FROM t1;
COUNT(*) = 0
1
DROP TABLE t1;
connection node_1;
CREATE TABLE t1 (f1 INTEGER PRIMARY KEY) ENGINE=InnoDB;
SET AUTOCOMMIT = OFF;
START TRANSACTION;
INSERT INTO t1 VALUES (1), (2);
connection node_2;
SET AUTOCOMMIT = OFF;
START TRANSACTION;
INSERT INTO t1 VALUES (2), (1);
connection node_1;
COMMIT;
connection node_2;
COMMIT;
 
 == /dev/shm/var/2/tmp/analyze-timeout-mysqld.1.err ==
mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/dev/shm/var/tmp/2/mysqld.1.sock' (111)
 
 == /dev/shm/var/2/tmp/analyze-timeout-mysqld.2.err ==
mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/dev/shm/var/tmp/2/mysqld.2.sock' (111)
 
 
 - found 'core' (0/0)
 
Trying 'dbx' to get a backtrace
 
Trying 'gdb' to get a backtrace from coredump /dev/shm/var/2/log/galera.galera_insert_multi-innodb/mysqld.1/data/core
Core generated by '/usr/sbin/mysqld'
Output from gdb follows. The first stack trace is from the failing thread.
The following stack traces are from all threads (so the failing one is
duplicated).
--------------------------
[New LWP 3113]
[New LWP 3115]
[New LWP 3129]
[New LWP 3119]
[New LWP 3117]
[New LWP 3130]
[New LWP 3114]
[New LWP 3131]
[New LWP 3142]
[New LWP 3123]
[New LWP 3144]
[New LWP 3140]
[New LWP 3124]
[New LWP 3125]
[New LWP 3143]
[New LWP 3133]
[New LWP 3121]
[New LWP 3141]
[New LWP 3126]
[New LWP 3122]
[New LWP 3139]
[New LWP 3135]
[New LWP 3138]
[New LWP 3134]
[New LWP 3137]
[New LWP 3147]
[New LWP 3127]
[New LWP 3136]
[New LWP 3837]
[New LWP 3116]
[New LWP 3132]
[New LWP 3120]
[New LWP 3118]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/sbin/mysqld --defaults-group-suffix=.1 --defaults-file=/dev/shm/var/2/my.c'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb77bdc31 in __kernel_vsyscall ()
[Current thread is 1 (Thread 0xb6efc7c0 (LWP 3113))]
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773dcc1 in __pthread_kill (threadid=3069167552, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:58
#2  0x80c1754c in my_write_core (sig=6) at /home/buildbot/buildbot/build/mariadb-10.4.13/mysys/stacktrace.c:481
#3  0x80672fd6 in handle_fatal_signal (sig=6) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/signal_handler.cc:343
#4  <signal handler called>
#5  0xb77bdc31 in __kernel_vsyscall ()
#6  0xb7188ecf in poll () at ../sysdeps/unix/syscall-template.S:84
#7  0xb71a3630 in __poll_chk (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>, fdslen=24) at poll_chk.c:27
#8  0x8036d897 in poll (__timeout=-1, __nfds=2, __fds=0xbfecb9f0) at /usr/include/i386-linux-gnu/bits/poll2.h:41
#9  handle_connections_sockets () at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:6464
#10 0x8036ee43 in mysqld_main (argc=162, argv=0xbfecc074) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:5900
#11 0x803489c7 in main (argc=23, argv=0xbfecc074) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/main.cc:25
 
Thread 33 (Thread 0xb2460b40 (LWP 3118)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0x805cfd3d in inline_mysql_cond_wait (src_line=69, src_file=0x80d17d9c "/home/buildbot/buildbot/build/mariadb-10.4.13/sql/wsrep_thd.h", mutex=0xae3100b4, that=0xae3100d0) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/mysql/psi/mysql_thread.h:1185
#3  Wsrep_thd_queue::pop_front (this=0xae310088) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/wsrep_thd.h:69
#4  wsrep_rollback_process (rollbacker=0xae300510, arg=0x8378d9b8) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/wsrep_thd.cc:246
#5  0x805bdcc3 in start_wsrep_THD (arg=0x8378d9b8) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/wsrep_mysqld.cc:2747
#6  0x80bc419b in pfs_spawn_thread (arg=0x837a16d0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
#7  0xb7737295 in start_thread (arg=0xb2460b40) at pthread_create.c:333
#8  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 32 (Thread 0xad73fb40 (LWP 3120)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
#2  0x80ace6ed in inline_mysql_cond_timedwait (src_file=0x80e6e83c "/home/buildbot/buildbot/build/mariadb-10.4.13/storage/maria/ma_servicethread.c", src_line=116, abstime=0xad73f194, mutex=0x81c103d4 <LOCK_checkpoint>, that=0x81c103a0 <COND_checkpoint>) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/mysql/psi/mysql_thread.h:1211
#3  my_service_thread_sleep (control=0x81347424 <checkpoint_control>, sleep_time=30000000000) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/maria/ma_servicethread.c:115
#4  0x80ac4cae in ma_checkpoint_background (arg=0x1e) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/maria/ma_checkpoint.c:707
#5  0x80bc419b in pfs_spawn_thread (arg=0x838108f0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
#6  0xb7737295 in start_thread (arg=0xad73fb40) at pthread_create.c:333
#7  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 31 (Thread 0xa63eeb40 (LWP 3132)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
#2  0x8088cf45 in os_event::timed_wait (abstime=0xa63ee0ac, this=0x8396f518) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:275
#3  os_event::wait_time_low (this=0x8396f518, time_in_usec=10000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:385
#4  0x8088d529 in os_event_wait_time_low (event=0x8396f518, time_in_usec=10000000, reset_sig_count=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:485
#5  0x80a07534 in dict_stats_thread () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/dict/dict0stats_bg.cc:476
#6  0xb7737295 in start_thread (arg=0xa63eeb40) at pthread_create.c:333
#7  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 30 (Thread 0xaf898b40 (LWP 3116)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb719388a in epoll_wait () at ../sysdeps/unix/syscall-template.S:84
#2  0xb21889a6 in asio::detail::epoll_reactor::run (this=0x8378d000, block=true, ops=...) at asio/asio/detail/impl/epoll_reactor.ipp:391
#3  0xb21a888b in asio::detail::task_io_service::do_run_one (ec=..., this_thread=..., lock=..., this=0x8378cf70) at asio/asio/detail/impl/task_io_service.ipp:355
#4  asio::detail::task_io_service::run (ec=..., this=0x8378cf70) at asio/asio/detail/impl/task_io_service.ipp:148
#5  asio::io_service::run (this=0x8378c5ac) at asio/asio/impl/io_service.ipp:58
#6  gcomm::AsioProtonet::event_loop (this=0x8378c540, period=...) at gcomm/src/asio_protonet.cpp:116
#7  0xb21df412 in GCommConn::run (this=this@entry=0x8378c718) at gcs/src/gcs_gcomm.cpp:433
#8  0xb21e705b in GCommConn::run_fn (arg=0x8378c718) at gcs/src/gcs_gcomm.cpp:174
#9  0xb7737295 in start_thread (arg=0xaf898b40) at pthread_create.c:333
#10 0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 29 (Thread 0xabf20b40 (LWP 3837)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
#2  0x803655b4 in inline_mysql_cond_timedwait (src_file=0x80cdb428 "/home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc", src_line=2688, abstime=0xabf20174, mutex=0x813ab354 <LOCK_thread_cache>, that=0x813ad300 <COND_thread_cache>) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/mysql/psi/mysql_thread.h:1211
#3  cache_thread (thd=0xb2305230) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:2687
#4  one_thread_per_connection_end (thd=0xb2305230, put_in_cache=true) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:2773
#5  0x805225df in do_handle_one_connection (connect=0x839f9cc8) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/sql_connect.cc:1423
#6  0x80522742 in handle_one_connection (arg=0x839f9cc8) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/sql_connect.cc:1316
#7  0x80bc419b in pfs_spawn_thread (arg=0x83a04a88) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
#8  0xb7737295 in start_thread (arg=0xabf20b40) at pthread_create.c:333
#9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 28 (Thread 0xa4bebb40 (LWP 3136)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0x8088d599 in os_event::wait (this=0x8383af60) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:158
#3  os_event::wait_low (reset_sig_count=2251, this=0x8383af60) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:325
#4  os_event_wait_low (event=0x8383af60, reset_sig_count=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:502
#5  0x8091bda4 in srv_resume_thread (sig_count=0, timeout_usec=0, wait=true, slot=0x813458e8 <srv_sys+168>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:911
#6  srv_worker_thread (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:2519
#7  0xb7737295 in start_thread (arg=0xa4bebb40) at pthread_create.c:333
#8  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 27 (Thread 0xa8df8b40 (LWP 3127)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
#2  0x8088cf45 in os_event::timed_wait (abstime=0xa8df7f4c, this=0x8383b118) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:275
#3  os_event::wait_time_low (this=0x8383b118, time_in_usec=904000, reset_sig_count=20) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:385
#4  0x8088d529 in os_event_wait_time_low (event=0x8383b118, time_in_usec=904000, reset_sig_count=20) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:485
#5  0x809c01f6 in pc_sleep_if_needed (cur_time=1220037, sig_count=20, next_loop_time=1220941) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/buf/buf0flu.cc:2640
#6  buf_flush_page_cleaner_coordinator () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/buf/buf0flu.cc:3099
#7  0xb7737295 in start_thread (arg=0xa8df8b40) at pthread_create.c:333
#8  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 26 (Thread 0xabffeb40 (LWP 3147)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
#2  0x803655b4 in inline_mysql_cond_timedwait (src_file=0x80cdb428 "/home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc", src_line=2688, abstime=0xabffe174, mutex=0x813ab354 <LOCK_thread_cache>, that=0x813ad300 <COND_thread_cache>) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/mysql/psi/mysql_thread.h:1211
#3  cache_thread (thd=0xae7052d0) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:2687
#4  one_thread_per_connection_end (thd=0xae7052d0, put_in_cache=true) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:2773
#5  0x805225df in do_handle_one_connection (connect=0x83a53a90) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/sql_connect.cc:1423
#6  0x80522742 in handle_one_connection (arg=0x83a53a90) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/sql_connect.cc:1316
#7  0x80bc419b in pfs_spawn_thread (arg=0x8399f028) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
#8  0xb7737295 in start_thread (arg=0xabffeb40) at pthread_create.c:333
#9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 25 (Thread 0xa43eab40 (LWP 3137)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0x8088d599 in os_event::wait (this=0x8383af08) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:158
#3  os_event::wait_low (reset_sig_count=2376, this=0x8383af08) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:325
#4  os_event_wait_low (event=0x8383af08, reset_sig_count=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:502
#5  0x8091bda4 in srv_resume_thread (sig_count=0, timeout_usec=0, wait=true, slot=0x813458cc <srv_sys+140>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:911
#6  srv_worker_thread (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:2519
#7  0xb7737295 in start_thread (arg=0xa43eab40) at pthread_create.c:333
#8  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 24 (Thread 0xa83f2b40 (LWP 3134)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb774088a in nanosleep () at ../sysdeps/unix/syscall-template.S:84
#2  0x8088d940 in os_thread_sleep (tm=1000000) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0thread.cc:231
#3  0x8091b067 in srv_master_sleep () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:2336
#4  srv_master_thread (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:2377
#5  0xb7737295 in start_thread (arg=0xa83f2b40) at pthread_create.c:333
#6  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 23 (Thread 0xa3be9b40 (LWP 3138)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0x8088d599 in os_event::wait (this=0x8383afb8) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:158
#3  os_event::wait_low (reset_sig_count=2159, this=0x8383afb8) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:325
#4  os_event_wait_low (event=0x8383afb8, reset_sig_count=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:502
#5  0x8091bda4 in srv_resume_thread (sig_count=0, timeout_usec=0, wait=true, slot=0x81345904 <srv_sys+196>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:911
#6  srv_worker_thread (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:2519
#7  0xb7737295 in start_thread (arg=0xa3be9b40) at pthread_create.c:333
#8  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 22 (Thread 0xa53ecb40 (LWP 3135)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0x8088d599 in os_event::wait (this=0x8383aeb0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:158
#3  os_event::wait_low (reset_sig_count=748, this=0x8383aeb0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:325
#4  os_event_wait_low (event=0x8383aeb0, reset_sig_count=748) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:502
#5  0x8091d0e0 in srv_resume_thread (timeout_usec=0, wait=true, sig_count=748, slot=0x813458b0 <srv_sys+112>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:911
#6  srv_purge_coordinator_suspend (rseg_history_len=<optimized out>, slot=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:2659
#7  srv_purge_coordinator_thread (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:2740
#8  0xb7737295 in start_thread (arg=0xa53ecb40) at pthread_create.c:333
#9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 21 (Thread 0xa33e8b40 (LWP 3139)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0x8088d599 in os_event::wait (this=0x8383b0c0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:158
#3  os_event::wait_low (reset_sig_count=1, this=0x8383b0c0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:325
#4  os_event_wait_low (event=0x8383b0c0, reset_sig_count=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:502
#5  0x809b4e5a in buf_dump_thread () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/buf/buf0dump.cc:833
#6  0xb7737295 in start_thread (arg=0xa33e8b40) at pthread_create.c:333
#7  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 20 (Thread 0xab5fdb40 (LWP 3122)):
#0  0xb779b570 in ?? () from /lib/i386-linux-gnu/libaio.so.1
#1  0xb779b5e6 in io_getevents () from /lib/i386-linux-gnu/libaio.so.1
#2  0x808825c7 in LinuxAIOHandler::collect (this=0xab5fd114) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1819
#3  0x80882ccb in LinuxAIOHandler::poll (this=0xab5fd114, m1=0xab5fd180, m2=0xab5fd184, request=0xab5fd188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1980
#4  0x80887687 in os_aio_linux_handler (request=0xab5fd188, m2=0xab5fd184, m1=0xab5fd180, global_segment=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:2034
#5  os_aio_handler (segment=1, m1=0xab5fd180, m2=0xab5fd184, request=0xab5fd188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:5604
#6  0x80a14010 in fil_aio_wait (segment=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/fil/fil0fil.cc:4353
#7  0x8091ed51 in io_handler_thread (arg=0x814026c4 <n+4>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0start.cc:324
#8  0xb7737295 in start_thread (arg=0xab5fdb40) at pthread_create.c:333
#9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 19 (Thread 0xa95f9b40 (LWP 3126)):
#0  0xb779b570 in ?? () from /lib/i386-linux-gnu/libaio.so.1
#1  0xb779b5e6 in io_getevents () from /lib/i386-linux-gnu/libaio.so.1
#2  0x808825c7 in LinuxAIOHandler::collect (this=0xa95f9114) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1819
#3  0x80882ccb in LinuxAIOHandler::poll (this=0xa95f9114, m1=0xa95f9180, m2=0xa95f9184, request=0xa95f9188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1980
#4  0x80887687 in os_aio_linux_handler (request=0xa95f9188, m2=0xa95f9184, m1=0xa95f9180, global_segment=5) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:2034
#5  os_aio_handler (segment=5, m1=0xa95f9180, m2=0xa95f9184, request=0xa95f9188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:5604
#6  0x80a14010 in fil_aio_wait (segment=5) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/fil/fil0fil.cc:4353
#7  0x8091ed51 in io_handler_thread (arg=0x814026d4 <n+20>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0start.cc:324
#8  0xb7737295 in start_thread (arg=0xa95f9b40) at pthread_create.c:333
#9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 18 (Thread 0xa23e6b40 (LWP 3141)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0x8088d599 in os_event::wait (this=0x8383b170) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:158
#3  os_event::wait_low (reset_sig_count=1, this=0x8383b170) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:325
#4  os_event_wait_low (event=0x8383b170, reset_sig_count=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:502
#5  0x809acc8c in buf_resize_thread () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/buf/buf0buf.cc:3178
#6  0xb7737295 in start_thread (arg=0xa23e6b40) at pthread_create.c:333
#7  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 17 (Thread 0xabdfeb40 (LWP 3121)):
#0  0xb779b570 in ?? () from /lib/i386-linux-gnu/libaio.so.1
#1  0xb779b5e6 in io_getevents () from /lib/i386-linux-gnu/libaio.so.1
#2  0x808825c7 in LinuxAIOHandler::collect (this=0xabdfe114) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1819
#3  0x80882ccb in LinuxAIOHandler::poll (this=0xabdfe114, m1=0xabdfe180, m2=0xabdfe184, request=0xabdfe188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1980
#4  0x80887687 in os_aio_linux_handler (request=0xabdfe188, m2=0xabdfe184, m1=0xabdfe180, global_segment=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:2034
#5  os_aio_handler (segment=0, m1=0xabdfe180, m2=0xabdfe184, request=0xabdfe188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:5604
#6  0x80a14010 in fil_aio_wait (segment=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/fil/fil0fil.cc:4353
#7  0x8091ed51 in io_handler_thread (arg=0x814026c0 <n>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0start.cc:324
#8  0xb7737295 in start_thread (arg=0xabdfeb40) at pthread_create.c:333
#9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 16 (Thread 0xa5bedb40 (LWP 3133)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
#2  0x8088cf45 in os_event::timed_wait (abstime=0xa5becf7c, this=0x8392c388) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:275
#3  os_event::wait_time_low (this=0x8392c388, time_in_usec=5000000, reset_sig_count=7) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:385
#4  0x8088d529 in os_event_wait_time_low (event=0x8392c388, time_in_usec=5000000, reset_sig_count=7) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:485
#5  0x80969d58 in ib_wqueue_timedwait (wq=0x839799d8, wait_in_usecs=5000000) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/ut/ut0wqueue.cc:156
#6  0x80a50c33 in fts_optimize_thread (arg=0x839799d8) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/fts/fts0opt.cc:2834
#7  0xb7737295 in start_thread (arg=0xa5bedb40) at pthread_create.c:333
#8  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 15 (Thread 0xae2beb40 (LWP 3143)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb70d8eac in __GI___sigwaitinfo (set=<optimized out>, info=0xae2be1b4) at ../sysdeps/unix/sysv/linux/sigwaitinfo.c:56
#2  0x803638ff in my_sigwait (code=<synthetic pointer>, sig=0xae2be130, set=0xae2be134) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/my_pthread.h:198
#3  signal_hand (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:3245
#4  0x80bc419b in pfs_spawn_thread (arg=0x8399ebf8) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
#5  0xb7737295 in start_thread (arg=0xae2beb40) at pthread_create.c:333
#6  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 14 (Thread 0xa9dfab40 (LWP 3125)):
#0  0xb779b570 in ?? () from /lib/i386-linux-gnu/libaio.so.1
#1  0xb779b5e6 in io_getevents () from /lib/i386-linux-gnu/libaio.so.1
#2  0x808825c7 in LinuxAIOHandler::collect (this=0xa9dfa114) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1819
#3  0x80882ccb in LinuxAIOHandler::poll (this=0xa9dfa114, m1=0xa9dfa180, m2=0xa9dfa184, request=0xa9dfa188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1980
#4  0x80887687 in os_aio_linux_handler (request=0xa9dfa188, m2=0xa9dfa184, m1=0xa9dfa180, global_segment=4) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:2034
#5  os_aio_handler (segment=4, m1=0xa9dfa180, m2=0xa9dfa184, request=0xa9dfa188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:5604
#6  0x80a14010 in fil_aio_wait (segment=4) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/fil/fil0fil.cc:4353
#7  0x8091ed51 in io_handler_thread (arg=0x814026d0 <n+16>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0start.cc:324
#8  0xb7737295 in start_thread (arg=0xa9dfab40) at pthread_create.c:333
#9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 13 (Thread 0xaa5fbb40 (LWP 3124)):
#0  0xb779b570 in ?? () from /lib/i386-linux-gnu/libaio.so.1
#1  0xb779b5e6 in io_getevents () from /lib/i386-linux-gnu/libaio.so.1
#2  0x808825c7 in LinuxAIOHandler::collect (this=0xaa5fb114) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1819
#3  0x80882ccb in LinuxAIOHandler::poll (this=0xaa5fb114, m1=0xaa5fb180, m2=0xaa5fb184, request=0xaa5fb188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1980
#4  0x80887687 in os_aio_linux_handler (request=0xaa5fb188, m2=0xaa5fb184, m1=0xaa5fb180, global_segment=3) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:2034
#5  os_aio_handler (segment=3, m1=0xaa5fb180, m2=0xaa5fb184, request=0xaa5fb188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:5604
#6  0x80a14010 in fil_aio_wait (segment=3) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/fil/fil0fil.cc:4353
#7  0x8091ed51 in io_handler_thread (arg=0x814026cc <n+12>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0start.cc:324
#8  0xb7737295 in start_thread (arg=0xaa5fbb40) at pthread_create.c:333
#9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 12 (Thread 0xa2be7b40 (LWP 3140)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb774088a in nanosleep () at ../sysdeps/unix/syscall-template.S:84
#2  0x8088d940 in os_thread_sleep (tm=1000000) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0thread.cc:231
#3  0x8099e2af in btr_defragment_thread () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/btr/btr0defragment.cc:717
#4  0xb7737295 in start_thread (arg=0xa2be7b40) at pthread_create.c:333
#5  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 11 (Thread 0xae274b40 (LWP 3144)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0x80383b27 in inline_mysql_cond_wait (that=<optimized out>, mutex=<optimized out>, src_file=0x80ce5a30 "/home/buildbot/buildbot/build/mariadb-10.4.13/sql/slave.cc", src_line=522) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/mysql/psi/mysql_thread.h:1174
#3  handle_slave_background (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/slave.cc:522
#4  0x80bc419b in pfs_spawn_thread (arg=0x83a4d0d8) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
#5  0xb7737295 in start_thread (arg=0xae274b40) at pthread_create.c:333
#6  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 10 (Thread 0xaadfcb40 (LWP 3123)):
#0  0xb779b570 in ?? () from /lib/i386-linux-gnu/libaio.so.1
#1  0xb779b5e6 in io_getevents () from /lib/i386-linux-gnu/libaio.so.1
#2  0x808825c7 in LinuxAIOHandler::collect (this=0xaadfc114) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1819
#3  0x80882ccb in LinuxAIOHandler::poll (this=0xaadfc114, m1=0xaadfc180, m2=0xaadfc184, request=0xaadfc188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1980
#4  0x80887687 in os_aio_linux_handler (request=0xaadfc188, m2=0xaadfc184, m1=0xaadfc180, global_segment=2) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:2034
#5  os_aio_handler (segment=2, m1=0xaadfc180, m2=0xaadfc184, request=0xaadfc188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:5604
#6  0x80a14010 in fil_aio_wait (segment=2) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/fil/fil0fil.cc:4353
#7  0x8091ed51 in io_handler_thread (arg=0x814026c8 <n+8>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0start.cc:324
#8  0xb7737295 in start_thread (arg=0xaadfcb40) at pthread_create.c:333
#9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 9 (Thread 0xa1be5b40 (LWP 3142)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0x80803a87 in inline_mysql_cond_wait (src_file=0x80e2199c "/home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/handler/ha_innodb.cc", src_line=288, mutex=0xa1be51fc, that=0xa1be5218) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/mysql/psi/mysql_thread.h:1185
#3  thd_destructor_proxy () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/handler/ha_innodb.cc:288
#4  0x80bc419b in pfs_spawn_thread (arg=0x83999f30) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
#5  0xb7737295 in start_thread (arg=0xa1be5b40) at pthread_create.c:333
#6  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 8 (Thread 0xa6befb40 (LWP 3131)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
#2  0x8088cf45 in os_event::timed_wait (abstime=0xa6bef10c, this=0x8383b068) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:275
#3  os_event::wait_time_low (this=0x8383b068, time_in_usec=5000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:385
#4  0x8088d529 in os_event_wait_time_low (event=0x8383b068, time_in_usec=5000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:485
#5  0x809197ef in srv_monitor_thread () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:1689
#6  0xb7737295 in start_thread (arg=0xa6befb40) at pthread_create.c:333
#7  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 7 (Thread 0xb2c61b40 (LWP 3114)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
#2  0x80c1c1ad in inline_mysql_cond_timedwait (that=0x81c1c160 <COND_timer>, mutex=0x81c1c194 <LOCK_timer>, src_file=0x80e84268 "/home/buildbot/buildbot/build/mariadb-10.4.13/mysys/thr_timer.c", src_line=292, abstime=0xb2c61224) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/mysql/psi/mysql_thread.h:1211
#3  timer_handler (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/mysys/thr_timer.c:292
#4  0x80bc419b in pfs_spawn_thread (arg=0x837194f8) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
#5  0xb7737295 in start_thread (arg=0xb2c61b40) at pthread_create.c:333
#6  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 6 (Thread 0xa73f0b40 (LWP 3130)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
#2  0x8088cf45 in os_event::timed_wait (abstime=0xa73f008c, this=0x8383b010) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:275
#3  os_event::wait_time_low (this=0x8383b010, time_in_usec=1000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:385
#4  0x8088d529 in os_event_wait_time_low (event=0x8383b010, time_in_usec=1000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:485
#5  0x80919f59 in srv_error_monitor_thread () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:1853
#6  0xb7737295 in start_thread (arg=0xa73f0b40) at pthread_create.c:333
#7  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 5 (Thread 0xaf097b40 (LWP 3117)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0xb21dcbee in gu::Lock::wait (this=<synthetic pointer>, cond=...) at galerautils/src/gu_lock.hpp:45
#3  RecvBuf::front (timeout=..., this=0x8378c84c) at gcs/src/gcs_gcomm.cpp:114
#4  gcomm_recv (backend=0x83743950, msg=0x83743834, timeout=9223372035999999999) at gcs/src/gcs_gcomm.cpp:608
#5  0xb21c95e1 in core_msg_recv (timeout=<optimized out>, recv_msg=<optimized out>, backend=0x83743950) at gcs/src/gcs_core.cpp:480
#6  gcs_core_recv (conn=0x837437f8, recv_act=recv_act@entry=0xaf0971c4, timeout=9223372035999999999) at gcs/src/gcs_core.cpp:1184
#7  0xb21d8259 in gcs_recv_thread (arg=0x837435f8) at gcs/src/gcs.cpp:1398
#8  0xb7737295 in start_thread (arg=0xaf097b40) at pthread_create.c:333
#9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 4 (Thread 0xae896b40 (LWP 3119)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0xb203654d in fifo_lock_get (q=0x83777b10) at galerautils/src/gu_fifo.c:262
#3  gu_fifo_get_head (q=0x83777b10, err=err@entry=0xae8954e8) at galerautils/src/gu_fifo.c:330
#4  0xb21ce71f in gcs_recv (conn=0x837435f8, action=action@entry=0xae895580) at gcs/src/gcs.cpp:2024
#5  0xb222f33e in galera::Gcs::recv (act=..., this=<optimized out>) at galera/src/galera_gcs.hpp:120
#6  galera::GcsActionSource::process (this=0x83788c98, recv_ctx=0xae895968, exit_loop=@0xae8956c3: false) at galera/src/gcs_action_source.cpp:162
#7  0xb227182a in galera::ReplicatorSMM::async_recv (this=0x8373d9c0, recv_ctx=0xae895968) at galera/src/replicator_smm.cpp:390
#8  0xb2297bac in galera_recv (gh=0x837194f0, recv_ctx=0xae895968) at galera/src/wsrep_provider.cpp:236
#9  0x80cc8a6f in wsrep::wsrep_provider_v26::run_applier (this=0x83614230, applier_ctx=0xae895968) at /home/buildbot/buildbot/build/mariadb-10.4.13/wsrep-lib/src/wsrep_provider_v26.cpp:731
#10 0x805d13ad in wsrep_replication_process (thd=0xae400510, arg=0x837a24c8) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/wsrep_thd.cc:62
#11 0x805bdcc3 in start_wsrep_THD (arg=0x837a24c8) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/wsrep_mysqld.cc:2747
#12 0x80bc419b in pfs_spawn_thread (arg=0x837a1a40) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
#13 0xb7737295 in start_thread (arg=0xae896b40) at pthread_create.c:333
#14 0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 3 (Thread 0xa7bf1b40 (LWP 3129)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
#2  0x8088cf45 in os_event::timed_wait (abstime=0xa7bf10ac, this=0x83946840) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:275
#3  os_event::wait_time_low (this=0x83946840, time_in_usec=1000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:385
#4  0x8088d529 in os_event_wait_time_low (event=0x83946840, time_in_usec=1000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:485
#5  0x8085e419 in lock_wait_timeout_thread () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/lock/lock0wait.cc:522
#6  0xb7737295 in start_thread (arg=0xa7bf1b40) at pthread_create.c:333
#7  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 2 (Thread 0xb159cb40 (LWP 3115)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0xb2220a96 in gu::Lock::wait (this=<synthetic pointer>, cond=...) at galerautils/src/gu_lock.hpp:45
#3  galera::ServiceThd::thd_func (arg=0x8373debc) at galera/src/galera_service_thd.cpp:30
#4  0xb7737295 in start_thread (arg=0xb159cb40) at pthread_create.c:333
#5  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
 
Thread 1 (Thread 0xb6efc7c0 (LWP 3113)):
#0  0xb77bdc31 in __kernel_vsyscall ()
#1  0xb773dcc1 in __pthread_kill (threadid=3069167552, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:58
#2  0x80c1754c in my_write_core (sig=6) at /home/buildbot/buildbot/build/mariadb-10.4.13/mysys/stacktrace.c:481
#3  0x80672fd6 in handle_fatal_signal (sig=6) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/signal_handler.cc:343
#4  <signal handler called>
#5  0xb77bdc31 in __kernel_vsyscall ()
#6  0xb7188ecf in poll () at ../sysdeps/unix/syscall-template.S:84
#7  0xb71a3630 in __poll_chk (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>, fdslen=24) at poll_chk.c:27
#8  0x8036d897 in poll (__timeout=-1, __nfds=2, __fds=0xbfecb9f0) at /usr/include/i386-linux-gnu/bits/poll2.h:41
#9  handle_connections_sockets () at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:6464
#10 0x8036ee43 in mysqld_main (argc=162, argv=0xbfecc074) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:5900
#11 0x803489c7 in main (argc=23, argv=0xbfecc074) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/main.cc:25
 
Compressed file /dev/shm/var/2/log/galera.galera_insert_multi-innodb/mysqld.1/data/core
 - saving '/dev/shm/var/2/log/galera.galera_insert_multi-innodb/' to '/dev/shm/var/log/galera.galera_insert_multi-innodb/'
 
Retrying test galera.galera_insert_multi, attempt(2/3)...
 
worker[2] > Restart  - not started
worker[2] > Restart  - not started



 Comments   
Comment by Stepan Patryshev (Inactive) [ 2020-03-16 ]

Closing since it does not fail on CI.

Generated at Thu Feb 08 09:09:26 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.