Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-21739

galera.galera_insert_multi MTR failed: Program terminated with signal SIGABRT

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Cannot Reproduce
    • 10.4.13
    • N/A
    • Galera, Tests
    • None
    • kvm-deb-xenial-x86

    Description

      galera.galera_insert_multi failed on bb: Program terminated with signal SIGABRT.

      stdio.log:

      10.4.13 c400a73d7a722f009b16a3ffddccf7f052abba31

      galera.galera_insert_multi 'innodb'      w2 [ fail ]  timeout after 900 seconds
              Test ended at 2020-02-13 11:25:17
       
      Test case timeout after 900 seconds
       
      == /dev/shm/var/2/log/galera_insert_multi.log == 
      COUNT(*) = 0
      1
      connection node_2;
      SELECT COUNT(*) = 0 FROM t1;
      COUNT(*) = 0
      1
      DROP TABLE t1;
      connection node_1;
      CREATE TABLE t1 (f1 INTEGER PRIMARY KEY) ENGINE=InnoDB;
      SET AUTOCOMMIT = OFF;
      START TRANSACTION;
      INSERT INTO t1 VALUES (1), (2);
      connection node_2;
      SET AUTOCOMMIT = OFF;
      START TRANSACTION;
      INSERT INTO t1 VALUES (2), (1);
      connection node_1;
      COMMIT;
      connection node_2;
      COMMIT;
       
       == /dev/shm/var/2/tmp/analyze-timeout-mysqld.1.err ==
      mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/dev/shm/var/tmp/2/mysqld.1.sock' (111)
       
       == /dev/shm/var/2/tmp/analyze-timeout-mysqld.2.err ==
      mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/dev/shm/var/tmp/2/mysqld.2.sock' (111)
       
       
       - found 'core' (0/0)
       
      Trying 'dbx' to get a backtrace
       
      Trying 'gdb' to get a backtrace from coredump /dev/shm/var/2/log/galera.galera_insert_multi-innodb/mysqld.1/data/core
      Core generated by '/usr/sbin/mysqld'
      Output from gdb follows. The first stack trace is from the failing thread.
      The following stack traces are from all threads (so the failing one is
      duplicated).
      --------------------------
      [New LWP 3113]
      [New LWP 3115]
      [New LWP 3129]
      [New LWP 3119]
      [New LWP 3117]
      [New LWP 3130]
      [New LWP 3114]
      [New LWP 3131]
      [New LWP 3142]
      [New LWP 3123]
      [New LWP 3144]
      [New LWP 3140]
      [New LWP 3124]
      [New LWP 3125]
      [New LWP 3143]
      [New LWP 3133]
      [New LWP 3121]
      [New LWP 3141]
      [New LWP 3126]
      [New LWP 3122]
      [New LWP 3139]
      [New LWP 3135]
      [New LWP 3138]
      [New LWP 3134]
      [New LWP 3137]
      [New LWP 3147]
      [New LWP 3127]
      [New LWP 3136]
      [New LWP 3837]
      [New LWP 3116]
      [New LWP 3132]
      [New LWP 3120]
      [New LWP 3118]
      [Thread debugging using libthread_db enabled]
      Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
      Core was generated by `/usr/sbin/mysqld --defaults-group-suffix=.1 --defaults-file=/dev/shm/var/2/my.c'.
      Program terminated with signal SIGABRT, Aborted.
      #0  0xb77bdc31 in __kernel_vsyscall ()
      [Current thread is 1 (Thread 0xb6efc7c0 (LWP 3113))]
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773dcc1 in __pthread_kill (threadid=3069167552, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:58
      #2  0x80c1754c in my_write_core (sig=6) at /home/buildbot/buildbot/build/mariadb-10.4.13/mysys/stacktrace.c:481
      #3  0x80672fd6 in handle_fatal_signal (sig=6) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/signal_handler.cc:343
      #4  <signal handler called>
      #5  0xb77bdc31 in __kernel_vsyscall ()
      #6  0xb7188ecf in poll () at ../sysdeps/unix/syscall-template.S:84
      #7  0xb71a3630 in __poll_chk (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>, fdslen=24) at poll_chk.c:27
      #8  0x8036d897 in poll (__timeout=-1, __nfds=2, __fds=0xbfecb9f0) at /usr/include/i386-linux-gnu/bits/poll2.h:41
      #9  handle_connections_sockets () at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:6464
      #10 0x8036ee43 in mysqld_main (argc=162, argv=0xbfecc074) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:5900
      #11 0x803489c7 in main (argc=23, argv=0xbfecc074) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/main.cc:25
       
      Thread 33 (Thread 0xb2460b40 (LWP 3118)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
      #2  0x805cfd3d in inline_mysql_cond_wait (src_line=69, src_file=0x80d17d9c "/home/buildbot/buildbot/build/mariadb-10.4.13/sql/wsrep_thd.h", mutex=0xae3100b4, that=0xae3100d0) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/mysql/psi/mysql_thread.h:1185
      #3  Wsrep_thd_queue::pop_front (this=0xae310088) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/wsrep_thd.h:69
      #4  wsrep_rollback_process (rollbacker=0xae300510, arg=0x8378d9b8) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/wsrep_thd.cc:246
      #5  0x805bdcc3 in start_wsrep_THD (arg=0x8378d9b8) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/wsrep_mysqld.cc:2747
      #6  0x80bc419b in pfs_spawn_thread (arg=0x837a16d0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
      #7  0xb7737295 in start_thread (arg=0xb2460b40) at pthread_create.c:333
      #8  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 32 (Thread 0xad73fb40 (LWP 3120)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
      #2  0x80ace6ed in inline_mysql_cond_timedwait (src_file=0x80e6e83c "/home/buildbot/buildbot/build/mariadb-10.4.13/storage/maria/ma_servicethread.c", src_line=116, abstime=0xad73f194, mutex=0x81c103d4 <LOCK_checkpoint>, that=0x81c103a0 <COND_checkpoint>) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/mysql/psi/mysql_thread.h:1211
      #3  my_service_thread_sleep (control=0x81347424 <checkpoint_control>, sleep_time=30000000000) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/maria/ma_servicethread.c:115
      #4  0x80ac4cae in ma_checkpoint_background (arg=0x1e) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/maria/ma_checkpoint.c:707
      #5  0x80bc419b in pfs_spawn_thread (arg=0x838108f0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
      #6  0xb7737295 in start_thread (arg=0xad73fb40) at pthread_create.c:333
      #7  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 31 (Thread 0xa63eeb40 (LWP 3132)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
      #2  0x8088cf45 in os_event::timed_wait (abstime=0xa63ee0ac, this=0x8396f518) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:275
      #3  os_event::wait_time_low (this=0x8396f518, time_in_usec=10000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:385
      #4  0x8088d529 in os_event_wait_time_low (event=0x8396f518, time_in_usec=10000000, reset_sig_count=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:485
      #5  0x80a07534 in dict_stats_thread () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/dict/dict0stats_bg.cc:476
      #6  0xb7737295 in start_thread (arg=0xa63eeb40) at pthread_create.c:333
      #7  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 30 (Thread 0xaf898b40 (LWP 3116)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb719388a in epoll_wait () at ../sysdeps/unix/syscall-template.S:84
      #2  0xb21889a6 in asio::detail::epoll_reactor::run (this=0x8378d000, block=true, ops=...) at asio/asio/detail/impl/epoll_reactor.ipp:391
      #3  0xb21a888b in asio::detail::task_io_service::do_run_one (ec=..., this_thread=..., lock=..., this=0x8378cf70) at asio/asio/detail/impl/task_io_service.ipp:355
      #4  asio::detail::task_io_service::run (ec=..., this=0x8378cf70) at asio/asio/detail/impl/task_io_service.ipp:148
      #5  asio::io_service::run (this=0x8378c5ac) at asio/asio/impl/io_service.ipp:58
      #6  gcomm::AsioProtonet::event_loop (this=0x8378c540, period=...) at gcomm/src/asio_protonet.cpp:116
      #7  0xb21df412 in GCommConn::run (this=this@entry=0x8378c718) at gcs/src/gcs_gcomm.cpp:433
      #8  0xb21e705b in GCommConn::run_fn (arg=0x8378c718) at gcs/src/gcs_gcomm.cpp:174
      #9  0xb7737295 in start_thread (arg=0xaf898b40) at pthread_create.c:333
      #10 0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 29 (Thread 0xabf20b40 (LWP 3837)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
      #2  0x803655b4 in inline_mysql_cond_timedwait (src_file=0x80cdb428 "/home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc", src_line=2688, abstime=0xabf20174, mutex=0x813ab354 <LOCK_thread_cache>, that=0x813ad300 <COND_thread_cache>) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/mysql/psi/mysql_thread.h:1211
      #3  cache_thread (thd=0xb2305230) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:2687
      #4  one_thread_per_connection_end (thd=0xb2305230, put_in_cache=true) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:2773
      #5  0x805225df in do_handle_one_connection (connect=0x839f9cc8) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/sql_connect.cc:1423
      #6  0x80522742 in handle_one_connection (arg=0x839f9cc8) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/sql_connect.cc:1316
      #7  0x80bc419b in pfs_spawn_thread (arg=0x83a04a88) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
      #8  0xb7737295 in start_thread (arg=0xabf20b40) at pthread_create.c:333
      #9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 28 (Thread 0xa4bebb40 (LWP 3136)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
      #2  0x8088d599 in os_event::wait (this=0x8383af60) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:158
      #3  os_event::wait_low (reset_sig_count=2251, this=0x8383af60) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:325
      #4  os_event_wait_low (event=0x8383af60, reset_sig_count=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:502
      #5  0x8091bda4 in srv_resume_thread (sig_count=0, timeout_usec=0, wait=true, slot=0x813458e8 <srv_sys+168>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:911
      #6  srv_worker_thread (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:2519
      #7  0xb7737295 in start_thread (arg=0xa4bebb40) at pthread_create.c:333
      #8  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 27 (Thread 0xa8df8b40 (LWP 3127)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
      #2  0x8088cf45 in os_event::timed_wait (abstime=0xa8df7f4c, this=0x8383b118) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:275
      #3  os_event::wait_time_low (this=0x8383b118, time_in_usec=904000, reset_sig_count=20) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:385
      #4  0x8088d529 in os_event_wait_time_low (event=0x8383b118, time_in_usec=904000, reset_sig_count=20) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:485
      #5  0x809c01f6 in pc_sleep_if_needed (cur_time=1220037, sig_count=20, next_loop_time=1220941) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/buf/buf0flu.cc:2640
      #6  buf_flush_page_cleaner_coordinator () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/buf/buf0flu.cc:3099
      #7  0xb7737295 in start_thread (arg=0xa8df8b40) at pthread_create.c:333
      #8  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 26 (Thread 0xabffeb40 (LWP 3147)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
      #2  0x803655b4 in inline_mysql_cond_timedwait (src_file=0x80cdb428 "/home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc", src_line=2688, abstime=0xabffe174, mutex=0x813ab354 <LOCK_thread_cache>, that=0x813ad300 <COND_thread_cache>) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/mysql/psi/mysql_thread.h:1211
      #3  cache_thread (thd=0xae7052d0) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:2687
      #4  one_thread_per_connection_end (thd=0xae7052d0, put_in_cache=true) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:2773
      #5  0x805225df in do_handle_one_connection (connect=0x83a53a90) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/sql_connect.cc:1423
      #6  0x80522742 in handle_one_connection (arg=0x83a53a90) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/sql_connect.cc:1316
      #7  0x80bc419b in pfs_spawn_thread (arg=0x8399f028) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
      #8  0xb7737295 in start_thread (arg=0xabffeb40) at pthread_create.c:333
      #9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 25 (Thread 0xa43eab40 (LWP 3137)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
      #2  0x8088d599 in os_event::wait (this=0x8383af08) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:158
      #3  os_event::wait_low (reset_sig_count=2376, this=0x8383af08) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:325
      #4  os_event_wait_low (event=0x8383af08, reset_sig_count=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:502
      #5  0x8091bda4 in srv_resume_thread (sig_count=0, timeout_usec=0, wait=true, slot=0x813458cc <srv_sys+140>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:911
      #6  srv_worker_thread (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:2519
      #7  0xb7737295 in start_thread (arg=0xa43eab40) at pthread_create.c:333
      #8  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 24 (Thread 0xa83f2b40 (LWP 3134)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb774088a in nanosleep () at ../sysdeps/unix/syscall-template.S:84
      #2  0x8088d940 in os_thread_sleep (tm=1000000) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0thread.cc:231
      #3  0x8091b067 in srv_master_sleep () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:2336
      #4  srv_master_thread (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:2377
      #5  0xb7737295 in start_thread (arg=0xa83f2b40) at pthread_create.c:333
      #6  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 23 (Thread 0xa3be9b40 (LWP 3138)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
      #2  0x8088d599 in os_event::wait (this=0x8383afb8) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:158
      #3  os_event::wait_low (reset_sig_count=2159, this=0x8383afb8) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:325
      #4  os_event_wait_low (event=0x8383afb8, reset_sig_count=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:502
      #5  0x8091bda4 in srv_resume_thread (sig_count=0, timeout_usec=0, wait=true, slot=0x81345904 <srv_sys+196>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:911
      #6  srv_worker_thread (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:2519
      #7  0xb7737295 in start_thread (arg=0xa3be9b40) at pthread_create.c:333
      #8  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 22 (Thread 0xa53ecb40 (LWP 3135)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
      #2  0x8088d599 in os_event::wait (this=0x8383aeb0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:158
      #3  os_event::wait_low (reset_sig_count=748, this=0x8383aeb0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:325
      #4  os_event_wait_low (event=0x8383aeb0, reset_sig_count=748) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:502
      #5  0x8091d0e0 in srv_resume_thread (timeout_usec=0, wait=true, sig_count=748, slot=0x813458b0 <srv_sys+112>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:911
      #6  srv_purge_coordinator_suspend (rseg_history_len=<optimized out>, slot=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:2659
      #7  srv_purge_coordinator_thread (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:2740
      #8  0xb7737295 in start_thread (arg=0xa53ecb40) at pthread_create.c:333
      #9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 21 (Thread 0xa33e8b40 (LWP 3139)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
      #2  0x8088d599 in os_event::wait (this=0x8383b0c0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:158
      #3  os_event::wait_low (reset_sig_count=1, this=0x8383b0c0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:325
      #4  os_event_wait_low (event=0x8383b0c0, reset_sig_count=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:502
      #5  0x809b4e5a in buf_dump_thread () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/buf/buf0dump.cc:833
      #6  0xb7737295 in start_thread (arg=0xa33e8b40) at pthread_create.c:333
      #7  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 20 (Thread 0xab5fdb40 (LWP 3122)):
      #0  0xb779b570 in ?? () from /lib/i386-linux-gnu/libaio.so.1
      #1  0xb779b5e6 in io_getevents () from /lib/i386-linux-gnu/libaio.so.1
      #2  0x808825c7 in LinuxAIOHandler::collect (this=0xab5fd114) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1819
      #3  0x80882ccb in LinuxAIOHandler::poll (this=0xab5fd114, m1=0xab5fd180, m2=0xab5fd184, request=0xab5fd188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1980
      #4  0x80887687 in os_aio_linux_handler (request=0xab5fd188, m2=0xab5fd184, m1=0xab5fd180, global_segment=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:2034
      #5  os_aio_handler (segment=1, m1=0xab5fd180, m2=0xab5fd184, request=0xab5fd188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:5604
      #6  0x80a14010 in fil_aio_wait (segment=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/fil/fil0fil.cc:4353
      #7  0x8091ed51 in io_handler_thread (arg=0x814026c4 <n+4>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0start.cc:324
      #8  0xb7737295 in start_thread (arg=0xab5fdb40) at pthread_create.c:333
      #9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 19 (Thread 0xa95f9b40 (LWP 3126)):
      #0  0xb779b570 in ?? () from /lib/i386-linux-gnu/libaio.so.1
      #1  0xb779b5e6 in io_getevents () from /lib/i386-linux-gnu/libaio.so.1
      #2  0x808825c7 in LinuxAIOHandler::collect (this=0xa95f9114) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1819
      #3  0x80882ccb in LinuxAIOHandler::poll (this=0xa95f9114, m1=0xa95f9180, m2=0xa95f9184, request=0xa95f9188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1980
      #4  0x80887687 in os_aio_linux_handler (request=0xa95f9188, m2=0xa95f9184, m1=0xa95f9180, global_segment=5) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:2034
      #5  os_aio_handler (segment=5, m1=0xa95f9180, m2=0xa95f9184, request=0xa95f9188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:5604
      #6  0x80a14010 in fil_aio_wait (segment=5) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/fil/fil0fil.cc:4353
      #7  0x8091ed51 in io_handler_thread (arg=0x814026d4 <n+20>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0start.cc:324
      #8  0xb7737295 in start_thread (arg=0xa95f9b40) at pthread_create.c:333
      #9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 18 (Thread 0xa23e6b40 (LWP 3141)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
      #2  0x8088d599 in os_event::wait (this=0x8383b170) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:158
      #3  os_event::wait_low (reset_sig_count=1, this=0x8383b170) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:325
      #4  os_event_wait_low (event=0x8383b170, reset_sig_count=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:502
      #5  0x809acc8c in buf_resize_thread () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/buf/buf0buf.cc:3178
      #6  0xb7737295 in start_thread (arg=0xa23e6b40) at pthread_create.c:333
      #7  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 17 (Thread 0xabdfeb40 (LWP 3121)):
      #0  0xb779b570 in ?? () from /lib/i386-linux-gnu/libaio.so.1
      #1  0xb779b5e6 in io_getevents () from /lib/i386-linux-gnu/libaio.so.1
      #2  0x808825c7 in LinuxAIOHandler::collect (this=0xabdfe114) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1819
      #3  0x80882ccb in LinuxAIOHandler::poll (this=0xabdfe114, m1=0xabdfe180, m2=0xabdfe184, request=0xabdfe188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1980
      #4  0x80887687 in os_aio_linux_handler (request=0xabdfe188, m2=0xabdfe184, m1=0xabdfe180, global_segment=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:2034
      #5  os_aio_handler (segment=0, m1=0xabdfe180, m2=0xabdfe184, request=0xabdfe188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:5604
      #6  0x80a14010 in fil_aio_wait (segment=0) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/fil/fil0fil.cc:4353
      #7  0x8091ed51 in io_handler_thread (arg=0x814026c0 <n>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0start.cc:324
      #8  0xb7737295 in start_thread (arg=0xabdfeb40) at pthread_create.c:333
      #9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 16 (Thread 0xa5bedb40 (LWP 3133)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
      #2  0x8088cf45 in os_event::timed_wait (abstime=0xa5becf7c, this=0x8392c388) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:275
      #3  os_event::wait_time_low (this=0x8392c388, time_in_usec=5000000, reset_sig_count=7) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:385
      #4  0x8088d529 in os_event_wait_time_low (event=0x8392c388, time_in_usec=5000000, reset_sig_count=7) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:485
      #5  0x80969d58 in ib_wqueue_timedwait (wq=0x839799d8, wait_in_usecs=5000000) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/ut/ut0wqueue.cc:156
      #6  0x80a50c33 in fts_optimize_thread (arg=0x839799d8) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/fts/fts0opt.cc:2834
      #7  0xb7737295 in start_thread (arg=0xa5bedb40) at pthread_create.c:333
      #8  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 15 (Thread 0xae2beb40 (LWP 3143)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb70d8eac in __GI___sigwaitinfo (set=<optimized out>, info=0xae2be1b4) at ../sysdeps/unix/sysv/linux/sigwaitinfo.c:56
      #2  0x803638ff in my_sigwait (code=<synthetic pointer>, sig=0xae2be130, set=0xae2be134) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/my_pthread.h:198
      #3  signal_hand (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:3245
      #4  0x80bc419b in pfs_spawn_thread (arg=0x8399ebf8) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
      #5  0xb7737295 in start_thread (arg=0xae2beb40) at pthread_create.c:333
      #6  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 14 (Thread 0xa9dfab40 (LWP 3125)):
      #0  0xb779b570 in ?? () from /lib/i386-linux-gnu/libaio.so.1
      #1  0xb779b5e6 in io_getevents () from /lib/i386-linux-gnu/libaio.so.1
      #2  0x808825c7 in LinuxAIOHandler::collect (this=0xa9dfa114) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1819
      #3  0x80882ccb in LinuxAIOHandler::poll (this=0xa9dfa114, m1=0xa9dfa180, m2=0xa9dfa184, request=0xa9dfa188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1980
      #4  0x80887687 in os_aio_linux_handler (request=0xa9dfa188, m2=0xa9dfa184, m1=0xa9dfa180, global_segment=4) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:2034
      #5  os_aio_handler (segment=4, m1=0xa9dfa180, m2=0xa9dfa184, request=0xa9dfa188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:5604
      #6  0x80a14010 in fil_aio_wait (segment=4) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/fil/fil0fil.cc:4353
      #7  0x8091ed51 in io_handler_thread (arg=0x814026d0 <n+16>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0start.cc:324
      #8  0xb7737295 in start_thread (arg=0xa9dfab40) at pthread_create.c:333
      #9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 13 (Thread 0xaa5fbb40 (LWP 3124)):
      #0  0xb779b570 in ?? () from /lib/i386-linux-gnu/libaio.so.1
      #1  0xb779b5e6 in io_getevents () from /lib/i386-linux-gnu/libaio.so.1
      #2  0x808825c7 in LinuxAIOHandler::collect (this=0xaa5fb114) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1819
      #3  0x80882ccb in LinuxAIOHandler::poll (this=0xaa5fb114, m1=0xaa5fb180, m2=0xaa5fb184, request=0xaa5fb188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1980
      #4  0x80887687 in os_aio_linux_handler (request=0xaa5fb188, m2=0xaa5fb184, m1=0xaa5fb180, global_segment=3) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:2034
      #5  os_aio_handler (segment=3, m1=0xaa5fb180, m2=0xaa5fb184, request=0xaa5fb188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:5604
      #6  0x80a14010 in fil_aio_wait (segment=3) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/fil/fil0fil.cc:4353
      #7  0x8091ed51 in io_handler_thread (arg=0x814026cc <n+12>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0start.cc:324
      #8  0xb7737295 in start_thread (arg=0xaa5fbb40) at pthread_create.c:333
      #9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 12 (Thread 0xa2be7b40 (LWP 3140)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb774088a in nanosleep () at ../sysdeps/unix/syscall-template.S:84
      #2  0x8088d940 in os_thread_sleep (tm=1000000) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0thread.cc:231
      #3  0x8099e2af in btr_defragment_thread () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/btr/btr0defragment.cc:717
      #4  0xb7737295 in start_thread (arg=0xa2be7b40) at pthread_create.c:333
      #5  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 11 (Thread 0xae274b40 (LWP 3144)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
      #2  0x80383b27 in inline_mysql_cond_wait (that=<optimized out>, mutex=<optimized out>, src_file=0x80ce5a30 "/home/buildbot/buildbot/build/mariadb-10.4.13/sql/slave.cc", src_line=522) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/mysql/psi/mysql_thread.h:1174
      #3  handle_slave_background (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/slave.cc:522
      #4  0x80bc419b in pfs_spawn_thread (arg=0x83a4d0d8) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
      #5  0xb7737295 in start_thread (arg=0xae274b40) at pthread_create.c:333
      #6  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 10 (Thread 0xaadfcb40 (LWP 3123)):
      #0  0xb779b570 in ?? () from /lib/i386-linux-gnu/libaio.so.1
      #1  0xb779b5e6 in io_getevents () from /lib/i386-linux-gnu/libaio.so.1
      #2  0x808825c7 in LinuxAIOHandler::collect (this=0xaadfc114) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1819
      #3  0x80882ccb in LinuxAIOHandler::poll (this=0xaadfc114, m1=0xaadfc180, m2=0xaadfc184, request=0xaadfc188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:1980
      #4  0x80887687 in os_aio_linux_handler (request=0xaadfc188, m2=0xaadfc184, m1=0xaadfc180, global_segment=2) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:2034
      #5  os_aio_handler (segment=2, m1=0xaadfc180, m2=0xaadfc184, request=0xaadfc188) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0file.cc:5604
      #6  0x80a14010 in fil_aio_wait (segment=2) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/fil/fil0fil.cc:4353
      #7  0x8091ed51 in io_handler_thread (arg=0x814026c8 <n+8>) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0start.cc:324
      #8  0xb7737295 in start_thread (arg=0xaadfcb40) at pthread_create.c:333
      #9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 9 (Thread 0xa1be5b40 (LWP 3142)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
      #2  0x80803a87 in inline_mysql_cond_wait (src_file=0x80e2199c "/home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/handler/ha_innodb.cc", src_line=288, mutex=0xa1be51fc, that=0xa1be5218) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/mysql/psi/mysql_thread.h:1185
      #3  thd_destructor_proxy () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/handler/ha_innodb.cc:288
      #4  0x80bc419b in pfs_spawn_thread (arg=0x83999f30) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
      #5  0xb7737295 in start_thread (arg=0xa1be5b40) at pthread_create.c:333
      #6  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 8 (Thread 0xa6befb40 (LWP 3131)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
      #2  0x8088cf45 in os_event::timed_wait (abstime=0xa6bef10c, this=0x8383b068) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:275
      #3  os_event::wait_time_low (this=0x8383b068, time_in_usec=5000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:385
      #4  0x8088d529 in os_event_wait_time_low (event=0x8383b068, time_in_usec=5000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:485
      #5  0x809197ef in srv_monitor_thread () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:1689
      #6  0xb7737295 in start_thread (arg=0xa6befb40) at pthread_create.c:333
      #7  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 7 (Thread 0xb2c61b40 (LWP 3114)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
      #2  0x80c1c1ad in inline_mysql_cond_timedwait (that=0x81c1c160 <COND_timer>, mutex=0x81c1c194 <LOCK_timer>, src_file=0x80e84268 "/home/buildbot/buildbot/build/mariadb-10.4.13/mysys/thr_timer.c", src_line=292, abstime=0xb2c61224) at /home/buildbot/buildbot/build/mariadb-10.4.13/include/mysql/psi/mysql_thread.h:1211
      #3  timer_handler (arg=0x0) at /home/buildbot/buildbot/build/mariadb-10.4.13/mysys/thr_timer.c:292
      #4  0x80bc419b in pfs_spawn_thread (arg=0x837194f8) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
      #5  0xb7737295 in start_thread (arg=0xb2c61b40) at pthread_create.c:333
      #6  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 6 (Thread 0xa73f0b40 (LWP 3130)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
      #2  0x8088cf45 in os_event::timed_wait (abstime=0xa73f008c, this=0x8383b010) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:275
      #3  os_event::wait_time_low (this=0x8383b010, time_in_usec=1000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:385
      #4  0x8088d529 in os_event_wait_time_low (event=0x8383b010, time_in_usec=1000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:485
      #5  0x80919f59 in srv_error_monitor_thread () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/srv/srv0srv.cc:1853
      #6  0xb7737295 in start_thread (arg=0xa73f0b40) at pthread_create.c:333
      #7  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 5 (Thread 0xaf097b40 (LWP 3117)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
      #2  0xb21dcbee in gu::Lock::wait (this=<synthetic pointer>, cond=...) at galerautils/src/gu_lock.hpp:45
      #3  RecvBuf::front (timeout=..., this=0x8378c84c) at gcs/src/gcs_gcomm.cpp:114
      #4  gcomm_recv (backend=0x83743950, msg=0x83743834, timeout=9223372035999999999) at gcs/src/gcs_gcomm.cpp:608
      #5  0xb21c95e1 in core_msg_recv (timeout=<optimized out>, recv_msg=<optimized out>, backend=0x83743950) at gcs/src/gcs_core.cpp:480
      #6  gcs_core_recv (conn=0x837437f8, recv_act=recv_act@entry=0xaf0971c4, timeout=9223372035999999999) at gcs/src/gcs_core.cpp:1184
      #7  0xb21d8259 in gcs_recv_thread (arg=0x837435f8) at gcs/src/gcs.cpp:1398
      #8  0xb7737295 in start_thread (arg=0xaf097b40) at pthread_create.c:333
      #9  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 4 (Thread 0xae896b40 (LWP 3119)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
      #2  0xb203654d in fifo_lock_get (q=0x83777b10) at galerautils/src/gu_fifo.c:262
      #3  gu_fifo_get_head (q=0x83777b10, err=err@entry=0xae8954e8) at galerautils/src/gu_fifo.c:330
      #4  0xb21ce71f in gcs_recv (conn=0x837435f8, action=action@entry=0xae895580) at gcs/src/gcs.cpp:2024
      #5  0xb222f33e in galera::Gcs::recv (act=..., this=<optimized out>) at galera/src/galera_gcs.hpp:120
      #6  galera::GcsActionSource::process (this=0x83788c98, recv_ctx=0xae895968, exit_loop=@0xae8956c3: false) at galera/src/gcs_action_source.cpp:162
      #7  0xb227182a in galera::ReplicatorSMM::async_recv (this=0x8373d9c0, recv_ctx=0xae895968) at galera/src/replicator_smm.cpp:390
      #8  0xb2297bac in galera_recv (gh=0x837194f0, recv_ctx=0xae895968) at galera/src/wsrep_provider.cpp:236
      #9  0x80cc8a6f in wsrep::wsrep_provider_v26::run_applier (this=0x83614230, applier_ctx=0xae895968) at /home/buildbot/buildbot/build/mariadb-10.4.13/wsrep-lib/src/wsrep_provider_v26.cpp:731
      #10 0x805d13ad in wsrep_replication_process (thd=0xae400510, arg=0x837a24c8) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/wsrep_thd.cc:62
      #11 0x805bdcc3 in start_wsrep_THD (arg=0x837a24c8) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/wsrep_mysqld.cc:2747
      #12 0x80bc419b in pfs_spawn_thread (arg=0x837a1a40) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/perfschema/pfs.cc:1869
      #13 0xb7737295 in start_thread (arg=0xae896b40) at pthread_create.c:333
      #14 0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 3 (Thread 0xa7bf1b40 (LWP 3129)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ce36 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
      #2  0x8088cf45 in os_event::timed_wait (abstime=0xa7bf10ac, this=0x83946840) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:275
      #3  os_event::wait_time_low (this=0x83946840, time_in_usec=1000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:385
      #4  0x8088d529 in os_event_wait_time_low (event=0x83946840, time_in_usec=1000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/os/os0event.cc:485
      #5  0x8085e419 in lock_wait_timeout_thread () at /home/buildbot/buildbot/build/mariadb-10.4.13/storage/innobase/lock/lock0wait.cc:522
      #6  0xb7737295 in start_thread (arg=0xa7bf1b40) at pthread_create.c:333
      #7  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 2 (Thread 0xb159cb40 (LWP 3115)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773ca6c in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
      #2  0xb2220a96 in gu::Lock::wait (this=<synthetic pointer>, cond=...) at galerautils/src/gu_lock.hpp:45
      #3  galera::ServiceThd::thd_func (arg=0x8373debc) at galera/src/galera_service_thd.cpp:30
      #4  0xb7737295 in start_thread (arg=0xb159cb40) at pthread_create.c:333
      #5  0xb71930ae in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:114
       
      Thread 1 (Thread 0xb6efc7c0 (LWP 3113)):
      #0  0xb77bdc31 in __kernel_vsyscall ()
      #1  0xb773dcc1 in __pthread_kill (threadid=3069167552, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:58
      #2  0x80c1754c in my_write_core (sig=6) at /home/buildbot/buildbot/build/mariadb-10.4.13/mysys/stacktrace.c:481
      #3  0x80672fd6 in handle_fatal_signal (sig=6) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/signal_handler.cc:343
      #4  <signal handler called>
      #5  0xb77bdc31 in __kernel_vsyscall ()
      #6  0xb7188ecf in poll () at ../sysdeps/unix/syscall-template.S:84
      #7  0xb71a3630 in __poll_chk (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>, fdslen=24) at poll_chk.c:27
      #8  0x8036d897 in poll (__timeout=-1, __nfds=2, __fds=0xbfecb9f0) at /usr/include/i386-linux-gnu/bits/poll2.h:41
      #9  handle_connections_sockets () at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:6464
      #10 0x8036ee43 in mysqld_main (argc=162, argv=0xbfecc074) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/mysqld.cc:5900
      #11 0x803489c7 in main (argc=23, argv=0xbfecc074) at /home/buildbot/buildbot/build/mariadb-10.4.13/sql/main.cc:25
       
      Compressed file /dev/shm/var/2/log/galera.galera_insert_multi-innodb/mysqld.1/data/core
       - saving '/dev/shm/var/2/log/galera.galera_insert_multi-innodb/' to '/dev/shm/var/log/galera.galera_insert_multi-innodb/'
       
      Retrying test galera.galera_insert_multi, attempt(2/3)...
       
      worker[2] > Restart  - not started
      worker[2] > Restart  - not started
      

      Attachments

        Activity

          People

            stepan.patryshev Stepan Patryshev (Inactive)
            stepan.patryshev Stepan Patryshev (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.