Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-21523

galera.MDEV-16509 MTR failed: timeout after 900 seconds: Can't connect to local MySQL server

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • 10.4.12
    • 10.4.18, 10.5.9, 10.6.0
    • Galera, Tests
    • None
    • kvm-rpm-centos74-amd64-debug

    Description

      galera.MDEV-16509 failed on bb.

      stdio.log:

      10.4.12 2d4b6571ecf15a4382702d26df9439bc5a1005de

      galera.MDEV-16509 'innodb'               w1 [ fail ]  timeout after 900 seconds
              Test ended at 2020-01-14 08:07:17
       
      Test case timeout after 900 seconds
       
      == /dev/shm/var/1/log/MDEV-16509.log == 
      SET DEBUG_SYNC = "now WAIT_FOR bcol_reached_1";
      wsrep_last_seen_gtid_match
      1
      connection node_1a;
      SET DEBUG_SYNC = "wsrep_before_commit_order_leave SIGNAL bcol_reached_2 WAIT_FOR bcol_continue_2";
      SET DEBUG_SYNC = "wsrep_after_commit_order_leave SIGNAL acol_reached_2 WAIT_FOR acol_continue_2";
      SET DEBUG_SYNC = "after_group_after_commit SIGNAL agac_reached_2 WAIT_FOR agac_continue_2";
      INSERT INTO t1 VALUES (3);;
      connection ctrl;
      SET DEBUG_SYNC = "now SIGNAL bcol_continue_1";
      SET DEBUG_SYNC = "now WAIT_FOR acol_reached_1";
      Warnings:
      Warning	1639	debug sync point wait timed out
      SET DEBUG_SYNC = "now WAIT_FOR bcol_reached_2";
      Warnings:
      Warning	1639	debug sync point wait timed out
      wsrep_last_seen_gtid_match
      0
      SET DEBUG_SYNC = "now SIGNAL bcol_continue_2";
      SET DEBUG_SYNC = "now WAIT_FOR acol_reached_2";
       
       == /dev/shm/var/1/tmp/analyze-timeout-mysqld.1.err ==
      mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/dev/shm/var/tmp/1/mysqld.1.sock' (111)
       
       == /dev/shm/var/1/tmp/analyze-timeout-mysqld.2.err ==
      mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/dev/shm/var/tmp/1/mysqld.2.sock' (111)
       
       
       - found 'core.3087' (0/0)
       
      Trying 'dbx' to get a backtrace
      gdb not found, cannot get the stack trace
       
      Trying 'lldb' to get a backtrace from coredump /dev/shm/var/1/log/galera.MDEV-16509-innodb/mysqld.2/data/core.3087
      Compressed file /dev/shm/var/1/log/galera.MDEV-16509-innodb/mysqld.2/data/core.3087
       - found 'core.3050' (1/0)
       
      Trying 'dbx' to get a backtrace
      gdb not found, cannot get the stack trace
       
      Trying 'lldb' to get a backtrace from coredump /dev/shm/var/1/log/galera.MDEV-16509-innodb/mysqld.1/data/core.3050
      Compressed file /dev/shm/var/1/log/galera.MDEV-16509-innodb/mysqld.1/data/core.3050
       - saving '/dev/shm/var/1/log/galera.MDEV-16509-innodb/' to '/dev/shm/var/log/galera.MDEV-16509-innodb/'
       
      Retrying test galera.MDEV-16509, attempt(2/3)...
       
      worker[1] > Restart  - not started
      worker[1] > Restart  - not started
      ***Warnings generated in error logs during shutdown after running tests: galera.GAL-480 galera.MDEV-16509 galera.GAL-382 galera.GCF-939 galera.GAL-401
       
      Attempting backtrace. You can use the following information to find out
      Attempting backtrace. You can use the following information to find out
       
      galera.mysql-wsrep#201 'innodb'          w2 [ pass ]   2722
      worker[2] > Restart [mysqld.1 - pid: 18136, winpid: 18136] - using different config file
      worker[2] > Restart [mysqld.2 - pid: 18172, winpid: 18172] - using different config file
      galera.MDEV-16509 'innodb'               w1 [ retry-pass ]   4051
       
      Retrying test galera.MDEV-16509, attempt(3/3)...
       
      galera.MDEV-20225 'innodb'               w1 [ pass ]   4046
      galera.MDEV-16509 'innodb'               w1 [ retry-pass ]   4054
      

      Attachments

        Issue Links

          Activity

            It is still failed on BB 10.4 CS.

            stdio.log:

            10.4.18-MariaDB-debug 031e1427ed9a7b939323f353c7aa037b8a74247c

            galera.MDEV-16509 'innodb'               w2 [ fail ]  timeout after 900 seconds
                    Test ended at 2020-11-19 13:01:09
             
            Test case timeout after 900 seconds
             
            == /dev/shm/var/2/log/MDEV-16509.log == 
            SET DEBUG_SYNC = "now WAIT_FOR bcol_reached_1";
            wsrep_last_seen_gtid_match
            1
            connection node_1a;
            SET DEBUG_SYNC = "wsrep_before_commit_order_leave SIGNAL bcol_reached_2 WAIT_FOR bcol_continue_2";
            SET DEBUG_SYNC = "wsrep_after_commit_order_leave SIGNAL acol_reached_2 WAIT_FOR acol_continue_2";
            SET DEBUG_SYNC = "after_group_after_commit SIGNAL agac_reached_2 WAIT_FOR agac_continue_2";
            INSERT INTO t1 VALUES (3);;
            connection ctrl;
            SET DEBUG_SYNC = "now SIGNAL bcol_continue_1";
            SET DEBUG_SYNC = "now WAIT_FOR acol_reached_1";
            Warnings:
            Warning	1639	debug sync point wait timed out
            SET DEBUG_SYNC = "now WAIT_FOR bcol_reached_2";
            Warnings:
            Warning	1639	debug sync point wait timed out
            wsrep_last_seen_gtid_match
            0
            SET DEBUG_SYNC = "now SIGNAL bcol_continue_2";
            SET DEBUG_SYNC = "now WAIT_FOR acol_reached_2";
             
             == /dev/shm/var/2/tmp/analyze-timeout-mysqld.2.err ==
            mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/dev/shm/var/tmp/2/mysqld.2.sock' (111)
             
             == /dev/shm/var/2/tmp/analyze-timeout-mysqld.1.err ==
            mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/dev/shm/var/tmp/2/mysqld.1.sock' (111)
             
             
             - found 'core.3754' (0/0)
             
            Trying 'dbx' to get a backtrace
            gdb not found, cannot get the stack trace
             
            Trying 'lldb' to get a backtrace from coredump /dev/shm/var/2/log/galera.MDEV-16509-innodb/mysqld.2/data/core.3754
             - deleting it, already saved 0
             - found 'core.3717' (0/0)
             
            Trying 'dbx' to get a backtrace
            gdb not found, cannot get the stack trace
             
            Trying 'lldb' to get a backtrace from coredump /dev/shm/var/2/log/galera.MDEV-16509-innodb/mysqld.1/data/core.3717
             - deleting it, already saved 0
             - saving '/dev/shm/var/2/log/galera.MDEV-16509-innodb/' to '/dev/shm/var/log/galera.MDEV-16509-innodb/'
             
            Retrying test galera.MDEV-16509, attempt(2/3)...
             
            worker[2] > Restart  - not started
            worker[2] > Restart  - not started
            ***Warnings generated in error logs during shutdown after running tests: galera.GAL-480 galera.MDEV-16509 galera.GAL-382 galera.GAL-401
             
            Attempting backtrace. You can use the following information to find out
            Attempting backtrace. You can use the following information to find out
            

            It fails also on BB 10.5 CS.

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - It is still failed on BB 10.4 CS . stdio.log : 10.4.18-MariaDB-debug 031e1427ed9a7b939323f353c7aa037b8a74247c galera.MDEV-16509 'innodb' w2 [ fail ] timeout after 900 seconds Test ended at 2020-11-19 13:01:09   Test case timeout after 900 seconds   == /dev/shm/var/2/log/MDEV-16509.log == SET DEBUG_SYNC = "now WAIT_FOR bcol_reached_1"; wsrep_last_seen_gtid_match 1 connection node_1a; SET DEBUG_SYNC = "wsrep_before_commit_order_leave SIGNAL bcol_reached_2 WAIT_FOR bcol_continue_2"; SET DEBUG_SYNC = "wsrep_after_commit_order_leave SIGNAL acol_reached_2 WAIT_FOR acol_continue_2"; SET DEBUG_SYNC = "after_group_after_commit SIGNAL agac_reached_2 WAIT_FOR agac_continue_2"; INSERT INTO t1 VALUES (3);; connection ctrl; SET DEBUG_SYNC = "now SIGNAL bcol_continue_1"; SET DEBUG_SYNC = "now WAIT_FOR acol_reached_1"; Warnings: Warning 1639 debug sync point wait timed out SET DEBUG_SYNC = "now WAIT_FOR bcol_reached_2"; Warnings: Warning 1639 debug sync point wait timed out wsrep_last_seen_gtid_match 0 SET DEBUG_SYNC = "now SIGNAL bcol_continue_2"; SET DEBUG_SYNC = "now WAIT_FOR acol_reached_2";   == /dev/shm/var/2/tmp/analyze-timeout-mysqld.2.err == mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/dev/shm/var/tmp/2/mysqld.2.sock' (111)   == /dev/shm/var/2/tmp/analyze-timeout-mysqld.1.err == mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/dev/shm/var/tmp/2/mysqld.1.sock' (111)     - found 'core.3754' (0/0)   Trying 'dbx' to get a backtrace gdb not found, cannot get the stack trace   Trying 'lldb' to get a backtrace from coredump /dev/shm/var/2/log/galera.MDEV-16509-innodb/mysqld.2/data/core.3754 - deleting it, already saved 0 - found 'core.3717' (0/0)   Trying 'dbx' to get a backtrace gdb not found, cannot get the stack trace   Trying 'lldb' to get a backtrace from coredump /dev/shm/var/2/log/galera.MDEV-16509-innodb/mysqld.1/data/core.3717 - deleting it, already saved 0 - saving '/dev/shm/var/2/log/galera.MDEV-16509-innodb/' to '/dev/shm/var/log/galera.MDEV-16509-innodb/'   Retrying test galera.MDEV-16509, attempt(2/3)...   worker[2] > Restart - not started worker[2] > Restart - not started ***Warnings generated in error logs during shutdown after running tests: galera.GAL-480 galera.MDEV-16509 galera.GAL-382 galera.GAL-401   Attempting backtrace. You can use the following information to find out Attempting backtrace. You can use the following information to find out It fails also on BB 10.5 CS .

            On the new BB 10.5 CS (10.4-Debug-manual-2020-12-10-21-51-09/debian/buster):

            10.4.18-MariaDB-debug e007fcf59dd02407277b130dbd3984a7b5352c5e debian buster

            galera.MDEV-16509 'innodb'               [ fail ]  timeout after 1200 seconds
                    Test ended at 2020-12-10 23:56:28
             
            Test case timeout after 1200 seconds
             
            == /var/tmp/mtr/log/MDEV-16509.log == 
            SET DEBUG_SYNC = "after_group_after_commit SIGNAL agac_reached_2 WAIT_FOR agac_continue_2";
            INSERT INTO t1 VALUES (3);;
            connection ctrl;
            SET DEBUG_SYNC = "now SIGNAL bcol_continue_1";
            SET DEBUG_SYNC = "now WAIT_FOR acol_reached_1";
            Warnings:
            Warning	1639	debug sync point wait timed out
            SET DEBUG_SYNC = "now WAIT_FOR bcol_reached_2";
            Warnings:
            Warning	1639	debug sync point wait timed out
            wsrep_last_seen_gtid_match
            0
            SET DEBUG_SYNC = "now SIGNAL bcol_continue_2";
            SET DEBUG_SYNC = "now WAIT_FOR acol_reached_2";
            Warnings:
            Warning	1639	debug sync point wait timed out
            wsrep_last_seen_gtid_match
            0
            SET DEBUG_SYNC = "now SIGNAL acol_continue_1";
            SET DEBUG_SYNC = "now WAIT_FOR agac_reached_1";
             
             == /var/tmp/mtr/tmp/analyze-timeout-mysqld.1.err ==
            mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/var/tmp/mtr/tmp/mysqld.1.sock' (111)
             
             == /var/tmp/mtr/tmp/analyze-timeout-mysqld.2.err ==
            mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/var/tmp/mtr/tmp/mysqld.2.sock' (111)
             
             
             - found 'core' (0/0)
             
            Trying 'dbx' to get a backtrace
             
            Trying 'gdb' to get a backtrace from coredump /var/tmp/mtr/log/galera.MDEV-16509-innodb/mysqld.2/data/core
            Core generated by '/home/timofey_turenko_mariadb_com/MariaDBEnterprise/bin/mysqld'
            Output from gdb follows. The first stack trace is from the failing thread.
            The following stack traces are from all threads (so the failing one is
            duplicated).
            --------------------------
            [New LWP 4340]
            [New LWP 4346]
            [New LWP 4344]
            [New LWP 4347]
            [New LWP 4343]
            [New LWP 4345]
            [New LWP 4342]
            [New LWP 4533]
            [New LWP 4540]
            [New LWP 4528]
            [New LWP 4532]
            [New LWP 4536]
            [New LWP 4537]
            [New LWP 4539]
            [New LWP 4534]
            [New LWP 4529]
            [New LWP 4521]
            [New LWP 4517]
            [New LWP 4541]
            [New LWP 4538]
            [New LWP 4530]
            [New LWP 4522]
            [New LWP 4523]
            [New LWP 4519]
            [New LWP 4545]
            [New LWP 4535]
            [New LWP 4531]
            [New LWP 4520]
            [New LWP 4542]
            [New LWP 4527]
            [New LWP 4518]
            [New LWP 4524]
            [Thread debugging using libthread_db enabled]
            Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
            Core was generated by `/home/timofey_turenko_mariadb_com/MariaDBEnterprise/bin/mysqld --defaults-group'.
            Program terminated with signal SIGABRT, Aborted.
            #0  __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:56
            56	../sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.
            [Current thread is 1 (Thread 0x7f6c705127c0 (LWP 4340))]
            #0  __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:56
            #1  0x0000559ab6c141f1 in my_write_core (sig=6) at /home/timofey_turenko_mariadb_com/server/mysys/stacktrace.c:386
            #2  0x0000559ab638ab8e in handle_fatal_signal (sig=6) at /home/timofey_turenko_mariadb_com/server/sql/signal_handler.cc:343
            #3  <signal handler called>
            #4  0x00007f6c7077a819 in __GI___poll (fds=0x7ffd054ef590, nfds=2, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
            #5  0x0000559ab5efb1f5 in handle_connections_sockets () at /home/timofey_turenko_mariadb_com/server/sql/mysqld.cc:6481
            #6  0x0000559ab5efa45c in mysqld_main (argc=163, argv=0x559ab861d000) at /home/timofey_turenko_mariadb_com/server/sql/mysqld.cc:5917
            #7  0x0000559ab5eee405 in main (argc=23, argv=0x7ffd054ef898) at /home/timofey_turenko_mariadb_com/server/sql/main.cc:25
             
            Thread 32 (Thread 0x7f6c317fa700 (LWP 4524)):
            #0  futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c317f9b80, expected=0, futex_word=0x559ab88dde1c) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
            #1  __pthread_cond_wait_common (abstime=0x7f6c317f9b80, mutex=0x559ab88dddc8, cond=0x559ab88dddf0) at pthread_cond_wait.c:539
            #2  __pthread_cond_timedwait (cond=0x559ab88dddf0, mutex=0x559ab88dddc8, abstime=0x7f6c317f9b80) at pthread_cond_wait.c:667
            #3  0x0000559ab66daa5a in os_event::timed_wait (this=0x559ab88dddb0, abstime=0x7f6c317f9b80) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:275
            #4  0x0000559ab66dad19 in os_event::wait_time_low (this=0x559ab88dddb0, time_in_usec=1000000, reset_sig_count=1695) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:385
            #5  0x0000559ab66daeb2 in os_event_wait_time_low (event=0x559ab88dddb0, time_in_usec=1000000, reset_sig_count=1695) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:485
            #6  0x0000559ab68ff1b7 in pc_sleep_if_needed (next_loop_time=2321467, sig_count=1695, cur_time=2320467) at /home/timofey_turenko_mariadb_com/server/storage/innobase/buf/buf0flu.cc:2627
            #7  0x0000559ab690039c in buf_flush_page_cleaner_coordinator () at /home/timofey_turenko_mariadb_com/server/storage/innobase/buf/buf0flu.cc:3086
            #8  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #9  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 31 (Thread 0x7f6c58954700 (LWP 4518)):
            #0  syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38
            #1  0x00007f6c7126e27a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #2  0x0000559ab66cac8b in LinuxAIOHandler::collect (this=0x7f6c58953b90) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1819
            #3  0x0000559ab66cb39a in LinuxAIOHandler::poll (this=0x7f6c58953b90, m1=0x7f6c58953c30, m2=0x7f6c58953c38, request=0x7f6c58953c60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1980
            #4  0x0000559ab66cb50d in os_aio_linux_handler (global_segment=0, m1=0x7f6c58953c30, m2=0x7f6c58953c38, request=0x7f6c58953c60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:2034
            #5  0x0000559ab66d0818 in os_aio_handler (segment=0, m1=0x7f6c58953c30, m2=0x7f6c58953c38, request=0x7f6c58953c60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:5607
            #6  0x0000559ab6980a97 in fil_aio_wait (segment=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/fil/fil0fil.cc:4316
            #7  0x0000559ab67f5b91 in io_handler_thread (arg=0x559ab78242e0 <n>) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0start.cc:324
            #8  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #9  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 30 (Thread 0x7f6c23fff700 (LWP 4527)):
            #0  futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c23ffedf0, expected=0, futex_word=0x559ab8aaf098) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
            #1  __pthread_cond_wait_common (abstime=0x7f6c23ffedf0, mutex=0x559ab8aaf048, cond=0x559ab8aaf070) at pthread_cond_wait.c:539
            #2  __pthread_cond_timedwait (cond=0x559ab8aaf070, mutex=0x559ab8aaf048, abstime=0x7f6c23ffedf0) at pthread_cond_wait.c:667
            #3  0x0000559ab66daa5a in os_event::timed_wait (this=0x559ab8aaf030, abstime=0x7f6c23ffedf0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:275
            #4  0x0000559ab66dad19 in os_event::wait_time_low (this=0x559ab8aaf030, time_in_usec=1000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:385
            #5  0x0000559ab66daeb2 in os_event_wait_time_low (event=0x559ab8aaf030, time_in_usec=1000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:485
            #6  0x0000559ab669c8d3 in lock_wait_timeout_thread () at /home/timofey_turenko_mariadb_com/server/storage/innobase/lock/lock0wait.cc:522
            #7  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #8  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 29 (Thread 0x7f6c58b09700 (LWP 4542)):
            #0  futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab77a548c <COND_slave_background+44>) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
            #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab77a8708 <LOCK_slave_background+40>, cond=0x559ab77a5460 <COND_slave_background>) at pthread_cond_wait.c:502
            #2  __pthread_cond_wait (cond=0x559ab77a5460 <COND_slave_background>, mutex=0x559ab77a8708 <LOCK_slave_background+40>) at pthread_cond_wait.c:655
            #3  0x0000559ab6c1994a in safe_cond_wait (cond=0x559ab77a5460 <COND_slave_background>, mp=0x559ab77a86e0 <LOCK_slave_background>, file=0x559ab6cc55a8 "/home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h", line=1174) at /home/timofey_turenko_mariadb_com/server/mysys/thr_mutex.c:492
            #4  0x0000559ab5f209d1 in inline_mysql_cond_wait (that=0x559ab77a5460 <COND_slave_background>, mutex=0x559ab77a86e0 <LOCK_slave_background>, src_file=0x559ab6cc6240 "/home/timofey_turenko_mariadb_com/server/sql/slave.cc", src_line=522) at /home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h:1174
            #5  0x0000559ab5f2229f in handle_slave_background (arg=0x0) at /home/timofey_turenko_mariadb_com/server/sql/slave.cc:522
            #6  0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab8c6be70) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869
            #7  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #8  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 28 (Thread 0x7f6c337fe700 (LWP 4520)):
            #0  syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38
            #1  0x00007f6c7126e27a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #2  0x0000559ab66cac8b in LinuxAIOHandler::collect (this=0x7f6c337fdb90) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1819
            #3  0x0000559ab66cb39a in LinuxAIOHandler::poll (this=0x7f6c337fdb90, m1=0x7f6c337fdc30, m2=0x7f6c337fdc38, request=0x7f6c337fdc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1980
            #4  0x0000559ab66cb50d in os_aio_linux_handler (global_segment=2, m1=0x7f6c337fdc30, m2=0x7f6c337fdc38, request=0x7f6c337fdc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:2034
            #5  0x0000559ab66d0818 in os_aio_handler (segment=2, m1=0x7f6c337fdc30, m2=0x7f6c337fdc38, request=0x7f6c337fdc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:5607
            #6  0x0000559ab6980a97 in fil_aio_wait (segment=2) at /home/timofey_turenko_mariadb_com/server/storage/innobase/fil/fil0fil.cc:4316
            #7  0x0000559ab67f5b91 in io_handler_thread (arg=0x559ab78242f0 <n+16>) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0start.cc:324
            #8  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #9  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 27 (Thread 0x7f6c227fc700 (LWP 4531)):
            #0  futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c227fbbf0, expected=0, futex_word=0x559ab8a75428) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
            #1  __pthread_cond_wait_common (abstime=0x7f6c227fbbf0, mutex=0x559ab8a753d8, cond=0x559ab8a75400) at pthread_cond_wait.c:539
            #2  __pthread_cond_timedwait (cond=0x559ab8a75400, mutex=0x559ab8a753d8, abstime=0x7f6c227fbbf0) at pthread_cond_wait.c:667
            #3  0x0000559ab66daa5a in os_event::timed_wait (this=0x559ab8a753c0, abstime=0x7f6c227fbbf0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:275
            #4  0x0000559ab66dad19 in os_event::wait_time_low (this=0x559ab8a753c0, time_in_usec=5000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:385
            #5  0x0000559ab66daeb2 in os_event_wait_time_low (event=0x559ab8a753c0, time_in_usec=5000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:485
            #6  0x0000559ab685b576 in ib_wqueue_timedwait (wq=0x559ab8a75270, wait_in_usecs=5000000) at /home/timofey_turenko_mariadb_com/server/storage/innobase/ut/ut0wqueue.cc:154
            #7  0x0000559ab69cb934 in fts_optimize_thread (arg=0x559ab8a75270) at /home/timofey_turenko_mariadb_com/server/storage/innobase/fts/fts0opt.cc:2830
            #8  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #9  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 26 (Thread 0x7f6c17fff700 (LWP 4535)):
            #0  futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab88ddb98) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
            #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab88ddb48, cond=0x559ab88ddb70) at pthread_cond_wait.c:502
            #2  __pthread_cond_wait (cond=0x559ab88ddb70, mutex=0x559ab88ddb48) at pthread_cond_wait.c:655
            #3  0x0000559ab66db0e8 in os_event::wait (this=0x559ab88ddb30) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:158
            #4  0x0000559ab66dabf4 in os_event::wait_low (this=0x559ab88ddb30, reset_sig_count=325) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:325
            #5  0x0000559ab66daed7 in os_event_wait_low (event=0x559ab88ddb30, reset_sig_count=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:502
            #6  0x0000559ab67ef5a2 in srv_resume_thread (slot=0x559ab75e1d78 <srv_sys+504>, sig_count=0, wait=true, timeout_usec=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:910
            #7  0x0000559ab67f3869 in srv_worker_thread (arg=0x0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:2517
            #8  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #9  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 25 (Thread 0x7f6c58abe700 (LWP 4545)):
            #0  futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c58abdd00, expected=0, futex_word=0x559ab77a544c <COND_thread_cache+44>) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
            #1  __pthread_cond_wait_common (abstime=0x7f6c58abdd00, mutex=0x559ab77a7e08 <LOCK_thread_cache+40>, cond=0x559ab77a5420 <COND_thread_cache>) at pthread_cond_wait.c:539
            #2  __pthread_cond_timedwait (cond=0x559ab77a5420 <COND_thread_cache>, mutex=0x559ab77a7e08 <LOCK_thread_cache+40>, abstime=0x7f6c58abdd00) at pthread_cond_wait.c:667
            #3  0x0000559ab6c19d0a in safe_cond_timedwait (cond=0x559ab77a5420 <COND_thread_cache>, mp=0x559ab77a7de0 <LOCK_thread_cache>, abstime=0x7f6c58abdd00, file=0x559ab6cb5028 "/home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h", line=1211) at /home/timofey_turenko_mariadb_com/server/mysys/thr_mutex.c:546
            #4  0x0000559ab5eeed78 in inline_mysql_cond_timedwait (that=0x559ab77a5420 <COND_thread_cache>, mutex=0x559ab77a7de0 <LOCK_thread_cache>, abstime=0x7f6c58abdd00, src_file=0x559ab6cb7178 "/home/timofey_turenko_mariadb_com/server/sql/mysqld.cc", src_line=2695) at /home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h:1211
            #5  0x0000559ab5ef3c41 in cache_thread (thd=0x7f6c3400b6a0) at /home/timofey_turenko_mariadb_com/server/sql/mysqld.cc:2694
            #6  0x0000559ab5ef3eb1 in one_thread_per_connection_end (thd=0x7f6c3400b6a0, put_in_cache=true) at /home/timofey_turenko_mariadb_com/server/sql/mysqld.cc:2780
            #7  0x0000559ab61b68d8 in do_handle_one_connection (connect=0x559ab8c22600) at /home/timofey_turenko_mariadb_com/server/sql/sql_connect.cc:1423
            #8  0x0000559ab61b65b8 in handle_one_connection (arg=0x559ab8c22600) at /home/timofey_turenko_mariadb_com/server/sql/sql_connect.cc:1316
            #9  0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab8c654a0) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869
            #10 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #11 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 24 (Thread 0x7f6c33fff700 (LWP 4519)):
            #0  syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38
            #1  0x00007f6c7126e27a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #2  0x0000559ab66cac8b in LinuxAIOHandler::collect (this=0x7f6c33ffeb90) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1819
            #3  0x0000559ab66cb39a in LinuxAIOHandler::poll (this=0x7f6c33ffeb90, m1=0x7f6c33ffec30, m2=0x7f6c33ffec38, request=0x7f6c33ffec60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1980
            #4  0x0000559ab66cb50d in os_aio_linux_handler (global_segment=1, m1=0x7f6c33ffec30, m2=0x7f6c33ffec38, request=0x7f6c33ffec60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:2034
            #5  0x0000559ab66d0818 in os_aio_handler (segment=1, m1=0x7f6c33ffec30, m2=0x7f6c33ffec38, request=0x7f6c33ffec60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:5607
            #6  0x0000559ab6980a97 in fil_aio_wait (segment=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/fil/fil0fil.cc:4316
            #7  0x0000559ab67f5b91 in io_handler_thread (arg=0x559ab78242e8 <n+8>) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0start.cc:324
            #8  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #9  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 23 (Thread 0x7f6c31ffb700 (LWP 4523)):
            #0  syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38
            #1  0x00007f6c7126e27a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #2  0x0000559ab66cac8b in LinuxAIOHandler::collect (this=0x7f6c31ffab90) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1819
            #3  0x0000559ab66cb39a in LinuxAIOHandler::poll (this=0x7f6c31ffab90, m1=0x7f6c31ffac30, m2=0x7f6c31ffac38, request=0x7f6c31ffac60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1980
            #4  0x0000559ab66cb50d in os_aio_linux_handler (global_segment=5, m1=0x7f6c31ffac30, m2=0x7f6c31ffac38, request=0x7f6c31ffac60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:2034
            #5  0x0000559ab66d0818 in os_aio_handler (segment=5, m1=0x7f6c31ffac30, m2=0x7f6c31ffac38, request=0x7f6c31ffac60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:5607
            #6  0x0000559ab6980a97 in fil_aio_wait (segment=5) at /home/timofey_turenko_mariadb_com/server/storage/innobase/fil/fil0fil.cc:4316
            #7  0x0000559ab67f5b91 in io_handler_thread (arg=0x559ab7824308 <n+40>) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0start.cc:324
            #8  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #9  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 22 (Thread 0x7f6c327fc700 (LWP 4522)):
            #0  syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38
            #1  0x00007f6c7126e27a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #2  0x0000559ab66cac8b in LinuxAIOHandler::collect (this=0x7f6c327fbb90) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1819
            #3  0x0000559ab66cb39a in LinuxAIOHandler::poll (this=0x7f6c327fbb90, m1=0x7f6c327fbc30, m2=0x7f6c327fbc38, request=0x7f6c327fbc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1980
            #4  0x0000559ab66cb50d in os_aio_linux_handler (global_segment=4, m1=0x7f6c327fbc30, m2=0x7f6c327fbc38, request=0x7f6c327fbc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:2034
            #5  0x0000559ab66d0818 in os_aio_handler (segment=4, m1=0x7f6c327fbc30, m2=0x7f6c327fbc38, request=0x7f6c327fbc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:5607
            #6  0x0000559ab6980a97 in fil_aio_wait (segment=4) at /home/timofey_turenko_mariadb_com/server/storage/innobase/fil/fil0fil.cc:4316
            #7  0x0000559ab67f5b91 in io_handler_thread (arg=0x559ab7824300 <n+32>) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0start.cc:324
            #8  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #9  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 21 (Thread 0x7f6c22ffd700 (LWP 4530)):
            #0  futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c22ffce10, expected=0, futex_word=0x559ab8ae0828) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
            #1  __pthread_cond_wait_common (abstime=0x7f6c22ffce10, mutex=0x559ab8ae07d8, cond=0x559ab8ae0800) at pthread_cond_wait.c:539
            #2  __pthread_cond_timedwait (cond=0x559ab8ae0800, mutex=0x559ab8ae07d8, abstime=0x7f6c22ffce10) at pthread_cond_wait.c:667
            #3  0x0000559ab66daa5a in os_event::timed_wait (this=0x559ab8ae07c0, abstime=0x7f6c22ffce10) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:275
            #4  0x0000559ab66dad19 in os_event::wait_time_low (this=0x559ab8ae07c0, time_in_usec=10000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:385
            #5  0x0000559ab66daeb2 in os_event_wait_time_low (event=0x559ab8ae07c0, time_in_usec=10000000, reset_sig_count=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:485
            #6  0x0000559ab696945e in dict_stats_thread () at /home/timofey_turenko_mariadb_com/server/storage/innobase/dict/dict0stats_bg.cc:475
            #7  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #8  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 20 (Thread 0x7f6c167fc700 (LWP 4538)):
            #0  0x00007f6c714aabf0 in __GI___nanosleep (requested_time=0x7f6c167fb790, remaining=0x0) at ../sysdeps/unix/sysv/linux/nanosleep.c:28
            #1  0x0000559ab66db459 in os_thread_sleep (tm=1000000) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0thread.cc:231
            #2  0x0000559ab68c6f8c in btr_defragment_thread () at /home/timofey_turenko_mariadb_com/server/storage/innobase/btr/btr0defragment.cc:700
            #3  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #4  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 19 (Thread 0x7f6c58b54700 (LWP 4541)):
            #0  0x00007f6c706c44cc in __GI___sigtimedwait (set=0x7f6c58b53d90, info=0x7f6c58b53cb0, timeout=0x0) at ../sysdeps/unix/sysv/linux/sigtimedwait.c:29
            #1  0x0000559ab5eee466 in my_sigwait (set=0x7f6c58b53d90, sig=0x7f6c58b53d54, code=0x7f6c58b53d58) at /home/timofey_turenko_mariadb_com/server/include/my_pthread.h:196
            #2  0x0000559ab5ef4b63 in signal_hand (arg=0x0) at /home/timofey_turenko_mariadb_com/server/sql/mysqld.cc:3251
            #3  0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab8b1c450) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869
            #4  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #5  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 18 (Thread 0x7f6c5a056700 (LWP 4517)):
            #0  futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c5a055d60, expected=0, futex_word=0x559ab8034ea8 <COND_checkpoint+40>) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
            #1  __pthread_cond_wait_common (abstime=0x7f6c5a055d60, mutex=0x559ab8034de8 <LOCK_checkpoint+40>, cond=0x559ab8034e80 <COND_checkpoint>) at pthread_cond_wait.c:539
            #2  __pthread_cond_timedwait (cond=0x559ab8034e80 <COND_checkpoint>, mutex=0x559ab8034de8 <LOCK_checkpoint+40>, abstime=0x7f6c5a055d60) at pthread_cond_wait.c:667
            #3  0x0000559ab6c19d0a in safe_cond_timedwait (cond=0x559ab8034e80 <COND_checkpoint>, mp=0x559ab8034dc0 <LOCK_checkpoint>, abstime=0x7f6c5a055d60, file=0x559ab708fd60 "/home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h", line=1211) at /home/timofey_turenko_mariadb_com/server/mysys/thr_mutex.c:546
            #4  0x0000559ab6a6f5ac in inline_mysql_cond_timedwait (that=0x559ab8034e80 <COND_checkpoint>, mutex=0x559ab8034dc0 <LOCK_checkpoint>, abstime=0x7f6c5a055d60, src_file=0x559ab708fdb0 "/home/timofey_turenko_mariadb_com/server/storage/maria/ma_servicethread.c", src_line=116) at /home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h:1211
            #5  0x0000559ab6a6faf1 in my_service_thread_sleep (control=0x559ab75e6ce0 <checkpoint_control>, sleep_time=30000000000) at /home/timofey_turenko_mariadb_com/server/storage/maria/ma_servicethread.c:115
            #6  0x0000559ab6a63911 in ma_checkpoint_background (arg=0x1e) at /home/timofey_turenko_mariadb_com/server/storage/maria/ma_checkpoint.c:707
            #7  0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab88964f0) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869
            #8  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #9  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 17 (Thread 0x7f6c32ffd700 (LWP 4521)):
            #0  syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38
            #1  0x00007f6c7126e27a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
            #2  0x0000559ab66cac8b in LinuxAIOHandler::collect (this=0x7f6c32ffcb90) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1819
            #3  0x0000559ab66cb39a in LinuxAIOHandler::poll (this=0x7f6c32ffcb90, m1=0x7f6c32ffcc30, m2=0x7f6c32ffcc38, request=0x7f6c32ffcc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1980
            #4  0x0000559ab66cb50d in os_aio_linux_handler (global_segment=3, m1=0x7f6c32ffcc30, m2=0x7f6c32ffcc38, request=0x7f6c32ffcc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:2034
            #5  0x0000559ab66d0818 in os_aio_handler (segment=3, m1=0x7f6c32ffcc30, m2=0x7f6c32ffcc38, request=0x7f6c32ffcc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:5607
            #6  0x0000559ab6980a97 in fil_aio_wait (segment=3) at /home/timofey_turenko_mariadb_com/server/storage/innobase/fil/fil0fil.cc:4316
            #7  0x0000559ab67f5b91 in io_handler_thread (arg=0x559ab78242f8 <n+24>) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0start.cc:324
            #8  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #9  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 16 (Thread 0x7f6c237fe700 (LWP 4529)):
            #0  futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c237fddd0, expected=0, futex_word=0x559ab88ddd18) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
            #1  __pthread_cond_wait_common (abstime=0x7f6c237fddd0, mutex=0x559ab88ddcc8, cond=0x559ab88ddcf0) at pthread_cond_wait.c:539
            #2  __pthread_cond_timedwait (cond=0x559ab88ddcf0, mutex=0x559ab88ddcc8, abstime=0x7f6c237fddd0) at pthread_cond_wait.c:667
            #3  0x0000559ab66daa5a in os_event::timed_wait (this=0x559ab88ddcb0, abstime=0x7f6c237fddd0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:275
            #4  0x0000559ab66dad19 in os_event::wait_time_low (this=0x559ab88ddcb0, time_in_usec=5000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:385
            #5  0x0000559ab66daeb2 in os_event_wait_time_low (event=0x559ab88ddcb0, time_in_usec=5000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:485
            #6  0x0000559ab67f1540 in srv_monitor_thread () at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:1690
            #7  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #8  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 15 (Thread 0x7f6c20ff9700 (LWP 4534)):
            #0  futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab88ddb1c) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
            #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab88ddac8, cond=0x559ab88ddaf0) at pthread_cond_wait.c:502
            #2  __pthread_cond_wait (cond=0x559ab88ddaf0, mutex=0x559ab88ddac8) at pthread_cond_wait.c:655
            #3  0x0000559ab66db0e8 in os_event::wait (this=0x559ab88ddab0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:158
            #4  0x0000559ab66dabf4 in os_event::wait_low (this=0x559ab88ddab0, reset_sig_count=388) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:325
            #5  0x0000559ab66daed7 in os_event_wait_low (event=0x559ab88ddab0, reset_sig_count=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:502
            #6  0x0000559ab67ef5a2 in srv_resume_thread (slot=0x559ab75e1d40 <srv_sys+448>, sig_count=0, wait=true, timeout_usec=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:910
            #7  0x0000559ab67f3869 in srv_worker_thread (arg=0x0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:2517
            #8  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #9  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 14 (Thread 0x7f6c15ffb700 (LWP 4539)):
            #0  futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab88dde98) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
            #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab88dde48, cond=0x559ab88dde70) at pthread_cond_wait.c:502
            #2  __pthread_cond_wait (cond=0x559ab88dde70, mutex=0x559ab88dde48) at pthread_cond_wait.c:655
            #3  0x0000559ab66db0e8 in os_event::wait (this=0x559ab88dde30) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:158
            #4  0x0000559ab66dabf4 in os_event::wait_low (this=0x559ab88dde30, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:325
            #5  0x0000559ab66daed7 in os_event_wait_low (event=0x559ab88dde30, reset_sig_count=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:502
            #6  0x0000559ab68d84dd in buf_resize_thread () at /home/timofey_turenko_mariadb_com/server/storage/innobase/buf/buf0buf.cc:3142
            #7  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #8  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 13 (Thread 0x7f6c16ffd700 (LWP 4537)):
            #0  futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab88ddd98) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
            #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab88ddd48, cond=0x559ab88ddd70) at pthread_cond_wait.c:502
            #2  __pthread_cond_wait (cond=0x559ab88ddd70, mutex=0x559ab88ddd48) at pthread_cond_wait.c:655
            #3  0x0000559ab66db0e8 in os_event::wait (this=0x559ab88ddd30) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:158
            #4  0x0000559ab66dabf4 in os_event::wait_low (this=0x559ab88ddd30, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:325
            #5  0x0000559ab66daed7 in os_event_wait_low (event=0x559ab88ddd30, reset_sig_count=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:502
            #6  0x0000559ab68f30c4 in buf_dump_thread () at /home/timofey_turenko_mariadb_com/server/storage/innobase/buf/buf0dump.cc:832
            #7  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #8  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 12 (Thread 0x7f6c177fe700 (LWP 4536)):
            #0  futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab88ddc18) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
            #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab88ddbc8, cond=0x559ab88ddbf0) at pthread_cond_wait.c:502
            #2  __pthread_cond_wait (cond=0x559ab88ddbf0, mutex=0x559ab88ddbc8) at pthread_cond_wait.c:655
            #3  0x0000559ab66db0e8 in os_event::wait (this=0x559ab88ddbb0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:158
            #4  0x0000559ab66dabf4 in os_event::wait_low (this=0x559ab88ddbb0, reset_sig_count=313) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:325
            #5  0x0000559ab66daed7 in os_event_wait_low (event=0x559ab88ddbb0, reset_sig_count=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:502
            #6  0x0000559ab67ef5a2 in srv_resume_thread (slot=0x559ab75e1db0 <srv_sys+560>, sig_count=0, wait=true, timeout_usec=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:910
            #7  0x0000559ab67f3869 in srv_worker_thread (arg=0x0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:2517
            #8  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #9  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 11 (Thread 0x7f6c21ffb700 (LWP 4532)):
            #0  0x00007f6c714aabf0 in __GI___nanosleep (requested_time=0x7f6c21ffade0, remaining=0x0) at ../sysdeps/unix/sysv/linux/nanosleep.c:28
            #1  0x0000559ab66db459 in os_thread_sleep (tm=1000000) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0thread.cc:231
            #2  0x0000559ab67f2f47 in srv_master_sleep () at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:2341
            #3  0x0000559ab67f30be in srv_master_thread (arg=0x0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:2381
            #4  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #5  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 10 (Thread 0x7f6c30df4700 (LWP 4528)):
            #0  futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c30df3c30, expected=0, futex_word=0x559ab88ddc98) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
            #1  __pthread_cond_wait_common (abstime=0x7f6c30df3c30, mutex=0x559ab88ddc48, cond=0x559ab88ddc70) at pthread_cond_wait.c:539
            #2  __pthread_cond_timedwait (cond=0x559ab88ddc70, mutex=0x559ab88ddc48, abstime=0x7f6c30df3c30) at pthread_cond_wait.c:667
            #3  0x0000559ab66daa5a in os_event::timed_wait (this=0x559ab88ddc30, abstime=0x7f6c30df3c30) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:275
            #4  0x0000559ab66dad19 in os_event::wait_time_low (this=0x559ab88ddc30, time_in_usec=1000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:385
            #5  0x0000559ab66daeb2 in os_event_wait_time_low (event=0x559ab88ddc30, time_in_usec=1000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:485
            #6  0x0000559ab67f1ac2 in srv_error_monitor_thread () at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:1854
            #7  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #8  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 9 (Thread 0x7f6c157fa700 (LWP 4540)):
            #0  futex_wait_cancelable (private=0, expected=0, futex_word=0x7f6c157f9d48) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
            #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x7f6c157f9d88, cond=0x7f6c157f9d20) at pthread_cond_wait.c:502
            #2  __pthread_cond_wait (cond=0x7f6c157f9d20, mutex=0x7f6c157f9d88) at pthread_cond_wait.c:655
            #3  0x0000559ab6c1994a in safe_cond_wait (cond=0x7f6c157f9d20, mp=0x7f6c157f9d60, file=0x559ab6f0aac0 "/home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h", line=1185) at /home/timofey_turenko_mariadb_com/server/mysys/thr_mutex.c:492
            #4  0x0000559ab65c7634 in inline_mysql_cond_wait (that=0x7f6c157f9d20, mutex=0x7f6c157f9d60, src_file=0x559ab6f0c9c8 "/home/timofey_turenko_mariadb_com/server/storage/innobase/handler/ha_innodb.cc", src_line=311) at /home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h:1185
            #5  0x0000559ab65cc635 in thd_destructor_proxy () at /home/timofey_turenko_mariadb_com/server/storage/innobase/handler/ha_innodb.cc:311
            #6  0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab8a8d080) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869
            #7  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #8  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 8 (Thread 0x7f6c217fa700 (LWP 4533)):
            #0  futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab88dda98) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
            #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab88dda48, cond=0x559ab88dda70) at pthread_cond_wait.c:502
            #2  __pthread_cond_wait (cond=0x559ab88dda70, mutex=0x559ab88dda48) at pthread_cond_wait.c:655
            #3  0x0000559ab66db0e8 in os_event::wait (this=0x559ab88dda30) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:158
            #4  0x0000559ab66dabf4 in os_event::wait_low (this=0x559ab88dda30, reset_sig_count=113) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:325
            #5  0x0000559ab66daed7 in os_event_wait_low (event=0x559ab88dda30, reset_sig_count=113) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:502
            #6  0x0000559ab67ef5a2 in srv_resume_thread (slot=0x559ab75e1d08 <srv_sys+392>, sig_count=113, wait=true, timeout_usec=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:910
            #7  0x0000559ab67f3d28 in srv_purge_coordinator_suspend (slot=0x559ab75e1d08 <srv_sys+392>, rseg_history_len=13) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:2655
            #8  0x0000559ab67f4002 in srv_purge_coordinator_thread (arg=0x0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:2732
            #9  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #10 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 7 (Thread 0x7f6c6c120700 (LWP 4342)):
            #0  futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c6c11fe10, expected=0, futex_word=0x559ab80475c8 <COND_timer+40>) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
            #1  __pthread_cond_wait_common (abstime=0x7f6c6c11fe10, mutex=0x559ab8047508 <LOCK_timer+40>, cond=0x559ab80475a0 <COND_timer>) at pthread_cond_wait.c:539
            #2  __pthread_cond_timedwait (cond=0x559ab80475a0 <COND_timer>, mutex=0x559ab8047508 <LOCK_timer+40>, abstime=0x7f6c6c11fe10) at pthread_cond_wait.c:667
            #3  0x0000559ab6c19d0a in safe_cond_timedwait (cond=0x559ab80475a0 <COND_timer>, mp=0x559ab80474e0 <LOCK_timer>, abstime=0x7f6c6c11fe10, file=0x559ab70d9700 "/home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h", line=1211) at /home/timofey_turenko_mariadb_com/server/mysys/thr_mutex.c:546
            #4  0x0000559ab6c1ad5a in inline_mysql_cond_timedwait (that=0x559ab80475a0 <COND_timer>, mutex=0x559ab80474e0 <LOCK_timer>, abstime=0x7f6c6c11fe10, src_file=0x559ab70d9750 "/home/timofey_turenko_mariadb_com/server/mysys/thr_timer.c", src_line=292) at /home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h:1211
            #5  0x0000559ab6c1b91f in timer_handler (arg=0x0) at /home/timofey_turenko_mariadb_com/server/mysys/thr_timer.c:292
            #6  0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab873dac0) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869
            #7  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #8  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 6 (Thread 0x7f6c68d93700 (LWP 4345)):
            #0  futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab8750b5c) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
            #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab8750b08, cond=0x559ab8750b30) at pthread_cond_wait.c:502
            #2  __pthread_cond_wait (cond=cond@entry=0x559ab8750b30, mutex=mutex@entry=0x559ab8750b08) at pthread_cond_wait.c:655
            #3  0x00007f6c6b835385 in gu::Lock::wait (this=<synthetic pointer>, cond=...) at galerautils/src/gu_mutex.hpp:85
            #4  RecvBuf::front (timeout=..., this=0x559ab8750b08) at gcs/src/gcs_gcomm.cpp:114
            #5  gcomm_recv (backend=<optimized out>, msg=0x559ab878aa80, timeout=9223372035999999999) at gcs/src/gcs_gcomm.cpp:608
            #6  0x00007f6c6b826f98 in core_msg_recv (timeout=9223372035999999999, recv_msg=0x559ab878aa80, backend=0x559ab878abe0) at gcs/src/gcs_core.cpp:1201
            #7  gcs_core_recv (conn=0x559ab878aa20, recv_act=recv_act@entry=0x7f6c68d92d60, timeout=9223372035999999999) at gcs/src/gcs_core.cpp:1201
            #8  0x00007f6c6b831d72 in gcs_recv_thread (arg=0x559ab878a7a0) at gcs/src/gcs.cpp:1413
            #9  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #10 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 5 (Thread 0x7f6c6b598700 (LWP 4343)):
            #0  futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab8781ab4) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
            #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab8781a60, cond=0x559ab8781a88) at pthread_cond_wait.c:502
            #2  __pthread_cond_wait (cond=cond@entry=0x559ab8781a88, mutex=mutex@entry=0x559ab8781a60) at pthread_cond_wait.c:655
            #3  0x00007f6c6b861ff0 in gu::Lock::wait (this=<synthetic pointer>, cond=...) at galerautils/src/gu_mutex.hpp:85
            #4  galera::ServiceThd::thd_func (arg=0x559ab8781a48) at galera/src/galera_service_thd.cpp:30
            #5  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #6  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 4 (Thread 0x7f6c68547700 (LWP 4347)):
            #0  futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab87b0f40) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
            #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab87b0ef0, cond=0x559ab87b0f18) at pthread_cond_wait.c:502
            #2  __pthread_cond_wait (cond=cond@entry=0x559ab87b0f18, mutex=mutex@entry=0x559ab87b0ef0) at pthread_cond_wait.c:655
            #3  0x00007f6c6b7032ce in fifo_lock_get (q=0x559ab87b0e70) at galerautils/src/gu_fifo.c:262
            #4  gu_fifo_get_head (q=0x559ab87b0e70, err=err@entry=0x7f6c685466b4) at galerautils/src/gu_fifo.c:330
            #5  0x00007f6c6b82b403 in gcs_recv (conn=0x559ab878a7a0, action=action@entry=0x7f6c68546720) at gcs/src/gcs.cpp:2048
            #6  0x00007f6c6b86a696 in galera::Gcs::recv (act=..., this=<optimized out>) at galera/src/galera_gcs.hpp:120
            #7  galera::GcsActionSource::process (this=0x559ab87c30f0, recv_ctx=0x7f6c68546d40, exit_loop=@0x7f6c6854692f: false) at galera/src/gcs_action_source.cpp:162
            #8  0x00007f6c6b892250 in galera::ReplicatorSMM::async_recv (this=0x559ab87812f0, recv_ctx=0x7f6c68546d40) at galera/src/replicator_smm.cpp:390
            #9  0x00007f6c6b8a95fb in galera_recv (gh=<optimized out>, recv_ctx=<optimized out>) at galera/src/wsrep_provider.cpp:236
            #10 0x0000559ab6cabcb8 in wsrep::wsrep_provider_v26::run_applier (this=0x559ab8620370, applier_ctx=0x7f6c68546d40) at /home/timofey_turenko_mariadb_com/server/wsrep-lib/src/wsrep_provider_v26.cpp:740
            #11 0x0000559ab62ab124 in wsrep_replication_process (thd=0x7f6c50001fa0, arg=0x559ab87cb9e0) at /home/timofey_turenko_mariadb_com/server/sql/wsrep_thd.cc:58
            #12 0x0000559ab629d994 in start_wsrep_THD (arg=0x559ab87cb9e0) at /home/timofey_turenko_mariadb_com/server/sql/wsrep_mysqld.cc:2847
            #13 0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab87a3180) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869
            #14 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #15 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 3 (Thread 0x7f6c69594700 (LWP 4344)):
            #0  0x00007f6c707857ef in epoll_wait (epfd=9, events=events@entry=0x7f6c69593430, maxevents=maxevents@entry=128, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30
            #1  0x00007f6c6b7f737f in asio::detail::epoll_reactor::run (this=0x559ab87c4650, block=block@entry=true, ops=...) at asio/asio/detail/impl/epoll_reactor.ipp:391
            #2  0x00007f6c6b811629 in asio::detail::task_io_service::do_run_one (ec=..., this_thread=..., lock=..., this=0x559ab87c8c60) at asio/asio/detail/impl/task_io_service.ipp:355
            #3  asio::detail::task_io_service::run (ec=..., this=0x559ab87c8c60) at asio/asio/detail/impl/task_io_service.ipp:148
            #4  asio::io_service::run (this=<optimized out>) at asio/asio/impl/io_service.ipp:58
            #5  gcomm::AsioProtonet::event_loop (this=<optimized out>, period=...) at gcomm/src/asio_protonet.cpp:116
            #6  0x00007f6c6b838194 in GCommConn::run (this=0x559ab8750910) at galerautils/src/gu_datetime.hpp:61
            #7  0x00007f6c6b83dc19 in GCommConn::run_fn (arg=<optimized out>) at gcs/src/gcs_gcomm.cpp:174
            #8  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #9  0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 2 (Thread 0x7f6c68592700 (LWP 4346)):
            #0  futex_wait_cancelable (private=0, expected=0, futex_word=0x7f6c44007850) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
            #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x7f6c440077a0, cond=0x7f6c44007828) at pthread_cond_wait.c:502
            #2  __pthread_cond_wait (cond=0x7f6c44007828, mutex=0x7f6c440077a0) at pthread_cond_wait.c:655
            #3  0x0000559ab6c1994a in safe_cond_wait (cond=0x7f6c44007828, mp=0x7f6c44007778, file=0x559ab6d78080 "/home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h", line=1185) at /home/timofey_turenko_mariadb_com/server/mysys/thr_mutex.c:492
            #4  0x0000559ab62aace1 in inline_mysql_cond_wait (that=0x7f6c44007828, mutex=0x7f6c44007778, src_file=0x559ab6d78390 "/home/timofey_turenko_mariadb_com/server/sql/wsrep_thd.h", src_line=69) at /home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h:1185
            #5  0x0000559ab62ad4f1 in Wsrep_thd_queue::pop_front (this=0x7f6c44007720) at /home/timofey_turenko_mariadb_com/server/sql/wsrep_thd.h:69
            #6  0x0000559ab62abf24 in wsrep_rollback_process (rollbacker=0x7f6c44000d50, arg=0x559ab87ca450) at /home/timofey_turenko_mariadb_com/server/sql/wsrep_thd.cc:241
            #7  0x0000559ab629d994 in start_wsrep_THD (arg=0x559ab87ca450) at /home/timofey_turenko_mariadb_com/server/sql/wsrep_mysqld.cc:2847
            #8  0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab87a2db0) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869
            #9  0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486
            #10 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
             
            Thread 1 (Thread 0x7f6c705127c0 (LWP 4340)):
            #0  __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:56
            #1  0x0000559ab6c141f1 in my_write_core (sig=6) at /home/timofey_turenko_mariadb_com/server/mysys/stacktrace.c:386
            #2  0x0000559ab638ab8e in handle_fatal_signal (sig=6) at /home/timofey_turenko_mariadb_com/server/sql/signal_handler.cc:343
            #3  <signal handler called>
            #4  0x00007f6c7077a819 in __GI___poll (fds=0x7ffd054ef590, nfds=2, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
            #5  0x0000559ab5efb1f5 in handle_connections_sockets () at /home/timofey_turenko_mariadb_com/server/sql/mysqld.cc:6481
            #6  0x0000559ab5efa45c in mysqld_main (argc=163, argv=0x559ab861d000) at /home/timofey_turenko_mariadb_com/server/sql/mysqld.cc:5917
            #7  0x0000559ab5eee405 in main (argc=23, argv=0x7ffd054ef898) at /home/timofey_turenko_mariadb_com/server/sql/main.cc:25
             
             - deleting it, already saved 0
             - found 'core' (0/0)
             
            Trying 'dbx' to get a backtrace
             
            Trying 'gdb' to get a backtrace from coredump /var/tmp/mtr/log/galera.MDEV-16509-innodb/mysqld.1/data/core
            Core generated by '/home/timofey_turenko_mariadb_com/MariaDBEnterprise/bin/mysqld'
            Output from gdb follows. The first stack trace is from the failing thread.
            The following stack traces are from all threads (so the failing one is
            duplicated).
            

            The full stack.

            stepan.patryshev Stepan Patryshev (Inactive) added a comment - On the new BB 10.5 CS (10.4-Debug-manual-2020-12-10-21-51-09/debian/buster): 10.4.18-MariaDB-debug e007fcf59dd02407277b130dbd3984a7b5352c5e debian buster galera.MDEV-16509 'innodb' [ fail ] timeout after 1200 seconds Test ended at 2020-12-10 23:56:28   Test case timeout after 1200 seconds   == /var/tmp/mtr/log/MDEV-16509.log == SET DEBUG_SYNC = "after_group_after_commit SIGNAL agac_reached_2 WAIT_FOR agac_continue_2"; INSERT INTO t1 VALUES (3);; connection ctrl; SET DEBUG_SYNC = "now SIGNAL bcol_continue_1"; SET DEBUG_SYNC = "now WAIT_FOR acol_reached_1"; Warnings: Warning 1639 debug sync point wait timed out SET DEBUG_SYNC = "now WAIT_FOR bcol_reached_2"; Warnings: Warning 1639 debug sync point wait timed out wsrep_last_seen_gtid_match 0 SET DEBUG_SYNC = "now SIGNAL bcol_continue_2"; SET DEBUG_SYNC = "now WAIT_FOR acol_reached_2"; Warnings: Warning 1639 debug sync point wait timed out wsrep_last_seen_gtid_match 0 SET DEBUG_SYNC = "now SIGNAL acol_continue_1"; SET DEBUG_SYNC = "now WAIT_FOR agac_reached_1";   == /var/tmp/mtr/tmp/analyze-timeout-mysqld.1.err == mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/var/tmp/mtr/tmp/mysqld.1.sock' (111)   == /var/tmp/mtr/tmp/analyze-timeout-mysqld.2.err == mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/var/tmp/mtr/tmp/mysqld.2.sock' (111)     - found 'core' (0/0)   Trying 'dbx' to get a backtrace   Trying 'gdb' to get a backtrace from coredump /var/tmp/mtr/log/galera.MDEV-16509-innodb/mysqld.2/data/core Core generated by '/home/timofey_turenko_mariadb_com/MariaDBEnterprise/bin/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- [New LWP 4340] [New LWP 4346] [New LWP 4344] [New LWP 4347] [New LWP 4343] [New LWP 4345] [New LWP 4342] [New LWP 4533] [New LWP 4540] [New LWP 4528] [New LWP 4532] [New LWP 4536] [New LWP 4537] [New LWP 4539] [New LWP 4534] [New LWP 4529] [New LWP 4521] [New LWP 4517] [New LWP 4541] [New LWP 4538] [New LWP 4530] [New LWP 4522] [New LWP 4523] [New LWP 4519] [New LWP 4545] [New LWP 4535] [New LWP 4531] [New LWP 4520] [New LWP 4542] [New LWP 4527] [New LWP 4518] [New LWP 4524] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `/home/timofey_turenko_mariadb_com/MariaDBEnterprise/bin/mysqld --defaults-group'. Program terminated with signal SIGABRT, Aborted. #0 __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:56 56 ../sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory. [Current thread is 1 (Thread 0x7f6c705127c0 (LWP 4340))] #0 __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:56 #1 0x0000559ab6c141f1 in my_write_core (sig=6) at /home/timofey_turenko_mariadb_com/server/mysys/stacktrace.c:386 #2 0x0000559ab638ab8e in handle_fatal_signal (sig=6) at /home/timofey_turenko_mariadb_com/server/sql/signal_handler.cc:343 #3 <signal handler called> #4 0x00007f6c7077a819 in __GI___poll (fds=0x7ffd054ef590, nfds=2, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29 #5 0x0000559ab5efb1f5 in handle_connections_sockets () at /home/timofey_turenko_mariadb_com/server/sql/mysqld.cc:6481 #6 0x0000559ab5efa45c in mysqld_main (argc=163, argv=0x559ab861d000) at /home/timofey_turenko_mariadb_com/server/sql/mysqld.cc:5917 #7 0x0000559ab5eee405 in main (argc=23, argv=0x7ffd054ef898) at /home/timofey_turenko_mariadb_com/server/sql/main.cc:25   Thread 32 (Thread 0x7f6c317fa700 (LWP 4524)): #0 futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c317f9b80, expected=0, futex_word=0x559ab88dde1c) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f6c317f9b80, mutex=0x559ab88dddc8, cond=0x559ab88dddf0) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x559ab88dddf0, mutex=0x559ab88dddc8, abstime=0x7f6c317f9b80) at pthread_cond_wait.c:667 #3 0x0000559ab66daa5a in os_event::timed_wait (this=0x559ab88dddb0, abstime=0x7f6c317f9b80) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:275 #4 0x0000559ab66dad19 in os_event::wait_time_low (this=0x559ab88dddb0, time_in_usec=1000000, reset_sig_count=1695) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:385 #5 0x0000559ab66daeb2 in os_event_wait_time_low (event=0x559ab88dddb0, time_in_usec=1000000, reset_sig_count=1695) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:485 #6 0x0000559ab68ff1b7 in pc_sleep_if_needed (next_loop_time=2321467, sig_count=1695, cur_time=2320467) at /home/timofey_turenko_mariadb_com/server/storage/innobase/buf/buf0flu.cc:2627 #7 0x0000559ab690039c in buf_flush_page_cleaner_coordinator () at /home/timofey_turenko_mariadb_com/server/storage/innobase/buf/buf0flu.cc:3086 #8 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 31 (Thread 0x7f6c58954700 (LWP 4518)): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f6c7126e27a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #2 0x0000559ab66cac8b in LinuxAIOHandler::collect (this=0x7f6c58953b90) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1819 #3 0x0000559ab66cb39a in LinuxAIOHandler::poll (this=0x7f6c58953b90, m1=0x7f6c58953c30, m2=0x7f6c58953c38, request=0x7f6c58953c60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1980 #4 0x0000559ab66cb50d in os_aio_linux_handler (global_segment=0, m1=0x7f6c58953c30, m2=0x7f6c58953c38, request=0x7f6c58953c60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:2034 #5 0x0000559ab66d0818 in os_aio_handler (segment=0, m1=0x7f6c58953c30, m2=0x7f6c58953c38, request=0x7f6c58953c60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:5607 #6 0x0000559ab6980a97 in fil_aio_wait (segment=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/fil/fil0fil.cc:4316 #7 0x0000559ab67f5b91 in io_handler_thread (arg=0x559ab78242e0 <n>) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0start.cc:324 #8 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 30 (Thread 0x7f6c23fff700 (LWP 4527)): #0 futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c23ffedf0, expected=0, futex_word=0x559ab8aaf098) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f6c23ffedf0, mutex=0x559ab8aaf048, cond=0x559ab8aaf070) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x559ab8aaf070, mutex=0x559ab8aaf048, abstime=0x7f6c23ffedf0) at pthread_cond_wait.c:667 #3 0x0000559ab66daa5a in os_event::timed_wait (this=0x559ab8aaf030, abstime=0x7f6c23ffedf0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:275 #4 0x0000559ab66dad19 in os_event::wait_time_low (this=0x559ab8aaf030, time_in_usec=1000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:385 #5 0x0000559ab66daeb2 in os_event_wait_time_low (event=0x559ab8aaf030, time_in_usec=1000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:485 #6 0x0000559ab669c8d3 in lock_wait_timeout_thread () at /home/timofey_turenko_mariadb_com/server/storage/innobase/lock/lock0wait.cc:522 #7 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 29 (Thread 0x7f6c58b09700 (LWP 4542)): #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab77a548c <COND_slave_background+44>) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab77a8708 <LOCK_slave_background+40>, cond=0x559ab77a5460 <COND_slave_background>) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x559ab77a5460 <COND_slave_background>, mutex=0x559ab77a8708 <LOCK_slave_background+40>) at pthread_cond_wait.c:655 #3 0x0000559ab6c1994a in safe_cond_wait (cond=0x559ab77a5460 <COND_slave_background>, mp=0x559ab77a86e0 <LOCK_slave_background>, file=0x559ab6cc55a8 "/home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h", line=1174) at /home/timofey_turenko_mariadb_com/server/mysys/thr_mutex.c:492 #4 0x0000559ab5f209d1 in inline_mysql_cond_wait (that=0x559ab77a5460 <COND_slave_background>, mutex=0x559ab77a86e0 <LOCK_slave_background>, src_file=0x559ab6cc6240 "/home/timofey_turenko_mariadb_com/server/sql/slave.cc", src_line=522) at /home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h:1174 #5 0x0000559ab5f2229f in handle_slave_background (arg=0x0) at /home/timofey_turenko_mariadb_com/server/sql/slave.cc:522 #6 0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab8c6be70) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869 #7 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 28 (Thread 0x7f6c337fe700 (LWP 4520)): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f6c7126e27a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #2 0x0000559ab66cac8b in LinuxAIOHandler::collect (this=0x7f6c337fdb90) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1819 #3 0x0000559ab66cb39a in LinuxAIOHandler::poll (this=0x7f6c337fdb90, m1=0x7f6c337fdc30, m2=0x7f6c337fdc38, request=0x7f6c337fdc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1980 #4 0x0000559ab66cb50d in os_aio_linux_handler (global_segment=2, m1=0x7f6c337fdc30, m2=0x7f6c337fdc38, request=0x7f6c337fdc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:2034 #5 0x0000559ab66d0818 in os_aio_handler (segment=2, m1=0x7f6c337fdc30, m2=0x7f6c337fdc38, request=0x7f6c337fdc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:5607 #6 0x0000559ab6980a97 in fil_aio_wait (segment=2) at /home/timofey_turenko_mariadb_com/server/storage/innobase/fil/fil0fil.cc:4316 #7 0x0000559ab67f5b91 in io_handler_thread (arg=0x559ab78242f0 <n+16>) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0start.cc:324 #8 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 27 (Thread 0x7f6c227fc700 (LWP 4531)): #0 futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c227fbbf0, expected=0, futex_word=0x559ab8a75428) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f6c227fbbf0, mutex=0x559ab8a753d8, cond=0x559ab8a75400) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x559ab8a75400, mutex=0x559ab8a753d8, abstime=0x7f6c227fbbf0) at pthread_cond_wait.c:667 #3 0x0000559ab66daa5a in os_event::timed_wait (this=0x559ab8a753c0, abstime=0x7f6c227fbbf0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:275 #4 0x0000559ab66dad19 in os_event::wait_time_low (this=0x559ab8a753c0, time_in_usec=5000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:385 #5 0x0000559ab66daeb2 in os_event_wait_time_low (event=0x559ab8a753c0, time_in_usec=5000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:485 #6 0x0000559ab685b576 in ib_wqueue_timedwait (wq=0x559ab8a75270, wait_in_usecs=5000000) at /home/timofey_turenko_mariadb_com/server/storage/innobase/ut/ut0wqueue.cc:154 #7 0x0000559ab69cb934 in fts_optimize_thread (arg=0x559ab8a75270) at /home/timofey_turenko_mariadb_com/server/storage/innobase/fts/fts0opt.cc:2830 #8 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 26 (Thread 0x7f6c17fff700 (LWP 4535)): #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab88ddb98) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab88ddb48, cond=0x559ab88ddb70) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x559ab88ddb70, mutex=0x559ab88ddb48) at pthread_cond_wait.c:655 #3 0x0000559ab66db0e8 in os_event::wait (this=0x559ab88ddb30) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:158 #4 0x0000559ab66dabf4 in os_event::wait_low (this=0x559ab88ddb30, reset_sig_count=325) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:325 #5 0x0000559ab66daed7 in os_event_wait_low (event=0x559ab88ddb30, reset_sig_count=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:502 #6 0x0000559ab67ef5a2 in srv_resume_thread (slot=0x559ab75e1d78 <srv_sys+504>, sig_count=0, wait=true, timeout_usec=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:910 #7 0x0000559ab67f3869 in srv_worker_thread (arg=0x0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:2517 #8 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 25 (Thread 0x7f6c58abe700 (LWP 4545)): #0 futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c58abdd00, expected=0, futex_word=0x559ab77a544c <COND_thread_cache+44>) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f6c58abdd00, mutex=0x559ab77a7e08 <LOCK_thread_cache+40>, cond=0x559ab77a5420 <COND_thread_cache>) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x559ab77a5420 <COND_thread_cache>, mutex=0x559ab77a7e08 <LOCK_thread_cache+40>, abstime=0x7f6c58abdd00) at pthread_cond_wait.c:667 #3 0x0000559ab6c19d0a in safe_cond_timedwait (cond=0x559ab77a5420 <COND_thread_cache>, mp=0x559ab77a7de0 <LOCK_thread_cache>, abstime=0x7f6c58abdd00, file=0x559ab6cb5028 "/home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h", line=1211) at /home/timofey_turenko_mariadb_com/server/mysys/thr_mutex.c:546 #4 0x0000559ab5eeed78 in inline_mysql_cond_timedwait (that=0x559ab77a5420 <COND_thread_cache>, mutex=0x559ab77a7de0 <LOCK_thread_cache>, abstime=0x7f6c58abdd00, src_file=0x559ab6cb7178 "/home/timofey_turenko_mariadb_com/server/sql/mysqld.cc", src_line=2695) at /home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h:1211 #5 0x0000559ab5ef3c41 in cache_thread (thd=0x7f6c3400b6a0) at /home/timofey_turenko_mariadb_com/server/sql/mysqld.cc:2694 #6 0x0000559ab5ef3eb1 in one_thread_per_connection_end (thd=0x7f6c3400b6a0, put_in_cache=true) at /home/timofey_turenko_mariadb_com/server/sql/mysqld.cc:2780 #7 0x0000559ab61b68d8 in do_handle_one_connection (connect=0x559ab8c22600) at /home/timofey_turenko_mariadb_com/server/sql/sql_connect.cc:1423 #8 0x0000559ab61b65b8 in handle_one_connection (arg=0x559ab8c22600) at /home/timofey_turenko_mariadb_com/server/sql/sql_connect.cc:1316 #9 0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab8c654a0) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869 #10 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #11 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 24 (Thread 0x7f6c33fff700 (LWP 4519)): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f6c7126e27a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #2 0x0000559ab66cac8b in LinuxAIOHandler::collect (this=0x7f6c33ffeb90) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1819 #3 0x0000559ab66cb39a in LinuxAIOHandler::poll (this=0x7f6c33ffeb90, m1=0x7f6c33ffec30, m2=0x7f6c33ffec38, request=0x7f6c33ffec60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1980 #4 0x0000559ab66cb50d in os_aio_linux_handler (global_segment=1, m1=0x7f6c33ffec30, m2=0x7f6c33ffec38, request=0x7f6c33ffec60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:2034 #5 0x0000559ab66d0818 in os_aio_handler (segment=1, m1=0x7f6c33ffec30, m2=0x7f6c33ffec38, request=0x7f6c33ffec60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:5607 #6 0x0000559ab6980a97 in fil_aio_wait (segment=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/fil/fil0fil.cc:4316 #7 0x0000559ab67f5b91 in io_handler_thread (arg=0x559ab78242e8 <n+8>) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0start.cc:324 #8 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 23 (Thread 0x7f6c31ffb700 (LWP 4523)): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f6c7126e27a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #2 0x0000559ab66cac8b in LinuxAIOHandler::collect (this=0x7f6c31ffab90) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1819 #3 0x0000559ab66cb39a in LinuxAIOHandler::poll (this=0x7f6c31ffab90, m1=0x7f6c31ffac30, m2=0x7f6c31ffac38, request=0x7f6c31ffac60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1980 #4 0x0000559ab66cb50d in os_aio_linux_handler (global_segment=5, m1=0x7f6c31ffac30, m2=0x7f6c31ffac38, request=0x7f6c31ffac60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:2034 #5 0x0000559ab66d0818 in os_aio_handler (segment=5, m1=0x7f6c31ffac30, m2=0x7f6c31ffac38, request=0x7f6c31ffac60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:5607 #6 0x0000559ab6980a97 in fil_aio_wait (segment=5) at /home/timofey_turenko_mariadb_com/server/storage/innobase/fil/fil0fil.cc:4316 #7 0x0000559ab67f5b91 in io_handler_thread (arg=0x559ab7824308 <n+40>) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0start.cc:324 #8 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 22 (Thread 0x7f6c327fc700 (LWP 4522)): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f6c7126e27a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #2 0x0000559ab66cac8b in LinuxAIOHandler::collect (this=0x7f6c327fbb90) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1819 #3 0x0000559ab66cb39a in LinuxAIOHandler::poll (this=0x7f6c327fbb90, m1=0x7f6c327fbc30, m2=0x7f6c327fbc38, request=0x7f6c327fbc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1980 #4 0x0000559ab66cb50d in os_aio_linux_handler (global_segment=4, m1=0x7f6c327fbc30, m2=0x7f6c327fbc38, request=0x7f6c327fbc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:2034 #5 0x0000559ab66d0818 in os_aio_handler (segment=4, m1=0x7f6c327fbc30, m2=0x7f6c327fbc38, request=0x7f6c327fbc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:5607 #6 0x0000559ab6980a97 in fil_aio_wait (segment=4) at /home/timofey_turenko_mariadb_com/server/storage/innobase/fil/fil0fil.cc:4316 #7 0x0000559ab67f5b91 in io_handler_thread (arg=0x559ab7824300 <n+32>) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0start.cc:324 #8 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 21 (Thread 0x7f6c22ffd700 (LWP 4530)): #0 futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c22ffce10, expected=0, futex_word=0x559ab8ae0828) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f6c22ffce10, mutex=0x559ab8ae07d8, cond=0x559ab8ae0800) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x559ab8ae0800, mutex=0x559ab8ae07d8, abstime=0x7f6c22ffce10) at pthread_cond_wait.c:667 #3 0x0000559ab66daa5a in os_event::timed_wait (this=0x559ab8ae07c0, abstime=0x7f6c22ffce10) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:275 #4 0x0000559ab66dad19 in os_event::wait_time_low (this=0x559ab8ae07c0, time_in_usec=10000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:385 #5 0x0000559ab66daeb2 in os_event_wait_time_low (event=0x559ab8ae07c0, time_in_usec=10000000, reset_sig_count=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:485 #6 0x0000559ab696945e in dict_stats_thread () at /home/timofey_turenko_mariadb_com/server/storage/innobase/dict/dict0stats_bg.cc:475 #7 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 20 (Thread 0x7f6c167fc700 (LWP 4538)): #0 0x00007f6c714aabf0 in __GI___nanosleep (requested_time=0x7f6c167fb790, remaining=0x0) at ../sysdeps/unix/sysv/linux/nanosleep.c:28 #1 0x0000559ab66db459 in os_thread_sleep (tm=1000000) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0thread.cc:231 #2 0x0000559ab68c6f8c in btr_defragment_thread () at /home/timofey_turenko_mariadb_com/server/storage/innobase/btr/btr0defragment.cc:700 #3 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #4 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 19 (Thread 0x7f6c58b54700 (LWP 4541)): #0 0x00007f6c706c44cc in __GI___sigtimedwait (set=0x7f6c58b53d90, info=0x7f6c58b53cb0, timeout=0x0) at ../sysdeps/unix/sysv/linux/sigtimedwait.c:29 #1 0x0000559ab5eee466 in my_sigwait (set=0x7f6c58b53d90, sig=0x7f6c58b53d54, code=0x7f6c58b53d58) at /home/timofey_turenko_mariadb_com/server/include/my_pthread.h:196 #2 0x0000559ab5ef4b63 in signal_hand (arg=0x0) at /home/timofey_turenko_mariadb_com/server/sql/mysqld.cc:3251 #3 0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab8b1c450) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869 #4 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #5 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 18 (Thread 0x7f6c5a056700 (LWP 4517)): #0 futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c5a055d60, expected=0, futex_word=0x559ab8034ea8 <COND_checkpoint+40>) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f6c5a055d60, mutex=0x559ab8034de8 <LOCK_checkpoint+40>, cond=0x559ab8034e80 <COND_checkpoint>) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x559ab8034e80 <COND_checkpoint>, mutex=0x559ab8034de8 <LOCK_checkpoint+40>, abstime=0x7f6c5a055d60) at pthread_cond_wait.c:667 #3 0x0000559ab6c19d0a in safe_cond_timedwait (cond=0x559ab8034e80 <COND_checkpoint>, mp=0x559ab8034dc0 <LOCK_checkpoint>, abstime=0x7f6c5a055d60, file=0x559ab708fd60 "/home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h", line=1211) at /home/timofey_turenko_mariadb_com/server/mysys/thr_mutex.c:546 #4 0x0000559ab6a6f5ac in inline_mysql_cond_timedwait (that=0x559ab8034e80 <COND_checkpoint>, mutex=0x559ab8034dc0 <LOCK_checkpoint>, abstime=0x7f6c5a055d60, src_file=0x559ab708fdb0 "/home/timofey_turenko_mariadb_com/server/storage/maria/ma_servicethread.c", src_line=116) at /home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h:1211 #5 0x0000559ab6a6faf1 in my_service_thread_sleep (control=0x559ab75e6ce0 <checkpoint_control>, sleep_time=30000000000) at /home/timofey_turenko_mariadb_com/server/storage/maria/ma_servicethread.c:115 #6 0x0000559ab6a63911 in ma_checkpoint_background (arg=0x1e) at /home/timofey_turenko_mariadb_com/server/storage/maria/ma_checkpoint.c:707 #7 0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab88964f0) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869 #8 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 17 (Thread 0x7f6c32ffd700 (LWP 4521)): #0 syscall () at ../sysdeps/unix/sysv/linux/x86_64/syscall.S:38 #1 0x00007f6c7126e27a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1 #2 0x0000559ab66cac8b in LinuxAIOHandler::collect (this=0x7f6c32ffcb90) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1819 #3 0x0000559ab66cb39a in LinuxAIOHandler::poll (this=0x7f6c32ffcb90, m1=0x7f6c32ffcc30, m2=0x7f6c32ffcc38, request=0x7f6c32ffcc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:1980 #4 0x0000559ab66cb50d in os_aio_linux_handler (global_segment=3, m1=0x7f6c32ffcc30, m2=0x7f6c32ffcc38, request=0x7f6c32ffcc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:2034 #5 0x0000559ab66d0818 in os_aio_handler (segment=3, m1=0x7f6c32ffcc30, m2=0x7f6c32ffcc38, request=0x7f6c32ffcc60) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0file.cc:5607 #6 0x0000559ab6980a97 in fil_aio_wait (segment=3) at /home/timofey_turenko_mariadb_com/server/storage/innobase/fil/fil0fil.cc:4316 #7 0x0000559ab67f5b91 in io_handler_thread (arg=0x559ab78242f8 <n+24>) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0start.cc:324 #8 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 16 (Thread 0x7f6c237fe700 (LWP 4529)): #0 futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c237fddd0, expected=0, futex_word=0x559ab88ddd18) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f6c237fddd0, mutex=0x559ab88ddcc8, cond=0x559ab88ddcf0) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x559ab88ddcf0, mutex=0x559ab88ddcc8, abstime=0x7f6c237fddd0) at pthread_cond_wait.c:667 #3 0x0000559ab66daa5a in os_event::timed_wait (this=0x559ab88ddcb0, abstime=0x7f6c237fddd0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:275 #4 0x0000559ab66dad19 in os_event::wait_time_low (this=0x559ab88ddcb0, time_in_usec=5000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:385 #5 0x0000559ab66daeb2 in os_event_wait_time_low (event=0x559ab88ddcb0, time_in_usec=5000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:485 #6 0x0000559ab67f1540 in srv_monitor_thread () at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:1690 #7 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 15 (Thread 0x7f6c20ff9700 (LWP 4534)): #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab88ddb1c) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab88ddac8, cond=0x559ab88ddaf0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x559ab88ddaf0, mutex=0x559ab88ddac8) at pthread_cond_wait.c:655 #3 0x0000559ab66db0e8 in os_event::wait (this=0x559ab88ddab0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:158 #4 0x0000559ab66dabf4 in os_event::wait_low (this=0x559ab88ddab0, reset_sig_count=388) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:325 #5 0x0000559ab66daed7 in os_event_wait_low (event=0x559ab88ddab0, reset_sig_count=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:502 #6 0x0000559ab67ef5a2 in srv_resume_thread (slot=0x559ab75e1d40 <srv_sys+448>, sig_count=0, wait=true, timeout_usec=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:910 #7 0x0000559ab67f3869 in srv_worker_thread (arg=0x0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:2517 #8 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 14 (Thread 0x7f6c15ffb700 (LWP 4539)): #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab88dde98) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab88dde48, cond=0x559ab88dde70) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x559ab88dde70, mutex=0x559ab88dde48) at pthread_cond_wait.c:655 #3 0x0000559ab66db0e8 in os_event::wait (this=0x559ab88dde30) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:158 #4 0x0000559ab66dabf4 in os_event::wait_low (this=0x559ab88dde30, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:325 #5 0x0000559ab66daed7 in os_event_wait_low (event=0x559ab88dde30, reset_sig_count=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:502 #6 0x0000559ab68d84dd in buf_resize_thread () at /home/timofey_turenko_mariadb_com/server/storage/innobase/buf/buf0buf.cc:3142 #7 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 13 (Thread 0x7f6c16ffd700 (LWP 4537)): #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab88ddd98) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab88ddd48, cond=0x559ab88ddd70) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x559ab88ddd70, mutex=0x559ab88ddd48) at pthread_cond_wait.c:655 #3 0x0000559ab66db0e8 in os_event::wait (this=0x559ab88ddd30) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:158 #4 0x0000559ab66dabf4 in os_event::wait_low (this=0x559ab88ddd30, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:325 #5 0x0000559ab66daed7 in os_event_wait_low (event=0x559ab88ddd30, reset_sig_count=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:502 #6 0x0000559ab68f30c4 in buf_dump_thread () at /home/timofey_turenko_mariadb_com/server/storage/innobase/buf/buf0dump.cc:832 #7 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 12 (Thread 0x7f6c177fe700 (LWP 4536)): #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab88ddc18) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab88ddbc8, cond=0x559ab88ddbf0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x559ab88ddbf0, mutex=0x559ab88ddbc8) at pthread_cond_wait.c:655 #3 0x0000559ab66db0e8 in os_event::wait (this=0x559ab88ddbb0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:158 #4 0x0000559ab66dabf4 in os_event::wait_low (this=0x559ab88ddbb0, reset_sig_count=313) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:325 #5 0x0000559ab66daed7 in os_event_wait_low (event=0x559ab88ddbb0, reset_sig_count=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:502 #6 0x0000559ab67ef5a2 in srv_resume_thread (slot=0x559ab75e1db0 <srv_sys+560>, sig_count=0, wait=true, timeout_usec=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:910 #7 0x0000559ab67f3869 in srv_worker_thread (arg=0x0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:2517 #8 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 11 (Thread 0x7f6c21ffb700 (LWP 4532)): #0 0x00007f6c714aabf0 in __GI___nanosleep (requested_time=0x7f6c21ffade0, remaining=0x0) at ../sysdeps/unix/sysv/linux/nanosleep.c:28 #1 0x0000559ab66db459 in os_thread_sleep (tm=1000000) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0thread.cc:231 #2 0x0000559ab67f2f47 in srv_master_sleep () at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:2341 #3 0x0000559ab67f30be in srv_master_thread (arg=0x0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:2381 #4 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #5 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 10 (Thread 0x7f6c30df4700 (LWP 4528)): #0 futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c30df3c30, expected=0, futex_word=0x559ab88ddc98) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f6c30df3c30, mutex=0x559ab88ddc48, cond=0x559ab88ddc70) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x559ab88ddc70, mutex=0x559ab88ddc48, abstime=0x7f6c30df3c30) at pthread_cond_wait.c:667 #3 0x0000559ab66daa5a in os_event::timed_wait (this=0x559ab88ddc30, abstime=0x7f6c30df3c30) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:275 #4 0x0000559ab66dad19 in os_event::wait_time_low (this=0x559ab88ddc30, time_in_usec=1000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:385 #5 0x0000559ab66daeb2 in os_event_wait_time_low (event=0x559ab88ddc30, time_in_usec=1000000, reset_sig_count=1) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:485 #6 0x0000559ab67f1ac2 in srv_error_monitor_thread () at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:1854 #7 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 9 (Thread 0x7f6c157fa700 (LWP 4540)): #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x7f6c157f9d48) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f6c157f9d88, cond=0x7f6c157f9d20) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x7f6c157f9d20, mutex=0x7f6c157f9d88) at pthread_cond_wait.c:655 #3 0x0000559ab6c1994a in safe_cond_wait (cond=0x7f6c157f9d20, mp=0x7f6c157f9d60, file=0x559ab6f0aac0 "/home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h", line=1185) at /home/timofey_turenko_mariadb_com/server/mysys/thr_mutex.c:492 #4 0x0000559ab65c7634 in inline_mysql_cond_wait (that=0x7f6c157f9d20, mutex=0x7f6c157f9d60, src_file=0x559ab6f0c9c8 "/home/timofey_turenko_mariadb_com/server/storage/innobase/handler/ha_innodb.cc", src_line=311) at /home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h:1185 #5 0x0000559ab65cc635 in thd_destructor_proxy () at /home/timofey_turenko_mariadb_com/server/storage/innobase/handler/ha_innodb.cc:311 #6 0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab8a8d080) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869 #7 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 8 (Thread 0x7f6c217fa700 (LWP 4533)): #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab88dda98) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab88dda48, cond=0x559ab88dda70) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x559ab88dda70, mutex=0x559ab88dda48) at pthread_cond_wait.c:655 #3 0x0000559ab66db0e8 in os_event::wait (this=0x559ab88dda30) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:158 #4 0x0000559ab66dabf4 in os_event::wait_low (this=0x559ab88dda30, reset_sig_count=113) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:325 #5 0x0000559ab66daed7 in os_event_wait_low (event=0x559ab88dda30, reset_sig_count=113) at /home/timofey_turenko_mariadb_com/server/storage/innobase/os/os0event.cc:502 #6 0x0000559ab67ef5a2 in srv_resume_thread (slot=0x559ab75e1d08 <srv_sys+392>, sig_count=113, wait=true, timeout_usec=0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:910 #7 0x0000559ab67f3d28 in srv_purge_coordinator_suspend (slot=0x559ab75e1d08 <srv_sys+392>, rseg_history_len=13) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:2655 #8 0x0000559ab67f4002 in srv_purge_coordinator_thread (arg=0x0) at /home/timofey_turenko_mariadb_com/server/storage/innobase/srv/srv0srv.cc:2732 #9 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #10 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 7 (Thread 0x7f6c6c120700 (LWP 4342)): #0 futex_abstimed_wait_cancelable (private=0, abstime=0x7f6c6c11fe10, expected=0, futex_word=0x559ab80475c8 <COND_timer+40>) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f6c6c11fe10, mutex=0x559ab8047508 <LOCK_timer+40>, cond=0x559ab80475a0 <COND_timer>) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x559ab80475a0 <COND_timer>, mutex=0x559ab8047508 <LOCK_timer+40>, abstime=0x7f6c6c11fe10) at pthread_cond_wait.c:667 #3 0x0000559ab6c19d0a in safe_cond_timedwait (cond=0x559ab80475a0 <COND_timer>, mp=0x559ab80474e0 <LOCK_timer>, abstime=0x7f6c6c11fe10, file=0x559ab70d9700 "/home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h", line=1211) at /home/timofey_turenko_mariadb_com/server/mysys/thr_mutex.c:546 #4 0x0000559ab6c1ad5a in inline_mysql_cond_timedwait (that=0x559ab80475a0 <COND_timer>, mutex=0x559ab80474e0 <LOCK_timer>, abstime=0x7f6c6c11fe10, src_file=0x559ab70d9750 "/home/timofey_turenko_mariadb_com/server/mysys/thr_timer.c", src_line=292) at /home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h:1211 #5 0x0000559ab6c1b91f in timer_handler (arg=0x0) at /home/timofey_turenko_mariadb_com/server/mysys/thr_timer.c:292 #6 0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab873dac0) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869 #7 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 6 (Thread 0x7f6c68d93700 (LWP 4345)): #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab8750b5c) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab8750b08, cond=0x559ab8750b30) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=cond@entry=0x559ab8750b30, mutex=mutex@entry=0x559ab8750b08) at pthread_cond_wait.c:655 #3 0x00007f6c6b835385 in gu::Lock::wait (this=<synthetic pointer>, cond=...) at galerautils/src/gu_mutex.hpp:85 #4 RecvBuf::front (timeout=..., this=0x559ab8750b08) at gcs/src/gcs_gcomm.cpp:114 #5 gcomm_recv (backend=<optimized out>, msg=0x559ab878aa80, timeout=9223372035999999999) at gcs/src/gcs_gcomm.cpp:608 #6 0x00007f6c6b826f98 in core_msg_recv (timeout=9223372035999999999, recv_msg=0x559ab878aa80, backend=0x559ab878abe0) at gcs/src/gcs_core.cpp:1201 #7 gcs_core_recv (conn=0x559ab878aa20, recv_act=recv_act@entry=0x7f6c68d92d60, timeout=9223372035999999999) at gcs/src/gcs_core.cpp:1201 #8 0x00007f6c6b831d72 in gcs_recv_thread (arg=0x559ab878a7a0) at gcs/src/gcs.cpp:1413 #9 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #10 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 5 (Thread 0x7f6c6b598700 (LWP 4343)): #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab8781ab4) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab8781a60, cond=0x559ab8781a88) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=cond@entry=0x559ab8781a88, mutex=mutex@entry=0x559ab8781a60) at pthread_cond_wait.c:655 #3 0x00007f6c6b861ff0 in gu::Lock::wait (this=<synthetic pointer>, cond=...) at galerautils/src/gu_mutex.hpp:85 #4 galera::ServiceThd::thd_func (arg=0x559ab8781a48) at galera/src/galera_service_thd.cpp:30 #5 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #6 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 4 (Thread 0x7f6c68547700 (LWP 4347)): #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x559ab87b0f40) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x559ab87b0ef0, cond=0x559ab87b0f18) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=cond@entry=0x559ab87b0f18, mutex=mutex@entry=0x559ab87b0ef0) at pthread_cond_wait.c:655 #3 0x00007f6c6b7032ce in fifo_lock_get (q=0x559ab87b0e70) at galerautils/src/gu_fifo.c:262 #4 gu_fifo_get_head (q=0x559ab87b0e70, err=err@entry=0x7f6c685466b4) at galerautils/src/gu_fifo.c:330 #5 0x00007f6c6b82b403 in gcs_recv (conn=0x559ab878a7a0, action=action@entry=0x7f6c68546720) at gcs/src/gcs.cpp:2048 #6 0x00007f6c6b86a696 in galera::Gcs::recv (act=..., this=<optimized out>) at galera/src/galera_gcs.hpp:120 #7 galera::GcsActionSource::process (this=0x559ab87c30f0, recv_ctx=0x7f6c68546d40, exit_loop=@0x7f6c6854692f: false) at galera/src/gcs_action_source.cpp:162 #8 0x00007f6c6b892250 in galera::ReplicatorSMM::async_recv (this=0x559ab87812f0, recv_ctx=0x7f6c68546d40) at galera/src/replicator_smm.cpp:390 #9 0x00007f6c6b8a95fb in galera_recv (gh=<optimized out>, recv_ctx=<optimized out>) at galera/src/wsrep_provider.cpp:236 #10 0x0000559ab6cabcb8 in wsrep::wsrep_provider_v26::run_applier (this=0x559ab8620370, applier_ctx=0x7f6c68546d40) at /home/timofey_turenko_mariadb_com/server/wsrep-lib/src/wsrep_provider_v26.cpp:740 #11 0x0000559ab62ab124 in wsrep_replication_process (thd=0x7f6c50001fa0, arg=0x559ab87cb9e0) at /home/timofey_turenko_mariadb_com/server/sql/wsrep_thd.cc:58 #12 0x0000559ab629d994 in start_wsrep_THD (arg=0x559ab87cb9e0) at /home/timofey_turenko_mariadb_com/server/sql/wsrep_mysqld.cc:2847 #13 0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab87a3180) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869 #14 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #15 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 3 (Thread 0x7f6c69594700 (LWP 4344)): #0 0x00007f6c707857ef in epoll_wait (epfd=9, events=events@entry=0x7f6c69593430, maxevents=maxevents@entry=128, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30 #1 0x00007f6c6b7f737f in asio::detail::epoll_reactor::run (this=0x559ab87c4650, block=block@entry=true, ops=...) at asio/asio/detail/impl/epoll_reactor.ipp:391 #2 0x00007f6c6b811629 in asio::detail::task_io_service::do_run_one (ec=..., this_thread=..., lock=..., this=0x559ab87c8c60) at asio/asio/detail/impl/task_io_service.ipp:355 #3 asio::detail::task_io_service::run (ec=..., this=0x559ab87c8c60) at asio/asio/detail/impl/task_io_service.ipp:148 #4 asio::io_service::run (this=<optimized out>) at asio/asio/impl/io_service.ipp:58 #5 gcomm::AsioProtonet::event_loop (this=<optimized out>, period=...) at gcomm/src/asio_protonet.cpp:116 #6 0x00007f6c6b838194 in GCommConn::run (this=0x559ab8750910) at galerautils/src/gu_datetime.hpp:61 #7 0x00007f6c6b83dc19 in GCommConn::run_fn (arg=<optimized out>) at gcs/src/gcs_gcomm.cpp:174 #8 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 2 (Thread 0x7f6c68592700 (LWP 4346)): #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x7f6c44007850) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f6c440077a0, cond=0x7f6c44007828) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x7f6c44007828, mutex=0x7f6c440077a0) at pthread_cond_wait.c:655 #3 0x0000559ab6c1994a in safe_cond_wait (cond=0x7f6c44007828, mp=0x7f6c44007778, file=0x559ab6d78080 "/home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h", line=1185) at /home/timofey_turenko_mariadb_com/server/mysys/thr_mutex.c:492 #4 0x0000559ab62aace1 in inline_mysql_cond_wait (that=0x7f6c44007828, mutex=0x7f6c44007778, src_file=0x559ab6d78390 "/home/timofey_turenko_mariadb_com/server/sql/wsrep_thd.h", src_line=69) at /home/timofey_turenko_mariadb_com/server/include/mysql/psi/mysql_thread.h:1185 #5 0x0000559ab62ad4f1 in Wsrep_thd_queue::pop_front (this=0x7f6c44007720) at /home/timofey_turenko_mariadb_com/server/sql/wsrep_thd.h:69 #6 0x0000559ab62abf24 in wsrep_rollback_process (rollbacker=0x7f6c44000d50, arg=0x559ab87ca450) at /home/timofey_turenko_mariadb_com/server/sql/wsrep_thd.cc:241 #7 0x0000559ab629d994 in start_wsrep_THD (arg=0x559ab87ca450) at /home/timofey_turenko_mariadb_com/server/sql/wsrep_mysqld.cc:2847 #8 0x0000559ab6ba1b40 in pfs_spawn_thread (arg=0x559ab87a2db0) at /home/timofey_turenko_mariadb_com/server/storage/perfschema/pfs.cc:1869 #9 0x00007f6c714a0fa3 in start_thread (arg=<optimized out>) at pthread_create.c:486 #10 0x00007f6c707854cf in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 1 (Thread 0x7f6c705127c0 (LWP 4340)): #0 __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:56 #1 0x0000559ab6c141f1 in my_write_core (sig=6) at /home/timofey_turenko_mariadb_com/server/mysys/stacktrace.c:386 #2 0x0000559ab638ab8e in handle_fatal_signal (sig=6) at /home/timofey_turenko_mariadb_com/server/sql/signal_handler.cc:343 #3 <signal handler called> #4 0x00007f6c7077a819 in __GI___poll (fds=0x7ffd054ef590, nfds=2, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29 #5 0x0000559ab5efb1f5 in handle_connections_sockets () at /home/timofey_turenko_mariadb_com/server/sql/mysqld.cc:6481 #6 0x0000559ab5efa45c in mysqld_main (argc=163, argv=0x559ab861d000) at /home/timofey_turenko_mariadb_com/server/sql/mysqld.cc:5917 #7 0x0000559ab5eee405 in main (argc=23, argv=0x7ffd054ef898) at /home/timofey_turenko_mariadb_com/server/sql/main.cc:25   - deleting it, already saved 0 - found 'core' (0/0)   Trying 'dbx' to get a backtrace   Trying 'gdb' to get a backtrace from coredump /var/tmp/mtr/log/galera.MDEV-16509-innodb/mysqld.1/data/core Core generated by '/home/timofey_turenko_mariadb_com/MariaDBEnterprise/bin/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). The full stack .

            People

              jplindst Jan Lindström (Inactive)
              stepan.patryshev Stepan Patryshev (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.