Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-19826

10.4 seems to crash with "pool-of-threads"

Details

    • Bug
    • Status: Closed (View Workflow)
    • Blocker
    • Resolution: Fixed
    • 10.4(EOL)
    • 10.4.8
    • Galera
    • None

    Description

      Might be just me, but in contrast to 10.3 I couldn't make 10.4 work with:

      thread-handling=pool-of-threads

      the database doesn't seem to start... Even a newly setup database with mysql_install_db. Only when I removed that line, the database was running. Sorry that I can't give any more info. I have only one production 10.4 server cluster available and I'm very happy, that it's finally running so I don't want to sacrifice it for experiments.

      Nevertheless, I'm just saying perhaps you might want to double-check this whether it really works. Otherwise feel free to close this as Works-For-Me. I'm on Ubuntu Disco with 10.4.6. Thank you

      Attachments

        Activity

          You of course shouldn't experiment with the production server, but can you provide the server error log from the previous crashed sessions?

          elenst Elena Stepanova added a comment - You of course shouldn't experiment with the production server, but can you provide the server error log from the previous crashed sessions?
          rgpublic Ranjan Ghosh added a comment -

          Okay, I've setup a dedicated cluster which isn't in production and which I can now crash at will I found the ingredients for this delicious bug dinner are:

          • wsrep=ON
          • thread-handling=pool-of-threads

          It's a 2 node cluster. The second node is not online. I start the first node with "galera_new_cluster". It's running. Great. Now, when I try to restore a backup with:

          cat blabla.sql | mysql

          I get this crash:

          Jun 25 16:38:48 ara1 mysqld[28693]: mysqld: /home/buildbot/buildbot/build/mariadb-10.4.6/wsrep-lib/src/client_state.cpp:308: int wsrep::client_state::enter_toi(const key_array&, const wsrep::const_buffer&, int): Assertion `state_ == s_exec' failed.
          Jun 25 16:38:48 ara1 mysqld[28693]: 190625 16:38:48 [ERROR] mysqld got signal 6 ;
          Jun 25 16:38:48 ara1 mysqld[28693]: This could be because you hit a bug. It is also possible that this binary
          Jun 25 16:38:48 ara1 mysqld[28693]: or one of the libraries it was linked against is corrupt, improperly built,
          Jun 25 16:38:48 ara1 mysqld[28693]: or misconfigured. This error can also be caused by malfunctioning hardware.
          Jun 25 16:38:48 ara1 mysqld[28693]: To report this bug, see https://mariadb.com/kb/en/reporting-bugs
          Jun 25 16:38:48 ara1 mysqld[28693]: We will try our best to scrape up some info that will hopefully help
          Jun 25 16:38:48 ara1 mysqld[28693]: diagnose the problem, but since we have already crashed,
          Jun 25 16:38:48 ara1 mysqld[28693]: something is definitely wrong and this may fail.
          Jun 25 16:38:48 ara1 mysqld[28693]: Server version: 10.4.6-MariaDB-1:10.4.6+maria~disco
          Jun 25 16:38:48 ara1 mysqld[28693]: key_buffer_size=134217728
          Jun 25 16:38:48 ara1 mysqld[28693]: read_buffer_size=131072
          Jun 25 16:38:48 ara1 mysqld[28693]: max_used_connections=1
          Jun 25 16:38:48 ara1 mysqld[28693]: max_threads=65537
          Jun 25 16:38:48 ara1 mysqld[28693]: thread_count=10
          Jun 25 16:38:48 ara1 mysqld[28693]: It is possible that mysqld could use up to
          Jun 25 16:38:48 ara1 mysqld[28693]: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 142743316 K  bytes of memory
          Jun 25 16:38:48 ara1 mysqld[28693]: Hope that's ok; if not, decrease some variables in the equation.
          Jun 25 16:38:48 ara1 mysqld[28693]: Thread pointer: 0x7fb3b8000ce8
          Jun 25 16:38:48 ara1 mysqld[28693]: Attempting backtrace. You can use the following information to find out
          Jun 25 16:38:48 ara1 mysqld[28693]: where mysqld died. If you see no messages after this, something went
          Jun 25 16:38:48 ara1 mysqld[28693]: terribly wrong...
          Jun 25 16:38:48 ara1 mysqld[28693]: stack_bottom = 0x7fb55c0e6d30 thread_stack 0x49000
          Jun 25 16:38:48 ara1 mysqld[28693]: /usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x556a6fa7f65e]
          Jun 25 16:38:48 ara1 mysqld[28693]: /usr/sbin/mysqld(handle_fatal_signal+0x54d)[0x556a6f57aa1d]
          Jun 25 16:38:48 ara1 mysqld[28693]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x13f40)[0x7fb7ff1c0f40]
          Jun 25 16:38:49 ara1 mysqld[28693]: /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xc7)[0x7fb7feccded7]
          Jun 25 16:38:49 ara1 mysqld[28693]: /lib/x86_64-linux-gnu/libc.so.6(abort+0x121)[0x7fb7fecaf535]
          Jun 25 16:38:49 ara1 mysqld[28693]: /lib/x86_64-linux-gnu/libc.so.6(+0x2540f)[0x7fb7fecaf40f]
          Jun 25 16:38:49 ara1 mysqld[28693]: /lib/x86_64-linux-gnu/libc.so.6(+0x35012)[0x7fb7fecbf012]
          Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(_ZN5wsrep12client_state9enter_toiERKSt6vectorINS_3keyESaIS2_EERKNS_12const_bufferEi+0x10b)[0x556a6fae0d3b]
          Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(+0x7ff20b)[0x556a6f4ee20b]
          Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(_ZN25Sql_cmd_create_table_like7executeEP3THD+0x870)[0x556a6f40b530]
          Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x3144)[0x556a6f374c24]
          Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_statebb+0x219)[0x556a6f37a739]
          Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(+0x68bf7a)[0x556a6f37af7a]
          Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0x20b5)[0x556a6f37d7f5]
          Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(_Z10do_commandP3THD+0x15e)[0x556a6f37e12e]
          Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(_Z11tp_callbackP13TP_connection+0x122)[0x556a6f54e292]
          Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(+0xa07520)[0x556a6f6f6520]
          Jun 25 16:38:49 ara1 mysqld[28693]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x9182)[0x7fb7ff1b6182]
          Jun 25 16:38:49 ara1 mysqld[28693]: /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7fb7feda7b1f]
          Jun 25 16:38:49 ara1 mysqld[28693]: Trying to get some variables.
          Jun 25 16:38:49 ara1 mysqld[28693]: Some pointers may be invalid and cause the dump to abort.
          Jun 25 16:38:49 ara1 mysqld[28693]: Query (0x7fb3b80141b0): CREATE TABLE `drupal_accesslog` (   `aid` int(11) NOT NULL AUTO_INCREMENT COMMENT 'Primary Key: Unique accesslog ID.',   `sid` varchar(128) NOT NULL DEFAULT '' COMMENT 'Browser session ID of user that visited page.',   `title` varchar(255) DEFAULT NULL COMMENT 'Title of page visited.',   `path` varchar(255) DEFAULT NULL COMMENT 'Internal path to page visited (relative to Drupal root.)',   `url` text DEFAULT NULL COMMENT 'Referrer URI.',   `hostname` varchar(128) DEFAULT NULL COMMENT 'Hostname of user that visited the page.',   `uid` int(10) unsigned DEFAULT 0 COMMENT 'User drupal_users.uid that visited the page.',   `timer` int(10) unsigned NOT NULL DEFAULT 0 COMMENT 'Time in milliseconds that the page took to load.',   `timestamp` int(10) unsigned NOT NULL DEFAULT 0 COMMENT 'Timestamp of when the page was visited.',   PRIMARY KEY (`aid`),   KEY `accesslog_timestamp` (`timestamp`),   KEY `uid` (`uid`) ) ENGINE=InnoDB AUTO_INCREMENT=13586521 DEFAULT CHARSET=utf8 COMMENT='Stores site access information for statistics.'
          Jun 25 16:38:49 ara1 mysqld[28693]: Connection ID (thread ID): 41
          Jun 25 16:38:49 ara1 mysqld[28693]: Status: NOT_KILLED
          Jun 25 16:38:49 ara1 mysqld[28693]: Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on
          Jun 25 16:38:49 ara1 mysqld[28693]: The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
          Jun 25 16:38:49 ara1 mysqld[28693]: information that should help you find out what is causing the crash.
          Jun 25 16:38:49 ara1 mysqld[28693]: Writing a core file...
          Jun 25 16:38:49 ara1 mysqld[28693]: Working directory at /var/lib/mysql
          Jun 25 16:38:49 ara1 mysqld[28693]: Resource Limits:
          Jun 25 16:38:49 ara1 mysqld[28693]: Limit                     Soft Limit           Hard Limit           Units
          Jun 25 16:38:49 ara1 mysqld[28693]: Max cpu time              unlimited            unlimited            seconds
          Jun 25 16:38:49 ara1 mysqld[28693]: Max file size             unlimited            unlimited            bytes
          Jun 25 16:38:49 ara1 mysqld[28693]: Max data size             unlimited            unlimited            bytes
          Jun 25 16:38:49 ara1 mysqld[28693]: Max stack size            8388608              unlimited            bytes
          Jun 25 16:38:49 ara1 mysqld[28693]: Max core file size        0                    unlimited            bytes
          Jun 25 16:38:49 ara1 mysqld[28693]: Max resident set          unlimited            unlimited            bytes
          Jun 25 16:38:49 ara1 mysqld[28693]: Max processes             256658               256658               processes
          Jun 25 16:38:49 ara1 mysqld[28693]: Max open files            16364                16364                files
          Jun 25 16:38:49 ara1 mysqld[28693]: Max locked memory         67108864             67108864             bytes
          Jun 25 16:38:49 ara1 mysqld[28693]: Max address space         unlimited            unlimited            bytes
          Jun 25 16:38:49 ara1 mysqld[28693]: Max file locks            unlimited            unlimited            locks
          Jun 25 16:38:49 ara1 mysqld[28693]: Max pending signals       256658               256658               signals
          Jun 25 16:38:49 ara1 mysqld[28693]: Max msgqueue size         819200               819200               bytes
          Jun 25 16:38:49 ara1 mysqld[28693]: Max nice priority         0                    0
          Jun 25 16:38:49 ara1 mysqld[28693]: Max realtime priority     0                    0
          Jun 25 16:38:49 ara1 mysqld[28693]: Max realtime timeout      unlimited            unlimited            us
          Jun 25 16:38:49 ara1 mysqld[28693]: Core pattern: core
          

          With the settings above this is 100% reproducible for me. Let me know if you need more info.

          rgpublic Ranjan Ghosh added a comment - Okay, I've setup a dedicated cluster which isn't in production and which I can now crash at will I found the ingredients for this delicious bug dinner are: wsrep=ON thread-handling=pool-of-threads It's a 2 node cluster. The second node is not online. I start the first node with "galera_new_cluster". It's running. Great. Now, when I try to restore a backup with: cat blabla.sql | mysql I get this crash: Jun 25 16:38:48 ara1 mysqld[28693]: mysqld: /home/buildbot/buildbot/build/mariadb-10.4.6/wsrep-lib/src/client_state.cpp:308: int wsrep::client_state::enter_toi(const key_array&, const wsrep::const_buffer&, int): Assertion `state_ == s_exec' failed. Jun 25 16:38:48 ara1 mysqld[28693]: 190625 16:38:48 [ERROR] mysqld got signal 6 ; Jun 25 16:38:48 ara1 mysqld[28693]: This could be because you hit a bug. It is also possible that this binary Jun 25 16:38:48 ara1 mysqld[28693]: or one of the libraries it was linked against is corrupt, improperly built, Jun 25 16:38:48 ara1 mysqld[28693]: or misconfigured. This error can also be caused by malfunctioning hardware. Jun 25 16:38:48 ara1 mysqld[28693]: To report this bug, see https://mariadb.com/kb/en/reporting-bugs Jun 25 16:38:48 ara1 mysqld[28693]: We will try our best to scrape up some info that will hopefully help Jun 25 16:38:48 ara1 mysqld[28693]: diagnose the problem, but since we have already crashed, Jun 25 16:38:48 ara1 mysqld[28693]: something is definitely wrong and this may fail. Jun 25 16:38:48 ara1 mysqld[28693]: Server version: 10.4.6-MariaDB-1:10.4.6+maria~disco Jun 25 16:38:48 ara1 mysqld[28693]: key_buffer_size=134217728 Jun 25 16:38:48 ara1 mysqld[28693]: read_buffer_size=131072 Jun 25 16:38:48 ara1 mysqld[28693]: max_used_connections=1 Jun 25 16:38:48 ara1 mysqld[28693]: max_threads=65537 Jun 25 16:38:48 ara1 mysqld[28693]: thread_count=10 Jun 25 16:38:48 ara1 mysqld[28693]: It is possible that mysqld could use up to Jun 25 16:38:48 ara1 mysqld[28693]: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 142743316 K bytes of memory Jun 25 16:38:48 ara1 mysqld[28693]: Hope that's ok; if not, decrease some variables in the equation. Jun 25 16:38:48 ara1 mysqld[28693]: Thread pointer: 0x7fb3b8000ce8 Jun 25 16:38:48 ara1 mysqld[28693]: Attempting backtrace. You can use the following information to find out Jun 25 16:38:48 ara1 mysqld[28693]: where mysqld died. If you see no messages after this, something went Jun 25 16:38:48 ara1 mysqld[28693]: terribly wrong... Jun 25 16:38:48 ara1 mysqld[28693]: stack_bottom = 0x7fb55c0e6d30 thread_stack 0x49000 Jun 25 16:38:48 ara1 mysqld[28693]: /usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x556a6fa7f65e] Jun 25 16:38:48 ara1 mysqld[28693]: /usr/sbin/mysqld(handle_fatal_signal+0x54d)[0x556a6f57aa1d] Jun 25 16:38:48 ara1 mysqld[28693]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x13f40)[0x7fb7ff1c0f40] Jun 25 16:38:49 ara1 mysqld[28693]: /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xc7)[0x7fb7feccded7] Jun 25 16:38:49 ara1 mysqld[28693]: /lib/x86_64-linux-gnu/libc.so.6(abort+0x121)[0x7fb7fecaf535] Jun 25 16:38:49 ara1 mysqld[28693]: /lib/x86_64-linux-gnu/libc.so.6(+0x2540f)[0x7fb7fecaf40f] Jun 25 16:38:49 ara1 mysqld[28693]: /lib/x86_64-linux-gnu/libc.so.6(+0x35012)[0x7fb7fecbf012] Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(_ZN5wsrep12client_state9enter_toiERKSt6vectorINS_3keyESaIS2_EERKNS_12const_bufferEi+0x10b)[0x556a6fae0d3b] Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(+0x7ff20b)[0x556a6f4ee20b] Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(_ZN25Sql_cmd_create_table_like7executeEP3THD+0x870)[0x556a6f40b530] Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x3144)[0x556a6f374c24] Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_statebb+0x219)[0x556a6f37a739] Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(+0x68bf7a)[0x556a6f37af7a] Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0x20b5)[0x556a6f37d7f5] Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(_Z10do_commandP3THD+0x15e)[0x556a6f37e12e] Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(_Z11tp_callbackP13TP_connection+0x122)[0x556a6f54e292] Jun 25 16:38:49 ara1 mysqld[28693]: /usr/sbin/mysqld(+0xa07520)[0x556a6f6f6520] Jun 25 16:38:49 ara1 mysqld[28693]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x9182)[0x7fb7ff1b6182] Jun 25 16:38:49 ara1 mysqld[28693]: /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7fb7feda7b1f] Jun 25 16:38:49 ara1 mysqld[28693]: Trying to get some variables. Jun 25 16:38:49 ara1 mysqld[28693]: Some pointers may be invalid and cause the dump to abort. Jun 25 16:38:49 ara1 mysqld[28693]: Query (0x7fb3b80141b0): CREATE TABLE `drupal_accesslog` ( `aid` int(11) NOT NULL AUTO_INCREMENT COMMENT 'Primary Key: Unique accesslog ID.', `sid` varchar(128) NOT NULL DEFAULT '' COMMENT 'Browser session ID of user that visited page.', `title` varchar(255) DEFAULT NULL COMMENT 'Title of page visited.', `path` varchar(255) DEFAULT NULL COMMENT 'Internal path to page visited (relative to Drupal root.)', `url` text DEFAULT NULL COMMENT 'Referrer URI.', `hostname` varchar(128) DEFAULT NULL COMMENT 'Hostname of user that visited the page.', `uid` int(10) unsigned DEFAULT 0 COMMENT 'User drupal_users.uid that visited the page.', `timer` int(10) unsigned NOT NULL DEFAULT 0 COMMENT 'Time in milliseconds that the page took to load.', `timestamp` int(10) unsigned NOT NULL DEFAULT 0 COMMENT 'Timestamp of when the page was visited.', PRIMARY KEY (`aid`), KEY `accesslog_timestamp` (`timestamp`), KEY `uid` (`uid`) ) ENGINE=InnoDB AUTO_INCREMENT=13586521 DEFAULT CHARSET=utf8 COMMENT='Stores site access information for statistics.' Jun 25 16:38:49 ara1 mysqld[28693]: Connection ID (thread ID): 41 Jun 25 16:38:49 ara1 mysqld[28693]: Status: NOT_KILLED Jun 25 16:38:49 ara1 mysqld[28693]: Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on Jun 25 16:38:49 ara1 mysqld[28693]: The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains Jun 25 16:38:49 ara1 mysqld[28693]: information that should help you find out what is causing the crash. Jun 25 16:38:49 ara1 mysqld[28693]: Writing a core file... Jun 25 16:38:49 ara1 mysqld[28693]: Working directory at /var/lib/mysql Jun 25 16:38:49 ara1 mysqld[28693]: Resource Limits: Jun 25 16:38:49 ara1 mysqld[28693]: Limit Soft Limit Hard Limit Units Jun 25 16:38:49 ara1 mysqld[28693]: Max cpu time unlimited unlimited seconds Jun 25 16:38:49 ara1 mysqld[28693]: Max file size unlimited unlimited bytes Jun 25 16:38:49 ara1 mysqld[28693]: Max data size unlimited unlimited bytes Jun 25 16:38:49 ara1 mysqld[28693]: Max stack size 8388608 unlimited bytes Jun 25 16:38:49 ara1 mysqld[28693]: Max core file size 0 unlimited bytes Jun 25 16:38:49 ara1 mysqld[28693]: Max resident set unlimited unlimited bytes Jun 25 16:38:49 ara1 mysqld[28693]: Max processes 256658 256658 processes Jun 25 16:38:49 ara1 mysqld[28693]: Max open files 16364 16364 files Jun 25 16:38:49 ara1 mysqld[28693]: Max locked memory 67108864 67108864 bytes Jun 25 16:38:49 ara1 mysqld[28693]: Max address space unlimited unlimited bytes Jun 25 16:38:49 ara1 mysqld[28693]: Max file locks unlimited unlimited locks Jun 25 16:38:49 ara1 mysqld[28693]: Max pending signals 256658 256658 signals Jun 25 16:38:49 ara1 mysqld[28693]: Max msgqueue size 819200 819200 bytes Jun 25 16:38:49 ara1 mysqld[28693]: Max nice priority 0 0 Jun 25 16:38:49 ara1 mysqld[28693]: Max realtime priority 0 0 Jun 25 16:38:49 ara1 mysqld[28693]: Max realtime timeout unlimited unlimited us Jun 25 16:38:49 ara1 mysqld[28693]: Core pattern: core With the settings above this is 100% reproducible for me. Let me know if you need more info.
          siddharth.agravat Siddharth Agravat added a comment - - edited

          Yes. It affects me as well. thread_pool doesn't seems to be working with wsrep (galera4) with different configuration than mentioned as well.
          System : CentOS 7.6.1810 (Core) - 3.10.0-862.14.4.el7.x86_64
          10.4.6-MariaDB Server
          Galera 26.4.2 (r4498)

          my.cnf :
          [mysqld]
          thread_handling = pool-of-threads

          [galera]
          wsrep_on=ON
          wsrep_provider=/usr/lib64/galera-4/libgalera_smm.so

          ThreadPool_galera_bug.txt

          siddharth.agravat Siddharth Agravat added a comment - - edited Yes. It affects me as well. thread_pool doesn't seems to be working with wsrep (galera4) with different configuration than mentioned as well. System : CentOS 7.6.1810 (Core) - 3.10.0-862.14.4.el7.x86_64 10.4.6-MariaDB Server Galera 26.4.2 (r4498) my.cnf : [mysqld] thread_handling = pool-of-threads [galera] wsrep_on=ON wsrep_provider=/usr/lib64/galera-4/libgalera_smm.so ThreadPool_galera_bug.txt

          I have not managed to reproduce it on my CentOS Linux release 7.6.1810 (Core).
          Tried on released 10.4.6 + Galera 26.4.2 (r4498), debug built from the sources.
          Experienced with 2 and 3 nodes cluster.
          All works successfully, have not observed any errors in the log:

          MariaDB [(none)]> SHOW VARIABLES LIKE 'wsrep_on';
          +---------------+-------+
          | Variable_name | Value |
          +---------------+-------+
          | wsrep_on      | ON    |
          +---------------+-------+
           
          MariaDB [(none)]> SHOW VARIABLES LIKE 'thread_handling';
          +-----------------+-----------------+
          | Variable_name   | Value           |
          +-----------------+-----------------+
          | thread_handling | pool-of-threads |
          +-----------------+-----------------+
          

          Tried also on the latest 10.4.7, branch 10.4, commit a0230bc76d78202178f43d2f4f6a7e3322c19a16. Result was the same.

          stepan.patryshev Stepan Patryshev (Inactive) added a comment - I have not managed to reproduce it on my CentOS Linux release 7.6.1810 (Core). Tried on released 10.4.6 + Galera 26.4.2 (r4498), debug built from the sources. Experienced with 2 and 3 nodes cluster. All works successfully, have not observed any errors in the log: MariaDB [(none)]> SHOW VARIABLES LIKE 'wsrep_on'; +---------------+-------+ | Variable_name | Value | +---------------+-------+ | wsrep_on | ON | +---------------+-------+   MariaDB [(none)]> SHOW VARIABLES LIKE 'thread_handling'; +-----------------+-----------------+ | Variable_name | Value | +-----------------+-----------------+ | thread_handling | pool-of-threads | +-----------------+-----------------+ Tried also on the latest 10.4.7, branch 10.4, commit a0230bc76d78202178f43d2f4f6a7e3322c19a16. Result was the same.
          • Branch: 10.4 commit a0230bc76d78202178f43d2f4f6a7e3322c19a16
          • Build: Debug
          • Galera library: galera-4 with debug build
          • How to repeat: ./mtr -suite=galera --mysqld=-thread-handling=pool-of-threads --force --parallel=auto

          galera.galera_mdev_13787 'innodb'        w5 [ fail ]
                  Test ended at 2019-07-15 09:31:28
           
          CURRENT_TEST: galera.galera_mdev_13787
          mysqltest: At line 4: query 'create table t(a int)' failed: 2013: Lost connection to MySQL server during query
           
          The result from queries just before the failure was:
          connection node_2;
          connection node_1;
          connection node_1;
          create table t(a int);
           
           
          Server [mysqld.1 - pid: 20734, winpid: 20734, exit: 256] failed during test run
          Server log from this test:
          ----------SERVER LOG START-----------
          2019-07-15  9:31:19 0 [Warning] WSREP: option --wsrep-causal-reads is deprecated
          2019-07-15  9:31:19 0 [Note] /home/jan/mysql/10.4/sql/mysqld (mysqld 10.4.7-MariaDB-debug-log) starting as process 20738 ...
          2019-07-15  9:31:19 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4182)
          2019-07-15  9:31:19 0 [Warning] Changed limits: max_open_files: 1024  max_connections: 151 (was 151)  table_cache: 421 (was 2000)
          2019-07-15  9:31:19 0 [Warning] WSREP: wsrep_sst_receive_address is set to '127.0.0.1:16084' which makes it impossible for another host to reach this one. Please set it to the address which this node can be connected at by other cluster members.
          2019-07-15  9:31:19 0 [Note] WSREP: Loading provider /usr/lib/libgalera_4d_smm.so initial position: 00000000-0000-0000-0000-000000000000:-1
          wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_4d_smm.so'
          wsrep loader: [INFO] wsrep_load(): Galera 26.4.2(r4498) by Codership Oy <info@codership.com> loaded successfully.
          2019-07-15  9:31:19 0 [Note] WSREP: CRC-32C: using hardware acceleration.
          2019-07-15  9:31:19 0 [Warning] WSREP: Could not open state file for reading: '/home/jan/mysql/10.4/mysql-test/var/5/mysqld.1/data//grastate.dat'
          2019-07-15  9:31:19 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1
          2019-07-15  9:31:19 0 [Note] WSREP: GCache DEBUG: opened preamble:
          Version: 0
          UUID: 00000000-0000-0000-0000-000000000000
          Seqno: -1 - -1
          Offset: -1
          Synced: 0
          2019-07-15  9:31:19 0 [Note] WSREP: Skipped GCache ring buffer recovery: could not determine history UUID.
          2019-07-15  9:31:19 0 [Note] WSREP: Passing config to GCS: base_dir = /home/jan/mysql/10.4/mysql-test/var/5/mysqld.1/data/; base_host = 127.0.0.1; base_port = 16082; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT30S; evs.install_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT10S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /home/jan/mysql/10.4/mysql-test/var/5/mysqld.1/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 10M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.r
          2019-07-15  9:31:19 0 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0 -> 00000000-0000-0000-0000-000000000000:-1
          2019-07-15  9:31:19 0 [Note] WSREP: Start replication
          2019-07-15  9:31:19 0 [Note] WSREP: Connecting with bootstrap option: 1
          2019-07-15  9:31:19 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1
          2019-07-15  9:31:19 0 [Note] WSREP: protonet asio version 0
          2019-07-15  9:31:19 0 [Note] WSREP: Using CRC-32C for message checksums.
          2019-07-15  9:31:19 0 [Note] WSREP: backend: asio
          2019-07-15  9:31:19 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 
          2019-07-15  9:31:19 0 [Warning] WSREP: access file(/home/jan/mysql/10.4/mysql-test/var/5/mysqld.1/data//gvwstate.dat) failed(No such file or directory)
          2019-07-15  9:31:19 0 [Note] WSREP: restore pc from disk failed
          2019-07-15  9:31:19 0 [Note] WSREP: GMCast version 0
          2019-07-15  9:31:19 0 [Note] WSREP: (2826cfab, 'tcp://0.0.0.0:16082') listening at tcp://0.0.0.0:16082
          2019-07-15  9:31:19 0 [Note] WSREP: (2826cfab, 'tcp://0.0.0.0:16082') multicast: , ttl: 1
          2019-07-15  9:31:19 0 [Note] WSREP: EVS version 1
          2019-07-15  9:31:19 0 [Note] WSREP: gcomm: bootstrapping new group 'my_wsrep_cluster'
          2019-07-15  9:31:19 0 [Note] WSREP: start_prim is enabled, turn off pc_recovery
          2019-07-15  9:31:19 0 [Note] WSREP: EVS version upgrade 0 -> 1
          2019-07-15  9:31:19 0 [Note] WSREP: PC protocol upgrade 0 -> 1
          2019-07-15  9:31:19 0 [Note] WSREP: Node 2826cfab state prim
          2019-07-15  9:31:19 0 [Note] WSREP: view(view_id(PRIM,2826cfab,1) memb {
          	2826cfab,0
          } joined {
          } left {
          } partitioned {
          })
          2019-07-15  9:31:19 0 [Note] WSREP: save pc into disk
          2019-07-15  9:31:19 0 [Note] WSREP: gcomm: connected
          2019-07-15  9:31:19 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
          2019-07-15  9:31:19 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
          2019-07-15  9:31:19 0 [Note] WSREP: Opened channel 'my_wsrep_cluster'
          2019-07-15  9:31:19 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1
          2019-07-15  9:31:19 0 [Note] WSREP: Starting new group from scratch: 2827f56e-a6ca-11e9-8716-53a41869b333
          2019-07-15  9:31:19 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 2827fb28-a6ca-11e9-9f14-2a17664a1654
          2019-07-15  9:31:19 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 2827fb28-a6ca-11e9-9f14-2a17664a1654
          2019-07-15  9:31:19 0 [Note] WSREP: STATE EXCHANGE: got state msg: 2827fb28-a6ca-11e9-9f14-2a17664a1654 from 0 (jan-HP-ZBook-15u-G5)
          2019-07-15  9:31:19 0 [Note] WSREP: Quorum results:
          	version    = 5,
          	component  = PRIMARY,
          	conf_id    = 0,
          	members    = 1/1 (joined/total),
          	act_id     = 0,
          	last_appl. = -1,
          	protocols  = 1/10/4 (gcs/repl/appl),
          	vote policy= 0,
          	group UUID = 2827f56e-a6ca-11e9-8716-53a41869b333
          2019-07-15  9:31:19 0 [Note] WSREP: Writing down CC checksum: 1aeaf9a0 90789d8d f2b791a0 271916ac at offset 144
          2019-07-15  9:31:19 0 [Note] WSREP: Flow-control interval: [16, 16]
          2019-07-15  9:31:19 1 [Note] WSREP: Starting post rollbacker thread 1
          2019-07-15  9:31:19 0 [Note] WSREP: Trying to continue unpaused monitor
          2019-07-15  9:31:19 0 [Note] WSREP: Restored state OPEN -> JOINED (1)
          2019-07-15  9:31:19 0 [Note] WSREP: Member 0.0 (jan-HP-ZBook-15u-G5) synced with group.
          2019-07-15  9:31:19 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 1)
          2019-07-15  9:31:19 3 [Note] WSREP: Starting rollbacker thread 3
          2019-07-15  9:31:19 2 [Note] WSREP: Starting applier thread 2
          2019-07-15  9:31:19 2 [Note] WSREP: ####### processing CC 1, local, ordered
          2019-07-15  9:31:19 2 [Note] WSREP: ####### drain monitors upto -1
          2019-07-15  9:31:19 2 [Note] WSREP: REPL Protocols: 10 (5, 3)
          2019-07-15  9:31:19 2 [Note] WSREP: ####### My UUID: 2826cfab-a6ca-11e9-9c26-df6a14e88650
          2019-07-15  9:31:19 2 [Note] WSREP: Server jan-HP-ZBook-15u-G5 connected to cluster at position 2827f56e-a6ca-11e9-8716-53a41869b333:1 with ID 2826cfab-a6ca-11e9-9c26-df6a14e88650
          2019-07-15  9:31:19 2 [Note] WSREP: Server status change disconnected -> connected
          2019-07-15  9:31:19 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
          2019-07-15  9:31:19 2 [Note] WSREP: ####### ST not required
          2019-07-15  9:31:19 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:0 (proto: 10), state transfer needed: no
          2019-07-15  9:31:19 0 [Note] WSREP: Service thread queue flushed.
          2019-07-15  9:31:19 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:0, protocol version: 5
          2019-07-15  9:31:19 2 [Note] WSREP: ####### Adjusting cert position: 0 -> 1
          2019-07-15  9:31:19 0 [Note] WSREP: Service thread queue flushed.
          2019-07-15  9:31:19 2 [Note] WSREP: ####### Setting monitor position to 1
          2019-07-15  9:31:19 2 [Note] WSREP: Lowest cert indnex boundary for CC from group: 1
          2019-07-15  9:31:19 2 [Note] WSREP: Min available from gcache for CC from group: 1
          2019-07-15  9:31:19 2 [Note] WSREP: ================================================
          View:
            id: 2827f56e-a6ca-11e9-8716-53a41869b333:1
            status: primary
            protocol_version: 4
            capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
            final: no
            own_index: 0
            members(1):
          	0: 2826cfab-a6ca-11e9-9c26-df6a14e88650, jan-HP-ZBook-15u-G5
          =================================================
          2019-07-15  9:31:19 2 [Note] WSREP: Server status change connected -> joiner
          2019-07-15  9:31:19 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
          2019-07-15  9:31:19 2 [Note] WSREP: Server status change joiner -> initializing
          2019-07-15  9:31:19 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
          2019-07-15  9:31:19 0 [Note] Plugin 'partition' is disabled.
          2019-07-15  9:31:19 0 [Note] Plugin 'SEQUENCE' is disabled.
          2019-07-15  9:31:19 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!!
          2019-07-15  9:31:19 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
          2019-07-15  9:31:19 0 [Note] InnoDB: Uses event mutexes
          2019-07-15  9:31:19 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
          2019-07-15  9:31:19 0 [Note] InnoDB: Number of pools: 1
          2019-07-15  9:31:19 0 [Note] InnoDB: Using SSE2 crc32 instructions
          2019-07-15  9:31:19 0 [Note] mysqld: O_TMPFILE is not supported on /home/jan/mysql/10.4/mysql-test/var/tmp/5/mysqld.1 (disabling future attempts)
          2019-07-15  9:31:19 0 [Note] InnoDB: Initializing buffer pool, total size = 8M, instances = 1, chunk size = 8M
          2019-07-15  9:31:19 0 [Note] InnoDB: Completed initialization of buffer pool
          2019-07-15  9:31:19 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
          2019-07-15  9:31:20 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
          2019-07-15  9:31:20 0 [Note] InnoDB: Creating shared tablespace for temporary tables
          2019-07-15  9:31:20 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
          2019-07-15  9:31:20 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
          2019-07-15  9:31:20 0 [Note] InnoDB: Waiting for purge to start
          2019-07-15  9:31:20 0 [Note] InnoDB: 10.4.7 started; log sequence number 151269; transaction id 34
          2019-07-15  9:31:20 0 [Note] InnoDB: Loading buffer pool(s) from /home/jan/mysql/10.4/mysql-test/var/5/mysqld.1/data/ib_buffer_pool
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_MUTEXES' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_CMP' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled.
          2019-07-15  9:31:20 0 [Note] InnoDB: Buffer pool(s) load completed at 190715  9:31:20
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'FEEDBACK' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'user_variables' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled.
          2019-07-15  9:31:20 0 [Note] Plugin 'unix_socket' is disabled.
          2019-07-15  9:31:20 0 [Warning] /home/jan/mysql/10.4/sql/mysqld: unknown option '--loose-pam-debug'
          2019-07-15  9:31:20 0 [Warning] /home/jan/mysql/10.4/sql/mysqld: unknown option '--loose-aria'
          2019-07-15  9:31:20 0 [Note] Server socket created on IP: '127.0.0.1'.
          2019-07-15  9:31:20 0 [Note] WSREP: wsrep_init_schema_and_SR (nil)
          2019-07-15  9:31:20 0 [Note] WSREP: Server initialized
          2019-07-15  9:31:20 0 [Note] WSREP: Server status change initializing -> initialized
          2019-07-15  9:31:20 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
          2019-07-15  9:31:20 2 [Note] WSREP: Bootstrapping a new cluster, setting initial position to 00000000-0000-0000-0000-000000000000:-1
          2019-07-15  9:31:20 10 [Note] WSREP: Cluster table is empty, not recovering transactions
          2019-07-15  9:31:20 2 [Note] WSREP: Server status change initialized -> joined
          2019-07-15  9:31:20 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
          2019-07-15  9:31:20 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
          2019-07-15  9:31:20 0 [Note] Reading of all Master_info entries succeeded
          2019-07-15  9:31:20 0 [Note] Added new Master_info '' to hash table
          2019-07-15  9:31:20 0 [Note] /home/jan/mysql/10.4/sql/mysqld: ready for connections.
          Version: '10.4.7-MariaDB-debug-log'  socket: '/home/jan/mysql/10.4/mysql-test/var/tmp/5/mysqld.1.sock'  port: 16080  Source distribution
          2019-07-15  9:31:20 2 [Note] WSREP: Server jan-HP-ZBook-15u-G5 synced with group
          2019-07-15  9:31:20 2 [Note] WSREP: Server status change joined -> synced
          2019-07-15  9:31:20 2 [Note] WSREP: Synchronized with group, ready for connections
          2019-07-15  9:31:20 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
          2019-07-15  9:31:20 0 [Note] WSREP: (2826cfab, 'tcp://0.0.0.0:16082') connection established to 28a291e5 tcp://127.0.0.1:16085
          2019-07-15  9:31:20 0 [Note] WSREP: (2826cfab, 'tcp://0.0.0.0:16082') turning message relay requesting on, nonlive peers: 
          2019-07-15  9:31:21 0 [Note] WSREP: declaring 28a291e5 at tcp://127.0.0.1:16085 stable
          2019-07-15  9:31:21 0 [Note] WSREP: Node 2826cfab state prim
          2019-07-15  9:31:21 0 [Note] WSREP: view(view_id(PRIM,2826cfab,2) memb {
          	2826cfab,0
          	28a291e5,0
          } joined {
          } left {
          } partitioned {
          })
          2019-07-15  9:31:21 0 [Note] WSREP: save pc into disk
          2019-07-15  9:31:21 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2
          2019-07-15  9:31:21 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 28f0b930-a6ca-11e9-9407-763ff24ccbd8
          2019-07-15  9:31:21 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 28f0b930-a6ca-11e9-9407-763ff24ccbd8
          2019-07-15  9:31:21 0 [Note] WSREP: STATE EXCHANGE: got state msg: 28f0b930-a6ca-11e9-9407-763ff24ccbd8 from 0 (jan-HP-ZBook-15u-G5)
          2019-07-15  9:31:21 0 [Note] WSREP: STATE EXCHANGE: got state msg: 28f0b930-a6ca-11e9-9407-763ff24ccbd8 from 1 (jan-HP-ZBook-15u-G5)
          2019-07-15  9:31:21 0 [Note] WSREP: Quorum results:
          	version    = 5,
          	component  = PRIMARY,
          	conf_id    = 1,
          	members    = 1/2 (joined/total),
          	act_id     = 1,
          	last_appl. = 0,
          	protocols  = 1/10/4 (gcs/repl/appl),
          	vote policy= 0,
          	group UUID = 2827f56e-a6ca-11e9-8716-53a41869b333
          2019-07-15  9:31:21 0 [Note] WSREP: Writing down CC checksum: 322d56e4 2b222494 662e7fc5 d676fa8f at offset 224
          2019-07-15  9:31:21 0 [Note] WSREP: Flow-control interval: [23, 23]
          2019-07-15  9:31:21 0 [Note] WSREP: Trying to continue unpaused monitor
          2019-07-15  9:31:21 2 [Note] WSREP: ####### processing CC 2, local, ordered
          2019-07-15  9:31:21 2 [Note] WSREP: ####### drain monitors upto 1
          2019-07-15  9:31:21 2 [Note] WSREP: REPL Protocols: 10 (5, 3)
          2019-07-15  9:31:21 2 [Note] WSREP: ####### My UUID: 2826cfab-a6ca-11e9-9c26-df6a14e88650
          2019-07-15  9:31:21 2 [Note] WSREP: ####### ST not required
          2019-07-15  9:31:21 2 [Note] WSREP: Skipping cert index reset
          2019-07-15  9:31:21 2 [Note] WSREP: ####### Adjusting cert position: 1 -> 2
          2019-07-15  9:31:21 0 [Note] WSREP: Service thread queue flushed.
          2019-07-15  9:31:21 2 [Note] WSREP: ####### Setting monitor position to 2
          2019-07-15  9:31:21 2 [Note] WSREP: Lowest cert indnex boundary for CC from group: 2
          2019-07-15  9:31:21 2 [Note] WSREP: Min available from gcache for CC from group: 1
          2019-07-15  9:31:21 2 [Note] WSREP: ================================================
          View:
            id: 2827f56e-a6ca-11e9-8716-53a41869b333:2
            status: primary
            protocol_version: 4
            capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO
            final: no
            own_index: 0
            members(2):
          	0: 2826cfab-a6ca-11e9-9c26-df6a14e88650, jan-HP-ZBook-15u-G5
          	1: 28a291e5-a6ca-11e9-925e-1e0c04ab35dd, jan-HP-ZBook-15u-G5
          =================================================
          2019-07-15  9:31:21 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
          2019-07-15  9:31:21 0 [Note] WSREP: Member 1.0 (jan-HP-ZBook-15u-G5) requested state transfer from '*any*'. Selected 0.0 (jan-HP-ZBook-15u-G5)(SYNCED) as donor.
          2019-07-15  9:31:21 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 2)
          2019-07-15  9:31:21 2 [Note] WSREP: Detected STR version: 1, req_len: 110, req: STRv1
          2019-07-15  9:31:21 2 [Note] WSREP: Cert index preload: 2 -> 2
          2019-07-15  9:31:21 2 [Note] WSREP: Server status change synced -> donor
          2019-07-15  9:31:21 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
          2019-07-15  9:31:21 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
          2019-07-15  9:31:21 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '127.0.0.2:16087/rsync_sst' --socket '/home/jan/mysql/10.4/mysql-test/var/tmp/5/mysqld.1.sock' --datadir '/home/jan/mysql/10.4/mysql-test/var/5/mysqld.1/data/'  --defaults-file '/home/jan/mysql/10.4/mysql-test/var/5/my.cnf' --defaults-group-suffix '.1'    ''  --binlog-index 'mysqld-bin.index' --gtid '2827f56e-a6ca-11e9-8716-53a41869b333:2' --gtid-domain-id '0''
          2019-07-15  9:31:21 0 [Note] WSREP: async IST sender starting to serve tcp://127.0.0.1:16086 sending 2-2
          2019-07-15  9:31:21 0 [Note] WSREP: IST sender 2 -> 2
          2019-07-15  9:31:21 2 [Note] WSREP: sst_donor_thread signaled with 0
          2019-07-15  9:31:22 0 [Note] WSREP: Flushing tables for SST...
          2019-07-15  9:31:22 0 [Note] WSREP: pause
          2019-07-15  9:31:22 0 [Note] WSREP: Provider paused at 2827f56e-a6ca-11e9-8716-53a41869b333:2 (5)
          2019-07-15  9:31:22 0 [Note] WSREP: Server paused at: 2
          2019-07-15  9:31:22 0 [Note] WSREP: Tables flushed.
          2019-07-15  9:31:23 0 [Note] WSREP: resume
          2019-07-15  9:31:23 0 [Note] WSREP: resuming provider at 5
          2019-07-15  9:31:23 0 [Note] WSREP: Provider resumed.
          2019-07-15  9:31:23 0 [Note] WSREP: SST sent: 2827f56e-a6ca-11e9-8716-53a41869b333:2
          2019-07-15  9:31:23 0 [Note] WSREP: Server status change donor -> joined
          2019-07-15  9:31:23 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
          2019-07-15  9:31:23 0 [Note] WSREP: 0.0 (jan-HP-ZBook-15u-G5): State transfer to 1.0 (jan-HP-ZBook-15u-G5) complete.
          2019-07-15  9:31:23 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 2)
          2019-07-15  9:31:23 0 [Note] WSREP: Member 0.0 (jan-HP-ZBook-15u-G5) synced with group.
          2019-07-15  9:31:23 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2)
          2019-07-15  9:31:23 2 [Note] WSREP: Server jan-HP-ZBook-15u-G5 synced with group
          2019-07-15  9:31:23 2 [Note] WSREP: Server status change joined -> synced
          2019-07-15  9:31:23 2 [Note] WSREP: Synchronized with group, ready for connections
          2019-07-15  9:31:23 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
          2019-07-15  9:31:23 0 [Note] WSREP: (2826cfab, 'tcp://0.0.0.0:16082') turning message relay requesting off
          2019-07-15  9:31:25 0 [Note] WSREP: async IST sender served
          2019-07-15  9:31:25 0 [Note] WSREP: 1.0 (jan-HP-ZBook-15u-G5): State transfer from 0.0 (jan-HP-ZBook-15u-G5) complete.
          2019-07-15  9:31:25 0 [Note] WSREP: Member 1.0 (jan-HP-ZBook-15u-G5) synced with group.
          mysqld: /home/jan/mysql/10.4/wsrep-lib/src/client_state.cpp:308: int wsrep::client_state::enter_toi(const key_array&, const wsrep::const_buffer&, int): Assertion `state_ == s_exec' failed.
          190715  9:31:27 [ERROR] mysqld got signal 6 ;
          This could be because you hit a bug. It is also possible that this binary
          or one of the libraries it was linked against is corrupt, improperly built,
          or misconfigured. This error can also be caused by malfunctioning hardware.
           
          To report this bug, see https://mariadb.com/kb/en/reporting-bugs
           
          We will try our best to scrape up some info that will hopefully help
          diagnose the problem, but since we have already crashed, 
          something is definitely wrong and this may fail.
           
          Server version: 10.4.7-MariaDB-debug-log
          key_buffer_size=1048576
          read_buffer_size=131072
          max_used_connections=2
          max_threads=65537
          thread_count=11
          It is possible that mysqld could use up to 
          key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 25171070 K  bytes of memory
          Hope that's ok; if not, decrease some variables in the equation.
           
          Thread pointer: 0x7f783c000f30
          Attempting backtrace. You can use the following information to find out
          where mysqld died. If you see no messages after this, something went
          terribly wrong...
          stack_bottom = 0x7f78d80dbd28 thread_stack 0x49000
          /home/jan/mysql/10.4/sql/mysqld(my_print_stacktrace+0x40)[0x560848adbb05]
          mysys/stacktrace.c:269(my_print_stacktrace)[0x560848325d15]
          /lib/x86_64-linux-gnu/libpthread.so.0(+0x13f40)[0x7f78e8ff5f40]
          /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xc7)[0x7f78e8ae8ed7]
          /lib/x86_64-linux-gnu/libc.so.6(abort+0x121)[0x7f78e8aca535]
          /lib/x86_64-linux-gnu/libc.so.6(+0x2540f)[0x7f78e8aca40f]
          /lib/x86_64-linux-gnu/libc.so.6(+0x35012)[0x7f78e8ada012]
          /home/jan/mysql/10.4/sql/mysqld(_ZN5wsrep12client_state9enter_toiERKSt6vectorINS_3keyESaIS2_EERKNS_12const_bufferEi+0x43)[0x560848b898db]
          src/client_state.cpp:309(wsrep::client_state::enter_toi(std::vector<wsrep::key, std::allocator<wsrep::key> > const&, wsrep::const_buffer const&, int))[0x56084823dd30]
          sql/wsrep_mysqld.cc:1853(wsrep_TOI_begin(THD*, char const*, char const*, TABLE_LIST const*, Alter_info*))[0x56084823eac7]
          sql/wsrep_mysqld.cc:2005(wsrep_to_isolation_begin(THD*, char const*, char const*, TABLE_LIST const*, Alter_info*))[0x5608480e1a49]
          sql/sql_table.cc:11359(Sql_cmd_create_table_like::execute(THD*))[0x560847ffe116]
          sql/sql_parse.cc:6082(mysql_execute_command(THD*))[0x56084800334b]
          sql/sql_parse.cc:7892(mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool))[0x5608480029c7]
          sql/sql_parse.cc:7715(wsrep_mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool))[0x560847fef5b9]
          sql/sql_parse.cc:1811(dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool))[0x560847feded9]
          sql/sql_parse.cc:1359(do_command(THD*))[0x5608482e18ad]
          sql/threadpool_common.cc:359(threadpool_process_request(THD*))[0x5608482e143d]
          sql/threadpool_common.cc:186(tp_callback(TP_connection*))[0x5608485316be]
          sql/threadpool_generic.cc:1593(worker_main(void*))[0x560848a71202]
          nptl/pthread_create.c:487(start_thread)[0x7f78e8feb182]
          /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7f78e8bc2b1f]
           
          Trying to get some variables.
          Some pointers may be invalid and cause the dump to abort.
          Query (0x7f783c0135a8): create table t(a int)
          Connection ID (thread ID): 18
          Status: NOT_KILLED
           
          Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on
           
          The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
          information that should help you find out what is causing the crash.
          Writing a core file...
          Working directory at /home/jan/mysql/10.4/mysql-test/var/5/mysqld.1/data
          Resource Limits:
          Limit                     Soft Limit           Hard Limit           Units     
          Max cpu time              unlimited            unlimited            seconds   
          Max file size             unlimited            unlimited            bytes     
          Max data size             unlimited            unlimited            bytes     
          Max stack size            8388608              unlimited            bytes     
          Max core file size        unlimited            unlimited            bytes     
          Max resident set          unlimited            unlimited            bytes     
          Max processes             127852               127852               processes 
          Max open files            1024                 1024                 files     
          Max locked memory         67108864             67108864             bytes     
          Max address space         unlimited            unlimited            bytes     
          Max file locks            unlimited            unlimited            locks     
          Max pending signals       127852               127852               signals   
          Max msgqueue size         819200               819200               bytes     
          Max nice priority         0                    0                    
          Max realtime priority     0                    0                    
          Max realtime timeout      unlimited            unlimited            us        
          Core pattern: |/usr/share/apport/apport %p %s %c %d %P
           
          ----------SERVER LOG END-------------
           
           
           - found 'core' (0/5)
           
          Trying 'dbx' to get a backtrace
           
          Trying 'gdb' to get a backtrace from coredump /home/jan/mysql/10.4/mysql-test/var/5/log/galera.galera_mdev_13787-innodb/mysqld.1/data/core
          Core generated by '/home/jan/mysql/10.4/sql/mysqld'
          Output from gdb follows. The first stack trace is from the failing thread.
          The following stack traces are from all threads (so the failing one is
          duplicated).
          --------------------------
          [New LWP 22835]
          [New LWP 20772]
          [New LWP 20834]
          [New LWP 22565]
          [New LWP 20836]
          [New LWP 22834]
          [New LWP 20837]
          [New LWP 20767]
          [New LWP 20775]
          [New LWP 20744]
          [New LWP 20749]
          [New LWP 20782]
          [New LWP 20868]
          [New LWP 20738]
          [New LWP 20912]
          [New LWP 20870]
          [New LWP 20829]
          [New LWP 20913]
          [New LWP 20799]
          [New LWP 20832]
          [New LWP 20833]
          [New LWP 20869]
          [New LWP 20951]
          [New LWP 20914]
          [New LWP 22560]
          [New LWP 20915]
          [New LWP 20835]
          [New LWP 20952]
          [New LWP 20991]
          [New LWP 20916]
          [New LWP 20953]
          [New LWP 21037]
          [New LWP 20954]
          [New LWP 21098]
          [New LWP 21036]
          [New LWP 22564]
          [New LWP 22559]
          [New LWP 21035]
          [New LWP 21076]
          [New LWP 20990]
          [New LWP 20758]
          [New LWP 20866]
          [New LWP 20867]
          [Thread debugging using libthread_db enabled]
          Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
          Core was generated by `/home/jan/mysql/10.4/sql/mysqld --defaults-group-suffix=.1 --defaults-file=/hom'.
          Program terminated with signal SIGABRT, Aborted.
          #0  __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:56
          56	../sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.
          [Current thread is 1 (Thread 0x7f78d80dc700 (LWP 22835))]
          #0  __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:56
          #1  0x0000560848adbbf7 in my_write_core (sig=6) at /home/jan/mysql/10.4/mysys/stacktrace.c:481
          #2  0x000056084832609e in handle_fatal_signal (sig=6) at /home/jan/mysql/10.4/sql/signal_handler.cc:343
          #3  <signal handler called>
          #4  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
          #5  0x00007f78e8aca535 in __GI_abort () at abort.c:79
          #6  0x00007f78e8aca40f in __assert_fail_base (fmt=0x7f78e8c58588 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=0x5608490e24b1 "state_ == s_exec", file=0x5608490e1f68 "/home/jan/mysql/10.4/wsrep-lib/src/client_state.cpp", line=308, function=<optimized out>) at assert.c:92
          #7  0x00007f78e8ada012 in __GI___assert_fail (assertion=0x5608490e24b1 "state_ == s_exec", file=0x5608490e1f68 "/home/jan/mysql/10.4/wsrep-lib/src/client_state.cpp", line=308, function=0x5608490e2b20 <wsrep::client_state::enter_toi(std::vector<wsrep::key, std::allocator<wsrep::key> > const&, wsrep::const_buffer const&, int)::__PRETTY_FUNCTION__> "int wsrep::client_state::enter_toi(const key_array&, const wsrep::const_buffer&, int)") at assert.c:101
          #8  0x0000560848b898db in wsrep::client_state::enter_toi (this=0x7f783c0070a8, keys=std::vector of length 1, capacity 1 = {...}, buffer=..., flags=3) at /home/jan/mysql/10.4/wsrep-lib/src/client_state.cpp:308
          #9  0x000056084823dd30 in wsrep_TOI_begin (thd=0x7f783c000f30, db=0x7f783c013d40 "test", table=0x7f783c013660 "t", table_list=0x0, alter_info=0x0) at /home/jan/mysql/10.4/sql/wsrep_mysqld.cc:1853
          #10 0x000056084823eac7 in wsrep_to_isolation_begin (thd=0x7f783c000f30, db_=0x7f783c013d40 "test", table_=0x7f783c013660 "t", table_list=0x0, alter_info=0x0) at /home/jan/mysql/10.4/sql/wsrep_mysqld.cc:2005
          #11 0x00005608480e1a49 in Sql_cmd_create_table_like::execute (this=0x7f783c013638, thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/sql_table.cc:11359
          #12 0x0000560847ffe116 in mysql_execute_command (thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/sql_parse.cc:6082
          #13 0x000056084800334b in mysql_parse (thd=0x7f783c000f30, rawbuf=0x7f783c0135a8 "create table t(a int)", length=21, parser_state=0x7f78d80db070, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.4/sql/sql_parse.cc:7892
          #14 0x00005608480029c7 in wsrep_mysql_parse (thd=0x7f783c000f30, rawbuf=0x7f783c0135a8 "create table t(a int)", length=21, parser_state=0x7f78d80db070, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.4/sql/sql_parse.cc:7704
          #15 0x0000560847fef5b9 in dispatch_command (command=COM_QUERY, thd=0x7f783c000f30, packet=0x7f783c008891 "create table t(a int)", packet_length=21, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.4/sql/sql_parse.cc:1811
          #16 0x0000560847feded9 in do_command (thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/sql_parse.cc:1359
          #17 0x00005608482e18ad in threadpool_process_request (thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/threadpool_common.cc:359
          #18 0x00005608482e143d in tp_callback (c=0x56084b8c8cd0) at /home/jan/mysql/10.4/sql/threadpool_common.cc:186
          #19 0x00005608485316be in worker_main (param=0x56084b882910) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1592
          #20 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b960ee0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #21 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #22 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 43 (Thread 0x7f789bfff700 (LWP 20867)):
          #0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f789bffeca0, expected=0, futex_word=0x56084b61a6c8) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
          #1  __pthread_cond_wait_common (abstime=0x7f789bffeca0, mutex=0x56084b61a678, cond=0x56084b61a6a0) at pthread_cond_wait.c:539
          #2  __pthread_cond_timedwait (cond=0x56084b61a6a0, mutex=0x56084b61a678, abstime=0x7f789bffeca0) at pthread_cond_wait.c:667
          #3  0x000056084862f2ba in os_event::timed_wait (this=0x56084b61a660, abstime=0x7f789bffeca0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:276
          #4  0x000056084862f5e7 in os_event::wait_time_low (this=0x56084b61a660, time_in_usec=1000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:398
          #5  0x000056084862f780 in os_event_wait_time_low (event=0x56084b61a660, time_in_usec=1000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:498
          #6  0x0000560848717661 in srv_error_monitor_thread () at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:1845
          #7  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #8  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 42 (Thread 0x7f78b8ff9700 (LWP 20866)):
          #0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78b8ff8e60, expected=0, futex_word=0x56084b7c4a08) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
          #1  __pthread_cond_wait_common (abstime=0x7f78b8ff8e60, mutex=0x56084b7c49b8, cond=0x56084b7c49e0) at pthread_cond_wait.c:539
          #2  __pthread_cond_timedwait (cond=0x56084b7c49e0, mutex=0x56084b7c49b8, abstime=0x7f78b8ff8e60) at pthread_cond_wait.c:667
          #3  0x000056084862f2ba in os_event::timed_wait (this=0x56084b7c49a0, abstime=0x7f78b8ff8e60) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:276
          #4  0x000056084862f5e7 in os_event::wait_time_low (this=0x56084b7c49a0, time_in_usec=1000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:398
          #5  0x000056084862f780 in os_event_wait_time_low (event=0x56084b7c49a0, time_in_usec=1000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:498
          #6  0x00005608485fcf78 in lock_wait_timeout_thread () at /home/jan/mysql/10.4/storage/innobase/lock/lock0wait.cc:543
          #7  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #8  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 41 (Thread 0x7f78e0911700 (LWP 20758)):
          #0  0x00007f78e8bc2e3f in epoll_wait (epfd=9, events=0x7f78e0910450, maxevents=128, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30
          #1  0x00007f78e3c62a41 in asio::detail::epoll_reactor::run (this=0x56084b512650, block=true, ops=...) at asio/asio/detail/impl/epoll_reactor.ipp:391
          #2  0x00007f78e3c63db5 in asio::detail::task_io_service::do_run_one (this=0x56084b50dcd0, lock=..., this_thread=..., ec=...) at asio/asio/detail/impl/task_io_service.ipp:355
          #3  0x00007f78e3c6385d in asio::detail::task_io_service::run (this=0x56084b50dcd0, ec=...) at asio/asio/detail/impl/task_io_service.ipp:148
          #4  0x00007f78e3c6406c in asio::io_service::run (this=0x56084b34acb8) at asio/asio/impl/io_service.ipp:58
          #5  0x00007f78e3c94f35 in gcomm::AsioProtonet::event_loop (this=0x56084b34ac00, period=...) at gcomm/src/asio_protonet.cpp:116
          #6  0x00007f78e3cbe931 in GCommConn::run (this=0x56084b511d30) at gcs/src/gcs_gcomm.cpp:498
          #7  0x00007f78e3cc30c4 in GCommConn::run_fn (arg=0x56084b511d30) at gcs/src/gcs_gcomm.cpp:209
          #8  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #9  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 40 (Thread 0x7f78897fa700 (LWP 20990)):
          #0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78897f9e60, expected=0, futex_word=0x560849686ff8 <pool_timer+216>) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
          #1  __pthread_cond_wait_common (abstime=0x7f78897f9e60, mutex=0x560849686f48 <pool_timer+40>, cond=0x560849686fd0 <pool_timer+176>) at pthread_cond_wait.c:539
          #2  __pthread_cond_timedwait (cond=0x560849686fd0 <pool_timer+176>, mutex=0x560849686f48 <pool_timer+40>, abstime=0x7f78897f9e60) at pthread_cond_wait.c:667
          #3  0x0000560848ae16d9 in safe_cond_timedwait (cond=0x560849686fd0 <pool_timer+176>, mp=0x560849686f20 <pool_timer>, abstime=0x7f78897f9e60, file=0x560848dcaaa0 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1215) at /home/jan/mysql/10.4/mysys/thr_mutex.c:546
          #4  0x000056084852f16e in inline_mysql_cond_timedwait (that=0x560849686fd0 <pool_timer+176>, mutex=0x560849686f20 <pool_timer>, abstime=0x7f78897f9e60, src_file=0x560848dcac68 "/home/jan/mysql/10.4/sql/threadpool_generic.cc", src_line=636) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1215
          #5  0x000056084852f759 in timer_thread (param=0x560849686f20 <pool_timer>) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:636
          #6  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b5de9c0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #7  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #8  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 39 (Thread 0x7f78d952e700 (LWP 21076)):
          #0  0x00007f78e8bc2e3f in epoll_wait (epfd=37, events=0x7f78d9527d20, maxevents=1024, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30
          #1  0x000056084852f338 in io_poll_wait (pollfd=37, native_events=0x7f78d9527d20, maxevents=1024, timeout_ms=-1) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:331
          #2  0x000056084852fc7f in listener (current_thread=0x7f78d952de20, thread_group=0x56084b882e10) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:792
          #3  0x000056084853087f in get_event (current_thread=0x7f78d952de20, thread_group=0x56084b882e10, abstime=0x7f78d952ddf0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1237
          #4  0x0000560848531680 in worker_main (param=0x56084b882e10) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588
          #5  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b98b950) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #6  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #7  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 38 (Thread 0x7f78d960f700 (LWP 21035)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084964c44c <COND_slave_background+44>) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084964f6c8 <LOCK_slave_background+40>, cond=0x56084964c420 <COND_slave_background>) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084964c420 <COND_slave_background>, mutex=0x56084964f6c8 <LOCK_slave_background+40>) at pthread_cond_wait.c:655
          #3  0x0000560848ae1319 in safe_cond_wait (cond=0x56084964c420 <COND_slave_background>, mp=0x56084964f6a0 <LOCK_slave_background>, file=0x560848bbcb98 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1167) at /home/jan/mysql/10.4/mysys/thr_mutex.c:492
          #4  0x0000560847eeca49 in inline_mysql_cond_wait (that=0x56084964c420 <COND_slave_background>, mutex=0x56084964f6a0 <LOCK_slave_background>, src_file=0x560848bbd708 "/home/jan/mysql/10.4/sql/slave.cc", src_line=519) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1167
          #5  0x0000560847eee242 in handle_slave_background (arg=0x0) at /home/jan/mysql/10.4/sql/slave.cc:519
          #6  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b994ac0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #7  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #8  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 37 (Thread 0x7f78d8253700 (LWP 22559)):
          #0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78d8252df0, expected=0, futex_word=0x7f78d8252e68) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
          #1  __pthread_cond_wait_common (abstime=0x7f78d8252df0, mutex=0x56084b8826b8, cond=0x7f78d8252e40) at pthread_cond_wait.c:539
          #2  __pthread_cond_timedwait (cond=0x7f78d8252e40, mutex=0x56084b8826b8, abstime=0x7f78d8252df0) at pthread_cond_wait.c:667
          #3  0x0000560848ae16d9 in safe_cond_timedwait (cond=0x7f78d8252e40, mp=0x56084b882690, abstime=0x7f78d8252df0, file=0x560848dcaaa0 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1204) at /home/jan/mysql/10.4/mysys/thr_mutex.c:546
          #4  0x000056084852f10e in inline_mysql_cond_timedwait (that=0x7f78d8252e40, mutex=0x56084b882690, abstime=0x7f78d8252df0, src_file=0x560848dcac68 "/home/jan/mysql/10.4/sql/threadpool_generic.cc", src_line=1280) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1204
          #5  0x00005608485309d1 in get_event (current_thread=0x7f78d8252e20, thread_group=0x56084b882690, abstime=0x7f78d8252df0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1279
          #6  0x0000560848531680 in worker_main (param=0x56084b882690) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588
          #7  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b8c85d0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #8  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #9  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 36 (Thread 0x7f78d81bd700 (LWP 22564)):
          #0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78d81bcdf0, expected=0, futex_word=0x7f78d81bce68) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
          #1  __pthread_cond_wait_common (abstime=0x7f78d81bcdf0, mutex=0x56084b8827f8, cond=0x7f78d81bce40) at pthread_cond_wait.c:539
          #2  __pthread_cond_timedwait (cond=0x7f78d81bce40, mutex=0x56084b8827f8, abstime=0x7f78d81bcdf0) at pthread_cond_wait.c:667
          #3  0x0000560848ae16d9 in safe_cond_timedwait (cond=0x7f78d81bce40, mp=0x56084b8827d0, abstime=0x7f78d81bcdf0, file=0x560848dcaaa0 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1204) at /home/jan/mysql/10.4/mysys/thr_mutex.c:546
          #4  0x000056084852f10e in inline_mysql_cond_timedwait (that=0x7f78d81bce40, mutex=0x56084b8827d0, abstime=0x7f78d81bcdf0, src_file=0x560848dcac68 "/home/jan/mysql/10.4/sql/threadpool_generic.cc", src_line=1280) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1204
          #5  0x00005608485309d1 in get_event (current_thread=0x7f78d81bce20, thread_group=0x56084b8827d0, abstime=0x7f78d81bcdf0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1279
          #6  0x0000560848531680 in worker_main (param=0x56084b8827d0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588
          #7  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b950fd0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #8  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #9  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 35 (Thread 0x7f78d95c4700 (LWP 21036)):
          #0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78d95c3df0, expected=0, futex_word=0x7f78d95c3e68) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
          #1  __pthread_cond_wait_common (abstime=0x7f78d95c3df0, mutex=0x56084b882cf8, cond=0x7f78d95c3e40) at pthread_cond_wait.c:539
          #2  __pthread_cond_timedwait (cond=0x7f78d95c3e40, mutex=0x56084b882cf8, abstime=0x7f78d95c3df0) at pthread_cond_wait.c:667
          #3  0x0000560848ae16d9 in safe_cond_timedwait (cond=0x7f78d95c3e40, mp=0x56084b882cd0, abstime=0x7f78d95c3df0, file=0x560848dcaaa0 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1204) at /home/jan/mysql/10.4/mysys/thr_mutex.c:546
          #4  0x000056084852f10e in inline_mysql_cond_timedwait (that=0x7f78d95c3e40, mutex=0x56084b882cd0, abstime=0x7f78d95c3df0, src_file=0x560848dcac68 "/home/jan/mysql/10.4/sql/threadpool_generic.cc", src_line=1280) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1204
          #5  0x00005608485309d1 in get_event (current_thread=0x7f78d95c3e20, thread_group=0x56084b882cd0, abstime=0x7f78d95c3df0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1279
          #6  0x0000560848531680 in worker_main (param=0x56084b882cd0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588
          #7  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b998230) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #8  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #9  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 34 (Thread 0x7f78d94e3700 (LWP 21098)):
          #0  0x00007f78e8bc2e3f in epoll_wait (epfd=38, events=0x7f78d94dcd20, maxevents=1024, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30
          #1  0x000056084852f338 in io_poll_wait (pollfd=38, native_events=0x7f78d94dcd20, maxevents=1024, timeout_ms=-1) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:331
          #2  0x000056084852fc7f in listener (current_thread=0x7f78d94e2e20, thread_group=0x56084b882f50) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:792
          #3  0x000056084853087f in get_event (current_thread=0x7f78d94e2e20, thread_group=0x56084b882f50, abstime=0x7f78d94e2df0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1237
          #4  0x0000560848531680 in worker_main (param=0x56084b882f50) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588
          #5  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b99f250) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #6  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #7  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 33 (Thread 0x7f7889ffb700 (LWP 20954)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7f7889ffadc8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x7f7889ffae08, cond=0x7f7889ffada0) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x7f7889ffada0, mutex=0x7f7889ffae08) at pthread_cond_wait.c:655
          #3  0x0000560848ae1319 in safe_cond_wait (cond=0x7f7889ffada0, mp=0x7f7889ffade0, file=0x560848dcdd40 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1178) at /home/jan/mysql/10.4/mysys/thr_mutex.c:492
          #4  0x0000560848546968 in inline_mysql_cond_wait (that=0x7f7889ffada0, mutex=0x7f7889ffade0, src_file=0x560848dcf7d0 "/home/jan/mysql/10.4/storage/innobase/handler/ha_innodb.cc", src_line=288) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1178
          #5  0x000056084854ad92 in thd_destructor_proxy () at /home/jan/mysql/10.4/storage/innobase/handler/ha_innodb.cc:288
          #6  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b8300f0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #7  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #8  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 32 (Thread 0x7f78d9579700 (LWP 21037)):
          #0  0x00007f78e8bc2e3f in epoll_wait (epfd=36, events=0x7f78d9572d20, maxevents=1024, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30
          #1  0x000056084852f338 in io_poll_wait (pollfd=36, native_events=0x7f78d9572d20, maxevents=1024, timeout_ms=-1) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:331
          #2  0x000056084852fc7f in listener (current_thread=0x7f78d9578e20, thread_group=0x56084b882cd0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:792
          #3  0x000056084853087f in get_event (current_thread=0x7f78d9578e20, thread_group=0x56084b882cd0, abstime=0x7f78d9578df0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1237
          #4  0x0000560848531680 in worker_main (param=0x56084b882cd0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588
          #5  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b998230) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #6  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #7  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 31 (Thread 0x7f788a7fc700 (LWP 20953)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b61a8c8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b61a878, cond=0x56084b61a8a0) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084b61a8a0, mutex=0x56084b61a878) at pthread_cond_wait.c:655
          #3  0x000056084862f9b6 in os_event::wait (this=0x56084b61a860) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159
          #4  0x000056084862f454 in os_event::wait_low (this=0x56084b61a860, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326
          #5  0x000056084862f7a5 in os_event_wait_low (event=0x56084b61a860, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515
          #6  0x00005608487da816 in buf_resize_thread () at /home/jan/mysql/10.4/storage/innobase/buf/buf0buf.cc:3207
          #7  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #8  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 30 (Thread 0x7f788bfff700 (LWP 20916)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b61a64c) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b61a5f8, cond=0x56084b61a620) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084b61a620, mutex=0x56084b61a5f8) at pthread_cond_wait.c:655
          #3  0x000056084862f9b6 in os_event::wait (this=0x56084b61a5e0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159
          #4  0x000056084862f454 in os_event::wait_low (this=0x56084b61a5e0, reset_sig_count=26) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326
          #5  0x000056084862f7a5 in os_event_wait_low (event=0x56084b61a5e0, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515
          #6  0x00005608487153d2 in srv_resume_thread (slot=0x560849488bf0 <srv_sys+560>, sig_count=0, wait=true, timeout_usec=0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:904
          #7  0x0000560848718e15 in srv_worker_thread (arg=0x0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:2508
          #8  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #9  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 29 (Thread 0x7f78d965a700 (LWP 20991)):
          #0  0x00007f78e8ae9ebc in __GI___sigtimedwait (set=0x7f78d9659e10, info=0x7f78d9659d30, timeout=0x0) at ../sysdeps/unix/sysv/linux/sigtimedwait.c:29
          #1  0x0000560847ebc2e6 in my_sigwait (set=0x7f78d9659e10, sig=0x7f78d9659dd4, code=0x7f78d9659dd8) at /home/jan/mysql/10.4/include/my_pthread.h:198
          #2  0x0000560847ec2a1f in signal_hand (arg=0x0) at /home/jan/mysql/10.4/sql/mysqld.cc:3249
          #3  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b83f6b0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #4  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #5  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 28 (Thread 0x7f788affd700 (LWP 20952)):
          #0  0x00007f78e8ff5440 in __GI___nanosleep (requested_time=0x7f788affc7d0, remaining=0x0) at ../sysdeps/unix/sysv/linux/nanosleep.c:28
          #1  0x000056084862fcb9 in os_thread_sleep (tm=1000000) at /home/jan/mysql/10.4/storage/innobase/os/os0thread.cc:225
          #2  0x00005608487cc042 in btr_defragment_thread () at /home/jan/mysql/10.4/storage/innobase/btr/btr0defragment.cc:707
          #3  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #4  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 27 (Thread 0x7f78baffd700 (LWP 20835)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b6735ec) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b673598, cond=0x56084b6735c0) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084b6735c0, mutex=0x56084b673598) at pthread_cond_wait.c:655
          #3  0x000056084862f9b6 in os_event::wait (this=0x56084b673580) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159
          #4  0x000056084862f454 in os_event::wait_low (this=0x56084b673580, reset_sig_count=6) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326
          #5  0x000056084862f7a5 in os_event_wait_low (event=0x56084b673580, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515
          #6  0x00005608486299fa in os_aio_simulated_handler (global_segment=4, m1=0x7f78baffcca8, m2=0x7f78baffccb0, type=0x7f78baffcce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:7136
          #7  0x0000560848628043 in os_aio_handler (segment=4, m1=0x7f78baffcca8, m2=0x7f78baffccb0, request=0x7f78baffcce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:5573
          #8  0x000056084886d291 in fil_aio_wait (segment=4) at /home/jan/mysql/10.4/storage/innobase/fil/fil0fil.cc:4349
          #9  0x000056084871ac20 in io_handler_thread (arg=0x5608496cae20 <n+32>) at /home/jan/mysql/10.4/storage/innobase/srv/srv0start.cc:325
          #10 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #11 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 26 (Thread 0x7f7898ff9700 (LWP 20915)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b61a548) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b61a4f8, cond=0x56084b61a520) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084b61a520, mutex=0x56084b61a4f8) at pthread_cond_wait.c:655
          #3  0x000056084862f9b6 in os_event::wait (this=0x56084b61a4e0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159
          #4  0x000056084862f454 in os_event::wait_low (this=0x56084b61a4e0, reset_sig_count=39) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326
          #5  0x000056084862f7a5 in os_event_wait_low (event=0x56084b61a4e0, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515
          #6  0x00005608487153d2 in srv_resume_thread (slot=0x560849488b80 <srv_sys+448>, sig_count=0, wait=true, timeout_usec=0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:904
          #7  0x0000560848718e15 in srv_worker_thread (arg=0x0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:2508
          #8  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #9  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 25 (Thread 0x7f78d8208700 (LWP 22560)):
          #0  0x00007f78e8bc2e3f in epoll_wait (epfd=31, events=0x7f78d8201d20, maxevents=1024, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30
          #1  0x000056084852f338 in io_poll_wait (pollfd=31, native_events=0x7f78d8201d20, maxevents=1024, timeout_ms=-1) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:331
          #2  0x000056084852fc7f in listener (current_thread=0x7f78d8207e20, thread_group=0x56084b882690) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:792
          #3  0x000056084853087f in get_event (current_thread=0x7f78d8207e20, thread_group=0x56084b882690, abstime=0x7f78d8207df0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1237
          #4  0x0000560848531680 in worker_main (param=0x56084b882690) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588
          #5  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b8c85d0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #6  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #7  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 24 (Thread 0x7f78997fa700 (LWP 20914)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b61a5c8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b61a578, cond=0x56084b61a5a0) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084b61a5a0, mutex=0x56084b61a578) at pthread_cond_wait.c:655
          #3  0x000056084862f9b6 in os_event::wait (this=0x56084b61a560) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159
          #4  0x000056084862f454 in os_event::wait_low (this=0x56084b61a560, reset_sig_count=27) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326
          #5  0x000056084862f7a5 in os_event_wait_low (event=0x56084b61a560, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515
          #6  0x00005608487153d2 in srv_resume_thread (slot=0x560849488bb8 <srv_sys+504>, sig_count=0, wait=true, timeout_usec=0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:904
          #7  0x0000560848718e15 in srv_worker_thread (arg=0x0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:2508
          #8  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #9  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 23 (Thread 0x7f788b7fe700 (LWP 20951)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b61a7c8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b61a778, cond=0x56084b61a7a0) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084b61a7a0, mutex=0x56084b61a778) at pthread_cond_wait.c:655
          #3  0x000056084862f9b6 in os_event::wait (this=0x56084b61a760) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159
          #4  0x000056084862f454 in os_event::wait_low (this=0x56084b61a760, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326
          #5  0x000056084862f7a5 in os_event_wait_low (event=0x56084b61a760, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515
          #6  0x00005608487f25aa in buf_dump_thread () at /home/jan/mysql/10.4/storage/innobase/buf/buf0dump.cc:833
          #7  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #8  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 22 (Thread 0x7f789affd700 (LWP 20869)):
          #0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f789affce80, expected=0, futex_word=0x56084b7f61dc) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
          #1  __pthread_cond_wait_common (abstime=0x7f789affce80, mutex=0x56084b7f6188, cond=0x56084b7f61b0) at pthread_cond_wait.c:539
          #2  __pthread_cond_timedwait (cond=0x56084b7f61b0, mutex=0x56084b7f6188, abstime=0x7f789affce80) at pthread_cond_wait.c:667
          #3  0x000056084862f2ba in os_event::timed_wait (this=0x56084b7f6170, abstime=0x7f789affce80) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:276
          #4  0x000056084862f5e7 in os_event::wait_time_low (this=0x56084b7f6170, time_in_usec=10000000, reset_sig_count=2) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:398
          #5  0x000056084862f780 in os_event_wait_time_low (event=0x56084b7f6170, time_in_usec=10000000, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:498
          #6  0x00005608488582e6 in dict_stats_thread () at /home/jan/mysql/10.4/storage/innobase/dict/dict0stats_bg.cc:475
          #7  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #8  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 21 (Thread 0x7f78bbfff700 (LWP 20833)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b6734e8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b673498, cond=0x56084b6734c0) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084b6734c0, mutex=0x56084b673498) at pthread_cond_wait.c:655
          #3  0x000056084862f9b6 in os_event::wait (this=0x56084b673480) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159
          #4  0x000056084862f454 in os_event::wait_low (this=0x56084b673480, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326
          #5  0x000056084862f7a5 in os_event_wait_low (event=0x56084b673480, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515
          #6  0x00005608486299fa in os_aio_simulated_handler (global_segment=2, m1=0x7f78bbffeca8, m2=0x7f78bbffecb0, type=0x7f78bbffece0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:7136
          #7  0x0000560848628043 in os_aio_handler (segment=2, m1=0x7f78bbffeca8, m2=0x7f78bbffecb0, request=0x7f78bbffece0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:5573
          #8  0x000056084886d291 in fil_aio_wait (segment=2) at /home/jan/mysql/10.4/storage/innobase/fil/fil0fil.cc:4349
          #9  0x000056084871ac20 in io_handler_thread (arg=0x5608496cae10 <n+16>) at /home/jan/mysql/10.4/storage/innobase/srv/srv0start.cc:325
          #10 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #11 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 20 (Thread 0x7f78d8c59700 (LWP 20832)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b673468) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b673418, cond=0x56084b673440) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084b673440, mutex=0x56084b673418) at pthread_cond_wait.c:655
          #3  0x000056084862f9b6 in os_event::wait (this=0x56084b673400) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159
          #4  0x000056084862f454 in os_event::wait_low (this=0x56084b673400, reset_sig_count=5) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326
          #5  0x000056084862f7a5 in os_event_wait_low (event=0x56084b673400, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515
          #6  0x00005608486299fa in os_aio_simulated_handler (global_segment=1, m1=0x7f78d8c58ca8, m2=0x7f78d8c58cb0, type=0x7f78d8c58ce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:7136
          #7  0x0000560848628043 in os_aio_handler (segment=1, m1=0x7f78d8c58ca8, m2=0x7f78d8c58cb0, request=0x7f78d8c58ce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:5573
          #8  0x000056084886d291 in fil_aio_wait (segment=1) at /home/jan/mysql/10.4/storage/innobase/fil/fil0fil.cc:4349
          #9  0x000056084871ac20 in io_handler_thread (arg=0x5608496cae08 <n+8>) at /home/jan/mysql/10.4/storage/innobase/srv/srv0start.cc:325
          #10 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #11 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 19 (Thread 0x7f78dac5c700 (LWP 20799)):
          #0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78dac5bde0, expected=0, futex_word=0x560849edbaa8 <COND_checkpoint+40>) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
          #1  __pthread_cond_wait_common (abstime=0x7f78dac5bde0, mutex=0x560849edb9e8 <LOCK_checkpoint+40>, cond=0x560849edba80 <COND_checkpoint>) at pthread_cond_wait.c:539
          #2  __pthread_cond_timedwait (cond=0x560849edba80 <COND_checkpoint>, mutex=0x560849edb9e8 <LOCK_checkpoint+40>, abstime=0x7f78dac5bde0) at pthread_cond_wait.c:667
          #3  0x0000560848ae16d9 in safe_cond_timedwait (cond=0x560849edba80 <COND_checkpoint>, mp=0x560849edb9c0 <LOCK_checkpoint>, abstime=0x7f78dac5bde0, file=0x560848f40740 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1204) at /home/jan/mysql/10.4/mysys/thr_mutex.c:546
          #4  0x00005608489477a8 in inline_mysql_cond_timedwait (that=0x560849edba80 <COND_checkpoint>, mutex=0x560849edb9c0 <LOCK_checkpoint>, abstime=0x7f78dac5bde0, src_file=0x560848f40778 "/home/jan/mysql/10.4/storage/maria/ma_servicethread.c", src_line=116) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1204
          #5  0x0000560848947ccd in my_service_thread_sleep (control=0x56084948dc20 <checkpoint_control>, sleep_time=29000000000) at /home/jan/mysql/10.4/storage/maria/ma_servicethread.c:115
          #6  0x000056084893c11d in ma_checkpoint_background (arg=0x1e) at /home/jan/mysql/10.4/storage/maria/ma_checkpoint.c:707
          #7  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b5d2fc0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #8  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #9  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 18 (Thread 0x7f7899ffb700 (LWP 20913)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b61a4cc) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b61a478, cond=0x56084b61a4a0) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084b61a4a0, mutex=0x56084b61a478) at pthread_cond_wait.c:655
          #3  0x000056084862f9b6 in os_event::wait (this=0x56084b61a460) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159
          #4  0x000056084862f454 in os_event::wait_low (this=0x56084b61a460, reset_sig_count=10) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326
          #5  0x000056084862f7a5 in os_event_wait_low (event=0x56084b61a460, reset_sig_count=10) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515
          #6  0x00005608487153d2 in srv_resume_thread (slot=0x560849488b48 <srv_sys+392>, sig_count=10, wait=true, timeout_usec=0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:904
          #7  0x000056084871922a in srv_purge_coordinator_suspend (slot=0x560849488b48 <srv_sys+392>, rseg_history_len=28) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:2637
          #8  0x00005608487194ca in srv_purge_coordinator_thread (arg=0x0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:2714
          #9  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #10 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 17 (Thread 0x7f78d945a700 (LWP 20829)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b6733e8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b673398, cond=0x56084b6733c0) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084b6733c0, mutex=0x56084b673398) at pthread_cond_wait.c:655
          #3  0x000056084862f9b6 in os_event::wait (this=0x56084b673380) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159
          #4  0x000056084862f454 in os_event::wait_low (this=0x56084b673380, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326
          #5  0x000056084862f7a5 in os_event_wait_low (event=0x56084b673380, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515
          #6  0x00005608486299fa in os_aio_simulated_handler (global_segment=0, m1=0x7f78d9459ca8, m2=0x7f78d9459cb0, type=0x7f78d9459ce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:7136
          #7  0x0000560848628043 in os_aio_handler (segment=0, m1=0x7f78d9459ca8, m2=0x7f78d9459cb0, request=0x7f78d9459ce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:5573
          #8  0x000056084886d291 in fil_aio_wait (segment=0) at /home/jan/mysql/10.4/storage/innobase/fil/fil0fil.cc:4349
          #9  0x000056084871ac20 in io_handler_thread (arg=0x5608496cae00 <n>) at /home/jan/mysql/10.4/storage/innobase/srv/srv0start.cc:325
          #10 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #11 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 16 (Thread 0x7f789a7fc700 (LWP 20870)):
          #0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f789a7fbc60, expected=0, futex_word=0x56084b78cd28) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
          #1  __pthread_cond_wait_common (abstime=0x7f789a7fbc60, mutex=0x56084b78ccd8, cond=0x56084b78cd00) at pthread_cond_wait.c:539
          #2  __pthread_cond_timedwait (cond=0x56084b78cd00, mutex=0x56084b78ccd8, abstime=0x7f789a7fbc60) at pthread_cond_wait.c:667
          #3  0x000056084862f2ba in os_event::timed_wait (this=0x56084b78ccc0, abstime=0x7f789a7fbc60) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:276
          #4  0x000056084862f5e7 in os_event::wait_time_low (this=0x56084b78ccc0, time_in_usec=5000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:398
          #5  0x000056084862f780 in os_event_wait_time_low (event=0x56084b78ccc0, time_in_usec=5000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:498
          #6  0x0000560848776185 in ib_wqueue_timedwait (wq=0x56084b78cc10, wait_in_usecs=5000000) at /home/jan/mysql/10.4/storage/innobase/ut/ut0wqueue.cc:161
          #7  0x00005608488b1f6d in fts_optimize_thread (arg=0x56084b78cc10) at /home/jan/mysql/10.4/storage/innobase/fts/fts0opt.cc:2837
          #8  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #9  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 15 (Thread 0x7f78b97fa700 (LWP 20912)):
          #0  0x00007f78e8ff5440 in __GI___nanosleep (requested_time=0x7f78b97f9e60, remaining=0x0) at ../sysdeps/unix/sysv/linux/nanosleep.c:28
          #1  0x000056084862fcb9 in os_thread_sleep (tm=1000000) at /home/jan/mysql/10.4/storage/innobase/os/os0thread.cc:225
          #2  0x0000560848718794 in srv_master_sleep () at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:2334
          #3  0x00005608487188d2 in srv_master_thread (arg=0x0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:2375
          #4  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #5  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 14 (Thread 0x7f78e8aa0740 (LWP 20738)):
          #0  0x00007f78e8bb6729 in __GI___poll (fds=0x7ffcf2f2e140, nfds=2, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
          #1  0x0000560847ec8cb5 in handle_connections_sockets () at /home/jan/mysql/10.4/sql/mysqld.cc:6457
          #2  0x0000560847ec7f3e in mysqld_main (argc=164, argv=0x56084b356330) at /home/jan/mysql/10.4/sql/mysqld.cc:5893
          #3  0x0000560847ebc285 in main (argc=25, argv=0x7ffcf2f2e448) at /home/jan/mysql/10.4/sql/main.cc:25
           
          Thread 13 (Thread 0x7f789b7fe700 (LWP 20868)):
          #0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f789b7fde40, expected=0, futex_word=0x56084b61a748) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
          #1  __pthread_cond_wait_common (abstime=0x7f789b7fde40, mutex=0x56084b61a6f8, cond=0x56084b61a720) at pthread_cond_wait.c:539
          #2  __pthread_cond_timedwait (cond=0x56084b61a720, mutex=0x56084b61a6f8, abstime=0x7f789b7fde40) at pthread_cond_wait.c:667
          #3  0x000056084862f2ba in os_event::timed_wait (this=0x56084b61a6e0, abstime=0x7f789b7fde40) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:276
          #4  0x000056084862f5e7 in os_event::wait_time_low (this=0x56084b61a6e0, time_in_usec=5000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:398
          #5  0x000056084862f780 in os_event_wait_time_low (event=0x56084b61a6e0, time_in_usec=5000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:498
          #6  0x0000560848717138 in srv_monitor_thread () at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:1681
          #7  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #8  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 12 (Thread 0x7f78e007a700 (LWP 20782)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7f78e2e970e0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x7f78e2e97090, cond=0x7f78e2e970b8) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x7f78e2e970b8, mutex=0x7f78e2e97090) at pthread_cond_wait.c:655
          #3  0x00007f78e3b4f88a in fifo_lock_get (q=0x7f78e2e97010) at galerautils/src/gu_fifo.c:262
          #4  0x00007f78e3b4fad3 in gu_fifo_get_head (q=0x7f78e2e97010, err=0x7f78e00790dc) at galerautils/src/gu_fifo.c:330
          #5  0x00007f78e3cbbdff in gcs_recv (conn=0x56084b4da930, action=0x7f78e0079180) at gcs/src/gcs.cpp:2024
          #6  0x00007f78e3d32c05 in galera::Gcs::recv (this=0x56084b4d1b28, act=...) at galera/src/galera_gcs.hpp:120
          #7  0x00007f78e3d01f69 in galera::GcsActionSource::process (this=0x56084b503110, recv_ctx=0x7f78e00795f0, exit_loop=@0x7f78e007936a: false) at galera/src/gcs_action_source.cpp:161
          #8  0x00007f78e3d20778 in galera::ReplicatorSMM::async_recv (this=0x56084b4d1360, recv_ctx=0x7f78e00795f0) at galera/src/replicator_smm.cpp:383
          #9  0x00007f78e3d4f7bf in galera_recv (gh=0x56084b49be30, recv_ctx=0x7f78e00795f0) at galera/src/wsrep_provider.cpp:236
          #10 0x0000560848ba56f4 in wsrep::wsrep_provider_v26::run_applier (this=0x56084b3559c0, applier_ctx=0x7f78e00795f0) at /home/jan/mysql/10.4/wsrep-lib/src/wsrep_provider_v26.cpp:690
          #11 0x00005608482502a6 in wsrep_replication_process (thd=0x7f78c4000d60, arg=0x0) at /home/jan/mysql/10.4/sql/wsrep_thd.cc:61
          #12 0x0000560848241c80 in start_wsrep_THD (arg=0x56084b52aef0) at /home/jan/mysql/10.4/sql/wsrep_mysqld.cc:2668
          #13 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #14 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 11 (Thread 0x7f78e2d95700 (LWP 20749)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b4d1bb4) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b4d1b50, cond=0x56084b4d1b88) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084b4d1b88, mutex=0x56084b4d1b50) at pthread_cond_wait.c:655
          #3  0x00007f78e3b5c608 in gu::Lock::wait (this=0x7f78e2d94cf0, cond=...) at galerautils/src/gu_lock.hpp:45
          #4  0x00007f78e3cfd79a in galera::ServiceThd::thd_func (arg=0x56084b4d1b38) at galera/src/galera_service_thd.cpp:30
          #5  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #6  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 10 (Thread 0x7f78e4655700 (LWP 20744)):
          #0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78e4654e90, expected=0, futex_word=0x560849eee1e8 <COND_timer+40>) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
          #1  __pthread_cond_wait_common (abstime=0x7f78e4654e90, mutex=0x560849eee128 <LOCK_timer+40>, cond=0x560849eee1c0 <COND_timer>) at pthread_cond_wait.c:539
          #2  __pthread_cond_timedwait (cond=0x560849eee1c0 <COND_timer>, mutex=0x560849eee128 <LOCK_timer+40>, abstime=0x7f78e4654e90) at pthread_cond_wait.c:667
          #3  0x0000560848ae16d9 in safe_cond_timedwait (cond=0x560849eee1c0 <COND_timer>, mp=0x560849eee100 <LOCK_timer>, abstime=0x7f78e4654e90, file=0x560848f84f80 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1204) at /home/jan/mysql/10.4/mysys/thr_mutex.c:546
          #4  0x0000560848ae26a0 in inline_mysql_cond_timedwait (that=0x560849eee1c0 <COND_timer>, mutex=0x560849eee100 <LOCK_timer>, abstime=0x7f78e4654e90, src_file=0x560848f84fb8 "/home/jan/mysql/10.4/mysys/thr_timer.c", src_line=292) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1204
          #5  0x0000560848ae3205 in timer_handler (arg=0x0) at /home/jan/mysql/10.4/mysys/thr_timer.c:292
          #6  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b49b240) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #7  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #8  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 9 (Thread 0x7f78e00c5700 (LWP 20775)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7f78d0015cd0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x7f78d0015c20, cond=0x7f78d0015ca8) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x7f78d0015ca8, mutex=0x7f78d0015c20) at pthread_cond_wait.c:655
          #3  0x0000560848ae1319 in safe_cond_wait (cond=0x7f78d0015ca8, mp=0x7f78d0015bf8, file=0x560848c62f20 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1178) at /home/jan/mysql/10.4/mysys/thr_mutex.c:492
          #4  0x000056084824fda4 in inline_mysql_cond_wait (that=0x7f78d0015ca8, mutex=0x7f78d0015bf8, src_file=0x560848c632b8 "/home/jan/mysql/10.4/sql/wsrep_thd.h", src_line=69) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1178
          #5  0x0000560848252df1 in Wsrep_thd_queue::pop_front (this=0x7f78d0015ba0) at /home/jan/mysql/10.4/sql/wsrep_thd.h:69
          #6  0x0000560848251741 in wsrep_post_rollback_process (post_rollbacker=0x7f78d0001fb0, arg=0x0) at /home/jan/mysql/10.4/sql/wsrep_thd.cc:288
          #7  0x0000560848241c80 in start_wsrep_THD (arg=0x56084b521de0) at /home/jan/mysql/10.4/sql/wsrep_mysqld.cc:2668
          #8  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #9  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 8 (Thread 0x7f78dbfff700 (LWP 20767)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b511fe8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b511f88, cond=0x56084b511fc0) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084b511fc0, mutex=0x56084b511f88) at pthread_cond_wait.c:655
          #3  0x00007f78e3b5c608 in gu::Lock::wait (this=0x7f78dbffea90, cond=...) at galerautils/src/gu_lock.hpp:45
          #4  0x00007f78e3cc2902 in RecvBuf::front (this=0x56084b511f88, timeout=...) at gcs/src/gcs_gcomm.cpp:124
          #5  0x00007f78e3cbf769 in gcomm_recv (backend=0x56084b4dad58, msg=0x56084b4dac10, timeout=9223372035999999999) at gcs/src/gcs_gcomm.cpp:673
          #6  0x00007f78e3cb0018 in core_msg_recv (backend=0x56084b4dad58, recv_msg=0x56084b4dac10, timeout=9223372035999999999) at gcs/src/gcs_core.cpp:480
          #7  0x00007f78e3cb24d9 in gcs_core_recv (conn=0x56084b4dabb0, recv_act=0x7f78dbffee60, timeout=9223372035999999999) at gcs/src/gcs_core.cpp:1184
          #8  0x00007f78e3cb99f3 in gcs_recv_thread (arg=0x56084b4da930) at gcs/src/gcs.cpp:1398
          #9  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #10 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 7 (Thread 0x7f78b9ffb700 (LWP 20837)):
          #0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78b9ffabf0, expected=0, futex_word=0x56084b61a84c) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
          #1  __pthread_cond_wait_common (abstime=0x7f78b9ffabf0, mutex=0x56084b61a7f8, cond=0x56084b61a820) at pthread_cond_wait.c:539
          #2  __pthread_cond_timedwait (cond=0x56084b61a820, mutex=0x56084b61a7f8, abstime=0x7f78b9ffabf0) at pthread_cond_wait.c:667
          #3  0x000056084862f2ba in os_event::timed_wait (this=0x56084b61a7e0, abstime=0x7f78b9ffabf0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:276
          #4  0x000056084862f5e7 in os_event::wait_time_low (this=0x56084b61a7e0, time_in_usec=1000000, reset_sig_count=2) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:398
          #5  0x000056084862f780 in os_event_wait_time_low (event=0x56084b61a7e0, time_in_usec=1000000, reset_sig_count=2) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:498
          #6  0x00005608487fc3e8 in pc_sleep_if_needed (next_loop_time=1563172288561, sig_count=2, cur_time=1563172287561) at /home/jan/mysql/10.4/storage/innobase/buf/buf0flu.cc:2640
          #7  0x00005608487fd352 in buf_flush_page_cleaner_coordinator () at /home/jan/mysql/10.4/storage/innobase/buf/buf0flu.cc:3099
          #8  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #9  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 6 (Thread 0x7f78d8127700 (LWP 22834)):
          #0  futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78d8126df0, expected=0, futex_word=0x7f78d8126e68) at ../sysdeps/unix/sysv/linux/futex-internal.h:205
          #1  __pthread_cond_wait_common (abstime=0x7f78d8126df0, mutex=0x56084b882938, cond=0x7f78d8126e40) at pthread_cond_wait.c:539
          #2  __pthread_cond_timedwait (cond=0x7f78d8126e40, mutex=0x56084b882938, abstime=0x7f78d8126df0) at pthread_cond_wait.c:667
          #3  0x0000560848ae16d9 in safe_cond_timedwait (cond=0x7f78d8126e40, mp=0x56084b882910, abstime=0x7f78d8126df0, file=0x560848dcaaa0 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1204) at /home/jan/mysql/10.4/mysys/thr_mutex.c:546
          #4  0x000056084852f10e in inline_mysql_cond_timedwait (that=0x7f78d8126e40, mutex=0x56084b882910, abstime=0x7f78d8126df0, src_file=0x560848dcac68 "/home/jan/mysql/10.4/sql/threadpool_generic.cc", src_line=1280) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1204
          #5  0x00005608485309d1 in get_event (current_thread=0x7f78d8126e20, thread_group=0x56084b882910, abstime=0x7f78d8126df0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1279
          #6  0x0000560848531680 in worker_main (param=0x56084b882910) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588
          #7  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b960ee0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #8  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #9  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 5 (Thread 0x7f78ba7fc700 (LWP 20836)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b67366c) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b673618, cond=0x56084b673640) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084b673640, mutex=0x56084b673618) at pthread_cond_wait.c:655
          #3  0x000056084862f9b6 in os_event::wait (this=0x56084b673600) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159
          #4  0x000056084862f454 in os_event::wait_low (this=0x56084b673600, reset_sig_count=6) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326
          #5  0x000056084862f7a5 in os_event_wait_low (event=0x56084b673600, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515
          #6  0x00005608486299fa in os_aio_simulated_handler (global_segment=5, m1=0x7f78ba7fbca8, m2=0x7f78ba7fbcb0, type=0x7f78ba7fbce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:7136
          #7  0x0000560848628043 in os_aio_handler (segment=5, m1=0x7f78ba7fbca8, m2=0x7f78ba7fbcb0, request=0x7f78ba7fbce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:5573
          #8  0x000056084886d291 in fil_aio_wait (segment=5) at /home/jan/mysql/10.4/storage/innobase/fil/fil0fil.cc:4349
          #9  0x000056084871ac20 in io_handler_thread (arg=0x5608496cae28 <n+40>) at /home/jan/mysql/10.4/storage/innobase/srv/srv0start.cc:325
          #10 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #11 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 4 (Thread 0x7f78d8172700 (LWP 22565)):
          #0  0x00007f78e8bc2e3f in epoll_wait (epfd=32, events=0x7f78d816bd20, maxevents=1024, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30
          #1  0x000056084852f338 in io_poll_wait (pollfd=32, native_events=0x7f78d816bd20, maxevents=1024, timeout_ms=-1) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:331
          #2  0x000056084852fc7f in listener (current_thread=0x7f78d8171e20, thread_group=0x56084b8827d0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:792
          #3  0x000056084853087f in get_event (current_thread=0x7f78d8171e20, thread_group=0x56084b8827d0, abstime=0x7f78d8171df0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1237
          #4  0x0000560848531680 in worker_main (param=0x56084b8827d0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588
          #5  0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b950fd0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #6  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #7  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 3 (Thread 0x7f78bb7fe700 (LWP 20834)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b673568) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b673518, cond=0x56084b673540) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x56084b673540, mutex=0x56084b673518) at pthread_cond_wait.c:655
          #3  0x000056084862f9b6 in os_event::wait (this=0x56084b673500) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159
          #4  0x000056084862f454 in os_event::wait_low (this=0x56084b673500, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326
          #5  0x000056084862f7a5 in os_event_wait_low (event=0x56084b673500, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515
          #6  0x00005608486299fa in os_aio_simulated_handler (global_segment=3, m1=0x7f78bb7fdca8, m2=0x7f78bb7fdcb0, type=0x7f78bb7fdce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:7136
          #7  0x0000560848628043 in os_aio_handler (segment=3, m1=0x7f78bb7fdca8, m2=0x7f78bb7fdcb0, request=0x7f78bb7fdce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:5573
          #8  0x000056084886d291 in fil_aio_wait (segment=3) at /home/jan/mysql/10.4/storage/innobase/fil/fil0fil.cc:4349
          #9  0x000056084871ac20 in io_handler_thread (arg=0x5608496cae18 <n+24>) at /home/jan/mysql/10.4/storage/innobase/srv/srv0start.cc:325
          #10 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #11 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 2 (Thread 0x7f78e0110700 (LWP 20772)):
          #0  futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7f78c80077a0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88
          #1  __pthread_cond_wait_common (abstime=0x0, mutex=0x7f78c80076f0, cond=0x7f78c8007778) at pthread_cond_wait.c:502
          #2  __pthread_cond_wait (cond=0x7f78c8007778, mutex=0x7f78c80076f0) at pthread_cond_wait.c:655
          #3  0x0000560848ae1319 in safe_cond_wait (cond=0x7f78c8007778, mp=0x7f78c80076c8, file=0x560848c62f20 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1178) at /home/jan/mysql/10.4/mysys/thr_mutex.c:492
          #4  0x000056084824fda4 in inline_mysql_cond_wait (that=0x7f78c8007778, mutex=0x7f78c80076c8, src_file=0x560848c632b8 "/home/jan/mysql/10.4/sql/wsrep_thd.h", src_line=69) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1178
          #5  0x0000560848252df1 in Wsrep_thd_queue::pop_front (this=0x7f78c8007670) at /home/jan/mysql/10.4/sql/wsrep_thd.h:69
          #6  0x0000560848250959 in wsrep_rollback_process (rollbacker=0x7f78c8000d60, arg=0x0) at /home/jan/mysql/10.4/sql/wsrep_thd.cc:145
          #7  0x0000560848241c80 in start_wsrep_THD (arg=0x56084b511b20) at /home/jan/mysql/10.4/sql/wsrep_mysqld.cc:2668
          #8  0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #9  0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Thread 1 (Thread 0x7f78d80dc700 (LWP 22835)):
          #0  __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:56
          #1  0x0000560848adbbf7 in my_write_core (sig=6) at /home/jan/mysql/10.4/mysys/stacktrace.c:481
          #2  0x000056084832609e in handle_fatal_signal (sig=6) at /home/jan/mysql/10.4/sql/signal_handler.cc:343
          #3  <signal handler called>
          #4  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
          #5  0x00007f78e8aca535 in __GI_abort () at abort.c:79
          #6  0x00007f78e8aca40f in __assert_fail_base (fmt=0x7f78e8c58588 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=0x5608490e24b1 "state_ == s_exec", file=0x5608490e1f68 "/home/jan/mysql/10.4/wsrep-lib/src/client_state.cpp", line=308, function=<optimized out>) at assert.c:92
          #7  0x00007f78e8ada012 in __GI___assert_fail (assertion=0x5608490e24b1 "state_ == s_exec", file=0x5608490e1f68 "/home/jan/mysql/10.4/wsrep-lib/src/client_state.cpp", line=308, function=0x5608490e2b20 <wsrep::client_state::enter_toi(std::vector<wsrep::key, std::allocator<wsrep::key> > const&, wsrep::const_buffer const&, int)::__PRETTY_FUNCTION__> "int wsrep::client_state::enter_toi(const key_array&, const wsrep::const_buffer&, int)") at assert.c:101
          #8  0x0000560848b898db in wsrep::client_state::enter_toi (this=0x7f783c0070a8, keys=std::vector of length 1, capacity 1 = {...}, buffer=..., flags=3) at /home/jan/mysql/10.4/wsrep-lib/src/client_state.cpp:308
          #9  0x000056084823dd30 in wsrep_TOI_begin (thd=0x7f783c000f30, db=0x7f783c013d40 "test", table=0x7f783c013660 "t", table_list=0x0, alter_info=0x0) at /home/jan/mysql/10.4/sql/wsrep_mysqld.cc:1853
          #10 0x000056084823eac7 in wsrep_to_isolation_begin (thd=0x7f783c000f30, db_=0x7f783c013d40 "test", table_=0x7f783c013660 "t", table_list=0x0, alter_info=0x0) at /home/jan/mysql/10.4/sql/wsrep_mysqld.cc:2005
          #11 0x00005608480e1a49 in Sql_cmd_create_table_like::execute (this=0x7f783c013638, thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/sql_table.cc:11359
          #12 0x0000560847ffe116 in mysql_execute_command (thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/sql_parse.cc:6082
          #13 0x000056084800334b in mysql_parse (thd=0x7f783c000f30, rawbuf=0x7f783c0135a8 "create table t(a int)", length=21, parser_state=0x7f78d80db070, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.4/sql/sql_parse.cc:7892
          #14 0x00005608480029c7 in wsrep_mysql_parse (thd=0x7f783c000f30, rawbuf=0x7f783c0135a8 "create table t(a int)", length=21, parser_state=0x7f78d80db070, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.4/sql/sql_parse.cc:7704
          #15 0x0000560847fef5b9 in dispatch_command (command=COM_QUERY, thd=0x7f783c000f30, packet=0x7f783c008891 "create table t(a int)", packet_length=21, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.4/sql/sql_parse.cc:1811
          #16 0x0000560847feded9 in do_command (thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/sql_parse.cc:1359
          #17 0x00005608482e18ad in threadpool_process_request (thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/threadpool_common.cc:359
          #18 0x00005608482e143d in tp_callback (c=0x56084b8c8cd0) at /home/jan/mysql/10.4/sql/threadpool_common.cc:186
          #19 0x00005608485316be in worker_main (param=0x56084b882910) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1592
          #20 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b960ee0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862
          #21 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486
          #22 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
           
          Compressed file /home/jan/mysql/10.4/mysql-test/var/5/log/galera.galera_mdev_13787-innodb/mysqld.1/data/core
           - saving '/home/jan/mysql/10.4/mysql-test/var/5/log/galera.galera_mdev_13787-innodb/' to '/home/jan/mysql/10.4/mysql-test/var/log/galera.galera_mdev_13787-innodb/'
          

          jplindst Jan Lindström (Inactive) added a comment - - edited Branch: 10.4 commit a0230bc76d78202178f43d2f4f6a7e3322c19a16 Build: Debug Galera library: galera-4 with debug build How to repeat: ./mtr - suite=galera --mysqld= -thread-handling=pool-of-threads --force --parallel=auto galera.galera_mdev_13787 'innodb' w5 [ fail ] Test ended at 2019-07-15 09:31:28   CURRENT_TEST: galera.galera_mdev_13787 mysqltest: At line 4: query 'create table t(a int)' failed: 2013: Lost connection to MySQL server during query   The result from queries just before the failure was: connection node_2; connection node_1; connection node_1; create table t(a int);     Server [mysqld.1 - pid: 20734, winpid: 20734, exit: 256] failed during test run Server log from this test: ----------SERVER LOG START----------- 2019-07-15 9:31:19 0 [Warning] WSREP: option --wsrep-causal-reads is deprecated 2019-07-15 9:31:19 0 [Note] /home/jan/mysql/10.4/sql/mysqld (mysqld 10.4.7-MariaDB-debug-log) starting as process 20738 ... 2019-07-15 9:31:19 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4182) 2019-07-15 9:31:19 0 [Warning] Changed limits: max_open_files: 1024 max_connections: 151 (was 151) table_cache: 421 (was 2000) 2019-07-15 9:31:19 0 [Warning] WSREP: wsrep_sst_receive_address is set to '127.0.0.1:16084' which makes it impossible for another host to reach this one. Please set it to the address which this node can be connected at by other cluster members. 2019-07-15 9:31:19 0 [Note] WSREP: Loading provider /usr/lib/libgalera_4d_smm.so initial position: 00000000-0000-0000-0000-000000000000:-1 wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_4d_smm.so' wsrep loader: [INFO] wsrep_load(): Galera 26.4.2(r4498) by Codership Oy <info@codership.com> loaded successfully. 2019-07-15 9:31:19 0 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-07-15 9:31:19 0 [Warning] WSREP: Could not open state file for reading: '/home/jan/mysql/10.4/mysql-test/var/5/mysqld.1/data//grastate.dat' 2019-07-15 9:31:19 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1 2019-07-15 9:31:19 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 0 UUID: 00000000-0000-0000-0000-000000000000 Seqno: -1 - -1 Offset: -1 Synced: 0 2019-07-15 9:31:19 0 [Note] WSREP: Skipped GCache ring buffer recovery: could not determine history UUID. 2019-07-15 9:31:19 0 [Note] WSREP: Passing config to GCS: base_dir = /home/jan/mysql/10.4/mysql-test/var/5/mysqld.1/data/; base_host = 127.0.0.1; base_port = 16082; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT30S; evs.install_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT10S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /home/jan/mysql/10.4/mysql-test/var/5/mysqld.1/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 10M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.r 2019-07-15 9:31:19 0 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0 -> 00000000-0000-0000-0000-000000000000:-1 2019-07-15 9:31:19 0 [Note] WSREP: Start replication 2019-07-15 9:31:19 0 [Note] WSREP: Connecting with bootstrap option: 1 2019-07-15 9:31:19 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1 2019-07-15 9:31:19 0 [Note] WSREP: protonet asio version 0 2019-07-15 9:31:19 0 [Note] WSREP: Using CRC-32C for message checksums. 2019-07-15 9:31:19 0 [Note] WSREP: backend: asio 2019-07-15 9:31:19 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-07-15 9:31:19 0 [Warning] WSREP: access file(/home/jan/mysql/10.4/mysql-test/var/5/mysqld.1/data//gvwstate.dat) failed(No such file or directory) 2019-07-15 9:31:19 0 [Note] WSREP: restore pc from disk failed 2019-07-15 9:31:19 0 [Note] WSREP: GMCast version 0 2019-07-15 9:31:19 0 [Note] WSREP: (2826cfab, 'tcp://0.0.0.0:16082') listening at tcp://0.0.0.0:16082 2019-07-15 9:31:19 0 [Note] WSREP: (2826cfab, 'tcp://0.0.0.0:16082') multicast: , ttl: 1 2019-07-15 9:31:19 0 [Note] WSREP: EVS version 1 2019-07-15 9:31:19 0 [Note] WSREP: gcomm: bootstrapping new group 'my_wsrep_cluster' 2019-07-15 9:31:19 0 [Note] WSREP: start_prim is enabled, turn off pc_recovery 2019-07-15 9:31:19 0 [Note] WSREP: EVS version upgrade 0 -> 1 2019-07-15 9:31:19 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2019-07-15 9:31:19 0 [Note] WSREP: Node 2826cfab state prim 2019-07-15 9:31:19 0 [Note] WSREP: view(view_id(PRIM,2826cfab,1) memb { 2826cfab,0 } joined { } left { } partitioned { }) 2019-07-15 9:31:19 0 [Note] WSREP: save pc into disk 2019-07-15 9:31:19 0 [Note] WSREP: gcomm: connected 2019-07-15 9:31:19 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-07-15 9:31:19 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-07-15 9:31:19 0 [Note] WSREP: Opened channel 'my_wsrep_cluster' 2019-07-15 9:31:19 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 2019-07-15 9:31:19 0 [Note] WSREP: Starting new group from scratch: 2827f56e-a6ca-11e9-8716-53a41869b333 2019-07-15 9:31:19 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 2827fb28-a6ca-11e9-9f14-2a17664a1654 2019-07-15 9:31:19 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 2827fb28-a6ca-11e9-9f14-2a17664a1654 2019-07-15 9:31:19 0 [Note] WSREP: STATE EXCHANGE: got state msg: 2827fb28-a6ca-11e9-9f14-2a17664a1654 from 0 (jan-HP-ZBook-15u-G5) 2019-07-15 9:31:19 0 [Note] WSREP: Quorum results: version = 5, component = PRIMARY, conf_id = 0, members = 1/1 (joined/total), act_id = 0, last_appl. = -1, protocols = 1/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 2827f56e-a6ca-11e9-8716-53a41869b333 2019-07-15 9:31:19 0 [Note] WSREP: Writing down CC checksum: 1aeaf9a0 90789d8d f2b791a0 271916ac at offset 144 2019-07-15 9:31:19 0 [Note] WSREP: Flow-control interval: [16, 16] 2019-07-15 9:31:19 1 [Note] WSREP: Starting post rollbacker thread 1 2019-07-15 9:31:19 0 [Note] WSREP: Trying to continue unpaused monitor 2019-07-15 9:31:19 0 [Note] WSREP: Restored state OPEN -> JOINED (1) 2019-07-15 9:31:19 0 [Note] WSREP: Member 0.0 (jan-HP-ZBook-15u-G5) synced with group. 2019-07-15 9:31:19 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 1) 2019-07-15 9:31:19 3 [Note] WSREP: Starting rollbacker thread 3 2019-07-15 9:31:19 2 [Note] WSREP: Starting applier thread 2 2019-07-15 9:31:19 2 [Note] WSREP: ####### processing CC 1, local, ordered 2019-07-15 9:31:19 2 [Note] WSREP: ####### drain monitors upto -1 2019-07-15 9:31:19 2 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-07-15 9:31:19 2 [Note] WSREP: ####### My UUID: 2826cfab-a6ca-11e9-9c26-df6a14e88650 2019-07-15 9:31:19 2 [Note] WSREP: Server jan-HP-ZBook-15u-G5 connected to cluster at position 2827f56e-a6ca-11e9-8716-53a41869b333:1 with ID 2826cfab-a6ca-11e9-9c26-df6a14e88650 2019-07-15 9:31:19 2 [Note] WSREP: Server status change disconnected -> connected 2019-07-15 9:31:19 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-15 9:31:19 2 [Note] WSREP: ####### ST not required 2019-07-15 9:31:19 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:0 (proto: 10), state transfer needed: no 2019-07-15 9:31:19 0 [Note] WSREP: Service thread queue flushed. 2019-07-15 9:31:19 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:0, protocol version: 5 2019-07-15 9:31:19 2 [Note] WSREP: ####### Adjusting cert position: 0 -> 1 2019-07-15 9:31:19 0 [Note] WSREP: Service thread queue flushed. 2019-07-15 9:31:19 2 [Note] WSREP: ####### Setting monitor position to 1 2019-07-15 9:31:19 2 [Note] WSREP: Lowest cert indnex boundary for CC from group: 1 2019-07-15 9:31:19 2 [Note] WSREP: Min available from gcache for CC from group: 1 2019-07-15 9:31:19 2 [Note] WSREP: ================================================ View: id: 2827f56e-a6ca-11e9-8716-53a41869b333:1 status: primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: no own_index: 0 members(1): 0: 2826cfab-a6ca-11e9-9c26-df6a14e88650, jan-HP-ZBook-15u-G5 ================================================= 2019-07-15 9:31:19 2 [Note] WSREP: Server status change connected -> joiner 2019-07-15 9:31:19 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-15 9:31:19 2 [Note] WSREP: Server status change joiner -> initializing 2019-07-15 9:31:19 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-15 9:31:19 0 [Note] Plugin 'partition' is disabled. 2019-07-15 9:31:19 0 [Note] Plugin 'SEQUENCE' is disabled. 2019-07-15 9:31:19 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!! 2019-07-15 9:31:19 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-07-15 9:31:19 0 [Note] InnoDB: Uses event mutexes 2019-07-15 9:31:19 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 2019-07-15 9:31:19 0 [Note] InnoDB: Number of pools: 1 2019-07-15 9:31:19 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-07-15 9:31:19 0 [Note] mysqld: O_TMPFILE is not supported on /home/jan/mysql/10.4/mysql-test/var/tmp/5/mysqld.1 (disabling future attempts) 2019-07-15 9:31:19 0 [Note] InnoDB: Initializing buffer pool, total size = 8M, instances = 1, chunk size = 8M 2019-07-15 9:31:19 0 [Note] InnoDB: Completed initialization of buffer pool 2019-07-15 9:31:19 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-07-15 9:31:20 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-07-15 9:31:20 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-07-15 9:31:20 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-07-15 9:31:20 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2019-07-15 9:31:20 0 [Note] InnoDB: Waiting for purge to start 2019-07-15 9:31:20 0 [Note] InnoDB: 10.4.7 started; log sequence number 151269; transaction id 34 2019-07-15 9:31:20 0 [Note] InnoDB: Loading buffer pool(s) from /home/jan/mysql/10.4/mysql-test/var/5/mysqld.1/data/ib_buffer_pool 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_MUTEXES' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_CMP' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled. 2019-07-15 9:31:20 0 [Note] InnoDB: Buffer pool(s) load completed at 190715 9:31:20 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'FEEDBACK' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'user_variables' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled. 2019-07-15 9:31:20 0 [Note] Plugin 'unix_socket' is disabled. 2019-07-15 9:31:20 0 [Warning] /home/jan/mysql/10.4/sql/mysqld: unknown option '--loose-pam-debug' 2019-07-15 9:31:20 0 [Warning] /home/jan/mysql/10.4/sql/mysqld: unknown option '--loose-aria' 2019-07-15 9:31:20 0 [Note] Server socket created on IP: '127.0.0.1'. 2019-07-15 9:31:20 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2019-07-15 9:31:20 0 [Note] WSREP: Server initialized 2019-07-15 9:31:20 0 [Note] WSREP: Server status change initializing -> initialized 2019-07-15 9:31:20 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-15 9:31:20 2 [Note] WSREP: Bootstrapping a new cluster, setting initial position to 00000000-0000-0000-0000-000000000000:-1 2019-07-15 9:31:20 10 [Note] WSREP: Cluster table is empty, not recovering transactions 2019-07-15 9:31:20 2 [Note] WSREP: Server status change initialized -> joined 2019-07-15 9:31:20 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-15 9:31:20 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-15 9:31:20 0 [Note] Reading of all Master_info entries succeeded 2019-07-15 9:31:20 0 [Note] Added new Master_info '' to hash table 2019-07-15 9:31:20 0 [Note] /home/jan/mysql/10.4/sql/mysqld: ready for connections. Version: '10.4.7-MariaDB-debug-log' socket: '/home/jan/mysql/10.4/mysql-test/var/tmp/5/mysqld.1.sock' port: 16080 Source distribution 2019-07-15 9:31:20 2 [Note] WSREP: Server jan-HP-ZBook-15u-G5 synced with group 2019-07-15 9:31:20 2 [Note] WSREP: Server status change joined -> synced 2019-07-15 9:31:20 2 [Note] WSREP: Synchronized with group, ready for connections 2019-07-15 9:31:20 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-15 9:31:20 0 [Note] WSREP: (2826cfab, 'tcp://0.0.0.0:16082') connection established to 28a291e5 tcp://127.0.0.1:16085 2019-07-15 9:31:20 0 [Note] WSREP: (2826cfab, 'tcp://0.0.0.0:16082') turning message relay requesting on, nonlive peers: 2019-07-15 9:31:21 0 [Note] WSREP: declaring 28a291e5 at tcp://127.0.0.1:16085 stable 2019-07-15 9:31:21 0 [Note] WSREP: Node 2826cfab state prim 2019-07-15 9:31:21 0 [Note] WSREP: view(view_id(PRIM,2826cfab,2) memb { 2826cfab,0 28a291e5,0 } joined { } left { } partitioned { }) 2019-07-15 9:31:21 0 [Note] WSREP: save pc into disk 2019-07-15 9:31:21 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2019-07-15 9:31:21 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 28f0b930-a6ca-11e9-9407-763ff24ccbd8 2019-07-15 9:31:21 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 28f0b930-a6ca-11e9-9407-763ff24ccbd8 2019-07-15 9:31:21 0 [Note] WSREP: STATE EXCHANGE: got state msg: 28f0b930-a6ca-11e9-9407-763ff24ccbd8 from 0 (jan-HP-ZBook-15u-G5) 2019-07-15 9:31:21 0 [Note] WSREP: STATE EXCHANGE: got state msg: 28f0b930-a6ca-11e9-9407-763ff24ccbd8 from 1 (jan-HP-ZBook-15u-G5) 2019-07-15 9:31:21 0 [Note] WSREP: Quorum results: version = 5, component = PRIMARY, conf_id = 1, members = 1/2 (joined/total), act_id = 1, last_appl. = 0, protocols = 1/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 2827f56e-a6ca-11e9-8716-53a41869b333 2019-07-15 9:31:21 0 [Note] WSREP: Writing down CC checksum: 322d56e4 2b222494 662e7fc5 d676fa8f at offset 224 2019-07-15 9:31:21 0 [Note] WSREP: Flow-control interval: [23, 23] 2019-07-15 9:31:21 0 [Note] WSREP: Trying to continue unpaused monitor 2019-07-15 9:31:21 2 [Note] WSREP: ####### processing CC 2, local, ordered 2019-07-15 9:31:21 2 [Note] WSREP: ####### drain monitors upto 1 2019-07-15 9:31:21 2 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-07-15 9:31:21 2 [Note] WSREP: ####### My UUID: 2826cfab-a6ca-11e9-9c26-df6a14e88650 2019-07-15 9:31:21 2 [Note] WSREP: ####### ST not required 2019-07-15 9:31:21 2 [Note] WSREP: Skipping cert index reset 2019-07-15 9:31:21 2 [Note] WSREP: ####### Adjusting cert position: 1 -> 2 2019-07-15 9:31:21 0 [Note] WSREP: Service thread queue flushed. 2019-07-15 9:31:21 2 [Note] WSREP: ####### Setting monitor position to 2 2019-07-15 9:31:21 2 [Note] WSREP: Lowest cert indnex boundary for CC from group: 2 2019-07-15 9:31:21 2 [Note] WSREP: Min available from gcache for CC from group: 1 2019-07-15 9:31:21 2 [Note] WSREP: ================================================ View: id: 2827f56e-a6ca-11e9-8716-53a41869b333:2 status: primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: no own_index: 0 members(2): 0: 2826cfab-a6ca-11e9-9c26-df6a14e88650, jan-HP-ZBook-15u-G5 1: 28a291e5-a6ca-11e9-925e-1e0c04ab35dd, jan-HP-ZBook-15u-G5 ================================================= 2019-07-15 9:31:21 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-15 9:31:21 0 [Note] WSREP: Member 1.0 (jan-HP-ZBook-15u-G5) requested state transfer from '*any*'. Selected 0.0 (jan-HP-ZBook-15u-G5)(SYNCED) as donor. 2019-07-15 9:31:21 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 2) 2019-07-15 9:31:21 2 [Note] WSREP: Detected STR version: 1, req_len: 110, req: STRv1 2019-07-15 9:31:21 2 [Note] WSREP: Cert index preload: 2 -> 2 2019-07-15 9:31:21 2 [Note] WSREP: Server status change synced -> donor 2019-07-15 9:31:21 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-15 9:31:21 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-15 9:31:21 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '127.0.0.2:16087/rsync_sst' --socket '/home/jan/mysql/10.4/mysql-test/var/tmp/5/mysqld.1.sock' --datadir '/home/jan/mysql/10.4/mysql-test/var/5/mysqld.1/data/' --defaults-file '/home/jan/mysql/10.4/mysql-test/var/5/my.cnf' --defaults-group-suffix '.1' '' --binlog-index 'mysqld-bin.index' --gtid '2827f56e-a6ca-11e9-8716-53a41869b333:2' --gtid-domain-id '0'' 2019-07-15 9:31:21 0 [Note] WSREP: async IST sender starting to serve tcp://127.0.0.1:16086 sending 2-2 2019-07-15 9:31:21 0 [Note] WSREP: IST sender 2 -> 2 2019-07-15 9:31:21 2 [Note] WSREP: sst_donor_thread signaled with 0 2019-07-15 9:31:22 0 [Note] WSREP: Flushing tables for SST... 2019-07-15 9:31:22 0 [Note] WSREP: pause 2019-07-15 9:31:22 0 [Note] WSREP: Provider paused at 2827f56e-a6ca-11e9-8716-53a41869b333:2 (5) 2019-07-15 9:31:22 0 [Note] WSREP: Server paused at: 2 2019-07-15 9:31:22 0 [Note] WSREP: Tables flushed. 2019-07-15 9:31:23 0 [Note] WSREP: resume 2019-07-15 9:31:23 0 [Note] WSREP: resuming provider at 5 2019-07-15 9:31:23 0 [Note] WSREP: Provider resumed. 2019-07-15 9:31:23 0 [Note] WSREP: SST sent: 2827f56e-a6ca-11e9-8716-53a41869b333:2 2019-07-15 9:31:23 0 [Note] WSREP: Server status change donor -> joined 2019-07-15 9:31:23 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-15 9:31:23 0 [Note] WSREP: 0.0 (jan-HP-ZBook-15u-G5): State transfer to 1.0 (jan-HP-ZBook-15u-G5) complete. 2019-07-15 9:31:23 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 2) 2019-07-15 9:31:23 0 [Note] WSREP: Member 0.0 (jan-HP-ZBook-15u-G5) synced with group. 2019-07-15 9:31:23 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2) 2019-07-15 9:31:23 2 [Note] WSREP: Server jan-HP-ZBook-15u-G5 synced with group 2019-07-15 9:31:23 2 [Note] WSREP: Server status change joined -> synced 2019-07-15 9:31:23 2 [Note] WSREP: Synchronized with group, ready for connections 2019-07-15 9:31:23 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-15 9:31:23 0 [Note] WSREP: (2826cfab, 'tcp://0.0.0.0:16082') turning message relay requesting off 2019-07-15 9:31:25 0 [Note] WSREP: async IST sender served 2019-07-15 9:31:25 0 [Note] WSREP: 1.0 (jan-HP-ZBook-15u-G5): State transfer from 0.0 (jan-HP-ZBook-15u-G5) complete. 2019-07-15 9:31:25 0 [Note] WSREP: Member 1.0 (jan-HP-ZBook-15u-G5) synced with group. mysqld: /home/jan/mysql/10.4/wsrep-lib/src/client_state.cpp:308: int wsrep::client_state::enter_toi(const key_array&, const wsrep::const_buffer&, int): Assertion `state_ == s_exec' failed. 190715 9:31:27 [ERROR] mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware.   To report this bug, see https://mariadb.com/kb/en/reporting-bugs   We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail.   Server version: 10.4.7-MariaDB-debug-log key_buffer_size=1048576 read_buffer_size=131072 max_used_connections=2 max_threads=65537 thread_count=11 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 25171070 K bytes of memory Hope that's ok; if not, decrease some variables in the equation.   Thread pointer: 0x7f783c000f30 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f78d80dbd28 thread_stack 0x49000 /home/jan/mysql/10.4/sql/mysqld(my_print_stacktrace+0x40)[0x560848adbb05] mysys/stacktrace.c:269(my_print_stacktrace)[0x560848325d15] /lib/x86_64-linux-gnu/libpthread.so.0(+0x13f40)[0x7f78e8ff5f40] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xc7)[0x7f78e8ae8ed7] /lib/x86_64-linux-gnu/libc.so.6(abort+0x121)[0x7f78e8aca535] /lib/x86_64-linux-gnu/libc.so.6(+0x2540f)[0x7f78e8aca40f] /lib/x86_64-linux-gnu/libc.so.6(+0x35012)[0x7f78e8ada012] /home/jan/mysql/10.4/sql/mysqld(_ZN5wsrep12client_state9enter_toiERKSt6vectorINS_3keyESaIS2_EERKNS_12const_bufferEi+0x43)[0x560848b898db] src/client_state.cpp:309(wsrep::client_state::enter_toi(std::vector<wsrep::key, std::allocator<wsrep::key> > const&, wsrep::const_buffer const&, int))[0x56084823dd30] sql/wsrep_mysqld.cc:1853(wsrep_TOI_begin(THD*, char const*, char const*, TABLE_LIST const*, Alter_info*))[0x56084823eac7] sql/wsrep_mysqld.cc:2005(wsrep_to_isolation_begin(THD*, char const*, char const*, TABLE_LIST const*, Alter_info*))[0x5608480e1a49] sql/sql_table.cc:11359(Sql_cmd_create_table_like::execute(THD*))[0x560847ffe116] sql/sql_parse.cc:6082(mysql_execute_command(THD*))[0x56084800334b] sql/sql_parse.cc:7892(mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool))[0x5608480029c7] sql/sql_parse.cc:7715(wsrep_mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool))[0x560847fef5b9] sql/sql_parse.cc:1811(dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool))[0x560847feded9] sql/sql_parse.cc:1359(do_command(THD*))[0x5608482e18ad] sql/threadpool_common.cc:359(threadpool_process_request(THD*))[0x5608482e143d] sql/threadpool_common.cc:186(tp_callback(TP_connection*))[0x5608485316be] sql/threadpool_generic.cc:1593(worker_main(void*))[0x560848a71202] nptl/pthread_create.c:487(start_thread)[0x7f78e8feb182] /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7f78e8bc2b1f]   Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x7f783c0135a8): create table t(a int) Connection ID (thread ID): 18 Status: NOT_KILLED   Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on   The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /home/jan/mysql/10.4/mysql-test/var/5/mysqld.1/data Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size unlimited unlimited bytes Max resident set unlimited unlimited bytes Max processes 127852 127852 processes Max open files 1024 1024 files Max locked memory 67108864 67108864 bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 127852 127852 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: |/usr/share/apport/apport %p %s %c %d %P   ----------SERVER LOG END-------------     - found 'core' (0/5)   Trying 'dbx' to get a backtrace   Trying 'gdb' to get a backtrace from coredump /home/jan/mysql/10.4/mysql-test/var/5/log/galera.galera_mdev_13787-innodb/mysqld.1/data/core Core generated by '/home/jan/mysql/10.4/sql/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- [New LWP 22835] [New LWP 20772] [New LWP 20834] [New LWP 22565] [New LWP 20836] [New LWP 22834] [New LWP 20837] [New LWP 20767] [New LWP 20775] [New LWP 20744] [New LWP 20749] [New LWP 20782] [New LWP 20868] [New LWP 20738] [New LWP 20912] [New LWP 20870] [New LWP 20829] [New LWP 20913] [New LWP 20799] [New LWP 20832] [New LWP 20833] [New LWP 20869] [New LWP 20951] [New LWP 20914] [New LWP 22560] [New LWP 20915] [New LWP 20835] [New LWP 20952] [New LWP 20991] [New LWP 20916] [New LWP 20953] [New LWP 21037] [New LWP 20954] [New LWP 21098] [New LWP 21036] [New LWP 22564] [New LWP 22559] [New LWP 21035] [New LWP 21076] [New LWP 20990] [New LWP 20758] [New LWP 20866] [New LWP 20867] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `/home/jan/mysql/10.4/sql/mysqld --defaults-group-suffix=.1 --defaults-file=/hom'. Program terminated with signal SIGABRT, Aborted. #0 __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:56 56 ../sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory. [Current thread is 1 (Thread 0x7f78d80dc700 (LWP 22835))] #0 __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:56 #1 0x0000560848adbbf7 in my_write_core (sig=6) at /home/jan/mysql/10.4/mysys/stacktrace.c:481 #2 0x000056084832609e in handle_fatal_signal (sig=6) at /home/jan/mysql/10.4/sql/signal_handler.cc:343 #3 <signal handler called> #4 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50 #5 0x00007f78e8aca535 in __GI_abort () at abort.c:79 #6 0x00007f78e8aca40f in __assert_fail_base (fmt=0x7f78e8c58588 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=0x5608490e24b1 "state_ == s_exec", file=0x5608490e1f68 "/home/jan/mysql/10.4/wsrep-lib/src/client_state.cpp", line=308, function=<optimized out>) at assert.c:92 #7 0x00007f78e8ada012 in __GI___assert_fail (assertion=0x5608490e24b1 "state_ == s_exec", file=0x5608490e1f68 "/home/jan/mysql/10.4/wsrep-lib/src/client_state.cpp", line=308, function=0x5608490e2b20 <wsrep::client_state::enter_toi(std::vector<wsrep::key, std::allocator<wsrep::key> > const&, wsrep::const_buffer const&, int)::__PRETTY_FUNCTION__> "int wsrep::client_state::enter_toi(const key_array&, const wsrep::const_buffer&, int)") at assert.c:101 #8 0x0000560848b898db in wsrep::client_state::enter_toi (this=0x7f783c0070a8, keys=std::vector of length 1, capacity 1 = {...}, buffer=..., flags=3) at /home/jan/mysql/10.4/wsrep-lib/src/client_state.cpp:308 #9 0x000056084823dd30 in wsrep_TOI_begin (thd=0x7f783c000f30, db=0x7f783c013d40 "test", table=0x7f783c013660 "t", table_list=0x0, alter_info=0x0) at /home/jan/mysql/10.4/sql/wsrep_mysqld.cc:1853 #10 0x000056084823eac7 in wsrep_to_isolation_begin (thd=0x7f783c000f30, db_=0x7f783c013d40 "test", table_=0x7f783c013660 "t", table_list=0x0, alter_info=0x0) at /home/jan/mysql/10.4/sql/wsrep_mysqld.cc:2005 #11 0x00005608480e1a49 in Sql_cmd_create_table_like::execute (this=0x7f783c013638, thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/sql_table.cc:11359 #12 0x0000560847ffe116 in mysql_execute_command (thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/sql_parse.cc:6082 #13 0x000056084800334b in mysql_parse (thd=0x7f783c000f30, rawbuf=0x7f783c0135a8 "create table t(a int)", length=21, parser_state=0x7f78d80db070, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.4/sql/sql_parse.cc:7892 #14 0x00005608480029c7 in wsrep_mysql_parse (thd=0x7f783c000f30, rawbuf=0x7f783c0135a8 "create table t(a int)", length=21, parser_state=0x7f78d80db070, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.4/sql/sql_parse.cc:7704 #15 0x0000560847fef5b9 in dispatch_command (command=COM_QUERY, thd=0x7f783c000f30, packet=0x7f783c008891 "create table t(a int)", packet_length=21, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.4/sql/sql_parse.cc:1811 #16 0x0000560847feded9 in do_command (thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/sql_parse.cc:1359 #17 0x00005608482e18ad in threadpool_process_request (thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/threadpool_common.cc:359 #18 0x00005608482e143d in tp_callback (c=0x56084b8c8cd0) at /home/jan/mysql/10.4/sql/threadpool_common.cc:186 #19 0x00005608485316be in worker_main (param=0x56084b882910) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1592 #20 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b960ee0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #21 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #22 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 43 (Thread 0x7f789bfff700 (LWP 20867)): #0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f789bffeca0, expected=0, futex_word=0x56084b61a6c8) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f789bffeca0, mutex=0x56084b61a678, cond=0x56084b61a6a0) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x56084b61a6a0, mutex=0x56084b61a678, abstime=0x7f789bffeca0) at pthread_cond_wait.c:667 #3 0x000056084862f2ba in os_event::timed_wait (this=0x56084b61a660, abstime=0x7f789bffeca0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:276 #4 0x000056084862f5e7 in os_event::wait_time_low (this=0x56084b61a660, time_in_usec=1000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:398 #5 0x000056084862f780 in os_event_wait_time_low (event=0x56084b61a660, time_in_usec=1000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:498 #6 0x0000560848717661 in srv_error_monitor_thread () at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:1845 #7 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 42 (Thread 0x7f78b8ff9700 (LWP 20866)): #0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78b8ff8e60, expected=0, futex_word=0x56084b7c4a08) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f78b8ff8e60, mutex=0x56084b7c49b8, cond=0x56084b7c49e0) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x56084b7c49e0, mutex=0x56084b7c49b8, abstime=0x7f78b8ff8e60) at pthread_cond_wait.c:667 #3 0x000056084862f2ba in os_event::timed_wait (this=0x56084b7c49a0, abstime=0x7f78b8ff8e60) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:276 #4 0x000056084862f5e7 in os_event::wait_time_low (this=0x56084b7c49a0, time_in_usec=1000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:398 #5 0x000056084862f780 in os_event_wait_time_low (event=0x56084b7c49a0, time_in_usec=1000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:498 #6 0x00005608485fcf78 in lock_wait_timeout_thread () at /home/jan/mysql/10.4/storage/innobase/lock/lock0wait.cc:543 #7 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 41 (Thread 0x7f78e0911700 (LWP 20758)): #0 0x00007f78e8bc2e3f in epoll_wait (epfd=9, events=0x7f78e0910450, maxevents=128, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30 #1 0x00007f78e3c62a41 in asio::detail::epoll_reactor::run (this=0x56084b512650, block=true, ops=...) at asio/asio/detail/impl/epoll_reactor.ipp:391 #2 0x00007f78e3c63db5 in asio::detail::task_io_service::do_run_one (this=0x56084b50dcd0, lock=..., this_thread=..., ec=...) at asio/asio/detail/impl/task_io_service.ipp:355 #3 0x00007f78e3c6385d in asio::detail::task_io_service::run (this=0x56084b50dcd0, ec=...) at asio/asio/detail/impl/task_io_service.ipp:148 #4 0x00007f78e3c6406c in asio::io_service::run (this=0x56084b34acb8) at asio/asio/impl/io_service.ipp:58 #5 0x00007f78e3c94f35 in gcomm::AsioProtonet::event_loop (this=0x56084b34ac00, period=...) at gcomm/src/asio_protonet.cpp:116 #6 0x00007f78e3cbe931 in GCommConn::run (this=0x56084b511d30) at gcs/src/gcs_gcomm.cpp:498 #7 0x00007f78e3cc30c4 in GCommConn::run_fn (arg=0x56084b511d30) at gcs/src/gcs_gcomm.cpp:209 #8 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 40 (Thread 0x7f78897fa700 (LWP 20990)): #0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78897f9e60, expected=0, futex_word=0x560849686ff8 <pool_timer+216>) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f78897f9e60, mutex=0x560849686f48 <pool_timer+40>, cond=0x560849686fd0 <pool_timer+176>) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x560849686fd0 <pool_timer+176>, mutex=0x560849686f48 <pool_timer+40>, abstime=0x7f78897f9e60) at pthread_cond_wait.c:667 #3 0x0000560848ae16d9 in safe_cond_timedwait (cond=0x560849686fd0 <pool_timer+176>, mp=0x560849686f20 <pool_timer>, abstime=0x7f78897f9e60, file=0x560848dcaaa0 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1215) at /home/jan/mysql/10.4/mysys/thr_mutex.c:546 #4 0x000056084852f16e in inline_mysql_cond_timedwait (that=0x560849686fd0 <pool_timer+176>, mutex=0x560849686f20 <pool_timer>, abstime=0x7f78897f9e60, src_file=0x560848dcac68 "/home/jan/mysql/10.4/sql/threadpool_generic.cc", src_line=636) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1215 #5 0x000056084852f759 in timer_thread (param=0x560849686f20 <pool_timer>) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:636 #6 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b5de9c0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #7 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 39 (Thread 0x7f78d952e700 (LWP 21076)): #0 0x00007f78e8bc2e3f in epoll_wait (epfd=37, events=0x7f78d9527d20, maxevents=1024, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30 #1 0x000056084852f338 in io_poll_wait (pollfd=37, native_events=0x7f78d9527d20, maxevents=1024, timeout_ms=-1) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:331 #2 0x000056084852fc7f in listener (current_thread=0x7f78d952de20, thread_group=0x56084b882e10) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:792 #3 0x000056084853087f in get_event (current_thread=0x7f78d952de20, thread_group=0x56084b882e10, abstime=0x7f78d952ddf0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1237 #4 0x0000560848531680 in worker_main (param=0x56084b882e10) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588 #5 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b98b950) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #6 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #7 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 38 (Thread 0x7f78d960f700 (LWP 21035)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084964c44c <COND_slave_background+44>) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084964f6c8 <LOCK_slave_background+40>, cond=0x56084964c420 <COND_slave_background>) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084964c420 <COND_slave_background>, mutex=0x56084964f6c8 <LOCK_slave_background+40>) at pthread_cond_wait.c:655 #3 0x0000560848ae1319 in safe_cond_wait (cond=0x56084964c420 <COND_slave_background>, mp=0x56084964f6a0 <LOCK_slave_background>, file=0x560848bbcb98 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1167) at /home/jan/mysql/10.4/mysys/thr_mutex.c:492 #4 0x0000560847eeca49 in inline_mysql_cond_wait (that=0x56084964c420 <COND_slave_background>, mutex=0x56084964f6a0 <LOCK_slave_background>, src_file=0x560848bbd708 "/home/jan/mysql/10.4/sql/slave.cc", src_line=519) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1167 #5 0x0000560847eee242 in handle_slave_background (arg=0x0) at /home/jan/mysql/10.4/sql/slave.cc:519 #6 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b994ac0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #7 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 37 (Thread 0x7f78d8253700 (LWP 22559)): #0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78d8252df0, expected=0, futex_word=0x7f78d8252e68) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f78d8252df0, mutex=0x56084b8826b8, cond=0x7f78d8252e40) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x7f78d8252e40, mutex=0x56084b8826b8, abstime=0x7f78d8252df0) at pthread_cond_wait.c:667 #3 0x0000560848ae16d9 in safe_cond_timedwait (cond=0x7f78d8252e40, mp=0x56084b882690, abstime=0x7f78d8252df0, file=0x560848dcaaa0 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1204) at /home/jan/mysql/10.4/mysys/thr_mutex.c:546 #4 0x000056084852f10e in inline_mysql_cond_timedwait (that=0x7f78d8252e40, mutex=0x56084b882690, abstime=0x7f78d8252df0, src_file=0x560848dcac68 "/home/jan/mysql/10.4/sql/threadpool_generic.cc", src_line=1280) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1204 #5 0x00005608485309d1 in get_event (current_thread=0x7f78d8252e20, thread_group=0x56084b882690, abstime=0x7f78d8252df0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1279 #6 0x0000560848531680 in worker_main (param=0x56084b882690) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588 #7 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b8c85d0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #8 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 36 (Thread 0x7f78d81bd700 (LWP 22564)): #0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78d81bcdf0, expected=0, futex_word=0x7f78d81bce68) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f78d81bcdf0, mutex=0x56084b8827f8, cond=0x7f78d81bce40) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x7f78d81bce40, mutex=0x56084b8827f8, abstime=0x7f78d81bcdf0) at pthread_cond_wait.c:667 #3 0x0000560848ae16d9 in safe_cond_timedwait (cond=0x7f78d81bce40, mp=0x56084b8827d0, abstime=0x7f78d81bcdf0, file=0x560848dcaaa0 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1204) at /home/jan/mysql/10.4/mysys/thr_mutex.c:546 #4 0x000056084852f10e in inline_mysql_cond_timedwait (that=0x7f78d81bce40, mutex=0x56084b8827d0, abstime=0x7f78d81bcdf0, src_file=0x560848dcac68 "/home/jan/mysql/10.4/sql/threadpool_generic.cc", src_line=1280) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1204 #5 0x00005608485309d1 in get_event (current_thread=0x7f78d81bce20, thread_group=0x56084b8827d0, abstime=0x7f78d81bcdf0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1279 #6 0x0000560848531680 in worker_main (param=0x56084b8827d0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588 #7 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b950fd0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #8 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 35 (Thread 0x7f78d95c4700 (LWP 21036)): #0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78d95c3df0, expected=0, futex_word=0x7f78d95c3e68) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f78d95c3df0, mutex=0x56084b882cf8, cond=0x7f78d95c3e40) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x7f78d95c3e40, mutex=0x56084b882cf8, abstime=0x7f78d95c3df0) at pthread_cond_wait.c:667 #3 0x0000560848ae16d9 in safe_cond_timedwait (cond=0x7f78d95c3e40, mp=0x56084b882cd0, abstime=0x7f78d95c3df0, file=0x560848dcaaa0 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1204) at /home/jan/mysql/10.4/mysys/thr_mutex.c:546 #4 0x000056084852f10e in inline_mysql_cond_timedwait (that=0x7f78d95c3e40, mutex=0x56084b882cd0, abstime=0x7f78d95c3df0, src_file=0x560848dcac68 "/home/jan/mysql/10.4/sql/threadpool_generic.cc", src_line=1280) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1204 #5 0x00005608485309d1 in get_event (current_thread=0x7f78d95c3e20, thread_group=0x56084b882cd0, abstime=0x7f78d95c3df0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1279 #6 0x0000560848531680 in worker_main (param=0x56084b882cd0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588 #7 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b998230) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #8 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 34 (Thread 0x7f78d94e3700 (LWP 21098)): #0 0x00007f78e8bc2e3f in epoll_wait (epfd=38, events=0x7f78d94dcd20, maxevents=1024, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30 #1 0x000056084852f338 in io_poll_wait (pollfd=38, native_events=0x7f78d94dcd20, maxevents=1024, timeout_ms=-1) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:331 #2 0x000056084852fc7f in listener (current_thread=0x7f78d94e2e20, thread_group=0x56084b882f50) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:792 #3 0x000056084853087f in get_event (current_thread=0x7f78d94e2e20, thread_group=0x56084b882f50, abstime=0x7f78d94e2df0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1237 #4 0x0000560848531680 in worker_main (param=0x56084b882f50) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588 #5 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b99f250) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #6 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #7 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 33 (Thread 0x7f7889ffb700 (LWP 20954)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7f7889ffadc8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f7889ffae08, cond=0x7f7889ffada0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x7f7889ffada0, mutex=0x7f7889ffae08) at pthread_cond_wait.c:655 #3 0x0000560848ae1319 in safe_cond_wait (cond=0x7f7889ffada0, mp=0x7f7889ffade0, file=0x560848dcdd40 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1178) at /home/jan/mysql/10.4/mysys/thr_mutex.c:492 #4 0x0000560848546968 in inline_mysql_cond_wait (that=0x7f7889ffada0, mutex=0x7f7889ffade0, src_file=0x560848dcf7d0 "/home/jan/mysql/10.4/storage/innobase/handler/ha_innodb.cc", src_line=288) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1178 #5 0x000056084854ad92 in thd_destructor_proxy () at /home/jan/mysql/10.4/storage/innobase/handler/ha_innodb.cc:288 #6 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b8300f0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #7 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 32 (Thread 0x7f78d9579700 (LWP 21037)): #0 0x00007f78e8bc2e3f in epoll_wait (epfd=36, events=0x7f78d9572d20, maxevents=1024, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30 #1 0x000056084852f338 in io_poll_wait (pollfd=36, native_events=0x7f78d9572d20, maxevents=1024, timeout_ms=-1) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:331 #2 0x000056084852fc7f in listener (current_thread=0x7f78d9578e20, thread_group=0x56084b882cd0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:792 #3 0x000056084853087f in get_event (current_thread=0x7f78d9578e20, thread_group=0x56084b882cd0, abstime=0x7f78d9578df0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1237 #4 0x0000560848531680 in worker_main (param=0x56084b882cd0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588 #5 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b998230) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #6 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #7 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 31 (Thread 0x7f788a7fc700 (LWP 20953)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b61a8c8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b61a878, cond=0x56084b61a8a0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084b61a8a0, mutex=0x56084b61a878) at pthread_cond_wait.c:655 #3 0x000056084862f9b6 in os_event::wait (this=0x56084b61a860) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159 #4 0x000056084862f454 in os_event::wait_low (this=0x56084b61a860, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326 #5 0x000056084862f7a5 in os_event_wait_low (event=0x56084b61a860, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515 #6 0x00005608487da816 in buf_resize_thread () at /home/jan/mysql/10.4/storage/innobase/buf/buf0buf.cc:3207 #7 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 30 (Thread 0x7f788bfff700 (LWP 20916)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b61a64c) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b61a5f8, cond=0x56084b61a620) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084b61a620, mutex=0x56084b61a5f8) at pthread_cond_wait.c:655 #3 0x000056084862f9b6 in os_event::wait (this=0x56084b61a5e0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159 #4 0x000056084862f454 in os_event::wait_low (this=0x56084b61a5e0, reset_sig_count=26) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326 #5 0x000056084862f7a5 in os_event_wait_low (event=0x56084b61a5e0, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515 #6 0x00005608487153d2 in srv_resume_thread (slot=0x560849488bf0 <srv_sys+560>, sig_count=0, wait=true, timeout_usec=0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:904 #7 0x0000560848718e15 in srv_worker_thread (arg=0x0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:2508 #8 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 29 (Thread 0x7f78d965a700 (LWP 20991)): #0 0x00007f78e8ae9ebc in __GI___sigtimedwait (set=0x7f78d9659e10, info=0x7f78d9659d30, timeout=0x0) at ../sysdeps/unix/sysv/linux/sigtimedwait.c:29 #1 0x0000560847ebc2e6 in my_sigwait (set=0x7f78d9659e10, sig=0x7f78d9659dd4, code=0x7f78d9659dd8) at /home/jan/mysql/10.4/include/my_pthread.h:198 #2 0x0000560847ec2a1f in signal_hand (arg=0x0) at /home/jan/mysql/10.4/sql/mysqld.cc:3249 #3 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b83f6b0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #4 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #5 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 28 (Thread 0x7f788affd700 (LWP 20952)): #0 0x00007f78e8ff5440 in __GI___nanosleep (requested_time=0x7f788affc7d0, remaining=0x0) at ../sysdeps/unix/sysv/linux/nanosleep.c:28 #1 0x000056084862fcb9 in os_thread_sleep (tm=1000000) at /home/jan/mysql/10.4/storage/innobase/os/os0thread.cc:225 #2 0x00005608487cc042 in btr_defragment_thread () at /home/jan/mysql/10.4/storage/innobase/btr/btr0defragment.cc:707 #3 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #4 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 27 (Thread 0x7f78baffd700 (LWP 20835)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b6735ec) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b673598, cond=0x56084b6735c0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084b6735c0, mutex=0x56084b673598) at pthread_cond_wait.c:655 #3 0x000056084862f9b6 in os_event::wait (this=0x56084b673580) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159 #4 0x000056084862f454 in os_event::wait_low (this=0x56084b673580, reset_sig_count=6) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326 #5 0x000056084862f7a5 in os_event_wait_low (event=0x56084b673580, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515 #6 0x00005608486299fa in os_aio_simulated_handler (global_segment=4, m1=0x7f78baffcca8, m2=0x7f78baffccb0, type=0x7f78baffcce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:7136 #7 0x0000560848628043 in os_aio_handler (segment=4, m1=0x7f78baffcca8, m2=0x7f78baffccb0, request=0x7f78baffcce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:5573 #8 0x000056084886d291 in fil_aio_wait (segment=4) at /home/jan/mysql/10.4/storage/innobase/fil/fil0fil.cc:4349 #9 0x000056084871ac20 in io_handler_thread (arg=0x5608496cae20 <n+32>) at /home/jan/mysql/10.4/storage/innobase/srv/srv0start.cc:325 #10 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #11 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 26 (Thread 0x7f7898ff9700 (LWP 20915)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b61a548) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b61a4f8, cond=0x56084b61a520) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084b61a520, mutex=0x56084b61a4f8) at pthread_cond_wait.c:655 #3 0x000056084862f9b6 in os_event::wait (this=0x56084b61a4e0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159 #4 0x000056084862f454 in os_event::wait_low (this=0x56084b61a4e0, reset_sig_count=39) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326 #5 0x000056084862f7a5 in os_event_wait_low (event=0x56084b61a4e0, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515 #6 0x00005608487153d2 in srv_resume_thread (slot=0x560849488b80 <srv_sys+448>, sig_count=0, wait=true, timeout_usec=0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:904 #7 0x0000560848718e15 in srv_worker_thread (arg=0x0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:2508 #8 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 25 (Thread 0x7f78d8208700 (LWP 22560)): #0 0x00007f78e8bc2e3f in epoll_wait (epfd=31, events=0x7f78d8201d20, maxevents=1024, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30 #1 0x000056084852f338 in io_poll_wait (pollfd=31, native_events=0x7f78d8201d20, maxevents=1024, timeout_ms=-1) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:331 #2 0x000056084852fc7f in listener (current_thread=0x7f78d8207e20, thread_group=0x56084b882690) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:792 #3 0x000056084853087f in get_event (current_thread=0x7f78d8207e20, thread_group=0x56084b882690, abstime=0x7f78d8207df0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1237 #4 0x0000560848531680 in worker_main (param=0x56084b882690) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588 #5 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b8c85d0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #6 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #7 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 24 (Thread 0x7f78997fa700 (LWP 20914)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b61a5c8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b61a578, cond=0x56084b61a5a0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084b61a5a0, mutex=0x56084b61a578) at pthread_cond_wait.c:655 #3 0x000056084862f9b6 in os_event::wait (this=0x56084b61a560) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159 #4 0x000056084862f454 in os_event::wait_low (this=0x56084b61a560, reset_sig_count=27) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326 #5 0x000056084862f7a5 in os_event_wait_low (event=0x56084b61a560, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515 #6 0x00005608487153d2 in srv_resume_thread (slot=0x560849488bb8 <srv_sys+504>, sig_count=0, wait=true, timeout_usec=0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:904 #7 0x0000560848718e15 in srv_worker_thread (arg=0x0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:2508 #8 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 23 (Thread 0x7f788b7fe700 (LWP 20951)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b61a7c8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b61a778, cond=0x56084b61a7a0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084b61a7a0, mutex=0x56084b61a778) at pthread_cond_wait.c:655 #3 0x000056084862f9b6 in os_event::wait (this=0x56084b61a760) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159 #4 0x000056084862f454 in os_event::wait_low (this=0x56084b61a760, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326 #5 0x000056084862f7a5 in os_event_wait_low (event=0x56084b61a760, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515 #6 0x00005608487f25aa in buf_dump_thread () at /home/jan/mysql/10.4/storage/innobase/buf/buf0dump.cc:833 #7 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 22 (Thread 0x7f789affd700 (LWP 20869)): #0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f789affce80, expected=0, futex_word=0x56084b7f61dc) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f789affce80, mutex=0x56084b7f6188, cond=0x56084b7f61b0) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x56084b7f61b0, mutex=0x56084b7f6188, abstime=0x7f789affce80) at pthread_cond_wait.c:667 #3 0x000056084862f2ba in os_event::timed_wait (this=0x56084b7f6170, abstime=0x7f789affce80) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:276 #4 0x000056084862f5e7 in os_event::wait_time_low (this=0x56084b7f6170, time_in_usec=10000000, reset_sig_count=2) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:398 #5 0x000056084862f780 in os_event_wait_time_low (event=0x56084b7f6170, time_in_usec=10000000, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:498 #6 0x00005608488582e6 in dict_stats_thread () at /home/jan/mysql/10.4/storage/innobase/dict/dict0stats_bg.cc:475 #7 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 21 (Thread 0x7f78bbfff700 (LWP 20833)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b6734e8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b673498, cond=0x56084b6734c0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084b6734c0, mutex=0x56084b673498) at pthread_cond_wait.c:655 #3 0x000056084862f9b6 in os_event::wait (this=0x56084b673480) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159 #4 0x000056084862f454 in os_event::wait_low (this=0x56084b673480, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326 #5 0x000056084862f7a5 in os_event_wait_low (event=0x56084b673480, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515 #6 0x00005608486299fa in os_aio_simulated_handler (global_segment=2, m1=0x7f78bbffeca8, m2=0x7f78bbffecb0, type=0x7f78bbffece0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:7136 #7 0x0000560848628043 in os_aio_handler (segment=2, m1=0x7f78bbffeca8, m2=0x7f78bbffecb0, request=0x7f78bbffece0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:5573 #8 0x000056084886d291 in fil_aio_wait (segment=2) at /home/jan/mysql/10.4/storage/innobase/fil/fil0fil.cc:4349 #9 0x000056084871ac20 in io_handler_thread (arg=0x5608496cae10 <n+16>) at /home/jan/mysql/10.4/storage/innobase/srv/srv0start.cc:325 #10 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #11 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 20 (Thread 0x7f78d8c59700 (LWP 20832)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b673468) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b673418, cond=0x56084b673440) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084b673440, mutex=0x56084b673418) at pthread_cond_wait.c:655 #3 0x000056084862f9b6 in os_event::wait (this=0x56084b673400) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159 #4 0x000056084862f454 in os_event::wait_low (this=0x56084b673400, reset_sig_count=5) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326 #5 0x000056084862f7a5 in os_event_wait_low (event=0x56084b673400, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515 #6 0x00005608486299fa in os_aio_simulated_handler (global_segment=1, m1=0x7f78d8c58ca8, m2=0x7f78d8c58cb0, type=0x7f78d8c58ce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:7136 #7 0x0000560848628043 in os_aio_handler (segment=1, m1=0x7f78d8c58ca8, m2=0x7f78d8c58cb0, request=0x7f78d8c58ce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:5573 #8 0x000056084886d291 in fil_aio_wait (segment=1) at /home/jan/mysql/10.4/storage/innobase/fil/fil0fil.cc:4349 #9 0x000056084871ac20 in io_handler_thread (arg=0x5608496cae08 <n+8>) at /home/jan/mysql/10.4/storage/innobase/srv/srv0start.cc:325 #10 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #11 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 19 (Thread 0x7f78dac5c700 (LWP 20799)): #0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78dac5bde0, expected=0, futex_word=0x560849edbaa8 <COND_checkpoint+40>) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f78dac5bde0, mutex=0x560849edb9e8 <LOCK_checkpoint+40>, cond=0x560849edba80 <COND_checkpoint>) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x560849edba80 <COND_checkpoint>, mutex=0x560849edb9e8 <LOCK_checkpoint+40>, abstime=0x7f78dac5bde0) at pthread_cond_wait.c:667 #3 0x0000560848ae16d9 in safe_cond_timedwait (cond=0x560849edba80 <COND_checkpoint>, mp=0x560849edb9c0 <LOCK_checkpoint>, abstime=0x7f78dac5bde0, file=0x560848f40740 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1204) at /home/jan/mysql/10.4/mysys/thr_mutex.c:546 #4 0x00005608489477a8 in inline_mysql_cond_timedwait (that=0x560849edba80 <COND_checkpoint>, mutex=0x560849edb9c0 <LOCK_checkpoint>, abstime=0x7f78dac5bde0, src_file=0x560848f40778 "/home/jan/mysql/10.4/storage/maria/ma_servicethread.c", src_line=116) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1204 #5 0x0000560848947ccd in my_service_thread_sleep (control=0x56084948dc20 <checkpoint_control>, sleep_time=29000000000) at /home/jan/mysql/10.4/storage/maria/ma_servicethread.c:115 #6 0x000056084893c11d in ma_checkpoint_background (arg=0x1e) at /home/jan/mysql/10.4/storage/maria/ma_checkpoint.c:707 #7 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b5d2fc0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #8 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 18 (Thread 0x7f7899ffb700 (LWP 20913)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b61a4cc) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b61a478, cond=0x56084b61a4a0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084b61a4a0, mutex=0x56084b61a478) at pthread_cond_wait.c:655 #3 0x000056084862f9b6 in os_event::wait (this=0x56084b61a460) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159 #4 0x000056084862f454 in os_event::wait_low (this=0x56084b61a460, reset_sig_count=10) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326 #5 0x000056084862f7a5 in os_event_wait_low (event=0x56084b61a460, reset_sig_count=10) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515 #6 0x00005608487153d2 in srv_resume_thread (slot=0x560849488b48 <srv_sys+392>, sig_count=10, wait=true, timeout_usec=0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:904 #7 0x000056084871922a in srv_purge_coordinator_suspend (slot=0x560849488b48 <srv_sys+392>, rseg_history_len=28) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:2637 #8 0x00005608487194ca in srv_purge_coordinator_thread (arg=0x0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:2714 #9 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #10 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 17 (Thread 0x7f78d945a700 (LWP 20829)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b6733e8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b673398, cond=0x56084b6733c0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084b6733c0, mutex=0x56084b673398) at pthread_cond_wait.c:655 #3 0x000056084862f9b6 in os_event::wait (this=0x56084b673380) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159 #4 0x000056084862f454 in os_event::wait_low (this=0x56084b673380, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326 #5 0x000056084862f7a5 in os_event_wait_low (event=0x56084b673380, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515 #6 0x00005608486299fa in os_aio_simulated_handler (global_segment=0, m1=0x7f78d9459ca8, m2=0x7f78d9459cb0, type=0x7f78d9459ce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:7136 #7 0x0000560848628043 in os_aio_handler (segment=0, m1=0x7f78d9459ca8, m2=0x7f78d9459cb0, request=0x7f78d9459ce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:5573 #8 0x000056084886d291 in fil_aio_wait (segment=0) at /home/jan/mysql/10.4/storage/innobase/fil/fil0fil.cc:4349 #9 0x000056084871ac20 in io_handler_thread (arg=0x5608496cae00 <n>) at /home/jan/mysql/10.4/storage/innobase/srv/srv0start.cc:325 #10 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #11 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 16 (Thread 0x7f789a7fc700 (LWP 20870)): #0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f789a7fbc60, expected=0, futex_word=0x56084b78cd28) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f789a7fbc60, mutex=0x56084b78ccd8, cond=0x56084b78cd00) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x56084b78cd00, mutex=0x56084b78ccd8, abstime=0x7f789a7fbc60) at pthread_cond_wait.c:667 #3 0x000056084862f2ba in os_event::timed_wait (this=0x56084b78ccc0, abstime=0x7f789a7fbc60) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:276 #4 0x000056084862f5e7 in os_event::wait_time_low (this=0x56084b78ccc0, time_in_usec=5000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:398 #5 0x000056084862f780 in os_event_wait_time_low (event=0x56084b78ccc0, time_in_usec=5000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:498 #6 0x0000560848776185 in ib_wqueue_timedwait (wq=0x56084b78cc10, wait_in_usecs=5000000) at /home/jan/mysql/10.4/storage/innobase/ut/ut0wqueue.cc:161 #7 0x00005608488b1f6d in fts_optimize_thread (arg=0x56084b78cc10) at /home/jan/mysql/10.4/storage/innobase/fts/fts0opt.cc:2837 #8 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 15 (Thread 0x7f78b97fa700 (LWP 20912)): #0 0x00007f78e8ff5440 in __GI___nanosleep (requested_time=0x7f78b97f9e60, remaining=0x0) at ../sysdeps/unix/sysv/linux/nanosleep.c:28 #1 0x000056084862fcb9 in os_thread_sleep (tm=1000000) at /home/jan/mysql/10.4/storage/innobase/os/os0thread.cc:225 #2 0x0000560848718794 in srv_master_sleep () at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:2334 #3 0x00005608487188d2 in srv_master_thread (arg=0x0) at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:2375 #4 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #5 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 14 (Thread 0x7f78e8aa0740 (LWP 20738)): #0 0x00007f78e8bb6729 in __GI___poll (fds=0x7ffcf2f2e140, nfds=2, timeout=-1) at ../sysdeps/unix/sysv/linux/poll.c:29 #1 0x0000560847ec8cb5 in handle_connections_sockets () at /home/jan/mysql/10.4/sql/mysqld.cc:6457 #2 0x0000560847ec7f3e in mysqld_main (argc=164, argv=0x56084b356330) at /home/jan/mysql/10.4/sql/mysqld.cc:5893 #3 0x0000560847ebc285 in main (argc=25, argv=0x7ffcf2f2e448) at /home/jan/mysql/10.4/sql/main.cc:25   Thread 13 (Thread 0x7f789b7fe700 (LWP 20868)): #0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f789b7fde40, expected=0, futex_word=0x56084b61a748) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f789b7fde40, mutex=0x56084b61a6f8, cond=0x56084b61a720) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x56084b61a720, mutex=0x56084b61a6f8, abstime=0x7f789b7fde40) at pthread_cond_wait.c:667 #3 0x000056084862f2ba in os_event::timed_wait (this=0x56084b61a6e0, abstime=0x7f789b7fde40) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:276 #4 0x000056084862f5e7 in os_event::wait_time_low (this=0x56084b61a6e0, time_in_usec=5000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:398 #5 0x000056084862f780 in os_event_wait_time_low (event=0x56084b61a6e0, time_in_usec=5000000, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:498 #6 0x0000560848717138 in srv_monitor_thread () at /home/jan/mysql/10.4/storage/innobase/srv/srv0srv.cc:1681 #7 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 12 (Thread 0x7f78e007a700 (LWP 20782)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7f78e2e970e0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f78e2e97090, cond=0x7f78e2e970b8) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x7f78e2e970b8, mutex=0x7f78e2e97090) at pthread_cond_wait.c:655 #3 0x00007f78e3b4f88a in fifo_lock_get (q=0x7f78e2e97010) at galerautils/src/gu_fifo.c:262 #4 0x00007f78e3b4fad3 in gu_fifo_get_head (q=0x7f78e2e97010, err=0x7f78e00790dc) at galerautils/src/gu_fifo.c:330 #5 0x00007f78e3cbbdff in gcs_recv (conn=0x56084b4da930, action=0x7f78e0079180) at gcs/src/gcs.cpp:2024 #6 0x00007f78e3d32c05 in galera::Gcs::recv (this=0x56084b4d1b28, act=...) at galera/src/galera_gcs.hpp:120 #7 0x00007f78e3d01f69 in galera::GcsActionSource::process (this=0x56084b503110, recv_ctx=0x7f78e00795f0, exit_loop=@0x7f78e007936a: false) at galera/src/gcs_action_source.cpp:161 #8 0x00007f78e3d20778 in galera::ReplicatorSMM::async_recv (this=0x56084b4d1360, recv_ctx=0x7f78e00795f0) at galera/src/replicator_smm.cpp:383 #9 0x00007f78e3d4f7bf in galera_recv (gh=0x56084b49be30, recv_ctx=0x7f78e00795f0) at galera/src/wsrep_provider.cpp:236 #10 0x0000560848ba56f4 in wsrep::wsrep_provider_v26::run_applier (this=0x56084b3559c0, applier_ctx=0x7f78e00795f0) at /home/jan/mysql/10.4/wsrep-lib/src/wsrep_provider_v26.cpp:690 #11 0x00005608482502a6 in wsrep_replication_process (thd=0x7f78c4000d60, arg=0x0) at /home/jan/mysql/10.4/sql/wsrep_thd.cc:61 #12 0x0000560848241c80 in start_wsrep_THD (arg=0x56084b52aef0) at /home/jan/mysql/10.4/sql/wsrep_mysqld.cc:2668 #13 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #14 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 11 (Thread 0x7f78e2d95700 (LWP 20749)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b4d1bb4) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b4d1b50, cond=0x56084b4d1b88) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084b4d1b88, mutex=0x56084b4d1b50) at pthread_cond_wait.c:655 #3 0x00007f78e3b5c608 in gu::Lock::wait (this=0x7f78e2d94cf0, cond=...) at galerautils/src/gu_lock.hpp:45 #4 0x00007f78e3cfd79a in galera::ServiceThd::thd_func (arg=0x56084b4d1b38) at galera/src/galera_service_thd.cpp:30 #5 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #6 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 10 (Thread 0x7f78e4655700 (LWP 20744)): #0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78e4654e90, expected=0, futex_word=0x560849eee1e8 <COND_timer+40>) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f78e4654e90, mutex=0x560849eee128 <LOCK_timer+40>, cond=0x560849eee1c0 <COND_timer>) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x560849eee1c0 <COND_timer>, mutex=0x560849eee128 <LOCK_timer+40>, abstime=0x7f78e4654e90) at pthread_cond_wait.c:667 #3 0x0000560848ae16d9 in safe_cond_timedwait (cond=0x560849eee1c0 <COND_timer>, mp=0x560849eee100 <LOCK_timer>, abstime=0x7f78e4654e90, file=0x560848f84f80 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1204) at /home/jan/mysql/10.4/mysys/thr_mutex.c:546 #4 0x0000560848ae26a0 in inline_mysql_cond_timedwait (that=0x560849eee1c0 <COND_timer>, mutex=0x560849eee100 <LOCK_timer>, abstime=0x7f78e4654e90, src_file=0x560848f84fb8 "/home/jan/mysql/10.4/mysys/thr_timer.c", src_line=292) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1204 #5 0x0000560848ae3205 in timer_handler (arg=0x0) at /home/jan/mysql/10.4/mysys/thr_timer.c:292 #6 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b49b240) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #7 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #8 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 9 (Thread 0x7f78e00c5700 (LWP 20775)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7f78d0015cd0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f78d0015c20, cond=0x7f78d0015ca8) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x7f78d0015ca8, mutex=0x7f78d0015c20) at pthread_cond_wait.c:655 #3 0x0000560848ae1319 in safe_cond_wait (cond=0x7f78d0015ca8, mp=0x7f78d0015bf8, file=0x560848c62f20 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1178) at /home/jan/mysql/10.4/mysys/thr_mutex.c:492 #4 0x000056084824fda4 in inline_mysql_cond_wait (that=0x7f78d0015ca8, mutex=0x7f78d0015bf8, src_file=0x560848c632b8 "/home/jan/mysql/10.4/sql/wsrep_thd.h", src_line=69) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1178 #5 0x0000560848252df1 in Wsrep_thd_queue::pop_front (this=0x7f78d0015ba0) at /home/jan/mysql/10.4/sql/wsrep_thd.h:69 #6 0x0000560848251741 in wsrep_post_rollback_process (post_rollbacker=0x7f78d0001fb0, arg=0x0) at /home/jan/mysql/10.4/sql/wsrep_thd.cc:288 #7 0x0000560848241c80 in start_wsrep_THD (arg=0x56084b521de0) at /home/jan/mysql/10.4/sql/wsrep_mysqld.cc:2668 #8 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 8 (Thread 0x7f78dbfff700 (LWP 20767)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b511fe8) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b511f88, cond=0x56084b511fc0) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084b511fc0, mutex=0x56084b511f88) at pthread_cond_wait.c:655 #3 0x00007f78e3b5c608 in gu::Lock::wait (this=0x7f78dbffea90, cond=...) at galerautils/src/gu_lock.hpp:45 #4 0x00007f78e3cc2902 in RecvBuf::front (this=0x56084b511f88, timeout=...) at gcs/src/gcs_gcomm.cpp:124 #5 0x00007f78e3cbf769 in gcomm_recv (backend=0x56084b4dad58, msg=0x56084b4dac10, timeout=9223372035999999999) at gcs/src/gcs_gcomm.cpp:673 #6 0x00007f78e3cb0018 in core_msg_recv (backend=0x56084b4dad58, recv_msg=0x56084b4dac10, timeout=9223372035999999999) at gcs/src/gcs_core.cpp:480 #7 0x00007f78e3cb24d9 in gcs_core_recv (conn=0x56084b4dabb0, recv_act=0x7f78dbffee60, timeout=9223372035999999999) at gcs/src/gcs_core.cpp:1184 #8 0x00007f78e3cb99f3 in gcs_recv_thread (arg=0x56084b4da930) at gcs/src/gcs.cpp:1398 #9 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #10 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 7 (Thread 0x7f78b9ffb700 (LWP 20837)): #0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78b9ffabf0, expected=0, futex_word=0x56084b61a84c) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f78b9ffabf0, mutex=0x56084b61a7f8, cond=0x56084b61a820) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x56084b61a820, mutex=0x56084b61a7f8, abstime=0x7f78b9ffabf0) at pthread_cond_wait.c:667 #3 0x000056084862f2ba in os_event::timed_wait (this=0x56084b61a7e0, abstime=0x7f78b9ffabf0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:276 #4 0x000056084862f5e7 in os_event::wait_time_low (this=0x56084b61a7e0, time_in_usec=1000000, reset_sig_count=2) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:398 #5 0x000056084862f780 in os_event_wait_time_low (event=0x56084b61a7e0, time_in_usec=1000000, reset_sig_count=2) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:498 #6 0x00005608487fc3e8 in pc_sleep_if_needed (next_loop_time=1563172288561, sig_count=2, cur_time=1563172287561) at /home/jan/mysql/10.4/storage/innobase/buf/buf0flu.cc:2640 #7 0x00005608487fd352 in buf_flush_page_cleaner_coordinator () at /home/jan/mysql/10.4/storage/innobase/buf/buf0flu.cc:3099 #8 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 6 (Thread 0x7f78d8127700 (LWP 22834)): #0 futex_abstimed_wait_cancelable (private=<optimized out>, abstime=0x7f78d8126df0, expected=0, futex_word=0x7f78d8126e68) at ../sysdeps/unix/sysv/linux/futex-internal.h:205 #1 __pthread_cond_wait_common (abstime=0x7f78d8126df0, mutex=0x56084b882938, cond=0x7f78d8126e40) at pthread_cond_wait.c:539 #2 __pthread_cond_timedwait (cond=0x7f78d8126e40, mutex=0x56084b882938, abstime=0x7f78d8126df0) at pthread_cond_wait.c:667 #3 0x0000560848ae16d9 in safe_cond_timedwait (cond=0x7f78d8126e40, mp=0x56084b882910, abstime=0x7f78d8126df0, file=0x560848dcaaa0 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1204) at /home/jan/mysql/10.4/mysys/thr_mutex.c:546 #4 0x000056084852f10e in inline_mysql_cond_timedwait (that=0x7f78d8126e40, mutex=0x56084b882910, abstime=0x7f78d8126df0, src_file=0x560848dcac68 "/home/jan/mysql/10.4/sql/threadpool_generic.cc", src_line=1280) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1204 #5 0x00005608485309d1 in get_event (current_thread=0x7f78d8126e20, thread_group=0x56084b882910, abstime=0x7f78d8126df0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1279 #6 0x0000560848531680 in worker_main (param=0x56084b882910) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588 #7 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b960ee0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #8 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 5 (Thread 0x7f78ba7fc700 (LWP 20836)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b67366c) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b673618, cond=0x56084b673640) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084b673640, mutex=0x56084b673618) at pthread_cond_wait.c:655 #3 0x000056084862f9b6 in os_event::wait (this=0x56084b673600) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159 #4 0x000056084862f454 in os_event::wait_low (this=0x56084b673600, reset_sig_count=6) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326 #5 0x000056084862f7a5 in os_event_wait_low (event=0x56084b673600, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515 #6 0x00005608486299fa in os_aio_simulated_handler (global_segment=5, m1=0x7f78ba7fbca8, m2=0x7f78ba7fbcb0, type=0x7f78ba7fbce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:7136 #7 0x0000560848628043 in os_aio_handler (segment=5, m1=0x7f78ba7fbca8, m2=0x7f78ba7fbcb0, request=0x7f78ba7fbce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:5573 #8 0x000056084886d291 in fil_aio_wait (segment=5) at /home/jan/mysql/10.4/storage/innobase/fil/fil0fil.cc:4349 #9 0x000056084871ac20 in io_handler_thread (arg=0x5608496cae28 <n+40>) at /home/jan/mysql/10.4/storage/innobase/srv/srv0start.cc:325 #10 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #11 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 4 (Thread 0x7f78d8172700 (LWP 22565)): #0 0x00007f78e8bc2e3f in epoll_wait (epfd=32, events=0x7f78d816bd20, maxevents=1024, timeout=-1) at ../sysdeps/unix/sysv/linux/epoll_wait.c:30 #1 0x000056084852f338 in io_poll_wait (pollfd=32, native_events=0x7f78d816bd20, maxevents=1024, timeout_ms=-1) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:331 #2 0x000056084852fc7f in listener (current_thread=0x7f78d8171e20, thread_group=0x56084b8827d0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:792 #3 0x000056084853087f in get_event (current_thread=0x7f78d8171e20, thread_group=0x56084b8827d0, abstime=0x7f78d8171df0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1237 #4 0x0000560848531680 in worker_main (param=0x56084b8827d0) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1588 #5 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b950fd0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #6 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #7 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 3 (Thread 0x7f78bb7fe700 (LWP 20834)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x56084b673568) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x56084b673518, cond=0x56084b673540) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x56084b673540, mutex=0x56084b673518) at pthread_cond_wait.c:655 #3 0x000056084862f9b6 in os_event::wait (this=0x56084b673500) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:159 #4 0x000056084862f454 in os_event::wait_low (this=0x56084b673500, reset_sig_count=1) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:326 #5 0x000056084862f7a5 in os_event_wait_low (event=0x56084b673500, reset_sig_count=0) at /home/jan/mysql/10.4/storage/innobase/os/os0event.cc:515 #6 0x00005608486299fa in os_aio_simulated_handler (global_segment=3, m1=0x7f78bb7fdca8, m2=0x7f78bb7fdcb0, type=0x7f78bb7fdce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:7136 #7 0x0000560848628043 in os_aio_handler (segment=3, m1=0x7f78bb7fdca8, m2=0x7f78bb7fdcb0, request=0x7f78bb7fdce0) at /home/jan/mysql/10.4/storage/innobase/os/os0file.cc:5573 #8 0x000056084886d291 in fil_aio_wait (segment=3) at /home/jan/mysql/10.4/storage/innobase/fil/fil0fil.cc:4349 #9 0x000056084871ac20 in io_handler_thread (arg=0x5608496cae18 <n+24>) at /home/jan/mysql/10.4/storage/innobase/srv/srv0start.cc:325 #10 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #11 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 2 (Thread 0x7f78e0110700 (LWP 20772)): #0 futex_wait_cancelable (private=<optimized out>, expected=0, futex_word=0x7f78c80077a0) at ../sysdeps/unix/sysv/linux/futex-internal.h:88 #1 __pthread_cond_wait_common (abstime=0x0, mutex=0x7f78c80076f0, cond=0x7f78c8007778) at pthread_cond_wait.c:502 #2 __pthread_cond_wait (cond=0x7f78c8007778, mutex=0x7f78c80076f0) at pthread_cond_wait.c:655 #3 0x0000560848ae1319 in safe_cond_wait (cond=0x7f78c8007778, mp=0x7f78c80076c8, file=0x560848c62f20 "/home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h", line=1178) at /home/jan/mysql/10.4/mysys/thr_mutex.c:492 #4 0x000056084824fda4 in inline_mysql_cond_wait (that=0x7f78c8007778, mutex=0x7f78c80076c8, src_file=0x560848c632b8 "/home/jan/mysql/10.4/sql/wsrep_thd.h", src_line=69) at /home/jan/mysql/10.4/include/mysql/psi/mysql_thread.h:1178 #5 0x0000560848252df1 in Wsrep_thd_queue::pop_front (this=0x7f78c8007670) at /home/jan/mysql/10.4/sql/wsrep_thd.h:69 #6 0x0000560848250959 in wsrep_rollback_process (rollbacker=0x7f78c8000d60, arg=0x0) at /home/jan/mysql/10.4/sql/wsrep_thd.cc:145 #7 0x0000560848241c80 in start_wsrep_THD (arg=0x56084b511b20) at /home/jan/mysql/10.4/sql/wsrep_mysqld.cc:2668 #8 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #9 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Thread 1 (Thread 0x7f78d80dc700 (LWP 22835)): #0 __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:56 #1 0x0000560848adbbf7 in my_write_core (sig=6) at /home/jan/mysql/10.4/mysys/stacktrace.c:481 #2 0x000056084832609e in handle_fatal_signal (sig=6) at /home/jan/mysql/10.4/sql/signal_handler.cc:343 #3 <signal handler called> #4 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50 #5 0x00007f78e8aca535 in __GI_abort () at abort.c:79 #6 0x00007f78e8aca40f in __assert_fail_base (fmt=0x7f78e8c58588 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=0x5608490e24b1 "state_ == s_exec", file=0x5608490e1f68 "/home/jan/mysql/10.4/wsrep-lib/src/client_state.cpp", line=308, function=<optimized out>) at assert.c:92 #7 0x00007f78e8ada012 in __GI___assert_fail (assertion=0x5608490e24b1 "state_ == s_exec", file=0x5608490e1f68 "/home/jan/mysql/10.4/wsrep-lib/src/client_state.cpp", line=308, function=0x5608490e2b20 <wsrep::client_state::enter_toi(std::vector<wsrep::key, std::allocator<wsrep::key> > const&, wsrep::const_buffer const&, int)::__PRETTY_FUNCTION__> "int wsrep::client_state::enter_toi(const key_array&, const wsrep::const_buffer&, int)") at assert.c:101 #8 0x0000560848b898db in wsrep::client_state::enter_toi (this=0x7f783c0070a8, keys=std::vector of length 1, capacity 1 = {...}, buffer=..., flags=3) at /home/jan/mysql/10.4/wsrep-lib/src/client_state.cpp:308 #9 0x000056084823dd30 in wsrep_TOI_begin (thd=0x7f783c000f30, db=0x7f783c013d40 "test", table=0x7f783c013660 "t", table_list=0x0, alter_info=0x0) at /home/jan/mysql/10.4/sql/wsrep_mysqld.cc:1853 #10 0x000056084823eac7 in wsrep_to_isolation_begin (thd=0x7f783c000f30, db_=0x7f783c013d40 "test", table_=0x7f783c013660 "t", table_list=0x0, alter_info=0x0) at /home/jan/mysql/10.4/sql/wsrep_mysqld.cc:2005 #11 0x00005608480e1a49 in Sql_cmd_create_table_like::execute (this=0x7f783c013638, thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/sql_table.cc:11359 #12 0x0000560847ffe116 in mysql_execute_command (thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/sql_parse.cc:6082 #13 0x000056084800334b in mysql_parse (thd=0x7f783c000f30, rawbuf=0x7f783c0135a8 "create table t(a int)", length=21, parser_state=0x7f78d80db070, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.4/sql/sql_parse.cc:7892 #14 0x00005608480029c7 in wsrep_mysql_parse (thd=0x7f783c000f30, rawbuf=0x7f783c0135a8 "create table t(a int)", length=21, parser_state=0x7f78d80db070, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.4/sql/sql_parse.cc:7704 #15 0x0000560847fef5b9 in dispatch_command (command=COM_QUERY, thd=0x7f783c000f30, packet=0x7f783c008891 "create table t(a int)", packet_length=21, is_com_multi=false, is_next_command=false) at /home/jan/mysql/10.4/sql/sql_parse.cc:1811 #16 0x0000560847feded9 in do_command (thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/sql_parse.cc:1359 #17 0x00005608482e18ad in threadpool_process_request (thd=0x7f783c000f30) at /home/jan/mysql/10.4/sql/threadpool_common.cc:359 #18 0x00005608482e143d in tp_callback (c=0x56084b8c8cd0) at /home/jan/mysql/10.4/sql/threadpool_common.cc:186 #19 0x00005608485316be in worker_main (param=0x56084b882910) at /home/jan/mysql/10.4/sql/threadpool_generic.cc:1592 #20 0x0000560848a71202 in pfs_spawn_thread (arg=0x56084b960ee0) at /home/jan/mysql/10.4/storage/perfschema/pfs.cc:1862 #21 0x00007f78e8feb182 in start_thread (arg=<optimized out>) at pthread_create.c:486 #22 0x00007f78e8bc2b1f in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95   Compressed file /home/jan/mysql/10.4/mysql-test/var/5/log/galera.galera_mdev_13787-innodb/mysqld.1/data/core - saving '/home/jan/mysql/10.4/mysql-test/var/5/log/galera.galera_mdev_13787-innodb/' to '/home/jan/mysql/10.4/mysql-test/var/log/galera.galera_mdev_13787-innodb/'

          Same issue with MariaDB 10.4.6, galera 26.4.2-1, CentOS 7.6.1810 (Core) but as additional info:
          Nodes also crashes when using "one-thread-per-connection" and wsrep_slave_threads > 1

          2019-07-25  7:00:22 2 [Note] WSREP: Server status change joined -> synced
          2019-07-25  7:00:22 2 [Note] WSREP: Synchronized with group, ready for connections
          2019-07-25  7:00:22 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
          2019-07-25  7:00:38 0 [Note] InnoDB: Buffer pool(s) load completed at 190725  7:00:38
          mysqld: /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.4.6/wsrep-lib/include/wsrep/client_state.hpp:279: int wsrep::client_state::append_key(const wsrep::key&): Assertion `state_ == s_exec' failed.
          190725  7:01:02 [ERROR] mysqld got signal 6 ;
          This could be because you hit a bug. It is also possible that this binary
          or one of the libraries it was linked against is corrupt, improperly built,
          or misconfigured. This error can also be caused by malfunctioning hardware.
           
          To report this bug, see https://mariadb.com/kb/en/reporting-bugs
           
          We will try our best to scrape up some info that will hopefully help
          diagnose the problem, but since we have already crashed, 
          something is definitely wrong and this may fail.
           
          Server version: 10.4.6-MariaDB
          key_buffer_size=134217728
          read_buffer_size=131072
          max_used_connections=8
          max_threads=51
          thread_count=31
          It is possible that mysqld could use up to 
          key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 246983 K  bytes of memory
          Hope that's ok; if not, decrease some variables in the equation.
           
          Thread pointer: 0x7f5898022218
          Attempting backtrace. You can use the following information to find out
          where mysqld died. If you see no messages after this, something went
          terribly wrong...
          stack_bottom = 0x7f5b7834ac50 thread_stack 0x80000
          *** buffer overflow detected ***: /usr/sbin/mysqld terminated
          ======= Backtrace: =========
          /lib64/libc.so.6(__fortify_fail+0x37)[0x7f5cc1708b67]
          /lib64/libc.so.6(+0x115ce2)[0x7f5cc1706ce2]
          /lib64/libc.so.6(+0x117ac7)[0x7f5cc1708ac7]
          /usr/sbin/mysqld(my_addr_resolve+0xda)[0x55654bc5551a]
          /usr/sbin/mysqld(my_print_stacktrace+0x1c2)[0x55654bc3df12]
          /usr/sbin/mysqld(handle_fatal_signal+0x30f)[0x55654b6d07af]
          /lib64/libpthread.so.0(+0xf5d0)[0x7f5cc33545d0]
          /lib64/libc.so.6(gsignal+0x37)[0x7f5cc16272c7]
          /lib64/libc.so.6(abort+0x148)[0x7f5cc16289b8]
          /lib64/libc.so.6(+0x2f0e6)[0x7f5cc16200e6]
          /lib64/libc.so.6(+0x2f192)[0x7f5cc1620192]
          /usr/sbin/mysqld(wsrep_thd_append_key+0x197)[0x55654b64cba7]
          /usr/sbin/mysqld(+0xa35443)[0x55654b86c443]
          /usr/sbin/mysqld(+0xa45065)[0x55654b87c065]
          /usr/sbin/mysqld(+0xa46881)[0x55654b87d881]
          /usr/sbin/mysqld(_ZN7handler13ha_update_rowEPKhS1_+0x377)[0x55654b6dc937]
          /usr/sbin/mysqld(_Z12mysql_updateP3THDP10TABLE_LISTR4ListI4ItemES6_PS4_jP8st_orderybPySA_+0x1bc0)[0x55654b571400]
          /usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x3af9)[0x55654b4c9699]
          /usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_statebb+0x24b)[0x55654b4cf14b]
          /usr/sbin/mysqld(+0x6989f9)[0x55654b4cf9f9]
          /usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0x298f)[0x55654b4d2cff]
          /usr/sbin/mysqld(_Z10do_commandP3THD+0x11c)[0x55654b4d34ac]
          /usr/sbin/mysqld(_Z11tp_callbackP13TP_connection+0x20b)[0x55654b6a354b]
          /usr/sbin/mysqld(+0xa221f0)[0x55654b8591f0]
          /usr/sbin/mysqld(+0xdb88bd)[0x55654bbef8bd]
          /lib64/libpthread.so.0(+0x7dd5)[0x7f5cc334cdd5]
          /lib64/libc.so.6(clone+0x6d)[0x7f5cc16ef02d]
          

          blaxbox Rainer Schwarz added a comment - Same issue with MariaDB 10.4.6, galera 26.4.2-1, CentOS 7.6.1810 (Core) but as additional info: Nodes also crashes when using "one-thread-per-connection" and wsrep_slave_threads > 1 2019-07-25 7:00:22 2 [Note] WSREP: Server status change joined -> synced 2019-07-25 7:00:22 2 [Note] WSREP: Synchronized with group, ready for connections 2019-07-25 7:00:22 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-07-25 7:00:38 0 [Note] InnoDB: Buffer pool(s) load completed at 190725 7:00:38 mysqld: /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.4.6/wsrep-lib/include/wsrep/client_state.hpp:279: int wsrep::client_state::append_key(const wsrep::key&): Assertion `state_ == s_exec' failed. 190725 7:01:02 [ERROR] mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware.   To report this bug, see https://mariadb.com/kb/en/reporting-bugs   We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail.   Server version: 10.4.6-MariaDB key_buffer_size=134217728 read_buffer_size=131072 max_used_connections=8 max_threads=51 thread_count=31 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 246983 K bytes of memory Hope that's ok; if not, decrease some variables in the equation.   Thread pointer: 0x7f5898022218 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f5b7834ac50 thread_stack 0x80000 *** buffer overflow detected ***: /usr/sbin/mysqld terminated ======= Backtrace: ========= /lib64/libc.so.6(__fortify_fail+0x37)[0x7f5cc1708b67] /lib64/libc.so.6(+0x115ce2)[0x7f5cc1706ce2] /lib64/libc.so.6(+0x117ac7)[0x7f5cc1708ac7] /usr/sbin/mysqld(my_addr_resolve+0xda)[0x55654bc5551a] /usr/sbin/mysqld(my_print_stacktrace+0x1c2)[0x55654bc3df12] /usr/sbin/mysqld(handle_fatal_signal+0x30f)[0x55654b6d07af] /lib64/libpthread.so.0(+0xf5d0)[0x7f5cc33545d0] /lib64/libc.so.6(gsignal+0x37)[0x7f5cc16272c7] /lib64/libc.so.6(abort+0x148)[0x7f5cc16289b8] /lib64/libc.so.6(+0x2f0e6)[0x7f5cc16200e6] /lib64/libc.so.6(+0x2f192)[0x7f5cc1620192] /usr/sbin/mysqld(wsrep_thd_append_key+0x197)[0x55654b64cba7] /usr/sbin/mysqld(+0xa35443)[0x55654b86c443] /usr/sbin/mysqld(+0xa45065)[0x55654b87c065] /usr/sbin/mysqld(+0xa46881)[0x55654b87d881] /usr/sbin/mysqld(_ZN7handler13ha_update_rowEPKhS1_+0x377)[0x55654b6dc937] /usr/sbin/mysqld(_Z12mysql_updateP3THDP10TABLE_LISTR4ListI4ItemES6_PS4_jP8st_orderybPySA_+0x1bc0)[0x55654b571400] /usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x3af9)[0x55654b4c9699] /usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_statebb+0x24b)[0x55654b4cf14b] /usr/sbin/mysqld(+0x6989f9)[0x55654b4cf9f9] /usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0x298f)[0x55654b4d2cff] /usr/sbin/mysqld(_Z10do_commandP3THD+0x11c)[0x55654b4d34ac] /usr/sbin/mysqld(_Z11tp_callbackP13TP_connection+0x20b)[0x55654b6a354b] /usr/sbin/mysqld(+0xa221f0)[0x55654b8591f0] /usr/sbin/mysqld(+0xdb88bd)[0x55654bbef8bd] /lib64/libpthread.so.0(+0x7dd5)[0x7f5cc334cdd5] /lib64/libc.so.6(clone+0x6d)[0x7f5cc16ef02d]

          In addition to my previous post:
          I've done an update to 10.4.7. In the first review, this was a very bad idea. The "cluster" crashes even there is only one node "online". The only possible solution was to disable wsrep.
          Up to now, i've done some tests. First of all, i did an OS-Update to OEL8 and still using 10.4.7 for RHEL8. At first, this doesn't solve anything, but (i'm still using the same config-file as before) suddently the cluster-node-crash was not so "hard" as with CentOS7.6 (only the thread-pointer a.s.o and a 16 GB core-crash file was generated). With this additional information i was able to see at which point the node crashes. The problem was, that one user ist using 2 triggers for to different tables, and one of this triggers does an update in the other table. Therefore it's an design-problem that there exists a loop. But in the logs i'm able to see, that exactly at this point (yes, i tried this with one-thread-per-connection, pool-of-threads and wsrep_slave_threads > 1) the threads crashes.
          Due to previous versions (10.3.x) this problem only causes a unresolveable LOCK (i've a backup of the old logs), now the "LOCK" is the crash of the cluster node.

          After all of that, i informed the user, that he has to change this triggers - since this point, there is no problem anymore.

          I hope this will perhaps help to solve the problem.

          blaxbox Rainer Schwarz added a comment - In addition to my previous post: I've done an update to 10.4.7. In the first review, this was a very bad idea. The "cluster" crashes even there is only one node "online". The only possible solution was to disable wsrep. Up to now, i've done some tests. First of all, i did an OS-Update to OEL8 and still using 10.4.7 for RHEL8. At first, this doesn't solve anything, but (i'm still using the same config-file as before) suddently the cluster-node-crash was not so "hard" as with CentOS7.6 (only the thread-pointer a.s.o and a 16 GB core-crash file was generated). With this additional information i was able to see at which point the node crashes. The problem was, that one user ist using 2 triggers for to different tables, and one of this triggers does an update in the other table. Therefore it's an design-problem that there exists a loop. But in the logs i'm able to see, that exactly at this point (yes, i tried this with one-thread-per-connection, pool-of-threads and wsrep_slave_threads > 1) the threads crashes. Due to previous versions (10.3.x) this problem only causes a unresolveable LOCK (i've a backup of the old logs), now the "LOCK" is the crash of the cluster node. After all of that, i informed the user, that he has to change this triggers - since this point, there is no problem anymore. I hope this will perhaps help to solve the problem.

          blaxbox I think you were actually reporting a different issue than the original bug here.

          The backtrace you provided does not match the original one, and while the original report failed on CREATE TABLE yours failed on updating a row, and was related to a specific use of triggers.

          Can you check whether your problem is also fixed with the 10.4.8 release, or can still be reproduced there?

          hholzgra Hartmut Holzgraefe added a comment - blaxbox I think you were actually reporting a different issue than the original bug here. The backtrace you provided does not match the original one, and while the original report failed on CREATE TABLE yours failed on updating a row, and was related to a specific use of triggers. Can you check whether your problem is also fixed with the 10.4.8 release, or can still be reproduced there?

          People

            sysprg Julius Goryavsky
            rgpublic Ranjan Ghosh
            Votes:
            3 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.