Checking supported features... MariaDB Version 10.4.9-MariaDB-debug - SSL connections supported - binaries are debug compiled - binaries built with wsrep patch Using suites: galera Collecting tests... Installing system database... worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 16000..16019 ============================================================================== TEST RESULT TIME (ms) or COMMENT -------------------------------------------------------------------------- 191028 21:55:55 +19.744 galera.GCF-1081 [ disabled ] MDEV-18283 Galera test failure on galera.GCF-1081 191028 21:55:55 +0.000 galera.MW-329 [ disabled ] MDEV-19962 Galera test failure on MW-329 191028 21:55:55 +0.000 galera.MW-360 [ disabled ] needs rewrite to be MariaDB gtid compatible 191028 21:55:55 +0.000 galera.MW-388 [ disabled ] MDEV-19803 Long semaphore wait error on galera.MW-388 191028 21:55:55 +0.000 galera.galera_account_management [ disabled ] MariaDB 10.0 does not support ALTER USER 191028 21:55:55 +0.000 galera.galera_as_master_gtid [ disabled ] Requires MySQL GTID 191028 21:55:55 +0.000 galera.galera_as_master_gtid_change_master [ disabled ] Requires MySQL GTID 191028 21:55:55 +0.000 galera.galera_as_slave_gtid_replicate_do_db_cc [ disabled ] Requires MySQL GTID 191028 21:55:55 +0.000 galera.galera_as_slave_preordered [ disabled ] wsrep-preordered feature not merged to MariaDB 191028 21:55:55 +0.000 galera.galera_as_slave_replication_bundle [ disabled ] MDEV-15785 OPTION_GTID_BEGIN is set in Gtid_log_event::do_apply_event() 191028 21:55:55 +0.000 galera.galera_bf_abort_group_commit [ disabled ] MDEV-18282 Galera test failure on galera.galera_bf_abort_group_commit 191028 21:55:55 +0.000 galera.galera_binlog_rows_query_log_events [ disabled ] MariaDB does not support binlog_rows_query_log_events 191028 21:55:55 +0.000 galera.galera_binlog_stmt_autoinc [ disabled ] MDEV-19959 Galera test failure on galera_binlog_stmt_autoinc 191028 21:55:55 +0.000 galera.galera_concurrent_ctas [ disabled ] MDEV-18180 Galera test failure on galera.galera_concurrent_ctas 191028 21:55:55 +0.000 galera.galera_encrypt_tmp_files [ disabled ] Get error failed to enable encryption of temporary files 191028 21:55:55 +0.000 galera.galera_flush [ disabled ] MariaDB does not have global.thread_statistics 191028 21:55:55 +0.000 galera.galera_gcache_recover_manytrx [ disabled ] MDEV-18834 Galera test failure 191028 21:55:55 +0.000 galera.galera_ist_mariabackup [ disabled ] MDEV-18829 test leaves port open 191028 21:55:55 +0.000 galera.galera_ist_progress [ disabled ] MDEV-15236 fails when trying to read transfer status 191028 21:55:55 +0.000 galera.galera_kill_largechanges [ disabled ] MDEV-18179 Galera test failure on galera.galera_kill_largechanges 191028 21:55:55 +0.000 galera.galera_kill_nochanges [ disabled ] MDEV-18280 Galera test failure on galera_split_brain and galera_kill_nochanges 191028 21:55:55 +0.000 galera.galera_many_tables_nopk [ disabled ] MDEV-18182 Galera test failure on galera.galera_many_tables_nopk 191028 21:55:55 +0.000 galera.galera_migrate [ disabled ] MariaDB does not support START SLAVE USER 191028 21:55:55 +0.000 galera.galera_split_brain [ disabled ] MDEV-18280 Galera test failure on galera_split_brain and galera_kill_nochanges 191028 21:55:55 +0.000 galera.galera_ssl_upgrade [ disabled ] MDEV-19950 Galera test failure on galera_ssl_upgrade 191028 21:55:55 +0.000 galera.galera_var_node_address [ disabled ] MDEV-20485 Galera test failure 191028 21:55:55 +0.000 galera.galera_var_notify_cmd [ disabled ] MDEV-20600 Galera test galera_var_notify_cmd causes hang 191028 21:55:55 +0.000 galera.galera_var_reject_queries [ disabled ] assertion in inline_mysql_socket_send 191028 21:55:55 +0.000 galera.galera_var_retry_autocommit [ disabled ] MDEV-18181 Galera test failure on galera.galera_var_retry_autocommit 191028 21:55:55 +0.000 galera.galera_wan [ disabled ] MDEV-17259 Test failure on galera.galera_wan 191028 21:55:55 +0.000 galera.mysql-wsrep#198 [ disabled ] MDEV-18935 Galera test mysql-wsrep#198 sporaric assertion transaction.cpp:362: int wsrep::transaction::before_commit(): Assertion `state() == s_executing || state() == s_committing || state() == s_must_abort || state() == s_replaying' failed. 191028 21:55:55 +0.000 galera.partition [ disabled ] MDEV-19958 Galera test failure on galera.partition 191028 21:55:55 +0.000 galera.query_cache [ disabled ] MDEV-15805 Test failure on galera.query_cache 191028 21:56:07 +12.485 galera.galera_binlog_checksum 'innodb' [ pass ] 4383 191028 21:56:32 +24.488 galera.MW-313 'innodb' [ pass ] 4636 191028 21:56:36 +4.245 galera.MW-86-wait1 'innodb' [ pass ] 3781 191028 21:56:42 +6.264 galera.MW-86-wait8 'innodb' [ pass ] 5925 191028 21:57:04 +21.992 galera.galera_binlog_event_max_size_min 'innodb' [ pass ] 3286 191028 21:58:12 +67.722 galera.galera_binlog_event_max_size_max 'innodb' [ pass ] 47746 191028 21:58:35 +22.575 galera.enforce_storage_engine2 'innodb' [ pass ] 4309 191028 21:58:57 +22.267 galera.galera_log_output_csv 'innodb' [ pass ] 4563 191028 21:59:23 +26.251 galera.MW-44 'innodb' [ pass ] 6791 191028 21:59:48 +24.450 galera.galera_mdev_13787 'innodb' [ pass ] 4977 191028 22:00:16 +28.813 galera.galera_applier_ftwrl_table_alter 'innodb' [ pass ] 10118 191028 22:00:57 +40.594 galera.galera_bf_background_statistics 'innodb' [ pass ] 20749 191028 22:01:20 +22.915 galera.galera_gtid 'innodb' [ pass ] 4059 191028 22:01:46 +25.854 galera.galera_forced_binlog_format 'innodb' [ pass ] 6604 191028 22:02:08 +22.502 galera.galera_sbr_binlog 'innodb' [ pass ] 3864 191028 22:02:33 +25.102 galera.galera_log_bin 'innodb' [ pass ] 6409 191028 22:02:56 +22.630 galera.galera_v1_row_events 'innodb' [ pass ] 3849 191028 22:03:19 +22.546 galera.galera_var_innodb_disallow_writes 'innodb' [ pass ] 4889 191028 22:03:25 +6.707 galera.mdev_18730 'innodb' [ pass ] 6368 191028 22:04:13 +47.630 galera.galera_flush_local 'innodb' [ pass ] 29901 191028 22:04:36 +23.288 galera.galera_query_cache 'innodb' [ pass ] 5518 191028 22:04:43 +6.583 galera.galera_query_cache_sync_wait 'innodb' [ pass ] 6124 191028 22:06:12 +89.558 galera.mysql-wsrep#201 'innodb' [ pass ] 71501 191028 22:06:35 +22.772 galera.galera_var_auto_inc_control_on 'innodb' [ pass ] 3873 191028 22:06:59 +23.437 galera.galera_sync_wait_upto 'innodb' [ pass ] 5581 191028 22:07:19 +20.484 galera.galera_wsrep_new_cluster 'innodb' [ pass ] 4704 191028 22:07:32 +13.257 galera.galera_wsrep_log_conficts 'innodb' [ pass ] 3607 191028 22:07:52 +19.831 galera.galera_var_sst_auth 'innodb' [ pass ] 2082 191028 22:08:27 +34.430 galera.GAL-419 'innodb' [ pass ] 15495 191028 22:16:58 +511.428 galera.MW-328A 'innodb' [ pass ] 510604 191028 22:28:38 +699.595 galera.MW-328B 'innodb' [ pass ] 696754 191028 22:43:13 +875.943 galera.MW-328C 'innodb' [ pass ] 875398 191028 22:45:02 +108.960 galera.galera_bf_lock_wait 'innodb' [ pass ] 106247 191028 22:45:47 +45.033 galera.galera_fulltext 'innodb' [ pass ] 44359 191028 22:45:53 +5.271 galera.galera_many_columns 'innodb' [ pass ] 5015 191028 22:48:51 +178.500 galera.galera_many_tables_pk 'innodb' [ pass ] 177632 191028 22:49:21 +29.776 galera.galera_parallel_autoinc_largetrx 'innodb' [ fail ] Test ended at 2019-10-28 22:49:21 CURRENT_TEST: galera.galera_parallel_autoinc_largetrx --- /home/stepan/mariadb/10.4/github/mysql-test/suite/galera/r/galera_parallel_autoinc_largetrx.result 2019-10-17 14:30:27.377278033 +0300 +++ /home/stepan/mariadb/10.4/github/mysql-test/suite/galera/r/galera_parallel_autoinc_largetrx.reject 2019-10-28 22:49:21.004375281 +0200 @@ -16,7 +16,7 @@ connection node_1; SELECT COUNT(*) FROM t1; COUNT(*) -30000 +20000 SELECT COUNT(worker[1] Test still running: galera.galera_gcs_fc_limit worker[1] Test still running: galera.galera_gcs_fc_limit worker[1] Test still running: galera.galera_gcs_fc_limit worker[1] Test still running: galera.galera_gcs_fc_limit worker[1] Trying to dump core for [mysqltest - pid: 6357, winpid: 6357] worker[1] Trying to dump core for [mysqld.1 - pid: 3981, winpid: 3981] worker[1] Trying to dump core for [mysqld.2 - pid: 5902, winpid: 5902] DISTINCT f1) FROM t1; COUNT(DISTINCT f1) 30000 mysqltest: Result content mismatch - saving '/home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_parallel_autoinc_largetrx-innodb/' to '/home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_parallel_autoinc_largetrx-innodb/' 191028 22:55:31 +369.617 galera.galera_parallel_autoinc_manytrx 'innodb' [ pass ] 350076 191028 22:55:54 +23.448 galera.galera_pc_recovery 'innodb' [ pass ] 15225 191028 22:58:30 +155.556 galera.galera_rsu_add_pk 'innodb' [ pass ] 136776 191028 23:03:18 +288.283 galera.galera_rsu_drop_pk 'innodb' [ pass ] 287444 191028 23:04:14 +55.596 galera.galera_toi_ddl_error 'innodb' [ pass ] 55163 191028 23:04:54 +40.905 galera.galera_toi_ddl_fk_insert 'innodb' [ pass ] 40412 191028 23:05:39 +44.554 galera.galera_toi_ddl_fk_update 'innodb' [ pass ] 44053 191028 23:06:16 +37.435 galera.galera_var_load_data_splitting 'innodb' [ pass ] 33914 191028 23:08:22 +125.461 galera.galera_wsrep_desync_wsrep_on 'innodb' [ pass ] 124605 191028 23:08:28 +6.473 galera.GAL-382 'innodb' [ pass ] 5756 191028 23:08:50 +21.261 galera.GAL-401 'innodb' [ pass ] 20782 191028 23:09:08 +18.056 galera.GAL-480 'innodb' [ pass ] 17478 191028 23:09:13 +5.122 galera.GCF-939 'innodb' [ pass ] 4588 191028 23:09:19 +6.125 galera.MDEV-16509 'innodb' [ pass ] 5487 191028 23:09:28 +8.732 galera.MDEV-20225 'innodb' [ fail ] Test ended at 2019-10-28 23:09:28 CURRENT_TEST: galera.MDEV-20225 --- /home/stepan/mariadb/10.4/github/mysql-test/suite/galera/r/MDEV-20225.result 2019-10-17 14:30:27.368278056 +0300 +++ /home/stepan/mariadb/10.4/github/mysql-test/suite/galera/r/MDEV-20225.reject 2019-10-28 23:09:27.824233482 +0200 @@ -18,5 +18,6 @@ SET GLOBAL wsrep_slave_threads = 1; SHOW TRIGGERS; Trigger Event Table Statement Timing Created sql_mode Definer character_set_client collation_connection Database Collation +tr1 INSERT t1 INSERT INTO t2 VALUES (NULL, NEW.f1) BEFORE 2019-10-28 23:09:23.00 STRICT_TRANS_TABLES,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION root@localhost latin1 latin1_swedish_ci latin1_swedish_ci DROP TABLE t1; DROP TABLE t2; mysqltest: Result length mismatch - saving '/home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.MDEV-20225-innodb/' to '/home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.MDEV-20225-innodb/' 191028 23:10:02 +34.480 galera.MW-252 'innodb' [ pass ] 25212 191028 23:10:14 +12.017 galera.MW-258 'innodb' [ pass ] 11755 191028 23:10:20 +6.099 galera.MW-259 'innodb' [ pass ] 5707 191028 23:10:29 +8.481 galera.MW-285 'innodb' [ pass ] 7607 191028 23:10:34 +5.189 galera.MW-286 'innodb' [ pass ] 4757 191028 23:10:45 +10.866 galera.MW-292 'innodb' [ pass ] 10308 191028 23:10:50 +4.765 galera.MW-309 'innodb' [ pass ] 4356 191028 23:10:56 +6.816 galera.MW-328D 'innodb' [ pass ] 6521 191028 23:11:04 +7.550 galera.MW-328E 'innodb' [ pass ] 7223 191028 23:11:08 +4.080 galera.MW-357 'innodb' [ pass ] 3771 191028 23:11:42 +34.387 galera.MW-369 'innodb' [ pass ] 33693 191028 23:12:11 +28.520 galera.MW-402 'innodb' [ pass ] 28075 191028 23:12:14 +3.345 galera.MW-416 'innodb' [ pass ] 2986 191028 23:12:18 +3.788 galera.basic 'innodb' [ pass ] 3504 191028 23:12:22 +4.322 galera.binlog_checksum 'innodb' [ pass ] 3917 191028 23:12:40 +17.686 galera.create 'innodb' [ pass ] 17168 191028 23:12:45 +4.914 galera.enforce_storage_engine 'innodb' [ pass ] 4336 191028 23:13:10 +24.896 galera.ev51914 'innodb' [ pass ] 24460 191028 23:13:22 +11.910 galera.fk 'innodb' [ pass ] 11486 191028 23:13:42 +20.006 galera.galera#500 'innodb' [ pass ] 19587 191028 23:13:44 +2.356 galera.galera#505 'innodb' [ pass ] 2048 191028 23:14:43 +59.007 galera.galera_FK_duplicate_client_insert 'innodb' [ pass ] 58123 191028 23:15:06 +22.869 galera.galera_admin 'innodb' [ pass ] 22404 191028 23:15:13 +7.379 galera.galera_alter_engine_innodb 'innodb' [ pass ] 6931 191028 23:15:19 +5.609 galera.galera_alter_engine_myisam 'innodb' [ pass ] 5168 191028 23:15:25 +6.489 galera.galera_alter_table_force 'innodb' [ pass ] 6079 191028 23:15:30 +4.972 galera.galera_applier_ftwrl_table 'innodb' [ pass ] 4669 191028 23:15:35 +4.370 galera.galera_bf_abort 'innodb' [ pass ] 4015 191028 23:15:39 +4.269 galera.galera_bf_abort_at_after_statement 'innodb' [ pass ] 3845 191028 23:15:44 +4.875 galera.galera_bf_abort_flush_for_export 'innodb' [ pass ] 4569 191028 23:15:49 +4.671 galera.galera_bf_abort_for_update 'innodb' [ pass ] 4331 191028 23:15:53 +4.490 galera.galera_bf_abort_ftwrl 'innodb' [ pass ] 4118 191028 23:15:58 +4.742 galera.galera_bf_abort_get_lock 'innodb' [ pass ] 4325 191028 23:16:02 +3.958 galera.galera_bf_abort_lock_table 'innodb' [ pass ] 3666 191028 23:16:16 +13.810 galera.galera_bf_abort_shutdown 'innodb' [ pass ] 13395 191028 23:16:20 +4.311 galera.galera_bf_abort_sleep 'innodb' [ pass ] 4034 191028 23:16:26 +6.537 galera.galera_binlog_cache_size 'innodb' [ pass ] 6123 191028 23:16:40 +13.361 galera.galera_binlog_row_image 'innodb' [ pass ] 12868 191028 23:16:45 +4.976 galera.galera_change_user 'innodb' [ pass ] 4668 191028 23:16:47 +2.289 galera.galera_commit_empty 'innodb' [ pass ] 2022 191028 23:16:52 +4.973 galera.galera_create_function 'innodb' [ pass ] 4656 191028 23:16:58 +6.382 galera.galera_create_procedure 'innodb' [ pass ] 5990 191028 23:17:25 +26.548 galera.galera_create_table_as_select 'innodb' [ pass ] 25955 191028 23:17:36 +11.162 galera.galera_create_table_like 'innodb' [ pass ] 10787 191028 23:17:49 +12.407 galera.galera_create_trigger 'innodb' [ pass ] 11997 191028 23:17:59 +10.431 galera.galera_ddl_multiline 'innodb' [ pass ] 9989 191028 23:18:01 +2.491 galera.galera_defaults 'innodb' [ pass ] 2069 191028 23:18:11 +9.008 galera.galera_delete_limit 'innodb' [ pass ] 8728 191028 23:18:20 +9.657 galera.galera_desync_overlapped 'innodb' [ pass ] 9089 191028 23:19:00 +39.505 galera.galera_drop_database 'innodb' [ pass ] 38927 191028 23:19:06 +5.891 galera.galera_drop_multi 'innodb' [ pass ] 5560 191028 23:19:12 +6.221 galera.galera_enum 'innodb' [ pass ] 5816 191028 23:19:17 +4.781 galera.galera_events 'innodb' [ pass ] 4398 191028 23:19:46 +28.976 galera.galera_events2 'innodb' [ pass ] 28638 191028 23:19:55 +9.206 galera.galera_fk_cascade_delete 'innodb' [ pass ] 8415 191028 23:20:03 +8.697 galera.galera_fk_cascade_update 'innodb' [ pass ] 8180 191028 23:20:11 +7.126 galera.galera_fk_conflict 'innodb' [ pass ] 6770 191028 23:20:19 +8.359 galera.galera_fk_mismatch 'innodb' [ pass ] 7989 191028 23:20:27 +8.105 galera.galera_fk_multicolumn 'innodb' [ pass ] 7730 191028 23:20:33 +5.682 galera.galera_fk_multitable 'innodb' [ pass ] 5346 191028 23:20:40 +7.277 galera.galera_fk_no_pk 'innodb' [ pass ] 6788 191028 23:20:45 +4.522 galera.galera_fk_selfreferential 'innodb' [ pass ] 4135 191028 23:20:52 +7.976 galera.galera_fk_setnull 'innodb' [ pass ] 7615 191028 23:20:59 +6.216 galera.galera_ftwrl 'innodb' [ pass ] 5889 191028 23:21:05 +6.649 galera.galera_ftwrl_drain 'innodb' [ pass ] 6292 191029 0:52:05 +5459.913 galera.galera_gcs_fc_limit 'innodb' [ fail ] timeout after 5400 seconds Test ended at 2019-10-29 00:52:05 Test case timeout after 5400 seconds == /home/stepan/mariadb/10.4/github/mysql-test/var/log/galera_gcs_fc_limit.log == connection node_2; connection node_1; CREATE TABLE t1 (f1 INTEGER NOT NULL PRIMARY KEY AUTO_INCREMENT,B INTEGER) ENGINE=InnoDB; INSERT INTO t1 VALUES (1,1); connection node_2; SET SESSION wsrep_sync_wait=15; SELECT COUNT(*) FROM t1; COUNT(*) 1 SET GLOBAL wsrep_provider_options = 'gcs.fc_limit=1'; LOCK TABLE t1 WRITE; connection node_1; FLUSH STATUS; INSERT INTO t1 VALUES (2,2); INSERT INTO t1 VALUES (3,3); INSERT INTO t1 VALUES (4,4); == /home/stepan/mariadb/10.4/github/mysql-test/var/tmp/analyze-timeout-mysqld.1.err == mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/home/stepan/mariadb/10.4/github/mysql-test/var/tmp/mysqld.1.soc' (111) == /home/stepan/mariadb/10.4/github/mysql-test/var/tmp/analyze-timeout-mysqld.2.err == mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/home/stepan/mariadb/10.4/github/mysql-test/var/tmp/mysqld.2.soc' (111) - found 'core.3984' (0/5) Trying 'dbx' to get a backtrace Trying 'gdb' to get a backtrace from coredump /home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_gcs_fc_limit-innodb/mysqld.1/data/core.3984 Core generated by '/home/stepan/mariadb/10.4/github/sql/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- [New LWP 3984] [New LWP 3985] [New LWP 3987] [New LWP 4013] [New LWP 3988] [New LWP 4015] [New LWP 3990] [New LWP 4016] [New LWP 3992] [New LWP 3993] [New LWP 3991] [New LWP 3996] [New LWP 4317] [New LWP 4002] [New LWP 3997] [New LWP 4022] [New LWP 4008] [New LWP 3999] [New LWP 4018] [New LWP 4011] [New LWP 4005] [New LWP 4007] [New LWP 4012] [New LWP 4003] [New LWP 4006] [New LWP 4267] [New LWP 4009] [New LWP 3994] [New LWP 4014] [New LWP 3986] [New LWP 4019] [New LWP 4017] [New LWP 4010] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `/home/stepan/mariadb/10.4/github/sql/mysqld --defaults-group-suffix=.1 --defaul'. Program terminated with signal 6, Aborted. #0 0x00007f99f87a39d1 in pthread_kill () from /lib64/libpthread.so.0 #0 0x00007f99f87a39d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x000055eb231190f6 in my_write_core (sig=6) at /home/stepan/mariadb/10.4/github/mysys/stacktrace.c:481 #2 0x000055eb22885964 in handle_fatal_signal (sig=6) at /home/stepan/mariadb/10.4/github/sql/signal_handler.cc:343 #3 #4 0x00007f99f6b5120d in poll () from /lib64/libc.so.6 #5 0x000055eb223ea2db in handle_connections_sockets () at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:6455 #6 0x000055eb223e9576 in mysqld_main (argc=162, argv=0x55eb25ca5130) at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:5891 #7 0x000055eb223dd095 in main (argc=23, argv=0x7ffd50f6d398) at /home/stepan/mariadb/10.4/github/sql/main.cc:25 Thread 33 (Thread 0x7f99c2ffd700 (LWP 4010)): #0 0x00007f99f87a5d1d in fsync () from /lib64/libpthread.so.0 #1 0x000055eb22bc75a7 in os_file_fsync_posix (file=19) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2366 #2 0x000055eb22bc78e2 in os_file_flush_func (file=19) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2459 #3 0x000055eb22e717f5 in pfs_os_file_flush_func (file=..., src_file=0x55eb2353d420 "/home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc", src_line=751) at /home/stepan/mariadb/10.4/github/storage/innobase/include/os0file.ic:406 #4 0x000055eb22e74186 in fil_flush_low (space=0x55eb261cbff0, metadata=false) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:751 #5 0x000055eb22e81b0f in fil_flush (space_id=4294967280) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4462 #6 0x000055eb22b9a3f8 in log_write_flush_to_disk_low () at /home/stepan/mariadb/10.4/github/storage/innobase/log/log0log.cc:809 #7 0x000055eb22b9aede in log_write_up_to (lsn=3464963, flush_to_disk=true, rotate_key=false) at /home/stepan/mariadb/10.4/github/storage/innobase/log/log0log.cc:1046 #8 0x000055eb22b9b046 in log_buffer_sync_in_background (flush=true) at /home/stepan/mariadb/10.4/github/storage/innobase/log/log0log.cc:1091 #9 0x000055eb22ceec7f in srv_sync_log_buffer_in_background () at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:1997 #10 0x000055eb22cef28c in srv_master_do_active_tasks () at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2156 #11 0x000055eb22ceff93 in srv_master_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2381 #12 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #13 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 32 (Thread 0x7f99a6ffd700 (LWP 4017)): #0 0x00007f99f87a2965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb22bd4377 in os_event::wait (this=0x55eb25f5f5c0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x000055eb22bd3e6b in os_event::wait_low (this=0x55eb25f5f5c0, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x000055eb22bd416e in os_event_wait_low (event=0x55eb25f5f5c0, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x000055eb22dd77d9 in buf_resize_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/buf/buf0buf.cc:3199 #5 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 31 (Thread 0x7f99e8178700 (LWP 4019)): #0 0x00007f99f6a9540a in sigwaitinfo () from /lib64/libc.so.6 #1 0x000055eb223dd114 in my_sigwait (set=0x7f99e8177cf0, sig=0x7f99e8177cb4, code=0x7f99e8177cb8) at /home/stepan/mariadb/10.4/github/include/my_pthread.h:198 #2 0x000055eb223e3a8d in signal_hand (arg=0x0) at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:3243 #3 0x000055eb230a74a5 in pfs_spawn_thread (arg=0x55eb2623dac0) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #4 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 30 (Thread 0x7f99eb5fe700 (LWP 3986)): #0 0x00007f99f87a2965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f99f06fddd7 in gu::Lock::wait (cond=..., this=0x7f99eb5fdbf0) at galerautils/src/gu_lock.hpp:45 #2 0x00007f99f06fde69 in galera::ServiceThd::thd_func (arg=0x55eb25e1f6b8) at galera/src/galera_service_thd.cpp:30 #3 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 29 (Thread 0x7f99c0ff9700 (LWP 4014)): #0 0x00007f99f87a2965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb22bd4377 in os_event::wait (this=0x55eb25f5f2c0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x000055eb22bd3e6b in os_event::wait_low (this=0x55eb25f5f2c0, reset_sig_count=2850) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x000055eb22bd416e in os_event_wait_low (event=0x55eb25f5f2c0, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x000055eb22cec328 in srv_resume_thread (slot=0x55eb23ce8e10 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:909 #5 0x000055eb22cf05e9 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 28 (Thread 0x7f99d1670700 (LWP 3994)): #0 0x00007f99f836f644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055eb22bc5dad in LinuxAIOHandler::collect (this=0x7f99d166fb00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x000055eb22bc63f6 in LinuxAIOHandler::poll (this=0x7f99d166fb00, m1=0x7f99d166fba8, m2=0x7f99d166fbb0, request=0x7f99d166fbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x000055eb22bc6559 in os_aio_linux_handler (global_segment=1, m1=0x7f99d166fba8, m2=0x7f99d166fbb0, request=0x7f99d166fbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x000055eb22bcb2c0 in os_aio_handler (segment=1, m1=0x7f99d166fba8, m2=0x7f99d166fbb0, request=0x7f99d166fbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x000055eb22e814f9 in fil_aio_wait (segment=1) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x000055eb22cf2e42 in io_handler_thread (arg=0x55eb23f2c988 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 27 (Thread 0x7f99c37fe700 (LWP 4009)): #0 0x00007f99f87a2d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb22bd3d00 in os_event::timed_wait (this=0x55eb260fb710, abstime=0x7f99c37fdb70) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x000055eb22bd3fa9 in os_event::wait_time_low (this=0x55eb260fb710, time_in_usec=5000000, reset_sig_count=7) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x000055eb22bd4149 in os_event_wait_time_low (event=0x55eb260fb710, time_in_usec=5000000, reset_sig_count=7) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x000055eb22d5c563 in ib_wqueue_timedwait (wq=0x55eb260f4da0, wait_in_usecs=5000000) at /home/stepan/mariadb/10.4/github/storage/innobase/ut/ut0wqueue.cc:163 #5 0x000055eb22ecf23d in fts_optimize_thread (arg=0x55eb260f4da0) at /home/stepan/mariadb/10.4/github/storage/innobase/fts/fts0opt.cc:2865 #6 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 26 (Thread 0x7f99e8097700 (LWP 4267)): #0 0x00007f99f87a2d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb2311ea6b in safe_cond_timedwait (cond=0x55eb23eae060 , mp=0x55eb23eb0a20 , abstime=0x7f99e8096c60, file=0x55eb231dcd68 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:546 #2 0x000055eb223dda15 in inline_mysql_cond_timedwait (that=0x55eb23eae060 , mutex=0x55eb23eb0a20 , abstime=0x7f99e8096c60, src_file=0x55eb231dedb8 "/home/stepan/mariadb/10.4/github/sql/mysqld.cc", src_line=2686) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1204 #3 0x000055eb223e2b2c in cache_thread (thd=0x7f997c000b00) at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:2685 #4 0x000055eb223e2dd2 in one_thread_per_connection_end (thd=0x7f997c000b00, put_in_cache=true) at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:2771 #5 0x000055eb226a7dcf in do_handle_one_connection (connect=0x55eb26263920) at /home/stepan/mariadb/10.4/github/sql/sql_connect.cc:1423 #6 0x000055eb226a7a80 in handle_one_connection (arg=0x55eb26263920) at /home/stepan/mariadb/10.4/github/sql/sql_connect.cc:1316 #7 0x000055eb230a74a5 in pfs_spawn_thread (arg=0x55eb25da8ee0) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #8 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #9 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 25 (Thread 0x7f99c8ff9700 (LWP 4006)): #0 0x00007f99f87a2d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb22bd3d00 in os_event::timed_wait (this=0x55eb25f5f3c0, abstime=0x7f99c8ff8bb0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x000055eb22bd3fa9 in os_event::wait_time_low (this=0x55eb25f5f3c0, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x000055eb22bd4149 in os_event_wait_time_low (event=0x55eb25f5f3c0, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x000055eb22cee789 in srv_error_monitor_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:1851 #5 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 24 (Thread 0x7f99ca7fc700 (LWP 4003)): #0 0x00007f99f87a2d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb22bd3d00 in os_event::timed_wait (this=0x55eb25f5f540, abstime=0x7f99ca7fbb00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x000055eb22bd3fa9 in os_event::wait_time_low (this=0x55eb25f5f540, time_in_usec=690000, reset_sig_count=20) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x000055eb22bd4149 in os_event_wait_time_low (event=0x55eb25f5f540, time_in_usec=690000, reset_sig_count=20) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x000055eb22dfe358 in pc_sleep_if_needed (next_loop_time=1042666555, sig_count=20, cur_time=1042665865) at /home/stepan/mariadb/10.4/github/storage/innobase/buf/buf0flu.cc:2643 #5 0x000055eb22dff4fc in buf_flush_page_cleaner_coordinator () at /home/stepan/mariadb/10.4/github/storage/innobase/buf/buf0flu.cc:3102 #6 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 23 (Thread 0x7f99c1ffb700 (LWP 4012)): #0 0x00007f99f87a2965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb22bd4377 in os_event::wait (this=0x55eb25f5f340) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x000055eb22bd3e6b in os_event::wait_low (this=0x55eb25f5f340, reset_sig_count=2706) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x000055eb22bd416e in os_event_wait_low (event=0x55eb25f5f340, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x000055eb22cec328 in srv_resume_thread (slot=0x55eb23ce8f10 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:909 #5 0x000055eb22cf05e9 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 22 (Thread 0x7f99c9ffb700 (LWP 4007)): #0 0x00007f99f87a2d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb22bd3d00 in os_event::timed_wait (this=0x55eb25f5f440, abstime=0x7f99c9ffad30) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x000055eb22bd3fa9 in os_event::wait_time_low (this=0x55eb25f5f440, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x000055eb22bd4149 in os_event_wait_time_low (event=0x55eb25f5f440, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x000055eb22cee20f in srv_monitor_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:1687 #5 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 21 (Thread 0x7f99c97fa700 (LWP 4005)): #0 0x00007f99f87a2d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb22bd3d00 in os_event::timed_wait (this=0x55eb2619a6b0, abstime=0x7f99c97f9d50) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x000055eb22bd3fa9 in os_event::wait_time_low (this=0x55eb2619a6b0, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x000055eb22bd4149 in os_event_wait_time_low (event=0x55eb2619a6b0, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x000055eb22b96527 in lock_wait_timeout_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/lock/lock0wait.cc:522 #5 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 20 (Thread 0x7f99c27fc700 (LWP 4011)): #0 0x00007f99f87a2965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb22bd4377 in os_event::wait (this=0x55eb25f5f1c0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x000055eb22bd3e6b in os_event::wait_low (this=0x55eb25f5f1c0, reset_sig_count=956) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x000055eb22bd416e in os_event_wait_low (event=0x55eb25f5f1c0, reset_sig_count=956) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x000055eb22cec328 in srv_resume_thread (slot=0x55eb23ce8c10 , sig_count=956, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:909 #5 0x000055eb22cf0aa0 in srv_purge_coordinator_suspend (slot=0x55eb23ce8c10 , rseg_history_len=3) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2657 #6 0x000055eb22cf0dd1 in srv_purge_coordinator_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2738 #7 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7f99a67fc700 (LWP 4018)): #0 0x00007f99f87a2965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb2311e769 in safe_cond_wait (cond=0x7f99a67fbc70, mp=0x7f99a67fbcb0, file=0x55eb2340bce0 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:492 #2 0x000055eb22ac715d in inline_mysql_cond_wait (that=0x7f99a67fbc70, mutex=0x7f99a67fbcb0, src_file=0x55eb2340d7f8 "/home/stepan/mariadb/10.4/github/storage/innobase/handler/ha_innodb.cc", src_line=288) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1178 #3 0x000055eb22acca55 in thd_destructor_proxy () at /home/stepan/mariadb/10.4/github/storage/innobase/handler/ha_innodb.cc:288 #4 0x000055eb230a74a5 in pfs_spawn_thread (arg=0x55eb26208070) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #5 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7f99cb7fe700 (LWP 3999)): #0 0x00007f99f836f644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055eb22bc5dad in LinuxAIOHandler::collect (this=0x7f99cb7fdb00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x000055eb22bc63f6 in LinuxAIOHandler::poll (this=0x7f99cb7fdb00, m1=0x7f99cb7fdba8, m2=0x7f99cb7fdbb0, request=0x7f99cb7fdbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x000055eb22bc6559 in os_aio_linux_handler (global_segment=4, m1=0x7f99cb7fdba8, m2=0x7f99cb7fdbb0, request=0x7f99cb7fdbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x000055eb22bcb2c0 in os_aio_handler (segment=4, m1=0x7f99cb7fdba8, m2=0x7f99cb7fdbb0, request=0x7f99cb7fdbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x000055eb22e814f9 in fil_aio_wait (segment=4) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x000055eb22cf2e42 in io_handler_thread (arg=0x55eb23f2c9a0 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 17 (Thread 0x7f99c3fff700 (LWP 4008)): #0 0x00007f99f87a2d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb22bd3d00 in os_event::timed_wait (this=0x55eb261cc6d0, abstime=0x7f99c3ffed70) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x000055eb22bd3fa9 in os_event::wait_time_low (this=0x55eb261cc6d0, time_in_usec=10000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x000055eb22bd4149 in os_event_wait_time_low (event=0x55eb261cc6d0, time_in_usec=10000000, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x000055eb22e686ca in dict_stats_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/dict/dict0stats_bg.cc:476 #5 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7f99e812d700 (LWP 4022)): #0 0x00007f99f87a2965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb2311e769 in safe_cond_wait (cond=0x55eb23eae0a0 , mp=0x55eb23eb1320 , file=0x55eb231ed0c0 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1167) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:492 #2 0x000055eb2241008e in inline_mysql_cond_wait (that=0x55eb23eae0a0 , mutex=0x55eb23eb1320 , src_file=0x55eb231edc20 "/home/stepan/mariadb/10.4/github/sql/slave.cc", src_line=519) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1167 #3 0x000055eb224119cb in handle_slave_background (arg=0x0) at /home/stepan/mariadb/10.4/github/sql/slave.cc:519 #4 0x000055eb230a74a5 in pfs_spawn_thread (arg=0x55eb263631b0) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #5 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7f99cbfff700 (LWP 3997)): #0 0x00007f99f836f644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055eb22bc5dad in LinuxAIOHandler::collect (this=0x7f99cbffeb00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x000055eb22bc63f6 in LinuxAIOHandler::poll (this=0x7f99cbffeb00, m1=0x7f99cbffeba8, m2=0x7f99cbffebb0, request=0x7f99cbffebe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x000055eb22bc6559 in os_aio_linux_handler (global_segment=3, m1=0x7f99cbffeba8, m2=0x7f99cbffebb0, request=0x7f99cbffebe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x000055eb22bcb2c0 in os_aio_handler (segment=3, m1=0x7f99cbffeba8, m2=0x7f99cbffebb0, request=0x7f99cbffebe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x000055eb22e814f9 in fil_aio_wait (segment=3) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x000055eb22cf2e42 in io_handler_thread (arg=0x55eb23f2c998 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7f99caffd700 (LWP 4002)): #0 0x00007f99f836f644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055eb22bc5dad in LinuxAIOHandler::collect (this=0x7f99caffcb00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x000055eb22bc63f6 in LinuxAIOHandler::poll (this=0x7f99caffcb00, m1=0x7f99caffcba8, m2=0x7f99caffcbb0, request=0x7f99caffcbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x000055eb22bc6559 in os_aio_linux_handler (global_segment=5, m1=0x7f99caffcba8, m2=0x7f99caffcbb0, request=0x7f99caffcbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x000055eb22bcb2c0 in os_aio_handler (segment=5, m1=0x7f99caffcba8, m2=0x7f99caffcbb0, request=0x7f99caffcbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x000055eb22e814f9 in fil_aio_wait (segment=5) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x000055eb22cf2e42 in io_handler_thread (arg=0x55eb23f2c9a8 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7f99d2071700 (LWP 4317)): #0 0x00007f99f87a2d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb2311ea6b in safe_cond_timedwait (cond=0x55eb23eae060 , mp=0x55eb23eb0a20 , abstime=0x7f99d2070c60, file=0x55eb231dcd68 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:546 #2 0x000055eb223dda15 in inline_mysql_cond_timedwait (that=0x55eb23eae060 , mutex=0x55eb23eb0a20 , abstime=0x7f99d2070c60, src_file=0x55eb231dedb8 "/home/stepan/mariadb/10.4/github/sql/mysqld.cc", src_line=2686) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1204 #3 0x000055eb223e2b2c in cache_thread (thd=0x7f9978000b00) at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:2685 #4 0x000055eb223e2dd2 in one_thread_per_connection_end (thd=0x7f9978000b00, put_in_cache=true) at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:2771 #5 0x000055eb226a7dcf in do_handle_one_connection (connect=0x55eb26263920) at /home/stepan/mariadb/10.4/github/sql/sql_connect.cc:1423 #6 0x000055eb226a7a80 in handle_one_connection (arg=0x55eb26263920) at /home/stepan/mariadb/10.4/github/sql/sql_connect.cc:1316 #7 0x000055eb230a74a5 in pfs_spawn_thread (arg=0x55eb262b01c0) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #8 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #9 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7f99d0e6f700 (LWP 3996)): #0 0x00007f99f836f644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055eb22bc5dad in LinuxAIOHandler::collect (this=0x7f99d0e6eb00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x000055eb22bc63f6 in LinuxAIOHandler::poll (this=0x7f99d0e6eb00, m1=0x7f99d0e6eba8, m2=0x7f99d0e6ebb0, request=0x7f99d0e6ebe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x000055eb22bc6559 in os_aio_linux_handler (global_segment=2, m1=0x7f99d0e6eba8, m2=0x7f99d0e6ebb0, request=0x7f99d0e6ebe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x000055eb22bcb2c0 in os_aio_handler (segment=2, m1=0x7f99d0e6eba8, m2=0x7f99d0e6ebb0, request=0x7f99d0e6ebe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x000055eb22e814f9 in fil_aio_wait (segment=2) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x000055eb22cf2e42 in io_handler_thread (arg=0x55eb23f2c990 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7f99f023b700 (LWP 3991)): #0 0x00007f99f87a2965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f99f05efe42 in fifo_lock_get (q=q@entry=0x7f99f0388010) at galerautils/src/gu_fifo.c:262 #2 0x00007f99f05f04b1 in gu_fifo_get_head (q=0x7f99f0388010, err=0x7f99f023a01c) at galerautils/src/gu_fifo.c:330 #3 0x00007f99f06d3d1c in gcs_recv (conn=0x55eb25e27280, action=0x7f99f023a060) at gcs/src/gcs.cpp:2024 #4 0x00007f99f0700f6c in galera::GcsActionSource::process (this=0x55eb25e26c60, recv_ctx=0x7f99f023a480, exit_loop=@0x7f99f023a24e: false) at galera/src/gcs_action_source.cpp:161 #5 0x00007f99f071ff24 in galera::ReplicatorSMM::async_recv (this=0x55eb25e1efa0, recv_ctx=0x7f99f023a480) at galera/src/replicator_smm.cpp:391 #6 0x000055eb231d4e7a in wsrep::wsrep_provider_v26::run_applier (this=0x55eb25da91f0, applier_ctx=0x7f99f023a480) at /home/stepan/mariadb/10.4/github/wsrep-lib/src/wsrep_provider_v26.cpp:727 #7 0x000055eb227a6787 in wsrep_replication_process (thd=0x7f99d4000b00, arg=0x55eb25e670b0) at /home/stepan/mariadb/10.4/github/sql/wsrep_thd.cc:62 #8 0x000055eb22796e70 in start_wsrep_THD (arg=0x55eb25e670b0) at /home/stepan/mariadb/10.4/github/sql/wsrep_mysqld.cc:2708 #9 0x000055eb230a74a5 in pfs_spawn_thread (arg=0x55eb25e6ffc0) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #10 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #11 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7f99d1e71700 (LWP 3993)): #0 0x00007f99f836f644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055eb22bc5dad in LinuxAIOHandler::collect (this=0x7f99d1e70b00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x000055eb22bc63f6 in LinuxAIOHandler::poll (this=0x7f99d1e70b00, m1=0x7f99d1e70ba8, m2=0x7f99d1e70bb0, request=0x7f99d1e70be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x000055eb22bc6559 in os_aio_linux_handler (global_segment=0, m1=0x7f99d1e70ba8, m2=0x7f99d1e70bb0, request=0x7f99d1e70be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x000055eb22bcb2c0 in os_aio_handler (segment=0, m1=0x7f99d1e70ba8, m2=0x7f99d1e70bb0, request=0x7f99d1e70be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x000055eb22e814f9 in fil_aio_wait (segment=0) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x000055eb22cf2e42 in io_handler_thread (arg=0x55eb23f2c980 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7f99d3673700 (LWP 3992)): #0 0x00007f99f87a2d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb2311ea6b in safe_cond_timedwait (cond=0x55eb2473d5e0 , mp=0x55eb2473d520 , abstime=0x7f99d3672cb0, file=0x55eb23588880 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:546 #2 0x000055eb22f76109 in inline_mysql_cond_timedwait (that=0x55eb2473d5e0 , mutex=0x55eb2473d520 , abstime=0x7f99d3672cb0, src_file=0x55eb235888c8 "/home/stepan/mariadb/10.4/github/storage/maria/ma_servicethread.c", src_line=116) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1204 #3 0x000055eb22f7664d in my_service_thread_sleep (control=0x55eb23cef780 , sleep_time=30000000000) at /home/stepan/mariadb/10.4/github/storage/maria/ma_servicethread.c:115 #4 0x000055eb22f6a50a in ma_checkpoint_background (arg=0x1e) at /home/stepan/mariadb/10.4/github/storage/maria/ma_checkpoint.c:707 #5 0x000055eb230a74a5 in pfs_spawn_thread (arg=0x55eb25f17210) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #6 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7f99a77fe700 (LWP 4016)): #0 0x00007f99f87a5e3d in nanosleep () from /lib64/libpthread.so.0 #1 0x000055eb22bd46b4 in os_thread_sleep (tm=1000000) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0thread.cc:225 #2 0x000055eb22dc6dd3 in btr_defragment_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/btr/btr0defragment.cc:705 #3 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7f99f0286700 (LWP 3990)): #0 0x00007f99f87a2965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb2311e769 in safe_cond_wait (cond=0x7f99e0014758, mp=0x7f99e00146a8, file=0x55eb2329b2c0 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:492 #2 0x000055eb227a61b4 in inline_mysql_cond_wait (that=0x7f99e0014758, mutex=0x7f99e00146a8, src_file=0x55eb2329b4e0 "/home/stepan/mariadb/10.4/github/sql/wsrep_thd.h", src_line=69) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1178 #3 0x000055eb227a9416 in Wsrep_thd_queue::pop_front (this=0x7f99e0014650) at /home/stepan/mariadb/10.4/github/sql/wsrep_thd.h:69 #4 0x000055eb227a7e23 in wsrep_rollback_process (rollbacker=0x7f99e0001d50, arg=0x55eb25e70ab0) at /home/stepan/mariadb/10.4/github/sql/wsrep_thd.cc:266 #5 0x000055eb22796e70 in start_wsrep_THD (arg=0x55eb25e70ab0) at /home/stepan/mariadb/10.4/github/sql/wsrep_mysqld.cc:2708 #6 0x000055eb230a74a5 in pfs_spawn_thread (arg=0x55eb25e6f6d0) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #7 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7f99a7fff700 (LWP 4015)): #0 0x00007f99f87a2965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb22bd4377 in os_event::wait (this=0x55eb25f5f4c0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x000055eb22bd3e6b in os_event::wait_low (this=0x55eb25f5f4c0, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x000055eb22bd416e in os_event_wait_low (event=0x55eb25f5f4c0, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x000055eb22df1e86 in buf_dump_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/buf/buf0dump.cc:833 #5 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7f99e8979700 (LWP 3988)): #0 0x00007f99f87a2965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f99f06d84b7 in gu::Lock::wait (cond=..., this=0x7f99e8978850) at galerautils/src/gu_lock.hpp:45 #2 0x00007f99f06daffb in RecvBuf::front (this=this@entry=0x55eb25e57318, timeout=...) at gcs/src/gcs_gcomm.cpp:124 #3 0x00007f99f06d8b96 in gcomm_recv (backend=, msg=0x55eb25e27560, timeout=9223372035999999999) at gcs/src/gcs_gcomm.cpp:673 #4 0x00007f99f06ccb2c in core_msg_recv (backend=backend@entry=0x55eb25e276c0, recv_msg=recv_msg@entry=0x55eb25e27560, timeout=timeout@entry=9223372035999999999) at gcs/src/gcs_core.cpp:480 #5 0x00007f99f06cfda4 in gcs_core_recv (conn=0x55eb25e27500, recv_act=recv_act@entry=0x7f99e8978d70, timeout=9223372035999999999) at gcs/src/gcs_core.cpp:1184 #6 0x00007f99f06d7028 in gcs_recv_thread (arg=0x55eb25e27280) at gcs/src/gcs.cpp:1398 #7 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7f99c17fa700 (LWP 4013)): #0 0x00007f99f87a2965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb22bd4377 in os_event::wait (this=0x55eb25f5f240) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x000055eb22bd3e6b in os_event::wait_low (this=0x55eb25f5f240, reset_sig_count=3614) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x000055eb22bd416e in os_event_wait_low (event=0x55eb25f5f240, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x000055eb22cec328 in srv_resume_thread (slot=0x55eb23ce8d10 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:909 #5 0x000055eb22cf05e9 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7f99e917a700 (LWP 3987)): #0 0x00007f99f6b5c483 in epoll_wait () from /lib64/libc.so.6 #1 0x00007f99f069e548 in asio::detail::epoll_reactor::run (this=0x55eb25e57c30, block=block@entry=true, ops=...) at asio/asio/detail/impl/epoll_reactor.ipp:391 #2 0x00007f99f06a2c40 in asio::detail::task_io_service::do_run_one (this=this@entry=0x55eb25e57ad0, lock=..., this_thread=..., ec=...) at asio/asio/detail/impl/task_io_service.ipp:355 #3 0x00007f99f06a2ef2 in asio::detail::task_io_service::run (this=0x55eb25e57ad0, ec=...) at asio/asio/detail/impl/task_io_service.ipp:148 #4 0x00007f99f06ba97d in asio::io_service::run (this=0x55eb25e577e0) at asio/asio/impl/io_service.ipp:58 #5 0x00007f99f06bb0d1 in gcomm::AsioProtonet::event_loop (this=0x55eb25e57740, period=...) at gcomm/src/asio_protonet.cpp:116 #6 0x00007f99f06d9f3d in GCommConn::run (this=0x55eb25e57130) at gcs/src/gcs_gcomm.cpp:498 #7 0x00007f99f06dcfe9 in GCommConn::run_fn (arg=) at gcs/src/gcs_gcomm.cpp:209 #8 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #9 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7f99f1237700 (LWP 3985)): #0 0x00007f99f87a2d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055eb2311ea6b in safe_cond_timedwait (cond=0x55eb2474fce0 , mp=0x55eb2474fc20 , abstime=0x7f99f1236d70, file=0x55eb235d1450 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:546 #2 0x000055eb2311faae in inline_mysql_cond_timedwait (that=0x55eb2474fce0 , mutex=0x55eb2474fc20 , abstime=0x7f99f1236d70, src_file=0x55eb235d1498 "/home/stepan/mariadb/10.4/github/mysys/thr_timer.c", src_line=292) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1204 #3 0x000055eb23120671 in timer_handler (arg=0x0) at /home/stepan/mariadb/10.4/github/mysys/thr_timer.c:292 #4 0x000055eb230a74a5 in pfs_spawn_thread (arg=0x55eb25deb1c0) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #5 0x00007f99f879edd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f99f6b5bead in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7f99f8baf880 (LWP 3984)): #0 0x00007f99f87a39d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x000055eb231190f6 in my_write_core (sig=6) at /home/stepan/mariadb/10.4/github/mysys/stacktrace.c:481 #2 0x000055eb22885964 in handle_fatal_signal (sig=6) at /home/stepan/mariadb/10.4/github/sql/signal_handler.cc:343 #3 #4 0x00007f99f6b5120d in poll () from /lib64/libc.so.6 #5 0x000055eb223ea2db in handle_connections_sockets () at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:6455 #6 0x000055eb223e9576 in mysqld_main (argc=162, argv=0x55eb25ca5130) at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:5891 #7 0x000055eb223dd095 in main (argc=23, argv=0x7ffd50f6d398) at /home/stepan/mariadb/10.4/github/sql/main.cc:25 Compressed file /home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_gcs_fc_limit-innodb/mysqld.1/data/core.3984 - found 'core.5903' (1/5) Trying 'dbx' to get a backtrace Trying 'gdb' to get a backtrace from coredump /home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_gcs_fc_limit-innodb/mysqld.2/data/core.5903 Core generated by '/home/stepan/mariadb/10.4/github/sql/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- [New LWP 5903] [New LWP 5905] [New LWP 5907] [New LWP 6086] [New LWP 5908] [New LWP 5909] [New LWP 6091] [New LWP 6087] [New LWP 6092] [New LWP 6096] [New LWP 6098] [New LWP 6099] [New LWP 6101] [New LWP 6109] [New LWP 6103] [New LWP 6090] [New LWP 6106] [New LWP 6111] [New LWP 6340] [New LWP 6107] [New LWP 6105] [New LWP 6104] [New LWP 6089] [New LWP 6102] [New LWP 6097] [New LWP 6108] [New LWP 6093] [New LWP 6110] [New LWP 6100] [New LWP 5904] [New LWP 5906] [New LWP 6088] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `/home/stepan/mariadb/10.4/github/sql/mysqld --defaults-group-suffix=.2 --defaul'. Program terminated with signal 6, Aborted. #0 0x00007f67308489d1 in pthread_kill () from /lib64/libpthread.so.0 #0 0x00007f67308489d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x000056230e1410f6 in my_write_core (sig=6) at /home/stepan/mariadb/10.4/github/mysys/stacktrace.c:481 #2 0x000056230d8ad964 in handle_fatal_signal (sig=6) at /home/stepan/mariadb/10.4/github/sql/signal_handler.cc:343 #3 #4 0x00007f672ebf620d in poll () from /lib64/libc.so.6 #5 0x000056230d4122db in handle_connections_sockets () at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:6455 #6 0x000056230d411576 in mysqld_main (argc=163, argv=0x5623106fc130) at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:5891 #7 0x000056230d405095 in main (argc=23, argv=0x7fffd9d5e398) at /home/stepan/mariadb/10.4/github/sql/main.cc:25 Thread 32 (Thread 0x7f6701056700 (LWP 6088)): #0 0x00007f6730414644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000056230dbeddad in LinuxAIOHandler::collect (this=0x7f6701055b00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x000056230dbee3f6 in LinuxAIOHandler::poll (this=0x7f6701055b00, m1=0x7f6701055ba8, m2=0x7f6701055bb0, request=0x7f6701055be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x000056230dbee559 in os_aio_linux_handler (global_segment=1, m1=0x7f6701055ba8, m2=0x7f6701055bb0, request=0x7f6701055be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x000056230dbf32c0 in os_aio_handler (segment=1, m1=0x7f6701055ba8, m2=0x7f6701055bb0, request=0x7f6701055be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x000056230dea94f9 in fil_aio_wait (segment=1) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x000056230dd1ae42 in io_handler_thread (arg=0x56230ef54988 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 31 (Thread 0x7f6719b7a700 (LWP 5906)): #0 0x00007f672ec01483 in epoll_wait () from /lib64/libc.so.6 #1 0x00007f6728743548 in asio::detail::epoll_reactor::run (this=0x5623108b9580, block=block@entry=true, ops=...) at asio/asio/detail/impl/epoll_reactor.ipp:391 #2 0x00007f6728747c40 in asio::detail::task_io_service::do_run_one (this=this@entry=0x5623108b9420, lock=..., this_thread=..., ec=...) at asio/asio/detail/impl/task_io_service.ipp:355 #3 0x00007f6728747ef2 in asio::detail::task_io_service::run (this=0x5623108b9420, ec=...) at asio/asio/detail/impl/task_io_service.ipp:148 #4 0x00007f672875f97d in asio::io_service::run (this=0x5623108b8180) at asio/asio/impl/io_service.ipp:58 #5 0x00007f67287600d1 in gcomm::AsioProtonet::event_loop (this=0x5623108b80e0, period=...) at gcomm/src/asio_protonet.cpp:116 #6 0x00007f672877ef3d in GCommConn::run (this=0x5623108b8c00) at gcs/src/gcs_gcomm.cpp:498 #7 0x00007f6728781fe9 in GCommConn::run_fn (arg=) at gcs/src/gcs_gcomm.cpp:209 #8 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #9 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 30 (Thread 0x7f67292dc700 (LWP 5904)): #0 0x00007f6730847d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230e146a6b in safe_cond_timedwait (cond=0x56230f777ce0 , mp=0x56230f777c20 , abstime=0x7f67292dbd70, file=0x56230e5f9450 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:546 #2 0x000056230e147aae in inline_mysql_cond_timedwait (that=0x56230f777ce0 , mutex=0x56230f777c20 , abstime=0x7f67292dbd70, src_file=0x56230e5f9498 "/home/stepan/mariadb/10.4/github/mysys/thr_timer.c", src_line=292) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1204 #3 0x000056230e148671 in timer_handler (arg=0x0) at /home/stepan/mariadb/10.4/github/mysys/thr_timer.c:292 #4 0x000056230e0cf4a5 in pfs_spawn_thread (arg=0x562310842250) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #5 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 29 (Thread 0x7f66e37fe700 (LWP 6100)): #0 0x00007f6730847d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230dbfbd00 in os_event::timed_wait (this=0x562310b6be50, abstime=0x7f66e37fdb70) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x000056230dbfbfa9 in os_event::wait_time_low (this=0x562310b6be50, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x000056230dbfc149 in os_event_wait_time_low (event=0x562310b6be50, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x000056230dd84563 in ib_wqueue_timedwait (wq=0x562310b6bd20, wait_in_usecs=5000000) at /home/stepan/mariadb/10.4/github/storage/innobase/ut/ut0wqueue.cc:163 #5 0x000056230def723d in fts_optimize_thread (arg=0x562310b6bd20) at /home/stepan/mariadb/10.4/github/storage/innobase/fts/fts0opt.cc:2865 #6 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 28 (Thread 0x7f67280b8700 (LWP 6110)): #0 0x00007f672eb3a40a in sigwaitinfo () from /lib64/libc.so.6 #1 0x000056230d405114 in my_sigwait (set=0x7f67280b7cf0, sig=0x7f67280b7cb4, code=0x7f67280b7cb8) at /home/stepan/mariadb/10.4/github/include/my_pthread.h:198 #2 0x000056230d40ba8d in signal_hand (arg=0x0) at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:3243 #3 0x000056230e0cf4a5 in pfs_spawn_thread (arg=0x56231090d460) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #4 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 27 (Thread 0x7f66f67fc700 (LWP 6093)): #0 0x00007f6730847d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230dbfbd00 in os_event::timed_wait (this=0x5623109050b0, abstime=0x7f66f67fbb00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x000056230dbfbfa9 in os_event::wait_time_low (this=0x5623109050b0, time_in_usec=999000, reset_sig_count=2) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x000056230dbfc149 in os_event_wait_time_low (event=0x5623109050b0, time_in_usec=999000, reset_sig_count=2) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x000056230de26358 in pc_sleep_if_needed (next_loop_time=1042672425, sig_count=2, cur_time=1042671426) at /home/stepan/mariadb/10.4/github/storage/innobase/buf/buf0flu.cc:2643 #5 0x000056230de274fc in buf_flush_page_cleaner_coordinator () at /home/stepan/mariadb/10.4/github/storage/innobase/buf/buf0flu.cc:3102 #6 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 26 (Thread 0x7f66caffd700 (LWP 6108)): #0 0x00007f6730847965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230dbfc377 in os_event::wait (this=0x562310905130) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x000056230dbfbe6b in os_event::wait_low (this=0x562310905130, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x000056230dbfc16e in os_event_wait_low (event=0x562310905130, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x000056230ddff7d9 in buf_resize_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/buf/buf0buf.cc:3199 #5 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 25 (Thread 0x7f66f5df6700 (LWP 6097)): #0 0x00007f6730847d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230dbfbd00 in os_event::timed_wait (this=0x562310904f30, abstime=0x7f66f5df5bb0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x000056230dbfbfa9 in os_event::wait_time_low (this=0x562310904f30, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x000056230dbfc149 in os_event_wait_time_low (event=0x562310904f30, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x000056230dd16789 in srv_error_monitor_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:1851 #5 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 24 (Thread 0x7f66e27fc700 (LWP 6102)): #0 0x00007f6730847965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230dbfc377 in os_event::wait (this=0x562310904d30) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x000056230dbfbe6b in os_event::wait_low (this=0x562310904d30, reset_sig_count=126) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x000056230dbfc16e in os_event_wait_low (event=0x562310904d30, reset_sig_count=126) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x000056230dd14328 in srv_resume_thread (slot=0x56230ed10c10 , sig_count=126, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:909 #5 0x000056230dd18aa0 in srv_purge_coordinator_suspend (slot=0x56230ed10c10 , rseg_history_len=12) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2657 #6 0x000056230dd18dd1 in srv_purge_coordinator_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2738 #7 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 23 (Thread 0x7f6700855700 (LWP 6089)): #0 0x00007f6730414644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000056230dbeddad in LinuxAIOHandler::collect (this=0x7f6700854b00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x000056230dbee3f6 in LinuxAIOHandler::poll (this=0x7f6700854b00, m1=0x7f6700854ba8, m2=0x7f6700854bb0, request=0x7f6700854be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x000056230dbee559 in os_aio_linux_handler (global_segment=2, m1=0x7f6700854ba8, m2=0x7f6700854bb0, request=0x7f6700854be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x000056230dbf32c0 in os_aio_handler (segment=2, m1=0x7f6700854ba8, m2=0x7f6700854bb0, request=0x7f6700854be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x000056230dea94f9 in fil_aio_wait (segment=2) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x000056230dd1ae42 in io_handler_thread (arg=0x56230ef54990 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 22 (Thread 0x7f66e17fa700 (LWP 6104)): #0 0x00007f6730847965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230dbfc377 in os_event::wait (this=0x562310904e30) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x000056230dbfbe6b in os_event::wait_low (this=0x562310904e30, reset_sig_count=382) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x000056230dbfc16e in os_event_wait_low (event=0x562310904e30, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x000056230dd14328 in srv_resume_thread (slot=0x56230ed10e10 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:909 #5 0x000056230dd185e9 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 21 (Thread 0x7f66e0ff9700 (LWP 6105)): #0 0x00007f6730847965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230dbfc377 in os_event::wait (this=0x562310904eb0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x000056230dbfbe6b in os_event::wait_low (this=0x562310904eb0, reset_sig_count=334) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x000056230dbfc16e in os_event_wait_low (event=0x562310904eb0, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x000056230dd14328 in srv_resume_thread (slot=0x56230ed10f10 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:909 #5 0x000056230dd185e9 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 20 (Thread 0x7f66cb7fe700 (LWP 6107)): #0 0x00007f673084ae3d in nanosleep () from /lib64/libpthread.so.0 #1 0x000056230dbfc6b4 in os_thread_sleep (tm=1000000) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0thread.cc:225 #2 0x000056230ddeedd3 in btr_defragment_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/btr/btr0defragment.cc:705 #3 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7f6718145700 (LWP 6340)): #0 0x00007f6730847d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230e146a6b in safe_cond_timedwait (cond=0x56230eed6060 , mp=0x56230eed8a20 , abstime=0x7f6718144c60, file=0x56230e204d68 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:546 #2 0x000056230d405a15 in inline_mysql_cond_timedwait (that=0x56230eed6060 , mutex=0x56230eed8a20 , abstime=0x7f6718144c60, src_file=0x56230e206db8 "/home/stepan/mariadb/10.4/github/sql/mysqld.cc", src_line=2686) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1204 #3 0x000056230d40ab2c in cache_thread (thd=0x7f66ac000b00) at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:2685 #4 0x000056230d40add2 in one_thread_per_connection_end (thd=0x7f66ac000b00, put_in_cache=true) at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:2771 #5 0x000056230d6cfdcf in do_handle_one_connection (connect=0x562310c81690) at /home/stepan/mariadb/10.4/github/sql/sql_connect.cc:1423 #6 0x000056230d6cfa80 in handle_one_connection (arg=0x562310c81690) at /home/stepan/mariadb/10.4/github/sql/sql_connect.cc:1316 #7 0x000056230e0cf4a5 in pfs_spawn_thread (arg=0x562310ce8440) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #8 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #9 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7f672806d700 (LWP 6111)): #0 0x00007f6730847965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230e146769 in safe_cond_wait (cond=0x56230eed60a0 , mp=0x56230eed9320 , file=0x56230e2150c0 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1167) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:492 #2 0x000056230d43808e in inline_mysql_cond_wait (that=0x56230eed60a0 , mutex=0x56230eed9320 , src_file=0x56230e215c20 "/home/stepan/mariadb/10.4/github/sql/slave.cc", src_line=519) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1167 #3 0x000056230d4399cb in handle_slave_background (arg=0x0) at /home/stepan/mariadb/10.4/github/sql/slave.cc:519 #4 0x000056230e0cf4a5 in pfs_spawn_thread (arg=0x562310dc3210) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #5 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 17 (Thread 0x7f66cbfff700 (LWP 6106)): #0 0x00007f6730847965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230dbfc377 in os_event::wait (this=0x562310905030) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x000056230dbfbe6b in os_event::wait_low (this=0x562310905030, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x000056230dbfc16e in os_event_wait_low (event=0x562310905030, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x000056230de19e86 in buf_dump_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/buf/buf0dump.cc:833 #5 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7f66f7fff700 (LWP 6090)): #0 0x00007f6730414644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000056230dbeddad in LinuxAIOHandler::collect (this=0x7f66f7ffeb00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x000056230dbee3f6 in LinuxAIOHandler::poll (this=0x7f66f7ffeb00, m1=0x7f66f7ffeba8, m2=0x7f66f7ffebb0, request=0x7f66f7ffebe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x000056230dbee559 in os_aio_linux_handler (global_segment=3, m1=0x7f66f7ffeba8, m2=0x7f66f7ffebb0, request=0x7f66f7ffebe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x000056230dbf32c0 in os_aio_handler (segment=3, m1=0x7f66f7ffeba8, m2=0x7f66f7ffebb0, request=0x7f66f7ffebe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x000056230dea94f9 in fil_aio_wait (segment=3) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x000056230dd1ae42 in io_handler_thread (arg=0x56230ef54998 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7f66e1ffb700 (LWP 6103)): #0 0x00007f6730847965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230dbfc377 in os_event::wait (this=0x562310904db0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x000056230dbfbe6b in os_event::wait_low (this=0x562310904db0, reset_sig_count=464) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x000056230dbfc16e in os_event_wait_low (event=0x562310904db0, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x000056230dd14328 in srv_resume_thread (slot=0x56230ed10d10 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:909 #5 0x000056230dd185e9 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7f66ca7fc700 (LWP 6109)): #0 0x00007f6730847965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230e146769 in safe_cond_wait (cond=0x7f66ca7fbc70, mp=0x7f66ca7fbcb0, file=0x56230e433ce0 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:492 #2 0x000056230daef15d in inline_mysql_cond_wait (that=0x7f66ca7fbc70, mutex=0x7f66ca7fbcb0, src_file=0x56230e4357f8 "/home/stepan/mariadb/10.4/github/storage/innobase/handler/ha_innodb.cc", src_line=288) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1178 #3 0x000056230daf4a55 in thd_destructor_proxy () at /home/stepan/mariadb/10.4/github/storage/innobase/handler/ha_innodb.cc:288 #4 0x000056230e0cf4a5 in pfs_spawn_thread (arg=0x562310c79680) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #5 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7f66e2ffd700 (LWP 6101)): #0 0x00007f673084ae3d in nanosleep () from /lib64/libpthread.so.0 #1 0x000056230dbfc6b4 in os_thread_sleep (tm=1000000) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0thread.cc:225 #2 0x000056230dd17d65 in srv_master_sleep () at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2334 #3 0x000056230dd17ecd in srv_master_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2375 #4 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7f66e3fff700 (LWP 6099)): #0 0x00007f6730847d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230dbfbd00 in os_event::timed_wait (this=0x562310c341b0, abstime=0x7f66e3ffed70) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x000056230dbfbfa9 in os_event::wait_time_low (this=0x562310c341b0, time_in_usec=10000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x000056230dbfc149 in os_event_wait_time_low (event=0x562310c341b0, time_in_usec=10000000, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x000056230de906ca in dict_stats_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/dict/dict0stats_bg.cc:476 #5 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7f66f4df4700 (LWP 6098)): #0 0x00007f6730847d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230dbfbd00 in os_event::timed_wait (this=0x562310904fb0, abstime=0x7f66f4df3d30) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x000056230dbfbfa9 in os_event::wait_time_low (this=0x562310904fb0, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x000056230dbfc149 in os_event_wait_time_low (event=0x562310904fb0, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x000056230dd1620f in srv_monitor_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:1687 #5 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7f66f55f5700 (LWP 6096)): #0 0x00007f6730847d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230dbfbd00 in os_event::timed_wait (this=0x562310c020f0, abstime=0x7f66f55f4d50) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x000056230dbfbfa9 in os_event::wait_time_low (this=0x562310c020f0, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x000056230dbfc149 in os_event_wait_time_low (event=0x562310c020f0, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x000056230dbbe527 in lock_wait_timeout_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/lock/lock0wait.cc:522 #5 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7f66f6ffd700 (LWP 6092)): #0 0x00007f6730414644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000056230dbeddad in LinuxAIOHandler::collect (this=0x7f66f6ffcb00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x000056230dbee3f6 in LinuxAIOHandler::poll (this=0x7f66f6ffcb00, m1=0x7f66f6ffcba8, m2=0x7f66f6ffcbb0, request=0x7f66f6ffcbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x000056230dbee559 in os_aio_linux_handler (global_segment=5, m1=0x7f66f6ffcba8, m2=0x7f66f6ffcbb0, request=0x7f66f6ffcbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x000056230dbf32c0 in os_aio_handler (segment=5, m1=0x7f66f6ffcba8, m2=0x7f66f6ffcbb0, request=0x7f66f6ffcbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x000056230dea94f9 in fil_aio_wait (segment=5) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x000056230dd1ae42 in io_handler_thread (arg=0x56230ef549a8 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7f6701857700 (LWP 6087)): #0 0x00007f6730414644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000056230dbeddad in LinuxAIOHandler::collect (this=0x7f6701856b00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x000056230dbee3f6 in LinuxAIOHandler::poll (this=0x7f6701856b00, m1=0x7f6701856ba8, m2=0x7f6701856bb0, request=0x7f6701856be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x000056230dbee559 in os_aio_linux_handler (global_segment=0, m1=0x7f6701856ba8, m2=0x7f6701856bb0, request=0x7f6701856be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x000056230dbf32c0 in os_aio_handler (segment=0, m1=0x7f6701856ba8, m2=0x7f6701856bb0, request=0x7f6701856be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x000056230dea94f9 in fil_aio_wait (segment=0) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x000056230dd1ae42 in io_handler_thread (arg=0x56230ef54980 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7f66f77fe700 (LWP 6091)): #0 0x00007f6730414644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000056230dbeddad in LinuxAIOHandler::collect (this=0x7f66f77fdb00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x000056230dbee3f6 in LinuxAIOHandler::poll (this=0x7f66f77fdb00, m1=0x7f66f77fdba8, m2=0x7f66f77fdbb0, request=0x7f66f77fdbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x000056230dbee559 in os_aio_linux_handler (global_segment=4, m1=0x7f66f77fdba8, m2=0x7f66f77fdbb0, request=0x7f66f77fdbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x000056230dbf32c0 in os_aio_handler (segment=4, m1=0x7f66f77fdba8, m2=0x7f66f77fdbb0, request=0x7f66f77fdbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x000056230dea94f9 in fil_aio_wait (segment=4) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x000056230dd1ae42 in io_handler_thread (arg=0x56230ef549a0 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7f67282e0700 (LWP 5909)): #0 0x00007f6730847965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f6728694e42 in fifo_lock_get (q=q@entry=0x7f672842d010) at galerautils/src/gu_fifo.c:262 #2 0x00007f67286954b1 in gu_fifo_get_head (q=0x7f672842d010, err=0x7f67282df01c) at galerautils/src/gu_fifo.c:330 #3 0x00007f6728778d1c in gcs_recv (conn=0x56231088c210, action=0x7f67282df060) at gcs/src/gcs.cpp:2024 #4 0x00007f67287a5f6c in galera::GcsActionSource::process (this=0x56231088bac0, recv_ctx=0x7f67282df480, exit_loop=@0x7f67282df24e: false) at galera/src/gcs_action_source.cpp:161 #5 0x00007f67287c4f24 in galera::ReplicatorSMM::async_recv (this=0x562310875f90, recv_ctx=0x7f67282df480) at galera/src/replicator_smm.cpp:391 #6 0x000056230e1fce7a in wsrep::wsrep_provider_v26::run_applier (this=0x5623107ee920, applier_ctx=0x7f67282df480) at /home/stepan/mariadb/10.4/github/wsrep-lib/src/wsrep_provider_v26.cpp:727 #7 0x000056230d7ce787 in wsrep_replication_process (thd=0x7f6704000b00, arg=0x5623108d9990) at /home/stepan/mariadb/10.4/github/sql/wsrep_thd.cc:62 #8 0x000056230d7bee70 in start_wsrep_THD (arg=0x5623108d9990) at /home/stepan/mariadb/10.4/github/sql/wsrep_mysqld.cc:2708 #9 0x000056230e0cf4a5 in pfs_spawn_thread (arg=0x5623108a69c0) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #10 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #11 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7f672832b700 (LWP 5908)): #0 0x00007f6730847965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230e146769 in safe_cond_wait (cond=0x7f6710015a68, mp=0x7f67100159b8, file=0x56230e2c32c0 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:492 #2 0x000056230d7ce1b4 in inline_mysql_cond_wait (that=0x7f6710015a68, mutex=0x7f67100159b8, src_file=0x56230e2c34e0 "/home/stepan/mariadb/10.4/github/sql/wsrep_thd.h", src_line=69) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1178 #3 0x000056230d7d1416 in Wsrep_thd_queue::pop_front (this=0x7f6710015960) at /home/stepan/mariadb/10.4/github/sql/wsrep_thd.h:69 #4 0x000056230d7cfe23 in wsrep_rollback_process (rollbacker=0x7f6710001d50, arg=0x5623108db0d0) at /home/stepan/mariadb/10.4/github/sql/wsrep_thd.cc:266 #5 0x000056230d7bee70 in start_wsrep_THD (arg=0x5623108db0d0) at /home/stepan/mariadb/10.4/github/sql/wsrep_mysqld.cc:2708 #6 0x000056230e0cf4a5 in pfs_spawn_thread (arg=0x5623108a4940) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #7 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7f6703059700 (LWP 6086)): #0 0x00007f6730847d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000056230e146a6b in safe_cond_timedwait (cond=0x56230f7655e0 , mp=0x56230f765520 , abstime=0x7f6703058cb0, file=0x56230e5b0880 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:546 #2 0x000056230df9e109 in inline_mysql_cond_timedwait (that=0x56230f7655e0 , mutex=0x56230f765520 , abstime=0x7f6703058cb0, src_file=0x56230e5b08c8 "/home/stepan/mariadb/10.4/github/storage/maria/ma_servicethread.c", src_line=116) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1204 #3 0x000056230df9e64d in my_service_thread_sleep (control=0x56230ed17780 , sleep_time=30000000000) at /home/stepan/mariadb/10.4/github/storage/maria/ma_servicethread.c:115 #4 0x000056230df9250a in ma_checkpoint_background (arg=0x1e) at /home/stepan/mariadb/10.4/github/storage/maria/ma_checkpoint.c:707 #5 0x000056230e0cf4a5 in pfs_spawn_thread (arg=0x5623108f85d0) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #6 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7f6719379700 (LWP 5907)): #0 0x00007f6730847965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f672877d4b7 in gu::Lock::wait (cond=..., this=0x7f6719378850) at galerautils/src/gu_lock.hpp:45 #2 0x00007f672877fffb in RecvBuf::front (this=this@entry=0x5623108b8de8, timeout=...) at gcs/src/gcs_gcomm.cpp:124 #3 0x00007f672877db96 in gcomm_recv (backend=, msg=0x56231088c4f0, timeout=9223372035999999999) at gcs/src/gcs_gcomm.cpp:673 #4 0x00007f6728771b2c in core_msg_recv (backend=backend@entry=0x56231088c650, recv_msg=recv_msg@entry=0x56231088c4f0, timeout=timeout@entry=9223372035999999999) at gcs/src/gcs_core.cpp:480 #5 0x00007f6728774da4 in gcs_core_recv (conn=0x56231088c490, recv_act=recv_act@entry=0x7f6719378d70, timeout=9223372035999999999) at gcs/src/gcs_core.cpp:1184 #6 0x00007f672877c028 in gcs_recv_thread (arg=0x56231088c210) at gcs/src/gcs.cpp:1398 #7 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7f671bffe700 (LWP 5905)): #0 0x00007f6730847965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f67287a2dd7 in gu::Lock::wait (cond=..., this=0x7f671bffdbf0) at galerautils/src/gu_lock.hpp:45 #2 0x00007f67287a2e69 in galera::ServiceThd::thd_func (arg=0x5623108766a8) at galera/src/galera_service_thd.cpp:30 #3 0x00007f6730843dd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f672ec00ead in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7f6730c54880 (LWP 5903)): #0 0x00007f67308489d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x000056230e1410f6 in my_write_core (sig=6) at /home/stepan/mariadb/10.4/github/mysys/stacktrace.c:481 #2 0x000056230d8ad964 in handle_fatal_signal (sig=6) at /home/stepan/mariadb/10.4/github/sql/signal_handler.cc:343 #3 #4 0x00007f672ebf620d in poll () from /lib64/libc.so.6 #5 0x000056230d4122db in handle_connections_sockets () at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:6455 #6 0x000056230d411576 in mysqld_main (argc=163, argv=0x5623106fc130) at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:5891 #7 0x000056230d405095 in main (argc=23, argv=0x7fffd9d5e398) at /home/stepan/mariadb/10.4/github/sql/main.cc:25 Compressed file /home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_gcs_fc_limit-innodb/mysqld.2/data/core.5903 - saving '/home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_gcs_fc_limit-innodb/' to '/home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_gcs_fc_limit-innodb/' ***Warnings generated in error logs during shutdown after running tests: galera.galera_fk_multitable galera.galera_fk_selfreferential galera.galera_create_function galera.galera_commit_empty galera.MW-286 galera.galera_events galera.galera_change_user galera.galera_alter_engine_innodb galera.galera_bf_abort_lock_table galera.galera_FK_duplicate_client_insert galera.MW-258 galera.galera_ftwrl_drain galera.MW-357 galera.galera_fk_cascade_update galera.galera_ddl_multiline galera.galera_bf_abort galera.galera_bf_abort_ftwrl galera.galera_create_table_as_select galera.MW-369 galera.galera_fk_setnull galera.galera_alter_table_force galera.galera_fk_cascade_delete galera.galera_bf_abort_sleep galera.galera_create_table_like galera.MW-328D galera.MW-416 galera.galera_events2 galera.basic galera.MW-309 galera.galera_bf_abort_at_after_statement galera.galera_enum galera.MW-402 galera.galera_fk_multicolumn galera.MW-285 galera.enforce_storage_engine galera.binlog_checksum galera.galera_binlog_cache_size galera.create galera.galera_admin galera.galera_create_procedure galera.MW-292 galera.galera_alter_engine_myisam galera.galera_create_trigger galera.galera_bf_abort_flush_for_export galera.galera_ftwrl galera.MW-328E galera.galera_delete_limit galera.galera_drop_database galera.galera_desync_overlapped galera.galera_bf_abort_for_update galera.galera_applier_ftwrl_table galera.galera_drop_multi galera.galera_defaults galera.fk galera.MW-252 galera.galera_bf_abort_get_lock galera.galera_gcs_fc_limit galera.galera_fk_mismatch galera.galera_fk_no_pk galera.ev51914 galera.galera_binlog_row_image galera.galera#505 galera.MW-259 galera.galera_bf_abort_shutdown galera.galera_fk_conflict galera.galera#500 Attempting backtrace. You can use the following information to find out Attempting backtrace. You can use the following information to find out 191029 0:52:35 +29.270 galera.galera_gra_log 'innodb' [ pass ] 3798 191029 0:52:42 +7.700 galera.galera_insert_ignore 'innodb' [ pass ] 7258 191029 0:52:52 +9.819 galera.galera_insert_multi 'innodb' [ pass ] 9554 191029 0:53:07 +14.762 galera.galera_kill_applier 'innodb' [ pass ] 4468 191029 0:53:38 +30.745 galera.galera_kill_ddl 'innodb' [ pass ] 20671 191029 0:53:58 +20.515 galera.galera_kill_smallchanges 'innodb' [ pass ] 20157 191029 0:54:02 +3.783 galera.galera_last_committed_id 'innodb' [ pass ] 3512 191029 0:54:09 +7.244 galera.galera_lock_table 'innodb' [ pass ] 6879 191029 0:55:11 +62.092 galera.galera_many_indexes 'innodb' [ pass ] 61703 191029 0:55:19 +8.027 galera.galera_mdev_10812 'innodb' [ pass ] 7603 191029 0:55:26 +6.318 galera.galera_mdl_race 'innodb' [ pass ] 5883 191029 0:55:33 +7.933 galera.galera_multi_database 'innodb' [ pass ] 7501 191029 0:55:38 +4.778 galera.galera_myisam_autocommit 'innodb' [ pass ] 4447 191029 0:55:44 +6.043 galera.galera_myisam_transactions 'innodb' [ pass ] 5634 191029 0:55:51 +7.137 galera.galera_nopk_bit 'innodb' [ pass ] 6814 191029 0:55:58 +6.666 galera.galera_nopk_blob 'innodb' [ pass ] 6385 191029 0:56:04 +6.164 galera.galera_nopk_large_varchar 'innodb' [ pass ] 5831 191029 0:56:08 +4.131 galera.galera_nopk_unicode 'innodb' [ pass ] 3858 191029 0:56:17 +8.189 galera.galera_parallel_apply_lock_table 'innodb' [ pass ] 7754 191029 0:56:25 +8.734 galera.galera_parallel_simple 'innodb' [ pass ] 8347 191029 0:56:48 +22.674 galera.galera_pc_ignore_sb 'innodb' [ pass ] 22216 191029 0:56:54 +6.224 galera.galera_performance_schema 'innodb' [ pass ] 5956 191029 0:56:59 +4.600 galera.galera_pk_bigint_signed 'innodb' [ pass ] 4317 191029 0:57:03 +4.045 galera.galera_pk_bigint_unsigned 'innodb' [ pass ] 3712 191029 0:57:14 +10.844 galera.galera_prepared_statement 'innodb' [ pass ] 10273 191029 0:57:19 +5.253 galera.galera_read_only 'innodb' [ pass ] 4817 191029 0:57:26 +6.861 galera.galera_repl_key_format_flat16 'innodb' [ pass ] 6431 191029 0:57:29 +3.618 galera.galera_repl_max_ws_size 'innodb' [ pass ] 3340 191029 0:57:42 +13.004 galera.galera_restart_nochanges 'innodb' [ pass ] 12734 191029 0:59:07 +84.801 galera.galera_restart_on_unknown_option 'innodb' [ pass ] 84376 191029 0:59:27 +19.361 galera.galera_roles 'innodb' [ pass ] 18927 191029 0:59:32 +4.970 galera.galera_rsu_error 'innodb' [ pass ] 4334 191029 0:59:36 +4.839 galera.galera_rsu_simple 'innodb' [ pass ] 4374 191029 0:59:45 +8.353 galera.galera_rsu_wsrep_desync 'innodb' [ pass ] 8015 191029 0:59:49 +4.403 galera.galera_sbr 'innodb' [ pass ] 3988 191029 0:59:52 +2.409 galera.galera_schema_dirty_reads 'innodb' [ pass ] 2086 191029 1:00:00 +8.522 galera.galera_serializable 'innodb' [ pass ] 8168 191029 1:00:04 +3.458 galera.galera_server 'innodb' [ pass ] 3183 191029 1:00:25 +21.084 galera.galera_shutdown_nonprim 'innodb' [ pass ] 20708 191029 1:00:42 +17.264 galera.galera_sp_bf_abort 'innodb' [ pass ] 16199 191029 1:05:50 +308.352 galera.galera_sp_insert_parallel 'innodb' [ pass ] 308063 191029 1:05:54 +4.132 galera.galera_sql_log_bin_zero 'innodb' [ pass ] 3795 191029 1:05:57 +2.288 galera.galera_status_cluster 'innodb' [ pass ] 2021 191029 1:06:01 +4.332 galera.galera_status_local_index 'innodb' [ pass ] 3942 191029 1:06:03 +2.303 galera.galera_status_local_state 'innodb' [ pass ] 2030 191029 1:06:31 +27.301 galera.galera_suspend_slave 'innodb' [ pass ] 27019 191029 1:06:39 +8.843 galera.galera_sync_wait_show 'innodb' [ pass ] 8437 191029 1:06:52 +12.641 galera.galera_toi_alter_auto_increment 'innodb' [ pass ] 12375 191029 1:07:02 +10.054 galera.galera_toi_ddl_locking 'innodb' [ pass ] 9609 191029 1:07:08 +5.957 galera.galera_toi_ddl_nonconflicting 'innodb' [ pass ] 5590 191029 1:07:14 +6.001 galera.galera_toi_ddl_sequential 'innodb' [ pass ] 5657 191029 1:10:01 +167.278 galera.galera_toi_drop_database 'innodb' [ pass ] 166541 191029 1:10:06 +4.700 galera.galera_toi_ftwrl 'innodb' [ pass ] 4382 191029 1:10:13 +6.822 galera.galera_toi_lock_exclusive 'innodb' [ pass ] 6191 191029 1:10:18 +4.970 galera.galera_toi_lock_shared 'innodb' [ pass ] 4659 191029 1:10:56 +37.681 galera.galera_toi_truncate 'innodb' [ pass ] 37070 191029 1:10:59 +3.786 galera.galera_transaction_read_only 'innodb' [ pass ] 3475 191029 1:11:10 +10.298 galera.galera_transaction_replay 'innodb' [ pass ] 9838 191029 1:11:27 +17.175 galera.galera_truncate 'innodb' [ pass ] 16729 191029 1:11:37 +10.271 galera.galera_truncate_temporary 'innodb' [ pass ] 9900 191029 1:11:49 +11.746 galera.galera_unicode_identifiers 'innodb' [ pass ] 11405 191029 1:11:54 +5.292 galera.galera_unicode_pk 'innodb' [ pass ] 4756 191029 1:12:03 +8.748 galera.galera_update_limit 'innodb' [ pass ] 8364 191029 1:12:07 +4.037 galera.galera_var_OSU_method 'innodb' [ pass ] 3691 191029 1:12:12 +4.926 galera.galera_var_OSU_method2 'innodb' [ pass ] 4549 191029 1:12:18 +6.179 galera.galera_var_auto_inc_control_off 'innodb' [ pass ] 5853 191029 1:12:25 +7.080 galera.galera_var_certify_nonPK_off 'innodb' [ pass ] 6666 191029 1:12:33 +8.027 galera.galera_var_cluster_address 'innodb' [ pass ] 7535 191029 1:12:41 +8.228 galera.galera_var_desync_on 'innodb' [ pass ] 7874 191029 1:12:49 +8.093 galera.galera_var_dirty_reads 'innodb' [ pass ] 7780 191029 1:12:57 +7.312 galera.galera_var_fkchecks 'innodb' [ pass ] 6935 191029 1:13:28 +30.981 galera.galera_var_ignore_apply_errors 'innodb' [ pass ] 30624 191029 1:14:20 +52.418 galera.galera_var_max_ws_rows 'innodb' [ pass ] 52031 191029 1:14:24 +4.135 galera.galera_var_max_ws_size 'innodb' [ pass ] 3791 191029 1:14:29 +4.589 galera.galera_var_mysql_replication_bundle 'innodb' [ pass ] 4261 191029 1:14:32 +3.062 galera.galera_var_replicate_myisam_off 'innodb' [ pass ] 2768 191029 1:14:49 +17.514 galera.galera_var_replicate_myisam_on 'innodb' [ pass ] 16554 191029 1:14:57 +7.760 galera.galera_var_sync_wait 'innodb' [ pass ] 7303 191029 1:15:02 +4.403 galera.galera_var_wsrep_on_off 'innodb' [ pass ] 4082 191029 1:15:04 +2.489 galera.galera_wsrep_provider_options_syntax 'innodb' [ pass ] 2209 191029 1:15:13 +9.266 galera.galera_wsrep_provider_unset_set 'innodb' [ pass ] 8992 191029 1:15:21 +7.506 galera.galera_zero_length_column 'innodb' [ pass ] 7047 191029 1:15:24 +3.475 galera.grant 'innodb' [ pass ] 2994 191029 1:15:30 +5.436 galera.lp1276424 'innodb' [ pass ] 5043 191029 1:15:34 +4.589 galera.lp1347768 'innodb' [ pass ] 4274 191029 1:15:42 +7.410 galera.lp1376747 'innodb' [ pass ] 7056 191029 1:15:48 +6.008 galera.lp1376747-2 'innodb' [ pass ] 5331 191029 1:15:54 +5.999 galera.lp1376747-3 'innodb' [ pass ] 5676 191029 1:16:06 +12.186 galera.lp1376747-4 'innodb' [ pass ] 11834 191029 1:16:15 +9.296 galera.lp1438990 'innodb' [ pass ] 8899 191029 1:16:23 +7.341 galera.lp959512 'innodb' [ pass ] 6936 191029 1:16:27 +4.055 galera.mdev_9290 'innodb' [ pass ] 3694 191029 1:16:36 +9.355 galera.mysql-wsrep#110 'innodb' [ pass ] 8907 191029 1:16:42 +5.507 galera.mysql-wsrep#237 'innodb' [ pass ] 4979 191029 1:16:46 +4.222 galera.mysql-wsrep#247 'innodb' [ pass ] 3892 191029 1:17:01 +14.922 galera.mysql-wsrep#31 'innodb' [ pass ] 14586 191029 1:17:39 +38.105 galera.mysql-wsrep#332 'innodb' [ pass ] 29617 191029 1:17:46 +7.309 galera.mysql-wsrep#90 'innodb' [ pass ] 6848 191029 1:17:57 +10.438 galera.pxc-421 'innodb' [ pass ] 9987 191029 1:18:02 +5.768 galera.rename 'innodb' [ pass ] 5341 191029 1:18:10 +7.879 galera.sql_log_bin 'innodb' [ pass ] 7348 191029 1:18:15 +4.593 galera.unique_key 'innodb' [ pass ] 4190 191029 1:18:23 +8.589 galera.view 'innodb' [ pass ] 7979 191029 1:18:26 +2.364 galera.wsrep_trx_fragment_size_sr 'innodb' [ pass ] 2035 191029 1:18:58 +32.207 galera.MDEV-15443 'innodb' [ pass ] 12722 191029 1:19:24 +26.119 galera.MDEV-18832 'innodb' [ pass ] 6714 191029 1:21:57 +152.783 galera.MDEV-6860 'innodb' [ pass ] 133693 191029 1:22:22 +24.855 galera.MW-284 'innodb' [ pass ] 13025 191029 1:22:49 +27.776 galera.MW-336 'innodb' [ pass ] 6427 191029 1:23:08 +18.682 galera.galera#414 'innodb' [ pass ] 10384 191029 1:23:33 +25.245 galera.galera_as_master 'innodb' [ pass ] 9039 191029 1:23:50 +16.668 galera.galera_as_master_large 'innodb' [ pass ] 5380 191029 1:24:05 +14.891 galera.galera_as_slave 'innodb' [ pass ] 4478 191029 1:24:21 +15.583 galera.galera_as_slave_autoinc 'innodb' [ pass ] 5309 191029 1:24:37 +16.671 galera.galera_as_slave_gtid 'innodb' [ pass ] 5605 191029 1:24:57 +19.511 galera.galera_as_slave_gtid_replicate_do_db 'innodb' [ pass ] 8292 191029 1:25:30 +33.284 galera.galera_as_slave_nonprim 'innodb' [ pass ] 19844 191029 1:26:28 +58.489 galera.galera_autoinc_sst_mariabackup 'innodb' [ pass ] 36428 191029 1:27:10 +41.295 galera.galera_gcache_recover 'innodb' [ pass ] 25468 191029 1:28:21 +70.815 galera.galera_gcache_recover_full_gcache 'innodb' [ pass ] 51965 191029 1:28:44 +23.298 galera.galera_gcs_fragment 'innodb' [ pass ] 8019 191029 1:29:14 +30.118 galera.galera_gcs_max_packet_size 'innodb' [ pass ] 12420 191029 1:29:37 +23.175 galera.galera_gtid_slave 'innodb' [ pass ] 6357 191029 1:30:10 +33.090 galera.galera_gtid_slave_sst_rsync 'innodb' [ pass ] 21937 191029 1:31:20 +69.297 galera.galera_ist_mariabackup_innodb_flush_logs 'debug,innodb' [ pass ] 46996 191029 1:33:25 +125.835 galera.galera_ist_mysqldump 'debug,innodb' [ pass ] 108719 191029 1:33:56 +31.021 galera.galera_ist_recv_bind 'innodb' [ pass ] 15005 191029 1:34:37 +40.255 galera.galera_ist_restart_joiner 'innodb' [ pass ] 24335 191029 1:35:56 +79.651 galera.galera_ist_rsync 'debug,innodb' [ pass ] 60166 191029 1:36:40 +43.686 galera.galera_load_data 'innodb' [ pass ] 25248 191029 1:43:09 +388.905 galera.galera_many_rows 'innodb' [ pass ] 368027 191029 1:44:05 +56.473 galera.galera_mdev_15611 'innodb' [ pass ] 36484 191029 1:44:28 +22.732 galera.galera_ssl 'innodb' [ pass ] 4058 191029 1:44:50 +21.459 galera.galera_ssl_compression 'innodb' [ pass ] 4528 191029 1:46:39 +109.028 galera.galera_sst_mariabackup 'debug,innodb' [ pass ] 82600 191029 1:48:31 +112.664 galera.galera_sst_mariabackup_data_dir 'debug,innodb' [ pass ] 85849 191029 1:48:59 +27.683 galera.galera_sst_mariabackup_encrypt_with_key 'innodb' [ pass ] 2034 191029 1:50:34 +95.516 galera.galera_sst_mariabackup_table_options '16k,clear,innodb' [ pass ] 32095 191029 1:52:10 +95.615 galera.galera_sst_mariabackup_table_options '16k,crypt,innodb' [ pass ] 33387 191029 1:53:49 +99.377 galera.galera_sst_mariabackup_table_options '4k,clear,innodb' [ pass ] 37846 191029 1:55:30 +100.983 galera.galera_sst_mariabackup_table_options '4k,crypt,innodb' [ pass ] 36815 191029 1:57:12 +101.295 galera.galera_sst_mariabackup_table_options '8k,clear,innodb' [ pass ] 35587 191029 1:58:50 +98.180 galera.galera_sst_mariabackup_table_options '8k,crypt,innodb' [ pass ] 35341 191029 2:01:59 +188.949 galera.galera_sst_mysqldump 'debug,innodb' [ pass ] 172806 191029 2:02:21 +21.842 galera.galera_sst_mysqldump_with_key 'debug,innodb' [ fail ] Test ended at 2019-10-29 02:02:21 CURRENT_TEST: galera.galera_sst_mysqldump_with_key mysqltest: In included file "./suite/galera/include/galera_st_shutdown_slave.inc": included from /home/stepan/mariadb/10.4/github/mysql-test/suite/galera/t/galera_sst_mysqldump_with_key.test at line 26: At line 22: query 'COMMIT' failed: 1213: Deadlock found when trying to get lock; try restarting transaction The result from queries just before the failure was: < snip > Performing State Transfer on a server that has been shut down cleanly and restarted connection node_1; CREATE TABLE t1 (f1 CHAR(255)) ENGINE=InnoDB; SET AUTOCOMMIT=OFF; START TRANSACTION; INSERT INTO t1 VALUES ('node1_committed_before'); INSERT INTO t1 VALUES ('node1_committed_before'); INSERT INTO t1 VALUES ('node1_committed_before'); INSERT INTO t1 VALUES ('node1_committed_before'); INSERT INTO t1 VALUES ('node1_committed_before'); COMMIT; connection node_2; SET AUTOCOMMIT=OFF; START TRANSACTION; INSERT INTO t1 VALUES ('node2_committed_before'); INSERT INTO t1 VALUES ('node2_committed_before'); INSERT INTO t1 VALUES ('node2_committed_before'); INSERT INTO t1 VALUES ('node2_committed_before'); INSERT INTO t1 VALUES ('node2_committed_before'); COMMIT; More results from queries before failure can be found in /home/stepan/mariadb/10.4/github/mysql-test/var/log/galera_sst_mysqldump_with_key,debug.log - saving '/home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_sst_mysqldump_with_key-debug,innodb/' to '/home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_sst_mysqldump_with_key-debug,innodb/' 191029 2:03:38 +77.083 galera.galera_sst_rsync 'debug,innodb' [ pass ] 67862 191029 2:04:58 +80.293 galera.galera_sst_rsync2 'debug,innodb' [ pass ] 62775 191029 2:06:18 +79.608 galera.galera_sst_rsync_data_dir 'debug,innodb' [ pass ] 63433 191029 2:06:39 +21.222 galera.galera_var_gtid_domain_id 'innodb' [ pass ] 4320 191029 2:07:02 +23.019 galera.galera_var_log_bin 'innodb' [ pass ] 3698 191029 2:07:47 +44.562 galera.galera_var_slave_threads 'innodb' [ pass ] 16192 191029 2:09:00 +73.219 galera.galera_wan_restart_ist 'innodb' [ pass ] 60078 191029 2:10:13 +73.222 galera.galera_wan_restart_sst 'innodb' [ pass ] 57561 191029 2:10:27 +14.153 galera.mdev_10518 'innodb' [ pass ] 4465 191029 2:11:39 +71.818 galera.mysql-wsrep#33 'innodb' [ pass ] 52062 191029 2:11:59 +19.822 galera.rpl_row_annotate 'innodb' [ pass ] 4266 191029 2:12:26 +27.122 galera.versioning_trx_id 'innodb' [ pass ] 4452 -------------------------------------------------------------------------- The servers were restarted 84 times Spent 8063.684 of 15413 seconds executing testcases Completed: Failed 4/275 tests, 98.55% were successful. Failing test(s): galera.galera_parallel_autoinc_largetrx galera.MDEV-20225 galera.galera_gcs_fc_limit galera.galera_sst_mysqldump_with_key The log files in var/log may give you some hint of what went wrong. If you want to report this error, please read first the documentation at http://dev.mysql.com/doc/mysql/en/mysql-test-suite.html Errors/warnings were found in logfiles during server shutdown after running the following sequence(s) of tests: galera.galera_fk_multitable galera.galera_fk_selfreferential galera.galera_create_function galera.galera_commit_empty galera.MW-286 galera.galera_events galera.galera_change_user galera.galera_alter_engine_innodb galera.galera_bf_abort_lock_table galera.galera_FK_duplicate_client_insert galera.MW-258 galera.galera_ftwrl_drain galera.MW-357 galera.galera_fk_cascade_update galera.galera_ddl_multiline galera.galera_bf_abort galera.galera_bf_abort_ftwrl galera.galera_create_table_as_select galera.MW-369 galera.galera_fk_setnull galera.galera_alter_table_force galera.galera_fk_cascade_delete galera.galera_bf_abort_sleep galera.galera_create_table_like galera.MW-328D galera.MW-416 galera.galera_events2 galera.basic galera.MW-309 galera.galera_bf_abort_at_after_statement galera.galera_enum galera.MW-402 galera.galera_fk_multicolumn galera.MW-285 galera.enforce_storage_engine galera.binlog_checksum galera.galera_binlog_cache_size galera.create galera.galera_admin galera.galera_create_procedure galera.MW-292 galera.galera_alter_engine_myisam galera.galera_create_trigger galera.galera_bf_abort_flush_for_export galera.galera_ftwrl galera.MW-328E galera.galera_delete_limit galera.galera_drop_database galera.galera_desync_overlapped galera.galera_bf_abort_for_update galera.galera_applier_ftwrl_table galera.galera_drop_multi galera.galera_defaults galera.fk galera.MW-252 galera.galera_bf_abort_get_lock galera.galera_gcs_fc_limit galera.galera_fk_mismatch galera.galera_fk_no_pk galera.ev51914 galera.galera_binlog_row_image galera.galera#505 galera.MW-259 galera.galera_bf_abort_shutdown galera.galera_fk_conflict galera.galera#500 191029 2:12:28 +2.382 mysql-test-run: *** ERROR: there were failing test cases