Checking supported features... MariaDB Version 10.4.9-MariaDB-debug - SSL connections supported - binaries are debug compiled - binaries built with wsrep patch Using suites: galera Collecting tests... Installing system database... Using parallel: 4 worker[2] Using MTR_BUILD_THREAD 300, with reserved ports 16000..16019 worker[1] Using MTR_BUILD_THREAD 302, with reserved ports 16040..16059 worker[3] Using MTR_BUILD_THREAD 301, with reserved ports 16020..16039 worker[4] Using MTR_BUILD_THREAD 303, with reserved ports 16060..16079 ============================================================================== TEST WORKER RESULT TIME (ms) or COMMENT -------------------------------------------------------------------------- 191029 13:24:18 +23.253 galera.GCF-1081 [ disabled ] MDEV-18283 Galera test failure on galera.GCF-1081 191029 13:24:18 +0.000 galera.MW-329 [ disabled ] MDEV-19962 Galera test failure on MW-329 191029 13:24:18 +0.000 galera.MW-360 [ disabled ] needs rewrite to be MariaDB gtid compatible 191029 13:24:18 +0.000 galera.MW-388 [ disabled ] MDEV-19803 Long semaphore wait error on galera.MW-388 191029 13:24:18 +0.000 galera.galera_account_management [ disabled ] MariaDB 10.0 does not support ALTER USER 191029 13:24:18 +0.000 galera.galera_as_master_gtid [ disabled ] Requires MySQL GTID 191029 13:24:18 +0.000 galera.galera_as_master_gtid_change_master [ disabled ] Requires MySQL GTID 191029 13:24:18 +0.000 galera.galera_as_slave_gtid_replicate_do_db_cc [ disabled ] Requires MySQL GTID 191029 13:24:18 +0.000 galera.galera_as_slave_preordered [ disabled ] wsrep-preordered feature not merged to MariaDB 191029 13:24:18 +0.000 galera.galera_as_slave_replication_bundle [ disabled ] MDEV-15785 OPTION_GTID_BEGIN is set in Gtid_log_event::do_apply_event() 191029 13:24:18 +0.000 galera.galera_bf_abort_group_commit [ disabled ] MDEV-18282 Galera test failure on galera.galera_bf_abort_group_commit 191029 13:24:18 +0.000 galera.galera_binlog_rows_query_log_events [ disabled ] MariaDB does not support binlog_rows_query_log_events 191029 13:24:18 +0.000 galera.galera_binlog_stmt_autoinc [ disabled ] MDEV-19959 Galera test failure on galera_binlog_stmt_autoinc 191029 13:24:18 +0.001 galera.galera_concurrent_ctas [ disabled ] MDEV-18180 Galera test failure on galera.galera_concurrent_ctas 191029 13:24:18 +0.004 galera.galera_encrypt_tmp_files [ disabled ] Get error failed to enable encryption of temporary files 191029 13:24:18 +0.000 galera.galera_flush [ disabled ] MariaDB does not have global.thread_statistics 191029 13:24:18 +0.000 galera.galera_gcache_recover_manytrx [ disabled ] MDEV-18834 Galera test failure 191029 13:24:18 +0.000 galera.galera_ist_mariabackup [ disabled ] MDEV-18829 test leaves port open 191029 13:24:18 +0.000 galera.galera_ist_progress [ disabled ] MDEV-15236 fails when trying to read transfer status 191029 13:24:18 +0.000 galera.galera_kill_largechanges [ disabled ] MDEV-18179 Galera test failure on galera.galera_kill_largechanges 191029 13:24:18 +0.000 galera.galera_kill_nochanges [ disabled ] MDEV-18280 Galera test failure on galera_split_brain and galera_kill_nochanges 191029 13:24:18 +0.000 galera.galera_many_tables_nopk [ disabled ] MDEV-18182 Galera test failure on galera.galera_many_tables_nopk 191029 13:24:18 +0.000 galera.galera_migrate [ disabled ] MariaDB does not support START SLAVE USER 191029 13:24:18 +0.000 galera.galera_split_brain [ disabled ] MDEV-18280 Galera test failure on galera_split_brain and galera_kill_nochanges 191029 13:24:18 +0.000 galera.galera_ssl_upgrade [ disabled ] MDEV-19950 Galera test failure on galera_ssl_upgrade 191029 13:24:18 +0.000 galera.galera_var_node_address [ disabled ] MDEV-20485 Galera test failure 191029 13:24:18 +0.000 galera.galera_var_notify_cmd [ disabled ] MDEV-20600 Galera test galera_var_notify_cmd causes hang 191029 13:24:18 +0.000 galera.galera_var_reject_queries [ disabled ] assertion in inline_mysql_socket_send 191029 13:24:18 +0.000 galera.galera_var_retry_autocommit [ disabled ] MDEV-18181 Galera test failure on galera.galera_var_retry_autocommit 191029 13:24:18 +0.000 galera.galera_wan [ disabled ] MDEV-17259 Test failure on galera.galera_wan 191029 13:24:18 +0.000 galera.mysql-wsrep#198 [ disabled ] MDEV-18935 Galera test mysql-wsrep#198 sporaric assertion transaction.cpp:362: int wsrep::transaction::before_commit(): Assertion `state() == s_executing || state() == s_committing || state() == s_must_abort || state() == s_replaying' failed. 191029 13:24:18 +0.000 galera.partition [ disabled ] MDEV-19958 Galera test failure on galera.partition 191029 13:24:18 +0.000 galera.query_cache [ disabled ] MDEV-15805 Test failure on galera.query_cache 191029 13:25:02 +43.334 galera.MW-86-wait1 'innodb' w4 [ pass ] 8733 191029 13:25:05 +3.290 galera.MW-313 'innodb' w3 [ pass ] 12262 191029 13:25:06 +1.117 galera.MW-86-wait8 'innodb' w1 [ pass ] 11274 191029 13:25:08 +1.973 galera.galera_binlog_checksum 'innodb' w2 [ pass ] 15220 191029 13:25:35 +26.543 galera.galera_binlog_event_max_size_min 'innodb' w4 [ pass ] 9500 191029 13:25:43 +8.418 galera.enforce_storage_engine2 'innodb' w1 [ pass ] 7586 191029 13:25:45 +2.345 galera.galera_log_output_csv 'innodb' w2 [ pass ] 7305 191029 13:26:12 +26.328 galera.MW-44 'innodb' w4 [ pass ] 13810 191029 13:26:18 +6.702 galera.galera_mdev_13787 'innodb' w1 [ pass ] 5848 191029 13:26:26 +7.251 galera.galera_applier_ftwrl_table_alter 'innodb' w2 [ pass ] 13094 191029 13:26:53 +26.782 galera.galera_gtid 'innodb' w1 [ pass ] 5357 191029 13:27:05 +12.915 galera.galera_forced_binlog_format 'innodb' w2 [ pass ] 14484 191029 13:27:21 +15.820 galera.galera_sbr_binlog 'innodb' w1 [ pass ] 5102 191029 13:27:24 +2.925 galera.galera_bf_background_statistics 'innodb' w4 [ pass ] 45507 191029 13:27:29 +4.806 galera.galera_binlog_event_max_size_max 'innodb' w3 [ pass ] 115258 191029 13:27:41 +11.887 galera.galera_log_bin 'innodb' w2 [ pass ] 10319 191029 13:27:51 +9.643 galera.galera_v1_row_events 'innodb' w1 [ pass ] 5383 191029 13:27:53 +2.490 galera.galera_var_innodb_disallow_writes 'innodb' w4 [ pass ] 5303 191029 13:28:02 +8.882 galera.mdev_18730 'innodb' w4 [ pass ] 8504 191029 13:28:11 +9.124 galera.galera_query_cache 'innodb' w2 [ pass ] 8049 191029 13:28:25 +13.529 galera.galera_query_cache_sync_wait 'innodb' w2 [ pass ] 13161 191029 13:28:32 +7.514 galera.galera_var_auto_inc_control_on 'innodb' w4 [ pass ] 5146 191029 13:28:53 +21.156 galera.galera_sync_wait_upto 'innodb' w2 [ pass ] 8006 191029 13:28:56 +3.180 galera.galera_flush_local 'innodb' w3 [ pass ] 63053 191029 13:29:01 +5.081 galera.galera_wsrep_new_cluster 'innodb' w4 [ pass ] 4673 191029 13:29:23 +21.859 galera.galera_wsrep_log_conficts 'innodb' w2 [ pass ] 4285 191029 13:29:23 +0.099 galera.galera_var_sst_auth 'innodb' w3 [ pass ] 2053 191029 13:29:35 +11.340 galera.GAL-419 'innodb' w4 [ pass ] 15777 191029 13:29:53 +17.947 galera.galera_commit_empty 'innodb' w2 [ pass ] 2065 191029 13:30:00 +6.929 galera.galera_create_function 'innodb' w2 [ pass ] 6645 191029 13:30:01 +1.268 galera.galera_performance_schema 'innodb' w3 [ pass ] 9157 191029 13:30:10 +8.860 galera.galera_pk_bigint_signed 'innodb' w3 [ pass ] 8043 191029 13:30:12 +2.122 galera.galera_create_procedure 'innodb' w2 [ pass ] 11808 191029 13:30:17 +4.712 galera.galera_pk_bigint_unsigned 'innodb' w3 [ pass ] 6473 191029 13:30:36 +19.590 galera.galera_prepared_statement 'innodb' w3 [ pass ] 19199 191029 13:30:45 +8.499 galera.galera_read_only 'innodb' w3 [ pass ] 7961 191029 13:30:56 +11.596 galera.galera_repl_key_format_flat16 'innodb' w3 [ pass ] 11285 191029 13:31:01 +4.378 galera.mysql-wsrep#201 'innodb' w1 [ pass ] 168119 191029 13:31:02 +1.566 galera.galera_repl_max_ws_size 'innodb' w3 [ pass ] 5585 191029 13:31:07 +4.513 galera.galera_create_table_as_select 'innodb' w2 [ pass ] 54189 191029 13:31:20 +13.000 galera.galera_restart_nochanges 'innodb' w3 [ pass ] 17153 191029 13:31:25 +5.417 galera.galera_create_table_like 'innodb' w2 [ pass ] 17968 191029 13:31:42 +16.375 galera.galera_create_trigger 'innodb' w2 [ pass ] 15965 191029 13:31:42 +0.477 galera.galera_transaction_replay 'innodb' w1 [ pass ] 14677 191029 13:31:59 +16.924 galera.galera_ddl_multiline 'innodb' w2 [ pass ] 16525 191029 13:32:01 +2.484 galera.galera_defaults 'innodb' w2 [ pass ] 2120 191029 13:32:14 +12.445 galera.galera_truncate 'innodb' w1 [ pass ] 30133 191029 13:32:17 +2.773 galera.galera_delete_limit 'innodb' w2 [ pass ] 14745 191029 13:32:31 +14.653 galera.galera_truncate_temporary 'innodb' w1 [ pass ] 16841 191029 13:32:33 +2.103 galera.galera_desync_overlapped 'innodb' w2 [ pass ] 16097 191029 13:32:49 +15.411 galera.galera_unicode_identifiers 'innodb' w1 [ pass ] 17060 191029 13:32:51 +1.855 galera.galera_restart_on_unknown_option 'innodb' w3 [ pass ] 90342 191029 13:32:56 +5.421 galera.galera_unicode_pk 'innodb' w1 [ pass ] 6970 191029 13:33:11 +15.315 galera.galera_update_limit 'innodb' w1 [ pass ] 14942 191029 13:33:16 +5.034 galera.galera_var_OSU_method 'innodb' w1 [ pass ] 4549 191029 13:33:19 +2.878 galera.galera_roles 'innodb' w3 [ pass ] 28082 191029 13:33:23 +3.506 galera.galera_var_OSU_method2 'innodb' w1 [ pass ] 5871 191029 13:33:28 +4.904 galera.galera_rsu_error 'innodb' w3 [ pass ] 8085 191029 13:33:31 +3.263 galera.galera_var_auto_inc_control_off 'innodb' w1 [ pass ] 7619 191029 13:33:35 +3.772 galera.galera_rsu_simple 'innodb' w3 [ pass ] 6607 191029 13:33:37 +1.871 galera.galera_drop_database 'innodb' w2 [ pass ] 62800 191029 13:33:42 +5.423 galera.galera_var_certify_nonPK_off 'innodb' w1 [ pass ] 10459 191029 13:33:46 +3.942 galera.galera_rsu_wsrep_desync 'innodb' w3 [ pass ] 10781 191029 13:33:47 +0.747 galera.galera_drop_multi 'innodb' w2 [ pass ] 9528 191029 13:33:52 +4.868 galera.galera_var_cluster_address 'innodb' w1 [ pass ] 9256 191029 13:33:52 +0.739 galera.galera_sbr 'innodb' w3 [ pass ] 5957 191029 13:33:55 +2.367 galera.galera_schema_dirty_reads 'innodb' w3 [ pass ] 2052 191029 13:33:59 +4.734 galera.galera_enum 'innodb' w2 [ pass ] 12145 191029 13:34:05 +6.024 galera.galera_events 'innodb' w2 [ pass ] 5701 191029 13:34:06 +0.109 galera.galera_var_desync_on 'innodb' w1 [ pass ] 13062 191029 13:34:06 +0.777 galera.galera_serializable 'innodb' w3 [ pass ] 11245 191029 13:34:11 +4.656 galera.galera_server 'innodb' w3 [ pass ] 4107 191029 13:34:15 +4.236 galera.galera_var_dirty_reads 'innodb' w1 [ pass ] 9049 191029 13:34:27 +11.647 galera.galera_var_fkchecks 'innodb' w1 [ pass ] 11097 191029 13:34:34 +6.813 galera.galera_shutdown_nonprim 'innodb' w3 [ pass ] 22331 191029 13:34:39 +5.758 galera.galera_events2 'innodb' w2 [ pass ] 33525 191029 13:34:54 +14.498 galera.galera_fk_cascade_delete 'innodb' w2 [ pass ] 14011 191029 13:35:08 +13.756 galera.galera_sp_bf_abort 'innodb' w3 [ pass ] 33608 191029 13:35:10 +2.059 galera.galera_fk_cascade_update 'innodb' w2 [ pass ] 14740 191029 13:35:21 +10.769 galera.galera_fk_conflict 'innodb' w2 [ pass ] 10324 191029 13:35:22 +1.219 galera.galera_var_ignore_apply_errors 'innodb' w1 [ pass ] 54247 191029 13:35:31 +8.733 galera.galera_fk_mismatch 'innodb' w2 [ pass ] 8246 191029 13:35:53 +22.931 galera.galera_fk_multicolumn 'innodb' w2 [ pass ] 21791 191029 13:36:05 +11.814 galera.galera_fk_multitable 'innodb' w2 [ pass ] 10951 191029 13:36:17 +12.093 galera.galera_fk_no_pk 'innodb' w2 [ pass ] 11327 191029 13:36:26 +8.450 galera.galera_fk_selfreferential 'innodb' w2 [ pass ] 7925 191029 13:36:40 +14.030 galera.galera_fk_setnull 'innodb' w2 [ pass ] 13075 191029 13:36:50 +10.111 galera.galera_ftwrl 'innodb' w2 [ pass ] 9379 191029 13:36:57 +6.936 galera.galera_var_max_ws_rows 'innodb' w1 [ pass ] 94343 191029 13:36:58 +1.573 galera.galera_ftwrl_drain 'innodb' w2 [ pass ] 8087 191029 13:37:05 +6.154 galera.galera_var_max_ws_size 'innodb' w1 [ pass ] 7153 191029 13:37:09 +4.538 galera.galera_gcs_fc_limit 'innodb' w2 [ pass ] 10251 191029 13:37:11 +2.137 galera.galera_var_mysql_replication_bundle 'innodb' w1 [ pass ] 6320 191029 13:37:15 +3.885 galera.galera_var_replicate_myisam_off 'innodb' w1 [ pass ] 3479 191029 13:37:16 +0.348 galera.galera_gra_log 'innodb' w2 [ pass ] 5823 191029 13:37:32 +16.322 galera.galera_insert_ignore 'innodb' w2 [ pass ] 14777 191029 13:37:40 +7.709 galera.MW-328A 'innodb' w4 [ pass ] 483456 191029 13:37:48 +8.738 galera.galera_var_replicate_myisam_on 'innodb' w1 [ pass ] 32653 191029 13:37:57 +8.875 galera.galera_insert_multi 'innodb' w2 [ pass ] 24885 191029 13:38:01 +4.033 galera.galera_var_sync_wait 'innodb' w1 [ pass ] 12466 191029 13:38:08 +6.374 galera.galera_var_wsrep_on_off 'innodb' w1 [ pass ] 5903 191029 13:38:10 +2.331 galera.galera_wsrep_provider_options_syntax 'innodb' w1 [ pass ] 2033 191029 13:38:14 +4.217 galera.galera_kill_applier 'innodb' w2 [ pass ] 6342 191029 13:38:24 +10.088 galera.galera_wsrep_provider_unset_set 'innodb' w1 [ pass ] 13583 191029 13:38:36 +11.450 galera.galera_zero_length_column 'innodb' w1 [ pass ] 10854 191029 13:38:40 +4.703 galera.grant 'innodb' w1 [ pass ] 4087 191029 13:38:48 +8.115 galera.lp1276424 'innodb' w1 [ pass ] 7781 191029 13:38:52 +3.349 galera.galera_kill_ddl 'innodb' w2 [ pass ] 24572 191029 13:38:55 +2.926 galera.lp1347768 'innodb' w1 [ pass ] 5571 191029 13:39:05 +10.709 galera.lp1376747 'innodb' w1 [ pass ] 10347 191029 13:39:14 +8.700 galera.lp1376747-2 'innodb' w1 [ pass ] 8208 191029 13:39:17 +3.251 galera.galera_kill_smallchanges 'innodb' w2 [ pass ] 24881 191029 13:39:24 +6.830 galera.lp1376747-3 'innodb' w1 [ pass ] 9487 191029 13:39:25 +1.077 galera.galera_last_committed_id 'innodb' w2 [ pass ] 7178 191029 13:39:37 +11.186 galera.galera_lock_table 'innodb' w2 [ pass ] 10777 191029 13:39:39 +2.740 galera.lp1376747-4 'innodb' w1 [ pass ] 14470 191029 13:39:53 +13.562 galera.lp1438990 'innodb' w1 [ pass ] 12997 191029 13:40:07 +14.009 galera.lp959512 'innodb' w1 [ pass ] 13045 191029 13:40:13 +5.762 galera.mdev_9290 'innodb' w1 [ pass ] 5192 191029 13:40:36 +23.083 galera.mysql-wsrep#110 'innodb' w1 [ pass ] 22252 191029 13:40:44 +8.524 galera.mysql-wsrep#237 'innodb' w1 [ pass ] 8216 191029 13:40:50 +5.966 galera.mysql-wsrep#247 'innodb' w1 [ pass ] 5397 191029 13:41:12 +21.546 galera.mysql-wsrep#31 'innodb' w1 [ pass ] 21240 191029 13:41:59 +47.464 galera.galera_many_indexes 'innodb' w2 [ pass ] 141519 191029 13:42:09 +10.021 galera.galera_mdev_10812 'innodb' w2 [ pass ] 9630 191029 13:42:22 +12.388 galera.galera_mdl_race 'innodb' w2 [ pass ] 11630 191029 13:42:34 +12.212 galera.galera_multi_database 'innodb' w2 [ pass ] 11835 191029 13:42:36 +2.183 galera.mysql-wsrep#332 'innodb' w1 [ pass ] 71186 191029 13:42:42 +6.080 galera.galera_myisam_autocommit 'innodb' w2 [ pass ] 7953 191029 13:42:50 +7.709 galera.mysql-wsrep#90 'innodb' w1 [ pass ] 13378 191029 13:42:50 +0.416 galera.galera_myisam_transactions 'innodb' w2 [ pass ] 7847 191029 13:43:02 +11.421 galera.galera_nopk_bit 'innodb' w2 [ pass ] 10767 191029 13:43:06 +4.274 galera.pxc-421 'innodb' w1 [ pass ] 15411 191029 13:43:12 +6.606 galera.galera_nopk_blob 'innodb' w2 [ pass ] 10541 191029 13:43:16 +3.545 galera.rename 'innodb' w1 [ pass ] 9838 191029 13:43:24 +7.654 galera.galera_nopk_large_varchar 'innodb' w2 [ pass ] 10401 191029 13:43:31 +7.228 galera.galera_nopk_unicode 'innodb' w2 [ pass ] 6834 191029 13:43:34 +3.002 galera.sql_log_bin 'innodb' w1 [ pass ] 17486 191029 13:43:43 +8.611 galera.unique_key 'innodb' w1 [ pass ] 7977 191029 13:43:44 +1.024 galera.galera_parallel_apply_lock_table 'innodb' w2 [ pass ] 11667 191029 13:43:57 +13.705 galera.view 'innodb' w1 [ pass ] 13746 191029 13:44:00 +2.405 galera.wsrep_trx_fragment_size_sr 'innodb' w1 [ pass ] 2087 191029 13:44:02 +2.058 galera.galera_parallel_simple 'innodb' w2 [ pass ] 17689 191029 13:44:44 +42.645 galera.galera_pc_ignore_sb 'innodb' w2 [ fail ] Test ended at 2019-10-29 13:44:44 CURRENT_TEST: galera.galera_pc_ignore_sb mysqltest: At line 38: query 'SET GLOBAL wsrep_cluster_address = ''' failed: 2013: Lost connection to MySQL server during query The result from queries just before the failure was: < snip > connection node_1; connection node_2; connection node_1; SET @wsrep_cluster_address_orig = @@GLOBAL.wsrep_cluster_address; SET @wsrep_provider_options_orig = @@GLOBAL.wsrep_provider_options; SET GLOBAL wsrep_provider_options ='pc.ignore_sb=true'; connection node_2; Killing server ... connection node_1; CREATE TABLE t1 (f1 INTEGER) ENGINE=InnoDB; INSERT INTO t1 VALUES (1); DROP TABLE t1; SELECT VARIABLE_VALUE = 1 FROM INFORMATION_SCHEMA.GLOBAL_STATUS WHERE VARIABLE_NAME = 'wsrep_cluster_size'; VARIABLE_VALUE = 1 1 SELECT VARIABLE_VALUE = 'ON' FROM INFORMATION_SCHEMA.GLOBAL_STATUS WHERE VARIABLE_NAME = 'wsrep_ready'; VARIABLE_VALUE = 'ON' 1 SET GLOBAL wsrep_cluster_address = ''; More results from queries before failure can be found in /home/stepan/mariadb/10.4/github/mysql-test/var/2/log/galera_pc_ignore_sb.log Server [mysqld.1 - pid: 24800, winpid: 24800, exit: 256] failed during test run Server log from this test: ----------SERVER LOG START----------- 2019-10-29 13:44:04 0 [Note] WSREP: (9854ea3e, 'tcp://0.0.0.0:16002') turning message relay requesting on, nonlive peers: tcp://127.0.0.1:16005 2019-10-29 13:44:05 0 [Note] WSREP: (9854ea3e, 'tcp://0.0.0.0:16002') reconnecting to 9b7be534 (tcp://127.0.0.1:16005), attempt 0 2019-10-29 13:44:14 0 [Note] WSREP: evs::proto(9854ea3e, OPERATIONAL, view_id(REG,9854ea3e,6)) suspecting node: 9b7be534 2019-10-29 13:44:14 0 [Note] WSREP: evs::proto(9854ea3e, OPERATIONAL, view_id(REG,9854ea3e,6)) suspected node without join message, declaring inactive 2019-10-29 13:44:15 0 [Warning] WSREP: Ignoring possible split-brain (allowed by configuration) from view: view(view_id(REG,9854ea3e,6) memb { 9854ea3e,0 9b7be534,0 } joined { 9b7be534,0 } left { } partitioned { }) to view: view(view_id(TRANS,9854ea3e,6) memb { 9854ea3e,0 } joined { } left { } partitioned { 9b7be534,0 }) 2019-10-29 13:44:15 0 [Note] WSREP: Node 9854ea3e state prim 2019-10-29 13:44:15 0 [Note] WSREP: view(view_id(PRIM,9854ea3e,7) memb { 9854ea3e,0 } joined { } left { } partitioned { 9b7be534,0 }) 2019-10-29 13:44:15 0 [Note] WSREP: save pc into disk 2019-10-29 13:44:16 0 [Note] WSREP: forgetting 9b7be534 (tcp://127.0.0.1:16005) 2019-10-29 13:44:16 0 [Note] WSREP: (9854ea3e, 'tcp://0.0.0.0:16002') turning message relay requesting off 2019-10-29 13:44:16 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 2019-10-29 13:44:16 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 6f63fffb-fa41-11e9-b051-0a91aed651a8 2019-10-29 13:44:16 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 6f63fffb-fa41-11e9-b051-0a91aed651a8 2019-10-29 13:44:16 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6f63fffb-fa41-11e9-b051-0a91aed651a8 from 0 (cnt7glr11.localdomain) 2019-10-29 13:44:16 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 6, members = 1/1 (joined/total), act_id = 183, last_appl. = 133, protocols = 2/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 987927f7-fa40-11e9-baf0-16b8f36a614f 2019-10-29 13:44:16 0 [Note] WSREP: Flow-control interval: [16, 16] 2019-10-29 13:44:16 2 [Note] WSREP: ####### processing CC 184, local, ordered 2019-10-29 13:44:16 2 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-10-29 13:44:16 2 [Note] WSREP: ####### My UUID: 9854ea3e-fa40-11e9-879e-ae53433a5055 2019-10-29 13:44:16 2 [Note] WSREP: ####### ST not required 2019-10-29 13:44:16 2 [Note] WSREP: Skipping cert index reset 2019-10-29 13:44:16 2 [Note] WSREP: ####### Adjusting cert position: 183 -> 184 2019-10-29 13:44:16 0 [Note] WSREP: Service thread queue flushed. 2019-10-29 13:44:16 2 [Note] WSREP: ####### Setting monitor position to 184 2019-10-29 13:44:16 2 [Note] WSREP: Lowest cert indnex boundary for CC from group: 134 2019-10-29 13:44:16 2 [Note] WSREP: Min available from gcache for CC from group: 1 2019-10-29 13:44:16 2 [Note] WSREP: ================================================ View: id: 987927f7-fa40-11e9-baf0-16b8f36a614f:184 status: primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: no own_index: 0 members(1): 0: 9854ea3e-fa40-11e9-879e-ae53433a5055, cnt7glr11.localdomain ================================================= 2019-10-29 13:44:16 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-10-29 13:44:18 0 [Note] WSREP: cleaning up 9b7be534 (tcp://127.0.0.1:16005) 2019-10-29 13:44:23 121 [Note] WSREP: Stop replication by 121 2019-10-29 13:44:23 121 [Note] WSREP: Server status change synced -> disconnecting 2019-10-29 13:44:23 121 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-10-29 13:44:23 121 [Note] WSREP: Closing send monitor... 2019-10-29 13:44:23 121 [Note] WSREP: Closed send monitor. 2019-10-29 13:44:23 121 [Note] WSREP: gcomm: terminating thread 2019-10-29 13:44:23 121 [Note] WSREP: gcomm: joining thread 2019-10-29 13:44:23 121 [Note] WSREP: gcomm: closing backend 2019-10-29 13:44:23 121 [Note] WSREP: PC protocol downgrade 1 -> 0 2019-10-29 13:44:23 121 [Note] WSREP: view((empty)) 2019-10-29 13:44:23 121 [Note] WSREP: gcomm: closed 2019-10-29 13:44:23 0 [Note] WSREP: New SELF-LEAVE. 2019-10-29 13:44:23 0 [Note] WSREP: Flow-control interval: [0, 0] 2019-10-29 13:44:23 0 [Note] WSREP: Received SELF-LEAVE. Closing connection. 2019-10-29 13:44:23 0 [Note] WSREP: Shifting SYNCED -> CLOSED (TO: 187) 2019-10-29 13:44:23 0 [Note] WSREP: RECV thread exiting 0: Success 2019-10-29 13:44:23 2 [Note] WSREP: ####### processing CC -1, local, ordered 2019-10-29 13:44:23 121 [Note] WSREP: recv_thread() joined. 2019-10-29 13:44:23 121 [Note] WSREP: Closing replication queue. 2019-10-29 13:44:23 121 [Note] WSREP: Closing slave action queue. 2019-10-29 13:44:23 2 [Note] WSREP: ####### My UUID: 9854ea3e-fa40-11e9-879e-ae53433a5055 2019-10-29 13:44:23 2 [Note] WSREP: ####### ST not required 2019-10-29 13:44:23 2 [Note] WSREP: ================================================ View: id: 987927f7-fa40-11e9-baf0-16b8f36a614f:-1 status: non-primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: yes own_index: -1 members(0): ================================================= 2019-10-29 13:44:23 2 [Note] WSREP: Non-primary view 2019-10-29 13:44:23 2 [Note] WSREP: Server status change disconnecting -> disconnected 2019-10-29 13:44:23 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-10-29 13:44:23 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-10-29 13:44:23 2 [Note] WSREP: Applier thread exiting ret: 0 thd: 2 2019-10-29 13:44:23 2 [Warning] Aborted connection 2 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) 2019-10-29 13:44:23 121 [Note] WSREP: killing local connection: 120 mysqld: /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_socket.h:779: inline_mysql_socket_recv: Assertion `mysql_socket.fd != -1' failed. 191029 13:44:23 [ERROR] mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.4.9-MariaDB-debug-log key_buffer_size=1048576 read_buffer_size=131072 max_used_connections=3 max_threads=153 thread_count=9 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 63618 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7f0f8c000b00 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f0fe7f68d30 thread_stack 0x49000 /home/stepan/mariadb/10.4/github/sql/mysqld(my_print_stacktrace+0x40)[0x563c5a8e0008] /home/stepan/mariadb/10.4/github/sql/mysqld(handle_fatal_signal+0x3a9)[0x563c5a04c5dd] sigaction.c:0(__restore_rt)[0x7f100e6915d0] :0(__GI_raise)[0x7f100c97f207] :0(__GI_abort)[0x7f100c9808f8] :0(__assert_fail_base)[0x7f100c978026] :0(__GI___assert_fail)[0x7f100c9780d2] psi/mysql_socket.h:781(inline_mysql_socket_recv)[0x563c5a94e638] vio/viosocket.c:189(vio_read)[0x563c5a94ed2e] sql/net_serv.cc:962(my_real_read(st_net*, unsigned long*, char))[0x563c5a1cd1e3] sql/net_serv.cc:1243(my_net_read_packet_reallen)[0x563c5a1cdae1] sql/net_serv.cc:1228(my_net_read_packet)[0x563c5a1cda94] sql/sql_parse.cc:1232(do_command(THD*))[0x563c59ce49de] sql/sql_connect.cc:1412(do_handle_one_connection(CONNECT*))[0x563c59e6ed51] sql/sql_connect.cc:1317(handle_one_connection)[0x563c59e6ea80] perfschema/pfs.cc:1864(pfs_spawn_thread)[0x563c5a86e4a5] pthread_create.c:0(start_thread)[0x7f100e689dd5] /lib64/libc.so.6(clone+0x6d)[0x7f100ca46ead] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x0): Connection ID (thread ID): 120 Status: KILL_CONNECTION Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /home/stepan/mariadb/10.4/github/mysql-test/var/2/mysqld.1/data Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size unlimited unlimited bytes Max resident set unlimited unlimited bytes Max processes 4096 23005 processes Max open files 1024 1024 files Max locked memory 65536 65536 bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 23005 23005 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: |/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t e %P %I %h ----------SERVER LOG END------------- - found 'core.24801' (0/5) Trying 'dbx' to get a backtrace Trying 'gdb' to get a backtrace from coredump /home/stepan/mariadb/10.4/github/mysql-test/var/2/log/galera.galera_pc_ignore_sb-innodb/mysqld.1/data/core.24801 Core generated by '/home/stepan/mariadb/10.4/github/sql/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- [New LWP 25720] [New LWP 24803] [New LWP 24802] [New LWP 24808] [New LWP 24821] [New LWP 24813] [New LWP 24809] [New LWP 24823] [New LWP 24814] [New LWP 24824] [New LWP 24810] [New LWP 24817] [New LWP 24827] [New LWP 24812] [New LWP 24818] [New LWP 24831] [New LWP 24815] [New LWP 24822] [New LWP 24819] [New LWP 24825] [New LWP 24820] [New LWP 24826] [New LWP 24830] [New LWP 24828] [New LWP 25107] [New LWP 24801] [New LWP 24840] [New LWP 24829] [New LWP 24806] [New LWP 24811] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `/home/stepan/mariadb/10.4/github/sql/mysqld --defaults-group-suffix=.1 --defaul'. Program terminated with signal 6, Aborted. #0 0x00007f100e68e9d1 in pthread_kill () from /lib64/libpthread.so.0 #0 0x00007f100e68e9d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x0000563c5a8e00f6 in my_write_core (sig=6) at /home/stepan/mariadb/10.4/github/mysys/stacktrace.c:481 #2 0x0000563c5a04c964 in handle_fatal_signal (sig=6) at /home/stepan/mariadb/10.4/github/sql/signal_handler.cc:343 #3 #4 0x00007f100c97f207 in raise () from /lib64/libc.so.6 #5 0x00007f100c9808f8 in abort () from /lib64/libc.so.6 #6 0x00007f100c978026 in __assert_fail_base () from /lib64/libc.so.6 #7 0x00007f100c9780d2 in __assert_fail () from /lib64/libc.so.6 #8 0x0000563c5a94e638 in inline_mysql_socket_recv (src_file=0x563c5aedb680 "/home/stepan/mariadb/10.4/github/vio/viosocket.c", src_line=190, mysql_socket=..., buf=0x7f0f8c008330, n=4, flags=64) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_socket.h:779 #9 0x0000563c5a94ed2e in vio_read (vio=0x563c5e1426e0, buf=0x7f0f8c008330 "\001", size=4) at /home/stepan/mariadb/10.4/github/vio/viosocket.c:189 #10 0x0000563c5a1cd1e3 in my_real_read (net=0x7f0f8c000df8, complen=0x7f0fe7f68810, header=1 '\001') at /home/stepan/mariadb/10.4/github/sql/net_serv.cc:962 #11 0x0000563c5a1cdae1 in my_net_read_packet_reallen (net=0x7f0f8c000df8, read_from_server=1 '\001', reallen=0x7f0fe7f68878) at /home/stepan/mariadb/10.4/github/sql/net_serv.cc:1243 #12 0x0000563c5a1cda94 in my_net_read_packet (net=0x7f0f8c000df8, read_from_server=1 '\001') at /home/stepan/mariadb/10.4/github/sql/net_serv.cc:1227 #13 0x0000563c59ce49de in do_command (thd=0x7f0f8c000b00) at /home/stepan/mariadb/10.4/github/sql/sql_parse.cc:1232 #14 0x0000563c59e6ed51 in do_handle_one_connection (connect=0x563c5e1cb1a0) at /home/stepan/mariadb/10.4/github/sql/sql_connect.cc:1412 #15 0x0000563c59e6ea80 in handle_one_connection (arg=0x563c5e1cb1a0) at /home/stepan/mariadb/10.4/github/sql/sql_connect.cc:1316 #16 0x0000563c5a86e4a5 in pfs_spawn_thread (arg=0x563c5e18be70) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #17 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #18 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 30 (Thread 0x7f0fe6dfd700 (LWP 24811)): #0 0x00007f100e25a644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x0000563c5a38cdad in LinuxAIOHandler::collect (this=0x7f0fe6dfcb00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x0000563c5a38d3f6 in LinuxAIOHandler::poll (this=0x7f0fe6dfcb00, m1=0x7f0fe6dfcba8, m2=0x7f0fe6dfcbb0, request=0x7f0fe6dfcbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x0000563c5a38d559 in os_aio_linux_handler (global_segment=2, m1=0x7f0fe6dfcba8, m2=0x7f0fe6dfcbb0, request=0x7f0fe6dfcbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x0000563c5a3922c0 in os_aio_handler (segment=2, m1=0x7f0fe6dfcba8, m2=0x7f0fe6dfcbb0, request=0x7f0fe6dfcbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x0000563c5a6484f9 in fil_aio_wait (segment=2) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x0000563c5a4b9e42 in io_handler_thread (arg=0x563c5b6f3990 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 29 (Thread 0x7f100466e700 (LWP 24806)): #0 0x00007f100e68d965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a8e5769 in safe_cond_wait (cond=0x7f0ff4014758, mp=0x7f0ff40146a8, file=0x563c5aa622c0 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:492 #2 0x0000563c59f6d1b4 in inline_mysql_cond_wait (that=0x7f0ff4014758, mutex=0x7f0ff40146a8, src_file=0x563c5aa624e0 "/home/stepan/mariadb/10.4/github/sql/wsrep_thd.h", src_line=69) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1178 #3 0x0000563c59f70416 in Wsrep_thd_queue::pop_front (this=0x7f0ff4014650) at /home/stepan/mariadb/10.4/github/sql/wsrep_thd.h:69 #4 0x0000563c59f6ee23 in wsrep_rollback_process (rollbacker=0x7f0ff4001d50, arg=0x563c5dcff1a0) at /home/stepan/mariadb/10.4/github/sql/wsrep_thd.cc:266 #5 0x0000563c59f5de70 in start_wsrep_THD (arg=0x563c5dcff1a0) at /home/stepan/mariadb/10.4/github/sql/wsrep_mysqld.cc:2708 #6 0x0000563c5a86e4a5 in pfs_spawn_thread (arg=0x563c5dd077c0) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #7 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 28 (Thread 0x7f0fd17fa700 (LWP 24829)): #0 0x00007f100e68d965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a39b377 in os_event::wait (this=0x563c5ddf7710) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x0000563c5a39ae6b in os_event::wait_low (this=0x563c5ddf7710, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x0000563c5a39b16e in os_event_wait_low (event=0x563c5ddf7710, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x0000563c5a59e7d9 in buf_resize_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/buf/buf0buf.cc:3199 #5 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 27 (Thread 0x7f0ffc089700 (LWP 24840)): #0 0x00007f100e68d965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a8e5769 in safe_cond_wait (cond=0x563c5b6750a0 , mp=0x563c5b678320 , file=0x563c5a9b40c0 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1167) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:492 #2 0x0000563c59bd708e in inline_mysql_cond_wait (that=0x563c5b6750a0 , mutex=0x563c5b678320 , src_file=0x563c5a9b4c20 "/home/stepan/mariadb/10.4/github/sql/slave.cc", src_line=519) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1167 #3 0x0000563c59bd89cb in handle_slave_background (arg=0x0) at /home/stepan/mariadb/10.4/github/sql/slave.cc:519 #4 0x0000563c5a86e4a5 in pfs_spawn_thread (arg=0x563c5e1fafe0) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #5 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 26 (Thread 0x7f100ea9a880 (LWP 24801)): #0 0x00007f100ca3c20d in poll () from /lib64/libc.so.6 #1 0x0000563c59bb12db in handle_connections_sockets () at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:6455 #2 0x0000563c59bb0576 in mysqld_main (argc=162, argv=0x563c5db3d130) at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:5891 #3 0x0000563c59ba4095 in main (argc=23, argv=0x7ffc25d9e8d8) at /home/stepan/mariadb/10.4/github/sql/main.cc:25 Thread 25 (Thread 0x7f0fe7fb4700 (LWP 25107)): #0 0x00007f100ca0de2d in nanosleep () from /lib64/libc.so.6 #1 0x00007f100ca0dcc4 in sleep () from /lib64/libc.so.6 #2 0x0000563c59f5c642 in wsrep_close_client_connections (wait_to_end=1 '\001', except_caller_thd=0x7f0f90000b00) at /home/stepan/mariadb/10.4/github/sql/wsrep_mysqld.cc:2344 #3 0x0000563c59f55ffc in wsrep_stop_replication (thd=0x7f0f90000b00) at /home/stepan/mariadb/10.4/github/sql/wsrep_mysqld.cc:943 #4 0x0000563c59f688ae in wsrep_cluster_address_update (self=0x563c5b69d8a0 , thd=0x7f0f90000b00, type=SHOW_OPT_GLOBAL) at /home/stepan/mariadb/10.4/github/sql/wsrep_var.cc:483 #5 0x0000563c59bd1958 in sys_var::update (this=0x563c5b69d8a0 , thd=0x7f0f90000b00, var=0x7f0f90011f60) at /home/stepan/mariadb/10.4/github/sql/set_var.cc:209 #6 0x0000563c59bd36f4 in set_var::update (this=0x7f0f90011f60, thd=0x7f0f90000b00) at /home/stepan/mariadb/10.4/github/sql/set_var.cc:837 #7 0x0000563c59bd336e in sql_set_variables (thd=0x7f0f90000b00, var_list=0x7f0f90005930, free=true) at /home/stepan/mariadb/10.4/github/sql/set_var.cc:740 #8 0x0000563c59cf1179 in mysql_execute_command (thd=0x7f0f90000b00) at /home/stepan/mariadb/10.4/github/sql/sql_parse.cc:4944 #9 0x0000563c59cfb7b5 in mysql_parse (thd=0x7f0f90000b00, rawbuf=0x7f0f90011df8 "SET GLOBAL wsrep_cluster_address = ''", length=37, parser_state=0x7f0fe7fb3030, is_com_multi=false, is_next_command=false) at /home/stepan/mariadb/10.4/github/sql/sql_parse.cc:7912 #10 0x0000563c59cfad68 in wsrep_mysql_parse (thd=0x7f0f90000b00, rawbuf=0x7f0f90011df8 "SET GLOBAL wsrep_cluster_address = ''", length=37, parser_state=0x7f0fe7fb3030, is_com_multi=false, is_next_command=false) at /home/stepan/mariadb/10.4/github/sql/sql_parse.cc:7716 #11 0x0000563c59ce6a77 in dispatch_command (command=COM_QUERY, thd=0x7f0f90000b00, packet=0x7f0f90008331 "SET GLOBAL wsrep_cluster_address = ''", packet_length=37, is_com_multi=false, is_next_command=false) at /home/stepan/mariadb/10.4/github/sql/sql_parse.cc:1826 #12 0x0000563c59ce518a in do_command (thd=0x7f0f90000b00) at /home/stepan/mariadb/10.4/github/sql/sql_parse.cc:1359 #13 0x0000563c59e6ed51 in do_handle_one_connection (connect=0x563c5e200380) at /home/stepan/mariadb/10.4/github/sql/sql_connect.cc:1412 #14 0x0000563c59e6ea80 in handle_one_connection (arg=0x563c5e200380) at /home/stepan/mariadb/10.4/github/sql/sql_connect.cc:1316 #15 0x0000563c5a86e4a5 in pfs_spawn_thread (arg=0x563c5e1eeec0) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #16 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #17 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 24 (Thread 0x7f0fd1ffb700 (LWP 24828)): #0 0x00007f100e690e3d in nanosleep () from /lib64/libpthread.so.0 #1 0x0000563c5a39b6b4 in os_thread_sleep (tm=1000000) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0thread.cc:225 #2 0x0000563c5a58ddd3 in btr_defragment_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/btr/btr0defragment.cc:705 #3 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 23 (Thread 0x7f0fd0ff9700 (LWP 24830)): #0 0x00007f100e68d965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a8e5769 in safe_cond_wait (cond=0x7f0fd0ff8c70, mp=0x7f0fd0ff8cb0, file=0x563c5abd2ce0 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:492 #2 0x0000563c5a28e15d in inline_mysql_cond_wait (that=0x7f0fd0ff8c70, mutex=0x7f0fd0ff8cb0, src_file=0x563c5abd47f8 "/home/stepan/mariadb/10.4/github/storage/innobase/handler/ha_innodb.cc", src_line=288) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1178 #3 0x0000563c5a293a55 in thd_destructor_proxy () at /home/stepan/mariadb/10.4/github/storage/innobase/handler/ha_innodb.cc:288 #4 0x0000563c5a86e4a5 in pfs_spawn_thread (arg=0x563c5e0a0200) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #5 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 22 (Thread 0x7f0fd2ffd700 (LWP 24826)): #0 0x00007f100e68d965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a39b377 in os_event::wait (this=0x563c5ddf7390) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x0000563c5a39ae6b in os_event::wait_low (this=0x563c5ddf7390, reset_sig_count=845) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x0000563c5a39b16e in os_event_wait_low (event=0x563c5ddf7390, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x0000563c5a4b3328 in srv_resume_thread (slot=0x563c5b4afd10 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:909 #5 0x0000563c5a4b75e9 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 21 (Thread 0x7f0fd3fff700 (LWP 24820)): #0 0x00007f100e68dd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a39ad00 in os_event::timed_wait (this=0x563c5e064820, abstime=0x7f0fd3ffed70) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x0000563c5a39afa9 in os_event::wait_time_low (this=0x563c5e064820, time_in_usec=10000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x0000563c5a39b149 in os_event_wait_time_low (event=0x563c5e064820, time_in_usec=10000000, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x0000563c5a62f6ca in dict_stats_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/dict/dict0stats_bg.cc:476 #5 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 20 (Thread 0x7f0fd37fe700 (LWP 24825)): #0 0x00007f100e68d965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a39b377 in os_event::wait (this=0x563c5ddf7410) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x0000563c5a39ae6b in os_event::wait_low (this=0x563c5ddf7410, reset_sig_count=745) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x0000563c5a39b16e in os_event_wait_low (event=0x563c5ddf7410, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x0000563c5a4b3328 in srv_resume_thread (slot=0x563c5b4afe10 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:909 #5 0x0000563c5a4b75e9 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7f0fda7fc700 (LWP 24819)): #0 0x00007f100e68dd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a39ad00 in os_event::timed_wait (this=0x563c5ddf7590, abstime=0x7f0fda7fbd30) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x0000563c5a39afa9 in os_event::wait_time_low (this=0x563c5ddf7590, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x0000563c5a39b149 in os_event_wait_time_low (event=0x563c5ddf7590, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x0000563c5a4b520f in srv_monitor_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:1687 #5 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7f0fdbfff700 (LWP 24822)): #0 0x00007f100e690e3d in nanosleep () from /lib64/libpthread.so.0 #1 0x0000563c5a39b6b4 in os_thread_sleep (tm=1000000) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0thread.cc:225 #2 0x0000563c5a4b6d65 in srv_master_sleep () at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2334 #3 0x0000563c5a4b6ecd in srv_master_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2375 #4 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 17 (Thread 0x7f0fe4df9700 (LWP 24815)): #0 0x00007f100e68dd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a39ad00 in os_event::timed_wait (this=0x563c5ddf7690, abstime=0x7f0fe4df8b00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x0000563c5a39afa9 in os_event::wait_time_low (this=0x563c5ddf7690, time_in_usec=490000, reset_sig_count=2) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x0000563c5a39b149 in os_event_wait_time_low (event=0x563c5ddf7690, time_in_usec=490000, reset_sig_count=2) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x0000563c5a5c5358 in pc_sleep_if_needed (next_loop_time=1089064865, sig_count=2, cur_time=1089064375) at /home/stepan/mariadb/10.4/github/storage/innobase/buf/buf0flu.cc:2643 #5 0x0000563c5a5c64fc in buf_flush_page_cleaner_coordinator () at /home/stepan/mariadb/10.4/github/storage/innobase/buf/buf0flu.cc:3102 #6 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7f0ffc0d4700 (LWP 24831)): #0 0x00007f100c98040a in sigwaitinfo () from /lib64/libc.so.6 #1 0x0000563c59ba4114 in my_sigwait (set=0x7f0ffc0d3cf0, sig=0x7f0ffc0d3cb4, code=0x7f0ffc0d3cb8) at /home/stepan/mariadb/10.4/github/include/my_pthread.h:198 #2 0x0000563c59baaa8d in signal_hand (arg=0x0) at /home/stepan/mariadb/10.4/github/sql/mysqld.cc:3243 #3 0x0000563c5a86e4a5 in pfs_spawn_thread (arg=0x563c5e0d5ee0) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #4 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7f0fdaffd700 (LWP 24818)): #0 0x00007f100e68dd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a39ad00 in os_event::timed_wait (this=0x563c5ddf7510, abstime=0x7f0fdaffcbb0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x0000563c5a39afa9 in os_event::wait_time_low (this=0x563c5ddf7510, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x0000563c5a39b149 in os_event_wait_time_low (event=0x563c5ddf7510, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x0000563c5a4b5789 in srv_error_monitor_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:1851 #5 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7f0fe65fc700 (LWP 24812)): #0 0x00007f100e25a644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x0000563c5a38cdad in LinuxAIOHandler::collect (this=0x7f0fe65fbb00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x0000563c5a38d3f6 in LinuxAIOHandler::poll (this=0x7f0fe65fbb00, m1=0x7f0fe65fbba8, m2=0x7f0fe65fbbb0, request=0x7f0fe65fbbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x0000563c5a38d559 in os_aio_linux_handler (global_segment=3, m1=0x7f0fe65fbba8, m2=0x7f0fe65fbbb0, request=0x7f0fe65fbbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x0000563c5a3922c0 in os_aio_handler (segment=3, m1=0x7f0fe65fbba8, m2=0x7f0fe65fbbb0, request=0x7f0fe65fbbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x0000563c5a6484f9 in fil_aio_wait (segment=3) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x0000563c5a4b9e42 in io_handler_thread (arg=0x563c5b6f3998 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7f0fd27fc700 (LWP 24827)): #0 0x00007f100e68d965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a39b377 in os_event::wait (this=0x563c5ddf7610) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x0000563c5a39ae6b in os_event::wait_low (this=0x563c5ddf7610, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x0000563c5a39b16e in os_event_wait_low (event=0x563c5ddf7610, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x0000563c5a5b8e86 in buf_dump_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/buf/buf0dump.cc:833 #5 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7f0fdb7fe700 (LWP 24817)): #0 0x00007f100e68dd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a39ad00 in os_event::timed_wait (this=0x563c5e032800, abstime=0x7f0fdb7fdd50) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x0000563c5a39afa9 in os_event::wait_time_low (this=0x563c5e032800, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x0000563c5a39b149 in os_event_wait_time_low (event=0x563c5e032800, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x0000563c5a35d527 in lock_wait_timeout_thread () at /home/stepan/mariadb/10.4/github/storage/innobase/lock/lock0wait.cc:522 #5 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7f0fe75fe700 (LWP 24810)): #0 0x00007f100e25a644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x0000563c5a38cdad in LinuxAIOHandler::collect (this=0x7f0fe75fdb00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x0000563c5a38d3f6 in LinuxAIOHandler::poll (this=0x7f0fe75fdb00, m1=0x7f0fe75fdba8, m2=0x7f0fe75fdbb0, request=0x7f0fe75fdbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x0000563c5a38d559 in os_aio_linux_handler (global_segment=1, m1=0x7f0fe75fdba8, m2=0x7f0fe75fdbb0, request=0x7f0fe75fdbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x0000563c5a3922c0 in os_aio_handler (segment=1, m1=0x7f0fe75fdba8, m2=0x7f0fe75fdbb0, request=0x7f0fe75fdbe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x0000563c5a6484f9 in fil_aio_wait (segment=1) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x0000563c5a4b9e42 in io_handler_thread (arg=0x563c5b6f3988 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7f0fd8ff9700 (LWP 24824)): #0 0x00007f100e68d965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a39b377 in os_event::wait (this=0x563c5ddf7490) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x0000563c5a39ae6b in os_event::wait_low (this=0x563c5ddf7490, reset_sig_count=740) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x0000563c5a39b16e in os_event_wait_low (event=0x563c5ddf7490, reset_sig_count=0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x0000563c5a4b3328 in srv_resume_thread (slot=0x563c5b4aff10 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:909 #5 0x0000563c5a4b75e9 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7f0fe55fa700 (LWP 24814)): #0 0x00007f100e25a644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x0000563c5a38cdad in LinuxAIOHandler::collect (this=0x7f0fe55f9b00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x0000563c5a38d3f6 in LinuxAIOHandler::poll (this=0x7f0fe55f9b00, m1=0x7f0fe55f9ba8, m2=0x7f0fe55f9bb0, request=0x7f0fe55f9be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x0000563c5a38d559 in os_aio_linux_handler (global_segment=5, m1=0x7f0fe55f9ba8, m2=0x7f0fe55f9bb0, request=0x7f0fe55f9be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x0000563c5a3922c0 in os_aio_handler (segment=5, m1=0x7f0fe55f9ba8, m2=0x7f0fe55f9bb0, request=0x7f0fe55f9be0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x0000563c5a6484f9 in fil_aio_wait (segment=5) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x0000563c5a4b9e42 in io_handler_thread (arg=0x563c5b6f39a8 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7f0fd97fa700 (LWP 24823)): #0 0x00007f100e68d965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a39b377 in os_event::wait (this=0x563c5ddf7310) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:158 #2 0x0000563c5a39ae6b in os_event::wait_low (this=0x563c5ddf7310, reset_sig_count=289) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:325 #3 0x0000563c5a39b16e in os_event_wait_low (event=0x563c5ddf7310, reset_sig_count=289) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:502 #4 0x0000563c5a4b3328 in srv_resume_thread (slot=0x563c5b4afc10 , sig_count=289, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:909 #5 0x0000563c5a4b7aa0 in srv_purge_coordinator_suspend (slot=0x563c5b4afc10 , rseg_history_len=3) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2657 #6 0x0000563c5a4b7dd1 in srv_purge_coordinator_thread (arg=0x0) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0srv.cc:2738 #7 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7f0fe7dff700 (LWP 24809)): #0 0x00007f100e25a644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x0000563c5a38cdad in LinuxAIOHandler::collect (this=0x7f0fe7dfeb00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x0000563c5a38d3f6 in LinuxAIOHandler::poll (this=0x7f0fe7dfeb00, m1=0x7f0fe7dfeba8, m2=0x7f0fe7dfebb0, request=0x7f0fe7dfebe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x0000563c5a38d559 in os_aio_linux_handler (global_segment=0, m1=0x7f0fe7dfeba8, m2=0x7f0fe7dfebb0, request=0x7f0fe7dfebe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x0000563c5a3922c0 in os_aio_handler (segment=0, m1=0x7f0fe7dfeba8, m2=0x7f0fe7dfebb0, request=0x7f0fe7dfebe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x0000563c5a6484f9 in fil_aio_wait (segment=0) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x0000563c5a4b9e42 in io_handler_thread (arg=0x563c5b6f3980 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7f0fe5dfb700 (LWP 24813)): #0 0x00007f100e25a644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x0000563c5a38cdad in LinuxAIOHandler::collect (this=0x7f0fe5dfab00) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1809 #2 0x0000563c5a38d3f6 in LinuxAIOHandler::poll (this=0x7f0fe5dfab00, m1=0x7f0fe5dfaba8, m2=0x7f0fe5dfabb0, request=0x7f0fe5dfabe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:1968 #3 0x0000563c5a38d559 in os_aio_linux_handler (global_segment=4, m1=0x7f0fe5dfaba8, m2=0x7f0fe5dfabb0, request=0x7f0fe5dfabe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:2022 #4 0x0000563c5a3922c0 in os_aio_handler (segment=4, m1=0x7f0fe5dfaba8, m2=0x7f0fe5dfabb0, request=0x7f0fe5dfabe0) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0file.cc:5561 #5 0x0000563c5a6484f9 in fil_aio_wait (segment=4) at /home/stepan/mariadb/10.4/github/storage/innobase/fil/fil0fil.cc:4357 #6 0x0000563c5a4b9e42 in io_handler_thread (arg=0x563c5b6f39a0 ) at /home/stepan/mariadb/10.4/github/storage/innobase/srv/srv0start.cc:324 #7 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7f0fd9ffb700 (LWP 24821)): #0 0x00007f100e68dd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a39ad00 in os_event::timed_wait (this=0x563c5df93a30, abstime=0x7f0fd9ffab70) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:275 #2 0x0000563c5a39afa9 in os_event::wait_time_low (this=0x563c5df93a30, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:385 #3 0x0000563c5a39b149 in os_event_wait_time_low (event=0x563c5df93a30, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/github/storage/innobase/os/os0event.cc:485 #4 0x0000563c5a523563 in ib_wqueue_timedwait (wq=0x563c5df8cef0, wait_in_usecs=5000000) at /home/stepan/mariadb/10.4/github/storage/innobase/ut/ut0wqueue.cc:163 #5 0x0000563c5a69623d in fts_optimize_thread (arg=0x563c5df8cef0) at /home/stepan/mariadb/10.4/github/storage/innobase/fts/fts0opt.cc:2865 #6 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7f0ffd4d6700 (LWP 24808)): #0 0x00007f100e68dd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a8e5a6b in safe_cond_timedwait (cond=0x563c5bf045e0 , mp=0x563c5bf04520 , abstime=0x7f0ffd4d5cb0, file=0x563c5ad4f880 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:546 #2 0x0000563c5a73d109 in inline_mysql_cond_timedwait (that=0x563c5bf045e0 , mutex=0x563c5bf04520 , abstime=0x7f0ffd4d5cb0, src_file=0x563c5ad4f8c8 "/home/stepan/mariadb/10.4/github/storage/maria/ma_servicethread.c", src_line=116) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1204 #3 0x0000563c5a73d64d in my_service_thread_sleep (control=0x563c5b4b6780 , sleep_time=30000000000) at /home/stepan/mariadb/10.4/github/storage/maria/ma_servicethread.c:115 #4 0x0000563c5a73150a in ma_checkpoint_background (arg=0x1e) at /home/stepan/mariadb/10.4/github/storage/maria/ma_checkpoint.c:707 #5 0x0000563c5a86e4a5 in pfs_spawn_thread (arg=0x563c5ddaf1f0) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #6 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7f1007122700 (LWP 24802)): #0 0x00007f100e68dd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563c5a8e5a6b in safe_cond_timedwait (cond=0x563c5bf16ce0 , mp=0x563c5bf16c20 , abstime=0x7f1007121d70, file=0x563c5ad98450 "/home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/github/mysys/thr_mutex.c:546 #2 0x0000563c5a8e6aae in inline_mysql_cond_timedwait (that=0x563c5bf16ce0 , mutex=0x563c5bf16c20 , abstime=0x7f1007121d70, src_file=0x563c5ad98498 "/home/stepan/mariadb/10.4/github/mysys/thr_timer.c", src_line=292) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_thread.h:1204 #3 0x0000563c5a8e7671 in timer_handler (arg=0x0) at /home/stepan/mariadb/10.4/github/mysys/thr_timer.c:292 #4 0x0000563c5a86e4a5 in pfs_spawn_thread (arg=0x563c5dc83270) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #5 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7f1005770700 (LWP 24803)): #0 0x00007f100e68d965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f10065e8dd7 in gu::Lock::wait (cond=..., this=0x7f100576fbf0) at galerautils/src/gu_lock.hpp:45 #2 0x00007f10065e8e69 in galera::ServiceThd::thd_func (arg=0x563c5dcb7768) at galera/src/galera_service_thd.cpp:30 #3 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7f0fe7f69700 (LWP 25720)): #0 0x00007f100e68e9d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x0000563c5a8e00f6 in my_write_core (sig=6) at /home/stepan/mariadb/10.4/github/mysys/stacktrace.c:481 #2 0x0000563c5a04c964 in handle_fatal_signal (sig=6) at /home/stepan/mariadb/10.4/github/sql/signal_handler.cc:343 #3 #4 0x00007f100c97f207 in raise () from /lib64/libc.so.6 #5 0x00007f100c9808f8 in abort () from /lib64/libc.so.6 #6 0x00007f100c978026 in __assert_fail_base () from /lib64/libc.so.6 #7 0x00007f100c9780d2 in __assert_fail () from /lib64/libc.so.6 #8 0x0000563c5a94e638 in inline_mysql_socket_recv (src_file=0x563c5aedb680 "/home/stepan/mariadb/10.4/github/vio/viosocket.c", src_line=190, mysql_socket=..., buf=0x7f0f8c008330, n=4, flags=64) at /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_socket.h:779 #9 0x0000563c5a94ed2e in vio_read (vio=0x563c5e1426e0, buf=0x7f0f8c008330 "\001", size=4) at /home/stepan/mariadb/10.4/github/vio/viosocket.c:189 #10 0x0000563c5a1cd1e3 in my_real_read (net=0x7f0f8c000df8, complen=0x7f0fe7f68810, header=1 '\001') at /home/stepan/mariadb/10.4/github/sql/net_serv.cc:962 #11 0x0000563c5a1cdae1 in my_net_read_packet_reallen (net=0x7f0f8c000df8, read_from_server=1 '\001', reallen=0x7f0fe7f68878) at /home/stepan/mariadb/10.4/github/sql/net_serv.cc:1243 #12 0x0000563c5a1cda94 in my_net_read_packet (net=0x7f0f8c000df8, read_from_server=1 '\001') at /home/stepan/mariadb/10.4/github/sql/net_serv.cc:1227 #13 0x0000563c59ce49de in do_command (thd=0x7f0f8c000b00) at /home/stepan/mariadb/10.4/github/sql/sql_parse.cc:1232 #14 0x0000563c59e6ed51 in do_handle_one_connection (connect=0x563c5e1cb1a0) at /home/stepan/mariadb/10.4/github/sql/sql_connect.cc:1412 #15 0x0000563c59e6ea80 in handle_one_connection (arg=0x563c5e1cb1a0) at /home/stepan/mariadb/10.4/github/sql/sql_connect.cc:1316 #16 0x0000563c5a86e4a5 in pfs_spawn_thread (arg=0x563c5e18be70) at /home/stepan/mariadb/10.4/github/storage/perfschema/pfs.cc:1862 #17 0x00007f100e689dd5 in start_thread () from /lib64/libpthread.so.0 #18 0x00007f100ca46ead in clone () from /lib64/libc.so.6 Compressed file /home/stepan/mariadb/10.4/github/mysql-test/var/2/log/galera.galera_pc_ignore_sb-innodb/mysqld.1/data/core.24801 - saving '/home/stepan/mariadb/10.4/github/mysql-test/var/2/log/galera.galera_pc_ignore_sb-innodb/' to '/home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_pc_ignore_sb-innodb/' 191029 13:44:54 +10.105 galera.MDEV-15443 'innodb' w1 [ pass ] 26733 ***Warnings generated in error logs during shutdown after running tests: galera.galera_many_indexes galera.galera_nopk_large_varchar galera.galera_kill_smallchanges galera.galera_lock_table galera.galera_mdev_10812 galera.galera_nopk_bit galera.galera_mdl_race galera.galera_last_committed_id galera.galera_pc_ignore_sb galera.galera_nopk_blob galera.galera_parallel_apply_lock_table galera.galera_parallel_simple galera.galera_nopk_unicode galera.galera_multi_database galera.galera_myisam_transactions galera.galera_myisam_autocommit galera.galera_kill_ddl mysqld: /home/stepan/mariadb/10.4/github/include/mysql/psi/mysql_socket.h:779: inline_mysql_socket_recv: Assertion `mysql_socket.fd != -1' failed. Attempting backtrace. You can use the following information to find out 191029 13:45:15 +20.741 galera.MW-328B 'innodb' w4 [ pass ] 453547 191029 13:45:18 +2.412 galera.galera_sp_insert_parallel 'innodb' w3 [ fail ] Found warnings/errors in server log file! Test ended at 2019-10-29 13:45:18 line 2019-10-29 13:36:07 0 [Warning] WSREP: Failed to report last committed 62630564-fa3f-11e9-9f10-9f9de3a421d7:361, -110 (Connection timed out) ^ Found warnings in /home/stepan/mariadb/10.4/github/mysql-test/var/3/log/mysqld.1.err ok - saving '/home/stepan/mariadb/10.4/github/mysql-test/var/3/log/galera.galera_sp_insert_parallel-innodb/' to '/home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_sp_insert_parallel-innodb/' 191029 13:45:22 +4.585 galera.MDEV-18832 'innodb' w2 [ pass ] 15097 191029 13:45:37 +15.242 galera.galera_sql_log_bin_zero 'innodb' w3 [ pass ] 5883 191029 13:45:40 +2.505 galera.galera_status_cluster 'innodb' w3 [ pass ] 2132 191029 13:45:48 +8.360 galera.galera_status_local_index 'innodb' w3 [ pass ] 8059 191029 13:45:51 +2.307 galera.galera_status_local_state 'innodb' w3 [ pass ] 2041 191029 13:46:03 +11.991 galera.MW-284 'innodb' w2 [ pass ] 14160 191029 13:46:21 +18.455 galera.galera_suspend_slave 'innodb' w3 [ pass ] 29942 191029 13:46:39 +17.832 galera.galera_sync_wait_show 'innodb' w3 [ pass ] 17373 191029 13:46:45 +5.646 galera.MW-336 'innodb' w2 [ pass ] 14305 191029 13:47:04 +19.504 galera.galera_toi_alter_auto_increment 'innodb' w3 [ pass ] 23825 191029 13:47:14 +9.558 galera.galera#414 'innodb' w2 [ pass ] 12823 191029 13:47:18 +4.515 galera.galera_toi_ddl_locking 'innodb' w3 [ pass ] 13285 191029 13:47:29 +11.045 galera.galera_toi_ddl_nonconflicting 'innodb' w3 [ pass ] 10507 191029 13:47:41 +12.020 galera.galera_toi_ddl_sequential 'innodb' w3 [ pass ] 11564 191029 13:47:53 +11.893 galera.MW-328C 'innodb' w4 [ pass ] 155691 191029 13:48:00 +7.408 galera.galera_as_master 'innodb' w2 [ pass ] 21254 191029 13:48:32 +31.246 galera.galera_as_master_large 'innodb' w2 [ pass ] 10902 191029 13:48:57 +25.517 galera.galera_as_slave 'innodb' w2 [ pass ] 8123 191029 13:49:24 +26.325 galera.galera_as_slave_autoinc 'innodb' w2 [ pass ] 8447 191029 13:49:50 +26.196 galera.galera_as_slave_gtid 'innodb' w2 [ pass ] 7590 191029 13:49:55 +5.401 galera.galera_bf_lock_wait 'innodb' w4 [ pass ] 114615 191029 13:50:18 +22.581 galera.galera_as_slave_gtid_replicate_do_db 'innodb' w2 [ pass ] 11735 191029 13:50:25 +7.156 galera.MDEV-6860 'innodb' w1 [ pass ] 305303 191029 13:51:02 +37.157 galera.galera_as_slave_nonprim 'innodb' w2 [ pass ] 22983 191029 13:51:20 +18.267 galera.galera_gcache_recover 'innodb' w1 [ pass ] 35725 191029 13:51:22 +1.966 galera.galera_fulltext 'innodb' w4 [ pass ] 85582 191029 13:51:31 +8.593 galera.galera_many_columns 'innodb' w4 [ pass ] 7873 191029 13:51:57 +26.184 galera.galera_gcs_fragment 'innodb' w1 [ pass ] 14890 191029 13:52:24 +27.437 galera.galera_autoinc_sst_mariabackup 'innodb' w2 [ pass ] 48731 191029 13:52:40 +15.031 galera.galera_gcs_max_packet_size 'innodb' w1 [ pass ] 19457 191029 13:53:04 +24.073 galera.galera_toi_drop_database 'innodb' w3 [ pass ] 321338 191029 13:53:13 +9.785 galera.galera_toi_ftwrl 'innodb' w3 [ pass ] 9328 191029 13:53:23 +9.212 galera.galera_toi_lock_exclusive 'innodb' w3 [ pass ] 8756 191029 13:53:30 +6.972 galera.galera_toi_lock_shared 'innodb' w3 [ pass ] 6432 191029 13:53:36 +6.099 galera.galera_gtid_slave_sst_rsync 'innodb' w1 [ pass ] 32701 191029 13:54:35 +59.701 galera.galera_toi_truncate 'innodb' w3 [ pass ] 64599 191029 13:54:40 +4.706 galera.galera_transaction_read_only 'innodb' w3 [ pass ] 4408 191029 13:55:05 +24.807 galera.galera_ist_mariabackup_innodb_flush_logs 'debug,innodb' w1 [ pass ] 59813 191029 13:55:05 +0.042 galera.galera_gcache_recover_full_gcache 'innodb' w2 [ fail ] Test ended at 2019-10-29 13:55:05 CURRENT_TEST: galera.galera_gcache_recover_full_gcache mysqltest: In included file "./include/assert_grep.inc": included from /home/stepan/mariadb/10.4/github/mysql-test/suite/galera/t/galera_gcache_recover_full_gcache.test at line 65: At line 152: assert_grep.inc failed. The result from queries just before the failure was: < snip > connection node_1; Performing --wsrep-recover ... Using --wsrep-start-position when starting mysqld ... connection node_2; Performing --wsrep-recover ... Using --wsrep-start-position when starting mysqld ... connection node_1; include/diff_servers.inc [servers=1 2] connection node_1; DROP TABLE t1; CALL mtr.add_suppression("Skipped GCache ring buffer recovery"); include/assert_grep.inc [IST first seqno [24] not found from cache, falling back to SST] include/assert_grep.inc failed! assert_text: 'IST first seqno [24] not found from cache, falling back to SST' assert_file: '/home/stepan/mariadb/10.4/github/mysql-test/var/2/log/mysqld.1.err' assert_select: 'IST first seqno [24] not found from cache, falling back to SST' assert_match: '' assert_count: '1' assert_only_after: 'starting as process' number of matching lines: 0 More results from queries before failure can be found in /home/stepan/mariadb/10.4/github/mysql-test/var/2/log/galera_gcache_recover_full_gcache.log - saving '/home/stepan/mariadb/10.4/github/mysql-test/var/2/log/galera.galera_gcache_recover_full_gcache-innodb/' to '/home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_gcache_recover_full_gcache-innodb/' 191029 13:55:32 +26.873 galera.galera_gtid_slave 'innodb' w2 [ pass ] 9785 191029 13:55:47 +15.232 galera.galera_ist_recv_bind 'innodb' w1 [ pass ] 17431 191029 13:56:08 +21.291 galera.galera_many_tables_pk 'innodb' w4 [ pass ] 276712 191029 13:56:16 +7.391 galera.galera_ist_restart_joiner 'innodb' w2 [ pass ] 29555 191029 13:56:34 +18.473 galera.galera_load_data 'innodb' w1 [ pass ] 26910 191029 13:56:47 +12.445 galera.galera_parallel_autoinc_largetrx 'innodb' w4 [ pass ] 27657 191029 13:57:33 +46.179 galera.galera_ist_mysqldump 'debug,innodb' w3 [ pass ] 140599 191029 13:57:55 +22.011 galera.galera_ist_rsync 'debug,innodb' w2 [ pass ] 78375 191029 13:58:00 +5.489 galera.galera_mdev_15611 'innodb' w1 [ pass ] 63358 191029 13:58:01 +0.241 galera.galera_ssl 'innodb' w3 [ pass ] 4332 191029 14:00:23 +142.105 galera.galera_sst_mariabackup_data_dir 'debug,innodb' w3 [ pass ] 106385 191029 14:00:23 +0.452 galera.galera_sst_mariabackup 'debug,innodb' w1 [ pass ] 107325 191029 14:00:57 +33.758 galera.galera_sst_mariabackup_encrypt_with_key 'innodb' w3 [ pass ] 2046 191029 14:03:00 +122.959 galera.galera_sst_mariabackup_table_options '16k,clear,innodb' w1 [ pass ] 55513 191029 14:03:35 +35.145 galera.galera_sst_mariabackup_table_options '16k,crypt,innodb' w3 [ pass ] 54161 191029 14:04:01 +26.429 galera.galera_parallel_autoinc_manytrx 'innodb' w4 [ pass ] 410004 191029 14:04:33 +32.087 galera.galera_pc_recovery 'innodb' w4 [ pass ] 17478 191029 14:05:31 +57.210 galera.galera_sst_mariabackup_table_options '4k,clear,innodb' w1 [ pass ] 49617 191029 14:05:59 +28.627 galera.galera_sst_mariabackup_table_options '4k,crypt,innodb' w3 [ pass ] 54211 191029 14:08:01 +121.951 galera.galera_sst_mariabackup_table_options '8k,clear,innodb' w1 [ pass ] 47510 191029 14:08:32 +30.843 galera.galera_sst_mariabackup_table_options '8k,crypt,innodb' w3 [ pass ] 52902 191029 14:08:43 +10.418 galera.galera_many_rows 'innodb' w2 [ pass ] 623283 191029 14:09:14 +31.737 galera.galera_ssl_compression 'innodb' w2 [ pass ] 8800 191029 14:09:18 +3.374 galera.galera_sst_mysqldump_with_key 'debug,innodb' w3 [ fail ] Test ended at 2019-10-29 14:09:18 CURRENT_TEST: galera.galera_sst_mysqldump_with_key mysqltest: In included file "./suite/galera/include/galera_st_kill_slave.inc": included from /home/stepan/mariadb/10.4/github/mysql-test/suite/galera/t/galera_sst_mysqldump_with_key.test at line 27: At line 22: query 'COMMIT' failed: 1213: Deadlock found when trying to get lock; try restarting transaction The result from queries just before the failure was: < snip > Performing State Transfer on a server that has been killed and restarted connection node_1; CREATE TABLE t1 (f1 CHAR(255)) ENGINE=InnoDB; SET AUTOCOMMIT=OFF; START TRANSACTION; INSERT INTO t1 VALUES ('node1_committed_before'); INSERT INTO t1 VALUES ('node1_committed_before'); INSERT INTO t1 VALUES ('node1_committed_before'); INSERT INTO t1 VALUES ('node1_committed_before'); INSERT INTO t1 VALUES ('node1_committed_before'); COMMIT; connection node_2; SET AUTOCOMMIT=OFF; START TRANSACTION; INSERT INTO t1 VALUES ('node2_committed_before'); INSERT INTO t1 VALUES ('node2_committed_before'); INSERT INTO t1 VALUES ('node2_committed_before'); INSERT INTO t1 VALUES ('node2_committed_before'); INSERT INTO t1 VALUES ('node2_committed_before'); COMMIT; More results from queries before failure can be found in /home/stepan/mariadb/10.4/github/mysql-test/var/3/log/galera_sst_mysqldump_with_key,debug.log - saving '/home/stepan/mariadb/10.4/github/mysql-test/var/3/log/galera.galera_sst_mysqldump_with_key-debug,innodb/' to '/home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_sst_mysqldump_with_key-debug,innodb/' 191029 14:09:46 +28.360 galera.galera_rsu_add_pk 'innodb' w4 [ pass ] 288845 191029 14:10:54 +68.206 galera.galera_sst_rsync_data_dir 'debug,innodb' w3 [ pass ] 84214 191029 14:10:59 +4.417 galera.galera_sst_rsync 'debug,innodb' w2 [ pass ] 83512 191029 14:11:21 +22.293 galera.galera_var_gtid_domain_id 'innodb' w3 [ pass ] 7139 191029 14:11:54 +33.302 galera.galera_sst_mysqldump 'debug,innodb' w1 [ pass ] 211449 191029 14:12:33 +38.755 galera.galera_var_slave_threads 'innodb' w3 [ pass ] 37952 191029 14:12:57 +24.303 galera.galera_sst_rsync2 'debug,innodb' w2 [ pass ] 96527 191029 14:13:22 +24.829 galera.galera_var_log_bin 'innodb' w2 [ pass ] 4598 191029 14:13:38 +16.245 galera.galera_wan_restart_ist 'innodb' w1 [ pass ] 73754 191029 14:13:55 +16.745 galera.mdev_10518 'innodb' w2 [ pass ] 7790 191029 14:14:00 +5.207 galera.rpl_row_annotate 'innodb' w1 [ pass ] 6600 191029 14:14:09 +8.851 galera.galera_wan_restart_sst 'innodb' w3 [ pass ] 73900 191029 14:15:22 +72.514 galera.mysql-wsrep#33 'innodb' w2 [ pass ] 59794 191029 14:15:22 +0.308 galera.galera_toi_ddl_fk_insert 'innodb' w3 [ pass ] 52723 191029 14:15:40 +17.638 galera.galera_toi_ddl_error 'innodb' w1 [ pass ] 70945 191029 14:16:06 +26.751 galera.versioning_trx_id 'innodb' w2 [ pass ] 8286 191029 14:16:10 +3.300 galera.galera_rsu_drop_pk 'innodb' w4 [ fail ] Test ended at 2019-10-29 14:16:10 CURRENT_TEST: galera.galera_rsu_drop_pk mysqltest: At line 34: query 'SELECT COUNT(*) = 300000 FROM t1' failed: 1205: Lock wait timeout exceeded; try restarting transaction The result from queries just before the failure was: < snip > connection node_1; connection node_1; CREATE TABLE ten (f1 INTEGER); INSERT INTO ten VALUES (0),(1),(2),(3),(4),(5),(6),(7),(8),(9); CREATE TABLE t1 (f1 INTEGER PRIMARY KEY) Engine=InnoDB; INSERT INTO t1 (f1) SELECT 000000 + (10000 * a1.f1) + (1000 * a2.f1) + (100 * a3.f1) + (10 * a4.f1) + a5.f1 FROM ten AS a1, ten AS a2, ten AS a3, ten AS a4, ten AS a5; INSERT INTO t1 (f1) SELECT 100000 + (10000 * a1.f1) + (1000 * a2.f1) + (100 * a3.f1) + (10 * a4.f1) + a5.f1 FROM ten AS a1, ten AS a2, ten AS a3, ten AS a4, ten AS a5;; connection node_2; SET SESSION wsrep_OSU_method = "RSU"; ALTER TABLE t1 DROP PRIMARY KEY; SET SESSION wsrep_OSU_method = "TOI"; INSERT INTO t1 (f1) SELECT 200000 + (10000 * a1.f1) + (1000 * a2.f1) + (100 * a3.f1) + (10 * a4.f1) + a5.f1 FROM ten AS a1, ten AS a2, ten AS a3, ten AS a4, ten AS a5; SELECT COUNT(*) = 300000 FROM t1; COUNT(*) = 300000 1 SELECT MAX(f1) = 299999 FROM t1; MAX(f1) = 299999 1 connection node_1; SELECT COUNT(*) = 300000 FROM t1; More results from queries before failure can be found in /home/stepan/mariadb/10.4/github/mysql-test/var/4/log/galera_rsu_drop_pk.log - saving '/home/stepan/mariadb/10.4/github/mysql-test/var/4/log/galera.galera_rsu_drop_pk-innodb/' to '/home/stepan/mariadb/10.4/github/mysql-test/var/log/galera.galera_rsu_drop_pk-innodb/' 191029 14:16:42 +32.725 galera.galera_var_load_data_splitting 'innodb' w3 [ pass ] 77505 191029 14:16:54 +11.259 galera.GAL-401 'innodb' w4 [ pass ] 26216 191029 14:17:02 +8.150 galera.GCF-939 'innodb' w4 [ pass ] 7804 191029 14:17:09 +7.650 galera.MDEV-16509 'innodb' w4 [ pass ] 7266 191029 14:17:22 +12.666 galera.MDEV-20225 'innodb' w4 [ pass ] 12333 191029 14:17:24 +2.245 galera.GAL-480 'innodb' w3 [ pass ] 41477 191029 14:17:32 +7.553 galera.galera_toi_ddl_fk_update 'innodb' w2 [ pass ] 64144 191029 14:17:39 +7.157 galera.MW-258 'innodb' w3 [ pass ] 14312 191029 14:17:42 +2.985 galera.GAL-382 'innodb' w2 [ pass ] 9423 191029 14:17:50 +8.422 galera.MW-259 'innodb' w2 [ pass ] 7899 191029 14:17:56 +5.342 galera.MW-285 'innodb' w3 [ pass ] 15008 191029 14:17:59 +3.238 galera.MW-286 'innodb' w2 [ pass ] 6845 191029 14:18:05 +6.083 galera.MW-309 'innodb' w3 [ pass ] 7589 191029 14:18:15 +10.146 galera.MW-292 'innodb' w2 [ pass ] 15753 191029 14:18:16 +0.772 galera.MW-328E 'innodb' w3 [ pass ] 10136 191029 14:18:27 +11.178 galera.MW-328D 'innodb' w2 [ pass ] 11333 191029 14:18:30 +2.305 galera.MW-252 'innodb' w4 [ pass ] 66774 191029 14:18:33 +3.869 galera.MW-357 'innodb' w2 [ pass ] 5636 191029 14:18:35 +1.225 galera.MW-416 'innodb' w4 [ pass ] 4382 191029 14:18:42 +6.932 galera.binlog_checksum 'innodb' w4 [ pass ] 6084 191029 14:19:22 +40.785 galera.create 'innodb' w4 [ pass ] 40141 191029 14:19:29 +6.890 galera.enforce_storage_engine 'innodb' w4 [ pass ] 6219 191029 14:19:38 +9.257 galera.MW-369 'innodb' w3 [ pass ] 81216 191029 14:19:46 +7.829 galera.MW-402 'innodb' w2 [ pass ] 72380 191029 14:19:53 +6.568 galera.basic 'innodb' w2 [ pass ] 6175 191029 14:20:04 +11.516 galera.fk 'innodb' w3 [ pass ] 23241 191029 14:20:16 +11.807 galera.galera#500 'innodb' w2 [ pass ] 22846 191029 14:20:19 +2.329 galera.galera#505 'innodb' w2 [ pass ] 2036 191029 14:20:22 +2.980 galera.ev51914 'innodb' w4 [ pass ] 51719 191029 14:20:29 +7.787 galera.galera_alter_engine_myisam 'innodb' w4 [ pass ] 7398 191029 14:20:39 +10.060 galera.galera_alter_table_force 'innodb' w4 [ pass ] 9245 191029 14:20:47 +7.269 galera.galera_applier_ftwrl_table 'innodb' w4 [ pass ] 6955 191029 14:20:53 +6.498 galera.galera_bf_abort 'innodb' w4 [ pass ] 5545 191029 14:20:57 +4.266 galera.galera_admin 'innodb' w2 [ pass ] 38344 191029 14:21:00 +2.243 galera.galera_bf_abort_at_after_statement 'innodb' w4 [ pass ] 5688 191029 14:21:07 +7.603 galera.galera_bf_abort_for_update 'innodb' w4 [ pass ] 7125 191029 14:21:09 +1.543 galera.galera_wsrep_desync_wsrep_on 'innodb' w1 [ pass ] 328266 191029 14:21:09 +0.539 galera.galera_alter_engine_innodb 'innodb' w2 [ pass ] 11051 191029 14:21:13 +3.744 galera.galera_bf_abort_ftwrl 'innodb' w4 [ pass ] 5441 191029 14:21:16 +2.521 galera.galera_bf_abort_get_lock 'innodb' w1 [ pass ] 5992 191029 14:21:16 +0.885 galera.galera_bf_abort_flush_for_export 'innodb' w2 [ pass ] 6118 191029 14:21:23 +6.238 galera.galera_bf_abort_lock_table 'innodb' w2 [ pass ] 5909 191029 14:21:23 +0.056 galera.galera_bf_abort_sleep 'innodb' w1 [ pass ] 6591 191029 14:21:30 +6.816 galera.galera_change_user 'innodb' w1 [ pass ] 5689 191029 14:21:31 +1.288 galera.galera_bf_abort_shutdown 'innodb' w4 [ pass ] 17422 191029 14:21:35 +3.882 galera.galera_binlog_cache_size 'innodb' w2 [ pass ] 11274 191029 14:21:55 +19.989 galera.galera_FK_duplicate_client_insert 'innodb' w3 [ pass ] 109489 191029 14:21:56 +0.917 galera.galera_binlog_row_image 'innodb' w2 [ pass ] 20315 -------------------------------------------------------------------------- The servers were restarted 89 times Spent 9734.457 of 3492 seconds executing testcases Completed: Failed 5/275 tests, 98.18% were successful. Failing test(s): galera.galera_pc_ignore_sb galera.galera_sp_insert_parallel galera.galera_gcache_recover_full_gcache galera.galera_sst_mysqldump_with_key galera.galera_rsu_drop_pk The log files in var/log may give you some hint of what went wrong. If you want to report this error, please read first the documentation at http://dev.mysql.com/doc/mysql/en/mysql-test-suite.html Errors/warnings were found in logfiles during server shutdown after running the following sequence(s) of tests: galera.galera_many_indexes galera.galera_nopk_large_varchar galera.galera_kill_smallchanges galera.galera_lock_table galera.galera_mdev_10812 galera.galera_nopk_bit galera.galera_mdl_race galera.galera_last_committed_id galera.galera_pc_ignore_sb galera.galera_nopk_blob galera.galera_parallel_apply_lock_table galera.galera_parallel_simple galera.galera_nopk_unicode galera.galera_multi_database galera.galera_myisam_transactions galera.galera_myisam_autocommit galera.galera_kill_ddl 191029 14:22:06 +10.107 mysql-test-run: *** ERROR: there were failing test cases