Checking supported features... MariaDB Version 10.4.4-MariaDB-debug - SSL connections supported - binaries are debug compiled Using suites: galera Collecting tests... Installing system database... Using parallel: 4 worker[2] Using MTR_BUILD_THREAD 300, with reserved ports 16000..16019 worker[1] Using MTR_BUILD_THREAD 301, with reserved ports 16020..16039 worker[3] Using MTR_BUILD_THREAD 302, with reserved ports 16040..16059 worker[4] Using MTR_BUILD_THREAD 303, with reserved ports 16060..16079 ============================================================================== TEST WORKER RESULT TIME (ms) or COMMENT -------------------------------------------------------------------------- galera.GAL-419 [ disabled ] MDEV-13549 Galera test failures galera.GCF-1081 [ disabled ] MDEV-18283 Galera test failure on galera.GCF-1081 galera.MW-328A [ disabled ] MDEV-17847 Galera test failure on MW-328[A|B|C] galera.MW-328B [ disabled ] MDEV-17847 Galera test failure on MW-328[A|B|C] galera.MW-328C [ disabled ] MDEV-17847 Galera test failure on MW-328[A|B|C] galera.MW-329 [ disabled ] wsrep_local_replays not stable galera.MW-336 [ disabled ] nondeterministic wsrep_thread_count galera.MW-360 [ disabled ] needs rewrite to be MariaDB gtid compatible galera.MW-388 [ disabled ] MDEV-13549 Galera test failures galera.MW-416 [ disabled ] MDEV-13549 Galera test failures galera.MW-44 [ disabled ] MDEV-15809 Test failure on galera.MW-44 galera.galera_account_management [ disabled ] MariaDB 10.0 does not support ALTER USER galera.galera_as_master_gtid [ disabled ] Requires MySQL GTID galera.galera_as_master_gtid_change_master [ disabled ] Requires MySQL GTID galera.galera_as_slave_gtid_replicate_do_db_cc [ disabled ] Requires MySQL GTID galera.galera_as_slave_preordered [ disabled ] wsrep-preordered feature not merged to MariaDB galera.galera_as_slave_replication_bundle [ disabled ] MDEV-13549 Galera test failures galera.galera_autoinc_sst_mariabackup [ disabled ] MDEV-18177 Galera test failure on galera_autoinc_sst_mariabackup galera.galera_bf_abort_group_commit [ disabled ] MDEV-18282 Galera test failure on galera.galera_bf_abort_group_commit galera.galera_binlog_rows_query_log_events [ disabled ] MariaDB does not support binlog_rows_query_log_events galera.galera_binlog_stmt_autoinc [ disabled ] MDEV-17106 Test failure on galera.galera_binlog_stmt_autoinc galera.galera_concurrent_ctas [ disabled ] MDEV-18180 Galera test failure on galera.galera_concurrent_ctas galera.galera_encrypt_tmp_files [ disabled ] Get error failed to enable encryption of temporary files galera.galera_flush [ disabled ] MariaDB does not have global.thread_statistics galera.galera_gcs_fc_limit [ disabled ] Timeouts galera.galera_ist_mariabackup [ disabled ] Leaves port open galera.galera_ist_progress [ disabled ] MDEV-15236 galera_ist_progress fails when trying to read transfer status galera.galera_kill_applier [ disabled ] race condition at the start of the test galera.galera_kill_ddl [ disabled ] MDEV-17108 Test failure on galera.galera_kill_ddl galera.galera_kill_largechanges [ disabled ] MDEV-18179 Galera test failure on galera.galera_kill_largechanges galera.galera_kill_nochanges [ disabled ] MDEV-18280 Galera test failure on galera_split_brain and galera_kill_nochanges galera.galera_many_tables_nopk [ disabled ] MDEV-18182 Galera test failure on galera.galera_many_tables_nopk galera.galera_migrate [ disabled ] MariaDB does not support START SLAVE USER galera.galera_pc_ignore_sb [ disabled ] MDEV-17357 Test failure on galera.galera_pc_ignore_sb galera.galera_split_brain [ disabled ] MDEV-18280 Galera test failure on galera_split_brain and galera_kill_nochanges galera.galera_ssl_upgrade [ disabled ] MDEV-13549 Galera test failures galera.galera_sst_mysqldump_with_key [ disabled ] MDEV-16890 Galera test failure galera.galera_var_innodb_disallow_writes [ disabled ] Timeout galera.galera_var_node_address [ disabled ] MDEV-17151 Galera test failure on galera.galera_var_node_address galera.galera_var_notify_cmd [ disabled ] MDEV-13549 Galera test failures galera.galera_var_reject_queries [ disabled ] assertion in inline_mysql_socket_send galera.galera_var_retry_autocommit [ disabled ] MDEV-18181 Galera test failure on galera.galera_var_retry_autocommit galera.galera_wan [ disabled ] MDEV-17259: Test failure on galera.galera_wan galera.pxc-421 [ disabled ] Lock timeout exceeded galera.query_cache [ disabled ] MDEV-18137: Galera test failure on query_cache galera.MW-86-wait1 'innodb' w2 [ pass ] 5990 galera.MW-313 'innodb' w3 [ pass ] 7666 galera.galera_binlog_checksum 'innodb' w4 [ pass ] 7623 galera.MW-86-wait8 'innodb' w1 [ pass ] 8558 galera.galera_binlog_event_max_size_min 'innodb' w2 [ pass ] 4399 galera.enforce_storage_engine2 'innodb' w4 [ pass ] 4849 galera.galera_log_output_csv 'innodb' w1 [ pass ] 4125 galera.galera_mdev_13787 'innodb' w2 [ pass ] 6579 galera.galera_applier_ftwrl_table_alter 'innodb' w4 [ pass ] 11623 galera.galera_gtid 'innodb' w2 [ pass ] 5646 galera.galera_bf_background_statistics 'innodb' w1 [ pass ] 33729 galera.galera_binlog_event_max_size_max 'innodb' w3 [ pass ] 70971 galera.galera_forced_binlog_format 'innodb' w4 [ pass ] 9610 galera.galera_sbr_binlog 'innodb' w2 [ pass ] 6682 galera.galera_v1_row_events 'innodb' w3 [ pass ] 6118 galera.galera_log_bin 'innodb' w1 [ pass ] 10849 galera.mysql-wsrep#198 'innodb' w4 [ pass ] 12562 galera.galera_query_cache 'innodb' w1 [ pass ] 10519 galera.galera_query_cache_sync_wait 'innodb' w1 [ pass ] 11660 galera.galera_var_auto_inc_control_on 'innodb' w1 [ pass ] 5736 galera.galera_flush_local 'innodb' w3 [ pass ] 61479 galera.partition 'innodb' w2 [ pass ] 78644 galera.galera_sync_wait_upto 'innodb' w1 [ pass ] 11048 galera.galera_wsrep_new_cluster 'innodb' w3 [ pass ] 4960 galera.galera_wsrep_log_conficts 'innodb' w2 [ pass ] 4949 galera.galera_var_sst_auth 'innodb' w1 [ pass ] 2038 galera.galera_create_table_like 'innodb' w2 [ pass ] 21640 galera.galera_repl_key_format_flat16 'innodb' w1 [ pass ] 11184 galera.galera_repl_max_ws_size 'innodb' w1 [ pass ] 5238 galera.galera_create_trigger 'innodb' w2 [ pass ] 23363 galera.galera_restart_nochanges 'innodb' w1 [ pass ] 26865 galera.galera_ddl_multiline 'innodb' w2 [ pass ] 19906 galera.galera_defaults 'innodb' w2 [ pass ] 2076 galera.galera_delete_limit 'innodb' w2 [ pass ] 15792 galera.mysql-wsrep#201 'innodb' w4 [ pass ] 200850 galera.galera_bf_lock_wait 'innodb' w3 [ pass ] 111609 galera.galera_desync_overlapped 'innodb' w2 [ pass ] 10199 galera.galera_unicode_pk 'innodb' w4 [ pass ] 6225 galera.galera_update_limit 'innodb' w4 [ pass ] 12218 galera.galera_var_OSU_method 'innodb' w4 [ pass ] 4960 galera.galera_var_OSU_method2 'innodb' w4 [ pass ] 6044 galera.galera_var_auto_inc_control_off 'innodb' w4 [ pass ] 6916 galera.galera_var_certify_nonPK_off 'innodb' w4 [ pass ] 6987 galera.galera_drop_database 'innodb' w2 [ pass ] 63606 galera.galera_fulltext 'innodb' w3 [ pass ] 71684 galera.galera_drop_multi 'innodb' w2 [ pass ] 7559 galera.galera_restart_on_unknown_option 'innodb' w1 [ pass ] 107716 galera.galera_var_cluster_address 'innodb' w4 [ pass ] 19033 galera.galera_enum 'innodb' w2 [ pass ] 8685 galera.galera_many_columns 'innodb' w3 [ pass ] 9318 galera.galera_events 'innodb' w2 [ pass ] 5420 galera.galera_var_desync_on 'innodb' w4 [ pass ] 14160 galera.galera_fk_cascade_delete 'innodb' w2 [ pass ] 12752 galera.galera_roles 'innodb' w1 [ pass ] 28788 galera.galera_fk_cascade_update 'innodb' w2 [ pass ] 13758 galera.galera_rsu_error 'innodb' w1 [ pass ] 9548 galera.galera_var_dirty_reads 'innodb' w4 [ pass ] 20911 galera.galera_rsu_simple 'innodb' w1 [ pass ] 8043 galera.galera_fk_conflict 'innodb' w2 [ pass ] 10061 galera.galera_var_fkchecks 'innodb' w4 [ pass ] 12232 galera.galera_fk_mismatch 'innodb' w2 [ pass ] 9587 galera.galera_rsu_wsrep_desync 'innodb' w1 [ pass ] 11507 galera.galera_sbr 'innodb' w1 [ pass ] 7265 galera.galera_schema_dirty_reads 'innodb' w1 [ pass ] 2241 galera.galera_fk_multicolumn 'innodb' w2 [ pass ] 14212 galera.galera_serializable 'innodb' w1 [ pass ] 12752 galera.galera_fk_multitable 'innodb' w2 [ pass ] 9299 galera.galera_server 'innodb' w1 [ pass ] 4365 galera.galera_sql_log_bin_zero 'innodb' w1 [ pass ] 6069 galera.galera_fk_no_pk 'innodb' w2 [ pass ] 12756 galera.galera_status_cluster 'innodb' w1 [ pass ] 2123 galera.galera_fk_selfreferential 'innodb' w2 [ pass ] 6425 galera.galera_status_local_index 'innodb' w1 [ pass ] 6126 galera.galera_status_local_state 'innodb' w1 [ pass ] 2166 galera.galera_var_ignore_apply_errors 'innodb' w4 [ pass ] 55656 galera.galera_fk_setnull 'innodb' w2 [ pass ] 11304 galera.galera_ftwrl 'innodb' w2 [ pass ] 7945 galera.galera_ftwrl_drain 'innodb' w2 [ pass ] 7959 galera.galera_suspend_slave 'innodb' w1 [ pass ] 30172 galera.galera_gra_log 'innodb' w2 [ pass ] 6151 galera.galera_sync_wait_show 'innodb' w1 [ pass ] 16187 galera.galera_insert_ignore 'innodb' w2 [ pass ] 16370 galera.galera_toi_alter_auto_increment 'innodb' w1 [ pass ] 18414 galera.galera_insert_multi 'innodb' w2 [ pass ] 17626 galera.galera_toi_ddl_locking 'innodb' w1 [ pass ] 14805 galera.galera_toi_ddl_nonconflicting 'innodb' w1 [ pass ] 8354 galera.galera_var_max_ws_rows 'innodb' w4 [ pass ] 91390 galera.galera_kill_smallchanges 'innodb' w2 [ pass ] 25806 galera.galera_var_max_ws_size 'innodb' w4 [ pass ] 5722 galera.galera_last_committed_id 'innodb' w2 [ pass ] 6212 galera.galera_toi_ddl_sequential 'innodb' w1 [ pass ] 9427 galera.galera_var_mysql_replication_bundle 'innodb' w4 [ pass ] 6967 galera.galera_var_replicate_myisam_off 'innodb' w4 [ pass ] 3817 galera.galera_lock_table 'innodb' w2 [ pass ] 13474 galera.galera_var_replicate_myisam_on 'innodb' w4 [ pass ] 32967 galera.galera_var_sync_wait 'innodb' w4 [ pass ] 12021 galera.galera_var_wsrep_on_off 'innodb' w4 [ pass ] 5726 galera.galera_wsrep_provider_options_syntax 'innodb' w4 [ pass ] 2085 galera.galera_wsrep_provider_unset_set 'innodb' w4 [ pass ] 21228 galera.galera_many_tables_pk 'innodb' w3 [ pass ] 303354 galera.galera_zero_length_column 'innodb' w4 [ pass ] 11546 galera.grant 'innodb' w4 [ pass ] 4411 galera.lp1276424 'innodb' w4 [ pass ] 5464 galera.lp1347768 'innodb' w4 [ pass ] 5627 galera.lp1376747 'innodb' w4 [ pass ] 10306 galera.galera_many_indexes 'innodb' w2 [ pass ] 119396 galera.galera_parallel_autoinc_largetrx 'innodb' w3 [ pass ] 35684 galera.lp1376747-2 'innodb' w4 [ pass ] 8183 galera.galera_mdev_10812 'innodb' w2 [ pass ] 8571 galera.lp1376747-3 'innodb' w4 [ pass ] 8042 galera.galera_mdl_race 'innodb' w2 [ pass ] 17417 galera.lp1376747-4 'innodb' w4 [ pass ] 14554 galera.galera_multi_database 'innodb' w2 [ pass ] 11940 galera.lp1438990 'innodb' w4 [ pass ] 14334 galera.galera_myisam_autocommit 'innodb' w2 [ pass ] 6055 galera.lp959512 'innodb' w4 [ pass ] 11034 galera.galera_myisam_transactions 'innodb' w2 [ pass ] 9152 galera.mdev_9290 'innodb' w4 [ pass ] 4866 galera.galera_nopk_bit 'innodb' w2 [ pass ] 11372 galera.mysql-wsrep#110 'innodb' w4 [ pass ] 13445 galera.galera_nopk_blob 'innodb' w2 [ pass ] 10456 galera.mysql-wsrep#237 'innodb' w4 [ pass ] 7317 galera.mysql-wsrep#247 'innodb' w4 [ pass ] 5222 galera.galera_nopk_large_varchar 'innodb' w2 [ pass ] 11232 galera.galera_nopk_unicode 'innodb' w2 [ pass ] 7744 galera.galera_parallel_apply_lock_table 'innodb' w2 [ pass ] 9622 galera.mysql-wsrep#31 'innodb' w4 [ pass ] 28578 galera.galera_parallel_simple 'innodb' w2 [ pass ] 15125 galera.galera_pk_bigint_signed 'innodb' w2 [ pass ] 7744 galera.galera_pk_bigint_unsigned 'innodb' w2 [ pass ] 7094 galera.galera_toi_drop_database 'innodb' w1 [ pass ] 282454 galera.galera_toi_ftwrl 'innodb' w1 [ pass ] 8786 galera.galera_prepared_statement 'innodb' w2 [ pass ] 20414 galera.galera_toi_lock_exclusive 'innodb' w1 [ pass ] 11264 galera.galera_read_only 'innodb' w2 [ pass ] 8550 galera.galera_toi_lock_shared 'innodb' w1 [ pass ] 6693 galera.mysql-wsrep#332 'innodb' w4 [ pass ] 65727 galera.mysql-wsrep#90 'innodb' w4 [ pass ] 10104 galera.MDEV-15443 'innodb' w2 [ pass ] 27528 galera.rename 'innodb' w4 [ pass ] 10279 galera.galera_toi_truncate 'innodb' w1 [ pass ] 58777 galera.sql_log_bin 'innodb' w4 [ pass ] 14567 galera.galera_transaction_read_only 'innodb' w1 [ pass ] 6345 galera.unique_key 'innodb' w4 [ pass ] 9782 galera.galera_transaction_replay 'innodb' w1 [ pass ] 17185 galera.view 'innodb' w4 [ pass ] 12222 galera.wsrep_trx_fragment_size_sr 'innodb' w4 [ pass ] 2093 galera.MW-284 'innodb' w2 [ pass ] 16378 galera.galera_truncate 'innodb' w1 [ pass ] 35751 galera.galera_as_master 'innodb' w2 [ pass ] 15535 galera.galera#414 'innodb' w4 [ pass ] 17820 galera.galera_truncate_temporary 'innodb' w1 [ pass ] 20159 galera.galera_as_master_large 'innodb' w2 [ pass ] 8370 galera.galera_unicode_identifiers 'innodb' w1 [ pass ] 23459 galera.galera_as_slave 'innodb' w4 [ pass ] 10246 galera.galera_as_slave_autoinc 'innodb' w2 [ pass ] 6833 galera.galera_as_slave_gtid_replicate_do_db 'innodb' w4 [ pass ] 16889 galera.galera_as_slave_gtid 'innodb' w1 [ pass ] 8009 galera.galera_as_slave_nonprim 'innodb' w2 [ pass ] 26775 galera.galera_gcache_recover 'innodb' w4 [ pass ] 36955 galera.galera_gcs_fragment 'innodb' w4 [ pass ] 19534 galera.galera_gcache_recover_manytrx 'innodb' w2 [ pass ] 60607 galera.galera_gtid_slave 'innodb' w2 [ pass ] 10429 galera.galera_gcs_max_packet_size 'innodb' w4 [ pass ] 19188 galera.galera_gcache_recover_full_gcache 'innodb' w1 [ fail ] Test ended at 2019-02-27 13:29:14 CURRENT_TEST: galera.galera_gcache_recover_full_gcache mysqltest: In included file "./include/assert_grep.inc": included from /home/stepan/galera/git/10.4/server/mysql-test/suite/galera/t/galera_gcache_recover_full_gcache.test at line 65: At line 152: assert_grep.inc failed. The result from queries just before the failure was: < snip > connection node_1; Performing --wsrep-recover ... Using --wsrep-start-position when starting mysqld ... connection node_2; Performing --wsrep-recover ... Using --wsrep-start-position when starting mysqld ... connection node_1; include/diff_servers.inc [servers=1 2] connection node_1; DROP TABLE t1; CALL mtr.add_suppression("Skipped GCache ring buffer recovery"); include/assert_grep.inc [IST first seqno [24] not found from cache, falling back to SST] include/assert_grep.inc failed! assert_text: 'IST first seqno [24] not found from cache, falling back to SST' assert_file: '/home/stepan/galera/git/10.4/server/mysql-test/var/1/log/mysqld.1.err' assert_select: 'IST first seqno [24] not found from cache, falling back to SST' assert_match: '' assert_count: '1' assert_only_after: 'starting as process' number of matching lines: 0 More results from queries before failure can be found in /home/stepan/galera/git/10.4/server/mysql-test/var/1/log/galera_gcache_recover_full_gcache.log - saving '/home/stepan/galera/git/10.4/server/mysql-test/var/1/log/galera.galera_gcache_recover_full_gcache-innodb/' to '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera.galera_gcache_recover_full_gcache-innodb/' galera.galera_gtid_slave_sst_rsync 'innodb' w2 [ pass ] 32514 galera.galera_ist_innodb_flush_logs 'debug,innodb' w4 [ pass ] 67439 galera.galera_ist_mariabackup_innodb_flush_logs 'debug,innodb' w1 [ pass ] 71248 galera.galera_ist_recv_bind 'innodb' w4 [ pass ] 19664 galera.galera_ist_restart_joiner 'innodb' w1 [ pass ] 43546 galera.galera_parallel_autoinc_manytrx 'innodb' w3 [ pass ] 711307 galera.galera_pc_recovery 'innodb' w3 [ pass ] 19578 galera.galera_ist_mysqldump 'debug,innodb' w2 [ pass ] 143335 galera.galera_ist_rsync 'debug,innodb' w4 [ pass ] 89241 galera.galera_ssl 'innodb' w4 [ pass ] 5769 galera.galera_mdev_15611 'innodb' w2 [ pass ] 77892 galera.galera_ssl_compression 'innodb' w4 [ pass ] 5931 galera.galera_sst_mariabackup 'debug,innodb' w2 [ pass ] 113996 galera.galera_sst_mariabackup_data_dir 'debug,innodb' w4 [ pass ] 114453 galera.galera_rsu_add_pk 'innodb' w3 [ pass ] 249288 galera.galera_sst_mariabackup_encrypt_with_key 'innodb' w2 [ pass ] 2085 galera.galera_sst_mariabackup_table_options '16k,clear,innodb' w4 [ pass ] 58301 galera.galera_sst_mariabackup_table_options '16k,crypt,innodb' w2 [ pass ] 60654 galera.galera_many_rows 'innodb' w1 [ pass ] 544508 galera.galera_sst_mariabackup_table_options '4k,clear,innodb' w4 [ pass ] 66015 galera.galera_sst_mariabackup_table_options '4k,crypt,innodb' w2 [ pass ] 64684 galera.galera_rsu_drop_pk 'innodb' w3 [ pass ] 409258 galera.galera_sst_mariabackup_table_options '8k,clear,innodb' w1 [ pass ] 49043 galera.galera_sst_mariabackup_table_options '8k,crypt,innodb' w4 [ pass ] 52975 galera.galera_toi_ddl_error 'innodb' w3 [ pass ] 83466 galera.galera_sst_rsync 'debug,innodb' w1 [ pass ] 88712 galera.galera_toi_ddl_fk_insert 'innodb' w3 [ pass ] 68541 galera.galera_sst_rsync2 'debug,innodb' w4 [ pass ] 93490 galera.galera_sst_mysqldump 'debug,innodb' w2 [ pass ] 222796 galera.galera_var_gtid_domain_id 'innodb' w4 [ pass ] 6338 galera.galera_var_log_bin 'innodb' w2 [ pass ] 5538 galera.galera_toi_ddl_fk_update 'innodb' w3 [ pass ] 56796 galera.galera_sst_rsync_data_dir 'debug,innodb' w1 [ pass ] 96731 galera.galera_var_load_data_splitting 'innodb' w3 [ pass ] 50887 galera.galera_var_slave_threads 'innodb' w4 [ fail ] Test ended at 2019-02-27 13:48:30 CURRENT_TEST: galera.galera_var_slave_threads mysqltest: At line 114: query 'SET GLOBAL wsrep_cluster_address=''' failed: 2013: Lost connection to MySQL server during query The result from queries just before the failure was: < snip > SET GLOBAL wsrep_slave_threads = 1; connection node_1; connection node_2; SELECT COUNT(*) FROM t2; COUNT(*) 64 SELECT COUNT(*) FROM INFORMATION_SCHEMA.PROCESSLIST WHERE USER = 'system user' AND STATE LIKE '%wsrep aborter%'; COUNT(*) 1 SET GLOBAL wsrep_slave_threads = 5; SET GLOBAL wsrep_slave_threads = 1; connection node_2; Shutting down server ... connection node_1; show status like 'wsrep_cluster_size'; Variable_name Value wsrep_cluster_size 1 SET GLOBAL wsrep_slave_threads = 6; SET GLOBAL wsrep_slave_threads = 1; SET GLOBAL wsrep_cluster_address=''; More results from queries before failure can be found in /home/stepan/galera/git/10.4/server/mysql-test/var/4/log/galera_var_slave_threads.log Server [mysqld.1 - pid: 141947, winpid: 141947, exit: 256] failed during test run Server log from this test: ----------SERVER LOG START----------- 2019-02-27 13:47:21 0 [Warning] WSREP: option --wsrep-causal-reads is deprecated 2019-02-27 13:47:21 0 [Note] /home/stepan/galera/git/10.4/server/sql/mysqld (mysqld 10.4.4-MariaDB-debug-log) starting as process 141948 ... 2019-02-27 13:47:21 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4186) 2019-02-27 13:47:21 0 [Warning] Changed limits: max_open_files: 1024 max_connections: 151 (was 151) table_cache: 421 (was 2000) 2019-02-27 13:47:21 0 [Warning] WSREP: wsrep_sst_receive_address is set to '127.0.0.1:16064' which makes it impossible for another host to reach this one. Please set it to the address which this node can be connected at by other cluster members. 2019-02-27 13:47:21 0 [Note] WSREP: Loading provider /usr/lib/libgalera_smm_4.so initial position: 00000000-0000-0000-0000-000000000000:-1 wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_smm_4.so' wsrep loader: [INFO] wsrep_load(): Galera 26.4.1(r4486) by Codership Oy loaded successfully. 2019-02-27 13:47:21 0 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-02-27 13:47:21 0 [Warning] WSREP: Could not open state file for reading: '/home/stepan/galera/git/10.4/server/mysql-test/var/4/mysqld.1/data//grastate.dat' 2019-02-27 13:47:21 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1 2019-02-27 13:47:21 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 0 UUID: 00000000-0000-0000-0000-000000000000 Seqno: -1 - -1 Offset: -1 Synced: 0 2019-02-27 13:47:21 0 [Note] WSREP: Skipped GCache ring buffer recovery: could not determine history UUID. 2019-02-27 13:47:21 0 [Note] WSREP: Passing config to GCS: base_dir = /home/stepan/galera/git/10.4/server/mysql-test/var/4/mysqld.1/data/; base_host = 127.0.0.1; base_port = 16062; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT30S; evs.install_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT10S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /home/stepan/galera/git/10.4/server/mysql-test/var/4/mysqld.1/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /home/stepan/galera/git/10.4/server/mysql-test/var/4/mysqld.1/data//galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 10M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.ma 2019-02-27 13:47:22 0 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0 -> 00000000-0000-0000-0000-000000000000:-1 2019-02-27 13:47:22 0 [Note] WSREP: Start replication 2019-02-27 13:47:22 0 [Note] WSREP: Connecting with bootstrap option: 1 2019-02-27 13:47:22 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1 2019-02-27 13:47:22 0 [Note] WSREP: protonet asio version 0 2019-02-27 13:47:22 0 [Note] WSREP: Using CRC-32C for message checksums. 2019-02-27 13:47:22 0 [Note] WSREP: backend: asio 2019-02-27 13:47:22 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-02-27 13:47:22 0 [Warning] WSREP: access file(/home/stepan/galera/git/10.4/server/mysql-test/var/4/mysqld.1/data//gvwstate.dat) failed(No such file or directory) 2019-02-27 13:47:22 0 [Note] WSREP: restore pc from disk failed 2019-02-27 13:47:22 0 [Note] WSREP: GMCast version 0 2019-02-27 13:47:22 0 [Note] WSREP: (719cb7cb, 'tcp://0.0.0.0:16062') listening at tcp://0.0.0.0:16062 2019-02-27 13:47:22 0 [Note] WSREP: (719cb7cb, 'tcp://0.0.0.0:16062') multicast: , ttl: 1 2019-02-27 13:47:22 0 [Note] WSREP: EVS version 1 2019-02-27 13:47:22 0 [Note] WSREP: gcomm: bootstrapping new group 'my_wsrep_cluster' 2019-02-27 13:47:22 0 [Note] WSREP: start_prim is enabled, turn off pc_recovery 2019-02-27 13:47:22 0 [Note] WSREP: EVS version upgrade 0 -> 1 2019-02-27 13:47:22 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2019-02-27 13:47:22 0 [Note] WSREP: Node 719cb7cb state prim 2019-02-27 13:47:22 0 [Note] WSREP: view(view_id(PRIM,719cb7cb,1) memb { 719cb7cb,0 } joined { } left { } partitioned { }) 2019-02-27 13:47:22 0 [Note] WSREP: save pc into disk 2019-02-27 13:47:22 0 [Note] WSREP: gcomm: connected 2019-02-27 13:47:22 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-02-27 13:47:22 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-02-27 13:47:22 0 [Note] WSREP: Opened channel 'my_wsrep_cluster' 2019-02-27 13:47:22 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 2019-02-27 13:47:22 0 [Note] WSREP: Starting new group from scratch: 71b23ded-3a85-11e9-a714-0fbb62f1607e 2019-02-27 13:47:22 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 71b24a0b-3a85-11e9-a77d-4bfdac4a6fe1 2019-02-27 13:47:22 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 71b24a0b-3a85-11e9-a77d-4bfdac4a6fe1 2019-02-27 13:47:22 0 [Note] WSREP: STATE EXCHANGE: got state msg: 71b24a0b-3a85-11e9-a77d-4bfdac4a6fe1 from 0 (cnts7gl1.localdomain) 2019-02-27 13:47:22 0 [Note] WSREP: Quorum results: version = 5, component = PRIMARY, conf_id = 0, members = 1/1 (joined/total), act_id = 0, last_appl. = -1, protocols = 1/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 71b23ded-3a85-11e9-a714-0fbb62f1607e 2019-02-27 13:47:22 0 [Note] WSREP: Writing down CC checksum: c22a7d1b b726e922 024cee4b a78b0afb at offset 144 2019-02-27 13:47:22 0 [Note] WSREP: Flow-control interval: [16, 16] 2019-02-27 13:47:22 0 [Note] WSREP: Trying to continue unpaused monitor 2019-02-27 13:47:22 0 [Note] WSREP: Restored state OPEN -> JOINED (1) 2019-02-27 13:47:22 0 [Note] WSREP: Member 0.0 (cnts7gl1.localdomain) synced with group. 2019-02-27 13:47:22 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 1) 2019-02-27 13:47:22 2 [Note] WSREP: Starting post rollbacker thread 2 2019-02-27 13:47:22 1 [Note] WSREP: Starting rollbacker thread 1 2019-02-27 13:47:22 3 [Note] WSREP: Starting applier thread 3 2019-02-27 13:47:22 3 [Note] WSREP: ####### processing CC 1, local, ordered 2019-02-27 13:47:22 3 [Note] WSREP: ####### drain monitors upto -1 2019-02-27 13:47:22 3 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-02-27 13:47:22 3 [Note] WSREP: ####### My UUID: 719cb7cb-3a85-11e9-9bda-76c3da452b0e 2019-02-27 13:47:22 3 [Note] WSREP: Server cnts7gl1.localdomain connected to cluster at position 71b23ded-3a85-11e9-a714-0fbb62f1607e:1 with ID 719cb7cb-3a85-11e9-9bda-76c3da452b0e 2019-02-27 13:47:22 3 [Note] WSREP: Server status change disconnected -> connected 2019-02-27 13:47:22 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:47:22 3 [Note] WSREP: ####### ST not required 2019-02-27 13:47:22 3 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:0 (proto: 10), state transfer needed: no 2019-02-27 13:47:22 0 [Note] WSREP: Service thread queue flushed. 2019-02-27 13:47:22 3 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:0, protocol version: 5 2019-02-27 13:47:22 3 [Note] WSREP: ####### Adjusting cert position: 0 -> 1 2019-02-27 13:47:22 0 [Note] WSREP: Service thread queue flushed. 2019-02-27 13:47:22 3 [Note] WSREP: ####### Setting monitor position to 1 2019-02-27 13:47:22 3 [Note] WSREP: Lowest cert indnex boundary for CC from group: 1 2019-02-27 13:47:22 3 [Note] WSREP: Min available from gcache for CC from group: 1 2019-02-27 13:47:22 3 [Note] WSREP: ================================================ View: id: 71b23ded-3a85-11e9-a714-0fbb62f1607e:1 seqno: 1 status: 0 protocol_version: 4 own_index: 0 final: 0 members 2019-02-27 13:47:22 3 [Note] WSREP: id: 719cb7cb-3a85-11e9-9bda-76c3da452b0e name: cnts7gl1.localdomain 2019-02-27 13:47:22 3 [Note] WSREP: ================================================= 2019-02-27 13:47:22 3 [Note] WSREP: Server status change connected -> joiner 2019-02-27 13:47:22 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:47:22 3 [Note] WSREP: Server status change joiner -> initializing 2019-02-27 13:47:22 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:47:22 0 [Note] Plugin 'partition' is disabled. 2019-02-27 13:47:22 0 [Note] Plugin 'SEQUENCE' is disabled. 2019-02-27 13:47:22 0 [Note] InnoDB: Using Linux native AIO 2019-02-27 13:47:22 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!! 2019-02-27 13:47:22 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-02-27 13:47:22 0 [Note] InnoDB: Uses event mutexes 2019-02-27 13:47:22 0 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-02-27 13:47:22 0 [Note] InnoDB: Number of pools: 1 2019-02-27 13:47:22 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-02-27 13:47:22 0 [Note] mysqld: O_TMPFILE is not supported on /home/stepan/galera/git/10.4/server/mysql-test/var/tmp/4/mysqld.1 (disabling future attempts) 2019-02-27 13:47:22 0 [Note] InnoDB: Initializing buffer pool, total size = 8M, instances = 1, chunk size = 8M 2019-02-27 13:47:22 0 [Note] InnoDB: Completed initialization of buffer pool 2019-02-27 13:47:22 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-02-27 13:47:23 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-02-27 13:47:23 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-02-27 13:47:23 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-02-27 13:47:23 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2019-02-27 13:47:23 0 [Note] InnoDB: Waiting for purge to start 2019-02-27 13:47:23 0 [Note] InnoDB: 10.4.4 started; log sequence number 151637; transaction id 34 2019-02-27 13:47:23 0 [Note] InnoDB: Loading buffer pool(s) from /home/stepan/galera/git/10.4/server/mysql-test/var/4/mysqld.1/data/ib_buffer_pool 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_MUTEXES' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_CMP' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled. 2019-02-27 13:47:23 0 [Note] InnoDB: Buffer pool(s) load completed at 190227 13:47:23 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'FEEDBACK' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'user_variables' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled. 2019-02-27 13:47:23 0 [Note] Plugin 'unix_socket' is disabled. 2019-02-27 13:47:23 0 [Warning] /home/stepan/galera/git/10.4/server/sql/mysqld: unknown option '--loose-pam-debug' 2019-02-27 13:47:23 0 [Warning] /home/stepan/galera/git/10.4/server/sql/mysqld: unknown option '--loose-aria' 2019-02-27 13:47:23 0 [Note] Server socket created on IP: '127.0.0.1'. 2019-02-27 13:47:23 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2019-02-27 13:47:25 0 [Note] WSREP: Server initialized 2019-02-27 13:47:25 0 [Note] WSREP: Server status change initializing -> initialized 2019-02-27 13:47:25 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:47:25 3 [Note] WSREP: Bootstrapping a new cluster, setting initial position to 00000000-0000-0000-0000-000000000000:-1 2019-02-27 13:47:25 10 [Note] WSREP: Cluster table is empty, not recovering transactions 2019-02-27 13:47:25 3 [Note] WSREP: Server status change initialized -> joined 2019-02-27 13:47:25 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:47:25 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:47:25 0 [Note] Reading of all Master_info entries succeded 2019-02-27 13:47:25 0 [Note] Added new Master_info '' to hash table 2019-02-27 13:47:25 0 [Note] /home/stepan/galera/git/10.4/server/sql/mysqld: ready for connections. Version: '10.4.4-MariaDB-debug-log' socket: '/home/stepan/galera/git/10.4/server/mysql-test/var/tmp/4/mysqld.1.sock' port: 16060 Source distribution 2019-02-27 13:47:25 3 [Note] WSREP: Server cnts7gl1.localdomain synced with group 2019-02-27 13:47:25 3 [Note] WSREP: Server status change joined -> synced 2019-02-27 13:47:25 3 [Note] WSREP: Synchronized with group, ready for connections 2019-02-27 13:47:25 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:47:26 0 [Note] WSREP: (719cb7cb, 'tcp://0.0.0.0:16062') connection established to 7413601a tcp://127.0.0.1:16065 2019-02-27 13:47:26 0 [Note] WSREP: (719cb7cb, 'tcp://0.0.0.0:16062') turning message relay requesting on, nonlive peers: 2019-02-27 13:47:26 0 [Note] WSREP: declaring 7413601a at tcp://127.0.0.1:16065 stable 2019-02-27 13:47:26 0 [Note] WSREP: Node 719cb7cb state prim 2019-02-27 13:47:26 0 [Note] WSREP: view(view_id(PRIM,719cb7cb,2) memb { 719cb7cb,0 7413601a,0 } joined { } left { } partitioned { }) 2019-02-27 13:47:26 0 [Note] WSREP: save pc into disk 2019-02-27 13:47:27 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2019-02-27 13:47:27 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 747fb6fd-3a85-11e9-9e4d-4eea62ca40f0 2019-02-27 13:47:27 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 747fb6fd-3a85-11e9-9e4d-4eea62ca40f0 2019-02-27 13:47:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 747fb6fd-3a85-11e9-9e4d-4eea62ca40f0 from 0 (cnts7gl1.localdomain) 2019-02-27 13:47:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 747fb6fd-3a85-11e9-9e4d-4eea62ca40f0 from 1 (cnts7gl1.localdomain) 2019-02-27 13:47:27 0 [Note] WSREP: Quorum results: version = 5, component = PRIMARY, conf_id = 1, members = 1/2 (joined/total), act_id = 1, last_appl. = 0, protocols = 1/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 71b23ded-3a85-11e9-a714-0fbb62f1607e 2019-02-27 13:47:27 0 [Note] WSREP: Writing down CC checksum: 9cd9c550 83d924f4 5ddd6849 1ce03005 at offset 224 2019-02-27 13:47:27 0 [Note] WSREP: Flow-control interval: [23, 23] 2019-02-27 13:47:27 0 [Note] WSREP: Trying to continue unpaused monitor 2019-02-27 13:47:27 3 [Note] WSREP: ####### processing CC 2, local, ordered 2019-02-27 13:47:27 3 [Note] WSREP: ####### drain monitors upto 1 2019-02-27 13:47:27 3 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-02-27 13:47:27 3 [Note] WSREP: ####### My UUID: 719cb7cb-3a85-11e9-9bda-76c3da452b0e 2019-02-27 13:47:27 3 [Note] WSREP: ####### ST not required 2019-02-27 13:47:27 3 [Note] WSREP: Skipping cert index reset 2019-02-27 13:47:27 3 [Note] WSREP: ####### Adjusting cert position: 1 -> 2 2019-02-27 13:47:27 0 [Note] WSREP: Service thread queue flushed. 2019-02-27 13:47:27 3 [Note] WSREP: ####### Setting monitor position to 2 2019-02-27 13:47:27 3 [Note] WSREP: Lowest cert indnex boundary for CC from group: 2 2019-02-27 13:47:27 3 [Note] WSREP: Min available from gcache for CC from group: 1 2019-02-27 13:47:27 0 [Note] WSREP: Member 1.0 (cnts7gl1.localdomain) requested state transfer from '*any*'. Selected 0.0 (cnts7gl1.localdomain)(SYNCED) as donor. 2019-02-27 13:47:27 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 2) 2019-02-27 13:47:27 3 [Note] WSREP: ================================================ View: id: 71b23ded-3a85-11e9-a714-0fbb62f1607e:2 seqno: 2 status: 0 protocol_version: 4 own_index: 0 final: 0 members 2019-02-27 13:47:27 3 [Note] WSREP: id: 719cb7cb-3a85-11e9-9bda-76c3da452b0e name: cnts7gl1.localdomain 2019-02-27 13:47:27 3 [Note] WSREP: id: 7413601a-3a85-11e9-9ae7-c7168137cc34 name: cnts7gl1.localdomain 2019-02-27 13:47:27 3 [Note] WSREP: ================================================= 2019-02-27 13:47:27 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:47:27 3 [Note] WSREP: Detected STR version: 1, req_len: 110, req: STRv1 2019-02-27 13:47:27 3 [Note] WSREP: Cert index preload: 2 -> 2 2019-02-27 13:47:27 3 [Note] WSREP: Server status change synced -> donor 2019-02-27 13:47:27 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:47:27 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:47:27 0 [Note] WSREP: async IST sender starting to serve tcp://127.0.0.1:16066 sending 2-2 2019-02-27 13:47:27 0 [Note] WSREP: IST sender 2 -> 2 2019-02-27 13:47:27 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '127.0.0.2:16067/rsync_sst' --socket '/home/stepan/galera/git/10.4/server/mysql-test/var/tmp/4/mysqld.1.sock' --datadir '/home/stepan/galera/git/10.4/server/mysql-test/var/4/mysqld.1/data/' --defaults-file '/home/stepan/galera/git/10.4/server/mysql-test/var/4/my.cnf' --defaults-group-suffix '.1' '' --binlog-index 'mysqld-bin.index' --gtid '71b23ded-3a85-11e9-a714-0fbb62f1607e:2' --gtid-domain-id '0'' 2019-02-27 13:47:27 3 [Note] WSREP: sst_donor_thread signaled with 0 2019-02-27 13:47:27 0 [Note] WSREP: Flushing tables for SST... 2019-02-27 13:47:27 0 [Note] WSREP: pause 2019-02-27 13:47:28 0 [Note] WSREP: Provider paused at 71b23ded-3a85-11e9-a714-0fbb62f1607e:2 (5) 2019-02-27 13:47:28 0 [Note] WSREP: Server paused at: 2 2019-02-27 13:47:28 0 [Note] WSREP: Tables flushed. 2019-02-27 13:47:29 0 [Note] WSREP: (719cb7cb, 'tcp://0.0.0.0:16062') turning message relay requesting off 2019-02-27 13:47:30 0 [Note] WSREP: resume 2019-02-27 13:47:31 0 [Note] WSREP: resuming provider at 5 2019-02-27 13:47:31 0 [Note] WSREP: Provider resumed. 2019-02-27 13:47:31 0 [Note] WSREP: SST sent: 71b23ded-3a85-11e9-a714-0fbb62f1607e:2 2019-02-27 13:47:31 0 [Note] WSREP: Server status change donor -> joined 2019-02-27 13:47:31 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:47:31 0 [Note] WSREP: 0.0 (cnts7gl1.localdomain): State transfer to 1.0 (cnts7gl1.localdomain) complete. 2019-02-27 13:47:31 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 2) 2019-02-27 13:47:31 0 [Note] WSREP: Member 0.0 (cnts7gl1.localdomain) synced with group. 2019-02-27 13:47:31 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2) 2019-02-27 13:47:31 3 [Note] WSREP: Server cnts7gl1.localdomain synced with group 2019-02-27 13:47:31 3 [Note] WSREP: Server status change joined -> synced 2019-02-27 13:47:31 3 [Note] WSREP: Synchronized with group, ready for connections 2019-02-27 13:47:31 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:47:33 0 [Note] WSREP: async IST sender served 2019-02-27 13:47:33 0 [Note] WSREP: 1.0 (cnts7gl1.localdomain): State transfer from 0.0 (cnts7gl1.localdomain) complete. 2019-02-27 13:47:33 0 [Note] WSREP: Member 1.0 (cnts7gl1.localdomain) synced with group. 2019-02-27 13:48:03 0 [Note] WSREP: forgetting 7413601a (tcp://127.0.0.1:16065) 2019-02-27 13:48:03 0 [Note] WSREP: Node 719cb7cb state prim 2019-02-27 13:48:03 0 [Note] WSREP: view(view_id(PRIM,719cb7cb,3) memb { 719cb7cb,0 } joined { } left { } partitioned { 7413601a,0 }) 2019-02-27 13:48:03 0 [Note] WSREP: save pc into disk 2019-02-27 13:48:03 0 [Note] WSREP: forgetting 7413601a (tcp://127.0.0.1:16065) 2019-02-27 13:48:03 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 2019-02-27 13:48:03 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 8a61f39d-3a85-11e9-b21a-57e2b4654b34 2019-02-27 13:48:03 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 8a61f39d-3a85-11e9-b21a-57e2b4654b34 2019-02-27 13:48:03 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8a61f39d-3a85-11e9-b21a-57e2b4654b34 from 0 (cnts7gl1.localdomain) 2019-02-27 13:48:03 0 [Note] WSREP: Quorum results: version = 5, component = PRIMARY, conf_id = 2, members = 1/1 (joined/total), act_id = 69, last_appl. = 0, protocols = 1/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 71b23ded-3a85-11e9-a714-0fbb62f1607e 2019-02-27 13:48:03 0 [Note] WSREP: Writing down CC checksum: 4155bfc9 e55495f6 e2ed2cc9 2396e2ee at offset 144 2019-02-27 13:48:03 0 [Note] WSREP: Flow-control interval: [16, 16] 2019-02-27 13:48:03 0 [Note] WSREP: Trying to continue unpaused monitor 2019-02-27 13:48:03 3 [Note] WSREP: ####### processing CC 70, local, ordered 2019-02-27 13:48:03 3 [Note] WSREP: ####### drain monitors upto 69 2019-02-27 13:48:03 3 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-02-27 13:48:03 3 [Note] WSREP: ####### My UUID: 719cb7cb-3a85-11e9-9bda-76c3da452b0e 2019-02-27 13:48:03 3 [Note] WSREP: ####### ST not required 2019-02-27 13:48:03 3 [Note] WSREP: Skipping cert index reset 2019-02-27 13:48:03 3 [Note] WSREP: ####### Adjusting cert position: 69 -> 70 2019-02-27 13:48:03 0 [Note] WSREP: Service thread queue flushed. 2019-02-27 13:48:03 3 [Note] WSREP: ####### Setting monitor position to 70 2019-02-27 13:48:04 3 [Note] WSREP: Lowest cert indnex boundary for CC from group: 3 2019-02-27 13:48:04 3 [Note] WSREP: Min available from gcache for CC from group: 1 2019-02-27 13:48:04 3 [Note] WSREP: ================================================ View: id: 71b23ded-3a85-11e9-a714-0fbb62f1607e:70 seqno: 3 status: 0 protocol_version: 4 own_index: 0 final: 0 members 2019-02-27 13:48:04 3 [Note] WSREP: id: 719cb7cb-3a85-11e9-9bda-76c3da452b0e name: cnts7gl1.localdomain 2019-02-27 13:48:04 3 [Note] WSREP: ================================================= 2019-02-27 13:48:04 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:48:07 0 [Note] WSREP: (719cb7cb, 'tcp://0.0.0.0:16062') connection established to 7413601a tcp://127.0.0.1:16065 2019-02-27 13:48:07 0 [Warning] WSREP: discarding established (time wait) 7413601a (tcp://127.0.0.1:16065) 2019-02-27 13:48:08 0 [Note] WSREP: cleaning up 7413601a (tcp://127.0.0.1:16065) 2019-02-27 13:48:12 0 [Note] WSREP: (719cb7cb, 'tcp://0.0.0.0:16062') connection established to 7413601a tcp://127.0.0.1:16065 2019-02-27 13:48:12 0 [Note] WSREP: (719cb7cb, 'tcp://0.0.0.0:16062') turning message relay requesting on, nonlive peers: 2019-02-27 13:48:13 0 [Note] WSREP: (719cb7cb, 'tcp://0.0.0.0:16062') reconnecting to 7413601a (tcp://127.0.0.1:16065), attempt 0 2019-02-27 13:48:15 24 [Note] WSREP: Starting applier thread 24 2019-02-27 13:48:15 25 [Note] WSREP: Starting applier thread 25 2019-02-27 13:48:15 23 [Note] WSREP: Starting applier thread 23 2019-02-27 13:48:15 21 [Note] WSREP: Starting applier thread 21 2019-02-27 13:48:15 22 [Note] WSREP: Starting applier thread 22 2019-02-27 13:48:15 20 [Note] WSREP: Stop replication by 20 2019-02-27 13:48:15 20 [Note] WSREP: Server status change synced -> disconnecting 2019-02-27 13:48:15 20 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:48:15 20 [Note] WSREP: Closing send monitor... 2019-02-27 13:48:15 20 [Note] WSREP: Closed send monitor. 2019-02-27 13:48:15 20 [Note] WSREP: gcomm: terminating thread 2019-02-27 13:48:15 20 [Note] WSREP: gcomm: joining thread 2019-02-27 13:48:15 20 [Note] WSREP: gcomm: closing backend 2019-02-27 13:48:15 20 [Note] WSREP: PC protocol downgrade 1 -> 0 2019-02-27 13:48:15 20 [Note] WSREP: view((empty)) 2019-02-27 13:48:15 20 [Note] WSREP: gcomm: closed 2019-02-27 13:48:15 0 [Note] WSREP: Received self-leave message. 2019-02-27 13:48:15 0 [Note] WSREP: Writing down CC checksum: 4ea925b7 fac75b4c 39cd0543 5936a705 at offset 64 2019-02-27 13:48:15 0 [Note] WSREP: Flow-control interval: [0, 0] 2019-02-27 13:48:15 0 [Note] WSREP: Trying to continue unpaused monitor 2019-02-27 13:48:15 0 [Note] WSREP: Received SELF-LEAVE. Closing connection. 2019-02-27 13:48:15 0 [Note] WSREP: Shifting SYNCED -> CLOSED (TO: 70) 2019-02-27 13:48:15 0 [Note] WSREP: RECV thread exiting 0: Success 2019-02-27 13:48:15 20 [Note] WSREP: recv_thread() joined. 2019-02-27 13:48:15 20 [Note] WSREP: Closing replication queue. 2019-02-27 13:48:15 20 [Note] WSREP: Closing slave action queue. 2019-02-27 13:48:15 3 [Note] WSREP: ####### processing CC -1, local, ordered 2019-02-27 13:48:15 3 [Note] WSREP: ####### drain monitors upto 70 2019-02-27 13:48:15 3 [Note] WSREP: ####### My UUID: 719cb7cb-3a85-11e9-9bda-76c3da452b0e 2019-02-27 13:48:15 3 [Note] WSREP: ####### ST not required 2019-02-27 13:48:15 3 [Note] WSREP: ================================================ View: id: 71b23ded-3a85-11e9-a714-0fbb62f1607e:-1 seqno: -1 status: 1 protocol_version: 4 own_index: -1 final: 1 members 2019-02-27 13:48:15 3 [Note] WSREP: ================================================= 2019-02-27 13:48:15 3 [Note] WSREP: Non-primary view 2019-02-27 13:48:15 3 [Note] WSREP: Server status change disconnecting -> disconnected 2019-02-27 13:48:15 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:48:15 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-27 13:48:15 24 [Note] WSREP: Applier thread exiting ret: 6 thd: 24 2019-02-27 13:48:15 23 [Note] WSREP: Applier thread exiting ret: 6 thd: 23 2019-02-27 13:48:15 22 [Note] WSREP: Applier thread exiting ret: 6 thd: 22 2019-02-27 13:48:15 25 [Note] WSREP: Applier thread exiting ret: 6 thd: 25 2019-02-27 13:48:15 21 [Note] WSREP: Applier thread exiting ret: 6 thd: 21 2019-02-27 13:48:16 3 [Note] WSREP: Applier thread exiting ret: 0 thd: 3 2019-02-27 13:48:16 20 [Note] WSREP: killing local connection: 19 mysqld: /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_socket.h:779: inline_mysql_socket_recv: Assertion `mysql_socket.fd != -1' failed. 190227 13:48:16 [ERROR] mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.4.4-MariaDB-debug-log key_buffer_size=1048576 read_buffer_size=131072 max_used_connections=2 max_threads=153 thread_count=10 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 63538 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7f211c000b00 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f21881d3d30 thread_stack 0x49000 /home/stepan/galera/git/10.4/server/sql/mysqld(my_print_stacktrace+0x40)[0x56328122b462] /home/stepan/galera/git/10.4/server/sql/mysqld(handle_fatal_signal+0x3e2)[0x563280a60a8f] /lib64/libpthread.so.0(+0xf5d0)[0x7f2198a7b5d0] :0(__GI_raise)[0x7f2196d6a207] :0(__GI_abort)[0x7f2196d6b8f8] :0(__assert_fail_base)[0x7f2196d63026] :0(__GI___assert_fail)[0x7f2196d630d2] /home/stepan/galera/git/10.4/server/sql/mysqld(+0x1307981)[0x56328129a981] psi/mysql_socket.h:781(inline_mysql_socket_recv)[0x56328129b027] vio/viosocket.c:185(vio_read)[0x563280bcb176] sql/net_serv.cc:962(my_real_read(st_net*, unsigned long*, char))[0x563280bcb9fd] sql/net_serv.cc:1228(my_net_read_packet)[0x563280bcb9b0] sql/sql_parse.cc:1231(do_command(THD*))[0x5632807135f3] sql/sql_connect.cc:1399(do_handle_one_connection(CONNECT*))[0x56328088ec9e] sql/sql_connect.cc:1303(handle_one_connection)[0x56328088e9e2] perfschema/pfs.cc:1864(pfs_spawn_thread)[0x5632811c2fb3] pthread_create.c:0(start_thread)[0x7f2198a73dd5] /lib64/libc.so.6(clone+0x6d)[0x7f2196e31ead] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x0): Connection ID (thread ID): 19 Status: KILL_CONNECTION Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. Writing a core file at /home/stepan/galera/git/10.4/server/mysql-test/var/4/mysqld.1/data/ ----------SERVER LOG END------------- - found 'core.141948' (0/5) Trying 'dbx' to get a backtrace Trying 'gdb' to get a backtrace from coredump /home/stepan/galera/git/10.4/server/mysql-test/var/4/log/galera.galera_var_slave_threads-innodb/mysqld.1/data/core.141948 Core generated by '/home/stepan/galera/git/10.4/server/sql/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- [New LWP 142158] [New LWP 141952] [New LWP 141956] [New LWP 142426] [New LWP 141959] [New LWP 141961] [New LWP 141964] [New LWP 141969] [New LWP 141974] [New LWP 141950] [New LWP 141960] [New LWP 141962] [New LWP 141965] [New LWP 141971] [New LWP 141973] [New LWP 141976] [New LWP 141977] [New LWP 141984] [New LWP 141985] [New LWP 142157] [New LWP 141948] [New LWP 141957] [New LWP 141963] [New LWP 141966] [New LWP 141968] [New LWP 141970] [New LWP 141972] [New LWP 141975] [New LWP 141982] [New LWP 141983] [New LWP 142052] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `/home/stepan/galera/git/10.4/server/sql/mysqld --defaults-group-suffix=.1 --def'. Program terminated with signal 6, Aborted. #0 0x00007f2198a789d1 in pthread_kill () from /lib64/libpthread.so.0 #0 0x00007f2198a789d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x000056328122b550 in my_write_core (sig=6) at /home/stepan/galera/git/10.4/server/mysys/stacktrace.c:481 #2 0x0000563280a60ebb in handle_fatal_signal (sig=6) at /home/stepan/galera/git/10.4/server/sql/signal_handler.cc:305 #3 #4 0x00007f2196d6a207 in raise () from /lib64/libc.so.6 #5 0x00007f2196d6b8f8 in abort () from /lib64/libc.so.6 #6 0x00007f2196d63026 in __assert_fail_base () from /lib64/libc.so.6 #7 0x00007f2196d630d2 in __assert_fail () from /lib64/libc.so.6 #8 0x000056328129a981 in inline_mysql_socket_recv (src_file=0x5632818061a0 "/home/stepan/galera/git/10.4/server/vio/viosocket.c", src_line=186, mysql_socket=..., buf=0x7f211c028540, n=4, flags=64) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_socket.h:779 #9 0x000056328129b027 in vio_read (vio=0x563284105fe0, buf=0x7f211c028540 "\001", size=4) at /home/stepan/galera/git/10.4/server/vio/viosocket.c:185 #10 0x0000563280bcb176 in my_real_read (net=0x7f211c000df8, complen=0x7f21881d3810, header=1 '\001') at /home/stepan/galera/git/10.4/server/sql/net_serv.cc:962 #11 0x0000563280bcb9fd in my_net_read_packet_reallen (net=0x7f211c000df8, read_from_server=1 '\001', reallen=0x7f21881d3878) at /home/stepan/galera/git/10.4/server/sql/net_serv.cc:1243 #12 0x0000563280bcb9b0 in my_net_read_packet (net=0x7f211c000df8, read_from_server=1 '\001') at /home/stepan/galera/git/10.4/server/sql/net_serv.cc:1227 #13 0x00005632807135f3 in do_command (thd=0x7f211c000b00) at /home/stepan/galera/git/10.4/server/sql/sql_parse.cc:1231 #14 0x000056328088ec9e in do_handle_one_connection (connect=0x5632840d6be0) at /home/stepan/galera/git/10.4/server/sql/sql_connect.cc:1399 #15 0x000056328088e9e2 in handle_one_connection (arg=0x5632840d6be0) at /home/stepan/galera/git/10.4/server/sql/sql_connect.cc:1302 #16 0x00005632811c2fb3 in pfs_spawn_thread (arg=0x56328410a200) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #17 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #18 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 31 (Thread 0x7f21900d1700 (LWP 142052)): #0 0x00007f2196d6b40a in sigwaitinfo () from /lib64/libc.so.6 #1 0x00005632805de714 in my_sigwait (set=0x7f21900d0cf0, sig=0x7f21900d0cb4, code=0x7f21900d0cb8) at /home/stepan/galera/git/10.4/server/include/my_pthread.h:196 #2 0x00005632805e4a71 in signal_hand (arg=0x0) at /home/stepan/galera/git/10.4/server/sql/mysqld.cc:3173 #3 0x00005632811c2fb3 in pfs_spawn_thread (arg=0x563283d37f70) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #4 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 30 (Thread 0x7f214b7fe700 (LWP 141983)): #0 0x00007f2198a7ae3d in nanosleep () from /lib64/libpthread.so.0 #1 0x0000563280d7207f in os_thread_sleep (tm=1000000) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0thread.cc:225 #2 0x0000563280f18b55 in btr_defragment_thread () at /home/stepan/galera/git/10.4/server/storage/innobase/btr/btr0defragment.cc:702 #3 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 29 (Thread 0x7f214bfff700 (LWP 141982)): #0 0x00007f2198a77965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563280d71d7d in os_event::wait (this=0x563283d74b80) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:159 #2 0x0000563280d71803 in os_event::wait_low (this=0x563283d74b80, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:326 #3 0x0000563280d71b74 in os_event_wait_low (event=0x563283d74b80, reset_sig_count=0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:515 #4 0x0000563280f3e19b in buf_dump_thread () at /home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0dump.cc:833 #5 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 28 (Thread 0x7f215dffb700 (LWP 141975)): #0 0x00007f2198a77965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563280d71d7d in os_event::wait (this=0x563283d74980) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:159 #2 0x0000563280d71803 in os_event::wait_low (this=0x563283d74980, reset_sig_count=263) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:326 #3 0x0000563280d71b74 in os_event_wait_low (event=0x563283d74980, reset_sig_count=0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:515 #4 0x0000563280e5df21 in srv_resume_thread (slot=0x563281dbf9b8 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:901 #5 0x0000563280e61b25 in srv_worker_thread (arg=0x0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:2483 #6 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 27 (Thread 0x7f215f7fe700 (LWP 141972)): #0 0x00007f2198a77d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563280d71698 in os_event::timed_wait (this=0x563283f149d0, abstime=0x7f215f7fdb60) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:276 #2 0x0000563280d719af in os_event::wait_time_low (this=0x563283f149d0, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:398 #3 0x0000563280d71b4f in os_event_wait_time_low (event=0x563283f149d0, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:498 #4 0x0000563280ec04c9 in ib_wqueue_timedwait (wq=0x563283f148a0, wait_in_usecs=5000000) at /home/stepan/galera/git/10.4/server/storage/innobase/ut/ut0wqueue.cc:163 #5 0x000056328100173a in fts_optimize_thread (arg=0x563283f148a0) at /home/stepan/galera/git/10.4/server/storage/innobase/fts/fts0opt.cc:2897 #6 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 26 (Thread 0x7f2169ffb700 (LWP 141970)): #0 0x00007f2198a77d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563280d71698 in os_event::timed_wait (this=0x563283d74b00, abstime=0x7f2169ffad20) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:276 #2 0x0000563280d719af in os_event::wait_time_low (this=0x563283d74b00, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:398 #3 0x0000563280d71b4f in os_event_wait_time_low (event=0x563283d74b00, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:498 #4 0x0000563280e5fc08 in srv_monitor_thread () at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:1672 #5 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 25 (Thread 0x7f21697fa700 (LWP 141968)): #0 0x00007f2198a77d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563280d71698 in os_event::timed_wait (this=0x563283f4cb70, abstime=0x7f21697f9d40) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:276 #2 0x0000563280d719af in os_event::wait_time_low (this=0x563283f4cb70, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:398 #3 0x0000563280d71b4f in os_event_wait_time_low (event=0x563283f4cb70, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:498 #4 0x0000563280d3e4f0 in lock_wait_timeout_thread () at /home/stepan/galera/git/10.4/server/storage/innobase/lock/lock0wait.cc:543 #5 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 24 (Thread 0x7f216a7fc700 (LWP 141966)): #0 0x00007f2198a77d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563280d71698 in os_event::timed_wait (this=0x563283d74c00, abstime=0x7f216a7fbaf0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:276 #2 0x0000563280d719af in os_event::wait_time_low (this=0x563283d74c00, time_in_usec=186000, reset_sig_count=2) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:398 #3 0x0000563280d71b4f in os_event_wait_time_low (event=0x563283d74c00, time_in_usec=186000, reset_sig_count=2) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:498 #4 0x0000563280f481fe in pc_sleep_if_needed (next_loop_time=1551268097013, sig_count=2, cur_time=1551268096827) at /home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0flu.cc:2637 #5 0x0000563280f49137 in buf_flush_page_cleaner_coordinator () at /home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0flu.cc:3096 #6 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 23 (Thread 0x7f216bfff700 (LWP 141963)): #0 0x00007f2198644644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x0000563280d6509a in LinuxAIOHandler::collect (this=0x7f216bffeb00) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:1915 #2 0x0000563280d655c3 in LinuxAIOHandler::poll (this=0x7f216bffeb00, m1=0x7f216bffeba8, m2=0x7f216bffebb0, request=0x7f216bffebe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2060 #3 0x0000563280d65726 in os_aio_linux_handler (global_segment=3, m1=0x7f216bffeba8, m2=0x7f216bffebb0, request=0x7f216bffebe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2114 #4 0x0000563280d6a24a in os_aio_handler (segment=3, m1=0x7f216bffeba8, m2=0x7f216bffebb0, request=0x7f216bffebe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:5665 #5 0x0000563280fbd4a6 in fil_aio_wait (segment=3) at /home/stepan/galera/git/10.4/server/storage/innobase/fil/fil0fil.cc:4370 #6 0x0000563280e63a47 in io_handler_thread (arg=0x563281ffe178 ) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0start.cc:325 #7 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 22 (Thread 0x7f2190344700 (LWP 141957)): #0 0x00007f2198a77965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563281230b7f in safe_cond_wait (cond=0x7f216c016c48, mp=0x7f216c016b98, file=0x56328139f4c0 "/home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/galera/git/10.4/server/mysys/thr_mutex.c:492 #2 0x000056328097e4ba in inline_mysql_cond_wait (that=0x7f216c016c48, mutex=0x7f216c016b98, src_file=0x56328139f7e0 "/home/stepan/galera/git/10.4/server/sql/wsrep_thd.h", src_line=69) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h:1178 #3 0x000056328098134e in Wsrep_thd_queue::pop_front (this=0x7f216c016b40) at /home/stepan/galera/git/10.4/server/sql/wsrep_thd.h:69 #4 0x00005632809800d0 in wsrep_post_rollback_process (post_rollbacker=0x7f216c000b00, arg=0x0) at /home/stepan/galera/git/10.4/server/sql/wsrep_thd.cc:288 #5 0x0000563280970587 in start_wsrep_THD (arg=0x563283c669d0) at /home/stepan/galera/git/10.4/server/sql/wsrep_mysqld.cc:2693 #6 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 21 (Thread 0x7f2198e82880 (LWP 141948)): #0 0x00007f2196e2720d in poll () from /lib64/libc.so.6 #1 0x00005632805eaf19 in handle_connections_sockets () at /home/stepan/galera/git/10.4/server/sql/mysqld.cc:6355 #2 0x00005632805ea1b4 in mysqld_main (argc=163, argv=0x563283aa6140) at /home/stepan/galera/git/10.4/server/sql/mysqld.cc:5791 #3 0x00005632805de695 in main (argc=23, argv=0x7ffd1b2c8098) at /home/stepan/galera/git/10.4/server/sql/main.cc:25 Thread 20 (Thread 0x7f2190086700 (LWP 142157)): #0 0x00007f2198a77965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563281230b7f in safe_cond_wait (cond=0x563281f824e0 , mp=0x563281f85800 , file=0x5632812fc488 "/home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h", line=1167) at /home/stepan/galera/git/10.4/server/mysys/thr_mutex.c:492 #2 0x000056328060ffe2 in inline_mysql_cond_wait (that=0x563281f824e0 , mutex=0x563281f85800 , src_file=0x5632812fcff0 "/home/stepan/galera/git/10.4/server/sql/slave.cc", src_line=519) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h:1167 #3 0x0000563280611874 in handle_slave_background (arg=0x0) at /home/stepan/galera/git/10.4/server/sql/slave.cc:519 #4 0x00005632811c2fb3 in pfs_spawn_thread (arg=0x563284076a70) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #5 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7f214a7fc700 (LWP 141985)): #0 0x00007f2198a77965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563281230b7f in safe_cond_wait (cond=0x7f214a7fbc70, mp=0x7f214a7fbcb0, file=0x563281507920 "/home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/galera/git/10.4/server/mysys/thr_mutex.c:492 #2 0x0000563280c87cad in inline_mysql_cond_wait (that=0x7f214a7fbc70, mutex=0x7f214a7fbcb0, src_file=0x563281509348 "/home/stepan/galera/git/10.4/server/storage/innobase/handler/ha_innodb.cc", src_line=294) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h:1178 #3 0x0000563280c8c79b in thd_destructor_proxy () at /home/stepan/galera/git/10.4/server/storage/innobase/handler/ha_innodb.cc:294 #4 0x00005632811c2fb3 in pfs_spawn_thread (arg=0x563283fb5840) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #5 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7f214affd700 (LWP 141984)): #0 0x00007f2198a77965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563280d71d7d in os_event::wait (this=0x563283d74c80) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:159 #2 0x0000563280d71803 in os_event::wait_low (this=0x563283d74c80, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:326 #3 0x0000563280d71b74 in os_event_wait_low (event=0x563283d74c80, reset_sig_count=0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:515 #4 0x0000563280f26cbe in buf_resize_thread () at /home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0buf.cc:3152 #5 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 17 (Thread 0x7f215cff9700 (LWP 141977)): #0 0x00007f2198a77965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563280d71d7d in os_event::wait (this=0x563283d74900) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:159 #2 0x0000563280d71803 in os_event::wait_low (this=0x563283d74900, reset_sig_count=289) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:326 #3 0x0000563280d71b74 in os_event_wait_low (event=0x563283d74900, reset_sig_count=0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:515 #4 0x0000563280e5df21 in srv_resume_thread (slot=0x563281dbf980 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:901 #5 0x0000563280e61b25 in srv_worker_thread (arg=0x0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:2483 #6 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7f215d7fa700 (LWP 141976)): #0 0x00007f2198a77965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563280d71d7d in os_event::wait (this=0x563283d74a00) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:159 #2 0x0000563280d71803 in os_event::wait_low (this=0x563283d74a00, reset_sig_count=274) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:326 #3 0x0000563280d71b74 in os_event_wait_low (event=0x563283d74a00, reset_sig_count=0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:515 #4 0x0000563280e5df21 in srv_resume_thread (slot=0x563281dbf9f0 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:901 #5 0x0000563280e61b25 in srv_worker_thread (arg=0x0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:2483 #6 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7f215effd700 (LWP 141973)): #0 0x00007f2198a7ae3d in nanosleep () from /lib64/libpthread.so.0 #1 0x0000563280d7207f in os_thread_sleep (tm=1000000) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0thread.cc:225 #2 0x0000563280e61489 in srv_master_sleep () at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:2309 #3 0x0000563280e615b9 in srv_master_thread (arg=0x0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:2350 #4 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7f215ffff700 (LWP 141971)): #0 0x00007f2198a77d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563280d71698 in os_event::timed_wait (this=0x563283f7ec30, abstime=0x7f215fffed60) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:276 #2 0x0000563280d719af in os_event::wait_time_low (this=0x563283f7ec30, time_in_usec=10000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:398 #3 0x0000563280d71b4f in os_event_wait_time_low (event=0x563283f7ec30, time_in_usec=10000000, reset_sig_count=0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:498 #4 0x0000563280fa70e7 in dict_stats_thread () at /home/stepan/galera/git/10.4/server/storage/innobase/dict/dict0stats_bg.cc:460 #5 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7f216affd700 (LWP 141965)): #0 0x00007f2198644644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x0000563280d6509a in LinuxAIOHandler::collect (this=0x7f216affcb00) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:1915 #2 0x0000563280d655c3 in LinuxAIOHandler::poll (this=0x7f216affcb00, m1=0x7f216affcba8, m2=0x7f216affcbb0, request=0x7f216affcbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2060 #3 0x0000563280d65726 in os_aio_linux_handler (global_segment=5, m1=0x7f216affcba8, m2=0x7f216affcbb0, request=0x7f216affcbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2114 #4 0x0000563280d6a24a in os_aio_handler (segment=5, m1=0x7f216affcba8, m2=0x7f216affcbb0, request=0x7f216affcbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:5665 #5 0x0000563280fbd4a6 in fil_aio_wait (segment=5) at /home/stepan/galera/git/10.4/server/storage/innobase/fil/fil0fil.cc:4370 #6 0x0000563280e63a47 in io_handler_thread (arg=0x563281ffe188 ) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0start.cc:325 #7 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7f21815c4700 (LWP 141962)): #0 0x00007f2198644644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x0000563280d6509a in LinuxAIOHandler::collect (this=0x7f21815c3b00) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:1915 #2 0x0000563280d655c3 in LinuxAIOHandler::poll (this=0x7f21815c3b00, m1=0x7f21815c3ba8, m2=0x7f21815c3bb0, request=0x7f21815c3be0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2060 #3 0x0000563280d65726 in os_aio_linux_handler (global_segment=2, m1=0x7f21815c3ba8, m2=0x7f21815c3bb0, request=0x7f21815c3be0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2114 #4 0x0000563280d6a24a in os_aio_handler (segment=2, m1=0x7f21815c3ba8, m2=0x7f21815c3bb0, request=0x7f21815c3be0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:5665 #5 0x0000563280fbd4a6 in fil_aio_wait (segment=2) at /home/stepan/galera/git/10.4/server/storage/innobase/fil/fil0fil.cc:4370 #6 0x0000563280e63a47 in io_handler_thread (arg=0x563281ffe170 ) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0start.cc:325 #7 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7f21825c6700 (LWP 141960)): #0 0x00007f2198644644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x0000563280d6509a in LinuxAIOHandler::collect (this=0x7f21825c5b00) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:1915 #2 0x0000563280d655c3 in LinuxAIOHandler::poll (this=0x7f21825c5b00, m1=0x7f21825c5ba8, m2=0x7f21825c5bb0, request=0x7f21825c5be0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2060 #3 0x0000563280d65726 in os_aio_linux_handler (global_segment=0, m1=0x7f21825c5ba8, m2=0x7f21825c5bb0, request=0x7f21825c5be0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2114 #4 0x0000563280d6a24a in os_aio_handler (segment=0, m1=0x7f21825c5ba8, m2=0x7f21825c5bb0, request=0x7f21825c5be0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:5665 #5 0x0000563280fbd4a6 in fil_aio_wait (segment=0) at /home/stepan/galera/git/10.4/server/storage/innobase/fil/fil0fil.cc:4370 #6 0x0000563280e63a47 in io_handler_thread (arg=0x563281ffe160 ) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0start.cc:325 #7 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7f21914cc700 (LWP 141950)): #0 0x00007f2198a77d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563281230e81 in safe_cond_timedwait (cond=0x5632828221c0 , mp=0x563282822100 , abstime=0x7f21914cbd70, file=0x5632816c2e90 "/home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/galera/git/10.4/server/mysys/thr_mutex.c:546 #2 0x0000563281231e3b in inline_mysql_cond_timedwait (that=0x5632828221c0 , mutex=0x563282822100 , abstime=0x7f21914cbd70, src_file=0x5632816c2ed8 "/home/stepan/galera/git/10.4/server/mysys/thr_timer.c", src_line=292) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h:1204 #3 0x000056328123299e in timer_handler (arg=0x0) at /home/stepan/galera/git/10.4/server/mysys/thr_timer.c:292 #4 0x00005632811c2fb3 in pfs_spawn_thread (arg=0x563283bedd40) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #5 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7f215e7fc700 (LWP 141974)): #0 0x00007f2198a77965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563280d71d7d in os_event::wait (this=0x563283d74880) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:159 #2 0x0000563280d71803 in os_event::wait_low (this=0x563283d74880, reset_sig_count=75) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:326 #3 0x0000563280d71b74 in os_event_wait_low (event=0x563283d74880, reset_sig_count=75) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:515 #4 0x0000563280e5df21 in srv_resume_thread (slot=0x563281dbf948 , sig_count=75, wait=true, timeout_usec=0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:901 #5 0x0000563280e61f32 in srv_purge_coordinator_suspend (slot=0x563281dbf948 , rseg_history_len=30) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:2614 #6 0x0000563280e621c8 in srv_purge_coordinator_thread (arg=0x0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:2689 #7 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7f2168ff9700 (LWP 141969)): #0 0x00007f2198a77d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563280d71698 in os_event::timed_wait (this=0x563283d74a80, abstime=0x7f2168ff8ba0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:276 #2 0x0000563280d719af in os_event::wait_time_low (this=0x563283d74a80, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:398 #3 0x0000563280d71b4f in os_event_wait_time_low (event=0x563283d74a80, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:498 #4 0x0000563280e6012a in srv_error_monitor_thread () at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:1836 #5 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7f216b7fe700 (LWP 141964)): #0 0x00007f2198644644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x0000563280d6509a in LinuxAIOHandler::collect (this=0x7f216b7fdb00) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:1915 #2 0x0000563280d655c3 in LinuxAIOHandler::poll (this=0x7f216b7fdb00, m1=0x7f216b7fdba8, m2=0x7f216b7fdbb0, request=0x7f216b7fdbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2060 #3 0x0000563280d65726 in os_aio_linux_handler (global_segment=4, m1=0x7f216b7fdba8, m2=0x7f216b7fdbb0, request=0x7f216b7fdbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2114 #4 0x0000563280d6a24a in os_aio_handler (segment=4, m1=0x7f216b7fdba8, m2=0x7f216b7fdbb0, request=0x7f216b7fdbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:5665 #5 0x0000563280fbd4a6 in fil_aio_wait (segment=4) at /home/stepan/galera/git/10.4/server/storage/innobase/fil/fil0fil.cc:4370 #6 0x0000563280e63a47 in io_handler_thread (arg=0x563281ffe180 ) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0start.cc:325 #7 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7f2181dc5700 (LWP 141961)): #0 0x00007f2198644644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x0000563280d6509a in LinuxAIOHandler::collect (this=0x7f2181dc4b00) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:1915 #2 0x0000563280d655c3 in LinuxAIOHandler::poll (this=0x7f2181dc4b00, m1=0x7f2181dc4ba8, m2=0x7f2181dc4bb0, request=0x7f2181dc4be0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2060 #3 0x0000563280d65726 in os_aio_linux_handler (global_segment=1, m1=0x7f2181dc4ba8, m2=0x7f2181dc4bb0, request=0x7f2181dc4be0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2114 #4 0x0000563280d6a24a in os_aio_handler (segment=1, m1=0x7f2181dc4ba8, m2=0x7f2181dc4bb0, request=0x7f2181dc4be0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:5665 #5 0x0000563280fbd4a6 in fil_aio_wait (segment=1) at /home/stepan/galera/git/10.4/server/storage/innobase/fil/fil0fil.cc:4370 #6 0x0000563280e63a47 in io_handler_thread (arg=0x563281ffe168 ) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0start.cc:325 #7 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7f2183e18700 (LWP 141959)): #0 0x00007f2198a77d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563281230e81 in safe_cond_timedwait (cond=0x56328280fa00 , mp=0x56328280f940 , abstime=0x7f2183e17cb0, file=0x56328167e630 "/home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/galera/git/10.4/server/mysys/thr_mutex.c:546 #2 0x000056328109a309 in inline_mysql_cond_timedwait (that=0x56328280fa00 , mutex=0x56328280f940 , abstime=0x7f2183e17cb0, src_file=0x56328167e678 "/home/stepan/galera/git/10.4/server/storage/maria/ma_servicethread.c", src_line=116) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h:1204 #3 0x000056328109a82d in my_service_thread_sleep (control=0x563281dc3d00 , sleep_time=30000000000) at /home/stepan/galera/git/10.4/server/storage/maria/ma_servicethread.c:115 #4 0x000056328108ecc6 in ma_checkpoint_background (arg=0x1e) at /home/stepan/galera/git/10.4/server/storage/maria/ma_checkpoint.c:707 #5 0x00005632811c2fb3 in pfs_spawn_thread (arg=0x563283d2c900) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #6 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7f2188189700 (LWP 142426)): #0 0x00007f2196df8e2d in nanosleep () from /lib64/libc.so.6 #1 0x00007f2196df8cc4 in sleep () from /lib64/libc.so.6 #2 0x000056328096ecbd in wsrep_close_client_connections (wait_to_end=1 '\001', except_caller_thd=0x7f2114000b00) at /home/stepan/galera/git/10.4/server/sql/wsrep_mysqld.cc:2313 #3 0x0000563280968b89 in wsrep_stop_replication (thd=0x7f2114000b00) at /home/stepan/galera/git/10.4/server/sql/wsrep_mysqld.cc:921 #4 0x000056328097a26e in wsrep_cluster_address_update (self=0x563281faad60 , thd=0x7f2114000b00, type=SHOW_OPT_GLOBAL) at /home/stepan/galera/git/10.4/server/sql/wsrep_var.cc:483 #5 0x000056328060aaa4 in sys_var::update (this=0x563281faad60 , thd=0x7f2114000b00, var=0x7f2114014300) at /home/stepan/galera/git/10.4/server/sql/set_var.cc:209 #6 0x000056328060c7d4 in set_var::update (this=0x7f2114014300, thd=0x7f2114000b00) at /home/stepan/galera/git/10.4/server/sql/set_var.cc:837 #7 0x000056328060c446 in sql_set_variables (thd=0x7f2114000b00, var_list=0x7f2114005900, free=true) at /home/stepan/galera/git/10.4/server/sql/set_var.cc:740 #8 0x000056328071ff4b in mysql_execute_command (thd=0x7f2114000b00) at /home/stepan/galera/git/10.4/server/sql/sql_parse.cc:5196 #9 0x000056328072a0f1 in mysql_parse (thd=0x7f2114000b00, rawbuf=0x7f2114014198 "SET GLOBAL wsrep_cluster_address=''", length=35, parser_state=0x7f2188188040, is_com_multi=false, is_next_command=false) at /home/stepan/galera/git/10.4/server/sql/sql_parse.cc:8157 #10 0x0000563280729720 in wsrep_mysql_parse (thd=0x7f2114000b00, rawbuf=0x7f2114014198 "SET GLOBAL wsrep_cluster_address=''", length=35, parser_state=0x7f2188188040, is_com_multi=false, is_next_command=false) at /home/stepan/galera/git/10.4/server/sql/sql_parse.cc:7969 #11 0x000056328071546d in dispatch_command (command=COM_QUERY, thd=0x7f2114000b00, packet=0x7f211400a761 "SET GLOBAL wsrep_cluster_address=''", packet_length=35, is_com_multi=false, is_next_command=false) at /home/stepan/galera/git/10.4/server/sql/sql_parse.cc:1813 #12 0x0000563280713cbb in do_command (thd=0x7f2114000b00) at /home/stepan/galera/git/10.4/server/sql/sql_parse.cc:1358 #13 0x000056328088ec9e in do_handle_one_connection (connect=0x5632840086b0) at /home/stepan/galera/git/10.4/server/sql/sql_connect.cc:1399 #14 0x000056328088e9e2 in handle_one_connection (arg=0x5632840086b0) at /home/stepan/galera/git/10.4/server/sql/sql_connect.cc:1302 #15 0x00005632811c2fb3 in pfs_spawn_thread (arg=0x563283babba0) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #16 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #17 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7f219038f700 (LWP 141956)): #0 0x00007f2198a77965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000563281230b7f in safe_cond_wait (cond=0x7f2174016b88, mp=0x7f2174016ad8, file=0x56328139f4c0 "/home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/galera/git/10.4/server/mysys/thr_mutex.c:492 #2 0x000056328097e4ba in inline_mysql_cond_wait (that=0x7f2174016b88, mutex=0x7f2174016ad8, src_file=0x56328139f7e0 "/home/stepan/galera/git/10.4/server/sql/wsrep_thd.h", src_line=69) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h:1178 #3 0x000056328098134e in Wsrep_thd_queue::pop_front (this=0x7f2174016a80) at /home/stepan/galera/git/10.4/server/sql/wsrep_thd.h:69 #4 0x000056328097fc54 in wsrep_rollback_process (rollbacker=0x7f2174001d50, arg=0x0) at /home/stepan/galera/git/10.4/server/sql/wsrep_thd.cc:145 #5 0x0000563280970587 in start_wsrep_THD (arg=0x563283c7c500) at /home/stepan/galera/git/10.4/server/sql/wsrep_mysqld.cc:2693 #6 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7f218b5fe700 (LWP 141952)): #0 0x00007f2198a77965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f2190994377 in gu::Lock::wait (cond=..., this=0x7f218b5fdbf0) at galerautils/src/gu_lock.hpp:45 #2 0x00007f2190994409 in galera::ServiceThd::thd_func (arg=0x563283c24b38) at galera/src/galera_service_thd.cpp:30 #3 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7f21881d4700 (LWP 142158)): #0 0x00007f2198a789d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x000056328122b550 in my_write_core (sig=6) at /home/stepan/galera/git/10.4/server/mysys/stacktrace.c:481 #2 0x0000563280a60ebb in handle_fatal_signal (sig=6) at /home/stepan/galera/git/10.4/server/sql/signal_handler.cc:305 #3 #4 0x00007f2196d6a207 in raise () from /lib64/libc.so.6 #5 0x00007f2196d6b8f8 in abort () from /lib64/libc.so.6 #6 0x00007f2196d63026 in __assert_fail_base () from /lib64/libc.so.6 #7 0x00007f2196d630d2 in __assert_fail () from /lib64/libc.so.6 #8 0x000056328129a981 in inline_mysql_socket_recv (src_file=0x5632818061a0 "/home/stepan/galera/git/10.4/server/vio/viosocket.c", src_line=186, mysql_socket=..., buf=0x7f211c028540, n=4, flags=64) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_socket.h:779 #9 0x000056328129b027 in vio_read (vio=0x563284105fe0, buf=0x7f211c028540 "\001", size=4) at /home/stepan/galera/git/10.4/server/vio/viosocket.c:185 #10 0x0000563280bcb176 in my_real_read (net=0x7f211c000df8, complen=0x7f21881d3810, header=1 '\001') at /home/stepan/galera/git/10.4/server/sql/net_serv.cc:962 #11 0x0000563280bcb9fd in my_net_read_packet_reallen (net=0x7f211c000df8, read_from_server=1 '\001', reallen=0x7f21881d3878) at /home/stepan/galera/git/10.4/server/sql/net_serv.cc:1243 #12 0x0000563280bcb9b0 in my_net_read_packet (net=0x7f211c000df8, read_from_server=1 '\001') at /home/stepan/galera/git/10.4/server/sql/net_serv.cc:1227 #13 0x00005632807135f3 in do_command (thd=0x7f211c000b00) at /home/stepan/galera/git/10.4/server/sql/sql_parse.cc:1231 #14 0x000056328088ec9e in do_handle_one_connection (connect=0x5632840d6be0) at /home/stepan/galera/git/10.4/server/sql/sql_connect.cc:1399 #15 0x000056328088e9e2 in handle_one_connection (arg=0x5632840d6be0) at /home/stepan/galera/git/10.4/server/sql/sql_connect.cc:1302 #16 0x00005632811c2fb3 in pfs_spawn_thread (arg=0x56328410a200) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #17 0x00007f2198a73dd5 in start_thread () from /lib64/libpthread.so.0 #18 0x00007f2196e31ead in clone () from /lib64/libc.so.6 Compressed file /home/stepan/galera/git/10.4/server/mysql-test/var/4/log/galera.galera_var_slave_threads-innodb/mysqld.1/data/core.141948 - saving '/home/stepan/galera/git/10.4/server/mysql-test/var/4/log/galera.galera_var_slave_threads-innodb/' to '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera.galera_var_slave_threads-innodb/' ***Warnings generated in error logs during shutdown after running tests: galera.galera_var_slave_threads mysqld: /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_socket.h:779: inline_mysql_socket_recv: Assertion `mysql_socket.fd != -1' failed. Attempting backtrace. You can use the following information to find out galera.mdev_10518 'innodb' w4 [ pass ] 7187 galera.galera_wan_restart_ist 'innodb' w2 [ pass ] 91016 galera.versioning_trx_id 'innodb' w2 [ pass ] 6036 galera.galera_wan_restart_sst 'innodb' w1 [ pass ] 80677 galera.GAL-382 'innodb' w2 [ pass ] 5720 galera.GAL-401 'innodb' w1 [ pass ] 24507 galera.GAL-480 'innodb' w2 [ pass ] 19943 galera.GCF-939 'innodb' w1 [ pass ] 5078 galera.mysql-wsrep#33 'innodb' w4 [ pass ] 69363 galera.MW-258 'innodb' w1 [ pass ] 13033 galera.MW-285 'innodb' w1 [ pass ] 15698 galera.rpl_row_annotate 'innodb' w4 [ pass ] 6113 galera.MW-286 'innodb' w1 [ pass ] 7227 galera.MW-309 'innodb' w1 [ pass ] 4927 galera.MW-252 'innodb' w2 [ pass ] 49107 galera.MW-328D 'innodb' w1 [ pass ] 8039 galera.MW-328E 'innodb' w2 [ pass ] 10739 galera.MW-357 'innodb' w1 [ pass ] 5933 galera.MW-259 'innodb' w4 [ pass ] 6600 galera.galera_wsrep_desync_wsrep_on 'innodb' w3 [ pass ] 224514 galera.MW-292 'innodb' w4 [ pass ] 14808 galera.binlog_checksum 'innodb' w3 [ pass ] 5705 galera.basic 'innodb' w4 [ pass ] 5835 galera.enforce_storage_engine 'innodb' w3 [ pass ] 6858 galera.MW-402 'innodb' w1 [ pass ] 53601 galera.fk 'innodb' w3 [ pass ] 22249 galera.MW-369 'innodb' w2 [ pass ] 59343 galera.galera#505 'innodb' w3 [ pass ] 2138 galera.create 'innodb' w4 [ pass ] 31057 galera.galera#500 'innodb' w1 [ pass ] 23845 galera.galera_alter_engine_myisam 'innodb' w1 [ pass ] 8391 galera.galera_alter_table_force 'innodb' w1 [ pass ] 11410 galera.galera_admin 'innodb' w3 [ pass ] 44651 galera.ev51914 'innodb' w4 [ pass ] 43939 galera.galera_applier_ftwrl_table 'innodb' w1 [ pass ] 7569 galera.galera_bf_abort 'innodb' w3 [ pass ] 6601 galera.galera_bf_abort_for_update 'innodb' w1 [ pass ] 7033 galera.galera_alter_engine_innodb 'innodb' w4 [ pass ] 8813 galera.galera_bf_abort_ftwrl 'innodb' w3 [ pass ] 5347 galera.galera_bf_abort_get_lock 'innodb' w1 [ pass ] 8235 galera.galera_bf_abort_flush_for_export 'innodb' w4 [ pass ] 6955 galera.galera_bf_abort_sleep 'innodb' w1 [ pass ] 4775 galera.galera_bf_abort_lock_table 'innodb' w4 [ pass ] 5553 galera.galera_binlog_cache_size 'innodb' w4 [ pass ] 9964 galera.galera_commit_empty 'innodb' w4 [ pass ] 2121 galera.galera_bf_abort_shutdown 'innodb' w3 [ pass ] 27350 galera.galera_create_function 'innodb' w4 [ pass ] 6496 galera.galera_binlog_row_image 'innodb' w1 [ pass ] 22549 galera.galera_create_procedure 'innodb' w4 [ pass ] 10296 galera.galera_FK_duplicate_client_insert 'innodb' w2 [ pass ] 117066 galera.galera_create_table_as_select 'innodb' w3 [ pass ] 40218 -------------------------------------------------------------------------- The servers were restarted 80 times Spent 8687.477 of 2923 seconds executing testcases Completed: Failed 2/251 tests, 99.20% were successful. Failing test(s): galera.galera_gcache_recover_full_gcache galera.galera_var_slave_threads The log files in var/log may give you some hint of what went wrong. If you want to report this error, please read first the documentation at http://dev.mysql.com/doc/mysql/en/mysql-test-suite.html Errors/warnings were found in logfiles during server shutdown after running the following sequence(s) of tests: galera.galera_var_slave_threads mysql-test-run: *** ERROR: there were failing test cases