Checking supported features... MariaDB Version 10.4.12-MariaDB-debug - SSL connections supported - binaries are debug compiled - binaries built with wsrep patch Using suites: galera_sr,galera,galera_3nodes,wsrep Collecting tests... Installing system database... worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 16000..16019 ============================================================================== TEST RESULT TIME (ms) or COMMENT -------------------------------------------------------------------------- 191221 22:36:42 +14.017 galera.GCF-1081 [ disabled ] MDEV-18283 Galera test failure on galera.GCF-1081 191221 22:36:42 +0.000 galera.MW-286 [ disabled ] MDEV-18464 Killing thread can cause mutex deadlock if done concurrently with Galera/replication victim kill 191221 22:36:42 +0.000 galera.MW-329 [ disabled ] MDEV-19962 Galera test failure on MW-329 191221 22:36:42 +0.000 galera.MW-360 [ disabled ] needs rewrite to be MariaDB gtid compatible 191221 22:36:42 +0.000 galera.MW-388 [ disabled ] MDEV-19803 Long semaphore wait error on galera.MW-388 191221 22:36:42 +0.000 galera.galera_account_management [ disabled ] MariaDB 10.0 does not support ALTER USER 191221 22:36:42 +0.000 galera.galera_as_master_gtid [ disabled ] Requires MySQL GTID 191221 22:36:42 +0.000 galera.galera_as_master_gtid_change_master [ disabled ] Requires MySQL GTID 191221 22:36:42 +0.000 galera.galera_as_slave_gtid_replicate_do_db_cc [ disabled ] Requires MySQL GTID 191221 22:36:42 +0.000 galera.galera_as_slave_preordered [ disabled ] wsrep-preordered feature not merged to MariaDB 191221 22:36:42 +0.000 galera.galera_as_slave_replication_bundle [ disabled ] MDEV-15785 OPTION_GTID_BEGIN is set in Gtid_log_event::do_apply_event() 191221 22:36:42 +0.000 galera.galera_autoinc_sst_mariabackup [ disabled ] Known issue, may require porting MDEV-17458 from later versions 191221 22:36:42 +0.000 galera.galera_bf_abort_group_commit [ disabled ] MDEV-18282 Galera test failure on galera.galera_bf_abort_group_commit 191221 22:36:42 +0.000 galera.galera_binlog_rows_query_log_events [ disabled ] MariaDB does not support binlog_rows_query_log_events 191221 22:36:42 +0.000 galera.galera_binlog_stmt_autoinc [ disabled ] MDEV-19959 Galera test failure on galera_binlog_stmt_autoinc 191221 22:36:42 +0.000 galera.galera_concurrent_ctas [ disabled ] MDEV-18180 Galera test failure on galera.galera_concurrent_ctas 191221 22:36:42 +0.000 galera.galera_encrypt_tmp_files [ disabled ] Get error failed to enable encryption of temporary files 191221 22:36:42 +0.000 galera.galera_flush [ disabled ] MariaDB does not have global.thread_statistics 191221 22:36:42 +0.000 galera.galera_gcache_recover_manytrx [ disabled ] MDEV-18834 Galera test failure 191221 22:36:42 +0.000 galera.galera_ist_mariabackup [ disabled ] MDEV-18829 test leaves port open 191221 22:36:42 +0.000 galera.galera_ist_progress [ disabled ] MDEV-15236 fails when trying to read transfer status 191221 22:36:42 +0.000 galera.galera_kill_largechanges [ disabled ] MDEV-18179 Galera test failure on galera.galera_kill_largechanges 191221 22:36:42 +0.000 galera.galera_kill_nochanges [ disabled ] MDEV-18280 Galera test failure on galera_split_brain and galera_kill_nochanges 191221 22:36:42 +0.000 galera.galera_many_tables_nopk [ disabled ] MDEV-18182 Galera test failure on galera.galera_many_tables_nopk 191221 22:36:42 +0.000 galera.galera_migrate [ disabled ] MariaDB does not support START SLAVE USER 191221 22:36:42 +0.000 galera.galera_partition [ disabled ] MDEV-21189 test timeout 191221 22:36:42 +0.000 galera.galera_split_brain [ disabled ] MDEV-18280 Galera test failure on galera_split_brain and galera_kill_nochanges 191221 22:36:42 +0.000 galera.galera_ssl_upgrade [ disabled ] MDEV-19950 Galera test failure on galera_ssl_upgrade 191221 22:36:42 +0.000 galera.galera_var_node_address [ disabled ] MDEV-20485 Galera test failure 191221 22:36:42 +0.000 galera.galera_var_notify_cmd [ disabled ] MDEV-20600 Galera test galera_var_notify_cmd causes hang 191221 22:36:42 +0.000 galera.galera_var_reject_queries [ disabled ] assertion in inline_mysql_socket_send 191221 22:36:42 +0.000 galera.galera_var_retry_autocommit [ disabled ] MDEV-18181 Galera test failure on galera.galera_var_retry_autocommit 191221 22:36:42 +0.000 galera.galera_wan [ disabled ] MDEV-17259 Test failure on galera.galera_wan 191221 22:36:42 +0.000 galera.mysql-wsrep#198 [ disabled ] MDEV-18935 Galera test mysql-wsrep#198 sporaric assertion transaction.cpp:362: int wsrep::transaction::before_commit(): Assertion `state() == s_executing || state() == s_committing || state() == s_must_abort || state() == s_replaying' failed. 191221 22:36:42 +0.000 galera.partition [ disabled ] MDEV-19958 Galera test failure on galera.partition 191221 22:36:42 +0.000 galera.query_cache [ disabled ] MDEV-15805 Test failure on galera.query_cache 191221 22:36:42 +0.000 galera_3nodes.galera_slave_options_do [ disabled ] MDEV-8798 191221 22:36:42 +0.000 galera_3nodes.galera_slave_options_ignore [ disabled ] MDEV-8798 191221 22:36:42 +0.000 galera_sr.GCF-1043A [ disabled ] MDEV-21170 Galera test failure on galera_sr.GCF-1043A 191221 22:36:42 +0.000 galera_sr.GCF-437 [ disabled ] test relies on InnoDB redo log size limitation 191221 22:36:42 +0.000 galera_sr.galera_sr_table_contents [ disabled ] missing file 191221 22:36:42 +0.000 wsrep.variables [ disabled ] MDEV-20581 Crash on wsrep.variables test case 191221 22:36:42 +0.000 galera_3nodes.galera_garbd 'innodb' [ skipped ] Need garbd 191221 22:36:49 +7.636 galera.MW-86-wait1 'innodb' [ pass ] 2100 191221 22:37:07 +17.787 galera.galera_log_output_csv 'innodb' [ pass ] 2097 191221 22:37:25 +17.883 galera.galera_forced_binlog_format 'innodb' [ pass ] 2208 191221 22:37:44 +18.758 galera.galera_var_innodb_disallow_writes 'innodb' [ pass ] 3078 191221 22:37:49 +5.373 galera.mdev_18730 'innodb' [ pass ] 5101 191221 22:38:07 +17.774 galera.MW-44 'innodb' [ pass ] 2088 191221 22:38:25 +18.567 galera.galera_sync_wait_upto 'innodb' [ pass ] 4097 191221 22:38:53 +27.951 galera.GAL-419 'innodb' [ pass ] 12213 191221 22:39:12 +18.560 galera.MW-328A 'innodb' [ pass ] 18242 191221 22:39:31 +19.362 galera.MW-328B 'innodb' [ pass ] 18947 191221 22:41:14 +102.808 galera.galera_bf_lock_wait 'innodb' [ pass ] 102318 191221 22:41:29 +14.863 galera.galera_fulltext 'innodb' [ pass ] 14450 191221 22:41:32 +3.289 galera.galera_many_columns 'innodb' [ pass ] 2943 191221 22:41:49 +17.263 galera.galera_many_tables_pk 'innodb' [ pass ] 16845 191221 22:42:06 +16.277 galera.galera_parallel_autoinc_largetrx 'innodb' [ fail ] Test ended at 2019-12-21 22:42:06 CURRENT_TEST: galera.galera_parallel_autoinc_largetrx --- /home/stepan/mariadb/10.4/git/mysql-test/suite/galera/r/galera_parallel_autoinc_largetrx.result 2019-08-21 19:11:10.820245673 +0300 +++ /home/stepan/mariadb/10.4/git/mysql-test/suite/galera/r/galera_parallel_autoinc_largetrx.reject 2019-12-21 22:42:05.959058298 +0200 @@ -16,7 +16,7 @@ connection node_1; SELECT COUNT(*) FROM t1; COUNT(*) -30000 +20000 SELECT COUNT(DISTINCT f1) FROM t1; COUNT(DISTINCT f1) 30000 mysqltest: Result content mismatch - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_parallel_autoinc_largetrx-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_parallel_autoinc_largetrx-innodb/' 191221 22:42:53 +47.313 galera.galera_parallel_autoinc_manytrx 'innodb' [ pass ] 31483 191221 22:43:12 +18.922 galera.galera_pc_recovery 'innodb' [ pass ] 13271 191221 22:44:39 +87.155 galera.galera_rsu_add_pk 'innodb' [ pass ] 71143 191221 22:46:49 +130.234 galera.galera_rsu_drop_pk 'innodb' [ pass ] 129792 191221 22:47:11 +21.644 galera.galera_tworker[1] Test still running: galera.galera_gcs_fc_limit worker[1] Test still running: galera.galera_gcs_fc_limit worker[1] Test still running: galera.galera_gcs_fc_limit worker[1] Test still running: galera.galera_gcs_fc_limit worker[1] Test still running: galera.galera_gcs_fc_limit worker[1] Trying to dump core for [mysqltest - pid: 2712, winpid: 2712] worker[1] Trying to dump core for [mysqld.1 - pid: 5377, winpid: 5377] worker[1] Trying to dump core for [mysqld.2 - pid: 486, winpid: 486] oi_ddl_error 'innodb' [ pass ] 21191 191221 22:47:30 +19.293 galera.galera_toi_ddl_fk_insert 'innodb' [ pass ] 18786 191221 22:47:45 +15.114 galera.galera_toi_ddl_fk_update 'innodb' [ pass ] 14770 191221 22:47:57 +11.377 galera.galera_var_load_data_splitting 'innodb' [ pass ] 11006 191221 22:48:57 +60.394 galera.galera_wsrep_desync_wsrep_on 'innodb' [ pass ] 59947 191221 22:49:00 +2.559 galera.GAL-382 'innodb' [ pass ] 2244 191221 22:49:18 +17.990 galera.GAL-401 'innodb' [ pass ] 17592 191221 22:49:21 +3.039 galera.GAL-480 'innodb' [ pass ] 2812 191221 22:49:23 +2.416 galera.GCF-939 'innodb' [ pass ] 2152 191221 22:49:28 +4.400 galera.MDEV-16509 'innodb' [ pass ] 4128 191221 22:49:32 +4.563 galera.MDEV-20225 'innodb' [ pass ] 4257 191221 22:49:36 +3.850 galera.MW-252 'innodb' [ pass ] 3575 191221 22:49:47 +10.531 galera.MW-258 'innodb' [ pass ] 10158 191221 22:49:51 +4.473 galera.MW-259 'innodb' [ pass ] 4227 191221 22:49:54 +2.616 galera.MW-285 'innodb' [ pass ] 2368 191221 22:49:59 +5.667 galera.MW-292 'innodb' [ pass ] 5384 191221 22:50:02 +2.432 galera.MW-309 'innodb' [ pass ] 2155 191221 22:50:06 +4.489 galera.MW-328D 'innodb' [ pass ] 4172 191221 22:50:11 +4.476 galera.MW-328E 'innodb' [ pass ] 4188 191221 22:50:13 +2.332 galera.MW-357 'innodb' [ pass ] 2091 191221 22:50:17 +3.770 galera.MW-369 'innodb' [ pass ] 3520 191221 22:50:20 +3.694 galera.MW-402 'innodb' [ pass ] 3401 191221 22:50:23 +2.337 galera.MW-416 'innodb' [ pass ] 2091 191221 22:50:25 +2.414 galera.basic 'innodb' [ pass ] 2136 191221 22:50:28 +2.401 galera.binlog_checksum 'innodb' [ pass ] 2147 191221 22:50:31 +3.045 galera.create 'innodb' [ pass ] 2781 191221 22:50:33 +2.407 galera.enforce_storage_engine 'innodb' [ pass ] 2135 191221 22:50:36 +3.043 galera.ev51914 'innodb' [ pass ] 2797 191221 22:50:39 +2.836 galera.fk 'innodb' [ pass ] 2459 191221 22:50:58 +18.677 galera.galera#500 'innodb' [ pass ] 18381 191221 22:51:00 +2.285 galera.galera#505 'innodb' [ pass ] 2020 191221 22:51:04 +3.865 galera.galera_FK_duplicate_client_insert 'innodb' [ pass ] 3563 191221 22:51:10 +5.991 galera.galera_admin 'innodb' [ pass ] 5714 191221 22:51:12 +2.398 galera.galera_alter_engine_innodb 'innodb' [ pass ] 2138 191221 22:51:15 +2.398 galera.galera_alter_engine_myisam 'innodb' [ pass ] 2111 191221 22:51:17 +2.414 galera.galera_alter_table_force 'innodb' [ pass ] 2150 191221 22:51:19 +2.329 galera.galera_applier_ftwrl_table 'innodb' [ pass ] 2101 191221 22:51:22 +2.344 galera.galera_bf_abort 'innodb' [ pass ] 2082 191221 22:51:24 +2.339 galera.galera_bf_abort_at_after_statement 'innodb' [ pass ] 2087 191221 22:51:26 +2.402 galera.galera_bf_abort_flush_for_export 'innodb' [ pass ] 2133 191221 22:51:29 +2.331 galera.galera_bf_abort_for_update 'innodb' [ pass ] 2086 191221 22:51:31 +2.367 galera.galera_bf_abort_ftwrl 'innodb' [ pass ] 2078 191221 22:51:34 +3.362 galera.galera_bf_abort_get_lock 'innodb' [ pass ] 3078 191221 22:51:37 +2.349 galera.galera_bf_abort_lock_table 'innodb' [ pass ] 2079 191221 22:51:46 +9.623 galera.galera_bf_abort_shutdown 'innodb' [ pass ] 9317 191221 22:51:49 +2.345 galera.galera_bf_abort_sleep 'innodb' [ pass ] 2078 191221 22:51:52 +3.441 galera.galera_binlog_cache_size 'innodb' [ pass ] 3147 191221 22:51:55 +2.618 galera.galera_binlog_row_image 'innodb' [ pass ] 2355 191221 22:51:57 +2.335 galera.galera_change_user 'innodb' [ pass ] 2096 191221 22:51:59 +2.272 galera.galera_commit_empty 'innodb' [ pass ] 2025 191221 22:52:02 +2.358 galera.galera_create_function 'innodb' [ pass ] 2107 191221 22:52:04 +2.408 galera.galera_create_procedure 'innodb' [ pass ] 2169 191221 22:52:07 +3.050 galera.galera_create_table_as_select 'innodb' [ pass ] 2802 191221 22:52:10 +2.549 galera.galera_create_table_like 'innodb' [ pass ] 2281 191221 22:52:12 +2.619 galera.galera_create_trigger 'innodb' [ pass ] 2319 191221 22:52:15 +2.617 galera.galera_ddl_multiline 'innodb' [ pass ] 2366 191221 22:52:17 +2.282 galera.galera_defaults 'innodb' [ pass ] 2035 191221 22:52:20 +2.475 galera.galera_delete_limit 'innodb' [ pass ] 2202 191221 22:52:24 +3.835 galera.galera_desync_overlapped 'innodb' [ pass ] 3442 191221 22:52:37 +13.659 galera.galera_drop_database 'innodb' [ pass ] 13335 191221 22:52:40 +2.411 galera.galera_drop_multi 'innodb' [ pass ] 2135 191221 22:52:42 +2.413 galera.galera_enum 'innodb' [ pass ] 2157 191221 22:52:45 +3.351 galera.galera_events 'innodb' [ pass ] 3067 191221 22:53:03 +17.388 galera.galera_events2 'innodb' [ pass ] 17064 191221 22:53:05 +2.481 galera.galera_fk_cascade_delete 'innodb' [ pass ] 2189 191221 22:53:08 +2.482 galera.galera_fk_cascade_update 'innodb' [ pass ] 2194 191221 22:53:10 +2.397 galera.galera_fk_conflict 'innodb' [ pass ] 2132 191221 22:53:13 +2.412 galera.galera_fk_mismatch 'innodb' [ pass ] 2154 191221 22:53:15 +2.484 galera.galera_fk_multicolumn 'innodb' [ pass ] 2183 191221 22:53:17 +2.397 galera.galera_fk_multitable 'innodb' [ pass ] 2134 191221 22:53:20 +2.405 galera.galera_fk_no_pk 'innodb' [ pass ] 2169 191221 22:53:22 +2.347 galera.galera_fk_selfreferential 'innodb' [ pass ] 2081 191221 22:53:25 +2.409 galera.galera_fk_setnull 'innodb' [ pass ] 2142 191221 22:53:29 +4.408 galera.galera_ftwrl 'innodb' [ pass ] 4089 191221 22:53:33 +4.433 galera.galera_ftwrl_drain 'innodb' [ pass ] 4122 191222 0:54:31 +7257.099 galera.galera_gcs_fc_limit 'innodb' [ fail ] timeout after 7200 seconds Test ended at 2019-12-22 00:54:31 Test case timeout after 7200 seconds == /home/stepan/mariadb/10.4/git/mysql-test/var/log/galera_gcs_fc_limit.log == connection node_2; connection node_1; CREATE TABLE t1 (f1 INTEGER NOT NULL PRIMARY KEY AUTO_INCREMENT,B INTEGER) ENGINE=InnoDB; INSERT INTO t1 VALUES (1,1); connection node_2; SET SESSION wsrep_sync_wait=15; SELECT COUNT(*) FROM t1; COUNT(*) 1 SET GLOBAL wsrep_provider_options = 'gcs.fc_limit=1'; LOCK TABLE t1 WRITE; connection node_1; FLUSH STATUS; INSERT INTO t1 VALUES (2,2); INSERT INTO t1 VALUES (3,3); INSERT INTO t1 VALUES (4,4); == /home/stepan/mariadb/10.4/git/mysql-test/var/tmp/analyze-timeout-mysqld.1.err == mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' (111) == /home/stepan/mariadb/10.4/git/mysql-test/var/tmp/analyze-timeout-mysqld.2.err == mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2.sock' (111) - found 'core.5378' (0/5) Trying 'dbx' to get a backtrace Trying 'gdb' to get a backtrace from coredump /home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_gcs_fc_limit-innodb/mysqld.1/data/core.5378 Core generated by '/home/stepan/mariadb/10.4/git/sql/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- [New LWP 5378] [New LWP 5382] [New LWP 5384] [New LWP 5387] [New LWP 5388] [New LWP 5391] [New LWP 5396] [New LWP 5397] [New LWP 5400] [New LWP 5406] [New LWP 5408] [New LWP 5379] [New LWP 5380] [New LWP 5385] [New LWP 5389] [New LWP 5395] [New LWP 5399] [New LWP 5402] [New LWP 5403] [New LWP 5407] [New LWP 5405] [New LWP 5394] [New LWP 14830] [New LWP 5412] [New LWP 5401] [New LWP 5398] [New LWP 5392] [New LWP 5390] [New LWP 5411] [New LWP 5404] [New LWP 5386] [New LWP 5383] [New LWP 5381] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `/home/stepan/mariadb/10.4/git/sql/mysqld --defaults-group-suffix=.1 --defaults-'. Program terminated with signal 6, Aborted. #0 0x00007f83f8d499d1 in pthread_kill () from /lib64/libpthread.so.0 #0 0x00007f83f8d499d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x00005643e7b380b2 in my_write_core (sig=6) at /home/stepan/mariadb/10.4/git/mysys/stacktrace.c:481 #2 0x00005643e72a419c in handle_fatal_signal (sig=6) at /home/stepan/mariadb/10.4/git/sql/signal_handler.cc:343 #3 #4 0x00007f83f70f720d in poll () from /lib64/libc.so.6 #5 0x00005643e6e0584a in handle_connections_sockets () at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:6456 #6 0x00005643e6e04ae5 in mysqld_main (argc=163, argv=0x5643eb038380) at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:5892 #7 0x00005643e6df8615 in main (argc=24, argv=0x7fffa41a9f38) at /home/stepan/mariadb/10.4/git/sql/main.cc:25 Thread 33 (Thread 0x7f83e997b700 (LWP 5381)): #0 0x00007f83f7102483 in epoll_wait () from /lib64/libc.so.6 #1 0x00007f83f0c445c8 in asio::detail::epoll_reactor::run (this=0x5643eb1d5a50, block=block@entry=true, ops=...) at asio/asio/detail/impl/epoll_reactor.ipp:391 #2 0x00007f83f0c48cc0 in asio::detail::task_io_service::do_run_one (this=this@entry=0x5643eb1d58f0, lock=..., this_thread=..., ec=...) at asio/asio/detail/impl/task_io_service.ipp:355 #3 0x00007f83f0c48f72 in asio::detail::task_io_service::run (this=0x5643eb1d58f0, ec=...) at asio/asio/detail/impl/task_io_service.ipp:148 #4 0x00007f83f0c609fd in asio::io_service::run (this=0x5643eb1d5600) at asio/asio/impl/io_service.ipp:58 #5 0x00007f83f0c61151 in gcomm::AsioProtonet::event_loop (this=0x5643eb1d5560, period=...) at gcomm/src/asio_protonet.cpp:116 #6 0x00007f83f0c8001d in GCommConn::run (this=0x5643eb1d4f50) at gcs/src/gcs_gcomm.cpp:498 #7 0x00007f83f0c830c9 in GCommConn::run_fn (arg=) at gcs/src/gcs_gcomm.cpp:209 #8 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #9 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 32 (Thread 0x7f83e8979700 (LWP 5383)): #0 0x00007f83f8d48965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e7b3d725 in safe_cond_wait (cond=0x7f83e00147b8, mp=0x7f83e0014708, file=0x5643e7cbbd40 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:492 #2 0x00005643e71c48a4 in inline_mysql_cond_wait (that=0x7f83e00147b8, mutex=0x7f83e0014708, src_file=0x5643e7cbbf50 "/home/stepan/mariadb/10.4/git/sql/wsrep_thd.h", src_line=69) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1178 #3 0x00005643e71c7776 in Wsrep_thd_queue::pop_front (this=0x7f83e00146b0) at /home/stepan/mariadb/10.4/git/sql/wsrep_thd.h:69 #4 0x00005643e71c6194 in wsrep_rollback_process (rollbacker=0x7f83e0001d40, arg=0x5643eb1ee8d0) at /home/stepan/mariadb/10.4/git/sql/wsrep_thd.cc:228 #5 0x00005643e71b54ee in start_wsrep_THD (arg=0x5643eb1ee8d0) at /home/stepan/mariadb/10.4/git/sql/wsrep_mysqld.cc:2723 #6 0x00005643e7ac600b in pfs_spawn_thread (arg=0x5643eb1ed4f0) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #7 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 31 (Thread 0x7f83d253a700 (LWP 5386)): #0 0x00007f83f8915644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x00005643e75e5661 in LinuxAIOHandler::collect (this=0x7f83d2539b00) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1813 #2 0x00005643e75e5d48 in LinuxAIOHandler::poll (this=0x7f83d2539b00, m1=0x7f83d2539ba8, m2=0x7f83d2539bb0, request=0x7f83d2539be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1974 #3 0x00005643e75e5eab in os_aio_linux_handler (global_segment=0, m1=0x7f83d2539ba8, m2=0x7f83d2539bb0, request=0x7f83d2539be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:2028 #4 0x00005643e75eafe2 in os_aio_handler (segment=0, m1=0x7f83d2539ba8, m2=0x7f83d2539bb0, request=0x7f83d2539be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:5598 #5 0x00005643e78a0d77 in fil_aio_wait (segment=0) at /home/stepan/mariadb/10.4/git/storage/innobase/fil/fil0fil.cc:4357 #6 0x00005643e7713e1a in io_handler_thread (arg=0x5643e896f940 ) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0start.cc:324 #7 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 30 (Thread 0x7f83c0ff9700 (LWP 5404)): #0 0x00007f83f8d48965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e75f4dc7 in os_event::wait (this=0x5643eb2dd330) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:158 #2 0x00005643e75f48bb in os_event::wait_low (this=0x5643eb2dd330, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:325 #3 0x00005643e75f4bbe in os_event_wait_low (event=0x5643eb2dd330, reset_sig_count=0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:502 #4 0x00005643e7812ac9 in buf_dump_thread () at /home/stepan/mariadb/10.4/git/storage/innobase/buf/buf0dump.cc:833 #5 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 29 (Thread 0x7f83d26ef700 (LWP 5411)): #0 0x00007f83f8d48965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e7b3d725 in safe_cond_wait (cond=0x5643e88f1020 , mp=0x5643e88f42a0 , file=0x5643e7c0da20 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1167) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:492 #2 0x00005643e6e2b5f6 in inline_mysql_cond_wait (that=0x5643e88f1020 , mutex=0x5643e88f42a0 , src_file=0x5643e7c0e560 "/home/stepan/mariadb/10.4/git/sql/slave.cc", src_line=522) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1167 #3 0x00005643e6e2cf3e in handle_slave_background (arg=0x0) at /home/stepan/mariadb/10.4/git/sql/slave.cc:522 #4 0x00005643e7ac600b in pfs_spawn_thread (arg=0x5643eb6d8670) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #5 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 28 (Thread 0x7f83cbfff700 (LWP 5390)): #0 0x00007f83f8915644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x00005643e75e5661 in LinuxAIOHandler::collect (this=0x7f83cbffeb00) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1813 #2 0x00005643e75e5d48 in LinuxAIOHandler::poll (this=0x7f83cbffeb00, m1=0x7f83cbffeba8, m2=0x7f83cbffebb0, request=0x7f83cbffebe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1974 #3 0x00005643e75e5eab in os_aio_linux_handler (global_segment=4, m1=0x7f83cbffeba8, m2=0x7f83cbffebb0, request=0x7f83cbffebe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:2028 #4 0x00005643e75eafe2 in os_aio_handler (segment=4, m1=0x7f83cbffeba8, m2=0x7f83cbffebb0, request=0x7f83cbffebe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:5598 #5 0x00005643e78a0d77 in fil_aio_wait (segment=4) at /home/stepan/mariadb/10.4/git/storage/innobase/fil/fil0fil.cc:4357 #6 0x00005643e7713e1a in io_handler_thread (arg=0x5643e896f960 ) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0start.cc:324 #7 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 27 (Thread 0x7f83caffd700 (LWP 5392)): #0 0x00007f83f8d48d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e75f4750 in os_event::timed_wait (this=0x5643eb2dd3b0, abstime=0x7f83caffcb00) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:275 #2 0x00005643e75f49f9 in os_event::wait_time_low (this=0x5643eb2dd3b0, time_in_usec=999000, reset_sig_count=753) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:385 #3 0x00005643e75f4b99 in os_event_wait_time_low (event=0x5643eb2dd3b0, time_in_usec=999000, reset_sig_count=753) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:485 #4 0x00005643e781ef9a in pc_sleep_if_needed (next_loop_time=208189716, sig_count=753, cur_time=208188717) at /home/stepan/mariadb/10.4/git/storage/innobase/buf/buf0flu.cc:2643 #5 0x00005643e782013e in buf_flush_page_cleaner_coordinator () at /home/stepan/mariadb/10.4/git/storage/innobase/buf/buf0flu.cc:3102 #6 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 26 (Thread 0x7f83c3fff700 (LWP 5398)): #0 0x00007f83f8d48d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e75f4750 in os_event::timed_wait (this=0x5643eb479370, abstime=0x7f83c3ffeb70) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:275 #2 0x00005643e75f49f9 in os_event::wait_time_low (this=0x5643eb479370, time_in_usec=5000000, reset_sig_count=7) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:385 #3 0x00005643e75f4b99 in os_event_wait_time_low (event=0x5643eb479370, time_in_usec=5000000, reset_sig_count=7) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:485 #4 0x00005643e777d6b6 in ib_wqueue_timedwait (wq=0x5643eb472930, wait_in_usecs=5000000) at /home/stepan/mariadb/10.4/git/storage/innobase/ut/ut0wqueue.cc:156 #5 0x00005643e78ee8b4 in fts_optimize_thread (arg=0x5643eb472930) at /home/stepan/mariadb/10.4/git/storage/innobase/fts/fts0opt.cc:2836 #6 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 25 (Thread 0x7f83c27fc700 (LWP 5401)): #0 0x00007f83f8d48965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e75f4dc7 in os_event::wait (this=0x5643eb2dd130) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:158 #2 0x00005643e75f48bb in os_event::wait_low (this=0x5643eb2dd130, reset_sig_count=3161) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:325 #3 0x00005643e75f4bbe in os_event_wait_low (event=0x5643eb2dd130, reset_sig_count=0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:502 #4 0x00005643e770d300 in srv_resume_thread (slot=0x5643e872bdd0 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:909 #5 0x00005643e77115c1 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 24 (Thread 0x7f83d26a4700 (LWP 5412)): #0 0x00007f83f8d48d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e7b3da27 in safe_cond_timedwait (cond=0x5643e88f0fe0 , mp=0x5643e88f39a0 , abstime=0x7f83d26a3c60, file=0x5643e7bfd708 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:546 #2 0x00005643e6df8f95 in inline_mysql_cond_timedwait (that=0x5643e88f0fe0 , mutex=0x5643e88f39a0 , abstime=0x7f83d26a3c60, src_file=0x5643e7bff738 "/home/stepan/mariadb/10.4/git/sql/mysqld.cc", src_line=2688) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1204 #3 0x00005643e6dfe0ac in cache_thread (thd=0x7f8384000af0) at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:2687 #4 0x00005643e6dfe352 in one_thread_per_connection_end (thd=0x7f8384000af0, put_in_cache=true) at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:2773 #5 0x00005643e70c5add in do_handle_one_connection (connect=0x5643eb6e7440) at /home/stepan/mariadb/10.4/git/sql/sql_connect.cc:1423 #6 0x00005643e70c578e in handle_one_connection (arg=0x5643eb6e7440) at /home/stepan/mariadb/10.4/git/sql/sql_connect.cc:1316 #7 0x00005643e7ac600b in pfs_spawn_thread (arg=0x5643eb6dd270) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #8 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #9 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 23 (Thread 0x7f83d260e700 (LWP 14830)): #0 0x00007f83f8d48d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e7b3da27 in safe_cond_timedwait (cond=0x5643e88f0fe0 , mp=0x5643e88f39a0 , abstime=0x7f83d260dc60, file=0x5643e7bfd708 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:546 #2 0x00005643e6df8f95 in inline_mysql_cond_timedwait (that=0x5643e88f0fe0 , mutex=0x5643e88f39a0 , abstime=0x7f83d260dc60, src_file=0x5643e7bff738 "/home/stepan/mariadb/10.4/git/sql/mysqld.cc", src_line=2688) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1204 #3 0x00005643e6dfe0ac in cache_thread (thd=0x7f836c000af0) at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:2687 #4 0x00005643e6dfe352 in one_thread_per_connection_end (thd=0x7f836c000af0, put_in_cache=true) at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:2773 #5 0x00005643e70c5add in do_handle_one_connection (connect=0x5643eb6e7440) at /home/stepan/mariadb/10.4/git/sql/sql_connect.cc:1423 #6 0x00005643e70c578e in handle_one_connection (arg=0x5643eb6e7440) at /home/stepan/mariadb/10.4/git/sql/sql_connect.cc:1316 #7 0x00005643e7ac600b in pfs_spawn_thread (arg=0x5643eb601ee0) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #8 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #9 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 22 (Thread 0x7f83c9ffb700 (LWP 5394)): #0 0x00007f83f8d48d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e75f4750 in os_event::timed_wait (this=0x5643eb518240, abstime=0x7f83c9ffad50) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:275 #2 0x00005643e75f49f9 in os_event::wait_time_low (this=0x5643eb518240, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:385 #3 0x00005643e75f4b99 in os_event_wait_time_low (event=0x5643eb518240, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:485 #4 0x00005643e75b6801 in lock_wait_timeout_thread () at /home/stepan/mariadb/10.4/git/storage/innobase/lock/lock0wait.cc:522 #5 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 21 (Thread 0x7f83a7fff700 (LWP 5405)): #0 0x00007f83f8d4be3d in nanosleep () from /lib64/libpthread.so.0 #1 0x00005643e75f5137 in os_thread_sleep (tm=1000000) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0thread.cc:231 #2 0x00005643e77e7917 in btr_defragment_thread () at /home/stepan/mariadb/10.4/git/storage/innobase/btr/btr0defragment.cc:705 #3 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 20 (Thread 0x7f83a6ffd700 (LWP 5407)): #0 0x00007f83f8d48965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e7b3d725 in safe_cond_wait (cond=0x7f83a6ffcc70, mp=0x7f83a6ffccb0, file=0x5643e7e46c40 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:492 #2 0x00005643e74e58e7 in inline_mysql_cond_wait (that=0x7f83a6ffcc70, mutex=0x7f83a6ffccb0, src_file=0x5643e7e488b8 "/home/stepan/mariadb/10.4/git/storage/innobase/handler/ha_innodb.cc", src_line=288) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1178 #3 0x00005643e74eb625 in thd_destructor_proxy () at /home/stepan/mariadb/10.4/git/storage/innobase/handler/ha_innodb.cc:288 #4 0x00005643e7ac600b in pfs_spawn_thread (arg=0x5643eb585550) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #5 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7f83c17fa700 (LWP 5403)): #0 0x00007f83f8d48965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e75f4dc7 in os_event::wait (this=0x5643eb2dd0b0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:158 #2 0x00005643e75f48bb in os_event::wait_low (this=0x5643eb2dd0b0, reset_sig_count=3726) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:325 #3 0x00005643e75f4bbe in os_event_wait_low (event=0x5643eb2dd0b0, reset_sig_count=0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:502 #4 0x00005643e770d300 in srv_resume_thread (slot=0x5643e872bcd0 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:909 #5 0x00005643e77115c1 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7f83c1ffb700 (LWP 5402)): #0 0x00007f83f8d48965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e75f4dc7 in os_event::wait (this=0x5643eb2dd1b0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:158 #2 0x00005643e75f48bb in os_event::wait_low (this=0x5643eb2dd1b0, reset_sig_count=3174) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:325 #3 0x00005643e75f4bbe in os_event_wait_low (event=0x5643eb2dd1b0, reset_sig_count=0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:502 #4 0x00005643e770d300 in srv_resume_thread (slot=0x5643e872bed0 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:909 #5 0x00005643e77115c1 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 17 (Thread 0x7f83c37fe700 (LWP 5399)): #0 0x00007f83f8d4be3d in nanosleep () from /lib64/libpthread.so.0 #1 0x00005643e75f5137 in os_thread_sleep (tm=1000000) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0thread.cc:231 #2 0x00005643e7710d3d in srv_master_sleep () at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:2334 #3 0x00005643e7710ea5 in srv_master_thread (arg=0x0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:2375 #4 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7f83c97fa700 (LWP 5395)): #0 0x00007f83f8d48d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e75f4750 in os_event::timed_wait (this=0x5643eb2dd230, abstime=0x7f83c97f9bb0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:275 #2 0x00005643e75f49f9 in os_event::wait_time_low (this=0x5643eb2dd230, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:385 #3 0x00005643e75f4b99 in os_event_wait_time_low (event=0x5643eb2dd230, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:485 #4 0x00005643e770f761 in srv_error_monitor_thread () at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:1851 #5 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7f83d0d37700 (LWP 5389)): #0 0x00007f83f8915644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x00005643e75e5661 in LinuxAIOHandler::collect (this=0x7f83d0d36b00) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1813 #2 0x00005643e75e5d48 in LinuxAIOHandler::poll (this=0x7f83d0d36b00, m1=0x7f83d0d36ba8, m2=0x7f83d0d36bb0, request=0x7f83d0d36be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1974 #3 0x00005643e75e5eab in os_aio_linux_handler (global_segment=3, m1=0x7f83d0d36ba8, m2=0x7f83d0d36bb0, request=0x7f83d0d36be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:2028 #4 0x00005643e75eafe2 in os_aio_handler (segment=3, m1=0x7f83d0d36ba8, m2=0x7f83d0d36bb0, request=0x7f83d0d36be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:5598 #5 0x00005643e78a0d77 in fil_aio_wait (segment=3) at /home/stepan/mariadb/10.4/git/storage/innobase/fil/fil0fil.cc:4357 #6 0x00005643e7713e1a in io_handler_thread (arg=0x5643e896f958 ) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0start.cc:324 #7 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7f83d3d3c700 (LWP 5385)): #0 0x00007f83f8d48d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e7b3da27 in safe_cond_timedwait (cond=0x5643e91805a0 , mp=0x5643e91804e0 , abstime=0x7f83d3d3bcb0, file=0x5643e7fc3090 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:546 #2 0x00005643e7994a37 in inline_mysql_cond_timedwait (that=0x5643e91805a0 , mutex=0x5643e91804e0 , abstime=0x7f83d3d3bcb0, src_file=0x5643e7fc30d0 "/home/stepan/mariadb/10.4/git/storage/maria/ma_servicethread.c", src_line=116) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1204 #3 0x00005643e7994f7b in my_service_thread_sleep (control=0x5643e8732720 , sleep_time=30000000000) at /home/stepan/mariadb/10.4/git/storage/maria/ma_servicethread.c:115 #4 0x00005643e7988de2 in ma_checkpoint_background (arg=0x1e) at /home/stepan/mariadb/10.4/git/storage/maria/ma_checkpoint.c:707 #5 0x00005643e7ac600b in pfs_spawn_thread (arg=0x5643eb294e80) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #6 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7f83f082c700 (LWP 5380)): #0 0x00007f83f8d48965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f83f0ca3eb7 in gu::Lock::wait (cond=..., this=0x7f83f082bbf0) at galerautils/src/gu_lock.hpp:45 #2 0x00007f83f0ca3f5b in galera::ServiceThd::thd_func (arg=0x5643eb19d4d8) at galera/src/galera_service_thd.cpp:30 #3 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7f83f17dd700 (LWP 5379)): #0 0x00007f83f8d48d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e7b3da27 in safe_cond_timedwait (cond=0x5643e9192ca0 , mp=0x5643e9192be0 , abstime=0x7f83f17dcd70, file=0x5643e800b700 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:546 #2 0x00005643e7b3ea6a in inline_mysql_cond_timedwait (that=0x5643e9192ca0 , mutex=0x5643e9192be0 , abstime=0x7f83f17dcd70, src_file=0x5643e800b740 "/home/stepan/mariadb/10.4/git/mysys/thr_timer.c", src_line=292) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1204 #3 0x00005643e7b3f62d in timer_handler (arg=0x0) at /home/stepan/mariadb/10.4/git/mysys/thr_timer.c:292 #4 0x00005643e7ac600b in pfs_spawn_thread (arg=0x5643eb169150) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #5 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7f83d273a700 (LWP 5408)): #0 0x00007f83f703b40a in sigwaitinfo () from /lib64/libc.so.6 #1 0x00005643e6df8694 in my_sigwait (set=0x7f83d2739cf0, sig=0x7f83d2739cb4, code=0x7f83d2739cb8) at /home/stepan/mariadb/10.4/git/include/my_pthread.h:198 #2 0x00005643e6dff00d in signal_hand (arg=0x0) at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:3245 #3 0x00005643e7ac600b in pfs_spawn_thread (arg=0x5643eb5bc4b0) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #4 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7f83a77fe700 (LWP 5406)): #0 0x00007f83f8d48965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e75f4dc7 in os_event::wait (this=0x5643eb2dd430) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:158 #2 0x00005643e75f48bb in os_event::wait_low (this=0x5643eb2dd430, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:325 #3 0x00005643e75f4bbe in os_event_wait_low (event=0x5643eb2dd430, reset_sig_count=0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:502 #4 0x00005643e77f831d in buf_resize_thread () at /home/stepan/mariadb/10.4/git/storage/innobase/buf/buf0buf.cc:3199 #5 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7f83c2ffd700 (LWP 5400)): #0 0x00007f83f8d48965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e75f4dc7 in os_event::wait (this=0x5643eb2dd030) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:158 #2 0x00005643e75f48bb in os_event::wait_low (this=0x5643eb2dd030, reset_sig_count=1104) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:325 #3 0x00005643e75f4bbe in os_event_wait_low (event=0x5643eb2dd030, reset_sig_count=1104) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:502 #4 0x00005643e770d300 in srv_resume_thread (slot=0x5643e872bbd0 , sig_count=1104, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:909 #5 0x00005643e7711a78 in srv_purge_coordinator_suspend (slot=0x5643e872bbd0 , rseg_history_len=21) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:2657 #6 0x00005643e7711da9 in srv_purge_coordinator_thread (arg=0x0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:2738 #7 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7f83ca7fc700 (LWP 5397)): #0 0x00007f83f8d48d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e75f4750 in os_event::timed_wait (this=0x5643eb54a300, abstime=0x7f83ca7fbd70) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:275 #2 0x00005643e75f49f9 in os_event::wait_time_low (this=0x5643eb54a300, time_in_usec=10000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:385 #3 0x00005643e75f4b99 in os_event_wait_time_low (event=0x5643eb54a300, time_in_usec=10000000, reset_sig_count=0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:485 #4 0x00005643e7888950 in dict_stats_thread () at /home/stepan/mariadb/10.4/git/storage/innobase/dict/dict0stats_bg.cc:476 #5 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7f83c8ff9700 (LWP 5396)): #0 0x00007f83f8d48d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00005643e75f4750 in os_event::timed_wait (this=0x5643eb2dd2b0, abstime=0x7f83c8ff8d30) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:275 #2 0x00005643e75f49f9 in os_event::wait_time_low (this=0x5643eb2dd2b0, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:385 #3 0x00005643e75f4b99 in os_event_wait_time_low (event=0x5643eb2dd2b0, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:485 #4 0x00005643e770f1e7 in srv_monitor_thread () at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:1687 #5 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7f83cb7fe700 (LWP 5391)): #0 0x00007f83f8915644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x00005643e75e5661 in LinuxAIOHandler::collect (this=0x7f83cb7fdb00) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1813 #2 0x00005643e75e5d48 in LinuxAIOHandler::poll (this=0x7f83cb7fdb00, m1=0x7f83cb7fdba8, m2=0x7f83cb7fdbb0, request=0x7f83cb7fdbe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1974 #3 0x00005643e75e5eab in os_aio_linux_handler (global_segment=5, m1=0x7f83cb7fdba8, m2=0x7f83cb7fdbb0, request=0x7f83cb7fdbe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:2028 #4 0x00005643e75eafe2 in os_aio_handler (segment=5, m1=0x7f83cb7fdba8, m2=0x7f83cb7fdbb0, request=0x7f83cb7fdbe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:5598 #5 0x00005643e78a0d77 in fil_aio_wait (segment=5) at /home/stepan/mariadb/10.4/git/storage/innobase/fil/fil0fil.cc:4357 #6 0x00005643e7713e1a in io_handler_thread (arg=0x5643e896f968 ) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0start.cc:324 #7 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7f83d1538700 (LWP 5388)): #0 0x00007f83f8915644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x00005643e75e5661 in LinuxAIOHandler::collect (this=0x7f83d1537b00) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1813 #2 0x00005643e75e5d48 in LinuxAIOHandler::poll (this=0x7f83d1537b00, m1=0x7f83d1537ba8, m2=0x7f83d1537bb0, request=0x7f83d1537be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1974 #3 0x00005643e75e5eab in os_aio_linux_handler (global_segment=2, m1=0x7f83d1537ba8, m2=0x7f83d1537bb0, request=0x7f83d1537be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:2028 #4 0x00005643e75eafe2 in os_aio_handler (segment=2, m1=0x7f83d1537ba8, m2=0x7f83d1537bb0, request=0x7f83d1537be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:5598 #5 0x00005643e78a0d77 in fil_aio_wait (segment=2) at /home/stepan/mariadb/10.4/git/storage/innobase/fil/fil0fil.cc:4357 #6 0x00005643e7713e1a in io_handler_thread (arg=0x5643e896f950 ) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0start.cc:324 #7 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7f83d1d39700 (LWP 5387)): #0 0x00007f83f8915644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x00005643e75e5661 in LinuxAIOHandler::collect (this=0x7f83d1d38b00) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1813 #2 0x00005643e75e5d48 in LinuxAIOHandler::poll (this=0x7f83d1d38b00, m1=0x7f83d1d38ba8, m2=0x7f83d1d38bb0, request=0x7f83d1d38be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1974 #3 0x00005643e75e5eab in os_aio_linux_handler (global_segment=1, m1=0x7f83d1d38ba8, m2=0x7f83d1d38bb0, request=0x7f83d1d38be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:2028 #4 0x00005643e75eafe2 in os_aio_handler (segment=1, m1=0x7f83d1d38ba8, m2=0x7f83d1d38bb0, request=0x7f83d1d38be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:5598 #5 0x00005643e78a0d77 in fil_aio_wait (segment=1) at /home/stepan/mariadb/10.4/git/storage/innobase/fil/fil0fil.cc:4357 #6 0x00005643e7713e1a in io_handler_thread (arg=0x5643e896f948 ) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0start.cc:324 #7 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7f83e892e700 (LWP 5384)): #0 0x00007f83f8d48965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f83f0b95e42 in fifo_lock_get (q=q@entry=0x7f83f092e010) at galerautils/src/gu_fifo.c:262 #2 0x00007f83f0b964b1 in gu_fifo_get_head (q=0x7f83f092e010, err=0x7f83e892d01c) at galerautils/src/gu_fifo.c:330 #3 0x00007f83f0c79dfc in gcs_recv (conn=0x5643eb1a50a0, action=0x7f83e892d060) at gcs/src/gcs.cpp:2024 #4 0x00007f83f0ca71bc in galera::GcsActionSource::process (this=0x5643eb1a4a80, recv_ctx=0x7f83e892d480, exit_loop=@0x7f83e892d24e: false) at galera/src/gcs_action_source.cpp:161 #5 0x00007f83f0cc6174 in galera::ReplicatorSMM::async_recv (this=0x5643eb19cdc0, recv_ctx=0x7f83e892d480) at galera/src/replicator_smm.cpp:391 #6 0x00005643e7bf56fe in wsrep::wsrep_provider_v26::run_applier (this=0x5643eb138da0, applier_ctx=0x7f83e892d480) at /home/stepan/mariadb/10.4/git/wsrep-lib/src/wsrep_provider_v26.cpp:731 #7 0x00005643e71c4e77 in wsrep_replication_process (thd=0x7f83d4000af0, arg=0x5643eb1e4ed0) at /home/stepan/mariadb/10.4/git/sql/wsrep_thd.cc:62 #8 0x00005643e71b54ee in start_wsrep_THD (arg=0x5643eb1e4ed0) at /home/stepan/mariadb/10.4/git/sql/wsrep_mysqld.cc:2723 #9 0x00005643e7ac600b in pfs_spawn_thread (arg=0x5643eb1edde0) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #10 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #11 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7f83e917a700 (LWP 5382)): #0 0x00007f83f8d48965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f83f0c7e597 in gu::Lock::wait (cond=..., this=0x7f83e9179850) at galerautils/src/gu_lock.hpp:45 #2 0x00007f83f0c810db in RecvBuf::front (this=this@entry=0x5643eb1d5138, timeout=...) at gcs/src/gcs_gcomm.cpp:124 #3 0x00007f83f0c7ec76 in gcomm_recv (backend=, msg=0x5643eb1a5380, timeout=9223372035999999999) at gcs/src/gcs_gcomm.cpp:673 #4 0x00007f83f0c72c0c in core_msg_recv (backend=backend@entry=0x5643eb1a54e0, recv_msg=recv_msg@entry=0x5643eb1a5380, timeout=timeout@entry=9223372035999999999) at gcs/src/gcs_core.cpp:480 #5 0x00007f83f0c75e84 in gcs_core_recv (conn=0x5643eb1a5320, recv_act=recv_act@entry=0x7f83e9179d70, timeout=9223372035999999999) at gcs/src/gcs_core.cpp:1184 #6 0x00007f83f0c7d108 in gcs_recv_thread (arg=0x5643eb1a50a0) at gcs/src/gcs.cpp:1398 #7 0x00007f83f8d44dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f83f7101ead in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7f83f9154880 (LWP 5378)): #0 0x00007f83f8d499d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x00005643e7b380b2 in my_write_core (sig=6) at /home/stepan/mariadb/10.4/git/mysys/stacktrace.c:481 #2 0x00005643e72a419c in handle_fatal_signal (sig=6) at /home/stepan/mariadb/10.4/git/sql/signal_handler.cc:343 #3 #4 0x00007f83f70f720d in poll () from /lib64/libc.so.6 #5 0x00005643e6e0584a in handle_connections_sockets () at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:6456 #6 0x00005643e6e04ae5 in mysqld_main (argc=163, argv=0x5643eb038380) at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:5892 #7 0x00005643e6df8615 in main (argc=24, argv=0x7fffa41a9f38) at /home/stepan/mariadb/10.4/git/sql/main.cc:25 Compressed file /home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_gcs_fc_limit-innodb/mysqld.1/data/core.5378 - found 'core.488' (1/5) Trying 'dbx' to get a backtrace Trying 'gdb' to get a backtrace from coredump /home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_gcs_fc_limit-innodb/mysqld.2/data/core.488 Core generated by '/home/stepan/mariadb/10.4/git/sql/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- [New LWP 488] [New LWP 491] [New LWP 493] [New LWP 492] [New LWP 542] [New LWP 841] [New LWP 544] [New LWP 543] [New LWP 845] [New LWP 837] [New LWP 847] [New LWP 842] [New LWP 876] [New LWP 843] [New LWP 878] [New LWP 844] [New LWP 879] [New LWP 846] [New LWP 880] [New LWP 875] [New LWP 881] [New LWP 888] [New LWP 884] [New LWP 887] [New LWP 882] [New LWP 883] [New LWP 885] [New LWP 890] [New LWP 2593] [New LWP 889] [New LWP 877] [New LWP 886] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `/home/stepan/mariadb/10.4/git/sql/mysqld --defaults-group-suffix=.2 --defaults-'. Program terminated with signal 6, Aborted. #0 0x00007f146743d9d1 in pthread_kill () from /lib64/libpthread.so.0 #0 0x00007f146743d9d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x000055ec56b2a0b2 in my_write_core (sig=6) at /home/stepan/mariadb/10.4/git/mysys/stacktrace.c:481 #2 0x000055ec5629619c in handle_fatal_signal (sig=6) at /home/stepan/mariadb/10.4/git/sql/signal_handler.cc:343 #3 #4 0x00007f14657eb20d in poll () from /lib64/libc.so.6 #5 0x000055ec55df784a in handle_connections_sockets () at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:6456 #6 0x000055ec55df6ae5 in mysqld_main (argc=164, argv=0x55ec59060380) at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:5892 #7 0x000055ec55dea615 in main (argc=24, argv=0x7ffce590ad78) at /home/stepan/mariadb/10.4/git/sql/main.cc:25 Thread 32 (Thread 0x7f1411ffb700 (LWP 886)): #0 0x00007f146743fe3d in nanosleep () from /lib64/libpthread.so.0 #1 0x000055ec565e7137 in os_thread_sleep (tm=1000000) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0thread.cc:231 #2 0x000055ec567d9917 in btr_defragment_thread () at /home/stepan/mariadb/10.4/git/storage/innobase/btr/btr0defragment.cc:705 #3 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 31 (Thread 0x7f1422ffd700 (LWP 877)): #0 0x00007f146743cd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec565e6750 in os_event::timed_wait (this=0x55ec59253d20, abstime=0x7f1422ffcd30) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:275 #2 0x000055ec565e69f9 in os_event::wait_time_low (this=0x55ec59253d20, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:385 #3 0x000055ec565e6b99 in os_event_wait_time_low (event=0x55ec59253d20, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:485 #4 0x000055ec567011e7 in srv_monitor_thread () at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:1687 #5 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 30 (Thread 0x7f144c86d700 (LWP 889)): #0 0x00007f146572f40a in sigwaitinfo () from /lib64/libc.so.6 #1 0x000055ec55dea694 in my_sigwait (set=0x7f144c86ccf0, sig=0x7f144c86ccb4, code=0x7f144c86ccb8) at /home/stepan/mariadb/10.4/git/include/my_pthread.h:198 #2 0x000055ec55df100d in signal_hand (arg=0x0) at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:3245 #3 0x000055ec56ab800b in pfs_spawn_thread (arg=0x55ec5925c520) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #4 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 29 (Thread 0x7f144c78c700 (LWP 2593)): #0 0x00007f146743cd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec56b2fa27 in safe_cond_timedwait (cond=0x55ec578e2fe0 , mp=0x55ec578e59a0 , abstime=0x7f144c78bc60, file=0x55ec56bef708 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:546 #2 0x000055ec55deaf95 in inline_mysql_cond_timedwait (that=0x55ec578e2fe0 , mutex=0x55ec578e59a0 , abstime=0x7f144c78bc60, src_file=0x55ec56bf1738 "/home/stepan/mariadb/10.4/git/sql/mysqld.cc", src_line=2688) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1204 #3 0x000055ec55df00ac in cache_thread (thd=0x7f13e4000af0) at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:2687 #4 0x000055ec55df0352 in one_thread_per_connection_end (thd=0x7f13e4000af0, put_in_cache=true) at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:2773 #5 0x000055ec560b7add in do_handle_one_connection (connect=0x55ec59689af0) at /home/stepan/mariadb/10.4/git/sql/sql_connect.cc:1423 #6 0x000055ec560b778e in handle_one_connection (arg=0x55ec59689af0) at /home/stepan/mariadb/10.4/git/sql/sql_connect.cc:1316 #7 0x000055ec56ab800b in pfs_spawn_thread (arg=0x55ec5917c920) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #8 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #9 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 28 (Thread 0x7f144c822700 (LWP 890)): #0 0x00007f146743c965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec56b2f725 in safe_cond_wait (cond=0x55ec578e3020 , mp=0x55ec578e62a0 , file=0x55ec56bffa20 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1167) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:492 #2 0x000055ec55e1d5f6 in inline_mysql_cond_wait (that=0x55ec578e3020 , mutex=0x55ec578e62a0 , src_file=0x55ec56c00560 "/home/stepan/mariadb/10.4/git/sql/slave.cc", src_line=522) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1167 #3 0x000055ec55e1ef3e in handle_slave_background (arg=0x0) at /home/stepan/mariadb/10.4/git/sql/slave.cc:522 #4 0x000055ec56ab800b in pfs_spawn_thread (arg=0x55ec596fe550) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #5 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 27 (Thread 0x7f14127fc700 (LWP 885)): #0 0x00007f146743c965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec565e6dc7 in os_event::wait (this=0x55ec59253da0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:158 #2 0x000055ec565e68bb in os_event::wait_low (this=0x55ec59253da0, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:325 #3 0x000055ec565e6bbe in os_event_wait_low (event=0x55ec59253da0, reset_sig_count=0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:502 #4 0x000055ec56804ac9 in buf_dump_thread () at /home/stepan/mariadb/10.4/git/storage/innobase/buf/buf0dump.cc:833 #5 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 26 (Thread 0x7f14137fe700 (LWP 883)): #0 0x00007f146743c965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec565e6dc7 in os_event::wait (this=0x55ec59253ba0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:158 #2 0x000055ec565e68bb in os_event::wait_low (this=0x55ec59253ba0, reset_sig_count=350) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:325 #3 0x000055ec565e6bbe in os_event_wait_low (event=0x55ec59253ba0, reset_sig_count=0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:502 #4 0x000055ec566ff300 in srv_resume_thread (slot=0x55ec5771ddd0 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:909 #5 0x000055ec567035c1 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 25 (Thread 0x7f1413fff700 (LWP 882)): #0 0x00007f146743c965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec565e6dc7 in os_event::wait (this=0x55ec59253b20) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:158 #2 0x000055ec565e68bb in os_event::wait_low (this=0x55ec59253b20, reset_sig_count=416) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:325 #3 0x000055ec565e6bbe in os_event_wait_low (event=0x55ec59253b20, reset_sig_count=0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:502 #4 0x000055ec566ff300 in srv_resume_thread (slot=0x55ec5771dcd0 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:909 #5 0x000055ec567035c1 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 24 (Thread 0x7f14117fa700 (LWP 887)): #0 0x00007f146743c965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec565e6dc7 in os_event::wait (this=0x55ec59253ea0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:158 #2 0x000055ec565e68bb in os_event::wait_low (this=0x55ec59253ea0, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:325 #3 0x000055ec565e6bbe in os_event_wait_low (event=0x55ec59253ea0, reset_sig_count=0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:502 #4 0x000055ec567ea31d in buf_resize_thread () at /home/stepan/mariadb/10.4/git/storage/innobase/buf/buf0buf.cc:3199 #5 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 23 (Thread 0x7f1412ffd700 (LWP 884)): #0 0x00007f146743c965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec565e6dc7 in os_event::wait (this=0x55ec59253c20) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:158 #2 0x000055ec565e68bb in os_event::wait_low (this=0x55ec59253c20, reset_sig_count=344) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:325 #3 0x000055ec565e6bbe in os_event_wait_low (event=0x55ec59253c20, reset_sig_count=0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:502 #4 0x000055ec566ff300 in srv_resume_thread (slot=0x55ec5771ded0 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:909 #5 0x000055ec567035c1 in srv_worker_thread (arg=0x0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:2517 #6 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 22 (Thread 0x7f1410ff9700 (LWP 888)): #0 0x00007f146743c965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec56b2f725 in safe_cond_wait (cond=0x7f1410ff8c70, mp=0x7f1410ff8cb0, file=0x55ec56e38c40 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:492 #2 0x000055ec564d78e7 in inline_mysql_cond_wait (that=0x7f1410ff8c70, mutex=0x7f1410ff8cb0, src_file=0x55ec56e3a8b8 "/home/stepan/mariadb/10.4/git/storage/innobase/handler/ha_innodb.cc", src_line=288) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1178 #3 0x000055ec564dd625 in thd_destructor_proxy () at /home/stepan/mariadb/10.4/git/storage/innobase/handler/ha_innodb.cc:288 #4 0x000055ec56ab800b in pfs_spawn_thread (arg=0x55ec595c7870) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #5 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 21 (Thread 0x7f1420ff9700 (LWP 881)): #0 0x00007f146743c965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec565e6dc7 in os_event::wait (this=0x55ec59253aa0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:158 #2 0x000055ec565e68bb in os_event::wait_low (this=0x55ec59253aa0, reset_sig_count=121) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:325 #3 0x000055ec565e6bbe in os_event_wait_low (event=0x55ec59253aa0, reset_sig_count=121) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:502 #4 0x000055ec566ff300 in srv_resume_thread (slot=0x55ec5771dbd0 , sig_count=121, wait=true, timeout_usec=0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:909 #5 0x000055ec56703a78 in srv_purge_coordinator_suspend (slot=0x55ec5771dbd0 , rseg_history_len=12) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:2657 #6 0x000055ec56703da9 in srv_purge_coordinator_thread (arg=0x0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:2738 #7 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 20 (Thread 0x7f14237fe700 (LWP 875)): #0 0x00007f146743cd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec565e6750 in os_event::timed_wait (this=0x55ec59551250, abstime=0x7f14237fdd50) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:275 #2 0x000055ec565e69f9 in os_event::wait_time_low (this=0x55ec59551250, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:385 #3 0x000055ec565e6b99 in os_event_wait_time_low (event=0x55ec59551250, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:485 #4 0x000055ec565a8801 in lock_wait_timeout_thread () at /home/stepan/mariadb/10.4/git/storage/innobase/lock/lock0wait.cc:522 #5 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7f14217fa700 (LWP 880)): #0 0x00007f146743fe3d in nanosleep () from /lib64/libpthread.so.0 #1 0x000055ec565e7137 in os_thread_sleep (tm=1000000) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0thread.cc:231 #2 0x000055ec56702d3d in srv_master_sleep () at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:2334 #3 0x000055ec56702ea5 in srv_master_thread (arg=0x0) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:2375 #4 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7f142d7fa700 (LWP 846)): #0 0x00007f1467009644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055ec565d7661 in LinuxAIOHandler::collect (this=0x7f142d7f9b00) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1813 #2 0x000055ec565d7d48 in LinuxAIOHandler::poll (this=0x7f142d7f9b00, m1=0x7f142d7f9ba8, m2=0x7f142d7f9bb0, request=0x7f142d7f9be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1974 #3 0x000055ec565d7eab in os_aio_linux_handler (global_segment=5, m1=0x7f142d7f9ba8, m2=0x7f142d7f9bb0, request=0x7f142d7f9be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:2028 #4 0x000055ec565dcfe2 in os_aio_handler (segment=5, m1=0x7f142d7f9ba8, m2=0x7f142d7f9bb0, request=0x7f142d7f9be0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:5598 #5 0x000055ec56892d77 in fil_aio_wait (segment=5) at /home/stepan/mariadb/10.4/git/storage/innobase/fil/fil0fil.cc:4357 #6 0x000055ec56705e1a in io_handler_thread (arg=0x55ec57961968 ) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0start.cc:324 #7 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 17 (Thread 0x7f1421ffb700 (LWP 879)): #0 0x00007f146743cd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec565e6750 in os_event::timed_wait (this=0x55ec594bbef0, abstime=0x7f1421ffab70) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:275 #2 0x000055ec565e69f9 in os_event::wait_time_low (this=0x55ec594bbef0, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:385 #3 0x000055ec565e6b99 in os_event_wait_time_low (event=0x55ec594bbef0, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:485 #4 0x000055ec5676f6b6 in ib_wqueue_timedwait (wq=0x55ec594b4c60, wait_in_usecs=5000000) at /home/stepan/mariadb/10.4/git/storage/innobase/ut/ut0wqueue.cc:156 #5 0x000055ec568e08b4 in fts_optimize_thread (arg=0x55ec594b4c60) at /home/stepan/mariadb/10.4/git/storage/innobase/fts/fts0opt.cc:2836 #6 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7f142e7fc700 (LWP 844)): #0 0x00007f1467009644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055ec565d7661 in LinuxAIOHandler::collect (this=0x7f142e7fbb00) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1813 #2 0x000055ec565d7d48 in LinuxAIOHandler::poll (this=0x7f142e7fbb00, m1=0x7f142e7fbba8, m2=0x7f142e7fbbb0, request=0x7f142e7fbbe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1974 #3 0x000055ec565d7eab in os_aio_linux_handler (global_segment=3, m1=0x7f142e7fbba8, m2=0x7f142e7fbbb0, request=0x7f142e7fbbe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:2028 #4 0x000055ec565dcfe2 in os_aio_handler (segment=3, m1=0x7f142e7fbba8, m2=0x7f142e7fbbb0, request=0x7f142e7fbbe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:5598 #5 0x000055ec56892d77 in fil_aio_wait (segment=3) at /home/stepan/mariadb/10.4/git/storage/innobase/fil/fil0fil.cc:4357 #6 0x000055ec56705e1a in io_handler_thread (arg=0x55ec57961958 ) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0start.cc:324 #7 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7f14227fc700 (LWP 878)): #0 0x00007f146743cd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec565e6750 in os_event::timed_wait (this=0x55ec595831d0, abstime=0x7f14227fbd70) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:275 #2 0x000055ec565e69f9 in os_event::wait_time_low (this=0x55ec595831d0, time_in_usec=10000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:385 #3 0x000055ec565e6b99 in os_event_wait_time_low (event=0x55ec595831d0, time_in_usec=10000000, reset_sig_count=0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:485 #4 0x000055ec5687a950 in dict_stats_thread () at /home/stepan/mariadb/10.4/git/storage/innobase/dict/dict0stats_bg.cc:476 #5 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7f142effd700 (LWP 843)): #0 0x00007f1467009644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055ec565d7661 in LinuxAIOHandler::collect (this=0x7f142effcb00) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1813 #2 0x000055ec565d7d48 in LinuxAIOHandler::poll (this=0x7f142effcb00, m1=0x7f142effcba8, m2=0x7f142effcbb0, request=0x7f142effcbe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1974 #3 0x000055ec565d7eab in os_aio_linux_handler (global_segment=2, m1=0x7f142effcba8, m2=0x7f142effcbb0, request=0x7f142effcbe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:2028 #4 0x000055ec565dcfe2 in os_aio_handler (segment=2, m1=0x7f142effcba8, m2=0x7f142effcbb0, request=0x7f142effcbe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:5598 #5 0x000055ec56892d77 in fil_aio_wait (segment=2) at /home/stepan/mariadb/10.4/git/storage/innobase/fil/fil0fil.cc:4357 #6 0x000055ec56705e1a in io_handler_thread (arg=0x55ec57961950 ) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0start.cc:324 #7 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7f1423fff700 (LWP 876)): #0 0x00007f146743cd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec565e6750 in os_event::timed_wait (this=0x55ec59253ca0, abstime=0x7f1423ffebb0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:275 #2 0x000055ec565e69f9 in os_event::wait_time_low (this=0x55ec59253ca0, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:385 #3 0x000055ec565e6b99 in os_event_wait_time_low (event=0x55ec59253ca0, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:485 #4 0x000055ec56701761 in srv_error_monitor_thread () at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0srv.cc:1851 #5 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7f142f7fe700 (LWP 842)): #0 0x00007f1467009644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055ec565d7661 in LinuxAIOHandler::collect (this=0x7f142f7fdb00) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1813 #2 0x000055ec565d7d48 in LinuxAIOHandler::poll (this=0x7f142f7fdb00, m1=0x7f142f7fdba8, m2=0x7f142f7fdbb0, request=0x7f142f7fdbe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1974 #3 0x000055ec565d7eab in os_aio_linux_handler (global_segment=1, m1=0x7f142f7fdba8, m2=0x7f142f7fdbb0, request=0x7f142f7fdbe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:2028 #4 0x000055ec565dcfe2 in os_aio_handler (segment=1, m1=0x7f142f7fdba8, m2=0x7f142f7fdbb0, request=0x7f142f7fdbe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:5598 #5 0x000055ec56892d77 in fil_aio_wait (segment=1) at /home/stepan/mariadb/10.4/git/storage/innobase/fil/fil0fil.cc:4357 #6 0x000055ec56705e1a in io_handler_thread (arg=0x55ec57961948 ) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0start.cc:324 #7 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7f142cff9700 (LWP 847)): #0 0x00007f146743cd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec565e6750 in os_event::timed_wait (this=0x55ec59253e20, abstime=0x7f142cff8b00) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:275 #2 0x000055ec565e69f9 in os_event::wait_time_low (this=0x55ec59253e20, time_in_usec=889000, reset_sig_count=2) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:385 #3 0x000055ec565e6b99 in os_event_wait_time_low (event=0x55ec59253e20, time_in_usec=889000, reset_sig_count=2) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0event.cc:485 #4 0x000055ec56810f9a in pc_sleep_if_needed (next_loop_time=208192818, sig_count=2, cur_time=208191929) at /home/stepan/mariadb/10.4/git/storage/innobase/buf/buf0flu.cc:2643 #5 0x000055ec5681213e in buf_flush_page_cleaner_coordinator () at /home/stepan/mariadb/10.4/git/storage/innobase/buf/buf0flu.cc:3102 #6 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7f144de6f700 (LWP 837)): #0 0x00007f146743cd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec56b2fa27 in safe_cond_timedwait (cond=0x55ec581725a0 , mp=0x55ec581724e0 , abstime=0x7f144de6ecb0, file=0x55ec56fb5090 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:546 #2 0x000055ec56986a37 in inline_mysql_cond_timedwait (that=0x55ec581725a0 , mutex=0x55ec581724e0 , abstime=0x7f144de6ecb0, src_file=0x55ec56fb50d0 "/home/stepan/mariadb/10.4/git/storage/maria/ma_servicethread.c", src_line=116) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1204 #3 0x000055ec56986f7b in my_service_thread_sleep (control=0x55ec57724720 , sleep_time=30000000000) at /home/stepan/mariadb/10.4/git/storage/maria/ma_servicethread.c:115 #4 0x000055ec5697ade2 in ma_checkpoint_background (arg=0x1e) at /home/stepan/mariadb/10.4/git/storage/maria/ma_checkpoint.c:707 #5 0x000055ec56ab800b in pfs_spawn_thread (arg=0x55ec59282e90) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #6 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7f142dffb700 (LWP 845)): #0 0x00007f1467009644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055ec565d7661 in LinuxAIOHandler::collect (this=0x7f142dffab00) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1813 #2 0x000055ec565d7d48 in LinuxAIOHandler::poll (this=0x7f142dffab00, m1=0x7f142dffaba8, m2=0x7f142dffabb0, request=0x7f142dffabe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1974 #3 0x000055ec565d7eab in os_aio_linux_handler (global_segment=4, m1=0x7f142dffaba8, m2=0x7f142dffabb0, request=0x7f142dffabe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:2028 #4 0x000055ec565dcfe2 in os_aio_handler (segment=4, m1=0x7f142dffaba8, m2=0x7f142dffabb0, request=0x7f142dffabe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:5598 #5 0x000055ec56892d77 in fil_aio_wait (segment=4) at /home/stepan/mariadb/10.4/git/storage/innobase/fil/fil0fil.cc:4357 #6 0x000055ec56705e1a in io_handler_thread (arg=0x55ec57961960 ) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0start.cc:324 #7 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7f145c29b700 (LWP 543)): #0 0x00007f146743c965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec56b2f725 in safe_cond_wait (cond=0x7f1444015ac8, mp=0x7f1444015a18, file=0x55ec56cadd40 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:492 #2 0x000055ec561b68a4 in inline_mysql_cond_wait (that=0x7f1444015ac8, mutex=0x7f1444015a18, src_file=0x55ec56cadf50 "/home/stepan/mariadb/10.4/git/sql/wsrep_thd.h", src_line=69) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1178 #3 0x000055ec561b9776 in Wsrep_thd_queue::pop_front (this=0x7f14440159c0) at /home/stepan/mariadb/10.4/git/sql/wsrep_thd.h:69 #4 0x000055ec561b8194 in wsrep_rollback_process (rollbacker=0x7f1444001d40, arg=0x55ec5922b6f0) at /home/stepan/mariadb/10.4/git/sql/wsrep_thd.cc:228 #5 0x000055ec561a74ee in start_wsrep_THD (arg=0x55ec5922b6f0) at /home/stepan/mariadb/10.4/git/sql/wsrep_mysqld.cc:2723 #6 0x000055ec56ab800b in pfs_spawn_thread (arg=0x55ec591f5000) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #7 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7f145c250700 (LWP 544)): #0 0x00007f146743c965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f145f289e42 in fifo_lock_get (q=q@entry=0x7f145f022010) at galerautils/src/gu_fifo.c:262 #2 0x00007f145f28a4b1 in gu_fifo_get_head (q=0x7f145f022010, err=0x7f145c24f01c) at galerautils/src/gu_fifo.c:330 #3 0x00007f145f36ddfc in gcs_recv (conn=0x55ec591dc8d0, action=0x7f145c24f060) at gcs/src/gcs.cpp:2024 #4 0x00007f145f39b1bc in galera::GcsActionSource::process (this=0x55ec591dc140, recv_ctx=0x7f145c24f480, exit_loop=@0x7f145c24f24e: false) at galera/src/gcs_action_source.cpp:161 #5 0x00007f145f3ba174 in galera::ReplicatorSMM::async_recv (this=0x55ec591c4db0, recv_ctx=0x7f145c24f480) at galera/src/replicator_smm.cpp:391 #6 0x000055ec56be76fe in wsrep::wsrep_provider_v26::run_applier (this=0x55ec5914fe00, applier_ctx=0x7f145c24f480) at /home/stepan/mariadb/10.4/git/wsrep-lib/src/wsrep_provider_v26.cpp:731 #7 0x000055ec561b6e77 in wsrep_replication_process (thd=0x7f1438000af0, arg=0x55ec5922b6d0) at /home/stepan/mariadb/10.4/git/sql/wsrep_thd.cc:62 #8 0x000055ec561a74ee in start_wsrep_THD (arg=0x55ec5922b6d0) at /home/stepan/mariadb/10.4/git/sql/wsrep_mysqld.cc:2723 #9 0x000055ec56ab800b in pfs_spawn_thread (arg=0x55ec591f54f0) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #10 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #11 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7f142ffff700 (LWP 841)): #0 0x00007f1467009644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055ec565d7661 in LinuxAIOHandler::collect (this=0x7f142fffeb00) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1813 #2 0x000055ec565d7d48 in LinuxAIOHandler::poll (this=0x7f142fffeb00, m1=0x7f142fffeba8, m2=0x7f142fffebb0, request=0x7f142fffebe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:1974 #3 0x000055ec565d7eab in os_aio_linux_handler (global_segment=0, m1=0x7f142fffeba8, m2=0x7f142fffebb0, request=0x7f142fffebe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:2028 #4 0x000055ec565dcfe2 in os_aio_handler (segment=0, m1=0x7f142fffeba8, m2=0x7f142fffebb0, request=0x7f142fffebe0) at /home/stepan/mariadb/10.4/git/storage/innobase/os/os0file.cc:5598 #5 0x000055ec56892d77 in fil_aio_wait (segment=0) at /home/stepan/mariadb/10.4/git/storage/innobase/fil/fil0fil.cc:4357 #6 0x000055ec56705e1a in io_handler_thread (arg=0x55ec57961940 ) at /home/stepan/mariadb/10.4/git/storage/innobase/srv/srv0start.cc:324 #7 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7f144fffe700 (LWP 542)): #0 0x00007f146743c965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f145f372597 in gu::Lock::wait (cond=..., this=0x7f144fffd850) at galerautils/src/gu_lock.hpp:45 #2 0x00007f145f3750db in RecvBuf::front (this=this@entry=0x55ec59209408, timeout=...) at gcs/src/gcs_gcomm.cpp:124 #3 0x00007f145f372c76 in gcomm_recv (backend=, msg=0x55ec591dcbb0, timeout=9223372035999999999) at gcs/src/gcs_gcomm.cpp:673 #4 0x00007f145f366c0c in core_msg_recv (backend=backend@entry=0x55ec591dcd10, recv_msg=recv_msg@entry=0x55ec591dcbb0, timeout=timeout@entry=9223372035999999999) at gcs/src/gcs_core.cpp:480 #5 0x00007f145f369e84 in gcs_core_recv (conn=0x55ec591dcb50, recv_act=recv_act@entry=0x7f144fffdd70, timeout=9223372035999999999) at gcs/src/gcs_core.cpp:1184 #6 0x00007f145f371108 in gcs_recv_thread (arg=0x55ec591dc8d0) at gcs/src/gcs.cpp:1398 #7 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7f145ef20700 (LWP 492)): #0 0x00007f146743c965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f145f397eb7 in gu::Lock::wait (cond=..., this=0x7f145ef1fbf0) at galerautils/src/gu_lock.hpp:45 #2 0x00007f145f397f5b in galera::ServiceThd::thd_func (arg=0x55ec591c54c8) at galera/src/galera_service_thd.cpp:30 #3 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7f145ca9c700 (LWP 493)): #0 0x00007f14657f6483 in epoll_wait () from /lib64/libc.so.6 #1 0x00007f145f3385c8 in asio::detail::epoll_reactor::run (this=0x55ec59209ba0, block=block@entry=true, ops=...) at asio/asio/detail/impl/epoll_reactor.ipp:391 #2 0x00007f145f33ccc0 in asio::detail::task_io_service::do_run_one (this=this@entry=0x55ec59209a40, lock=..., this_thread=..., ec=...) at asio/asio/detail/impl/task_io_service.ipp:355 #3 0x00007f145f33cf72 in asio::detail::task_io_service::run (this=0x55ec59209a40, ec=...) at asio/asio/detail/impl/task_io_service.ipp:148 #4 0x00007f145f3549fd in asio::io_service::run (this=0x55ec592087a0) at asio/asio/impl/io_service.ipp:58 #5 0x00007f145f355151 in gcomm::AsioProtonet::event_loop (this=0x55ec59208700, period=...) at gcomm/src/asio_protonet.cpp:116 #6 0x00007f145f37401d in GCommConn::run (this=0x55ec59209220) at gcs/src/gcs_gcomm.cpp:498 #7 0x00007f145f3770c9 in GCommConn::run_fn (arg=) at gcs/src/gcs_gcomm.cpp:209 #8 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #9 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7f145fed1700 (LWP 491)): #0 0x00007f146743cd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055ec56b2fa27 in safe_cond_timedwait (cond=0x55ec58184ca0 , mp=0x55ec58184be0 , abstime=0x7f145fed0d70, file=0x55ec56ffd700 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:546 #2 0x000055ec56b30a6a in inline_mysql_cond_timedwait (that=0x55ec58184ca0 , mutex=0x55ec58184be0 , abstime=0x7f145fed0d70, src_file=0x55ec56ffd740 "/home/stepan/mariadb/10.4/git/mysys/thr_timer.c", src_line=292) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1204 #3 0x000055ec56b3162d in timer_handler (arg=0x0) at /home/stepan/mariadb/10.4/git/mysys/thr_timer.c:292 #4 0x000055ec56ab800b in pfs_spawn_thread (arg=0x55ec591910d0) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #5 0x00007f1467438dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f14657f5ead in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7f1467848880 (LWP 488)): #0 0x00007f146743d9d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x000055ec56b2a0b2 in my_write_core (sig=6) at /home/stepan/mariadb/10.4/git/mysys/stacktrace.c:481 #2 0x000055ec5629619c in handle_fatal_signal (sig=6) at /home/stepan/mariadb/10.4/git/sql/signal_handler.cc:343 #3 #4 0x00007f14657eb20d in poll () from /lib64/libc.so.6 #5 0x000055ec55df784a in handle_connections_sockets () at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:6456 #6 0x000055ec55df6ae5 in mysqld_main (argc=164, argv=0x55ec59060380) at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:5892 #7 0x000055ec55dea615 in main (argc=24, argv=0x7ffce590ad78) at /home/stepan/mariadb/10.4/git/sql/main.cc:25 Compressed file /home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_gcs_fc_limit-innodb/mysqld.2/data/core.488 - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_gcs_fc_limit-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_gcs_fc_limit-innodb/' ***Warnings generated in error logs during shutdown after running tests: galera.galera_fk_multitable galera.galera_toi_ddl_fk_insert galera.galera_fk_selfreferential galera.galera_create_function galera.galera_commit_empty galera.galera_events galera.galera_change_user galera.galera_alter_engine_innodb galera.galera_bf_abort_lock_table galera.galera_FK_duplicate_client_insert galera.MW-258 galera.galera_ftwrl_drain galera.galera_rsu_add_pk galera.MW-357 galera.galera_toi_ddl_fk_update galera.MDEV-16509 galera.galera_fk_cascade_update galera.galera_ddl_multiline galera.galera_bf_abort galera.galera_bf_abort_ftwrl galera.galera_create_table_as_select galera.GCF-939 galera.MW-369 galera.galera_fk_setnull galera.galera_alter_table_force galera.galera_fk_cascade_delete galera.GAL-480 galera.galera_bf_abort_sleep galera.galera_create_table_like galera.MDEV-20225 galera.galera_toi_ddl_error galera.MW-328D galera.galera_var_load_data_splitting galera.MW-416 galera.galera_wsrep_desync_wsrep_on galera.galera_events2 galera.basic galera.MW-309 galera.galera_bf_abort_at_after_statement galera.GAL-382 galera.galera_enum galera.MW-402 galera.galera_fk_multicolumn galera.MW-285 galera.enforce_storage_engine galera.binlog_checksum galera.galera_binlog_cache_size galera.create galera.galera_admin galera.GAL-401 galera.galera_create_procedure galera.MW-292 galera.galera_alter_engine_myisam galera.galera_create_trigger galera.galera_rsu_drop_pk galera.galera_bf_abort_flush_for_export galera.galera_ftwrl galera.MW-328E galera.galera_delete_limit galera.galera_drop_database galera.galera_desync_overlapped galera.galera_bf_abort_for_update galera.galera_applier_ftwrl_table galera.galera_drop_multi galera.galera_defaults galera.fk galera.MW-252 galera.galera_bf_abort_get_lock galera.galera_gcs_fc_limit galera.galera_fk_mismatch galera.galera_fk_no_pk galera.ev51914 galera.galera_binlog_row_image galera.galera#505 galera.MW-259 galera.galera_bf_abort_shutdown galera.galera_fk_conflict galera.galera#500 Attempting backtrace. You can use the following information to find out Attempting backtrace. You can use the following information to find out 191222 0:54:55 +24.356 galera.galera_gra_log 'innodb' [ pass ] 2109 191222 0:54:57 +2.461 galera.galera_insert_ignore 'innodb' [ pass ] 2199 191222 0:55:00 +2.612 galera.galera_insert_multi 'innodb' [ pass ] 2335 191222 0:55:12 +12.323 galera.galera_kill_applier 'innodb' [ pass ] 2085 191222 0:55:36 +23.838 galera.galera_kill_ddl 'innodb' [ pass ] 18334 191222 0:55:56 +19.479 galera.galera_kill_smallchanges 'innodb' [ pass ] 19167 191222 0:55:58 +2.330 galera.galera_last_committed_id 'innodb' [ pass ] 2091 191222 0:56:02 +4.501 galera.galera_lock_table 'innodb' [ pass ] 4171 191222 0:56:07 +4.465 galera.galera_many_indexes 'innodb' [ pass ] 4209 191222 0:56:13 +6.301 galera.galera_mdev_10812 'innodb' [ pass ] 6079 191222 0:56:16 +2.407 galera.galera_mdl_race 'innodb' [ pass ] 2149 191222 0:56:18 +2.463 galera.galera_multi_database 'innodb' [ pass ] 2191 191222 0:56:20 +2.327 galera.galera_myisam_autocommit 'innodb' [ pass ] 2094 191222 0:56:23 +2.406 galera.galera_myisam_transactions 'innodb' [ pass ] 2123 191222 0:56:25 +2.383 galera.galera_nopk_bit 'innodb' [ pass ] 2144 191222 0:56:28 +2.394 galera.galera_nopk_blob 'innodb' [ pass ] 2155 191222 0:56:30 +2.407 galera.galera_nopk_large_varchar 'innodb' [ pass ] 2156 191222 0:56:32 +2.342 galera.galera_nopk_unicode 'innodb' [ pass ] 2099 191222 0:56:37 +4.482 galera.galera_parallel_apply_lock_table 'innodb' [ pass ] 4157 191222 0:56:39 +2.460 galera.galera_parallel_simple 'innodb' [ pass ] 2239 191222 0:57:00 +20.827 galera.galera_pc_ignore_sb 'innodb' [ pass ] 20504 191222 0:57:03 +2.393 galera.galera_performance_schema 'innodb' [ pass ] 2142 191222 0:57:05 +2.353 galera.galera_pk_bigint_signed 'innodb' [ pass ] 2097 191222 0:57:07 +2.346 galera.galera_pk_bigint_unsigned 'innodb' [ pass ] 2096 191222 0:57:10 +2.529 galera.galera_prepared_statement 'innodb' [ pass ] 2267 191222 0:57:12 +2.329 galera.galera_read_only 'innodb' [ pass ] 2107 191222 0:57:14 +2.393 galera.galera_repl_key_format_flat16 'innodb' [ pass ] 2137 191222 0:57:17 +2.326 galera.galera_repl_max_ws_size 'innodb' [ pass ] 2087 191222 0:57:26 +9.635 galera.galera_restart_nochanges 'innodb' [ pass ] 9316 191222 0:58:44 +77.395 galera.galera_restart_on_unknown_option 'innodb' [ pass ] 77083 191222 0:58:50 +5.775 galera.galera_roles 'innodb' [ pass ] 5508 191222 0:58:52 +2.410 galera.galera_rsu_error 'innodb' [ pass ] 2119 191222 0:58:54 +2.330 galera.galera_rsu_simple 'innodb' [ pass ] 2089 191222 0:58:59 +4.660 galera.galera_rsu_wsrep_desync 'innodb' [ pass ] 4370 191222 0:59:01 +2.328 galera.galera_sbr 'innodb' [ pass ] 2071 191222 0:59:04 +2.264 galera.galera_schema_dirty_reads 'innodb' [ pass ] 2025 191222 0:59:10 +6.416 galera.galera_serializable 'innodb' [ pass ] 6098 191222 0:59:12 +2.342 galera.galera_server 'innodb' [ pass ] 2048 191222 0:59:31 +18.817 galera.galera_shutdown_nonprim 'innodb' [ pass ] 18547 191222 0:59:34 +3.034 galera.galera_sp_bf_abort 'innodb' [ pass ] 2749 191222 0:59:46 +12.019 galera.galera_sp_insert_parallel 'innodb' [ pass ] 11648 191222 0:59:49 +2.326 galera.galera_sql_log_bin_zero 'innodb' [ pass ] 2072 191222 0:59:51 +2.276 galera.galera_status_cluster 'innodb' [ pass ] 2019 191222 0:59:53 +2.329 galera.galera_status_local_index 'innodb' [ pass ] 2084 191222 0:59:55 +2.279 galera.galera_status_local_state 'innodb' [ pass ] 2025 191222 1:00:21 +25.669 galera.galera_suspend_slave 'innodb' [ pass ] 25278 191222 1:00:24 +2.481 galera.galera_sync_wait_show 'innodb' [ pass ] 2233 191222 1:00:28 +4.562 galera.galera_toi_alter_auto_increment 'innodb' [ pass ] 4332 191222 1:00:35 +6.525 galera.galera_toi_ddl_locking 'innodb' [ pass ] 6264 191222 1:00:37 +2.397 galera.galera_toi_ddl_nonconflicting 'innodb' [ pass ] 2127 191222 1:00:39 +2.392 galera.galera_toi_ddl_sequential 'innodb' [ pass ] 2136 191222 1:02:01 +81.749 galera.galera_toi_drop_database 'innodb' [ pass ] 81153 191222 1:02:04 +2.397 galera.galera_toi_ftwrl 'innodb' [ pass ] 2113 191222 1:02:07 +3.336 galera.galera_toi_lock_exclusive 'innodb' [ pass ] 3117 191222 1:02:09 +2.360 galera.galera_toi_lock_shared 'innodb' [ pass ] 2102 191222 1:02:29 +19.742 galera.galera_toi_truncate 'innodb' [ pass ] 19378 191222 1:02:31 +2.328 galera.galera_transaction_read_only 'innodb' [ pass ] 2076 191222 1:02:34 +2.598 galera.galera_transaction_replay 'innodb' [ pass ] 2320 191222 1:02:37 +2.684 galera.galera_truncate 'innodb' [ pass ] 2436 191222 1:02:39 +2.530 galera.galera_truncate_temporary 'innodb' [ pass ] 2277 191222 1:02:42 +2.532 galera.galera_unicode_identifiers 'innodb' [ pass ] 2273 191222 1:02:44 +2.327 galera.galera_unicode_pk 'innodb' [ pass ] 2093 191222 1:02:47 +2.482 galera.galera_update_limit 'innodb' [ pass ] 2199 191222 1:02:49 +2.458 galera.galera_var_OSU_method 'innodb' [ pass ] 2182 191222 1:02:51 +2.476 galera.galera_var_OSU_method2 'innodb' [ pass ] 2193 191222 1:02:56 +4.375 galera.galera_var_auto_inc_control_off 'innodb' [ pass ] 4096 191222 1:02:58 +2.394 galera.galera_var_certify_nonPK_off 'innodb' [ pass ] 2130 191222 1:03:05 +6.546 galera.galera_var_cluster_address 'innodb' [ pass ] 6252 191222 1:03:08 +3.456 galera.galera_var_desync_on 'innodb' [ pass ] 3178 191222 1:03:13 +4.582 galera.galera_var_dirty_reads 'innodb' [ pass ] 4319 191222 1:03:15 +2.411 galera.galera_var_fkchecks 'innodb' [ pass ] 2142 191222 1:03:18 +3.129 galera.galera_var_ignore_apply_errors 'innodb' [ pass ] 2886 191222 1:03:33 +14.440 galera.galera_var_max_ws_rows 'innodb' [ pass ] 14106 191222 1:03:35 +2.342 galera.galera_var_max_ws_size 'innodb' [ pass ] 2067 191222 1:03:38 +2.344 galera.galera_var_mysql_replication_bundle 'innodb' [ pass ] 2075 191222 1:03:40 +2.359 galera.galera_var_replicate_myisam_off 'innodb' [ pass ] 2043 191222 1:03:43 +2.669 galera.galera_var_replicate_myisam_on 'innodb' [ pass ] 2435 191222 1:03:45 +2.466 galera.galera_var_sync_wait 'innodb' [ pass ] 2218 191222 1:03:47 +2.329 galera.galera_var_wsrep_on_off 'innodb' [ pass ] 2083 191222 1:03:50 +2.279 galera.galera_wsrep_provider_options_syntax 'innodb' [ pass ] 2026 191222 1:03:55 +5.661 galera.galera_wsrep_provider_unset_set 'innodb' [ pass ] 5337 191222 1:03:58 +2.407 galera.galera_zero_length_column 'innodb' [ pass ] 2164 191222 1:04:00 +2.341 galera.grant 'innodb' [ pass ] 2063 191222 1:04:02 +2.343 galera.lp1276424 'innodb' [ pass ] 2091 191222 1:04:05 +2.343 galera.lp1347768 'innodb' [ pass ] 2074 191222 1:04:09 +4.377 galera.lp1376747 'innodb' [ pass ] 4144 191222 1:04:11 +2.412 galera.lp1376747-2 'innodb' [ pass ] 2134 191222 1:04:14 +2.381 galera.lp1376747-3 'innodb' [ pass ] 2137 191222 1:04:23 +9.386 galera.lp1376747-4 'innodb' [ pass ] 9130 191222 1:04:26 +2.462 galera.lp1438990 'innodb' [ pass ] 2217 191222 1:04:28 +2.427 galera.lp959512 'innodb' [ pass ] 2161 191222 1:04:30 +2.325 galera.mdev_9290 'innodb' [ pass ] 2073 191222 1:04:33 +2.452 galera.mysql-wsrep#110 'innodb' [ pass ] 2211 191222 1:04:36 +3.362 galera.mysql-wsrep#237 'innodb' [ pass ] 3110 191222 1:04:40 +3.349 galera.mysql-wsrep#247 'innodb' [ pass ] 3072 191222 1:04:50 +10.733 galera.mysql-wsrep#31 'innodb' [ pass ] 10452 191222 1:05:01 +10.471 galera.mysql-wsrep#332 'innodb' [ pass ] 2983 191222 1:05:03 +2.601 galera.mysql-wsrep#90 'innodb' [ pass ] 2365 191222 1:05:09 +5.652 galera.pxc-421 'innodb' [ pass ] 5401 191222 1:05:11 +2.402 galera.rename 'innodb' [ pass ] 2144 191222 1:05:14 +2.452 galera.sql_log_bin 'innodb' [ pass ] 2226 191222 1:05:16 +2.400 galera.unique_key 'innodb' [ pass ] 2141 191222 1:05:19 +2.482 galera.view 'innodb' [ pass ] 2198 191222 1:05:21 +2.278 galera.wsrep_trx_fragment_size_sr 'innodb' [ pass ] 2019 191222 1:05:46 +24.930 galera.MDEV-15443 'innodb' [ pass ] 9215 191222 1:06:04 +17.860 galera.MDEV-18832 'innodb' [ pass ] 2179 191222 1:07:21 +76.913 galera.MDEV-6860 'innodb' [ fail ] Test ended at 2019-12-22 01:07:21 CURRENT_TEST: galera.MDEV-6860 mysqltest: In included file "./include/wait_until_ready.inc": included from ./include/have_wsrep_enabled.inc at line 11: included from ./include/galera_init.inc at line 15: included from ./include/galera_cluster.inc at line 11: included from /home/stepan/mariadb/10.4/git/mysql-test/suite/galera/t/MDEV-6860.test at line 4: At line 29: The result from queries just before the failure was: =============================================== Node still not ready after a minute, giving up! =============================================== - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.MDEV-6860-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.MDEV-6860-innodb/' 191222 1:07:37 +16.428 galera.MW-284 'innodb' [ fail ] Test ended at 2019-12-22 01:07:37 CURRENT_TEST: galera.MW-284 --- /home/stepan/mariadb/10.4/git/mysql-test/suite/galera/r/MW-284.result 2019-12-19 15:22:17.061804649 +0200 +++ /home/stepan/mariadb/10.4/git/mysql-test/suite/galera/r/MW-284.reject 2019-12-22 01:07:37.387197573 +0200 @@ -12,7 +12,7 @@ connection node_3; SELECT @@wsrep_on; @@wsrep_on -0 +1 START SLAVE; include/wait_for_slave_param.inc [Slave_IO_Running] connection node_1; mysqltest: Result content mismatch - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.MW-284-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.MW-284-innodb/' 191222 1:07:45 +7.749 galera.MW-313 'innodb' [ pass ] 2144 191222 1:08:13 +27.876 galera.MW-336 'innodb' [ pass ] 2210 191222 1:08:23 +10.007 galera.MW-86-wait8 'innodb' [ pass ] 4421 191222 1:08:40 +17.516 galera.enforce_storage_engine2 'innodb' [ pass ] 2100 191222 1:09:04 +23.717 galera.galera#414 'innodb' [ pass ] 8181 191222 1:09:24 +20.211 galera.galera_applier_ftwrl_table_alter 'innodb' [ pass ] 8143 191222 1:09:43 +18.221 galera.galera_as_master 'innodb' [ pass ] 2488 191222 1:09:52 +9.236 galera.galera_as_master_large 'innodb' [ pass ] 2148 191222 1:10:59 +67.723 galera.galera_as_slave 'innodb' [ fail ] Test ended at 2019-12-22 01:10:59 CURRENT_TEST: galera.galera_as_slave mysqltest: In included file "./include/wait_until_ready.inc": included from ./include/have_wsrep_enabled.inc at line 11: included from ./include/galera_init.inc at line 15: included from ./include/galera_cluster.inc at line 11: included from /home/stepan/mariadb/10.4/git/mysql-test/suite/galera/t/galera_as_slave.test at line 9: At line 29: The result from queries just before the failure was: =============================================== Node still not ready after a minute, giving up! =============================================== - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_as_slave-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_as_slave-innodb/' 191222 1:12:06 +66.840 galera.galera_as_slave_autoinc 'innodb' [ fail ] Test ended at 2019-12-22 01:12:06 CURRENT_TEST: galera.galera_as_slave_autoinc mysqltest: In included file "./include/wait_until_ready.inc": included from ./include/have_wsrep_enabled.inc at line 11: included from ./include/galera_init.inc at line 15: included from ./include/galera_cluster.inc at line 11: included from /home/stepan/mariadb/10.4/git/mysql-test/suite/galera/t/galera_as_slave_autoinc.test at line 9: At line 29: The result from queries just before the failure was: =============================================== Node still not ready after a minute, giving up! =============================================== - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_as_slave_autoinc-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_as_slave_autoinc-innodb/' 191222 1:12:13 +6.439 galera.galera_as_slave_ctas 'innodb' [ pass ] 809 191222 1:13:26 +73.401 galera.galera_as_slave_gtid 'innodb' [ fail ] Test ended at 2019-12-22 01:13:26 CURRENT_TEST: galera.galera_as_slave_gtid mysqltest: In included file "./include/wait_until_ready.inc": included from ./include/have_wsrep_enabled.inc at line 11: included from ./include/galera_init.inc at line 15: included from ./include/galera_cluster.inc at line 11: included from /home/stepan/mariadb/10.4/git/mysql-test/suite/galera/t/galera_as_slave_gtid.inc at line 12: included from /home/stepan/mariadb/10.4/git/mysql-test/suite/galera/t/galera_as_slave_gtid.test at line 11: At line 29: The result from queries just before the failure was: =============================================== Node still not ready after a minute, giving up! =============================================== - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_as_slave_gtid-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_as_slave_gtid-innodb/' 191222 1:14:33 +66.880 galera.galera_as_slave_gtid_auto_engine 'innodb' [ fail ] Test ended at 2019-12-22 01:14:33 CURRENT_TEST: galera.galera_as_slave_gtid_auto_engine mysqltest: In included file "./include/wait_until_ready.inc": included from ./include/have_wsrep_enabled.inc at line 11: included from ./include/galera_init.inc at line 15: included from ./include/galera_cluster.inc at line 11: included from /home/stepan/mariadb/10.4/git/mysql-test/suite/galera/t/galera_as_slave_gtid.inc at line 12: included from /home/stepan/mariadb/10.4/git/mysql-test/suite/galera/t/galera_as_slave_gtid_auto_engine.test at line 11: At line 29: The result from queries just before the failure was: =============================================== Node still not ready after a minute, giving up! =============================================== - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_as_slave_gtid_auto_engine-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_as_slave_gtid_auto_engine-innodb/' 191222 1:14:39 +6.232 galera.galera_as_slave_gtid_myisam 'innodb' [ pass ] 617 191222 1:15:53 +73.634 galera.galera_as_slave_gtid_replicate_do_db 'innodb' [ fail ] Test ended at 2019-12-22 01:15:53 CURRENT_TEST: galera.galera_as_slave_gtid_replicate_do_db mysqltest: In included file "./include/wait_until_ready.inc": included from ./include/have_wsrep_enabled.inc at line 11: included from ./include/galera_init.inc at line 15: included from ./include/galera_cluster.inc at line 11: included from /home/stepan/mariadb/10.4/git/mysql-test/suite/galera/t/galera_as_slave_gtid_replicate_do_db.test at line 7: At line 29: The result from queries just before the failure was: =============================================== Node still not ready after a minute, giving up! =============================================== - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_as_slave_gtid_replicate_do_db-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_as_slave_gtid_replicate_do_db-innodb/' 191222 1:16:18 +24.792 galera.galera_as_slave_nonprim 'innodb' [ pass ] 17204 191222 1:16:31 +13.321 galera.galera_bf_background_statistics 'innodb' [ pass ] 7252 191222 1:16:49 +17.679 galera.galera_binlog_checksum 'innodb' [ pass ] 2108 191222 1:17:24 +34.938 galera.galera_binlog_event_max_size_max 'innodb' [ pass ] 19163 191222 1:17:41 +17.746 galera.galera_binlog_event_max_size_min 'innodb' [ pass ] 2072 191222 1:18:06 +24.804 galera.galera_flush_local 'innodb' [ pass ] 9132 191222 1:18:47 +41.163 galera.galera_gcache_recover 'innodb' [ pass ] 25654 191222 1:19:27 +39.241 galera.galera_gcache_recover_full_gcache 'innodb' [ pass ] 26256 191222 1:19:43 +16.846 galera.galera_gcs_fragment 'innodb' [ pass ] 5249 191222 1:20:02 +18.153 galera.galera_gcs_max_packet_size 'innodb' [ pass ] 5330 191222 1:20:16 +14.580 galera.galera_gtid 'innodb' [ pass ] 2079 191222 1:21:33 +76.958 galera.galera_gtid_slave 'innodb' [ fail ] Test ended at 2019-12-22 01:21:33 CURRENT_TEST: galera.galera_gtid_slave mysqltest: In included file "./include/wait_until_ready.inc": included from ./include/have_wsrep_enabled.inc at line 11: included from ./include/galera_init.inc at line 15: included from ./include/galera_cluster.inc at line 11: included from /home/stepan/mariadb/10.4/git/mysql-test/suite/galera/t/galera_gtid_slave.test at line 12: At line 29: The result from queries just before the failure was: =============================================== Node still not ready after a minute, giving up! =============================================== - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_gtid_slave-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_gtid_slave-innodb/' 191222 1:22:40 +66.889 galera.galera_gtid_slave_sst_rsync 'innodb' [ fail ] Test ended at 2019-12-22 01:22:40 CURRENT_TEST: galera.galera_gtid_slave_sst_rsync mysqltest: In included file "./include/wait_until_ready.inc": included from ./include/have_wsrep_enabled.inc at line 11: included from ./include/galera_init.inc at line 15: included from ./include/galera_cluster.inc at line 11: included from /home/stepan/mariadb/10.4/git/mysql-test/suite/galera/t/galera_gtid_slave_sst_rsync.test at line 12: At line 29: The result from queries just before the failure was: =============================================== Node still not ready after a minute, giving up! =============================================== - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_gtid_slave_sst_rsync-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_gtid_slave_sst_rsync-innodb/' 191222 1:23:36 +55.716 galera.galera_ist_mariabackup_innodb_flush_logs 'debug,innodb' [ pass ] 39731 191222 1:23:59 +23.570 galera.galera_ist_mysqldump 'debug,innodb' [ fail ] Test ended at 2019-12-22 01:23:59 CURRENT_TEST: galera.galera_ist_mysqldump Server [mysqld.2 - pid: 7934, winpid: 7934, exit: 256] failed during test run Server log from this test: ----------SERVER LOG START----------- 2019-12-22 1:23:43 0 [Warning] WSREP: option --wsrep-causal-reads is deprecated 2019-12-22 1:23:43 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld (mysqld 10.4.12-MariaDB-debug-log) starting as process 6991 ... 2019-12-22 1:23:43 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4186) 2019-12-22 1:23:43 0 [Warning] Changed limits: max_open_files: 1024 max_connections: 151 (was 151) table_cache: 421 (was 2000) 2019-12-22 1:23:43 0 [Note] WSREP: Loading provider /usr/lib/libgalera_smm_4.so initial position: 00000000-0000-0000-0000-000000000000:-1 wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_smm_4.so' wsrep loader: [INFO] wsrep_load(): Galera 26.4.3(r4548) by Codership Oy loaded successfully. 2019-12-22 1:23:43 0 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-12-22 1:23:43 0 [Warning] WSREP: Could not open state file for reading: '/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//grastate.dat' 2019-12-22 1:23:43 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1 2019-12-22 1:23:43 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 0 UUID: 00000000-0000-0000-0000-000000000000 Seqno: -1 - -1 Offset: -1 Synced: 0 2019-12-22 1:23:43 0 [Note] WSREP: Skipped GCache ring buffer recovery: could not determine history UUID. 2019-12-22 1:23:43 0 [Note] WSREP: Passing config to GCS: base_dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; base_host = 127.0.0.1; base_port = 16005; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limi 2019-12-22 1:23:43 0 [Note] WSREP: Start replication 2019-12-22 1:23:43 0 [Note] WSREP: Connecting with bootstrap option: 0 2019-12-22 1:23:43 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1 2019-12-22 1:23:43 0 [Note] WSREP: protonet asio version 0 2019-12-22 1:23:43 0 [Note] WSREP: Using CRC-32C for message checksums. 2019-12-22 1:23:43 0 [Note] WSREP: backend: asio 2019-12-22 1:23:43 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-12-22 1:23:43 0 [Warning] WSREP: access file(/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//gvwstate.dat) failed(No such file or directory) 2019-12-22 1:23:43 0 [Note] WSREP: restore pc from disk failed 2019-12-22 1:23:43 0 [Note] WSREP: GMCast version 0 2019-12-22 1:23:43 0 [Note] WSREP: (edb43283, 'tcp://0.0.0.0:16005') listening at tcp://0.0.0.0:16005 2019-12-22 1:23:43 0 [Note] WSREP: (edb43283, 'tcp://0.0.0.0:16005') multicast: , ttl: 1 2019-12-22 1:23:43 0 [Note] WSREP: EVS version 1 2019-12-22 1:23:43 0 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '127.0.0.1:16002' 2019-12-22 1:23:43 0 [Note] WSREP: (edb43283, 'tcp://0.0.0.0:16005') connection established to ed7090af tcp://127.0.0.1:16002 2019-12-22 1:23:43 0 [Note] WSREP: (edb43283, 'tcp://0.0.0.0:16005') turning message relay requesting on, nonlive peers: 2019-12-22 1:23:43 0 [Note] WSREP: EVS version upgrade 0 -> 1 2019-12-22 1:23:43 0 [Note] WSREP: declaring ed7090af at tcp://127.0.0.1:16002 stable 2019-12-22 1:23:43 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2019-12-22 1:23:43 0 [Note] WSREP: Node ed7090af state prim 2019-12-22 1:23:43 0 [Note] WSREP: view(view_id(PRIM,ed7090af,2) memb { ed7090af,0 edb43283,0 } joined { } left { } partitioned { }) 2019-12-22 1:23:43 0 [Note] WSREP: save pc into disk 2019-12-22 1:23:44 0 [Note] WSREP: gcomm: connected 2019-12-22 1:23:44 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-12-22 1:23:44 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-12-22 1:23:44 0 [Note] WSREP: Opened channel 'my_wsrep_cluster' 2019-12-22 1:23:44 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2019-12-22 1:23:44 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2019-12-22 1:23:44 0 [Note] WSREP: STATE EXCHANGE: sent state msg: ee02fa98-2448-11ea-b75c-5a17cc9acf62 2019-12-22 1:23:44 0 [Note] WSREP: STATE EXCHANGE: got state msg: ee02fa98-2448-11ea-b75c-5a17cc9acf62 from 0 (cnt7glr11.localdomain) 2019-12-22 1:23:44 0 [Note] WSREP: STATE EXCHANGE: got state msg: ee02fa98-2448-11ea-b75c-5a17cc9acf62 from 1 (cnt7glr11.localdomain) 2019-12-22 1:23:44 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 1, members = 1/2 (joined/total), act_id = 1, last_appl. = 0, protocols = 2/10/4 (gcs/repl/appl), vote policy= 0, group UUID = ed7160c0-2448-11ea-af15-56eb995a541c 2019-12-22 1:23:44 0 [Note] WSREP: Flow-control interval: [23, 23] 2019-12-22 1:23:44 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 2) 2019-12-22 1:23:44 1 [Note] WSREP: Starting rollbacker thread 1 2019-12-22 1:23:44 2 [Note] WSREP: Starting applier thread 2 2019-12-22 1:23:44 2 [Note] WSREP: ####### processing CC 2, local, ordered 2019-12-22 1:23:44 2 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:23:44 2 [Note] WSREP: ####### My UUID: edb43283-2448-11ea-ac05-d31bf7094945 2019-12-22 1:23:44 2 [Note] WSREP: Server cnt7glr11.localdomain connected to cluster at position ed7160c0-2448-11ea-af15-56eb995a541c:2 with ID edb43283-2448-11ea-ac05-d31bf7094945 2019-12-22 1:23:44 2 [Note] WSREP: Server status change disconnected -> connected 2019-12-22 1:23:44 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:44 2 [Note] WSREP: State transfer required: Group state: ed7160c0-2448-11ea-af15-56eb995a541c:2 Local state: 00000000-0000-0000-0000-000000000000:-1 2019-12-22 1:23:44 2 [Note] WSREP: Server status change connected -> joiner 2019-12-22 1:23:44 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:44 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '127.0.0.2:16007' --datadir '/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.2' --parent '6991' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.2 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' 2019-12-22 1:23:44 2 [Note] WSREP: Prepared SST request: rsync|127.0.0.2:16007/rsync_sst 2019-12-22 1:23:44 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes 2019-12-22 1:23:44 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:23:44 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: 5 2019-12-22 1:23:44 2 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 2, STRv: 3 2019-12-22 1:23:44 2 [Note] WSREP: IST receiver addr using tcp://127.0.0.1:16006 2019-12-22 1:23:44 2 [Note] WSREP: Prepared IST receiver for 0-2, listening at: tcp://127.0.0.1:16006 2019-12-22 1:23:44 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) requested state transfer from '*any*'. Selected 0.0 (cnt7glr11.localdomain)(SYNCED) as donor. 2019-12-22 1:23:44 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 2) 2019-12-22 1:23:44 2 [Note] WSREP: Requesting state transfer: success, donor: 0 2019-12-22 1:23:44 2 [Note] WSREP: Resetting GCache seqno map due to different histories. 2019-12-22 1:23:44 2 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0 -> ed7160c0-2448-11ea-af15-56eb995a541c:2 2019-12-22 1:23:45 0 [Note] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) complete. 2019-12-22 1:23:45 0 [Note] WSREP: Member 0.0 (cnt7glr11.localdomain) synced with group. 2019-12-22 1:23:46 0 [Note] WSREP: (edb43283, 'tcp://0.0.0.0:16005') turning message relay requesting off WSREP_SST: [INFO] Joiner cleanup. rsync PID: 7131 (20191222 01:23:46.409) WSREP_SST: [INFO] Joiner cleanup done. (20191222 01:23:46.917) 2019-12-22 1:23:46 3 [Note] WSREP: SST received 2019-12-22 1:23:46 3 [Note] WSREP: Server status change joiner -> initializing 2019-12-22 1:23:46 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:46 0 [Note] Plugin 'partition' is disabled. 2019-12-22 1:23:46 0 [Note] Plugin 'SEQUENCE' is disabled. 2019-12-22 1:23:46 0 [Note] InnoDB: Using Linux native AIO 2019-12-22 1:23:46 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!! 2019-12-22 1:23:46 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-12-22 1:23:46 0 [Note] InnoDB: Uses event mutexes 2019-12-22 1:23:46 0 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-12-22 1:23:46 0 [Note] InnoDB: Number of pools: 1 2019-12-22 1:23:46 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-12-22 1:23:46 0 [Note] mysqld: O_TMPFILE is not supported on /home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2 (disabling future attempts) 2019-12-22 1:23:46 0 [Note] InnoDB: Initializing buffer pool, total size = 8M, instances = 1, chunk size = 8M 2019-12-22 1:23:46 0 [Note] InnoDB: Completed initialization of buffer pool 2019-12-22 1:23:46 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-12-22 1:23:46 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=68855 2019-12-22 1:23:46 0 [Note] InnoDB: Starting final batch to recover 18 pages from redo log. 2019-12-22 1:23:47 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-12-22 1:23:47 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-12-22 1:23:47 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-12-22 1:23:47 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2019-12-22 1:23:47 0 [Note] InnoDB: Waiting for purge to start 2019-12-22 1:23:47 0 [Note] InnoDB: 10.4.12 started; log sequence number 78230; transaction id 46 2019-12-22 1:23:47 0 [Note] InnoDB: Loading buffer pool(s) from /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/ib_buffer_pool 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_MUTEXES' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_CMP' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'FEEDBACK' is disabled. 2019-12-22 1:23:47 0 [Note] InnoDB: Buffer pool(s) load completed at 191222 1:23:47 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'user_variables' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled. 2019-12-22 1:23:47 0 [Note] Plugin 'unix_socket' is disabled. 2019-12-22 1:23:47 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-pam-debug' 2019-12-22 1:23:47 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-aria' 2019-12-22 1:23:47 0 [Note] Server socket created on IP: '127.0.0.1'. 2019-12-22 1:23:47 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2019-12-22 1:23:47 0 [Note] WSREP: Server initialized 2019-12-22 1:23:47 0 [Note] WSREP: Server status change initializing -> initialized 2019-12-22 1:23:47 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:47 3 [Note] WSREP: Server status change initialized -> joined 2019-12-22 1:23:47 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:47 0 [Note] Reading of all Master_info entries succeeded 2019-12-22 1:23:47 0 [Note] Added new Master_info '' to hash table 2019-12-22 1:23:47 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld: ready for connections. Version: '10.4.12-MariaDB-debug-log' socket: '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2.sock' port: 16001 Source distribution 2019-12-22 1:23:47 3 [Note] WSREP: Recovered position from storage: ed7160c0-2448-11ea-af15-56eb995a541c:2 2019-12-22 1:23:47 3 [Note] WSREP: Recovered view from SST: id: ed7160c0-2448-11ea-af15-56eb995a541c:2 status: primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: no own_index: 1 members(2): 0: ed7090af-2448-11ea-81c6-73960b2e3a1d, cnt7glr11.localdomain 1: edb43283-2448-11ea-ac05-d31bf7094945, cnt7glr11.localdomain 2019-12-22 1:23:47 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:47 12 [Note] WSREP: Recovered cluster id ed7160c0-2448-11ea-af15-56eb995a541c 2019-12-22 1:23:47 3 [Note] WSREP: SST received: ed7160c0-2448-11ea-af15-56eb995a541c:2 2019-12-22 1:23:47 2 [Note] WSREP: Installed new state from SST: ed7160c0-2448-11ea-af15-56eb995a541c:2 2019-12-22 1:23:47 2 [Note] WSREP: Cert. index preload up to 2 2019-12-22 1:23:47 0 [Note] WSREP: ####### IST applying starts with 3 2019-12-22 1:23:47 0 [Note] WSREP: ####### IST current seqno initialized to 2 2019-12-22 1:23:47 0 [Note] WSREP: Receiving IST... 0.0% (0/1 events) complete. 2019-12-22 1:23:47 0 [Note] WSREP: IST preload starting at 2 2019-12-22 1:23:47 0 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:23:47 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:23:47 0 [Note] WSREP: ####### Assign initial position for certification: ed7160c0-2448-11ea-af15-56eb995a541c:1, protocol version: 5 2019-12-22 1:23:47 0 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:23:47 0 [Note] WSREP: ####### Adjusting cert position: 1 -> 2 2019-12-22 1:23:47 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:23:47 0 [Note] WSREP: Lowest cert indnex boundary for CC from preload: 2 2019-12-22 1:23:47 0 [Note] WSREP: Min available from gcache for CC from preload: 2 2019-12-22 1:23:47 0 [Note] WSREP: Receiving IST...100.0% (1/1 events) complete. 2019-12-22 1:23:47 2 [Note] WSREP: IST received: ed7160c0-2448-11ea-af15-56eb995a541c:2 2019-12-22 1:23:47 2 [Note] WSREP: Lowest cert indnex boundary for CC from group: 2 2019-12-22 1:23:47 2 [Note] WSREP: Min available from gcache for CC from group: 2 2019-12-22 1:23:47 0 [Note] WSREP: 1.0 (cnt7glr11.localdomain): State transfer from 0.0 (cnt7glr11.localdomain) complete. 2019-12-22 1:23:47 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 2) 2019-12-22 1:23:47 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) synced with group. 2019-12-22 1:23:47 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2) 2019-12-22 1:23:47 2 [Note] WSREP: Server cnt7glr11.localdomain synced with group 2019-12-22 1:23:47 2 [Note] WSREP: Server status change joined -> synced 2019-12-22 1:23:47 2 [Note] WSREP: Synchronized with group, ready for connections 2019-12-22 1:23:47 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:50 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld (initiated by: root[root] @ localhost [127.0.0.1]): Normal shutdown 2019-12-22 1:23:50 0 [Note] WSREP: Shutdown replication 2019-12-22 1:23:50 0 [Note] WSREP: Server status change synced -> disconnecting 2019-12-22 1:23:50 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:50 0 [Note] WSREP: Closing send monitor... 2019-12-22 1:23:50 0 [Note] WSREP: Closed send monitor. 2019-12-22 1:23:50 0 [Note] WSREP: gcomm: terminating thread 2019-12-22 1:23:50 0 [Note] WSREP: gcomm: joining thread 2019-12-22 1:23:50 0 [Note] WSREP: gcomm: closing backend 2019-12-22 1:23:51 0 [Note] WSREP: view(view_id(NON_PRIM,ed7090af,2) memb { edb43283,0 } joined { } left { } partitioned { ed7090af,0 }) 2019-12-22 1:23:51 0 [Note] WSREP: PC protocol downgrade 1 -> 0 2019-12-22 1:23:51 0 [Note] WSREP: view((empty)) 2019-12-22 1:23:51 0 [Note] WSREP: gcomm: closed 2019-12-22 1:23:51 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 2019-12-22 1:23:51 0 [Note] WSREP: Flow-control interval: [16, 16] 2019-12-22 1:23:51 0 [Note] WSREP: Received NON-PRIMARY. 2019-12-22 1:23:51 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 7) 2019-12-22 1:23:51 0 [Note] WSREP: New SELF-LEAVE. 2019-12-22 1:23:51 0 [Note] WSREP: Flow-control interval: [0, 0] 2019-12-22 1:23:51 0 [Note] WSREP: Received SELF-LEAVE. Closing connection. 2019-12-22 1:23:51 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: -1) 2019-12-22 1:23:51 0 [Note] WSREP: RECV thread exiting 0: Success 2019-12-22 1:23:51 2 [Note] WSREP: ####### processing CC -1, local, ordered 2019-12-22 1:23:51 0 [Note] WSREP: recv_thread() joined. 2019-12-22 1:23:51 0 [Note] WSREP: Closing replication queue. 2019-12-22 1:23:51 0 [Note] WSREP: Closing slave action queue. 2019-12-22 1:23:51 2 [Note] WSREP: ####### My UUID: edb43283-2448-11ea-ac05-d31bf7094945 2019-12-22 1:23:51 2 [Note] WSREP: ####### ST not required 2019-12-22 1:23:51 2 [Note] WSREP: ================================================ View: id: ed7160c0-2448-11ea-af15-56eb995a541c:-1 status: non-primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: no own_index: 0 members(1): 0: edb43283-2448-11ea-ac05-d31bf7094945, cnt7glr11.localdomain ================================================= 2019-12-22 1:23:51 2 [Note] WSREP: Non-primary view 2019-12-22 1:23:51 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:51 2 [Note] WSREP: ####### processing CC -1, local, ordered 2019-12-22 1:23:51 2 [Note] WSREP: ####### My UUID: edb43283-2448-11ea-ac05-d31bf7094945 2019-12-22 1:23:51 2 [Note] WSREP: ####### ST not required 2019-12-22 1:23:51 2 [Note] WSREP: ================================================ View: id: ed7160c0-2448-11ea-af15-56eb995a541c:-1 status: non-primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: yes own_index: -1 members(0): ================================================= 2019-12-22 1:23:51 2 [Note] WSREP: Non-primary view 2019-12-22 1:23:51 2 [Note] WSREP: Server status change disconnecting -> disconnected 2019-12-22 1:23:51 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:51 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:51 2 [Note] WSREP: Applier thread exiting ret: 0 thd: 2 2019-12-22 1:23:51 2 [Warning] Aborted connection 2 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) 2019-12-22 1:23:51 1 [Note] WSREP: rollbacker thread exiting 1 2019-12-22 1:23:51 1 [Warning] Aborted connection 1 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) 2019-12-22 1:23:51 0 [Note] InnoDB: FTS optimize thread exiting. 2019-12-22 1:23:51 0 [Note] Event Scheduler: Purging the queue. 0 events 2019-12-22 1:23:51 0 [Note] WSREP: dtor state: CLOSED 2019-12-22 1:23:51 0 [Note] WSREP: MemPool(TrxHandleSlave): hit ratio: 0, misses: 5, in use: 5, in pool: 0 2019-12-22 1:23:51 0 [Note] WSREP: mon: entered 5 oooe fraction 0 oool fraction 0 2019-12-22 1:23:51 0 [Note] WSREP: mon: entered 5 oooe fraction 0 oool fraction 0 2019-12-22 1:23:51 0 [Note] WSREP: mon: entered 10 oooe fraction 0 oool fraction 0.1 2019-12-22 1:23:51 0 [Note] WSREP: cert index usage at exit 5 2019-12-22 1:23:51 0 [Note] WSREP: cert trx map usage at exit 5 2019-12-22 1:23:51 0 [Note] WSREP: deps set usage at exit 0 2019-12-22 1:23:51 0 [Note] WSREP: avg deps dist 1.2 2019-12-22 1:23:51 0 [Note] WSREP: avg cert interval 0 2019-12-22 1:23:51 0 [Note] WSREP: cert index size 5 2019-12-22 1:23:51 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:23:51 0 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0 2019-12-22 1:23:51 0 [Note] WSREP: MemPool(LocalTrxHandle): hit ratio: 0, misses: 1, in use: 0, in pool: 1 2019-12-22 1:23:51 0 [Note] WSREP: trx map: conn query map: 2019-12-22 1:23:51 0 [Note] WSREP: Shifting CLOSED -> DESTROYED (TO: -1) 2019-12-22 1:23:51 0 [Note] WSREP: Flushing memory map to disk... 2019-12-22 1:23:51 0 [Note] InnoDB: Starting shutdown... 2019-12-22 1:23:51 0 [Note] InnoDB: Dumping buffer pool(s) to /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/ib_buffer_pool 2019-12-22 1:23:51 0 [Note] InnoDB: Instance 0, restricted to 123 pages due to innodb_buf_pool_dump_pct=25 2019-12-22 1:23:51 0 [Note] InnoDB: Buffer pool(s) dump completed at 191222 1:23:51 2019-12-22 1:23:52 0 [Note] InnoDB: Shutdown completed; log sequence number 84013; transaction id 53 2019-12-22 1:23:52 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2019-12-22 1:23:52 0 [Note] Debug sync points hit: 1831 2019-12-22 1:23:52 0 [Note] Debug sync points executed: 0 2019-12-22 1:23:52 0 [Note] Debug sync points max active per thread: 0 2019-12-22 1:23:52 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld: Shutdown complete 2019-12-22 1:23:54 0 [Warning] WSREP: option --wsrep-causal-reads is deprecated 2019-12-22 1:23:54 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld (mysqld 10.4.12-MariaDB-debug-log) starting as process 7945 ... 2019-12-22 1:23:54 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4186) 2019-12-22 1:23:54 0 [Warning] Changed limits: max_open_files: 1024 max_connections: 151 (was 151) table_cache: 421 (was 2000) 2019-12-22 1:23:54 0 [Warning] WSREP: wsrep_sst_method is set to 'mysqldump' yet mysqld bind_address is set to '127.0.0.1', which makes it impossible to receive state transfer from another node, since mysqld won't accept such connections. If you wish to use mysqldump state transfer method, set bind_address to allow mysql client connections from other cluster members (e.g. 0.0.0.0). 2019-12-22 1:23:54 0 [Warning] WSREP: wsrep_sst_receive_address is set to '127.0.0.1:16001' which makes it impossible for another host to reach this one. Please set it to the address which this node can be connected at by other cluster members. 2019-12-22 1:23:54 0 [Note] Plugin 'partition' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'SEQUENCE' is disabled. 2019-12-22 1:23:54 0 [Note] InnoDB: Using Linux native AIO 2019-12-22 1:23:54 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!! 2019-12-22 1:23:54 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-12-22 1:23:54 0 [Note] InnoDB: Uses event mutexes 2019-12-22 1:23:54 0 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-12-22 1:23:54 0 [Note] InnoDB: Number of pools: 1 2019-12-22 1:23:54 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-12-22 1:23:54 0 [Note] mysqld: O_TMPFILE is not supported on /home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2 (disabling future attempts) 2019-12-22 1:23:54 0 [Note] InnoDB: Initializing buffer pool, total size = 8M, instances = 1, chunk size = 8M 2019-12-22 1:23:54 0 [Note] InnoDB: Completed initialization of buffer pool 2019-12-22 1:23:54 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-12-22 1:23:54 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-12-22 1:23:54 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-12-22 1:23:54 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-12-22 1:23:54 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2019-12-22 1:23:54 0 [Note] InnoDB: Waiting for purge to start 2019-12-22 1:23:54 0 [Note] InnoDB: 10.4.12 started; log sequence number 84013; transaction id 55 2019-12-22 1:23:54 0 [Note] InnoDB: Loading buffer pool(s) from /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/ib_buffer_pool 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_MUTEXES' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_CMP' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'FEEDBACK' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'user_variables' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled. 2019-12-22 1:23:54 0 [Note] InnoDB: Buffer pool(s) load completed at 191222 1:23:54 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled. 2019-12-22 1:23:54 0 [Note] Plugin 'unix_socket' is disabled. 2019-12-22 1:23:54 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-pam-debug' 2019-12-22 1:23:54 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-aria' 2019-12-22 1:23:54 0 [Note] Server socket created on IP: '127.0.0.1'. 2019-12-22 1:23:54 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2019-12-22 1:23:54 0 [Note] WSREP: Server initialized 2019-12-22 1:23:54 0 [Note] WSREP: Server status change disconnected -> initializing 2019-12-22 1:23:54 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:54 0 [Note] WSREP: Server status change initializing -> initialized 2019-12-22 1:23:54 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:54 0 [Note] WSREP: Loading provider /usr/lib/libgalera_smm_4.so initial position: 00000000-0000-0000-0000-000000000000:-1 wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_smm_4.so' wsrep loader: [INFO] wsrep_load(): Galera 26.4.3(r4548) by Codership Oy loaded successfully. 2019-12-22 1:23:54 0 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-12-22 1:23:54 0 [Note] WSREP: Found saved state: ed7160c0-2448-11ea-af15-56eb995a541c:7, safe_to_bootstrap: 0 2019-12-22 1:23:54 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 2 UUID: ed7160c0-2448-11ea-af15-56eb995a541c Seqno: 2 - 7 Offset: 1280 Synced: 1 2019-12-22 1:23:54 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: ed7160c0-2448-11ea-af15-56eb995a541c, offset: 1280 2019-12-22 1:23:54 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/134217752 bytes) complete. 2019-12-22 1:23:54 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (134217752/134217752 bytes) complete. 2019-12-22 1:23:54 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 2-7 2019-12-22 1:23:54 0 [Note] WSREP: GCache::RingBuffer unused buffers scan... 0.0% ( 0/3728 bytes) complete. 2019-12-22 1:23:54 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (3728/3728 bytes) complete. 2019-12-22 1:23:54 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): found 0/6 locked buffers 2019-12-22 1:23:54 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): used space: 3728/134217728 2019-12-22 1:23:54 0 [Note] WSREP: Passing config to GCS: base_dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; base_host = 127.0.0.1; base_port = 16005; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limi 2019-12-22 1:23:54 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:23:54 0 [Note] WSREP: ####### Assign initial position for certification: ed7160c0-2448-11ea-af15-56eb995a541c:7, protocol version: -1 2019-12-22 1:23:54 0 [Note] WSREP: Start replication 2019-12-22 1:23:54 0 [Note] WSREP: Connecting with bootstrap option: 0 2019-12-22 1:23:54 0 [Note] WSREP: Setting GCS initial position to ed7160c0-2448-11ea-af15-56eb995a541c:7 2019-12-22 1:23:54 0 [Note] WSREP: protonet asio version 0 2019-12-22 1:23:54 0 [Note] WSREP: Using CRC-32C for message checksums. 2019-12-22 1:23:54 0 [Note] WSREP: backend: asio 2019-12-22 1:23:54 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-12-22 1:23:54 0 [Warning] WSREP: access file(/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//gvwstate.dat) failed(No such file or directory) 2019-12-22 1:23:54 0 [Note] WSREP: restore pc from disk failed 2019-12-22 1:23:54 0 [Note] WSREP: GMCast version 0 2019-12-22 1:23:54 0 [Note] WSREP: (f462897b, 'tcp://0.0.0.0:16005') listening at tcp://0.0.0.0:16005 2019-12-22 1:23:54 0 [Note] WSREP: (f462897b, 'tcp://0.0.0.0:16005') multicast: , ttl: 1 2019-12-22 1:23:54 0 [Note] WSREP: EVS version 1 2019-12-22 1:23:54 0 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '127.0.0.1:16002' 2019-12-22 1:23:54 0 [Note] WSREP: (f462897b, 'tcp://0.0.0.0:16005') connection established to ed7090af tcp://127.0.0.1:16002 2019-12-22 1:23:54 0 [Note] WSREP: (f462897b, 'tcp://0.0.0.0:16005') turning message relay requesting on, nonlive peers: 2019-12-22 1:23:54 0 [Note] WSREP: EVS version upgrade 0 -> 1 2019-12-22 1:23:54 0 [Note] WSREP: declaring ed7090af at tcp://127.0.0.1:16002 stable 2019-12-22 1:23:54 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2019-12-22 1:23:54 0 [Note] WSREP: Node ed7090af state prim 2019-12-22 1:23:54 0 [Note] WSREP: view(view_id(PRIM,ed7090af,4) memb { ed7090af,0 f462897b,0 } joined { } left { } partitioned { }) 2019-12-22 1:23:54 0 [Note] WSREP: save pc into disk 2019-12-22 1:23:55 0 [Note] WSREP: gcomm: connected 2019-12-22 1:23:55 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-12-22 1:23:55 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-12-22 1:23:55 0 [Note] WSREP: Opened channel 'my_wsrep_cluster' 2019-12-22 1:23:55 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2019-12-22 1:23:55 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2019-12-22 1:23:55 0 [Note] WSREP: STATE EXCHANGE: sent state msg: f4b00fb3-2448-11ea-9d62-cfe832ff3484 2019-12-22 1:23:55 0 [Note] WSREP: STATE EXCHANGE: got state msg: f4b00fb3-2448-11ea-9d62-cfe832ff3484 from 0 (cnt7glr11.localdomain) 2019-12-22 1:23:55 8 [Note] WSREP: Starting rollbacker thread 8 2019-12-22 1:23:55 0 [Note] WSREP: STATE EXCHANGE: got state msg: f4b00fb3-2448-11ea-9d62-cfe832ff3484 from 1 (cnt7glr11.localdomain) 2019-12-22 1:23:55 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 3, members = 1/2 (joined/total), act_id = 9, last_appl. = 0, protocols = 2/10/4 (gcs/repl/appl), vote policy= 0, group UUID = ed7160c0-2448-11ea-af15-56eb995a541c 2019-12-22 1:23:55 0 [Note] WSREP: Flow-control interval: [23, 23] 2019-12-22 1:23:55 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 10) 2019-12-22 1:23:55 7 [Note] WSREP: Starting applier thread 7 2019-12-22 1:23:55 7 [Note] WSREP: ####### processing CC 10, local, ordered 2019-12-22 1:23:55 7 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:23:55 7 [Note] WSREP: ####### My UUID: f462897b-2448-11ea-8e24-766e7fc7b091 2019-12-22 1:23:55 7 [Note] WSREP: Server cnt7glr11.localdomain connected to cluster at position ed7160c0-2448-11ea-af15-56eb995a541c:10 with ID f462897b-2448-11ea-8e24-766e7fc7b091 2019-12-22 1:23:55 7 [Note] WSREP: Server status change initialized -> connected 2019-12-22 1:23:55 7 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:55 7 [Note] WSREP: State transfer required: Group state: ed7160c0-2448-11ea-af15-56eb995a541c:10 Local state: ed7160c0-2448-11ea-af15-56eb995a541c:7 2019-12-22 1:23:55 7 [Note] WSREP: Server status change connected -> joiner 2019-12-22 1:23:55 7 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:23:55 7 [Note] WSREP: Prepared SST request: mysqldump|127.0.0.1:16001 2019-12-22 1:23:55 7 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes 2019-12-22 1:23:55 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:23:55 7 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: 5 2019-12-22 1:23:55 7 [Note] WSREP: ####### IST uuid:ed7160c0-2448-11ea-af15-56eb995a541c f: 8, l: 10, STRv: 3 2019-12-22 1:23:55 7 [Note] WSREP: IST receiver addr using tcp://127.0.0.1:16006 2019-12-22 1:23:55 7 [Note] WSREP: Prepared IST receiver for 8-10, listening at: tcp://127.0.0.1:16006 2019-12-22 1:23:55 0 [Note] Reading of all Master_info entries succeeded 2019-12-22 1:23:55 0 [Note] Added new Master_info '' to hash table 2019-12-22 1:23:55 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld: ready for connections. Version: '10.4.12-MariaDB-debug-log' socket: '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2.sock' port: 16001 Source distribution 2019-12-22 1:23:55 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) requested state transfer from '*any*'. Selected 0.0 (cnt7glr11.localdomain)(SYNCED) as donor. 2019-12-22 1:23:55 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 10) 2019-12-22 1:23:55 7 [Note] WSREP: Requesting state transfer: success, donor: 0 2019-12-22 1:23:57 0 [Note] WSREP: (f462897b, 'tcp://0.0.0.0:16005') turning message relay requesting off 2019-12-22 1:23:58 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 1:23:58 0 [ERROR] WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1178: Will never receive state. Need to abort. 2019-12-22 1:23:58 0 [Note] WSREP: gcomm: terminating thread 2019-12-22 1:23:58 0 [Note] WSREP: gcomm: joining thread 2019-12-22 1:23:58 0 [Note] WSREP: gcomm: closing backend 2019-12-22 1:23:59 0 [Note] WSREP: view(view_id(NON_PRIM,ed7090af,4) memb { f462897b,0 } joined { } left { } partitioned { ed7090af,0 }) 2019-12-22 1:23:59 0 [Note] WSREP: PC protocol downgrade 1 -> 0 2019-12-22 1:23:59 0 [Note] WSREP: view((empty)) 2019-12-22 1:23:59 0 [Note] WSREP: gcomm: closed 2019-12-22 1:23:59 0 [Note] WSREP: /home/stepan/mariadb/10.4/git/sql/mysqld: Terminated. ----------SERVER LOG END------------- mysqltest failed but provided no output - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_ist_mysqldump-debug,innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_ist_mysqldump-debug,innodb/' ***Warnings generated in error logs during shutdown after running tests: galera.galera_ist_mysqldump 2019-12-22 1:23:55 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid 'ed7160c0-2448-11ea-af15-56eb995a541c:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 1:23:55 2 [ERROR] WSREP: Try 1/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid 'ed7160c0-2448-11ea-af15-56eb995a541c:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 1:23:56 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid 'ed7160c0-2448-11ea-af15-56eb995a541c:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 1:23:56 2 [ERROR] WSREP: Try 2/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid 'ed7160c0-2448-11ea-af15-56eb995a541c:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 1:23:57 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid 'ed7160c0-2448-11ea-af15-56eb995a541c:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 1:23:57 2 [ERROR] WSREP: Try 3/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid 'ed7160c0-2448-11ea-af15-56eb995a541c:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 1:23:58 2 [Warning] WSREP: SST start failed 2019-12-22 1:23:58 2 [ERROR] WSREP: SST bypass failed: 1 2019-12-22 1:23:58 2 [ERROR] WSREP: Failed to bypass SST 2019-12-22 1:23:58 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 1:23:58 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 1:23:58 0 [ERROR] WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1178: Will never receive state. Need to abort. 191222 1:24:17 +18.145 galera.galera_ist_recv_bind 'innodb' [ pass ] 12476 191222 1:24:49 +31.099 galera.galera_ist_restart_joiner 'innodb' [ pass ] 18646 191222 1:25:50 +61.177 galera.galera_ist_rsync 'debug,innodb' [ pass ] 45589 191222 1:26:24 +34.288 galera.galera_load_data 'innodb' [ pass ] 22283 191222 1:26:52 +28.152 galera.galera_log_bin 'innodb' [ pass ] 2484 191222 1:29:44 +171.943 galera.galera_many_rows 'innodb' [ pass ] 165543 191222 1:30:02 +17.661 galera.galera_mdev_13787 'innodb' [ pass ] 2094 191222 1:30:21 +18.906 galera.galera_mdev_15611 'innodb' [ pass ] 3241 191222 1:30:38 +17.578 galera.galera_query_cache 'innodb' [ pass ] 2150 191222 1:30:58 +19.573 galera.galera_query_cache_sync_wait 'innodb' [ pass ] 4140 191222 1:31:15 +17.605 galera.galera_sbr_binlog 'innodb' [ pass ] 2084 191222 1:31:33 +17.625 galera.galera_ssl 'innodb' [ pass ] 2074 191222 1:31:47 +14.007 galera.galera_ssl_compression 'innodb' [ pass ] 2097 191222 1:33:16 +88.664 galera.galera_sst_mariabackup 'debug,innodb' [ pass ] 65200 191222 1:34:44 +88.548 galera.galera_sst_mariabackup_data_dir 'debug,innodb' [ pass ] 65095 191222 1:35:09 +25.156 galera.galera_sst_mariabackup_encrypt_with_key 'innodb' [ pass ] 2018 191222 1:36:02 +52.614 galera.galera_sst_mariabackup_table_options '16k,clear,innodb' [ pass ] 21894 191222 1:36:52 +49.816 galera.galera_sst_mariabackup_table_options '16k,crypt,innodb' [ pass ] 21778 191222 1:37:42 +49.881 galera.galera_sst_mariabackup_table_options '4k,clear,innodb' [ pass ] 22069 191222 1:38:33 +50.878 galera.galera_sst_mariabackup_table_options '4k,crypt,innodb' [ pass ] 22049 191222 1:39:22 +49.840 galera.galera_sst_mariabackup_table_options '8k,clear,innodb' [ pass ] 21820 191222 1:40:13 +50.342 galera.galera_sst_mariabackup_table_options '8k,crypt,innodb' [ pass ] 21902 191222 1:40:35 +22.070 galera.galera_sst_mysqldump 'debug,innodb' [ fail ] Test ended at 2019-12-22 01:40:35 CURRENT_TEST: galera.galera_sst_mysqldump Server [mysqld.2 - pid: 20790, winpid: 20790, exit: 256] failed during test run Server log from this test: ----------SERVER LOG START----------- 2019-12-22 1:40:20 0 [Warning] WSREP: option --wsrep-causal-reads is deprecated 2019-12-22 1:40:20 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld (mysqld 10.4.12-MariaDB-debug-log) starting as process 20792 ... 2019-12-22 1:40:20 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4186) 2019-12-22 1:40:20 0 [Warning] Changed limits: max_open_files: 1024 max_connections: 151 (was 151) table_cache: 421 (was 2000) 2019-12-22 1:40:20 0 [Note] WSREP: Loading provider /usr/lib/libgalera_smm_4.so initial position: 00000000-0000-0000-0000-000000000000:-1 wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_smm_4.so' wsrep loader: [INFO] wsrep_load(): Galera 26.4.3(r4548) by Codership Oy loaded successfully. 2019-12-22 1:40:20 0 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-12-22 1:40:20 0 [Warning] WSREP: Could not open state file for reading: '/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//grastate.dat' 2019-12-22 1:40:20 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1 2019-12-22 1:40:20 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 0 UUID: 00000000-0000-0000-0000-000000000000 Seqno: -1 - -1 Offset: -1 Synced: 0 2019-12-22 1:40:20 0 [Note] WSREP: Skipped GCache ring buffer recovery: could not determine history UUID. 2019-12-22 1:40:20 0 [Note] WSREP: Passing config to GCS: base_dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; base_host = 127.0.0.1; base_port = 16005; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 1; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 2019-12-22 1:40:20 0 [Note] WSREP: Start replication 2019-12-22 1:40:20 0 [Note] WSREP: Connecting with bootstrap option: 0 2019-12-22 1:40:20 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1 2019-12-22 1:40:20 0 [Note] WSREP: protonet asio version 0 2019-12-22 1:40:20 0 [Note] WSREP: Using CRC-32C for message checksums. 2019-12-22 1:40:20 0 [Note] WSREP: backend: asio 2019-12-22 1:40:20 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-12-22 1:40:20 0 [Warning] WSREP: access file(/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//gvwstate.dat) failed(No such file or directory) 2019-12-22 1:40:20 0 [Note] WSREP: restore pc from disk failed 2019-12-22 1:40:20 0 [Note] WSREP: GMCast version 0 2019-12-22 1:40:20 0 [Note] WSREP: (3fe15868, 'tcp://0.0.0.0:16005') listening at tcp://0.0.0.0:16005 2019-12-22 1:40:20 0 [Note] WSREP: (3fe15868, 'tcp://0.0.0.0:16005') multicast: , ttl: 1 2019-12-22 1:40:20 0 [Note] WSREP: EVS version 1 2019-12-22 1:40:20 0 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '127.0.0.1:16002' 2019-12-22 1:40:20 0 [Note] WSREP: (3fe15868, 'tcp://0.0.0.0:16005') connection established to 3f9e01bc tcp://127.0.0.1:16002 2019-12-22 1:40:20 0 [Note] WSREP: (3fe15868, 'tcp://0.0.0.0:16005') turning message relay requesting on, nonlive peers: 2019-12-22 1:40:20 0 [Note] WSREP: EVS version upgrade 0 -> 1 2019-12-22 1:40:20 0 [Note] WSREP: declaring 3f9e01bc at tcp://127.0.0.1:16002 stable 2019-12-22 1:40:20 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2019-12-22 1:40:20 0 [Note] WSREP: Node 3f9e01bc state prim 2019-12-22 1:40:20 0 [Note] WSREP: view(view_id(PRIM,3f9e01bc,2) memb { 3f9e01bc,0 3fe15868,0 } joined { } left { } partitioned { }) 2019-12-22 1:40:20 0 [Note] WSREP: save pc into disk 2019-12-22 1:40:21 0 [Note] WSREP: gcomm: connected 2019-12-22 1:40:21 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-12-22 1:40:21 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-12-22 1:40:21 0 [Note] WSREP: Opened channel 'my_wsrep_cluster' 2019-12-22 1:40:21 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2019-12-22 1:40:21 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2019-12-22 1:40:21 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 402fe63e-244b-11ea-b363-56da180fafc4 2019-12-22 1:40:21 0 [Note] WSREP: STATE EXCHANGE: got state msg: 402fe63e-244b-11ea-b363-56da180fafc4 from 0 (cnt7glr11.localdomain) 2019-12-22 1:40:21 0 [Note] WSREP: STATE EXCHANGE: got state msg: 402fe63e-244b-11ea-b363-56da180fafc4 from 1 (cnt7glr11.localdomain) 2019-12-22 1:40:21 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 1, members = 1/2 (joined/total), act_id = 1, last_appl. = 0, protocols = 2/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 3f9ee2a8-244b-11ea-b6fd-067012a84121 2019-12-22 1:40:21 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000000 of size 134217728 bytes 2019-12-22 1:40:21 1 [Note] WSREP: Starting rollbacker thread 1 2019-12-22 1:40:21 0 [Note] WSREP: Flow-control interval: [23, 23] 2019-12-22 1:40:21 2 [Note] WSREP: Starting applier thread 2 2019-12-22 1:40:21 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 2) 2019-12-22 1:40:21 2 [Note] WSREP: ####### processing CC 2, local, ordered 2019-12-22 1:40:21 2 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:40:21 2 [Note] WSREP: ####### My UUID: 3fe15868-244b-11ea-9bf4-6eb8f6ed6d08 2019-12-22 1:40:21 2 [Note] WSREP: Server cnt7glr11.localdomain connected to cluster at position 3f9ee2a8-244b-11ea-b6fd-067012a84121:2 with ID 3fe15868-244b-11ea-9bf4-6eb8f6ed6d08 2019-12-22 1:40:21 2 [Note] WSREP: Server status change disconnected -> connected 2019-12-22 1:40:21 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:21 2 [Note] WSREP: State transfer required: Group state: 3f9ee2a8-244b-11ea-b6fd-067012a84121:2 Local state: 00000000-0000-0000-0000-000000000000:-1 2019-12-22 1:40:21 2 [Note] WSREP: Server status change connected -> joiner 2019-12-22 1:40:21 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:21 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '127.0.0.2:16007' --datadir '/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.2' --parent '20792' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.2 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' 2019-12-22 1:40:21 2 [Note] WSREP: Prepared SST request: rsync|127.0.0.2:16007/rsync_sst 2019-12-22 1:40:21 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes 2019-12-22 1:40:21 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:40:21 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: 5 2019-12-22 1:40:21 2 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 2, STRv: 3 2019-12-22 1:40:21 2 [Note] WSREP: IST receiver addr using tcp://127.0.0.1:16006 2019-12-22 1:40:21 2 [Note] WSREP: Prepared IST receiver for 0-2, listening at: tcp://127.0.0.1:16006 2019-12-22 1:40:21 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000001 of size 134217728 bytes 2019-12-22 1:40:21 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) requested state transfer from '*any*'. Selected 0.0 (cnt7glr11.localdomain)(SYNCED) as donor. 2019-12-22 1:40:21 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 2) 2019-12-22 1:40:21 0 [Note] WSREP: Deleted page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000000 2019-12-22 1:40:21 2 [Note] WSREP: Requesting state transfer: success, donor: 0 2019-12-22 1:40:21 2 [Note] WSREP: Resetting GCache seqno map due to different histories. 2019-12-22 1:40:21 2 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0 -> 3f9ee2a8-244b-11ea-b6fd-067012a84121:2 2019-12-22 1:40:21 0 [Note] WSREP: Deleted page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000001 2019-12-22 1:40:22 0 [Note] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) complete. 2019-12-22 1:40:22 0 [Note] WSREP: Member 0.0 (cnt7glr11.localdomain) synced with group. 2019-12-22 1:40:23 0 [Note] WSREP: (3fe15868, 'tcp://0.0.0.0:16005') turning message relay requesting off WSREP_SST: [INFO] Joiner cleanup. rsync PID: 20909 (20191222 01:40:23.282) WSREP_SST: [INFO] Joiner cleanup done. (20191222 01:40:23.789) 2019-12-22 1:40:23 3 [Note] WSREP: SST received 2019-12-22 1:40:23 3 [Note] WSREP: Server status change joiner -> initializing 2019-12-22 1:40:23 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:23 0 [Note] Plugin 'partition' is disabled. 2019-12-22 1:40:23 0 [Note] Plugin 'SEQUENCE' is disabled. 2019-12-22 1:40:23 0 [Note] InnoDB: Using Linux native AIO 2019-12-22 1:40:23 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!! 2019-12-22 1:40:23 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-12-22 1:40:23 0 [Note] InnoDB: Uses event mutexes 2019-12-22 1:40:23 0 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-12-22 1:40:23 0 [Note] InnoDB: Number of pools: 1 2019-12-22 1:40:23 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-12-22 1:40:23 0 [Note] mysqld: O_TMPFILE is not supported on /home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2 (disabling future attempts) 2019-12-22 1:40:23 0 [Note] InnoDB: Initializing buffer pool, total size = 8M, instances = 1, chunk size = 8M 2019-12-22 1:40:23 0 [Note] InnoDB: Completed initialization of buffer pool 2019-12-22 1:40:23 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-12-22 1:40:23 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=68855 2019-12-22 1:40:23 0 [Note] InnoDB: Starting final batch to recover 18 pages from redo log. 2019-12-22 1:40:24 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-12-22 1:40:24 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-12-22 1:40:24 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-12-22 1:40:24 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2019-12-22 1:40:24 0 [Note] InnoDB: Waiting for purge to start 2019-12-22 1:40:24 0 [Note] InnoDB: 10.4.12 started; log sequence number 78230; transaction id 46 2019-12-22 1:40:24 0 [Note] InnoDB: Loading buffer pool(s) from /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/ib_buffer_pool 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_MUTEXES' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_CMP' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'FEEDBACK' is disabled. 2019-12-22 1:40:24 0 [Note] InnoDB: Buffer pool(s) load completed at 191222 1:40:24 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'user_variables' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled. 2019-12-22 1:40:24 0 [Note] Plugin 'unix_socket' is disabled. 2019-12-22 1:40:24 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-pam-debug' 2019-12-22 1:40:24 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-aria' 2019-12-22 1:40:24 0 [Note] Server socket created on IP: '127.0.0.1'. 2019-12-22 1:40:24 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2019-12-22 1:40:24 0 [Note] WSREP: Server initialized 2019-12-22 1:40:24 0 [Note] WSREP: Server status change initializing -> initialized 2019-12-22 1:40:24 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:24 3 [Note] WSREP: Server status change initialized -> joined 2019-12-22 1:40:24 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:24 0 [Note] Reading of all Master_info entries succeeded 2019-12-22 1:40:24 0 [Note] Added new Master_info '' to hash table 2019-12-22 1:40:24 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld: ready for connections. Version: '10.4.12-MariaDB-debug-log' socket: '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2.sock' port: 16001 Source distribution 2019-12-22 1:40:24 3 [Note] WSREP: Recovered position from storage: 3f9ee2a8-244b-11ea-b6fd-067012a84121:2 2019-12-22 1:40:24 3 [Note] WSREP: Recovered view from SST: id: 3f9ee2a8-244b-11ea-b6fd-067012a84121:2 status: primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: no own_index: 1 members(2): 0: 3f9e01bc-244b-11ea-82b1-53a5b2a38bbe, cnt7glr11.localdomain 1: 3fe15868-244b-11ea-9bf4-6eb8f6ed6d08, cnt7glr11.localdomain 2019-12-22 1:40:24 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:24 13 [Note] WSREP: Recovered cluster id 3f9ee2a8-244b-11ea-b6fd-067012a84121 2019-12-22 1:40:24 3 [Note] WSREP: SST received: 3f9ee2a8-244b-11ea-b6fd-067012a84121:2 2019-12-22 1:40:24 2 [Note] WSREP: Installed new state from SST: 3f9ee2a8-244b-11ea-b6fd-067012a84121:2 2019-12-22 1:40:24 2 [Note] WSREP: Cert. index preload up to 2 2019-12-22 1:40:24 0 [Note] WSREP: ####### IST applying starts with 3 2019-12-22 1:40:24 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000002 of size 134217728 bytes 2019-12-22 1:40:24 0 [Note] WSREP: ####### IST current seqno initialized to 2 2019-12-22 1:40:24 0 [Note] WSREP: Receiving IST... 0.0% (0/1 events) complete. 2019-12-22 1:40:24 0 [Note] WSREP: IST preload starting at 2 2019-12-22 1:40:24 0 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:40:24 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:40:24 0 [Note] WSREP: ####### Assign initial position for certification: 3f9ee2a8-244b-11ea-b6fd-067012a84121:1, protocol version: 5 2019-12-22 1:40:24 0 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:40:24 0 [Note] WSREP: ####### Adjusting cert position: 1 -> 2 2019-12-22 1:40:24 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:40:24 0 [Note] WSREP: Lowest cert indnex boundary for CC from preload: 2 2019-12-22 1:40:24 0 [Note] WSREP: Min available from gcache for CC from preload: 2 2019-12-22 1:40:24 0 [Note] WSREP: Receiving IST...100.0% (1/1 events) complete. 2019-12-22 1:40:24 2 [Note] WSREP: IST received: 3f9ee2a8-244b-11ea-b6fd-067012a84121:2 2019-12-22 1:40:24 2 [Note] WSREP: Lowest cert indnex boundary for CC from group: 2 2019-12-22 1:40:24 2 [Note] WSREP: Min available from gcache for CC from group: 2 2019-12-22 1:40:24 0 [Note] WSREP: 1.0 (cnt7glr11.localdomain): State transfer from 0.0 (cnt7glr11.localdomain) complete. 2019-12-22 1:40:24 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 2) 2019-12-22 1:40:24 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) synced with group. 2019-12-22 1:40:24 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2) 2019-12-22 1:40:24 2 [Note] WSREP: Server cnt7glr11.localdomain synced with group 2019-12-22 1:40:24 2 [Note] WSREP: Server status change joined -> synced 2019-12-22 1:40:24 2 [Note] WSREP: Synchronized with group, ready for connections 2019-12-22 1:40:24 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:26 16 [Note] WSREP: Stop replication by 16 2019-12-22 1:40:26 16 [Note] WSREP: Server status change synced -> disconnecting 2019-12-22 1:40:26 16 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:28 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:28 2 [Note] WSREP: Server status change disconnecting -> disconnected 2019-12-22 1:40:28 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:28 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:28 2 [Note] WSREP: Applier thread exiting ret: 0 thd: 2 2019-12-22 1:40:28 2 [Warning] Aborted connection 2 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) 2019-12-22 1:40:28 1 [Note] WSREP: rollbacker thread exiting 1 2019-12-22 1:40:28 1 [Warning] Aborted connection 1 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) wsrep loader: [INFO] wsrep_load(): loading provider library 'none' 2019-12-22 1:40:30 16 [Note] WSREP: Stop replication by 16 2019-12-22 1:40:30 16 [Note] WSREP: Loading provider /usr/lib/libgalera_smm_4.so initial position: 00000000-0000-0000-0000-000000000000:-1 wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_smm_4.so' wsrep loader: [INFO] wsrep_load(): Galera 26.4.3(r4548) by Codership Oy loaded successfully. 2019-12-22 1:40:30 16 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-12-22 1:40:30 16 [Note] WSREP: Found saved state: 3f9ee2a8-244b-11ea-b6fd-067012a84121:7, safe_to_bootstrap: 0 2019-12-22 1:40:30 16 [Note] WSREP: GCache DEBUG: opened preamble: Version: 2 UUID: 3f9ee2a8-244b-11ea-b6fd-067012a84121 Seqno: -1 - -1 Offset: -1 Synced: 1 2019-12-22 1:40:30 16 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 3f9ee2a8-244b-11ea-b6fd-067012a84121, offset: -1 2019-12-22 1:40:30 16 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/25 bytes) complete. 2019-12-22 1:40:30 16 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (25/25 bytes) complete. 2019-12-22 1:40:30 16 [Note] WSREP: Recovering GCache ring buffer: didn't recover any events. 2019-12-22 1:40:30 16 [Note] WSREP: Passing config to GCS: base_dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; base_host = 127.0.0.1; base_port = 16005; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.causal_keepalive_period = PT1S; evs.debug_log_mask = 0x1; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.info_log_mask = 0; evs.install_timeout = PT7.5S; evs.join_retrans_period = PT1S; evs.keepalive_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.use_aggregate = true; evs.user_send_window = 2; evs.version = 1; evs.view_forget_timeout = P1D; gcache.debug = 0; gcache.dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 1; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs 2019-12-22 1:40:30 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:40:30 16 [Note] WSREP: ####### Assign initial position for certification: 3f9ee2a8-244b-11ea-b6fd-067012a84121:7, protocol version: -1 2019-12-22 1:40:30 16 [Note] WSREP: GCache history reset: old(3f9ee2a8-244b-11ea-b6fd-067012a84121:0 -> 3f9ee2a8-244b-11ea-b6fd-067012a84121:7 2019-12-22 1:40:30 16 [Note] WSREP: Stop replication by 16 2019-12-22 1:40:30 16 [Note] WSREP: Start replication 2019-12-22 1:40:30 16 [Note] WSREP: Connecting with bootstrap option: 0 2019-12-22 1:40:30 16 [Note] WSREP: Setting GCS initial position to 3f9ee2a8-244b-11ea-b6fd-067012a84121:7 2019-12-22 1:40:30 16 [Note] WSREP: protonet asio version 0 2019-12-22 1:40:30 16 [Note] WSREP: Using CRC-32C for message checksums. 2019-12-22 1:40:30 16 [Note] WSREP: backend: asio 2019-12-22 1:40:30 16 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-12-22 1:40:30 16 [Warning] WSREP: access file(/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//gvwstate.dat) failed(No such file or directory) 2019-12-22 1:40:30 16 [Note] WSREP: restore pc from disk failed 2019-12-22 1:40:30 16 [Note] WSREP: GMCast version 0 2019-12-22 1:40:30 16 [Note] WSREP: (45cd5e8d, 'tcp://0.0.0.0:16005') listening at tcp://0.0.0.0:16005 2019-12-22 1:40:30 16 [Note] WSREP: (45cd5e8d, 'tcp://0.0.0.0:16005') multicast: , ttl: 1 2019-12-22 1:40:30 16 [Note] WSREP: EVS version 1 2019-12-22 1:40:30 16 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '127.0.0.1:16002' 2019-12-22 1:40:30 16 [Note] WSREP: (45cd5e8d, 'tcp://0.0.0.0:16005') connection established to 3f9e01bc tcp://127.0.0.1:16002 2019-12-22 1:40:30 16 [Note] WSREP: (45cd5e8d, 'tcp://0.0.0.0:16005') turning message relay requesting on, nonlive peers: 2019-12-22 1:40:30 16 [Note] WSREP: EVS version upgrade 0 -> 1 2019-12-22 1:40:30 16 [Note] WSREP: declaring 3f9e01bc at tcp://127.0.0.1:16002 stable 2019-12-22 1:40:30 16 [Note] WSREP: PC protocol upgrade 0 -> 1 2019-12-22 1:40:30 16 [Note] WSREP: Node 3f9e01bc state prim 2019-12-22 1:40:30 16 [Note] WSREP: view(view_id(PRIM,3f9e01bc,4) memb { 3f9e01bc,0 45cd5e8d,0 } joined { } left { } partitioned { }) 2019-12-22 1:40:30 16 [Note] WSREP: save pc into disk 2019-12-22 1:40:31 16 [Note] WSREP: gcomm: connected 2019-12-22 1:40:31 16 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-12-22 1:40:31 16 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-12-22 1:40:31 16 [Note] WSREP: Opened channel 'my_wsrep_cluster' 2019-12-22 1:40:31 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2019-12-22 1:40:31 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2019-12-22 1:40:31 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 461b2340-244b-11ea-8030-5b0ea03538a8 2019-12-22 1:40:31 0 [Note] WSREP: STATE EXCHANGE: got state msg: 461b2340-244b-11ea-8030-5b0ea03538a8 from 0 (cnt7glr11.localdomain) 2019-12-22 1:40:31 0 [Note] WSREP: STATE EXCHANGE: got state msg: 461b2340-244b-11ea-8030-5b0ea03538a8 from 1 (cnt7glr11.localdomain) 2019-12-22 1:40:31 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 3, members = 1/2 (joined/total), act_id = 9, last_appl. = 0, protocols = 2/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 3f9ee2a8-244b-11ea-b6fd-067012a84121 2019-12-22 1:40:31 18 [Note] WSREP: Starting applier thread 18 2019-12-22 1:40:31 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000000 of size 134217728 bytes 2019-12-22 1:40:31 17 [Note] WSREP: Starting rollbacker thread 17 2019-12-22 1:40:31 0 [Note] WSREP: Flow-control interval: [23, 23] 2019-12-22 1:40:31 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 10) 2019-12-22 1:40:31 18 [Note] WSREP: ####### processing CC 10, local, ordered 2019-12-22 1:40:31 18 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:40:31 18 [Note] WSREP: ####### My UUID: 45cd5e8d-244b-11ea-9af7-2a2ad11712c8 2019-12-22 1:40:31 18 [Note] WSREP: Server cnt7glr11.localdomain connected to cluster at position 3f9ee2a8-244b-11ea-b6fd-067012a84121:10 with ID 45cd5e8d-244b-11ea-9af7-2a2ad11712c8 2019-12-22 1:40:31 18 [Note] WSREP: Server status change disconnected -> connected 2019-12-22 1:40:31 18 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:31 18 [Note] WSREP: State transfer required: Group state: 3f9ee2a8-244b-11ea-b6fd-067012a84121:10 Local state: 3f9ee2a8-244b-11ea-b6fd-067012a84121:7 2019-12-22 1:40:31 18 [Note] WSREP: Server status change connected -> joiner 2019-12-22 1:40:31 18 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:31 18 [Note] WSREP: Prepared SST request: mysqldump|127.0.0.1:16001 2019-12-22 1:40:31 18 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes 2019-12-22 1:40:31 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:40:31 18 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: 5 2019-12-22 1:40:31 18 [Note] WSREP: ####### IST uuid:3f9ee2a8-244b-11ea-b6fd-067012a84121 f: 8, l: 10, STRv: 3 2019-12-22 1:40:31 18 [Note] WSREP: IST receiver addr using tcp://127.0.0.1:16006 2019-12-22 1:40:31 18 [Note] WSREP: Prepared IST receiver for 8-10, listening at: tcp://127.0.0.1:16006 2019-12-22 1:40:31 0 [Note] WSREP: Deleted page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000000 2019-12-22 1:40:31 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000001 of size 134217728 bytes 2019-12-22 1:40:31 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) requested state transfer from '*any*'. Selected 0.0 (cnt7glr11.localdomain)(SYNCED) as donor. 2019-12-22 1:40:31 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 10) 2019-12-22 1:40:31 18 [Note] WSREP: Requesting state transfer: success, donor: 0 2019-12-22 1:40:31 0 [Note] WSREP: Deleted page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000001 2019-12-22 1:40:33 0 [Note] WSREP: (45cd5e8d, 'tcp://0.0.0.0:16005') turning message relay requesting off 2019-12-22 1:40:34 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 1:40:34 0 [ERROR] WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1178: Will never receive state. Need to abort. 2019-12-22 1:40:34 0 [Note] WSREP: gcomm: terminating thread 2019-12-22 1:40:34 0 [Note] WSREP: gcomm: joining thread 2019-12-22 1:40:34 0 [Note] WSREP: gcomm: closing backend 2019-12-22 1:40:35 0 [Note] WSREP: view(view_id(NON_PRIM,3f9e01bc,4) memb { 45cd5e8d,0 } joined { } left { } partitioned { 3f9e01bc,0 }) 2019-12-22 1:40:35 0 [Note] WSREP: PC protocol downgrade 1 -> 0 2019-12-22 1:40:35 0 [Note] WSREP: view((empty)) 2019-12-22 1:40:35 0 [Note] WSREP: gcomm: closed 2019-12-22 1:40:35 0 [Note] WSREP: /home/stepan/mariadb/10.4/git/sql/mysqld: Terminated. ----------SERVER LOG END------------- mysqltest failed but provided no output - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_sst_mysqldump-debug,innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_sst_mysqldump-debug,innodb/' ***Warnings generated in error logs during shutdown after running tests: galera.galera_sst_mysqldump 2019-12-22 1:40:31 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '3f9ee2a8-244b-11ea-b6fd-067012a84121:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 1:40:31 2 [ERROR] WSREP: Try 1/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '3f9ee2a8-244b-11ea-b6fd-067012a84121:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 1:40:32 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '3f9ee2a8-244b-11ea-b6fd-067012a84121:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 1:40:32 2 [ERROR] WSREP: Try 2/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '3f9ee2a8-244b-11ea-b6fd-067012a84121:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 1:40:33 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '3f9ee2a8-244b-11ea-b6fd-067012a84121:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 1:40:33 2 [ERROR] WSREP: Try 3/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '3f9ee2a8-244b-11ea-b6fd-067012a84121:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 1:40:34 2 [Warning] WSREP: SST start failed 2019-12-22 1:40:34 2 [ERROR] WSREP: SST bypass failed: 1 2019-12-22 1:40:34 2 [ERROR] WSREP: Failed to bypass SST 2019-12-22 1:40:34 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 1:40:34 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 1:40:34 0 [ERROR] WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1178: Will never receive state. Need to abort. 191222 1:40:51 +16.540 galera.galera_sst_mysqldump_with_key 'debug,innodb' [ fail ] Test ended at 2019-12-22 01:40:51 CURRENT_TEST: galera.galera_sst_mysqldump CURRENT_TEST: galera.galera_sst_mysqldump_with_key Server [mysqld.2 - pid: 22654, winpid: 22654, exit: 256] failed during test run Server log from this test: ----------SERVER LOG START----------- 2019-12-22 1:40:36 0 [Warning] WSREP: option --wsrep-causal-reads is deprecated 2019-12-22 1:40:36 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld (mysqld 10.4.12-MariaDB-debug-log) starting as process 21911 ... 2019-12-22 1:40:36 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4186) 2019-12-22 1:40:36 0 [Warning] Changed limits: max_open_files: 1024 max_connections: 151 (was 151) table_cache: 421 (was 2000) 2019-12-22 1:40:36 0 [Note] WSREP: Loading provider /usr/lib/libgalera_smm_4.so initial position: 00000000-0000-0000-0000-000000000000:-1 wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_smm_4.so' wsrep loader: [INFO] wsrep_load(): Galera 26.4.3(r4548) by Codership Oy loaded successfully. 2019-12-22 1:40:36 0 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-12-22 1:40:36 0 [Warning] WSREP: Could not open state file for reading: '/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//grastate.dat' 2019-12-22 1:40:36 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1 2019-12-22 1:40:36 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 0 UUID: 00000000-0000-0000-0000-000000000000 Seqno: -1 - -1 Offset: -1 Synced: 0 2019-12-22 1:40:36 0 [Note] WSREP: Skipped GCache ring buffer recovery: could not determine history UUID. 2019-12-22 1:40:36 0 [Note] WSREP: Passing config to GCS: base_dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; base_host = 127.0.0.1; base_port = 16005; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 1; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 2019-12-22 1:40:36 0 [Note] WSREP: Start replication 2019-12-22 1:40:36 0 [Note] WSREP: Connecting with bootstrap option: 0 2019-12-22 1:40:36 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1 2019-12-22 1:40:36 0 [Note] WSREP: protonet asio version 0 2019-12-22 1:40:36 0 [Note] WSREP: Using CRC-32C for message checksums. 2019-12-22 1:40:36 0 [Note] WSREP: backend: asio 2019-12-22 1:40:36 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-12-22 1:40:36 0 [Warning] WSREP: access file(/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//gvwstate.dat) failed(No such file or directory) 2019-12-22 1:40:36 0 [Note] WSREP: restore pc from disk failed 2019-12-22 1:40:36 0 [Note] WSREP: GMCast version 0 2019-12-22 1:40:36 0 [Note] WSREP: (4975648a, 'tcp://0.0.0.0:16005') listening at tcp://0.0.0.0:16005 2019-12-22 1:40:36 0 [Note] WSREP: (4975648a, 'tcp://0.0.0.0:16005') multicast: , ttl: 1 2019-12-22 1:40:36 0 [Note] WSREP: EVS version 1 2019-12-22 1:40:36 0 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '127.0.0.1:16002' 2019-12-22 1:40:36 0 [Note] WSREP: (4975648a, 'tcp://0.0.0.0:16005') connection established to 491c75b3 tcp://127.0.0.1:16002 2019-12-22 1:40:36 0 [Note] WSREP: (4975648a, 'tcp://0.0.0.0:16005') turning message relay requesting on, nonlive peers: 2019-12-22 1:40:36 0 [Note] WSREP: EVS version upgrade 0 -> 1 2019-12-22 1:40:36 0 [Note] WSREP: declaring 491c75b3 at tcp://127.0.0.1:16002 stable 2019-12-22 1:40:36 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2019-12-22 1:40:36 0 [Note] WSREP: Node 491c75b3 state prim 2019-12-22 1:40:36 0 [Note] WSREP: view(view_id(PRIM,491c75b3,2) memb { 491c75b3,0 4975648a,0 } joined { } left { } partitioned { }) 2019-12-22 1:40:36 0 [Note] WSREP: save pc into disk 2019-12-22 1:40:37 0 [Note] WSREP: gcomm: connected 2019-12-22 1:40:37 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-12-22 1:40:37 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-12-22 1:40:37 0 [Note] WSREP: Opened channel 'my_wsrep_cluster' 2019-12-22 1:40:37 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2019-12-22 1:40:37 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2019-12-22 1:40:37 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 49c2c309-244b-11ea-9950-92abeb93c6b9 2019-12-22 1:40:37 0 [Note] WSREP: STATE EXCHANGE: got state msg: 49c2c309-244b-11ea-9950-92abeb93c6b9 from 0 (cnt7glr11.localdomain) 2019-12-22 1:40:37 0 [Note] WSREP: STATE EXCHANGE: got state msg: 49c2c309-244b-11ea-9950-92abeb93c6b9 from 1 (cnt7glr11.localdomain) 2019-12-22 1:40:37 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 1, members = 1/2 (joined/total), act_id = 1, last_appl. = 0, protocols = 2/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 491d5f68-244b-11ea-bed1-da093aaab784 2019-12-22 1:40:37 2 [Note] WSREP: Starting rollbacker thread 2 2019-12-22 1:40:37 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000000 of size 134217728 bytes 2019-12-22 1:40:37 0 [Note] WSREP: Flow-control interval: [23, 23] 2019-12-22 1:40:37 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 2) 2019-12-22 1:40:37 1 [Note] WSREP: Starting applier thread 1 2019-12-22 1:40:37 1 [Note] WSREP: ####### processing CC 2, local, ordered 2019-12-22 1:40:37 1 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:40:37 1 [Note] WSREP: ####### My UUID: 4975648a-244b-11ea-8072-ba8b37389ea6 2019-12-22 1:40:37 1 [Note] WSREP: Server cnt7glr11.localdomain connected to cluster at position 491d5f68-244b-11ea-bed1-da093aaab784:2 with ID 4975648a-244b-11ea-8072-ba8b37389ea6 2019-12-22 1:40:37 1 [Note] WSREP: Server status change disconnected -> connected 2019-12-22 1:40:37 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:37 1 [Note] WSREP: State transfer required: Group state: 491d5f68-244b-11ea-bed1-da093aaab784:2 Local state: 00000000-0000-0000-0000-000000000000:-1 2019-12-22 1:40:37 1 [Note] WSREP: Server status change connected -> joiner 2019-12-22 1:40:37 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:37 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '127.0.0.2:16007' --datadir '/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.2' --parent '21911' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.2 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' 2019-12-22 1:40:37 1 [Note] WSREP: Prepared SST request: rsync|127.0.0.2:16007/rsync_sst 2019-12-22 1:40:37 1 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes 2019-12-22 1:40:37 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:40:37 1 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: 5 2019-12-22 1:40:37 1 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 2, STRv: 3 2019-12-22 1:40:37 1 [Note] WSREP: IST receiver addr using tcp://127.0.0.1:16006 2019-12-22 1:40:37 1 [Note] WSREP: Prepared IST receiver for 0-2, listening at: tcp://127.0.0.1:16006 2019-12-22 1:40:37 0 [Note] WSREP: Deleted page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000000 2019-12-22 1:40:37 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000001 of size 134217728 bytes 2019-12-22 1:40:37 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) requested state transfer from '*any*'. Selected 0.0 (cnt7glr11.localdomain)(SYNCED) as donor. 2019-12-22 1:40:37 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 2) 2019-12-22 1:40:37 1 [Note] WSREP: Requesting state transfer: success, donor: 0 2019-12-22 1:40:37 1 [Note] WSREP: Resetting GCache seqno map due to different histories. 2019-12-22 1:40:37 1 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0 -> 491d5f68-244b-11ea-bed1-da093aaab784:2 2019-12-22 1:40:37 0 [Note] WSREP: Deleted page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000001 2019-12-22 1:40:38 0 [Note] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) complete. 2019-12-22 1:40:38 0 [Note] WSREP: Member 0.0 (cnt7glr11.localdomain) synced with group. WSREP_SST: [INFO] Joiner cleanup. rsync PID: 22044 (20191222 01:40:39.364) 2019-12-22 1:40:39 0 [Note] WSREP: (4975648a, 'tcp://0.0.0.0:16005') turning message relay requesting off WSREP_SST: [INFO] Joiner cleanup done. (20191222 01:40:39.871) 2019-12-22 1:40:39 3 [Note] WSREP: SST received 2019-12-22 1:40:39 3 [Note] WSREP: Server status change joiner -> initializing 2019-12-22 1:40:39 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:39 0 [Note] Plugin 'partition' is disabled. 2019-12-22 1:40:39 0 [Note] Plugin 'SEQUENCE' is disabled. 2019-12-22 1:40:39 0 [Note] InnoDB: Using Linux native AIO 2019-12-22 1:40:39 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!! 2019-12-22 1:40:39 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-12-22 1:40:39 0 [Note] InnoDB: Uses event mutexes 2019-12-22 1:40:39 0 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-12-22 1:40:39 0 [Note] InnoDB: Number of pools: 1 2019-12-22 1:40:39 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-12-22 1:40:39 0 [Note] mysqld: O_TMPFILE is not supported on /home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2 (disabling future attempts) 2019-12-22 1:40:39 0 [Note] InnoDB: Initializing buffer pool, total size = 8M, instances = 1, chunk size = 8M 2019-12-22 1:40:39 0 [Note] InnoDB: Completed initialization of buffer pool 2019-12-22 1:40:39 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-12-22 1:40:39 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=68855 2019-12-22 1:40:39 0 [Note] InnoDB: Starting final batch to recover 18 pages from redo log. 2019-12-22 1:40:40 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-12-22 1:40:40 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-12-22 1:40:40 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-12-22 1:40:40 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2019-12-22 1:40:40 0 [Note] InnoDB: Waiting for purge to start 2019-12-22 1:40:40 0 [Note] InnoDB: 10.4.12 started; log sequence number 78230; transaction id 46 2019-12-22 1:40:40 0 [Note] InnoDB: Loading buffer pool(s) from /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/ib_buffer_pool 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_MUTEXES' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_CMP' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'FEEDBACK' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled. 2019-12-22 1:40:40 0 [Note] InnoDB: Buffer pool(s) load completed at 191222 1:40:40 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'user_variables' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled. 2019-12-22 1:40:40 0 [Note] Plugin 'unix_socket' is disabled. 2019-12-22 1:40:40 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-pam-debug' 2019-12-22 1:40:40 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-aria' 2019-12-22 1:40:40 0 [Note] Server socket created on IP: '127.0.0.1'. 2019-12-22 1:40:40 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2019-12-22 1:40:40 0 [Note] WSREP: Server initialized 2019-12-22 1:40:40 0 [Note] WSREP: Server status change initializing -> initialized 2019-12-22 1:40:40 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:40 3 [Note] WSREP: Server status change initialized -> joined 2019-12-22 1:40:40 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:40 0 [Note] Reading of all Master_info entries succeeded 2019-12-22 1:40:40 0 [Note] Added new Master_info '' to hash table 2019-12-22 1:40:40 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld: ready for connections. Version: '10.4.12-MariaDB-debug-log' socket: '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2.sock' port: 16001 Source distribution 2019-12-22 1:40:40 3 [Note] WSREP: Recovered position from storage: 491d5f68-244b-11ea-bed1-da093aaab784:2 2019-12-22 1:40:40 3 [Note] WSREP: Recovered view from SST: id: 491d5f68-244b-11ea-bed1-da093aaab784:2 status: primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: no own_index: 1 members(2): 0: 491c75b3-244b-11ea-b187-03cec59d711b, cnt7glr11.localdomain 1: 4975648a-244b-11ea-8072-ba8b37389ea6, cnt7glr11.localdomain 2019-12-22 1:40:40 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:40 13 [Note] WSREP: Recovered cluster id 491d5f68-244b-11ea-bed1-da093aaab784 2019-12-22 1:40:40 3 [Note] WSREP: SST received: 491d5f68-244b-11ea-bed1-da093aaab784:2 2019-12-22 1:40:40 1 [Note] WSREP: Installed new state from SST: 491d5f68-244b-11ea-bed1-da093aaab784:2 2019-12-22 1:40:40 1 [Note] WSREP: Cert. index preload up to 2 2019-12-22 1:40:40 0 [Note] WSREP: ####### IST applying starts with 3 2019-12-22 1:40:40 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000002 of size 134217728 bytes 2019-12-22 1:40:40 0 [Note] WSREP: ####### IST current seqno initialized to 2 2019-12-22 1:40:40 0 [Note] WSREP: Receiving IST... 0.0% (0/1 events) complete. 2019-12-22 1:40:40 0 [Note] WSREP: IST preload starting at 2 2019-12-22 1:40:40 0 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:40:40 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:40:40 0 [Note] WSREP: ####### Assign initial position for certification: 491d5f68-244b-11ea-bed1-da093aaab784:1, protocol version: 5 2019-12-22 1:40:40 0 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:40:40 0 [Note] WSREP: ####### Adjusting cert position: 1 -> 2 2019-12-22 1:40:40 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:40:40 0 [Note] WSREP: Lowest cert indnex boundary for CC from preload: 2 2019-12-22 1:40:40 0 [Note] WSREP: Min available from gcache for CC from preload: 2 2019-12-22 1:40:40 0 [Note] WSREP: Receiving IST...100.0% (1/1 events) complete. 2019-12-22 1:40:40 1 [Note] WSREP: IST received: 491d5f68-244b-11ea-bed1-da093aaab784:2 2019-12-22 1:40:40 1 [Note] WSREP: Lowest cert indnex boundary for CC from group: 2 2019-12-22 1:40:40 1 [Note] WSREP: Min available from gcache for CC from group: 2 2019-12-22 1:40:40 0 [Note] WSREP: 1.0 (cnt7glr11.localdomain): State transfer from 0.0 (cnt7glr11.localdomain) complete. 2019-12-22 1:40:40 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 2) 2019-12-22 1:40:40 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) synced with group. 2019-12-22 1:40:40 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2) 2019-12-22 1:40:40 1 [Note] WSREP: Server cnt7glr11.localdomain synced with group 2019-12-22 1:40:40 1 [Note] WSREP: Server status change joined -> synced 2019-12-22 1:40:40 1 [Note] WSREP: Synchronized with group, ready for connections 2019-12-22 1:40:40 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:43 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld (initiated by: root[root] @ localhost [127.0.0.1]): Normal shutdown 2019-12-22 1:40:43 0 [Note] WSREP: Shutdown replication 2019-12-22 1:40:43 0 [Note] WSREP: Server status change synced -> disconnecting 2019-12-22 1:40:43 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:43 0 [Note] WSREP: Closing send monitor... 2019-12-22 1:40:43 0 [Note] WSREP: Closed send monitor. 2019-12-22 1:40:43 0 [Note] WSREP: gcomm: terminating thread 2019-12-22 1:40:43 0 [Note] WSREP: gcomm: joining thread 2019-12-22 1:40:43 0 [Note] WSREP: gcomm: closing backend 2019-12-22 1:40:44 0 [Note] WSREP: view(view_id(NON_PRIM,491c75b3,2) memb { 4975648a,0 } joined { } left { } partitioned { 491c75b3,0 }) 2019-12-22 1:40:44 0 [Note] WSREP: PC protocol downgrade 1 -> 0 2019-12-22 1:40:44 0 [Note] WSREP: view((empty)) 2019-12-22 1:40:44 0 [Note] WSREP: gcomm: closed 2019-12-22 1:40:44 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 2019-12-22 1:40:44 0 [Note] WSREP: Flow-control interval: [16, 16] 2019-12-22 1:40:44 0 [Note] WSREP: Received NON-PRIMARY. 2019-12-22 1:40:44 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 10) 2019-12-22 1:40:44 0 [Note] WSREP: New SELF-LEAVE. 2019-12-22 1:40:44 0 [Note] WSREP: Flow-control interval: [0, 0] 2019-12-22 1:40:44 0 [Note] WSREP: Received SELF-LEAVE. Closing connection. 2019-12-22 1:40:44 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: -1) 2019-12-22 1:40:44 0 [Note] WSREP: RECV thread exiting 0: Success 2019-12-22 1:40:44 1 [Note] WSREP: ####### processing CC -1, local, ordered 2019-12-22 1:40:44 1 [Note] WSREP: ####### My UUID: 4975648a-244b-11ea-8072-ba8b37389ea6 2019-12-22 1:40:44 0 [Note] WSREP: recv_thread() joined. 2019-12-22 1:40:44 0 [Note] WSREP: Closing replication queue. 2019-12-22 1:40:44 0 [Note] WSREP: Closing slave action queue. 2019-12-22 1:40:44 1 [Note] WSREP: ####### ST not required 2019-12-22 1:40:44 1 [Note] WSREP: ================================================ View: id: 491d5f68-244b-11ea-bed1-da093aaab784:-1 status: non-primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: no own_index: 0 members(1): 0: 4975648a-244b-11ea-8072-ba8b37389ea6, cnt7glr11.localdomain ================================================= 2019-12-22 1:40:44 1 [Note] WSREP: Non-primary view 2019-12-22 1:40:44 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:44 1 [Note] WSREP: ####### processing CC -1, local, ordered 2019-12-22 1:40:44 1 [Note] WSREP: ####### My UUID: 4975648a-244b-11ea-8072-ba8b37389ea6 2019-12-22 1:40:44 1 [Note] WSREP: ####### ST not required 2019-12-22 1:40:44 1 [Note] WSREP: ================================================ View: id: 491d5f68-244b-11ea-bed1-da093aaab784:-1 status: non-primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: yes own_index: -1 members(0): ================================================= 2019-12-22 1:40:44 1 [Note] WSREP: Non-primary view 2019-12-22 1:40:44 1 [Note] WSREP: Server status change disconnecting -> disconnected 2019-12-22 1:40:44 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:44 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:44 1 [Note] WSREP: Applier thread exiting ret: 0 thd: 1 2019-12-22 1:40:44 2 [Note] WSREP: rollbacker thread exiting 2 2019-12-22 1:40:44 2 [Warning] Aborted connection 2 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) 2019-12-22 1:40:44 1 [Warning] Aborted connection 1 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) 2019-12-22 1:40:44 0 [Note] InnoDB: FTS optimize thread exiting. 2019-12-22 1:40:44 0 [Note] Event Scheduler: Purging the queue. 0 events 2019-12-22 1:40:44 0 [Note] WSREP: dtor state: CLOSED 2019-12-22 1:40:44 0 [Note] WSREP: MemPool(TrxHandleSlave): hit ratio: 0, misses: 8, in use: 8, in pool: 0 2019-12-22 1:40:44 0 [Note] WSREP: mon: entered 8 oooe fraction 0 oool fraction 0 2019-12-22 1:40:44 0 [Note] WSREP: mon: entered 8 oooe fraction 0 oool fraction 0 2019-12-22 1:40:44 0 [Note] WSREP: mon: entered 13 oooe fraction 0 oool fraction 0.0769231 2019-12-22 1:40:44 0 [Note] WSREP: cert index usage at exit 5 2019-12-22 1:40:44 0 [Note] WSREP: cert trx map usage at exit 8 2019-12-22 1:40:44 0 [Note] WSREP: deps set usage at exit 0 2019-12-22 1:40:44 0 [Note] WSREP: avg deps dist 1.125 2019-12-22 1:40:44 0 [Note] WSREP: avg cert interval 0 2019-12-22 1:40:44 0 [Note] WSREP: cert index size 5 2019-12-22 1:40:44 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:40:44 0 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0 2019-12-22 1:40:44 0 [Note] WSREP: MemPool(LocalTrxHandle): hit ratio: 0, misses: 1, in use: 0, in pool: 1 2019-12-22 1:40:44 0 [Note] WSREP: trx map: conn query map: 2019-12-22 1:40:44 0 [Note] WSREP: Shifting CLOSED -> DESTROYED (TO: -1) 2019-12-22 1:40:44 0 [Note] WSREP: Deleted page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000002 2019-12-22 1:40:44 0 [Note] WSREP: Flushing memory map to disk... 2019-12-22 1:40:44 0 [Note] InnoDB: Starting shutdown... 2019-12-22 1:40:44 0 [Note] InnoDB: Dumping buffer pool(s) to /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/ib_buffer_pool 2019-12-22 1:40:44 0 [Note] InnoDB: Instance 0, restricted to 123 pages due to innodb_buf_pool_dump_pct=25 2019-12-22 1:40:44 0 [Note] InnoDB: Buffer pool(s) dump completed at 191222 1:40:44 2019-12-22 1:40:45 0 [Note] InnoDB: Shutdown completed; log sequence number 84211; transaction id 53 2019-12-22 1:40:45 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2019-12-22 1:40:45 0 [Note] Debug sync points hit: 1833 2019-12-22 1:40:45 0 [Note] Debug sync points executed: 0 2019-12-22 1:40:45 0 [Note] Debug sync points max active per thread: 0 2019-12-22 1:40:45 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld: Shutdown complete 2019-12-22 1:40:46 0 [Warning] WSREP: option --wsrep-causal-reads is deprecated 2019-12-22 1:40:46 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld (mysqld 10.4.12-MariaDB-debug-log) starting as process 22655 ... 2019-12-22 1:40:46 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4186) 2019-12-22 1:40:46 0 [Warning] Changed limits: max_open_files: 1024 max_connections: 151 (was 151) table_cache: 421 (was 2000) 2019-12-22 1:40:46 0 [Warning] WSREP: wsrep_sst_method is set to 'mysqldump' yet mysqld bind_address is set to '127.0.0.1', which makes it impossible to receive state transfer from another node, since mysqld won't accept such connections. If you wish to use mysqldump state transfer method, set bind_address to allow mysql client connections from other cluster members (e.g. 0.0.0.0). 2019-12-22 1:40:46 0 [Warning] WSREP: wsrep_sst_receive_address is set to '127.0.0.1:16001' which makes it impossible for another host to reach this one. Please set it to the address which this node can be connected at by other cluster members. 2019-12-22 1:40:46 0 [Note] Plugin 'partition' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'SEQUENCE' is disabled. 2019-12-22 1:40:46 0 [Note] InnoDB: Using Linux native AIO 2019-12-22 1:40:46 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!! 2019-12-22 1:40:46 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-12-22 1:40:46 0 [Note] InnoDB: Uses event mutexes 2019-12-22 1:40:46 0 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-12-22 1:40:46 0 [Note] InnoDB: Number of pools: 1 2019-12-22 1:40:46 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-12-22 1:40:46 0 [Note] mysqld: O_TMPFILE is not supported on /home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2 (disabling future attempts) 2019-12-22 1:40:46 0 [Note] InnoDB: Initializing buffer pool, total size = 8M, instances = 1, chunk size = 8M 2019-12-22 1:40:46 0 [Note] InnoDB: Completed initialization of buffer pool 2019-12-22 1:40:46 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-12-22 1:40:46 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-12-22 1:40:46 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-12-22 1:40:46 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-12-22 1:40:46 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2019-12-22 1:40:46 0 [Note] InnoDB: Waiting for purge to start 2019-12-22 1:40:46 0 [Note] InnoDB: 10.4.12 started; log sequence number 84211; transaction id 55 2019-12-22 1:40:46 0 [Note] InnoDB: Loading buffer pool(s) from /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/ib_buffer_pool 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_MUTEXES' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_CMP' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'FEEDBACK' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'user_variables' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled. 2019-12-22 1:40:46 0 [Note] Plugin 'unix_socket' is disabled. 2019-12-22 1:40:46 0 [Note] InnoDB: Buffer pool(s) load completed at 191222 1:40:46 2019-12-22 1:40:46 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-pam-debug' 2019-12-22 1:40:46 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-aria' 2019-12-22 1:40:46 0 [Note] Server socket created on IP: '127.0.0.1'. 2019-12-22 1:40:46 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2019-12-22 1:40:46 0 [Note] WSREP: Server initialized 2019-12-22 1:40:46 0 [Note] WSREP: Server status change disconnected -> initializing 2019-12-22 1:40:46 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:46 0 [Note] WSREP: Server status change initializing -> initialized 2019-12-22 1:40:46 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:46 0 [Note] WSREP: Loading provider /usr/lib/libgalera_smm_4.so initial position: 00000000-0000-0000-0000-000000000000:-1 wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_smm_4.so' wsrep loader: [INFO] wsrep_load(): Galera 26.4.3(r4548) by Codership Oy loaded successfully. 2019-12-22 1:40:46 0 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-12-22 1:40:46 0 [Note] WSREP: Found saved state: 491d5f68-244b-11ea-bed1-da093aaab784:10, safe_to_bootstrap: 0 2019-12-22 1:40:46 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 2 UUID: 491d5f68-244b-11ea-bed1-da093aaab784 Seqno: -1 - -1 Offset: -1 Synced: 1 2019-12-22 1:40:46 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 491d5f68-244b-11ea-bed1-da093aaab784, offset: -1 2019-12-22 1:40:46 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/25 bytes) complete. 2019-12-22 1:40:46 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (25/25 bytes) complete. 2019-12-22 1:40:46 0 [Note] WSREP: Recovering GCache ring buffer: didn't recover any events. 2019-12-22 1:40:46 0 [Note] WSREP: Passing config to GCS: base_dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; base_host = 127.0.0.1; base_port = 16005; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 1; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 2019-12-22 1:40:46 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:40:46 0 [Note] WSREP: ####### Assign initial position for certification: 491d5f68-244b-11ea-bed1-da093aaab784:10, protocol version: -1 2019-12-22 1:40:46 0 [Note] WSREP: GCache history reset: old(491d5f68-244b-11ea-bed1-da093aaab784:0 -> 491d5f68-244b-11ea-bed1-da093aaab784:10 2019-12-22 1:40:46 0 [Note] WSREP: Start replication 2019-12-22 1:40:46 0 [Note] WSREP: Connecting with bootstrap option: 0 2019-12-22 1:40:46 0 [Note] WSREP: Setting GCS initial position to 491d5f68-244b-11ea-bed1-da093aaab784:10 2019-12-22 1:40:46 0 [Note] WSREP: protonet asio version 0 2019-12-22 1:40:46 0 [Note] WSREP: Using CRC-32C for message checksums. 2019-12-22 1:40:46 0 [Note] WSREP: backend: asio 2019-12-22 1:40:46 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-12-22 1:40:46 0 [Warning] WSREP: access file(/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//gvwstate.dat) failed(No such file or directory) 2019-12-22 1:40:46 0 [Note] WSREP: restore pc from disk failed 2019-12-22 1:40:46 0 [Note] WSREP: GMCast version 0 2019-12-22 1:40:46 0 [Note] WSREP: (4fa1f8c0, 'tcp://0.0.0.0:16005') listening at tcp://0.0.0.0:16005 2019-12-22 1:40:46 0 [Note] WSREP: (4fa1f8c0, 'tcp://0.0.0.0:16005') multicast: , ttl: 1 2019-12-22 1:40:46 0 [Note] WSREP: EVS version 1 2019-12-22 1:40:46 0 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '127.0.0.1:16002' 2019-12-22 1:40:46 0 [Note] WSREP: (4fa1f8c0, 'tcp://0.0.0.0:16005') connection established to 491c75b3 tcp://127.0.0.1:16002 2019-12-22 1:40:46 0 [Note] WSREP: (4fa1f8c0, 'tcp://0.0.0.0:16005') turning message relay requesting on, nonlive peers: 2019-12-22 1:40:47 0 [Note] WSREP: EVS version upgrade 0 -> 1 2019-12-22 1:40:47 0 [Note] WSREP: declaring 491c75b3 at tcp://127.0.0.1:16002 stable 2019-12-22 1:40:47 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2019-12-22 1:40:47 0 [Note] WSREP: Node 491c75b3 state prim 2019-12-22 1:40:47 0 [Note] WSREP: view(view_id(PRIM,491c75b3,4) memb { 491c75b3,0 4fa1f8c0,0 } joined { } left { } partitioned { }) 2019-12-22 1:40:47 0 [Note] WSREP: save pc into disk 2019-12-22 1:40:47 0 [Note] WSREP: gcomm: connected 2019-12-22 1:40:47 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-12-22 1:40:47 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-12-22 1:40:47 0 [Note] WSREP: Opened channel 'my_wsrep_cluster' 2019-12-22 1:40:47 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2019-12-22 1:40:47 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2019-12-22 1:40:47 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 4fef5346-244b-11ea-a1a9-4f2a92ec5563 2019-12-22 1:40:47 0 [Note] WSREP: STATE EXCHANGE: got state msg: 4fef5346-244b-11ea-a1a9-4f2a92ec5563 from 0 (cnt7glr11.localdomain) 2019-12-22 1:40:47 0 [Note] WSREP: STATE EXCHANGE: got state msg: 4fef5346-244b-11ea-a1a9-4f2a92ec5563 from 1 (cnt7glr11.localdomain) 2019-12-22 1:40:47 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 3, members = 1/2 (joined/total), act_id = 12, last_appl. = 0, protocols = 2/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 491d5f68-244b-11ea-bed1-da093aaab784 2019-12-22 1:40:47 7 [Note] WSREP: Starting rollbacker thread 7 2019-12-22 1:40:47 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000000 of size 134217728 bytes 2019-12-22 1:40:47 8 [Note] WSREP: Starting applier thread 8 2019-12-22 1:40:47 0 [Note] WSREP: Flow-control interval: [23, 23] 2019-12-22 1:40:47 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 13) 2019-12-22 1:40:47 8 [Note] WSREP: ####### processing CC 13, local, ordered 2019-12-22 1:40:47 8 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:40:47 8 [Note] WSREP: ####### My UUID: 4fa1f8c0-244b-11ea-b40b-b7feebe269bc 2019-12-22 1:40:47 8 [Note] WSREP: Server cnt7glr11.localdomain connected to cluster at position 491d5f68-244b-11ea-bed1-da093aaab784:13 with ID 4fa1f8c0-244b-11ea-b40b-b7feebe269bc 2019-12-22 1:40:47 8 [Note] WSREP: Server status change initialized -> connected 2019-12-22 1:40:47 8 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:47 8 [Note] WSREP: State transfer required: Group state: 491d5f68-244b-11ea-bed1-da093aaab784:13 Local state: 491d5f68-244b-11ea-bed1-da093aaab784:10 2019-12-22 1:40:47 8 [Note] WSREP: Server status change connected -> joiner 2019-12-22 1:40:47 8 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:40:47 8 [Note] WSREP: Prepared SST request: mysqldump|127.0.0.1:16001 2019-12-22 1:40:47 8 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes 2019-12-22 1:40:47 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:40:47 8 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: 5 2019-12-22 1:40:47 8 [Note] WSREP: ####### IST uuid:491d5f68-244b-11ea-bed1-da093aaab784 f: 11, l: 13, STRv: 3 2019-12-22 1:40:47 8 [Note] WSREP: IST receiver addr using tcp://127.0.0.1:16006 2019-12-22 1:40:47 8 [Note] WSREP: Prepared IST receiver for 11-13, listening at: tcp://127.0.0.1:16006 2019-12-22 1:40:47 0 [Note] WSREP: Deleted page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000000 2019-12-22 1:40:47 0 [Note] Reading of all Master_info entries succeeded 2019-12-22 1:40:47 0 [Note] Added new Master_info '' to hash table 2019-12-22 1:40:47 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld: ready for connections. Version: '10.4.12-MariaDB-debug-log' socket: '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2.sock' port: 16001 Source distribution 2019-12-22 1:40:47 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000001 of size 134217728 bytes 2019-12-22 1:40:47 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) requested state transfer from '*any*'. Selected 0.0 (cnt7glr11.localdomain)(SYNCED) as donor. 2019-12-22 1:40:47 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 13) 2019-12-22 1:40:47 8 [Note] WSREP: Requesting state transfer: success, donor: 0 2019-12-22 1:40:47 0 [Note] WSREP: Deleted page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000001 2019-12-22 1:40:49 0 [Note] WSREP: (4fa1f8c0, 'tcp://0.0.0.0:16005') turning message relay requesting off 2019-12-22 1:40:50 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 1:40:50 0 [ERROR] WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1178: Will never receive state. Need to abort. 2019-12-22 1:40:50 0 [Note] WSREP: gcomm: terminating thread 2019-12-22 1:40:50 0 [Note] WSREP: gcomm: joining thread 2019-12-22 1:40:50 0 [Note] WSREP: gcomm: closing backend 2019-12-22 1:40:51 0 [Note] WSREP: view(view_id(NON_PRIM,491c75b3,4) memb { 4fa1f8c0,0 } joined { } left { } partitioned { 491c75b3,0 }) 2019-12-22 1:40:51 0 [Note] WSREP: PC protocol downgrade 1 -> 0 2019-12-22 1:40:51 0 [Note] WSREP: view((empty)) 2019-12-22 1:40:51 0 [Note] WSREP: gcomm: closed 2019-12-22 1:40:51 0 [Note] WSREP: /home/stepan/mariadb/10.4/git/sql/mysqld: Terminated. ----------SERVER LOG END------------- - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_sst_mysqldump_with_key-debug,innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.galera_sst_mysqldump_with_key-debug,innodb/' ***Warnings generated in error logs during shutdown after running tests: galera.galera_sst_mysqldump_with_key 2019-12-22 1:40:47 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '491d5f68-244b-11ea-bed1-da093aaab784:10' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 1:40:47 2 [ERROR] WSREP: Try 1/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '491d5f68-244b-11ea-bed1-da093aaab784:10' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 1:40:48 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '491d5f68-244b-11ea-bed1-da093aaab784:10' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 1:40:48 2 [ERROR] WSREP: Try 2/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '491d5f68-244b-11ea-bed1-da093aaab784:10' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 1:40:49 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '491d5f68-244b-11ea-bed1-da093aaab784:10' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 1:40:49 2 [ERROR] WSREP: Try 3/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '491d5f68-244b-11ea-bed1-da093aaab784:10' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --enable-gdb --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 1:40:50 2 [Warning] WSREP: SST start failed 2019-12-22 1:40:50 2 [ERROR] WSREP: SST bypass failed: 1 2019-12-22 1:40:50 2 [ERROR] WSREP: Failed to bypass SST 2019-12-22 1:40:50 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 1:40:50 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 1:40:50 0 [ERROR] WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1178: Will never receive state. Need to abort. 191222 1:41:43 +51.956 galera.galera_sst_rsync 'debug,innodb' [ pass ] 46324 191222 1:42:40 +57.106 galera.galera_sst_rsync2 'debug,innodb' [ pass ] 45107 191222 1:43:38 +57.473 galera.galera_sst_rsync_data_dir 'debug,innodb' [ pass ] 45409 191222 1:43:52 +14.047 galera.galera_v1_row_events 'innodb' [ pass ] 2087 191222 1:44:10 +17.653 galera.galera_var_auto_inc_control_on 'innodb' [ pass ] 2106 191222 1:44:28 +18.315 galera.galera_var_gtid_domain_id 'innodb' [ pass ] 2743 191222 1:44:46 +17.646 galera.galera_var_log_bin 'innodb' [ pass ] 2096 191222 1:45:14 +28.453 galera.galera_var_slave_threads 'innodb' [ pass ] 2787 191222 1:45:22 +7.632 galera.galera_var_sst_auth 'innodb' [ pass ] 2017 191222 1:46:32 +70.648 galera.galera_wan_restart_ist 'innodb' [ pass ] 49415 191222 1:47:36 +63.508 galera.galera_wan_restart_sst 'innodb' [ pass ] 51539 191222 1:47:45 +8.899 galera.galera_wsrep_log_conficts 'innodb' [ pass ] 2139 191222 1:48:02 +17.661 galera.galera_wsrep_new_cluster 'innodb' [ pass ] 2031 191222 1:48:21 +18.327 galera.mdev_10518 'innodb' [ pass ] 2782 191222 1:48:42 +21.396 galera.mysql-wsrep#201 'innodb' [ pass ] 5729 191222 1:49:06 +23.918 galera.mysql-wsrep#33 'innodb' [ fail ] Test ended at 2019-12-22 01:49:06 CURRENT_TEST: galera.mysql-wsrep#33 Server [mysqld.2 - pid: 24637, winpid: 24637, exit: 256] failed during test run Server log from this test: ----------SERVER LOG START----------- 2019-12-22 1:48:53 0 [Warning] WSREP: option --wsrep-causal-reads is deprecated 2019-12-22 1:48:53 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld (mysqld 10.4.12-MariaDB-debug-log) starting as process 24640 ... 2019-12-22 1:48:53 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4186) 2019-12-22 1:48:53 0 [Warning] Changed limits: max_open_files: 1024 max_connections: 151 (was 151) table_cache: 421 (was 2000) 2019-12-22 1:48:53 0 [Note] WSREP: Loading provider /usr/lib/libgalera_smm_4.so initial position: 00000000-0000-0000-0000-000000000000:-1 wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_smm_4.so' wsrep loader: [INFO] wsrep_load(): Galera 26.4.3(r4548) by Codership Oy loaded successfully. 2019-12-22 1:48:53 0 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-12-22 1:48:53 0 [Warning] WSREP: Could not open state file for reading: '/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//grastate.dat' 2019-12-22 1:48:53 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1 2019-12-22 1:48:53 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 0 UUID: 00000000-0000-0000-0000-000000000000 Seqno: -1 - -1 Offset: -1 Synced: 0 2019-12-22 1:48:53 0 [Note] WSREP: Skipped GCache ring buffer recovery: could not determine history UUID. 2019-12-22 1:48:53 0 [Note] WSREP: Passing config to GCS: base_dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; base_host = 127.0.0.1; base_port = 16005; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limi 2019-12-22 1:48:53 0 [Note] WSREP: Start replication 2019-12-22 1:48:53 0 [Note] WSREP: Connecting with bootstrap option: 0 2019-12-22 1:48:53 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1 2019-12-22 1:48:53 0 [Note] WSREP: protonet asio version 0 2019-12-22 1:48:53 0 [Note] WSREP: Using CRC-32C for message checksums. 2019-12-22 1:48:53 0 [Note] WSREP: backend: asio 2019-12-22 1:48:53 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-12-22 1:48:53 0 [Warning] WSREP: access file(/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//gvwstate.dat) failed(No such file or directory) 2019-12-22 1:48:53 0 [Note] WSREP: restore pc from disk failed 2019-12-22 1:48:53 0 [Note] WSREP: GMCast version 0 2019-12-22 1:48:53 0 [Note] WSREP: (71d0618c, 'tcp://0.0.0.0:16005') listening at tcp://0.0.0.0:16005 2019-12-22 1:48:53 0 [Note] WSREP: (71d0618c, 'tcp://0.0.0.0:16005') multicast: , ttl: 1 2019-12-22 1:48:53 0 [Note] WSREP: EVS version 1 2019-12-22 1:48:53 0 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '127.0.0.1:16002' 2019-12-22 1:48:53 0 [Note] WSREP: (71d0618c, 'tcp://0.0.0.0:16005') connection established to 718ce379 tcp://127.0.0.1:16002 2019-12-22 1:48:53 0 [Note] WSREP: (71d0618c, 'tcp://0.0.0.0:16005') turning message relay requesting on, nonlive peers: 2019-12-22 1:48:53 0 [Note] WSREP: EVS version upgrade 0 -> 1 2019-12-22 1:48:53 0 [Note] WSREP: declaring 718ce379 at tcp://127.0.0.1:16002 stable 2019-12-22 1:48:53 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2019-12-22 1:48:53 0 [Note] WSREP: Node 718ce379 state prim 2019-12-22 1:48:53 0 [Note] WSREP: view(view_id(PRIM,718ce379,2) memb { 718ce379,0 71d0618c,0 } joined { } left { } partitioned { }) 2019-12-22 1:48:53 0 [Note] WSREP: save pc into disk 2019-12-22 1:48:54 0 [Note] WSREP: gcomm: connected 2019-12-22 1:48:54 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-12-22 1:48:54 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-12-22 1:48:54 0 [Note] WSREP: Opened channel 'my_wsrep_cluster' 2019-12-22 1:48:54 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2019-12-22 1:48:54 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2019-12-22 1:48:54 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 721d985f-244c-11ea-afb3-3726532ccdad 2019-12-22 1:48:54 0 [Note] WSREP: STATE EXCHANGE: got state msg: 721d985f-244c-11ea-afb3-3726532ccdad from 0 (cnt7glr11.localdomain) 2019-12-22 1:48:54 0 [Note] WSREP: STATE EXCHANGE: got state msg: 721d985f-244c-11ea-afb3-3726532ccdad from 1 (cnt7glr11.localdomain) 2019-12-22 1:48:54 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 1, members = 1/2 (joined/total), act_id = 1, last_appl. = 0, protocols = 2/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 718da6f9-244c-11ea-aa05-63d39047a7c6 2019-12-22 1:48:54 0 [Note] WSREP: Flow-control interval: [23, 23] 2019-12-22 1:48:54 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 2) 2019-12-22 1:48:54 1 [Note] WSREP: Starting rollbacker thread 1 2019-12-22 1:48:54 2 [Note] WSREP: Starting applier thread 2 2019-12-22 1:48:54 2 [Note] WSREP: ####### processing CC 2, local, ordered 2019-12-22 1:48:54 2 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:48:54 2 [Note] WSREP: ####### My UUID: 71d0618c-244c-11ea-9547-6a0c29545033 2019-12-22 1:48:54 2 [Note] WSREP: Server cnt7glr11.localdomain connected to cluster at position 718da6f9-244c-11ea-aa05-63d39047a7c6:2 with ID 71d0618c-244c-11ea-9547-6a0c29545033 2019-12-22 1:48:54 2 [Note] WSREP: Server status change disconnected -> connected 2019-12-22 1:48:54 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:48:54 2 [Note] WSREP: State transfer required: Group state: 718da6f9-244c-11ea-aa05-63d39047a7c6:2 Local state: 00000000-0000-0000-0000-000000000000:-1 2019-12-22 1:48:54 2 [Note] WSREP: Server status change connected -> joiner 2019-12-22 1:48:54 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:48:54 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '127.0.0.2:16007' --datadir '/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.2' --parent '24640' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.2 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' 2019-12-22 1:48:54 2 [Note] WSREP: Prepared SST request: rsync|127.0.0.2:16007/rsync_sst 2019-12-22 1:48:54 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes 2019-12-22 1:48:54 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:48:54 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: 5 2019-12-22 1:48:54 2 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 2, STRv: 3 2019-12-22 1:48:54 2 [Note] WSREP: IST receiver addr using tcp://127.0.0.1:16006 2019-12-22 1:48:54 2 [Note] WSREP: Prepared IST receiver for 0-2, listening at: tcp://127.0.0.1:16006 2019-12-22 1:48:54 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) requested state transfer from '*any*'. Selected 0.0 (cnt7glr11.localdomain)(SYNCED) as donor. 2019-12-22 1:48:54 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 2) 2019-12-22 1:48:54 2 [Note] WSREP: Requesting state transfer: success, donor: 0 2019-12-22 1:48:54 2 [Note] WSREP: Resetting GCache seqno map due to different histories. 2019-12-22 1:48:54 2 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0 -> 718da6f9-244c-11ea-aa05-63d39047a7c6:2 WSREP_SST: [INFO] Joiner cleanup. rsync PID: 24789 (20191222 01:48:55.515) 2019-12-22 1:48:55 0 [Note] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) complete. 2019-12-22 1:48:55 0 [Note] WSREP: Member 0.0 (cnt7glr11.localdomain) synced with group. WSREP_SST: [INFO] Joiner cleanup done. (20191222 01:48:56.022) 2019-12-22 1:48:56 3 [Note] WSREP: SST received 2019-12-22 1:48:56 3 [Note] WSREP: Server status change joiner -> initializing 2019-12-22 1:48:56 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:48:56 0 [Note] Plugin 'partition' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'SEQUENCE' is disabled. 2019-12-22 1:48:56 0 [Note] InnoDB: Using Linux native AIO 2019-12-22 1:48:56 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!! 2019-12-22 1:48:56 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-12-22 1:48:56 0 [Note] InnoDB: Uses event mutexes 2019-12-22 1:48:56 0 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-12-22 1:48:56 0 [Note] InnoDB: Number of pools: 1 2019-12-22 1:48:56 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-12-22 1:48:56 0 [Note] mysqld: O_TMPFILE is not supported on /home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2 (disabling future attempts) 2019-12-22 1:48:56 0 [Note] InnoDB: Initializing buffer pool, total size = 8M, instances = 1, chunk size = 8M 2019-12-22 1:48:56 0 [Note] InnoDB: Completed initialization of buffer pool 2019-12-22 1:48:56 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-12-22 1:48:56 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=68855 2019-12-22 1:48:56 0 [Note] InnoDB: Starting final batch to recover 18 pages from redo log. 2019-12-22 1:48:56 0 [Note] WSREP: (71d0618c, 'tcp://0.0.0.0:16005') turning message relay requesting off 2019-12-22 1:48:56 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-12-22 1:48:56 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-12-22 1:48:56 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-12-22 1:48:56 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2019-12-22 1:48:56 0 [Note] InnoDB: Waiting for purge to start 2019-12-22 1:48:56 0 [Note] InnoDB: 10.4.12 started; log sequence number 78230; transaction id 46 2019-12-22 1:48:56 0 [Note] InnoDB: Loading buffer pool(s) from /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/ib_buffer_pool 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_MUTEXES' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_CMP' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'FEEDBACK' is disabled. 2019-12-22 1:48:56 0 [Note] InnoDB: Buffer pool(s) load completed at 191222 1:48:56 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'user_variables' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled. 2019-12-22 1:48:56 0 [Note] Plugin 'unix_socket' is disabled. 2019-12-22 1:48:56 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-pam-debug' 2019-12-22 1:48:56 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-aria' 2019-12-22 1:48:56 0 [Note] Server socket created on IP: '127.0.0.1'. 2019-12-22 1:48:56 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2019-12-22 1:48:56 0 [Note] WSREP: Server initialized 2019-12-22 1:48:56 0 [Note] WSREP: Server status change initializing -> initialized 2019-12-22 1:48:56 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:48:56 3 [Note] WSREP: Server status change initialized -> joined 2019-12-22 1:48:56 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:48:56 0 [Note] Reading of all Master_info entries succeeded 2019-12-22 1:48:56 0 [Note] Added new Master_info '' to hash table 2019-12-22 1:48:56 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld: ready for connections. Version: '10.4.12-MariaDB-debug-log' socket: '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2.sock' port: 16001 Source distribution 2019-12-22 1:48:56 3 [Note] WSREP: Recovered position from storage: 718da6f9-244c-11ea-aa05-63d39047a7c6:2 2019-12-22 1:48:56 3 [Note] WSREP: Recovered view from SST: id: 718da6f9-244c-11ea-aa05-63d39047a7c6:2 status: primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: no own_index: 1 members(2): 0: 718ce379-244c-11ea-95a6-c3f7f83b550f, cnt7glr11.localdomain 1: 71d0618c-244c-11ea-9547-6a0c29545033, cnt7glr11.localdomain 2019-12-22 1:48:56 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:48:56 12 [Note] WSREP: Recovered cluster id 718da6f9-244c-11ea-aa05-63d39047a7c6 2019-12-22 1:48:56 3 [Note] WSREP: SST received: 718da6f9-244c-11ea-aa05-63d39047a7c6:2 2019-12-22 1:48:56 2 [Note] WSREP: Installed new state from SST: 718da6f9-244c-11ea-aa05-63d39047a7c6:2 2019-12-22 1:48:56 2 [Note] WSREP: Cert. index preload up to 2 2019-12-22 1:48:56 0 [Note] WSREP: ####### IST applying starts with 3 2019-12-22 1:48:56 0 [Note] WSREP: ####### IST current seqno initialized to 2 2019-12-22 1:48:56 0 [Note] WSREP: Receiving IST... 0.0% (0/1 events) complete. 2019-12-22 1:48:56 0 [Note] WSREP: IST preload starting at 2 2019-12-22 1:48:56 0 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:48:56 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:48:56 0 [Note] WSREP: ####### Assign initial position for certification: 718da6f9-244c-11ea-aa05-63d39047a7c6:1, protocol version: 5 2019-12-22 1:48:56 0 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:48:56 0 [Note] WSREP: ####### Adjusting cert position: 1 -> 2 2019-12-22 1:48:56 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:48:56 0 [Note] WSREP: Lowest cert indnex boundary for CC from preload: 2 2019-12-22 1:48:56 0 [Note] WSREP: Min available from gcache for CC from preload: 2 2019-12-22 1:48:56 0 [Note] WSREP: Receiving IST...100.0% (1/1 events) complete. 2019-12-22 1:48:56 2 [Note] WSREP: IST received: 718da6f9-244c-11ea-aa05-63d39047a7c6:2 2019-12-22 1:48:56 2 [Note] WSREP: Lowest cert indnex boundary for CC from group: 2 2019-12-22 1:48:56 2 [Note] WSREP: Min available from gcache for CC from group: 2 2019-12-22 1:48:56 0 [Note] WSREP: 1.0 (cnt7glr11.localdomain): State transfer from 0.0 (cnt7glr11.localdomain) complete. 2019-12-22 1:48:56 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 2) 2019-12-22 1:48:56 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) synced with group. 2019-12-22 1:48:56 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2) 2019-12-22 1:48:56 2 [Note] WSREP: Server cnt7glr11.localdomain synced with group 2019-12-22 1:48:56 2 [Note] WSREP: Server status change joined -> synced 2019-12-22 1:48:56 2 [Note] WSREP: Synchronized with group, ready for connections 2019-12-22 1:48:56 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:48:59 15 [Note] WSREP: Stop replication by 15 2019-12-22 1:48:59 15 [Note] WSREP: Server status change synced -> disconnecting 2019-12-22 1:48:59 15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:49:00 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:49:00 2 [Note] WSREP: Server status change disconnecting -> disconnected 2019-12-22 1:49:00 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:49:00 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:49:00 2 [Note] WSREP: Applier thread exiting ret: 0 thd: 2 2019-12-22 1:49:00 2 [Warning] Aborted connection 2 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) 2019-12-22 1:49:00 1 [Note] WSREP: rollbacker thread exiting 1 2019-12-22 1:49:00 1 [Warning] Aborted connection 1 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) wsrep loader: [INFO] wsrep_load(): loading provider library 'none' 2019-12-22 1:49:01 15 [Note] WSREP: Stop replication by 15 2019-12-22 1:49:01 15 [Note] WSREP: Loading provider /usr/lib/libgalera_smm_4.so initial position: 00000000-0000-0000-0000-000000000000:-1 wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_smm_4.so' wsrep loader: [INFO] wsrep_load(): Galera 26.4.3(r4548) by Codership Oy loaded successfully. 2019-12-22 1:49:01 15 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-12-22 1:49:01 15 [Note] WSREP: Found saved state: 718da6f9-244c-11ea-aa05-63d39047a7c6:7, safe_to_bootstrap: 0 2019-12-22 1:49:01 15 [Note] WSREP: GCache DEBUG: opened preamble: Version: 2 UUID: 718da6f9-244c-11ea-aa05-63d39047a7c6 Seqno: 2 - 7 Offset: 1280 Synced: 1 2019-12-22 1:49:01 15 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 718da6f9-244c-11ea-aa05-63d39047a7c6, offset: 1280 2019-12-22 1:49:01 15 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/134217752 bytes) complete. 2019-12-22 1:49:01 15 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (134217752/134217752 bytes) complete. 2019-12-22 1:49:01 15 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 2-7 2019-12-22 1:49:01 15 [Note] WSREP: GCache::RingBuffer unused buffers scan... 0.0% ( 0/3728 bytes) complete. 2019-12-22 1:49:01 15 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (3728/3728 bytes) complete. 2019-12-22 1:49:01 15 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): found 0/6 locked buffers 2019-12-22 1:49:01 15 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): used space: 3728/134217728 2019-12-22 1:49:01 15 [Note] WSREP: Passing config to GCS: base_dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; base_host = 127.0.0.1; base_port = 16005; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.causal_keepalive_period = PT1S; evs.debug_log_mask = 0x1; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.info_log_mask = 0; evs.install_timeout = PT7.5S; evs.join_retrans_period = PT1S; evs.keepalive_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.use_aggregate = true; evs.user_send_window = 2; evs.version = 1; evs.view_forget_timeout = P1D; gcache.debug = 0; gcache.dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; 2019-12-22 1:49:01 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:49:01 15 [Note] WSREP: ####### Assign initial position for certification: 718da6f9-244c-11ea-aa05-63d39047a7c6:7, protocol version: -1 2019-12-22 1:49:01 15 [Note] WSREP: Stop replication by 15 2019-12-22 1:49:01 15 [Note] WSREP: Start replication 2019-12-22 1:49:01 15 [Note] WSREP: Connecting with bootstrap option: 0 2019-12-22 1:49:01 15 [Note] WSREP: Setting GCS initial position to 718da6f9-244c-11ea-aa05-63d39047a7c6:7 2019-12-22 1:49:01 15 [Note] WSREP: protonet asio version 0 2019-12-22 1:49:01 15 [Note] WSREP: Using CRC-32C for message checksums. 2019-12-22 1:49:01 15 [Note] WSREP: backend: asio 2019-12-22 1:49:01 15 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-12-22 1:49:01 15 [Warning] WSREP: access file(/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//gvwstate.dat) failed(No such file or directory) 2019-12-22 1:49:01 15 [Note] WSREP: restore pc from disk failed 2019-12-22 1:49:01 15 [Note] WSREP: GMCast version 0 2019-12-22 1:49:01 15 [Note] WSREP: (767aeb36, 'tcp://0.0.0.0:16005') listening at tcp://0.0.0.0:16005 2019-12-22 1:49:01 15 [Note] WSREP: (767aeb36, 'tcp://0.0.0.0:16005') multicast: , ttl: 1 2019-12-22 1:49:01 15 [Note] WSREP: EVS version 1 2019-12-22 1:49:01 15 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '127.0.0.1:16002' 2019-12-22 1:49:01 15 [Note] WSREP: (767aeb36, 'tcp://0.0.0.0:16005') connection established to 718ce379 tcp://127.0.0.1:16002 2019-12-22 1:49:01 15 [Note] WSREP: (767aeb36, 'tcp://0.0.0.0:16005') turning message relay requesting on, nonlive peers: 2019-12-22 1:49:01 15 [Note] WSREP: EVS version upgrade 0 -> 1 2019-12-22 1:49:01 15 [Note] WSREP: declaring 718ce379 at tcp://127.0.0.1:16002 stable 2019-12-22 1:49:01 15 [Note] WSREP: PC protocol upgrade 0 -> 1 2019-12-22 1:49:01 15 [Note] WSREP: Node 718ce379 state prim 2019-12-22 1:49:01 15 [Note] WSREP: view(view_id(PRIM,718ce379,4) memb { 718ce379,0 767aeb36,0 } joined { } left { } partitioned { }) 2019-12-22 1:49:01 15 [Note] WSREP: save pc into disk 2019-12-22 1:49:02 15 [Note] WSREP: gcomm: connected 2019-12-22 1:49:02 15 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-12-22 1:49:02 15 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-12-22 1:49:02 15 [Note] WSREP: Opened channel 'my_wsrep_cluster' 2019-12-22 1:49:02 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2019-12-22 1:49:02 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2019-12-22 1:49:02 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 76c82957-244c-11ea-bd1a-9ef239691c76 2019-12-22 1:49:02 0 [Note] WSREP: STATE EXCHANGE: got state msg: 76c82957-244c-11ea-bd1a-9ef239691c76 from 0 (cnt7glr11.localdomain) 2019-12-22 1:49:02 16 [Note] WSREP: Starting rollbacker thread 16 2019-12-22 1:49:02 17 [Note] WSREP: Starting applier thread 17 2019-12-22 1:49:02 0 [Note] WSREP: STATE EXCHANGE: got state msg: 76c82957-244c-11ea-bd1a-9ef239691c76 from 1 (cnt7glr11.localdomain) 2019-12-22 1:49:02 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 3, members = 1/2 (joined/total), act_id = 9, last_appl. = 0, protocols = 2/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 718da6f9-244c-11ea-aa05-63d39047a7c6 2019-12-22 1:49:02 0 [Note] WSREP: Flow-control interval: [23, 23] 2019-12-22 1:49:02 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 10) 2019-12-22 1:49:02 17 [Note] WSREP: ####### processing CC 10, local, ordered 2019-12-22 1:49:02 17 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 1:49:02 17 [Note] WSREP: ####### My UUID: 767aeb36-244c-11ea-86f1-f34c5a682e72 2019-12-22 1:49:02 17 [Note] WSREP: Server cnt7glr11.localdomain connected to cluster at position 718da6f9-244c-11ea-aa05-63d39047a7c6:10 with ID 767aeb36-244c-11ea-86f1-f34c5a682e72 2019-12-22 1:49:02 17 [Note] WSREP: Server status change disconnected -> connected 2019-12-22 1:49:02 17 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:49:02 17 [Note] WSREP: State transfer required: Group state: 718da6f9-244c-11ea-aa05-63d39047a7c6:10 Local state: 718da6f9-244c-11ea-aa05-63d39047a7c6:7 2019-12-22 1:49:02 17 [Note] WSREP: Server status change connected -> joiner 2019-12-22 1:49:02 17 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 1:49:02 17 [Note] WSREP: Prepared SST request: mysqldump|127.0.0.1:16001 2019-12-22 1:49:02 17 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes 2019-12-22 1:49:02 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 1:49:02 17 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: 5 2019-12-22 1:49:02 17 [Note] WSREP: ####### IST uuid:718da6f9-244c-11ea-aa05-63d39047a7c6 f: 8, l: 10, STRv: 3 2019-12-22 1:49:02 17 [Note] WSREP: IST receiver addr using tcp://127.0.0.1:16006 2019-12-22 1:49:02 17 [Note] WSREP: Prepared IST receiver for 8-10, listening at: tcp://127.0.0.1:16006 2019-12-22 1:49:02 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) requested state transfer from '*any*'. Selected 0.0 (cnt7glr11.localdomain)(SYNCED) as donor. 2019-12-22 1:49:02 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 10) 2019-12-22 1:49:02 17 [Note] WSREP: Requesting state transfer: success, donor: 0 2019-12-22 1:49:04 0 [Note] WSREP: (767aeb36, 'tcp://0.0.0.0:16005') turning message relay requesting off 2019-12-22 1:49:05 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 1:49:05 0 [ERROR] WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1178: Will never receive state. Need to abort. 2019-12-22 1:49:05 0 [Note] WSREP: gcomm: terminating thread 2019-12-22 1:49:05 0 [Note] WSREP: gcomm: joining thread 2019-12-22 1:49:05 0 [Note] WSREP: gcomm: closing backend 2019-12-22 1:49:06 0 [Note] WSREP: view(view_id(NON_PRIM,718ce379,4) memb { 767aeb36,0 } joined { } left { } partitioned { 718ce379,0 }) 2019-12-22 1:49:06 0 [Note] WSREP: PC protocol downgrade 1 -> 0 2019-12-22 1:49:06 0 [Note] WSREP: view((empty)) 2019-12-22 1:49:06 0 [Note] WSREP: gcomm: closed 2019-12-22 1:49:06 0 [Note] WSREP: /home/stepan/mariadb/10.4/git/sql/mysqld: Terminated. ----------SERVER LOG END------------- mysqltest failed but provided no output The result from queries just before the failure was: < snip > INSERT INTO t1 VALUES ('node1_committed_during'); INSERT INTO t1 VALUES ('node1_committed_during'); INSERT INTO t1 VALUES ('node1_committed_during'); COMMIT; START TRANSACTION; INSERT INTO t1 VALUES ('node1_to_be_committed_after'); INSERT INTO t1 VALUES ('node1_to_be_committed_after'); INSERT INTO t1 VALUES ('node1_to_be_committed_after'); INSERT INTO t1 VALUES ('node1_to_be_committed_after'); INSERT INTO t1 VALUES ('node1_to_be_committed_after'); connect node_1a_galera_st_disconnect_slave, 127.0.0.1, root, , test, $NODE_MYPORT_1; SET AUTOCOMMIT=OFF; START TRANSACTION; INSERT INTO t1 VALUES ('node1_to_be_rollbacked_after'); INSERT INTO t1 VALUES ('node1_to_be_rollbacked_after'); INSERT INTO t1 VALUES ('node1_to_be_rollbacked_after'); INSERT INTO t1 VALUES ('node1_to_be_rollbacked_after'); INSERT INTO t1 VALUES ('node1_to_be_rollbacked_after'); connection node_2; Loading wsrep provider ... - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.mysql-wsrep#33-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera.mysql-wsrep#33-innodb/' ***Warnings generated in error logs during shutdown after running tests: galera.mysql-wsrep#33 2019-12-22 1:49:02 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '718da6f9-244c-11ea-aa05-63d39047a7c6:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 1:49:02 2 [ERROR] WSREP: Try 1/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '718da6f9-244c-11ea-aa05-63d39047a7c6:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 1:49:03 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '718da6f9-244c-11ea-aa05-63d39047a7c6:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 1:49:03 2 [ERROR] WSREP: Try 2/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '718da6f9-244c-11ea-aa05-63d39047a7c6:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 1:49:04 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '718da6f9-244c-11ea-aa05-63d39047a7c6:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 1:49:04 2 [ERROR] WSREP: Try 3/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '718da6f9-244c-11ea-aa05-63d39047a7c6:7' --gtid-domain-id '0' --bypass --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 1:49:05 2 [Warning] WSREP: SST start failed 2019-12-22 1:49:05 2 [ERROR] WSREP: SST bypass failed: 1 2019-12-22 1:49:05 2 [ERROR] WSREP: Failed to bypass SST 2019-12-22 1:49:05 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 1:49:05 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 1:49:05 0 [ERROR] WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1178: Will never receive state. Need to abort. 191222 1:49:14 +7.551 galera.rpl_row_annotate 'innodb' [ pass ] 2091 191222 1:49:34 +20.359 galera.versioning_trx_id 'innodb' [ pass ] 2129 191222 1:49:57 +23.385 galera_3nodes.galera_certification_ccc 'innodb' [ pass ] 15113 191222 1:50:01 +3.482 galera_3nodes.galera_certification_double_failure 'innodb' [ pass ] 3146 191222 1:50:15 +13.986 galera_3nodes.galera_evs_suspect_timeout 'innodb' [ pass ] 13693 191222 1:50:18 +3.395 galera_3nodes.galera_parallel_apply_3nodes 'innodb' [ pass ] 3091 191222 1:50:58 +39.506 galera_3nodes.galera_safe_to_bootstrap 'innodb' [ pass ] 39133 191222 1:51:16 +18.238 galera_3nodes.galera_var_dirty_reads2 'innodb' [ pass ] 17898 191222 1:51:26 +9.955 galera_3nodes.galera_wsrep_schema 'innodb' [ pass ] 9647 191222 1:51:47 +21.393 galera_3nodes.GAL-501 'innodb' [ pass ] 13380 191222 1:52:04 +16.498 galera_3nodes.galera_gtid_2_cluster 'innodb' [ pass ] 8283 191222 1:52:47 +42.711 galera_3nodes.galera_innobackupex_backup 'innodb' [ pass ] 34266 191222 1:53:29 +42.925 galera_3nodes.galera_ipv6_mariabackup 'innodb' [ pass ] 12626 191222 1:54:13 +43.190 galera_3nodes.galera_ipv6_mariabackup_section 'innodb' [ pass ] 12584 191222 1:54:40 +27.205 galera_3nodes.galera_ipv6_mysqldump 'innodb' [ pass ] 18725 191222 1:55:01 +20.976 galera_3nodes.galera_ipv6_rsync 'innodb' [ pass ] 13418 191222 1:55:25 +24.019 galera_3nodes.galera_ipv6_rsync_section 'innodb' [ pass ] 12514 191222 1:55:49 +24.552 galera_3nodes.galera_ist_gcache_rollover 'innodb' [ pass ] 15499 191222 1:56:37 +47.677 galera_3nodes.galera_pc_bootstrap 'innodb' [ pass ] 38693 191222 1:57:04 +26.814 galera_3nodes.galera_pc_weight 'innodb' [ pass ] 18413 191222 1:59:24 +139.742 galera_sr.galera_sr_large_fragment 'innodb' [ pass ] 127614 191222 1:59:43 +19.591 galera_sr.mysql-wsrep-features#32 'innodb' [ pass ] 3824 191222 2:00:01 +17.801 galera_sr.galera_sr_gtid 'innodb' [ pass ] 2114 191222 2:00:20 +18.602 galera_sr.galera_sr_log_bin 'innodb' [ pass ] 2923 191222 2:00:22 +2.361 galera_sr.mysql-wsrep-features#136 'innodb' [ pass ] 2094 191222 2:00:40 +17.732 galera_sr.galera_sr_v1_row_events 'innodb' [ pass ] 2086 191222 2:01:09 +29.491 galera_sr.GCF-1018B 'innodb' [ pass ] 13801 191222 2:03:46 +156.964 galera_sr.galera-features#56 'innodb' [ pass ] 156712 191222 2:04:00 +13.954 galera_sr.galera_sr_kill_all_nobootstrap 'innodb' [ pass ] 13665 191222 2:04:11 +11.046 galera_sr.galera_sr_kill_all_pcrecovery 'innodb' [ fail ] Test ended at 2019-12-22 02:04:11 CURRENT_TEST: galera_sr.galera_sr_kill_all_pcrecovery Server [mysqld.2 - pid: 20900, winpid: 20900, exit: 256] failed during test run Server log from this test: ----------SERVER LOG START----------- 2019-12-22 2:04:09 0 [Warning] WSREP: option --wsrep-causal-reads is deprecated 2019-12-22 2:04:09 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld (mysqld 10.4.12-MariaDB-debug-log) starting as process 20901 ... 2019-12-22 2:04:09 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4186) 2019-12-22 2:04:09 0 [Warning] Changed limits: max_open_files: 1024 max_connections: 151 (was 151) table_cache: 421 (was 2000) 2019-12-22 2:04:09 0 [Note] WSREP: Loading provider /usr/lib/libgalera_smm_4.so initial position: 00000000-0000-0000-0000-000000000000:-1 wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_smm_4.so' wsrep loader: [INFO] wsrep_load(): Galera 26.4.3(r4548) by Codership Oy loaded successfully. 2019-12-22 2:04:09 0 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-12-22 2:04:09 0 [Warning] WSREP: Could not open state file for reading: '/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//grastate.dat' 2019-12-22 2:04:09 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1 2019-12-22 2:04:09 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 2 UUID: 8ac49ac6-244e-11ea-9e57-de0321ede38c Seqno: -1 - -1 Offset: -1 Synced: 0 2019-12-22 2:04:09 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 8ac49ac6-244e-11ea-9e57-de0321ede38c, offset: -1 2019-12-22 2:04:09 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/134217752 bytes) complete. 2019-12-22 2:04:09 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (134217752/134217752 bytes) complete. 2019-12-22 2:04:09 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 2-32014 2019-12-22 2:04:09 0 [Note] WSREP: GCache::RingBuffer unused buffers scan... 0.0% ( 0/7678728 bytes) complete. 2019-12-22 2:04:09 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (7678728/7678728 bytes) complete. 2019-12-22 2:04:09 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): found 2/32015 locked buffers 2019-12-22 2:04:09 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): used space: 7678728/134217728 2019-12-22 2:04:09 0 [Note] WSREP: Passing config to GCS: base_dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; base_host = 127.0.0.1; base_port = 16005; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT30S; evs.install_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT10S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 92233720368 2019-12-22 2:04:09 0 [Note] WSREP: Start replication 2019-12-22 2:04:09 0 [Note] WSREP: Connecting with bootstrap option: 0 2019-12-22 2:04:09 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1 2019-12-22 2:04:09 0 [Note] WSREP: protonet asio version 0 2019-12-22 2:04:09 0 [Note] WSREP: Using CRC-32C for message checksums. 2019-12-22 2:04:09 0 [Note] WSREP: backend: asio 2019-12-22 2:04:09 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-12-22 2:04:09 0 [Note] WSREP: restore pc from disk successfully 2019-12-22 2:04:09 0 [Note] WSREP: GMCast version 0 2019-12-22 2:04:09 0 [Note] WSREP: (1d98a443, 'tcp://0.0.0.0:16005') listening at tcp://0.0.0.0:16005 2019-12-22 2:04:09 0 [Note] WSREP: (1d98a443, 'tcp://0.0.0.0:16005') multicast: , ttl: 1 2019-12-22 2:04:09 0 [Note] WSREP: EVS version 1 2019-12-22 2:04:09 0 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '127.0.0.1:16002' 2019-12-22 2:04:09 0 [Note] WSREP: (1d98a443, 'tcp://0.0.0.0:16005') connection established to 1d42b7c7 tcp://127.0.0.1:16002 2019-12-22 2:04:09 0 [Note] WSREP: (1d98a443, 'tcp://0.0.0.0:16005') turning message relay requesting on, nonlive peers: 2019-12-22 2:04:09 0 [Note] WSREP: EVS version upgrade 0 -> 1 2019-12-22 2:04:09 0 [Note] WSREP: declaring 1d42b7c7 at tcp://127.0.0.1:16002 stable 2019-12-22 2:04:09 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2019-12-22 2:04:09 0 [Note] WSREP: Node 1d42b7c7 state prim 2019-12-22 2:04:09 0 [Note] WSREP: view(view_id(PRIM,1d42b7c7,8) memb { 1d42b7c7,0 1d98a443,0 } joined { } left { } partitioned { }) 2019-12-22 2:04:09 0 [Note] WSREP: save pc into disk 2019-12-22 2:04:09 0 [Note] WSREP: clear restored view 2019-12-22 2:04:10 0 [Note] WSREP: gcomm: connected 2019-12-22 2:04:10 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-12-22 2:04:10 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-12-22 2:04:10 0 [Note] WSREP: Opened channel 'my_wsrep_cluster' 2019-12-22 2:04:10 1 [Note] WSREP: Starting rollbacker thread 1 2019-12-22 2:04:10 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2019-12-22 2:04:10 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2019-12-22 2:04:10 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 940fc7d1-244e-11ea-9028-f655cd44c8e8 2019-12-22 2:04:10 0 [Note] WSREP: STATE EXCHANGE: got state msg: 940fc7d1-244e-11ea-9028-f655cd44c8e8 from 0 (cnt7glr11.localdomain) 2019-12-22 2:04:10 0 [Note] WSREP: STATE EXCHANGE: got state msg: 940fc7d1-244e-11ea-9028-f655cd44c8e8 from 1 (cnt7glr11.localdomain) 2019-12-22 2:04:10 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 1, members = 1/2 (joined/total), act_id = 1, last_appl. = 0, protocols = 2/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 9309a66e-244e-11ea-b021-ebbdaedd8413 2019-12-22 2:04:10 0 [Note] WSREP: Flow-control interval: [23, 23] 2019-12-22 2:04:10 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 2) 2019-12-22 2:04:10 2 [Note] WSREP: Starting applier thread 2 2019-12-22 2:04:10 2 [Note] WSREP: ####### processing CC 2, local, ordered 2019-12-22 2:04:10 2 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 2:04:10 2 [Note] WSREP: ####### My UUID: 1d98a443-244e-11ea-97ca-93649b78079e 2019-12-22 2:04:10 2 [Note] WSREP: Server cnt7glr11.localdomain connected to cluster at position 9309a66e-244e-11ea-b021-ebbdaedd8413:2 with ID 1d98a443-244e-11ea-97ca-93649b78079e 2019-12-22 2:04:10 2 [Note] WSREP: Server status change disconnected -> connected 2019-12-22 2:04:10 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:04:10 2 [Note] WSREP: State transfer required: Group state: 9309a66e-244e-11ea-b021-ebbdaedd8413:2 Local state: 00000000-0000-0000-0000-000000000000:-1 2019-12-22 2:04:10 2 [Note] WSREP: Server status change connected -> joiner 2019-12-22 2:04:10 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:04:10 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '127.0.0.2:16007' --datadir '/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.2' --parent '20901' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.2 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' 2019-12-22 2:04:10 2 [Note] WSREP: Prepared SST request: rsync|127.0.0.2:16007/rsync_sst 2019-12-22 2:04:10 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes 2019-12-22 2:04:10 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 2:04:10 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: 5 2019-12-22 2:04:10 2 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 2, STRv: 3 2019-12-22 2:04:10 2 [Note] WSREP: IST receiver addr using tcp://127.0.0.1:16006 2019-12-22 2:04:10 2 [Note] WSREP: Prepared IST receiver for 0-2, listening at: tcp://127.0.0.1:16006 2019-12-22 2:04:10 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) requested state transfer from '*any*'. Selected 0.0 (cnt7glr11.localdomain)(SYNCED) as donor. 2019-12-22 2:04:10 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 2) 2019-12-22 2:04:10 2 [Note] WSREP: Requesting state transfer: success, donor: 0 2019-12-22 2:04:10 2 [Note] WSREP: Resetting GCache seqno map due to different histories. 2019-12-22 2:04:10 2 [Note] WSREP: GCache history reset: old(8ac49ac6-244e-11ea-9e57-de0321ede38c:32014 -> 9309a66e-244e-11ea-b021-ebbdaedd8413:2 mysqld: gcache/src/gcache_rb_store.cpp:462: void gcache::RingBuffer::seqno_reset(): Assertion `(reinterpret_cast(first_))->size > 0' failed. 191222 2:04:10 [ERROR] mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.4.12-MariaDB-debug-log key_buffer_size=0 read_buffer_size=131072 max_used_connections=0 max_threads=153 thread_count=2 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 62610 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7fa394000af0 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7fa3a647a950 thread_stack 0x49000 mysys/stacktrace.c:269(my_print_stacktrace)[0x55946a47afc4] sql/signal_handler.cc:209(handle_fatal_signal)[0x559469be6e15] sigaction.c:0(__restore_rt)[0x7fa3bd64c5d0] :0(__GI_raise)[0x7fa3bb93a207] :0(__GI_abort)[0x7fa3bb93b8f8] :0(__assert_fail_base)[0x7fa3bb933026] :0(__GI___assert_fail)[0x7fa3bb9330d2] src/gcache_rb_store.cpp:462(gcache::RingBuffer::seqno_reset())[0x7fa3b54be1e5] src/GCache_seqno.cpp:45(gcache::GCache::seqno_reset(gu::GTID const&))[0x7fa3b54b7264] src/replicator_str.cpp:824(galera::ReplicatorSMM::request_state_transfer(void*, wsrep_uuid const&, long, void const*, long))[0x7fa3b55d7735] src/replicator_smm.cpp:2759(galera::ReplicatorSMM::process_conf_change(void*, gcs_action const&))[0x7fa3b55c6fb8] src/gcs_action_source.cpp:154(galera::GcsActionSource::dispatch(void*, gcs_action const&, bool&))[0x7fa3b55a6f19] src/gcs_action_source.cpp:188(galera::GcsActionSource::process(void*, bool&))[0x7fa3b55a726d] src/replicator_smm.cpp:391(galera::ReplicatorSMM::async_recv(void*))[0x7fa3b55c6174] src/wsrep_provider_v26.cpp:731(wsrep::wsrep_provider_v26::run_applier(wsrep::high_priority_service*))[0x55946a5386fe] sql/wsrep_thd.cc:62(wsrep_replication_process(THD*, void*))[0x559469b07e77] sql/wsrep_mysqld.cc:2725(start_wsrep_THD(void*))[0x559469af84ee] perfschema/pfs.cc:1864(pfs_spawn_thread)[0x55946a40900b] pthread_create.c:0(start_thread)[0x7fa3bd644dd5] /lib64/libc.so.6(clone+0x6d)[0x7fa3bba01ead] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x0): Connection ID (thread ID): 2 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size unlimited unlimited bytes Max resident set unlimited unlimited bytes Max processes 4096 23005 processes Max open files 1024 1024 files Max locked memory 65536 65536 bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 23005 23005 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: |/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t e %P %I %h ----------SERVER LOG END------------- mysqltest failed but provided no output The result from queries just before the failure was: < snip > connection node_2; connection node_1; CREATE TABLE t1 (f1 INTEGER PRIMARY KEY) ENGINE=InnoDB; SET SESSION wsrep_trx_fragment_size = 1; SET AUTOCOMMIT=OFF; START TRANSACTION; INSERT INTO t1 VALUES (1); INSERT INTO t1 VALUES (2); INSERT INTO t1 VALUES (3); INSERT INTO t1 VALUES (4); INSERT INTO t1 VALUES (5); connection node_2; Killing server ... connection node_1; Killing server ... connection node_1; # restart connection node_2; # restart - found 'core.20901' (2/5) Trying 'dbx' to get a backtrace Trying 'gdb' to get a backtrace from coredump /home/stepan/mariadb/10.4/git/mysql-test/var/log/galera_sr.galera_sr_kill_all_pcrecovery-innodb/mysqld.2/data/core.20901 Core generated by '/home/stepan/mariadb/10.4/git/sql/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- [New LWP 20981] [New LWP 21061] [New LWP 20901] [New LWP 20929] [New LWP 20924] [New LWP 20979] [New LWP 20980] [New LWP 20982] [New LWP 20927] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `/home/stepan/mariadb/10.4/git/sql/mysqld --defaults-group-suffix=.2 --defaults-'. Program terminated with signal 6, Aborted. #0 0x00007fa3bd6499d1 in pthread_kill () from /lib64/libpthread.so.0 #0 0x00007fa3bd6499d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x000055946a47b0b2 in my_write_core (sig=6) at /home/stepan/mariadb/10.4/git/mysys/stacktrace.c:481 #2 0x0000559469be719c in handle_fatal_signal (sig=6) at /home/stepan/mariadb/10.4/git/sql/signal_handler.cc:343 #3 #4 0x00007fa3bb93a207 in raise () from /lib64/libc.so.6 #5 0x00007fa3bb93b8f8 in abort () from /lib64/libc.so.6 #6 0x00007fa3bb933026 in __assert_fail_base () from /lib64/libc.so.6 #7 0x00007fa3bb9330d2 in __assert_fail () from /lib64/libc.so.6 #8 0x00007fa3b54be1e5 in gcache::RingBuffer::seqno_reset (this=this@entry=0x55946d5572d8) at gcache/src/gcache_rb_store.cpp:462 #9 0x00007fa3b54b7264 in gcache::GCache::seqno_reset (this=this@entry=0x55946d557188, gtid=...) at gcache/src/GCache_seqno.cpp:44 #10 0x00007fa3b55d7735 in galera::ReplicatorSMM::request_state_transfer (this=this@entry=0x55946d556db0, recv_ctx=recv_ctx@entry=0x7fa3a647a480, group_uuid=..., cc_seqno=cc_seqno@entry=2, sst_req=0x7fa3940271e0, sst_req_len=32) at galera/src/replicator_str.cpp:821 #11 0x00007fa3b55c6fb8 in galera::ReplicatorSMM::process_conf_change (this=0x55946d556db0, recv_ctx=0x7fa3a647a480, cc=...) at galera/src/replicator_smm.cpp:2688 #12 0x00007fa3b55a6f19 in galera::GcsActionSource::dispatch (this=this@entry=0x55946d78f0c0, recv_ctx=recv_ctx@entry=0x7fa3a647a480, act=..., exit_loop=@0x7fa3a647a24e: false) at galera/src/gcs_action_source.cpp:124 #13 0x00007fa3b55a726d in galera::GcsActionSource::process (this=0x55946d78f0c0, recv_ctx=0x7fa3a647a480, exit_loop=@0x7fa3a647a24e: false) at galera/src/gcs_action_source.cpp:182 #14 0x00007fa3b55c6174 in galera::ReplicatorSMM::async_recv (this=0x55946d556db0, recv_ctx=0x7fa3a647a480) at galera/src/replicator_smm.cpp:391 #15 0x000055946a5386fe in wsrep::wsrep_provider_v26::run_applier (this=0x55946d4e1e00, applier_ctx=0x7fa3a647a480) at /home/stepan/mariadb/10.4/git/wsrep-lib/src/wsrep_provider_v26.cpp:731 #16 0x0000559469b07e77 in wsrep_replication_process (thd=0x7fa394000af0, arg=0x55946d79a1e0) at /home/stepan/mariadb/10.4/git/sql/wsrep_thd.cc:62 #17 0x0000559469af84ee in start_wsrep_THD (arg=0x55946d79a1e0) at /home/stepan/mariadb/10.4/git/sql/wsrep_mysqld.cc:2723 #18 0x000055946a40900b in pfs_spawn_thread (arg=0x55946d770e40) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #19 0x00007fa3bd644dd5 in start_thread () from /lib64/libpthread.so.0 #20 0x00007fa3bba01ead in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7fa3b514d700 (LWP 20927)): #0 0x00007fa3bd648965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fa3b55a3eb7 in gu::Lock::wait (cond=..., this=0x7fa3b514cbf0) at galerautils/src/gu_lock.hpp:45 #2 0x00007fa3b55a3f5b in galera::ServiceThd::thd_func (arg=0x55946d5574c8) at galera/src/galera_service_thd.cpp:30 #3 0x00007fa3bd644dd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007fa3bba01ead in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7fa3a6430700 (LWP 20982)): #0 0x00007fa3bb9f2f8d in read () from /lib64/libc.so.6 #1 0x00007fa3bb97fb14 in __GI__IO_file_underflow () from /lib64/libc.so.6 #2 0x00007fa3bb980ce2 in __GI__IO_default_uflow () from /lib64/libc.so.6 #3 0x00007fa3bb973ac4 in __GI__IO_getline_info () from /lib64/libc.so.6 #4 0x00007fa3bb9728c6 in fgets () from /lib64/libc.so.6 #5 0x0000559469afbfc4 in my_fgets (buf=0x7fa3a642f750 "ready 127.0.0.2:16007/rsync_sst", buf_len=512, stream=0x7fa388001070) at /home/stepan/mariadb/10.4/git/sql/wsrep_sst.cc:301 #6 0x0000559469afc760 in sst_joiner_thread (a=0x7fa3a64774f0) at /home/stepan/mariadb/10.4/git/sql/wsrep_sst.cc:446 #7 0x000055946a40900b in pfs_spawn_thread (arg=0x7fa394024a90) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #8 0x00007fa3bd644dd5 in start_thread () from /lib64/libpthread.so.0 #9 0x00007fa3bba01ead in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7fa3b404b700 (LWP 20980)): #0 0x00007fa3bd648965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055946a480725 in safe_cond_wait (cond=0x7fa398015ac8, mp=0x7fa398015a18, file=0x55946a5fed40 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:492 #2 0x0000559469b078a4 in inline_mysql_cond_wait (that=0x7fa398015ac8, mutex=0x7fa398015a18, src_file=0x55946a5fef50 "/home/stepan/mariadb/10.4/git/sql/wsrep_thd.h", src_line=69) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1178 #3 0x0000559469b0a776 in Wsrep_thd_queue::pop_front (this=0x7fa3980159c0) at /home/stepan/mariadb/10.4/git/sql/wsrep_thd.h:69 #4 0x0000559469b09194 in wsrep_rollback_process (rollbacker=0x7fa398001d40, arg=0x55946d7b48d0) at /home/stepan/mariadb/10.4/git/sql/wsrep_thd.cc:228 #5 0x0000559469af84ee in start_wsrep_THD (arg=0x55946d7b48d0) at /home/stepan/mariadb/10.4/git/sql/wsrep_mysqld.cc:2723 #6 0x000055946a40900b in pfs_spawn_thread (arg=0x55946d76edc0) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #7 0x00007fa3bd644dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fa3bba01ead in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7fa39ffff700 (LWP 20979)): #0 0x00007fa3bd648965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fa3b557e597 in gu::Lock::wait (cond=..., this=0x7fa39fffe850) at galerautils/src/gu_lock.hpp:45 #2 0x00007fa3b55810db in RecvBuf::front (this=this@entry=0x55946d793758, timeout=...) at gcs/src/gcs_gcomm.cpp:124 #3 0x00007fa3b557ec76 in gcomm_recv (backend=, msg=0x55946d756970, timeout=9223372035999999999) at gcs/src/gcs_gcomm.cpp:673 #4 0x00007fa3b5572c0c in core_msg_recv (backend=backend@entry=0x55946d756ad0, recv_msg=recv_msg@entry=0x55946d756970, timeout=timeout@entry=9223372035999999999) at gcs/src/gcs_core.cpp:480 #5 0x00007fa3b5575e84 in gcs_core_recv (conn=0x55946d756910, recv_act=recv_act@entry=0x7fa39fffed70, timeout=9223372035999999999) at gcs/src/gcs_core.cpp:1184 #6 0x00007fa3b557d108 in gcs_recv_thread (arg=0x55946d756690) at gcs/src/gcs.cpp:1398 #7 0x00007fa3bd644dd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007fa3bba01ead in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7fa3b60dd700 (LWP 20924)): #0 0x00007fa3bd648d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055946a480a27 in safe_cond_timedwait (cond=0x55946bad5ca0 , mp=0x55946bad5be0 , abstime=0x7fa3b60dcd70, file=0x55946a94e700 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:546 #2 0x000055946a481a6a in inline_mysql_cond_timedwait (that=0x55946bad5ca0 , mutex=0x55946bad5be0 , abstime=0x7fa3b60dcd70, src_file=0x55946a94e740 "/home/stepan/mariadb/10.4/git/mysys/thr_timer.c", src_line=292) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1204 #3 0x000055946a48262d in timer_handler (arg=0x0) at /home/stepan/mariadb/10.4/git/mysys/thr_timer.c:292 #4 0x000055946a40900b in pfs_spawn_thread (arg=0x55946d5230d0) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #5 0x00007fa3bd644dd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007fa3bba01ead in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7fa3a6c7c700 (LWP 20929)): #0 0x00007fa3bba02483 in epoll_wait () from /lib64/libc.so.6 #1 0x00007fa3b55445c8 in asio::detail::epoll_reactor::run (this=0x55946d793ef0, block=block@entry=true, ops=...) at asio/asio/detail/impl/epoll_reactor.ipp:391 #2 0x00007fa3b5548cc0 in asio::detail::task_io_service::do_run_one (this=this@entry=0x55946d793d90, lock=..., this_thread=..., ec=...) at asio/asio/detail/impl/task_io_service.ipp:355 #3 0x00007fa3b5548f72 in asio::detail::task_io_service::run (this=0x55946d793d90, ec=...) at asio/asio/detail/impl/task_io_service.ipp:148 #4 0x00007fa3b55609fd in asio::io_service::run (this=0x55946d792af0) at asio/asio/impl/io_service.ipp:58 #5 0x00007fa3b5561151 in gcomm::AsioProtonet::event_loop (this=0x55946d792a50, period=...) at gcomm/src/asio_protonet.cpp:116 #6 0x00007fa3b558001d in GCommConn::run (this=0x55946d793570) at gcs/src/gcs_gcomm.cpp:498 #7 0x00007fa3b55830c9 in GCommConn::run_fn (arg=) at gcs/src/gcs_gcomm.cpp:209 #8 0x00007fa3bd644dd5 in start_thread () from /lib64/libpthread.so.0 #9 0x00007fa3bba01ead in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7fa3bda54880 (LWP 20901)): #0 0x00007fa3bd648965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055946a480725 in safe_cond_wait (cond=0x55946b26e900 , mp=0x55946b26e840 , file=0x55946a56a9e8 "/home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/mariadb/10.4/git/mysys/thr_mutex.c:492 #2 0x000055946980691c in inline_mysql_cond_wait (that=0x55946b26e900 , mutex=0x55946b26e840 , src_file=0x55946a56ae50 "/home/stepan/mariadb/10.4/git/sql/wsrep_condition_variable.h", src_line=48) at /home/stepan/mariadb/10.4/git/include/mysql/psi/mysql_thread.h:1178 #3 0x000055946981d9a9 in Wsrep_condition_variable::wait (this=0x55946d523a20, lock=...) at /home/stepan/mariadb/10.4/git/sql/wsrep_condition_variable.h:48 #4 0x000055946a524bc3 in wsrep::server_state::wait_until_state (this=0x55946d5237c0, lock=..., state=wsrep::server_state::s_initializing) at /home/stepan/mariadb/10.4/git/wsrep-lib/src/server_state.cpp:1381 #5 0x0000559469af907f in wsrep::server_state::wait_until_state (this=0x55946d5237c0, state=wsrep::server_state::s_initializing) at /home/stepan/mariadb/10.4/git/wsrep-lib/include/wsrep/server_state.hpp:364 #6 0x0000559469aefad0 in wsrep_init_startup (sst_first=true) at /home/stepan/mariadb/10.4/git/sql/wsrep_mysqld.cc:838 #7 0x0000559469745fb3 in init_server_components () at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:5136 #8 0x00005594697474a4 in mysqld_main (argc=164, argv=0x55946d3f2380) at /home/stepan/mariadb/10.4/git/sql/mysqld.cc:5722 #9 0x000055946973b615 in main (argc=24, argv=0x7ffd25099738) at /home/stepan/mariadb/10.4/git/sql/main.cc:25 Thread 2 (Thread 0x7fa3a5c2f700 (LWP 21061)): #0 0x00007fa3bd648965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007fa3b55a9cf7 in gu::Lock::wait (cond=..., this=0x7fa3a5c2ec10) at galerautils/src/gu_lock.hpp:45 #2 0x00007fa3b55acc3b in galera::ist::Receiver::run (this=0x55946d557630) at galera/src/ist.cpp:422 #3 0x00007fa3b55adb39 in run_receiver_thread (arg=) at galera/src/ist.cpp:156 #4 0x00007fa3bd644dd5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007fa3bba01ead in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7fa3a647b700 (LWP 20981)): #0 0x00007fa3bd6499d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x000055946a47b0b2 in my_write_core (sig=6) at /home/stepan/mariadb/10.4/git/mysys/stacktrace.c:481 #2 0x0000559469be719c in handle_fatal_signal (sig=6) at /home/stepan/mariadb/10.4/git/sql/signal_handler.cc:343 #3 #4 0x00007fa3bb93a207 in raise () from /lib64/libc.so.6 #5 0x00007fa3bb93b8f8 in abort () from /lib64/libc.so.6 #6 0x00007fa3bb933026 in __assert_fail_base () from /lib64/libc.so.6 #7 0x00007fa3bb9330d2 in __assert_fail () from /lib64/libc.so.6 #8 0x00007fa3b54be1e5 in gcache::RingBuffer::seqno_reset (this=this@entry=0x55946d5572d8) at gcache/src/gcache_rb_store.cpp:462 #9 0x00007fa3b54b7264 in gcache::GCache::seqno_reset (this=this@entry=0x55946d557188, gtid=...) at gcache/src/GCache_seqno.cpp:44 #10 0x00007fa3b55d7735 in galera::ReplicatorSMM::request_state_transfer (this=this@entry=0x55946d556db0, recv_ctx=recv_ctx@entry=0x7fa3a647a480, group_uuid=..., cc_seqno=cc_seqno@entry=2, sst_req=0x7fa3940271e0, sst_req_len=32) at galera/src/replicator_str.cpp:821 #11 0x00007fa3b55c6fb8 in galera::ReplicatorSMM::process_conf_change (this=0x55946d556db0, recv_ctx=0x7fa3a647a480, cc=...) at galera/src/replicator_smm.cpp:2688 #12 0x00007fa3b55a6f19 in galera::GcsActionSource::dispatch (this=this@entry=0x55946d78f0c0, recv_ctx=recv_ctx@entry=0x7fa3a647a480, act=..., exit_loop=@0x7fa3a647a24e: false) at galera/src/gcs_action_source.cpp:124 #13 0x00007fa3b55a726d in galera::GcsActionSource::process (this=0x55946d78f0c0, recv_ctx=0x7fa3a647a480, exit_loop=@0x7fa3a647a24e: false) at galera/src/gcs_action_source.cpp:182 #14 0x00007fa3b55c6174 in galera::ReplicatorSMM::async_recv (this=0x55946d556db0, recv_ctx=0x7fa3a647a480) at galera/src/replicator_smm.cpp:391 #15 0x000055946a5386fe in wsrep::wsrep_provider_v26::run_applier (this=0x55946d4e1e00, applier_ctx=0x7fa3a647a480) at /home/stepan/mariadb/10.4/git/wsrep-lib/src/wsrep_provider_v26.cpp:731 #16 0x0000559469b07e77 in wsrep_replication_process (thd=0x7fa394000af0, arg=0x55946d79a1e0) at /home/stepan/mariadb/10.4/git/sql/wsrep_thd.cc:62 #17 0x0000559469af84ee in start_wsrep_THD (arg=0x55946d79a1e0) at /home/stepan/mariadb/10.4/git/sql/wsrep_mysqld.cc:2723 #18 0x000055946a40900b in pfs_spawn_thread (arg=0x55946d770e40) at /home/stepan/mariadb/10.4/git/storage/perfschema/pfs.cc:1862 #19 0x00007fa3bd644dd5 in start_thread () from /lib64/libpthread.so.0 #20 0x00007fa3bba01ead in clone () from /lib64/libc.so.6 Compressed file /home/stepan/mariadb/10.4/git/mysql-test/var/log/galera_sr.galera_sr_kill_all_pcrecovery-innodb/mysqld.2/data/core.20901 - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera_sr.galera_sr_kill_all_pcrecovery-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera_sr.galera_sr_kill_all_pcrecovery-innodb/' ***Warnings generated in error logs during shutdown after running tests: galera_sr.galera_sr_kill_all_pcrecovery mysqld: gcache/src/gcache_rb_store.cpp:462: void gcache::RingBuffer::seqno_reset(): Assertion `(reinterpret_cast(first_))->size > 0' failed. Attempting backtrace. You can use the following information to find out WSREP_SST: [ERROR] Parent mysqld process (PID:20901) terminated unexpectedly. (20191222 02:04:11.521) 191222 2:04:28 +16.972 galera_sr.galera_sr_load_data_splitting 'innodb' [ pass ] 11249 191222 2:05:34 +66.016 galera_sr.galera_sr_many_fragments 'innodb' [ pass ] 65501 191222 2:08:18 +164.346 galera_sr.mysql-wsrep-features#8 'innodb' [ pass ] 163703 191222 2:08:38 +19.664 galera_sr.mysql-wsrep-features#9 'innodb' [ pass ] 19403 191222 2:08:43 +4.477 galera_sr.GCF-1008 'innodb' [ pass ] 4184 191222 2:08:45 +2.467 galera_sr.GCF-1018 'innodb' [ pass ] 2207 191222 2:09:28 +43.335 galera_sr.GCF-1043B 'innodb' [ pass ] 42916 191222 2:09:31 +2.337 galera_sr.GCF-1051 'innodb' [ pass ] 2094 191222 2:09:40 +9.264 galera_sr.GCF-1060 'innodb' [ pass ] 8982 191222 2:09:42 +2.409 galera_sr.GCF-561 'innodb' [ pass ] 2158 191222 2:09:45 +2.399 galera_sr.GCF-571 'innodb' [ pass ] 2133 191222 2:09:47 +2.337 galera_sr.GCF-572 'innodb' [ pass ] 2097 191222 2:09:50 +2.400 galera_sr.GCF-580 'innodb' [ pass ] 2130 191222 2:09:56 +6.418 galera_sr.GCF-585 'innodb' [ pass ] 6137 191222 2:09:58 +2.404 galera_sr.GCF-597 'innodb' [ pass ] 2111 191222 2:10:01 +2.332 galera_sr.GCF-620 'innodb' [ pass ] 2074 191222 2:10:03 +2.405 galera_sr.GCF-623 'innodb' [ pass ] 2125 191222 2:10:06 +2.395 galera_sr.GCF-627 'innodb' [ pass ] 2133 191222 2:10:10 +4.423 galera_sr.GCF-845 'innodb' [ pass ] 4142 191222 2:10:12 +2.331 galera_sr.GCF-851 'innodb' [ pass ] 2073 191222 2:10:15 +2.913 galera_sr.GCF-867 'innodb' [ pass ] 2656 191222 2:10:18 +2.333 galera_sr.GCF-889 'innodb' [ pass ] 2083 191222 2:10:20 +2.418 galera_sr.GCF-900 'innodb' [ pass ] 2122 191222 2:10:23 +3.057 galera_sr.galera_sr_bf_abort 'innodb' [ pass ] 2792 191222 2:10:25 +2.331 galera_sr.galera_sr_blob 'innodb' [ pass ] 2090 191222 2:10:32 +6.419 galera_sr.galera_sr_cc_master 'innodb' [ pass ] 6185 191222 2:10:47 +15.621 galera_sr.galera_sr_cc_no_primary 'innodb' [ pass ] 15258 191222 2:10:52 +4.655 galera_sr.galera_sr_cc_slave 'innodb' [ pass ] 4414 191222 2:10:54 +2.399 galera_sr.galera_sr_concurrent 'innodb' [ pass ] 2174 191222 2:10:57 +2.418 galera_sr.galera_sr_conflict 'innodb' [ pass ] 2110 191222 2:10:59 +2.417 galera_sr.galera_sr_conflict_on_commit 'innodb' [ pass ] 2119 191222 2:11:03 +3.353 galera_sr.galera_sr_conflict_on_commit2 'innodb' [ pass ] 3116 191222 2:11:05 +2.348 galera_sr.galera_sr_conflict_with_rollback_master 'innodb' [ pass ] 2106 191222 2:11:07 +2.336 galera_sr.galera_sr_create_drop 'innodb' [ pass ] 2095 191222 2:11:10 +2.400 galera_sr.galera_sr_ddl_master 'innodb' [ pass ] 2163 191222 2:11:12 +2.413 galera_sr.galera_sr_ddl_schema 'innodb' [ pass ] 2123 191222 2:11:15 +2.468 galera_sr.galera_sr_ddl_slave 'innodb' [ pass ] 2179 191222 2:11:17 +2.470 galera_sr.galera_sr_ddl_unrelated 'innodb' [ pass ] 2202 191222 2:11:20 +2.446 galera_sr.galera_sr_dupkey_error 'innodb' [ pass ] 2151 191222 2:11:26 +6.644 galera_sr.galera_sr_fk_conflict 'innodb' [ pass ] 6323 191222 2:12:27 +60.390 galera_sr.galera_sr_insert_select 'innodb' [ pass ] 59127 191222 2:12:29 +2.429 galera_sr.galera_sr_kill_connection 'innodb' [ pass ] 2118 191222 2:12:32 +2.837 galera_sr.galera_sr_kill_query 'innodb' [ pass ] 2592 191222 2:12:37 +5.076 galera_sr.galera_sr_load_data 'innodb' [ pass ] 4775 191222 2:12:39 +2.335 galera_sr.galera_sr_myisam 'innodb' [ pass ] 2057 191222 2:12:42 +2.416 galera_sr.galera_sr_parallel_apply 'innodb' [ pass ] 2133 191222 2:12:44 +2.463 galera_sr.galera_sr_rollback 'innodb' [ pass ] 2211 191222 2:12:47 +2.436 galera_sr.galera_sr_rollback_retry 'innodb' [ pass ] 2139 191222 2:12:49 +2.461 galera_sr.galera_sr_rollback_savepoint 'innodb' [ pass ] 2186 191222 2:12:51 +2.468 galera_sr.galera_sr_rollback_statement 'innodb' [ pass ] 2202 191222 2:13:01 +9.667 galera_sr.galera_sr_shutdown_master 'innodb' [ pass ] 9387 191222 2:13:11 +9.687 galera_sr.galera_sr_shutdown_slave 'innodb' [ pass ] 9416 191222 2:13:13 +2.482 galera_sr.galera_sr_transaction_replay 'innodb' [ pass ] 2187 191222 2:13:16 +2.333 galera_sr.galera_sr_unit_statements 'innodb' [ pass ] 2087 191222 2:13:18 +2.747 galera_sr.galera_sr_ws_size 'innodb' [ pass ] 2453 191222 2:13:23 +4.392 galera_sr.galera_sr_ws_size2 'innodb' [ pass ] 4151 191222 2:13:25 +2.338 galera_sr.galera_var_ignore_apply_errors_sr 'innodb' [ pass ] 2091 191222 2:13:28 +2.705 galera_sr.mysql-wsrep#215 'innodb' [ pass ] 2445 191222 2:13:30 +2.399 galera_sr.mysql-wsrep-features#138 'innodb' [ pass ] 2115 191222 2:13:33 +2.365 galera_sr.mysql-wsrep-features#14 'innodb' [ pass ] 2077 191222 2:13:35 +2.465 galera_sr.mysql-wsrep-features#148 'innodb' [ pass ] 2238 191222 2:13:37 +2.333 galera_sr.mysql-wsrep-features#15 'innodb' [ pass ] 2077 191222 2:13:41 +3.967 galera_sr.mysql-wsrep-features#165 'innodb' [ pass ] 3628 191222 2:13:44 +2.397 galera_sr.mysql-wsrep-features#22 'innodb' [ pass ] 2138 191222 2:13:48 +4.387 galera_sr.mysql-wsrep-features#27 'innodb' [ pass ] 4112 191222 2:13:51 +2.400 galera_sr.mysql-wsrep-features#35 'innodb' [ pass ] 2131 191222 2:13:53 +2.349 galera_sr.mysql-wsrep-features#93 'innodb' [ pass ] 2097 191222 2:13:55 +2.398 galera_sr.mysql-wsrep-features#96 'innodb' [ pass ] 2147 191222 2:14:13 +17.833 galera_sr.MDEV-18585 'innodb' [ pass ] 2111 191222 2:14:42 +28.581 galera_sr.galera_sr_kill_all_norecovery 'innodb' [ pass ] 13045 191222 2:15:17 +35.697 galera_sr.galera_sr_kill_slave 'innodb' [ pass ] 21245 191222 2:15:49 +31.468 galera_sr.galera_sr_mysqldump_sst 'innodb' [ fail ] Test ended at 2019-12-22 02:15:49 CURRENT_TEST: galera_sr.galera_sr_mysqldump_sst Server [mysqld.2 - pid: 27665, winpid: 27665, exit: 256] failed during test run Server log from this test: ----------SERVER LOG START----------- 2019-12-22 2:15:28 0 [Warning] WSREP: option --wsrep-causal-reads is deprecated 2019-12-22 2:15:28 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld (mysqld 10.4.12-MariaDB-debug-log) starting as process 26696 ... 2019-12-22 2:15:28 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4186) 2019-12-22 2:15:28 0 [Warning] Changed limits: max_open_files: 1024 max_connections: 151 (was 151) table_cache: 421 (was 2000) 2019-12-22 2:15:28 0 [Note] WSREP: Loading provider /usr/lib/libgalera_smm_4.so initial position: 00000000-0000-0000-0000-000000000000:-1 wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_smm_4.so' wsrep loader: [INFO] wsrep_load(): Galera 26.4.3(r4548) by Codership Oy loaded successfully. 2019-12-22 2:15:28 0 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-12-22 2:15:28 0 [Warning] WSREP: Could not open state file for reading: '/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//grastate.dat' 2019-12-22 2:15:28 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1 2019-12-22 2:15:28 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 0 UUID: 00000000-0000-0000-0000-000000000000 Seqno: -1 - -1 Offset: -1 Synced: 0 2019-12-22 2:15:28 0 [Note] WSREP: Skipped GCache ring buffer recovery: could not determine history UUID. 2019-12-22 2:15:28 0 [Note] WSREP: Passing config to GCS: base_dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; base_host = 127.0.0.1; base_port = 16005; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 1; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 2019-12-22 2:15:28 0 [Note] WSREP: Start replication 2019-12-22 2:15:28 0 [Note] WSREP: Connecting with bootstrap option: 0 2019-12-22 2:15:28 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1 2019-12-22 2:15:28 0 [Note] WSREP: protonet asio version 0 2019-12-22 2:15:28 0 [Note] WSREP: Using CRC-32C for message checksums. 2019-12-22 2:15:28 0 [Note] WSREP: backend: asio 2019-12-22 2:15:28 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-12-22 2:15:28 0 [Warning] WSREP: access file(/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//gvwstate.dat) failed(No such file or directory) 2019-12-22 2:15:28 0 [Note] WSREP: restore pc from disk failed 2019-12-22 2:15:28 0 [Note] WSREP: GMCast version 0 2019-12-22 2:15:28 0 [Note] WSREP: (28bb5429, 'tcp://0.0.0.0:16005') listening at tcp://0.0.0.0:16005 2019-12-22 2:15:28 0 [Note] WSREP: (28bb5429, 'tcp://0.0.0.0:16005') multicast: , ttl: 1 2019-12-22 2:15:28 0 [Note] WSREP: EVS version 1 2019-12-22 2:15:28 0 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '127.0.0.1:16002' 2019-12-22 2:15:28 0 [Note] WSREP: (28bb5429, 'tcp://0.0.0.0:16005') connection established to 2866fca0 tcp://127.0.0.1:16002 2019-12-22 2:15:28 0 [Note] WSREP: (28bb5429, 'tcp://0.0.0.0:16005') turning message relay requesting on, nonlive peers: 2019-12-22 2:15:29 0 [Note] WSREP: EVS version upgrade 0 -> 1 2019-12-22 2:15:29 0 [Note] WSREP: declaring 2866fca0 at tcp://127.0.0.1:16002 stable 2019-12-22 2:15:29 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2019-12-22 2:15:29 0 [Note] WSREP: Node 2866fca0 state prim 2019-12-22 2:15:29 0 [Note] WSREP: view(view_id(PRIM,2866fca0,2) memb { 2866fca0,0 28bb5429,0 } joined { } left { } partitioned { }) 2019-12-22 2:15:29 0 [Note] WSREP: save pc into disk 2019-12-22 2:15:29 0 [Note] WSREP: gcomm: connected 2019-12-22 2:15:29 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-12-22 2:15:29 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-12-22 2:15:29 0 [Note] WSREP: Opened channel 'my_wsrep_cluster' 2019-12-22 2:15:29 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2019-12-22 2:15:29 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2019-12-22 2:15:29 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 2909340b-2450-11ea-8df8-2f0ad38d8db5 2019-12-22 2:15:29 0 [Note] WSREP: STATE EXCHANGE: got state msg: 2909340b-2450-11ea-8df8-2f0ad38d8db5 from 0 (cnt7glr11.localdomain) 2019-12-22 2:15:29 1 [Note] WSREP: Starting rollbacker thread 1 2019-12-22 2:15:29 0 [Note] WSREP: STATE EXCHANGE: got state msg: 2909340b-2450-11ea-8df8-2f0ad38d8db5 from 1 (cnt7glr11.localdomain) 2019-12-22 2:15:29 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 1, members = 1/2 (joined/total), act_id = 1, last_appl. = 0, protocols = 2/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 2868deec-2450-11ea-bfbf-4ba24e57d047 2019-12-22 2:15:29 2 [Note] WSREP: Starting applier thread 2 2019-12-22 2:15:29 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000000 of size 134217728 bytes 2019-12-22 2:15:29 0 [Note] WSREP: Flow-control interval: [23, 23] 2019-12-22 2:15:29 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 2) 2019-12-22 2:15:29 2 [Note] WSREP: ####### processing CC 2, local, ordered 2019-12-22 2:15:29 2 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 2:15:29 2 [Note] WSREP: ####### My UUID: 28bb5429-2450-11ea-a27b-5767f9a4ef14 2019-12-22 2:15:29 2 [Note] WSREP: Server cnt7glr11.localdomain connected to cluster at position 2868deec-2450-11ea-bfbf-4ba24e57d047:2 with ID 28bb5429-2450-11ea-a27b-5767f9a4ef14 2019-12-22 2:15:29 2 [Note] WSREP: Server status change disconnected -> connected 2019-12-22 2:15:29 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:29 2 [Note] WSREP: State transfer required: Group state: 2868deec-2450-11ea-bfbf-4ba24e57d047:2 Local state: 00000000-0000-0000-0000-000000000000:-1 2019-12-22 2:15:29 2 [Note] WSREP: Server status change connected -> joiner 2019-12-22 2:15:29 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:29 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '127.0.0.2:16007' --datadir '/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.2' --parent '26696' --binlog-index 'mysqld-bin.index' --mysqld-args --defaults-group-suffix=.2 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' 2019-12-22 2:15:29 2 [Note] WSREP: Prepared SST request: rsync|127.0.0.2:16007/rsync_sst 2019-12-22 2:15:29 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes 2019-12-22 2:15:29 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 2:15:29 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: 5 2019-12-22 2:15:29 2 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 2, STRv: 3 2019-12-22 2:15:29 2 [Note] WSREP: IST receiver addr using tcp://127.0.0.1:16006 2019-12-22 2:15:29 2 [Note] WSREP: Prepared IST receiver for 0-2, listening at: tcp://127.0.0.1:16006 2019-12-22 2:15:29 0 [Note] WSREP: Deleted page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000000 2019-12-22 2:15:29 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000001 of size 134217728 bytes 2019-12-22 2:15:29 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) requested state transfer from '*any*'. Selected 0.0 (cnt7glr11.localdomain)(SYNCED) as donor. 2019-12-22 2:15:29 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 2) 2019-12-22 2:15:29 2 [Note] WSREP: Requesting state transfer: success, donor: 0 2019-12-22 2:15:29 2 [Note] WSREP: Resetting GCache seqno map due to different histories. 2019-12-22 2:15:29 2 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0 -> 2868deec-2450-11ea-bfbf-4ba24e57d047:2 2019-12-22 2:15:29 0 [Note] WSREP: Deleted page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000001 2019-12-22 2:15:31 0 [Note] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) complete. 2019-12-22 2:15:31 0 [Note] WSREP: Member 0.0 (cnt7glr11.localdomain) synced with group. 2019-12-22 2:15:31 0 [Note] WSREP: (28bb5429, 'tcp://0.0.0.0:16005') turning message relay requesting off WSREP_SST: [INFO] Joiner cleanup. rsync PID: 26806 (20191222 02:15:31.930) WSREP_SST: [INFO] Joiner cleanup done. (20191222 02:15:32.437) 2019-12-22 2:15:32 3 [Note] WSREP: SST received 2019-12-22 2:15:32 3 [Note] WSREP: Server status change joiner -> initializing 2019-12-22 2:15:32 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:32 0 [Note] Plugin 'partition' is disabled. 2019-12-22 2:15:32 0 [Note] Plugin 'SEQUENCE' is disabled. 2019-12-22 2:15:32 0 [Note] InnoDB: Using Linux native AIO 2019-12-22 2:15:32 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!! 2019-12-22 2:15:32 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-12-22 2:15:32 0 [Note] InnoDB: Uses event mutexes 2019-12-22 2:15:32 0 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-12-22 2:15:32 0 [Note] InnoDB: Number of pools: 1 2019-12-22 2:15:32 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-12-22 2:15:32 0 [Note] mysqld: O_TMPFILE is not supported on /home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2 (disabling future attempts) 2019-12-22 2:15:32 0 [Note] InnoDB: Initializing buffer pool, total size = 8M, instances = 1, chunk size = 8M 2019-12-22 2:15:32 0 [Note] InnoDB: Completed initialization of buffer pool 2019-12-22 2:15:32 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-12-22 2:15:32 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=68855 2019-12-22 2:15:32 0 [Note] InnoDB: Starting final batch to recover 18 pages from redo log. 2019-12-22 2:15:33 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-12-22 2:15:33 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-12-22 2:15:33 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-12-22 2:15:33 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2019-12-22 2:15:33 0 [Note] InnoDB: Waiting for purge to start 2019-12-22 2:15:33 0 [Note] InnoDB: 10.4.12 started; log sequence number 78230; transaction id 46 2019-12-22 2:15:33 0 [Note] InnoDB: Loading buffer pool(s) from /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/ib_buffer_pool 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_MUTEXES' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_CMP' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'FEEDBACK' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'user_variables' is disabled. 2019-12-22 2:15:33 0 [Note] InnoDB: Buffer pool(s) load completed at 191222 2:15:33 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled. 2019-12-22 2:15:33 0 [Note] Plugin 'unix_socket' is disabled. 2019-12-22 2:15:33 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-pam-debug' 2019-12-22 2:15:33 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-aria' 2019-12-22 2:15:33 0 [Note] Server socket created on IP: '127.0.0.1'. 2019-12-22 2:15:33 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2019-12-22 2:15:33 0 [Note] WSREP: Server initialized 2019-12-22 2:15:33 0 [Note] WSREP: Server status change initializing -> initialized 2019-12-22 2:15:33 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:33 3 [Note] WSREP: Server status change initialized -> joined 2019-12-22 2:15:33 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:33 0 [Note] Reading of all Master_info entries succeeded 2019-12-22 2:15:33 0 [Note] Added new Master_info '' to hash table 2019-12-22 2:15:33 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld: ready for connections. Version: '10.4.12-MariaDB-debug-log' socket: '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2.sock' port: 16001 Source distribution 2019-12-22 2:15:33 3 [Note] WSREP: Recovered position from storage: 2868deec-2450-11ea-bfbf-4ba24e57d047:2 2019-12-22 2:15:33 3 [Note] WSREP: Recovered view from SST: id: 2868deec-2450-11ea-bfbf-4ba24e57d047:2 status: primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: no own_index: 1 members(2): 0: 2866fca0-2450-11ea-9730-2fe1624c9ba3, cnt7glr11.localdomain 1: 28bb5429-2450-11ea-a27b-5767f9a4ef14, cnt7glr11.localdomain 2019-12-22 2:15:33 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:33 13 [Note] WSREP: Recovered cluster id 2868deec-2450-11ea-bfbf-4ba24e57d047 2019-12-22 2:15:33 3 [Note] WSREP: SST received: 2868deec-2450-11ea-bfbf-4ba24e57d047:2 2019-12-22 2:15:33 2 [Note] WSREP: Installed new state from SST: 2868deec-2450-11ea-bfbf-4ba24e57d047:2 2019-12-22 2:15:33 2 [Note] WSREP: Cert. index preload up to 2 2019-12-22 2:15:33 0 [Note] WSREP: ####### IST applying starts with 3 2019-12-22 2:15:33 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000002 of size 134217728 bytes 2019-12-22 2:15:33 0 [Note] WSREP: ####### IST current seqno initialized to 2 2019-12-22 2:15:33 0 [Note] WSREP: Receiving IST... 0.0% (0/1 events) complete. 2019-12-22 2:15:33 0 [Note] WSREP: IST preload starting at 2 2019-12-22 2:15:33 0 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 2:15:33 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 2:15:33 0 [Note] WSREP: ####### Assign initial position for certification: 2868deec-2450-11ea-bfbf-4ba24e57d047:1, protocol version: 5 2019-12-22 2:15:33 0 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 2:15:33 0 [Note] WSREP: ####### Adjusting cert position: 1 -> 2 2019-12-22 2:15:33 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 2:15:33 0 [Note] WSREP: Lowest cert indnex boundary for CC from preload: 2 2019-12-22 2:15:33 0 [Note] WSREP: Min available from gcache for CC from preload: 2 2019-12-22 2:15:33 0 [Note] WSREP: Receiving IST...100.0% (1/1 events) complete. 2019-12-22 2:15:33 2 [Note] WSREP: IST received: 2868deec-2450-11ea-bfbf-4ba24e57d047:2 2019-12-22 2:15:33 2 [Note] WSREP: Lowest cert indnex boundary for CC from group: 2 2019-12-22 2:15:33 2 [Note] WSREP: Min available from gcache for CC from group: 2 2019-12-22 2:15:33 0 [Note] WSREP: 1.0 (cnt7glr11.localdomain): State transfer from 0.0 (cnt7glr11.localdomain) complete. 2019-12-22 2:15:33 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 2) 2019-12-22 2:15:33 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) synced with group. 2019-12-22 2:15:33 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2) 2019-12-22 2:15:33 2 [Note] WSREP: Server cnt7glr11.localdomain synced with group 2019-12-22 2:15:33 2 [Note] WSREP: Server status change joined -> synced 2019-12-22 2:15:33 2 [Note] WSREP: Synchronized with group, ready for connections 2019-12-22 2:15:33 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:40 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld (initiated by: root[root] @ localhost [127.0.0.1]): Normal shutdown 2019-12-22 2:15:40 0 [Note] WSREP: Shutdown replication 2019-12-22 2:15:40 0 [Note] WSREP: Server status change synced -> disconnecting 2019-12-22 2:15:40 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:40 0 [Note] WSREP: Closing send monitor... 2019-12-22 2:15:40 0 [Note] WSREP: Closed send monitor. 2019-12-22 2:15:40 0 [Note] WSREP: gcomm: terminating thread 2019-12-22 2:15:40 0 [Note] WSREP: gcomm: joining thread 2019-12-22 2:15:40 0 [Note] WSREP: gcomm: closing backend 2019-12-22 2:15:41 0 [Note] WSREP: view(view_id(NON_PRIM,2866fca0,2) memb { 28bb5429,0 } joined { } left { } partitioned { 2866fca0,0 }) 2019-12-22 2:15:41 0 [Note] WSREP: PC protocol downgrade 1 -> 0 2019-12-22 2:15:41 0 [Note] WSREP: view((empty)) 2019-12-22 2:15:41 0 [Note] WSREP: gcomm: closed 2019-12-22 2:15:41 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 2019-12-22 2:15:41 0 [Note] WSREP: Flow-control interval: [16, 16] 2019-12-22 2:15:41 0 [Note] WSREP: Received NON-PRIMARY. 2019-12-22 2:15:41 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 757) 2019-12-22 2:15:41 0 [Note] WSREP: New SELF-LEAVE. 2019-12-22 2:15:41 0 [Note] WSREP: Flow-control interval: [0, 0] 2019-12-22 2:15:41 0 [Note] WSREP: Received SELF-LEAVE. Closing connection. 2019-12-22 2:15:41 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: -1) 2019-12-22 2:15:41 0 [Note] WSREP: RECV thread exiting 0: Success 2019-12-22 2:15:41 2 [Note] WSREP: ####### processing CC -1, local, ordered 2019-12-22 2:15:41 2 [Note] WSREP: ####### My UUID: 28bb5429-2450-11ea-a27b-5767f9a4ef14 2019-12-22 2:15:41 2 [Note] WSREP: ####### ST not required 2019-12-22 2:15:41 0 [Note] WSREP: recv_thread() joined. 2019-12-22 2:15:41 0 [Note] WSREP: Closing replication queue. 2019-12-22 2:15:41 0 [Note] WSREP: Closing slave action queue. 2019-12-22 2:15:41 2 [Note] WSREP: ================================================ View: id: 2868deec-2450-11ea-bfbf-4ba24e57d047:-1 status: non-primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: no own_index: 0 members(1): 0: 28bb5429-2450-11ea-a27b-5767f9a4ef14, cnt7glr11.localdomain ================================================= 2019-12-22 2:15:41 2 [Note] WSREP: Non-primary view 2019-12-22 2:15:41 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:41 2 [Note] WSREP: ####### processing CC -1, local, ordered 2019-12-22 2:15:41 2 [Note] WSREP: ####### My UUID: 28bb5429-2450-11ea-a27b-5767f9a4ef14 2019-12-22 2:15:41 2 [Note] WSREP: ####### ST not required 2019-12-22 2:15:41 2 [Note] WSREP: ================================================ View: id: 2868deec-2450-11ea-bfbf-4ba24e57d047:-1 status: non-primary protocol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: yes own_index: -1 members(0): ================================================= 2019-12-22 2:15:41 2 [Note] WSREP: Non-primary view 2019-12-22 2:15:41 2 [Note] WSREP: Server status change disconnecting -> disconnected 2019-12-22 2:15:41 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:41 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:41 2 [Note] WSREP: Applier thread exiting ret: 0 thd: 2 2019-12-22 2:15:41 2 [Warning] Aborted connection 2 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) 2019-12-22 2:15:41 1 [Note] WSREP: rollbacker thread exiting 1 2019-12-22 2:15:41 1 [Warning] Aborted connection 1 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) 2019-12-22 2:15:41 0 [Note] InnoDB: FTS optimize thread exiting. 2019-12-22 2:15:41 0 [Note] Event Scheduler: Purging the queue. 0 events 2019-12-22 2:15:41 0 [Note] WSREP: dtor state: CLOSED 2019-12-22 2:15:41 0 [Note] WSREP: MemPool(TrxHandleSlave): hit ratio: 0.81457, misses: 140, in use: 116, in pool: 24 2019-12-22 2:15:41 0 [Note] WSREP: mon: entered 755 oooe fraction 0 oool fraction 0 2019-12-22 2:15:41 0 [Note] WSREP: mon: entered 755 oooe fraction 0 oool fraction 0 2019-12-22 2:15:41 0 [Note] WSREP: mon: entered 765 oooe fraction 0 oool fraction 0.00130719 2019-12-22 2:15:41 0 [Note] WSREP: cert index usage at exit 234 2019-12-22 2:15:41 0 [Note] WSREP: cert trx map usage at exit 116 2019-12-22 2:15:41 0 [Note] WSREP: deps set usage at exit 0 2019-12-22 2:15:41 0 [Note] WSREP: avg deps dist 1 2019-12-22 2:15:41 0 [Note] WSREP: avg cert interval 0 2019-12-22 2:15:41 0 [Note] WSREP: cert index size 234 2019-12-22 2:15:41 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 2:15:41 0 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0 2019-12-22 2:15:41 0 [Note] WSREP: MemPool(LocalTrxHandle): hit ratio: 0, misses: 0, in use: 0, in pool: 0 2019-12-22 2:15:41 0 [Note] WSREP: trx map: conn query map: 2019-12-22 2:15:41 0 [Note] WSREP: Shifting CLOSED -> DESTROYED (TO: -1) 2019-12-22 2:15:41 0 [Note] WSREP: Deleted page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000002 2019-12-22 2:15:41 0 [Note] WSREP: Flushing memory map to disk... 2019-12-22 2:15:41 0 [Note] InnoDB: Starting shutdown... 2019-12-22 2:15:41 0 [Note] InnoDB: Dumping buffer pool(s) to /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/ib_buffer_pool 2019-12-22 2:15:41 0 [Note] InnoDB: Instance 0, restricted to 123 pages due to innodb_buf_pool_dump_pct=25 2019-12-22 2:15:41 0 [Note] InnoDB: Buffer pool(s) dump completed at 191222 2:15:41 2019-12-22 2:15:42 0 [Note] InnoDB: Shutdown completed; log sequence number 2610965; transaction id 1555 2019-12-22 2:15:42 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2019-12-22 2:15:42 0 [Note] Debug sync points hit: 51484 2019-12-22 2:15:42 0 [Note] Debug sync points executed: 0 2019-12-22 2:15:42 0 [Note] Debug sync points max active per thread: 0 2019-12-22 2:15:42 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld: Shutdown complete 2019-12-22 2:15:43 0 [Warning] WSREP: option --wsrep-causal-reads is deprecated 2019-12-22 2:15:43 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld (mysqld 10.4.12-MariaDB-debug-log) starting as process 27666 ... 2019-12-22 2:15:43 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4186) 2019-12-22 2:15:43 0 [Warning] Changed limits: max_open_files: 1024 max_connections: 151 (was 151) table_cache: 421 (was 2000) 2019-12-22 2:15:43 0 [Warning] WSREP: wsrep_sst_method is set to 'mysqldump' yet mysqld bind_address is set to '127.0.0.1', which makes it impossible to receive state transfer from another node, since mysqld won't accept such connections. If you wish to use mysqldump state transfer method, set bind_address to allow mysql client connections from other cluster members (e.g. 0.0.0.0). 2019-12-22 2:15:43 0 [Warning] WSREP: wsrep_sst_receive_address is set to '127.0.0.1:16001' which makes it impossible for another host to reach this one. Please set it to the address which this node can be connected at by other cluster members. 2019-12-22 2:15:43 0 [Note] Plugin 'partition' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'SEQUENCE' is disabled. 2019-12-22 2:15:43 0 [Note] InnoDB: Using Linux native AIO 2019-12-22 2:15:43 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!! 2019-12-22 2:15:43 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-12-22 2:15:43 0 [Note] InnoDB: Uses event mutexes 2019-12-22 2:15:43 0 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-12-22 2:15:43 0 [Note] InnoDB: Number of pools: 1 2019-12-22 2:15:43 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-12-22 2:15:43 0 [Note] mysqld: O_TMPFILE is not supported on /home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2 (disabling future attempts) 2019-12-22 2:15:43 0 [Note] InnoDB: Initializing buffer pool, total size = 8M, instances = 1, chunk size = 8M 2019-12-22 2:15:43 0 [Note] InnoDB: Completed initialization of buffer pool 2019-12-22 2:15:43 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-12-22 2:15:43 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-12-22 2:15:43 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-12-22 2:15:43 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-12-22 2:15:43 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2019-12-22 2:15:43 0 [Note] InnoDB: Waiting for purge to start 2019-12-22 2:15:43 0 [Note] InnoDB: 10.4.12 started; log sequence number 2610965; transaction id 1557 2019-12-22 2:15:43 0 [Note] InnoDB: Loading buffer pool(s) from /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/ib_buffer_pool 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_MUTEXES' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_CMP' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'FEEDBACK' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'user_variables' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled. 2019-12-22 2:15:43 0 [Note] Plugin 'unix_socket' is disabled. 2019-12-22 2:15:43 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-pam-debug' 2019-12-22 2:15:43 0 [Warning] /home/stepan/mariadb/10.4/git/sql/mysqld: unknown option '--loose-aria' 2019-12-22 2:15:43 0 [Note] InnoDB: Buffer pool(s) load completed at 191222 2:15:43 2019-12-22 2:15:43 0 [Note] Server socket created on IP: '127.0.0.1'. 2019-12-22 2:15:43 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2019-12-22 2:15:43 0 [Note] WSREP: Server initialized 2019-12-22 2:15:43 0 [Note] WSREP: Server status change disconnected -> initializing 2019-12-22 2:15:43 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:43 0 [Note] WSREP: Server status change initializing -> initialized 2019-12-22 2:15:43 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:43 0 [Note] WSREP: Loading provider /usr/lib/libgalera_smm_4.so initial position: 00000000-0000-0000-0000-000000000000:-1 wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_smm_4.so' wsrep loader: [INFO] wsrep_load(): Galera 26.4.3(r4548) by Codership Oy loaded successfully. 2019-12-22 2:15:43 0 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-12-22 2:15:43 0 [Warning] WSREP: Could not open state file for reading: '/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//grastate.dat' 2019-12-22 2:15:43 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1 2019-12-22 2:15:43 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 2 UUID: 2868deec-2450-11ea-bfbf-4ba24e57d047 Seqno: -1 - -1 Offset: -1 Synced: 1 2019-12-22 2:15:43 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 2868deec-2450-11ea-bfbf-4ba24e57d047, offset: -1 2019-12-22 2:15:43 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/25 bytes) complete. 2019-12-22 2:15:43 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (25/25 bytes) complete. 2019-12-22 2:15:43 0 [Note] WSREP: Recovering GCache ring buffer: didn't recover any events. 2019-12-22 2:15:43 0 [Note] WSREP: Passing config to GCS: base_dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; base_host = 127.0.0.1; base_port = 16005; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 1; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 2019-12-22 2:15:43 0 [Note] WSREP: Start replication 2019-12-22 2:15:43 0 [Note] WSREP: Connecting with bootstrap option: 0 2019-12-22 2:15:43 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1 2019-12-22 2:15:43 0 [Note] WSREP: protonet asio version 0 2019-12-22 2:15:43 0 [Note] WSREP: Using CRC-32C for message checksums. 2019-12-22 2:15:43 0 [Note] WSREP: backend: asio 2019-12-22 2:15:43 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-12-22 2:15:43 0 [Warning] WSREP: access file(/home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data//gvwstate.dat) failed(No such file or directory) 2019-12-22 2:15:43 0 [Note] WSREP: restore pc from disk failed 2019-12-22 2:15:43 0 [Note] WSREP: GMCast version 0 2019-12-22 2:15:43 0 [Note] WSREP: (31ca7ae5, 'tcp://0.0.0.0:16005') listening at tcp://0.0.0.0:16005 2019-12-22 2:15:43 0 [Note] WSREP: (31ca7ae5, 'tcp://0.0.0.0:16005') multicast: , ttl: 1 2019-12-22 2:15:43 0 [Note] WSREP: EVS version 1 2019-12-22 2:15:43 0 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '127.0.0.1:16002' 2019-12-22 2:15:43 0 [Note] WSREP: (31ca7ae5, 'tcp://0.0.0.0:16005') connection established to 2866fca0 tcp://127.0.0.1:16002 2019-12-22 2:15:43 0 [Note] WSREP: (31ca7ae5, 'tcp://0.0.0.0:16005') turning message relay requesting on, nonlive peers: 2019-12-22 2:15:44 0 [Note] WSREP: EVS version upgrade 0 -> 1 2019-12-22 2:15:44 0 [Note] WSREP: declaring 2866fca0 at tcp://127.0.0.1:16002 stable 2019-12-22 2:15:44 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2019-12-22 2:15:44 0 [Note] WSREP: Node 2866fca0 state prim 2019-12-22 2:15:44 0 [Note] WSREP: view(view_id(PRIM,2866fca0,4) memb { 2866fca0,0 31ca7ae5,0 } joined { } left { } partitioned { }) 2019-12-22 2:15:44 0 [Note] WSREP: save pc into disk 2019-12-22 2:15:44 0 [Note] WSREP: gcomm: connected 2019-12-22 2:15:44 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-12-22 2:15:44 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-12-22 2:15:44 0 [Note] WSREP: Opened channel 'my_wsrep_cluster' 2019-12-22 2:15:44 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2019-12-22 2:15:44 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2019-12-22 2:15:44 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 32183c8a-2450-11ea-aec6-377140b216c1 2019-12-22 2:15:44 0 [Note] WSREP: STATE EXCHANGE: got state msg: 32183c8a-2450-11ea-aec6-377140b216c1 from 0 (cnt7glr11.localdomain) 2019-12-22 2:15:44 7 [Note] WSREP: Starting rollbacker thread 7 2019-12-22 2:15:44 0 [Note] WSREP: STATE EXCHANGE: got state msg: 32183c8a-2450-11ea-aec6-377140b216c1 from 1 (cnt7glr11.localdomain) 2019-12-22 2:15:44 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 3, members = 1/2 (joined/total), act_id = 758, last_appl. = 641, protocols = 2/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 2868deec-2450-11ea-bfbf-4ba24e57d047 2019-12-22 2:15:44 8 [Note] WSREP: Starting applier thread 8 2019-12-22 2:15:44 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000000 of size 134217728 bytes 2019-12-22 2:15:44 0 [Note] WSREP: Flow-control interval: [23, 23] 2019-12-22 2:15:44 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 759) 2019-12-22 2:15:44 8 [Note] WSREP: ####### processing CC 759, local, ordered 2019-12-22 2:15:44 8 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-12-22 2:15:44 8 [Note] WSREP: ####### My UUID: 31ca7ae5-2450-11ea-b45e-526afa885c78 2019-12-22 2:15:44 8 [Note] WSREP: Server cnt7glr11.localdomain connected to cluster at position 2868deec-2450-11ea-bfbf-4ba24e57d047:759 with ID 31ca7ae5-2450-11ea-b45e-526afa885c78 2019-12-22 2:15:44 8 [Note] WSREP: Server status change initialized -> connected 2019-12-22 2:15:44 8 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:44 8 [Note] WSREP: State transfer required: Group state: 2868deec-2450-11ea-bfbf-4ba24e57d047:759 Local state: 00000000-0000-0000-0000-000000000000:-1 2019-12-22 2:15:44 8 [Note] WSREP: Server status change connected -> joiner 2019-12-22 2:15:44 8 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-12-22 2:15:44 8 [Note] WSREP: Prepared SST request: mysqldump|127.0.0.1:16001 2019-12-22 2:15:44 8 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes 2019-12-22 2:15:44 0 [Note] WSREP: Service thread queue flushed. 2019-12-22 2:15:44 8 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: 5 2019-12-22 2:15:44 8 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 759, STRv: 3 2019-12-22 2:15:44 8 [Note] WSREP: IST receiver addr using tcp://127.0.0.1:16006 2019-12-22 2:15:44 8 [Note] WSREP: Prepared IST receiver for 0-759, listening at: tcp://127.0.0.1:16006 2019-12-22 2:15:44 0 [Note] WSREP: Deleted page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000000 2019-12-22 2:15:44 0 [Note] WSREP: Created page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000001 of size 134217728 bytes 2019-12-22 2:15:44 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) requested state transfer from '*any*'. Selected 0.0 (cnt7glr11.localdomain)(SYNCED) as donor. 2019-12-22 2:15:44 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 759) 2019-12-22 2:15:44 8 [Note] WSREP: Requesting state transfer: success, donor: 0 2019-12-22 2:15:44 8 [Note] WSREP: Resetting GCache seqno map due to different histories. 2019-12-22 2:15:44 8 [Note] WSREP: GCache history reset: old(2868deec-2450-11ea-bfbf-4ba24e57d047:0 -> 2868deec-2450-11ea-bfbf-4ba24e57d047:759 2019-12-22 2:15:44 0 [Note] Reading of all Master_info entries succeeded 2019-12-22 2:15:44 0 [Note] Added new Master_info '' to hash table 2019-12-22 2:15:44 0 [Note] /home/stepan/mariadb/10.4/git/sql/mysqld: ready for connections. Version: '10.4.12-MariaDB-debug-log' socket: '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.2.sock' port: 16001 Source distribution 2019-12-22 2:15:44 0 [Note] WSREP: Deleted page /home/stepan/mariadb/10.4/git/mysql-test/var/mysqld.2/data/gcache.page.000001 2019-12-22 2:15:46 0 [Note] WSREP: (31ca7ae5, 'tcp://0.0.0.0:16005') turning message relay requesting off 2019-12-22 2:15:48 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 2:15:48 0 [ERROR] WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1178: Will never receive state. Need to abort. 2019-12-22 2:15:48 0 [Note] WSREP: gcomm: terminating thread 2019-12-22 2:15:48 0 [Note] WSREP: gcomm: joining thread 2019-12-22 2:15:48 0 [Note] WSREP: gcomm: closing backend 2019-12-22 2:15:49 0 [Note] WSREP: view(view_id(NON_PRIM,2866fca0,4) memb { 31ca7ae5,0 } joined { } left { } partitioned { 2866fca0,0 }) 2019-12-22 2:15:49 0 [Note] WSREP: PC protocol downgrade 1 -> 0 2019-12-22 2:15:49 0 [Note] WSREP: view((empty)) 2019-12-22 2:15:49 0 [Note] WSREP: gcomm: closed 2019-12-22 2:15:49 0 [Note] WSREP: /home/stepan/mariadb/10.4/git/sql/mysqld: Terminated. ----------SERVER LOG END------------- mysqltest failed but provided no output The result from queries just before the failure was: < snip > SET GLOBAL wsrep_sst_auth = 'sst:'; connection node_2; SET GLOBAL wsrep_sst_method = 'mysqldump'; connection node_1; connection node_2; connection node_1; CREATE TABLE ten (f1 INTEGER); INSERT INTO ten VALUES (1),(2),(3),(4),(5),(6),(7),(8),(9),(10); CREATE TABLE t1 (f1 INTEGER PRIMARY KEY AUTO_INCREMENT, f2 CHAR(255)) ENGINE=InnoDB; SET AUTOCOMMIT=OFF; SET SESSION wsrep_trx_fragment_size = 1000; START TRANSACTION; INSERT INTO t1 (f2) SELECT REPEAT('x', 255) FROM ten AS a1, ten AS a2, ten AS a3; UPDATE t1 SET f2 = REPEAT('y', 255); connection node_2; connection node_2; Shutting down server ... connection node_1; connection node_2; # restart: with restart_parameters - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera_sr.galera_sr_mysqldump_sst-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/galera_sr.galera_sr_mysqldump_sst-innodb/' ***Warnings generated in error logs during shutdown after running tests: galera_sr.galera_sr_mysqldump_sst 2019-12-22 2:15:45 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '2868deec-2450-11ea-bfbf-4ba24e57d047:759' --gtid-domain-id '0' --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 2:15:45 2 [ERROR] WSREP: Try 1/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '2868deec-2450-11ea-bfbf-4ba24e57d047:759' --gtid-domain-id '0' --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 2:15:46 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/howorker[1] 191222 2:17:40 +13272.303 mysql-test-run: WARNING: Process [mysqld.1 - pid: 1982, winpid: 1982, exit: 256] died after mysql-test-run waited 0.3 seconds for /home/stepan/mariadb/10.4/git/mysql-test/var/run/mysqld.1.pid to be created. me/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '2868deec-2450-11ea-bfbf-4ba24e57d047:759' --gtid-domain-id '0' --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 2:15:46 2 [ERROR] WSREP: Try 2/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '2868deec-2450-11ea-bfbf-4ba24e57d047:759' --gtid-domain-id '0' --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 2:15:47 2 [ERROR] WSREP: Process completed with error: wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '2868deec-2450-11ea-bfbf-4ba24e57d047:759' --gtid-domain-id '0' --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300: 1 (Operation not permitted) 2019-12-22 2:15:47 2 [ERROR] WSREP: Try 3/3: 'wsrep_sst_mysqldump --address '127.0.0.1:16001' --port '16001' --local-port '16000' --socket '/home/stepan/mariadb/10.4/git/mysql-test/var/tmp/mysqld.1.sock' --defaults-file '/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf' --defaults-group-suffix '.1' --gtid '2868deec-2450-11ea-bfbf-4ba24e57d047:759' --gtid-domain-id '0' --mysqld-args --defaults-group-suffix=.1 --defaults-file=/home/stepan/mariadb/10.4/git/mysql-test/var/my.cnf --log-output=file --innodb --innodb-cmpmem --innodb-cmp-per-index --innodb-trx --innodb-locks --innodb-lock-waits --innodb-metrics --innodb-buffer-pool-stats --innodb-buffer-page --innodb-buffer-page-lru --innodb-sys-columns --innodb-sys-fields --innodb-sys-foreign --innodb-sys-foreign-cols --innodb-sys-indexes --innodb-sys-tables --innodb-sys-virtual --wsrep-on=ON --core-file --loose-debug-sync-timeout=300' failed: 1 (Operation not permitted) 2019-12-22 2:15:48 2 [Warning] WSREP: SST start failed 2019-12-22 2:15:48 2 [ERROR] WSREP: SST failed: 1 2019-12-22 2:15:48 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 2:15:48 0 [Warning] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) failed: -1 (Operation not permitted) 2019-12-22 2:15:48 0 [ERROR] WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1178: Will never receive state. Need to abort. 191222 2:16:52 +63.598 galera_sr.galera_sr_small_gcache 'innodb' [ pass ] 57921 191222 2:17:07 +14.304 galera_sr.mdev_18631 'innodb' [ pass ] 2083 191222 2:17:18 +10.880 wsrep.pool_of_threads 'innodb' [ pass ] 8 191222 2:17:20 +2.276 wsrep.foreign_key 'innodb' [ pass ] 117 191222 2:17:22 +1.938 wsrep.plugin 'innodb' [ pass ] 3 191222 2:17:24 +2.473 wsrep.mysql_tzinfo_to_sql_symlink 'innodb' [ fail ] Test ended at 2019-12-22 02:17:24 CURRENT_TEST: wsrep.mysql_tzinfo_to_sql_symlink mysqltest: At line 18: exec of '/home/stepan/mariadb/10.4/git/sql/mysql_tzinfo_to_sql --verbose /home/stepan/mariadb/10.4/git/mysql-test/var/zoneinfo 2>&1' failed, error: 256, status: 1, errno: 0 Output from before failure: /home/stepan/mariadb/10.4/git/sql/mysql_tzinfo_to_sql: Can't read dir of '/etc/my.cnf.d' (Errcode: 2 "No such file or directory") Fatal error in defaults handling. Program aborted The result from queries just before the failure was: # # MDEV-5226 mysql_tzinfo_to_sql errors with tzdata 2013f and above # # Verbose run - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/wsrep.mysql_tzinfo_to_sql_symlink-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/wsrep.mysql_tzinfo_to_sql_symlink-innodb/' 191222 2:17:25 +0.915 wsrep.mysql_tzinfo_to_sql_symlink_skip 'innodb' [ fail ] Test ended at 2019-12-22 02:17:25 CURRENT_TEST: wsrep.mysql_tzinfo_to_sql_symlink_skip mkdir: cannot create directory '/home/stepan/mariadb/10.4/git/mysql-test/var/zoneinfo': File exists mysqltest: At line 10: exec of 'mkdir /home/stepan/mariadb/10.4/git/mysql-test/var/zoneinfo' failed, error: 256, status: 1, errno: 2 Output from before failure: # The result from queries just before the failure was: # # MDEV-5226 mysql_tzinfo_to_sql errors with tzdata 2013f and above # - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/wsrep.mysql_tzinfo_to_sql_symlink_skip-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/wsrep.mysql_tzinfo_to_sql_symlink_skip-innodb/' 191222 2:17:26 +0.737 wsrep.trans 'innodb' [ pass ] 3 191222 2:17:37 +10.685 wsrep.alter_table_innodb 'innodb' [ pass ] 8528 191222 2:17:38 +1.515 wsrep.binlog_format 'innodb' [ pass ] 62 191222 2:17:40 +1.777 wsrep.mdev_10186 'innodb' [ fail ] Test ended at 2019-12-22 02:17:40 CURRENT_TEST: wsrep.mdev_10186 Failed to start mysqld.1 mysqltest failed but provided no output - saving '/home/stepan/mariadb/10.4/git/mysql-test/var/log/wsrep.mdev_10186-innodb/' to '/home/stepan/mariadb/10.4/git/mysql-test/var/log/wsrep.mdev_10186-innodb/' ***Warnings generated in error logs during shutdown after running tests: wsrep.mdev_10186 wsrep loader: [ERROR] wsrep_load(): dlopen(): $WSREP_PROVIDER: cannot open shared object file: No such file or directory 2019-12-22 2:17:40 0 [ERROR] WSREP: Failed to create a new provider '$WSREP_PROVIDER' with options 'base_port=16001;gcache.size=10M':Failed to load wsrep library 2019-12-22 2:17:40 0 [ERROR] WSREP: Failed to load provider 2019-12-22 2:17:40 0 [ERROR] Aborting 191222 2:17:41 +0.792 wsrep.mdev_6832 'innodb' [ pass ] 157 191222 2:17:45 +4.712 wsrep.mdev_7798 'innodb' [ pass ] 2635 191222 2:18:01 +15.840 wsrep.wsrep-recover-v25 'binlogon,innodb' [ pass ] 13737 191222 2:18:14 +12.691 wsrep.wsrep-recover-v25 'binlogoff,innodb' [ pass ] 10445 191222 2:18:33 +19.427 wsrep.wsrep-recover 'binlogon,innodb' [ pass ] 17265 191222 2:18:53 +19.329 wsrep.wsrep-recover 'binlogoff,innodb' [ pass ] 17182 191222 2:18:56 +3.324 wsrep.wsrep_rpl 'innodb,mix' [ pass ] 1041 191222 2:18:59 +3.186 wsrep.wsrep_rpl 'innodb,row' [ pass ] 1150 191222 2:19:02 +2.984 wsrep.wsrep_rpl 'innodb,stmt' [ pass ] 1049 -------------------------------------------------------------------------- The servers were restarted 131 times Spent 3789.368 of 13357 seconds executing testcases Completed: Failed 20/395 tests, 94.94% were successful. Failing test(s): galera.galera_parallel_autoinc_largetrx galera.galera_gcs_fc_limit galera.MDEV-6860 galera.MW-284 galera.galera_as_slave galera.galera_as_slave_autoinc galera.galera_as_slave_gtid galera.galera_as_slave_gtid_auto_engine galera.galera_as_slave_gtid_replicate_do_db galera.galera_gtid_slave galera.galera_gtid_slave_sst_rsync galera.galera_ist_mysqldump galera.galera_sst_mysqldump galera.galera_sst_mysqldump_with_key galera.mysql-wsrep#33 galera_sr.galera_sr_kill_all_pcrecovery galera_sr.galera_sr_mysqldump_sst wsrep.mysql_tzinfo_to_sql_symlink wsrep.mysql_tzinfo_to_sql_symlink_skip wsrep.mdev_10186 The log files in var/log may give you some hint of what went wrong. If you want to report this error, please read first the documentation at http://dev.mysql.com/doc/mysql/en/mysql-test-suite.html Errors/warnings were found in logfiles during server shutdown after running the following sequence(s) of tests: galera.galera_fk_multitable galera.galera_toi_ddl_fk_insert galera.galera_fk_selfreferential galera.galera_create_function galera.galera_commit_empty galera.galera_events galera.galera_change_user galera.galera_alter_engine_innodb galera.galera_bf_abort_lock_table galera.galera_FK_duplicate_client_insert galera.MW-258 galera.galera_ftwrl_drain galera.galera_rsu_add_pk galera.MW-357 galera.galera_toi_ddl_fk_update galera.MDEV-16509 galera.galera_fk_cascade_update galera.galera_ddl_multiline galera.galera_bf_abort galera.galera_bf_abort_ftwrl galera.galera_create_table_as_select galera.GCF-939 galera.MW-369 galera.galera_fk_setnull galera.galera_alter_table_force galera.galera_fk_cascade_delete galera.GAL-480 galera.galera_bf_abort_sleep galera.galera_create_table_like galera.MDEV-20225 galera.galera_toi_ddl_error galera.MW-328D galera.galera_var_load_data_splitting galera.MW-416 galera.galera_wsrep_desync_wsrep_on galera.galera_events2 galera.basic galera.MW-309 galera.galera_bf_abort_at_after_statement galera.GAL-382 galera.galera_enum galera.MW-402 galera.galera_fk_multicolumn galera.MW-285 galera.enforce_storage_engine galera.binlog_checksum galera.galera_binlog_cache_size galera.create galera.galera_admin galera.GAL-401 galera.galera_create_procedure galera.MW-292 galera.galera_alter_engine_myisam galera.galera_create_trigger galera.galera_rsu_drop_pk galera.galera_bf_abort_flush_for_export galera.galera_ftwrl galera.MW-328E galera.galera_delete_limit galera.galera_drop_database galera.galera_desync_overlapped galera.galera_bf_abort_for_update galera.galera_applier_ftwrl_table galera.galera_drop_multi galera.galera_defaults galera.fk galera.MW-252 galera.galera_bf_abort_get_lock galera.galera_gcs_fc_limit galera.galera_fk_mismatch galera.galera_fk_no_pk galera.ev51914 galera.galera_binlog_row_image galera.galera#505 galera.MW-259 galera.galera_bf_abort_shutdown galera.galera_fk_conflict galera.galera#500 galera.galera_ist_mysqldump galera.galera_sst_mysqldump galera.galera_sst_mysqldump_with_key galera.mysql-wsrep#33 galera_sr.galera_sr_kill_all_pcrecovery galera_sr.galera_sr_mysqldump_sst wsrep.mdev_10186 1 tests were skipped, 0 by the test itself. 191222 2:19:04 +1.312 mysql-test-run: *** ERROR: there were failing test cases