Checking supported features... MariaDB Version 10.4.3-MariaDB-debug - SSL connections supported - binaries are debug compiled Using suites: galera_sr Collecting tests... Installing system database... worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 16000..16019 ============================================================================== TEST RESULT TIME (ms) or COMMENT -------------------------------------------------------------------------- galera_sr.GCF-574 [ disabled ] CTAS is not supported together with SR galera_sr.galera_sr_sbr [ disabled ] binlog_format=STATEMENT not supported with SR galera_sr.mysql-wsrep-features#29 [ disabled ] binlog_format=STATEMENT not supported with SR galera_sr.galera_sr_large_fragment 'innodb' [ pass ] 71349 galera_sr.mysql-wsrep-features#32 'innodb' [ pass ] 4760 galera_sr.galera_sr_gtid 'innodb' [ pass ] 2178 galera_sr.galera_sr_log_bin 'innodb' [ fail ] Test ended at 2019-02-04 16:26:55 CURRENT_TEST: galera_sr.galera_sr_log_bin mysqltest: At line 51: query 'COMMIT' failed: 2013: Lost connection to MySQL server during query The result from queries just before the failure was: < snip > RESET MASTER; SET GLOBAL wsrep_on=ON; SET AUTOCOMMIT=OFF; SET SESSION wsrep_trx_fragment_size = 1; START TRANSACTION; INSERT INTO t3 VALUES (1); connect node_2a, 127.0.0.1, root, , test, $NODE_MYPORT_2; connection node_2a; SET AUTOCOMMIT=OFF; START TRANSACTION; INSERT INTO t4 VALUES (1); connection node_1; INSERT INTO t1 VALUES (2); COMMIT; connection node_1a; INSERT INTO t2 VALUES (2); COMMIT; connection node_2; INSERT INTO t3 VALUES (2); COMMIT; More results from queries before failure can be found in /home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr_log_bin.log Server [mysqld.2 - pid: 41597, winpid: 41597, exit: 256] failed during test run Server log from this test: ----------SERVER LOG START----------- 2019-02-04 16:26:45 0 [Warning] WSREP: option --wsrep-causal-reads is deprecated 2019-02-04 16:26:45 0 [Note] /home/stepan/galera/git/10.4/server/sql/mysqld (mysqld 10.4.3-MariaDB-debug-log) starting as process 41599 ... 2019-02-04 16:26:45 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4186) 2019-02-04 16:26:45 0 [Warning] Changed limits: max_open_files: 1024 max_connections: 151 (was 151) table_cache: 421 (was 2000) 2019-02-04 16:26:45 0 [Note] WSREP: Loading provider /usr/lib/libgalera_smm_4.soinitial position: 00000000-0000-0000-0000-000000000000:-1 wsrep loader: [INFO] wsrep_load(): loading provider library '/usr/lib/libgalera_smm_4.so' wsrep loader: [INFO] wsrep_load(): Galera 26.4.0(r4463) by Codership Oy loaded successfully. 2019-02-04 16:26:45 0 [Note] WSREP: CRC-32C: using hardware acceleration. 2019-02-04 16:26:45 0 [Warning] WSREP: Could not open state file for reading: '/home/stepan/galera/git/10.4/server/mysql-test/var/mysqld.2/data//grastate.dat' 2019-02-04 16:26:45 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1 2019-02-04 16:26:45 0 [Note] WSREP: GCache DEBUG: opened preamble: Version: 0 UUID: 00000000-0000-0000-0000-000000000000 Seqno: -1 - -1 Offset: -1 Synced: 0 2019-02-04 16:26:45 0 [Note] WSREP: Skipped GCache ring buffer recovery: could not determine history UUID. 2019-02-04 16:26:45 0 [Note] WSREP: Passing config to GCS: base_dir = /home/stepan/galera/git/10.4/server/mysql-test/var/mysqld.2/data/; base_host = 127.0.0.1; base_port = 16005; cert.log_conflicts = no; cert.optimistic_pa = yes; dbug = ; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT30S; evs.install_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT10S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.debug = 0; gcache.dir = /home/stepan/galera/git/10.4/server/mysql-test/var/mysqld.2/data/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /home/stepan/galera/git/10.4/server/mysql-test/var/mysqld.2/data//galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_pac 2019-02-04 16:26:45 0 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0 -> 00000000-0000-0000-0000-000000000000:-1 2019-02-04 16:26:45 0 [Note] WSREP: Start replication 2019-02-04 16:26:45 0 [Note] WSREP: Connecting with bootstrap option: 0 2019-02-04 16:26:45 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1 2019-02-04 16:26:45 0 [Note] WSREP: protonet asio version 0 2019-02-04 16:26:45 0 [Note] WSREP: Using CRC-32C for message checksums. 2019-02-04 16:26:45 0 [Note] WSREP: backend: asio 2019-02-04 16:26:45 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2019-02-04 16:26:45 0 [Warning] WSREP: access file(/home/stepan/galera/git/10.4/server/mysql-test/var/mysqld.2/data//gvwstate.dat) failed(No such file or directory) 2019-02-04 16:26:45 0 [Note] WSREP: restore pc from disk failed 2019-02-04 16:26:45 0 [Note] WSREP: GMCast version 0 2019-02-04 16:26:45 0 [Note] WSREP: (e62db46d, 'tcp://0.0.0.0:16005') listening at tcp://0.0.0.0:16005 2019-02-04 16:26:45 0 [Note] WSREP: (e62db46d, 'tcp://0.0.0.0:16005') multicast: , ttl: 1 2019-02-04 16:26:45 0 [Note] WSREP: EVS version 1 2019-02-04 16:26:45 0 [Note] WSREP: gcomm: connecting to group 'my_wsrep_cluster', peer '127.0.0.1:16002' 2019-02-04 16:26:45 0 [Note] WSREP: (e62db46d, 'tcp://0.0.0.0:16005') connection established to e5c29b16 tcp://127.0.0.1:16002 2019-02-04 16:26:45 0 [Note] WSREP: (e62db46d, 'tcp://0.0.0.0:16005') turning message relay requesting on, nonlive peers: 2019-02-04 16:26:45 0 [Note] WSREP: EVS version upgrade 0 -> 1 2019-02-04 16:26:45 0 [Note] WSREP: declaring e5c29b16 at tcp://127.0.0.1:16002 stable 2019-02-04 16:26:45 0 [Note] WSREP: PC protocol upgrade 0 -> 1 2019-02-04 16:26:45 0 [Note] WSREP: Node e5c29b16 state prim 2019-02-04 16:26:45 0 [Note] WSREP: view(view_id(PRIM,e5c29b16,2) memb { e5c29b16,0 e62db46d,0 } joined { } left { } partitioned { }) 2019-02-04 16:26:45 0 [Note] WSREP: save pc into disk 2019-02-04 16:26:46 0 [Note] WSREP: gcomm: connected 2019-02-04 16:26:46 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2019-02-04 16:26:46 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2019-02-04 16:26:46 0 [Note] WSREP: Opened channel 'my_wsrep_cluster' 2019-02-04 16:26:46 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2019-02-04 16:26:46 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2019-02-04 16:26:46 0 [Note] WSREP: STATE EXCHANGE: sent state msg: e67b3aba-2888-11e9-b072-9f8288d0f640 2019-02-04 16:26:46 0 [Note] WSREP: STATE EXCHANGE: got state msg: e67b3aba-2888-11e9-b072-9f8288d0f640 from 0 (cnt7glr11.localdomain) 2019-02-04 16:26:46 0 [Note] WSREP: STATE EXCHANGE: got state msg: e67b3aba-2888-11e9-b072-9f8288d0f640 from 1 (cnt7glr11.localdomain) 2019-02-04 16:26:46 0 [Note] WSREP: Quorum results: version = 5, component = PRIMARY, conf_id = 1, members = 1/2 (joined/total), act_id = 1, last_appl. = 0, protocols = 1/10/4 (gcs/repl/appl), vote policy= 0, group UUID = e5c3864a-2888-11e9-9bbe-37d7667f094c 2019-02-04 16:26:46 0 [Note] WSREP: Writing down CC checksum: 63b3e795 9bd26d7f cbb97c45 f858e9af at offset 224 2019-02-04 16:26:46 0 [Note] WSREP: Flow-control interval: [23, 23] 2019-02-04 16:26:46 0 [Note] WSREP: Trying to continue unpaused monitor 2019-02-04 16:26:46 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 2) 2019-02-04 16:26:46 3 [Note] WSREP: Starting applier thread 3 2019-02-04 16:26:46 3 [Note] WSREP: ####### processing CC 2, local, ordered 2019-02-04 16:26:46 3 [Note] WSREP: ####### drain monitors upto -1 2019-02-04 16:26:46 3 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-02-04 16:26:46 3 [Note] WSREP: ####### My UUID: e62db46d-2888-11e9-8a69-4622fbee31e4 2019-02-04 16:26:46 3 [Note] WSREP: Server cnt7glr11.localdomain connected to cluster at position e5c3864a-2888-11e9-9bbe-37d7667f094c:2 with ID e62db46d-2888-11e9-8a69-4622fbee31e4 2019-02-04 16:26:46 3 [Note] WSREP: Server status change disconnected -> connected 2019-02-04 16:26:46 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-04 16:26:46 3 [Note] WSREP: State transfer required: Group state: e5c3864a-2888-11e9-9bbe-37d7667f094c:2 Local state: 00000000-0000-0000-0000-000000000000:-1 2019-02-04 16:26:46 3 [Note] WSREP: Server status change connected -> joiner 2019-02-04 16:26:46 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-04 16:26:46 0 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '127.0.0.2:16007' --datadir '/home/stepan/galera/git/10.4/server/mysql-test/var/mysqld.2/data/' --defaults-file '/home/stepan/galera/git/10.4/server/mysql-test/var/my.cnf' --defaults-group-suffix '.2' --parent '41599' --binlog 'mysqld-bin' --binlog-index 'mysqld-bin.index'' 2019-02-04 16:26:46 3 [Note] WSREP: Prepared SST request: rsync|127.0.0.2:16007/rsync_sst 2019-02-04 16:26:46 3 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:0 (proto: 10), state transfer needed: yes 2019-02-04 16:26:46 0 [Note] WSREP: Service thread queue flushed. 2019-02-04 16:26:46 3 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:0, protocol version: 5 2019-02-04 16:26:46 3 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 2, p: 10 2019-02-04 16:26:46 3 [Note] WSREP: IST receiver addr using tcp://127.0.0.1:16006 2019-02-04 16:26:46 3 [Note] WSREP: Prepared IST receiver for 0-2, listening at: tcp://127.0.0.1:16006 2019-02-04 16:26:46 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) requested state transfer from '*any*'. Selected 0.0 (cnt7glr11.localdomain)(SYNCED) as donor. 2019-02-04 16:26:46 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 2) 2019-02-04 16:26:46 3 [Note] WSREP: Requesting state transfer: success, donor: 0 2019-02-04 16:26:46 3 [Note] WSREP: Resetting GCache seqno map due to different histories. 2019-02-04 16:26:46 3 [Note] WSREP: GCache history reset: old(00000000-0000-0000-0000-000000000000:0 -> e5c3864a-2888-11e9-9bbe-37d7667f094c:2 2019-02-04 16:26:47 0 [Note] WSREP: 0.0 (cnt7glr11.localdomain): State transfer to 1.0 (cnt7glr11.localdomain) complete. 2019-02-04 16:26:47 0 [Note] WSREP: Member 0.0 (cnt7glr11.localdomain) synced with group. 2019-02-04 16:26:48 0 [Note] WSREP: (e62db46d, 'tcp://0.0.0.0:16005') turning message relay requesting off WSREP_SST: [INFO] Extracting binlog files: (20190204 16:26:48.592) mysqld-bin.000002 WSREP_SST: [INFO] Joiner cleanup. rsync PID: 41660 (20190204 16:26:48.601) WSREP_SST: [INFO] Joiner cleanup done. (20190204 16:26:49.119) 2019-02-04 16:26:49 4 [Note] WSREP: SST received 2019-02-04 16:26:49 4 [Note] WSREP: Server status change joiner -> initializing 2019-02-04 16:26:49 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-04 16:26:49 0 [Note] Plugin 'partition' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'SEQUENCE' is disabled. 2019-02-04 16:26:49 0 [Note] InnoDB: Using Linux native AIO 2019-02-04 16:26:49 0 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!! 2019-02-04 16:26:49 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2019-02-04 16:26:49 0 [Note] InnoDB: Uses event mutexes 2019-02-04 16:26:49 0 [Note] InnoDB: Compressed tables use zlib 1.2.7 2019-02-04 16:26:49 0 [Note] InnoDB: Number of pools: 1 2019-02-04 16:26:49 0 [Note] InnoDB: Using SSE2 crc32 instructions 2019-02-04 16:26:49 0 [Note] mysqld: O_TMPFILE is not supported on /home/stepan/galera/git/10.4/server/mysql-test/var/tmp/mysqld.2 (disabling future attempts) 2019-02-04 16:26:49 0 [Note] InnoDB: Initializing buffer pool, total size = 8M, instances = 1, chunk size = 8M 2019-02-04 16:26:49 0 [Note] InnoDB: Completed initialization of buffer pool 2019-02-04 16:26:49 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2019-02-04 16:26:49 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=151248 2019-02-04 16:26:49 0 [Note] InnoDB: Starting final batch to recover 18 pages from redo log. 2019-02-04 16:26:49 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2019-02-04 16:26:49 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2019-02-04 16:26:49 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2019-02-04 16:26:49 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2019-02-04 16:26:49 0 [Note] InnoDB: Waiting for purge to start 2019-02-04 16:26:49 0 [Note] InnoDB: 10.4.3 started; log sequence number 186000; transaction id 47 2019-02-04 16:26:49 0 [Note] InnoDB: Loading buffer pool(s) from /home/stepan/galera/git/10.4/server/mysql-test/var/mysqld.2/data/ib_buffer_pool 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_MUTEXES' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_CMP' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled. 2019-02-04 16:26:49 0 [Note] InnoDB: Buffer pool(s) load completed at 190204 16:26:49 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'FEEDBACK' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'user_variables' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled. 2019-02-04 16:26:49 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled. 2019-02-04 16:26:49 0 [Warning] /home/stepan/galera/git/10.4/server/sql/mysqld: unknown option '--loose-pam-debug' 2019-02-04 16:26:49 0 [Warning] /home/stepan/galera/git/10.4/server/sql/mysqld: unknown option '--loose-aria' 2019-02-04 16:26:49 0 [Note] Recovering after a crash using mysqld-bin 2019-02-04 16:26:49 0 [Note] Starting crash recovery... 2019-02-04 16:26:49 0 [Note] Crash recovery finished. 2019-02-04 16:26:49 0 [Note] Server socket created on IP: '127.0.0.1'. 2019-02-04 16:26:49 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) 2019-02-04 16:26:49 0 [Note] WSREP: Server initialized 2019-02-04 16:26:49 0 [Note] WSREP: Server status change initializing -> initialized 2019-02-04 16:26:49 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-04 16:26:49 4 [Note] WSREP: Server status change initialized -> joined 2019-02-04 16:26:49 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-04 16:26:49 0 [Note] Reading of all Master_info entries succeded 2019-02-04 16:26:49 0 [Note] Added new Master_info '' to hash table 2019-02-04 16:26:49 0 [Note] /home/stepan/galera/git/10.4/server/sql/mysqld: ready for connections. Version: '10.4.3-MariaDB-debug-log' socket: '/home/stepan/galera/git/10.4/server/mysql-test/var/tmp/mysqld.2.sock' port: 16001 Source distribution 2019-02-04 16:26:49 4 [Note] WSREP: Recovered position from storage: e5c3864a-2888-11e9-9bbe-37d7667f094c:2 2019-02-04 16:26:49 4 [Note] WSREP: Recovered view from SST: id: e5c3864a-2888-11e9-9bbe-37d7667f094c:2 status: primary prococol_version: 4 capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO final: no own_index: 1 members(2): 0: e5c29b16-2888-11e9-9493-8e364cceb5d2, cnt7glr11.localdomain 1: e62db46d-2888-11e9-8a69-4622fbee31e4, cnt7glr11.localdomain 2019-02-04 16:26:49 4 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2019-02-04 16:26:49 1 [Note] WSREP: Recovered cluster id e5c3864a-2888-11e9-9bbe-37d7667f094c 2019-02-04 16:26:49 4 [Note] WSREP: SST received: e5c3864a-2888-11e9-9bbe-37d7667f094c:2 2019-02-04 16:26:49 3 [Note] WSREP: Installed new state from SST: e5c3864a-2888-11e9-9bbe-37d7667f094c:2 2019-02-04 16:26:49 3 [Note] WSREP: Cert. index preload up to 2 2019-02-04 16:26:49 0 [Note] WSREP: ####### IST applying starts with 3 2019-02-04 16:26:49 0 [Note] WSREP: ####### IST current seqno initialized to 2 2019-02-04 16:26:49 0 [Note] WSREP: Receiving IST... 0.0% (0/1 events) complete. 2019-02-04 16:26:49 0 [Note] WSREP: IST preload starting at 2 2019-02-04 16:26:49 0 [Note] WSREP: REPL Protocols: 10 (5, 3) 2019-02-04 16:26:49 0 [Note] WSREP: ####### Adjusting cert position: 0 -> 2 2019-02-04 16:26:49 0 [Note] WSREP: Service thread queue flushed. 2019-02-04 16:26:49 0 [Note] WSREP: Lowest cert indnex boundary for CC from preload: 2 2019-02-04 16:26:49 0 [Note] WSREP: Min available from gcache for CC from preload: 2 2019-02-04 16:26:49 0 [Note] WSREP: Receiving IST...100.0% (1/1 events) complete. 2019-02-04 16:26:49 3 [Note] WSREP: IST received: e5c3864a-2888-11e9-9bbe-37d7667f094c:2 2019-02-04 16:26:49 0 [Note] WSREP: 1.0 (cnt7glr11.localdomain): State transfer from 0.0 (cnt7glr11.localdomain) complete. 2019-02-04 16:26:49 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 2) 2019-02-04 16:26:49 0 [Note] WSREP: Member 1.0 (cnt7glr11.localdomain) synced with group. 2019-02-04 16:26:49 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2) 2019-02-04 16:26:49 3 [Note] WSREP: Server cnt7glr11.localdomain synced with group 2019-02-04 16:26:49 3 [Note] WSREP: Server status change joined -> synced 2019-02-04 16:26:49 3 [Note] WSREP: Synchronized with group, ready for connections 2019-02-04 16:26:49 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. mysqld: /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0rseg.cc:92: void trx_rseg_update_wsrep_checkpoint(trx_rsegf_t*, const XID*, mtr_t*): Assertion `xid_seqno > wsrep_seqno' failed. 190204 16:26:52 [ERROR] mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.4.3-MariaDB-debug-log key_buffer_size=1048576 read_buffer_size=131072 max_used_connections=2 max_threads=153 thread_count=13 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 63459 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7f3ffc000b00 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f402047e9a0 thread_stack 0x49000 /home/stepan/galera/git/10.4/server/sql/mysqld(my_print_stacktrace+0x40)[0x55a555f0228c] mysys/stacktrace.c:269(my_print_stacktrace)[0x55a55573e939] sigaction.c:0(__restore_rt)[0x7f402b0f45d0] :0(__GI_raise)[0x7f40293e3207] :0(__GI_abort)[0x7f40293e48f8] :0(__assert_fail_base)[0x7f40293dc026] :0(__GI___assert_fail)[0x7f40293dc0d2] trx/trx0rseg.cc:92(trx_rseg_update_wsrep_checkpoint(unsigned char*, xid_t const*, mtr_t*))[0x55a555b7a401] trx/trx0purge.cc:290(trx_purge_add_undo_to_history(trx_t const*, trx_undo_t*&, mtr_t*))[0x55a555b5f0b4] trx/trx0trx.cc:1095(trx_write_serialisation_history(trx_t*, mtr_t*))[0x55a555b84243] trx/trx0trx.cc:1523(trx_commit_low(trx_t*, mtr_t*))[0x55a555b85d23] trx/trx0trx.cc:1570(trx_commit(trx_t*))[0x55a555b85e75] trx/trx0trx.cc:1708(trx_commit_for_mysql(trx_t*))[0x55a555b8627f] handler/ha_innodb.cc:4373(innobase_commit_low(trx_t*))[0x55a55596a19c] handler/ha_innodb.cc:4495(innobase_commit_ordered_2(trx_t*, THD*))[0x55a55596a55c] handler/ha_innodb.cc:4555(innobase_commit_ordered(handlerton*, THD*, bool))[0x55a55596a792] sql/log.cc:8860(TC_LOG::run_commit_ordered(THD*, bool))[0x55a55586dc52] sql/log.cc:8110(MYSQL_BIN_LOG::trx_group_commit_leader(MYSQL_BIN_LOG::group_commit_entry*))[0x55a55586baeb] sql/log.cc:7700(MYSQL_BIN_LOG::write_transaction_to_binlog_events(MYSQL_BIN_LOG::group_commit_entry*))[0x55a55586a720] sql/log.cc:7370(MYSQL_BIN_LOG::write_transaction_to_binlog(THD*, binlog_cache_mngr*, Log_event*, bool, bool, bool))[0x55a555869d03] sql/log.cc:1787(binlog_flush_cache(THD*, binlog_cache_mngr*, Log_event*, bool, bool, bool))[0x55a555859e9e] sql/log.cc:1893(binlog_commit_flush_xid_caches(THD*, binlog_cache_mngr*, bool, unsigned long long))[0x55a55585a4dc] sql/log.cc:9642(MYSQL_BIN_LOG::log_and_order(THD*, unsigned long long, bool, bool, bool))[0x55a55586fed7] sql/handler.cc:1591(ha_commit_trans(THD*, bool))[0x55a555743e2a] sql/transaction.cc:313(trans_commit(THD*))[0x55a555589a76] sql/wsrep_high_priority_service.cc:318(Wsrep_high_priority_service::commit(wsrep::ws_handle const&, wsrep::ws_meta const&))[0x55a55563d3cb] src/server_state.cpp:193(apply_write_set(wsrep::server_state&, wsrep::high_priority_service&, wsrep::ws_handle const&, wsrep::ws_meta const&, wsrep::const_buffer const&))[0x55a555fa51a6] src/server_state.cpp:925(wsrep::server_state::on_apply(wsrep::high_priority_service&, wsrep::ws_handle const&, wsrep::ws_meta const&, wsrep::const_buffer const&))[0x55a555fa8731] wsrep/high_priority_service.hpp:47(wsrep::high_priority_service::apply(wsrep::ws_handle const&, wsrep::ws_meta const&, wsrep::const_buffer const&))[0x55a555fbcddb] src/wsrep_provider_v26.cpp:460((anonymous namespace)::apply_cb(void*, wsrep_ws_handle const*, unsigned int, wsrep_buf const*, wsrep_trx_meta const*, bool*))[0x55a555fba68b] src/trx_handle.cpp:414(galera::TrxHandleSlave::apply(void*, wsrep_cb_status (*)(void*, wsrep_ws_handle const*, unsigned int, wsrep_buf const*, wsrep_trx_meta const*, bool*), wsrep_trx_meta const&, bool&))[0x7f4022fe43b1] src/replicator_smm.cpp:500(galera::ReplicatorSMM::apply_trx(void*, galera::TrxHandleSlave&))[0x7f4023016d92] src/replicator_smm.cpp:2137(galera::ReplicatorSMM::process_trx(void*, boost::shared_ptr const&))[0x7f402301ca40] src/gcs_action_source.cpp:63(galera::GcsActionSource::process_writeset(void*, gcs_action const&, bool&))[0x7f4022ffdc6b] src/gcs_action_source.cpp:109(galera::GcsActionSource::dispatch(void*, gcs_action const&, bool&))[0x7f4022ffde45] src/gcs_action_source.cpp:188(galera::GcsActionSource::process(void*, bool&))[0x7f4022ffe21d] src/replicator_smm.cpp:383(galera::ReplicatorSMM::async_recv(void*))[0x7f402301d033] src/wsrep_provider_v26.cpp:646(wsrep::wsrep_provider_v26::run_applier(wsrep::high_priority_service*))[0x55a555fbb20e] sql/wsrep_thd.cc:61(wsrep_replication_process(THD*, void*))[0x55a55565e2b4] sql/wsrep_mysqld.cc:2770(start_wsrep_THD(void*))[0x55a55564ff01] pthread_create.c:0(start_thread)[0x7f402b0ecdd5] /lib64/libc.so.6(clone+0x6d)[0x7f40294aaead] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x0): Connection ID (thread ID): 3 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. Writing a core file at /home/stepan/galera/git/10.4/server/mysql-test/var/mysqld.2/data/ ----------SERVER LOG END------------- - found 'core.41599' (0/5) Trying 'dbx' to get a backtrace Trying 'gdb' to get a backtrace from coredump /home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.galera_sr_log_bin-innodb/mysqld.2/data/core.41599 Core generated by '/home/stepan/galera/git/10.4/server/sql/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- [New LWP 41607] [New LWP 41790] [New LWP 41791] [New LWP 41793] [New LWP 41797] [New LWP 41800] [New LWP 41798] [New LWP 41803] [New LWP 41801] [New LWP 41806] [New LWP 41804] [New LWP 41808] [New LWP 41807] [New LWP 41811] [New LWP 41812] [New LWP 41813] [New LWP 41599] [New LWP 41787] [New LWP 41601] [New LWP 41792] [New LWP 41788] [New LWP 41605] [New LWP 41794] [New LWP 41604] [New LWP 41606] [New LWP 41799] [New LWP 41816] [New LWP 41802] [New LWP 41789] [New LWP 41810] [New LWP 41805] [New LWP 41603] [New LWP 41809] [New LWP 41602] [New LWP 41825] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `/home/stepan/galera/git/10.4/server/sql/mysqld --defaults-group-suffix=.2 --def'. Program terminated with signal 6, Aborted. #0 0x00007f402b0f19d1 in pthread_kill () from /lib64/libpthread.so.0 #0 0x00007f402b0f19d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x000055a555f0237a in my_write_core (sig=6) at /home/stepan/galera/git/10.4/server/mysys/stacktrace.c:481 #2 0x000055a55573ed65 in handle_fatal_signal (sig=6) at /home/stepan/galera/git/10.4/server/sql/signal_handler.cc:305 #3 #4 0x00007f40293e3207 in raise () from /lib64/libc.so.6 #5 0x00007f40293e48f8 in abort () from /lib64/libc.so.6 #6 0x00007f40293dc026 in __assert_fail_base () from /lib64/libc.so.6 #7 0x00007f40293dc0d2 in __assert_fail () from /lib64/libc.so.6 #8 0x000055a555b7a401 in trx_rseg_update_wsrep_checkpoint (rseg_header=0x7f40104f8026 "", xid=0x55a558de9420, mtr=0x7f402047b290) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0rseg.cc:92 #9 0x000055a555b5f0b4 in trx_purge_add_undo_to_history (trx=0x7f4010c55140, undo=@0x7f4010c56160: 0x55a559019b30, mtr=0x7f402047b290) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0purge.cc:286 #10 0x000055a555b84243 in trx_write_serialisation_history (trx=0x7f4010c55140, mtr=0x7f402047b290) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0trx.cc:1092 #11 0x000055a555b85d23 in trx_commit_low (trx=0x7f4010c55140, mtr=0x7f402047b290) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0trx.cc:1503 #12 0x000055a555b85e75 in trx_commit (trx=0x7f4010c55140) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0trx.cc:1570 #13 0x000055a555b8627f in trx_commit_for_mysql (trx=0x7f4010c55140) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0trx.cc:1706 #14 0x000055a55596a19c in innobase_commit_low (trx=0x7f4010c55140) at /home/stepan/galera/git/10.4/server/storage/innobase/handler/ha_innodb.cc:4371 #15 0x000055a55596a55c in innobase_commit_ordered_2 (trx=0x7f4010c55140, thd=0x7f3ffc000b00) at /home/stepan/galera/git/10.4/server/storage/innobase/handler/ha_innodb.cc:4493 #16 0x000055a55596a792 in innobase_commit_ordered (hton=0x55a558dc4b40, thd=0x7f3ffc000b00, all=true) at /home/stepan/galera/git/10.4/server/storage/innobase/handler/ha_innodb.cc:4553 #17 0x000055a55586dc52 in TC_LOG::run_commit_ordered (this=0x55a556c7f1c0 , thd=0x7f3ffc000b00, all=true) at /home/stepan/galera/git/10.4/server/sql/log.cc:8859 #18 0x000055a55586baeb in MYSQL_BIN_LOG::trx_group_commit_leader (this=0x55a556c7f1c0 , leader=0x7f402047bd00) at /home/stepan/galera/git/10.4/server/sql/log.cc:8109 #19 0x000055a55586a720 in MYSQL_BIN_LOG::write_transaction_to_binlog_events (this=0x55a556c7f1c0 , entry=0x7f402047bd00) at /home/stepan/galera/git/10.4/server/sql/log.cc:7700 #20 0x000055a555869d03 in MYSQL_BIN_LOG::write_transaction_to_binlog (this=0x55a556c7f1c0 , thd=0x7f3ffc000b00, cache_mngr=0x7f3ffc065ea0, end_ev=0x7f402047bea0, all=true, using_stmt_cache=true, using_trx_cache=true) at /home/stepan/galera/git/10.4/server/sql/log.cc:7370 #21 0x000055a555859e9e in binlog_flush_cache (thd=0x7f3ffc000b00, cache_mngr=0x7f3ffc065ea0, end_ev=0x7f402047bea0, all=true, using_stmt=true, using_trx=true) at /home/stepan/galera/git/10.4/server/sql/log.cc:1787 #22 0x000055a55585a4dc in binlog_commit_flush_xid_caches (thd=0x7f3ffc000b00, cache_mngr=0x7f3ffc065ea0, all=true, xid=11) at /home/stepan/galera/git/10.4/server/sql/log.cc:1893 #23 0x000055a55586fed7 in MYSQL_BIN_LOG::log_and_order (this=0x55a556c7f1c0 , thd=0x7f3ffc000b00, xid=11, all=true, need_prepare_ordered=false, need_commit_ordered=true) at /home/stepan/galera/git/10.4/server/sql/log.cc:9642 #24 0x000055a555743e2a in ha_commit_trans (thd=0x7f3ffc000b00, all=true) at /home/stepan/galera/git/10.4/server/sql/handler.cc:1591 #25 0x000055a555589a76 in trans_commit (thd=0x7f3ffc000b00) at /home/stepan/galera/git/10.4/server/sql/transaction.cc:313 #26 0x000055a55563d3cb in Wsrep_high_priority_service::commit (this=0x7f402047e4d0, ws_handle=..., ws_meta=...) at /home/stepan/galera/git/10.4/server/sql/wsrep_high_priority_service.cc:318 #27 0x000055a555fa51a6 in apply_write_set (server_state=..., high_priority_service=..., ws_handle=..., ws_meta=..., data=...) at /home/stepan/galera/git/10.4/server/wsrep-lib/src/server_state.cpp:194 #28 0x000055a555fa8731 in wsrep::server_state::on_apply (this=0x55a558c5f7d0, high_priority_service=..., ws_handle=..., ws_meta=..., data=...) at /home/stepan/galera/git/10.4/server/wsrep-lib/src/server_state.cpp:923 #29 0x000055a555fbcddb in wsrep::high_priority_service::apply (this=0x7f402047e4d0, ws_handle=..., ws_meta=..., data=...) at /home/stepan/galera/git/10.4/server/wsrep-lib/include/wsrep/high_priority_service.hpp:46 #30 0x000055a555fba68b in (anonymous namespace)::apply_cb (ctx=0x7f402047e4d0, wsh=0x7f402047d3e0, flags=65, buf=0x7f402047d420, meta=0x7f402047d6b0, exit_loop=0x7f402047d5ef) at /home/stepan/galera/git/10.4/server/wsrep-lib/src/wsrep_provider_v26.cpp:460 #31 0x00007f4022fe43b1 in galera::TrxHandleSlave::apply (this=this@entry=0x7f3ffc0263d0, recv_ctx=recv_ctx@entry=0x7f402047e4d0, apply_cb=0x55a555fba468 <(anonymous namespace)::apply_cb(void*, wsrep_ws_handle_t const*, uint32_t, wsrep_buf_t const*, wsrep_trx_meta_t const*, wsrep_bool_t*)>, meta=..., exit_loop=exit_loop@entry=@0x7f402047d5ef: false) at galera/src/trx_handle.cpp:418 #32 0x00007f4023016d92 in galera::ReplicatorSMM::apply_trx (this=this@entry=0x55a558c95250, recv_ctx=recv_ctx@entry=0x7f402047e4d0, ts=...) at galera/src/replicator_smm.cpp:489 #33 0x00007f402301ca40 in galera::ReplicatorSMM::process_trx (this=0x55a558c95250, recv_ctx=0x7f402047e4d0, ts_ptr=...) at galera/src/replicator_smm.cpp:2116 #34 0x00007f4022ffdc6b in galera::GcsActionSource::process_writeset (this=this@entry=0x55a558cd5ec0, recv_ctx=0x7f402047e4d0, act=..., exit_loop=@0x7f402047e29e: false) at galera/src/gcs_action_source.cpp:62 #35 0x00007f4022ffde45 in galera::GcsActionSource::dispatch (this=this@entry=0x55a558cd5ec0, recv_ctx=recv_ctx@entry=0x7f402047e4d0, act=..., exit_loop=@0x7f402047e29e: false) at galera/src/gcs_action_source.cpp:109 #36 0x00007f4022ffe21d in galera::GcsActionSource::process (this=0x55a558cd5ec0, recv_ctx=0x7f402047e4d0, exit_loop=@0x7f402047e29e: false) at galera/src/gcs_action_source.cpp:182 #37 0x00007f402301d033 in galera::ReplicatorSMM::async_recv (this=0x55a558c95250, recv_ctx=0x7f402047e4d0) at galera/src/replicator_smm.cpp:383 #38 0x000055a555fbb20e in wsrep::wsrep_provider_v26::run_applier (this=0x55a558c0aee0, applier_ctx=0x7f402047e4d0) at /home/stepan/galera/git/10.4/server/wsrep-lib/src/wsrep_provider_v26.cpp:646 #39 0x000055a55565e2b4 in wsrep_replication_process (thd=0x7f3ffc000b00, arg=0x0) at /home/stepan/galera/git/10.4/server/sql/wsrep_thd.cc:61 #40 0x000055a55564ff01 in start_wsrep_THD (arg=0x55a558cf5b40) at /home/stepan/galera/git/10.4/server/sql/wsrep_mysqld.cc:2768 #41 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #42 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 35 (Thread 0x7f4010122700 (LWP 41825)): #0 0x00007f40294a020d in poll () from /lib64/libc.so.6 #1 0x000055a555f7361e in vio_io_wait (vio=0x55a559184050, event=VIO_IO_EVENT_READ, timeout=28800000) at /home/stepan/galera/git/10.4/server/vio/viosocket.c:976 #2 0x000055a555f71c3e in vio_socket_io_wait (vio=0x55a559184050, event=VIO_IO_EVENT_READ) at /home/stepan/galera/git/10.4/server/vio/viosocket.c:118 #3 0x000055a555f71e24 in vio_read (vio=0x55a559184050, buf=0x7f3f9400a550 "\a", size=4) at /home/stepan/galera/git/10.4/server/vio/viosocket.c:195 #4 0x000055a5558a78bc in my_real_read (net=0x7f3f94000df8, complen=0x7f4010121810, header=1 '\001') at /home/stepan/galera/git/10.4/server/sql/net_serv.cc:962 #5 0x000055a5558a8143 in my_net_read_packet_reallen (net=0x7f3f94000df8, read_from_server=1 '\001', reallen=0x7f4010121878) at /home/stepan/galera/git/10.4/server/sql/net_serv.cc:1243 #6 0x000055a5558a80f6 in my_net_read_packet (net=0x7f3f94000df8, read_from_server=1 '\001') at /home/stepan/galera/git/10.4/server/sql/net_serv.cc:1227 #7 0x000055a555403ed2 in do_command (thd=0x7f3f94000b00) at /home/stepan/galera/git/10.4/server/sql/sql_parse.cc:1229 #8 0x000055a555574c50 in do_handle_one_connection (connect=0x55a55916a220) at /home/stepan/galera/git/10.4/server/sql/sql_connect.cc:1398 #9 0x000055a555574994 in handle_one_connection (arg=0x55a55916a220) at /home/stepan/galera/git/10.4/server/sql/sql_connect.cc:1301 #10 0x000055a555e9a471 in pfs_spawn_thread (arg=0x55a559184540) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #11 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #12 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 34 (Thread 0x7f4022999700 (LWP 41602)): #0 0x00007f402b0f0965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f4022ffafd7 in gu::Lock::wait (cond=..., this=0x7f4022998bf0) at galerautils/src/gu_lock.hpp:45 #2 0x00007f4022ffb069 in galera::ServiceThd::thd_func (arg=0x55a558c95968) at galera/src/galera_service_thd.cpp:30 #3 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 33 (Thread 0x7f3fd1ffb700 (LWP 41809)): #0 0x00007f402b0f0965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555a48889 in os_event::wait (this=0x55a558df0960) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:159 #2 0x000055a555a4830f in os_event::wait_low (this=0x55a558df0960, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:326 #3 0x000055a555a48680 in os_event_wait_low (event=0x55a558df0960, reset_sig_count=0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:515 #4 0x000055a555bfd8b3 in buf_resize_thread () at /home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0buf.cc:3092 #5 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 32 (Thread 0x7f4013ffe700 (LWP 41603)): #0 0x00007f40294ab483 in epoll_wait () from /lib64/libc.so.6 #1 0x00007f4022f9c6f8 in asio::detail::epoll_reactor::run (this=0x55a558cde060, block=block@entry=true, ops=...) at asio/asio/detail/impl/epoll_reactor.ipp:391 #2 0x00007f4022fa0df0 in asio::detail::task_io_service::do_run_one (this=this@entry=0x55a558cddf00, lock=..., this_thread=..., ec=...) at asio/asio/detail/impl/task_io_service.ipp:355 #3 0x00007f4022fa10a2 in asio::detail::task_io_service::run (this=0x55a558cddf00, ec=...) at asio/asio/detail/impl/task_io_service.ipp:148 #4 0x00007f4022fb8afd in asio::io_service::run (this=0x55a558cdcc20) at asio/asio/impl/io_service.ipp:58 #5 0x00007f4022fb9251 in gcomm::AsioProtonet::event_loop (this=0x55a558cdcb80, period=...) at gcomm/src/asio_protonet.cpp:116 #6 0x00007f4022fd72ed in GCommConn::run (this=0x55a558cdd690) at gcs/src/gcs_gcomm.cpp:498 #7 0x00007f4022fda399 in GCommConn::run_fn (arg=) at gcs/src/gcs_gcomm.cpp:209 #8 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #9 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 31 (Thread 0x7f3fd37fe700 (LWP 41805)): #0 0x00007f402b0f0965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555a48889 in os_event::wait (this=0x55a558df05e0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:159 #2 0x000055a555a4830f in os_event::wait_low (this=0x55a558df05e0, reset_sig_count=45) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:326 #3 0x000055a555a48680 in os_event_wait_low (event=0x55a558df05e0, reset_sig_count=0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:515 #4 0x000055a555b345ff in srv_resume_thread (slot=0x55a556a85580 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:903 #5 0x000055a555b38203 in srv_worker_thread (arg=0x0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:2485 #6 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 30 (Thread 0x7f3fd17fa700 (LWP 41810)): #0 0x00007f402b0f0965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555f079a9 in safe_cond_wait (cond=0x7f3fd17f9c70, mp=0x7f3fd17f9cb0, file=0x55a5561d4860 "/home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/galera/git/10.4/server/mysys/thr_mutex.c:492 #2 0x000055a55595fa13 in inline_mysql_cond_wait (that=0x7f3fd17f9c70, mutex=0x7f3fd17f9cb0, src_file=0x55a5561d63a0 "/home/stepan/galera/git/10.4/server/storage/innobase/handler/ha_innodb.cc", src_line=289) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h:1178 #3 0x000055a555964632 in thd_destructor_proxy () at /home/stepan/galera/git/10.4/server/storage/innobase/handler/ha_innodb.cc:289 #4 0x000055a555e9a471 in pfs_spawn_thread (arg=0x55a558faa470) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #5 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 29 (Thread 0x7f40037fe700 (LWP 41789)): #0 0x00007f402acbd644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055a555a3bba6 in LinuxAIOHandler::collect (this=0x7f40037fdb00) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:1915 #2 0x000055a555a3c0cf in LinuxAIOHandler::poll (this=0x7f40037fdb00, m1=0x7f40037fdba8, m2=0x7f40037fdbb0, request=0x7f40037fdbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2060 #3 0x000055a555a3c232 in os_aio_linux_handler (global_segment=1, m1=0x7f40037fdba8, m2=0x7f40037fdbb0, request=0x7f40037fdbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2114 #4 0x000055a555a40d56 in os_aio_handler (segment=1, m1=0x7f40037fdba8, m2=0x7f40037fdbb0, request=0x7f40037fdbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:5667 #5 0x000055a555c94bc1 in fil_aio_wait (segment=1) at /home/stepan/galera/git/10.4/server/storage/innobase/fil/fil0fil.cc:4402 #6 0x000055a555b3a12f in io_handler_thread (arg=0x55a556cc3428 ) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0start.cc:325 #7 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 28 (Thread 0x7f3fe17fa700 (LWP 41802)): #0 0x00007f402b0f3e3d in nanosleep () from /lib64/libpthread.so.0 #1 0x000055a555a48b8b in os_thread_sleep (tm=1000000) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0thread.cc:225 #2 0x000055a555b37b67 in srv_master_sleep () at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:2311 #3 0x000055a555b37c97 in srv_master_thread (arg=0x0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:2352 #4 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 27 (Thread 0x7f401016d700 (LWP 41816)): #0 0x00007f402b0f34ed in __lll_lock_wait () from /lib64/libpthread.so.0 #1 0x00007f402b0eedcb in _L_lock_883 () from /lib64/libpthread.so.0 #2 0x00007f402b0eec98 in pthread_mutex_lock () from /lib64/libpthread.so.0 #3 0x000055a555f07170 in safe_mutex_lock (mp=0x55a556c808e0 , my_flags=0, file=0x55a5561a3810 "/home/stepan/galera/git/10.4/server/sql/log.cc", line=8057) at /home/stepan/galera/git/10.4/server/mysys/thr_mutex.c:293 #4 0x000055a5558546a7 in inline_mysql_mutex_lock (that=0x55a556c808e0 , src_file=0x55a5561a3810 "/home/stepan/galera/git/10.4/server/sql/log.cc", src_line=8057) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h:695 #5 0x000055a55586b8ec in MYSQL_BIN_LOG::trx_group_commit_leader (this=0x55a556c7f1c0 , leader=0x7f4010169f60) at /home/stepan/galera/git/10.4/server/sql/log.cc:8057 #6 0x000055a55586a720 in MYSQL_BIN_LOG::write_transaction_to_binlog_events (this=0x55a556c7f1c0 , entry=0x7f4010169f60) at /home/stepan/galera/git/10.4/server/sql/log.cc:7700 #7 0x000055a555869d03 in MYSQL_BIN_LOG::write_transaction_to_binlog (this=0x55a556c7f1c0 , thd=0x7f3ff000a040, cache_mngr=0x7f3ff007ed60, end_ev=0x7f401016a100, all=true, using_stmt_cache=true, using_trx_cache=true) at /home/stepan/galera/git/10.4/server/sql/log.cc:7370 #8 0x000055a555859e9e in binlog_flush_cache (thd=0x7f3ff000a040, cache_mngr=0x7f3ff007ed60, end_ev=0x7f401016a100, all=true, using_stmt=true, using_trx=true) at /home/stepan/galera/git/10.4/server/sql/log.cc:1787 #9 0x000055a55585a4dc in binlog_commit_flush_xid_caches (thd=0x7f3ff000a040, cache_mngr=0x7f3ff007ed60, all=true, xid=13) at /home/stepan/galera/git/10.4/server/sql/log.cc:1893 #10 0x000055a55586fed7 in MYSQL_BIN_LOG::log_and_order (this=0x55a556c7f1c0 , thd=0x7f3ff000a040, xid=13, all=true, need_prepare_ordered=false, need_commit_ordered=true) at /home/stepan/galera/git/10.4/server/sql/log.cc:9642 #11 0x000055a555743e2a in ha_commit_trans (thd=0x7f3ff000a040, all=true) at /home/stepan/galera/git/10.4/server/sql/handler.cc:1591 #12 0x000055a555589a76 in trans_commit (thd=0x7f3ff000a040) at /home/stepan/galera/git/10.4/server/sql/transaction.cc:313 #13 0x000055a55541361e in mysql_execute_command (thd=0x7f3ff000a040) at /home/stepan/galera/git/10.4/server/sql/sql_parse.cc:5825 #14 0x000055a55541a675 in mysql_parse (thd=0x7f3ff000a040, rawbuf=0x7f3ff0017388 "COMMIT", length=6, parser_state=0x7f401016c0b0, is_com_multi=false, is_next_command=false) at /home/stepan/galera/git/10.4/server/sql/sql_parse.cc:8117 #15 0x000055a555419ca8 in wsrep_mysql_parse (thd=0x7f3ff000a040, rawbuf=0x7f3ff0017388 "COMMIT", length=6, parser_state=0x7f401016c0b0, is_com_multi=false, is_next_command=false) at /home/stepan/galera/git/10.4/server/sql/sql_parse.cc:7929 #16 0x000055a555405b65 in dispatch_command (command=COM_QUERY, thd=0x7f3ff000a040, packet=0x7f3ff0028821 "COMMIT", packet_length=6, is_com_multi=false, is_next_command=false) at /home/stepan/galera/git/10.4/server/sql/sql_parse.cc:1787 #17 0x000055a555404599 in do_command (thd=0x7f3ff000a040) at /home/stepan/galera/git/10.4/server/sql/sql_parse.cc:1356 #18 0x000055a555574c50 in do_handle_one_connection (connect=0x55a55916a220) at /home/stepan/galera/git/10.4/server/sql/sql_connect.cc:1398 #19 0x000055a555574994 in handle_one_connection (arg=0x55a55916a220) at /home/stepan/galera/git/10.4/server/sql/sql_connect.cc:1301 #20 0x000055a555e9a471 in pfs_spawn_thread (arg=0x55a559184050) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #21 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #22 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 26 (Thread 0x7f3fe2ffd700 (LWP 41799)): #0 0x00007f402b0f0d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555a481a4 in os_event::timed_wait (this=0x55a558df07e0, abstime=0x7f3fe2ffcd20) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:276 #2 0x000055a555a484bb in os_event::wait_time_low (this=0x55a558df07e0, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:398 #3 0x000055a555a4865b in os_event_wait_time_low (event=0x55a558df07e0, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:498 #4 0x000055a555b362e6 in srv_monitor_thread () at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:1674 #5 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 25 (Thread 0x7f40204ca700 (LWP 41606)): #0 0x00007f402b0f0965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555f079a9 in safe_cond_wait (cond=0x7f3ff4016a38, mp=0x7f3ff4016988, file=0x55a556070a00 "/home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/galera/git/10.4/server/mysys/thr_mutex.c:492 #2 0x000055a55565dd06 in inline_mysql_cond_wait (that=0x7f3ff4016a38, mutex=0x7f3ff4016988, src_file=0x55a556070d20 "/home/stepan/galera/git/10.4/server/sql/wsrep_thd.h", src_line=69) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h:1178 #3 0x000055a55566099e in Wsrep_thd_queue::pop_front (this=0x7f3ff4016930) at /home/stepan/galera/git/10.4/server/sql/wsrep_thd.h:69 #4 0x000055a55565f77e in wsrep_post_rollback_process (post_rollbacker=0x7f3ff4000b00, arg=0x0) at /home/stepan/galera/git/10.4/server/sql/wsrep_thd.cc:285 #5 0x000055a55564ff01 in start_wsrep_THD (arg=0x55a558cfe6d0) at /home/stepan/galera/git/10.4/server/sql/wsrep_mysqld.cc:2768 #6 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 24 (Thread 0x7f40137fd700 (LWP 41604)): #0 0x00007f402b0f0965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x00007f4022fd5867 in gu::Lock::wait (cond=..., this=0x7f40137fc850) at galerautils/src/gu_lock.hpp:45 #2 0x00007f4022fd83ab in RecvBuf::front (this=this@entry=0x55a558cdd878, timeout=...) at gcs/src/gcs_gcomm.cpp:124 #3 0x00007f4022fd5f46 in gcomm_recv (backend=, msg=0x55a558c9d780, timeout=9223372035999999999) at gcs/src/gcs_gcomm.cpp:673 #4 0x00007f4022fc9eec in core_msg_recv (backend=backend@entry=0x55a558c9d8c8, recv_msg=recv_msg@entry=0x55a558c9d780, timeout=timeout@entry=9223372035999999999) at gcs/src/gcs_core.cpp:480 #5 0x00007f4022fcd164 in gcs_core_recv (conn=0x55a558c9d720, recv_act=recv_act@entry=0x7f40137fcd70, timeout=9223372035999999999) at gcs/src/gcs_core.cpp:1184 #6 0x00007f4022fd43d8 in gcs_recv_thread (arg=0x55a558c9d4a0) at gcs/src/gcs.cpp:1398 #7 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 23 (Thread 0x7f4000ff9700 (LWP 41794)): #0 0x00007f402b0f0965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555a48889 in os_event::wait (this=0x55a558edf080) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:159 #2 0x000055a555a4830f in os_event::wait_low (this=0x55a558edf080, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:326 #3 0x000055a555a48680 in os_event_wait_low (event=0x55a558edf080, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:515 #4 0x000055a555b4242e in sync_array_wait_event (arr=0x55a558dc79c0, cell=@0x7f4000ff8680: 0x55a558dc7b30) at /home/stepan/galera/git/10.4/server/storage/innobase/sync/sync0arr.cc:469 #5 0x000055a555b45cad in rw_lock_sx_lock_func (lock=0x7f401040a880, pass=2, file_name=0x55a5562d8c60 "/home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0flu.cc", line=1143) at /home/stepan/galera/git/10.4/server/storage/innobase/sync/sync0rw.cc:837 #6 0x000055a555c15765 in pfs_rw_lock_sx_lock_func (lock=0x7f401040a880, pass=2, file_name=0x55a5562d8c60 "/home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0flu.cc", line=1143) at /home/stepan/galera/git/10.4/server/storage/innobase/include/sync0rw.ic:686 #7 0x000055a555c19dee in buf_flush_page (buf_pool=0x55a558ed6060, bpage=0x7f401040a7b0, flush_type=BUF_FLUSH_LIST, sync=false) at /home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0flu.cc:1143 #8 0x000055a555c1a838 in buf_flush_try_neighbors (page_id=..., flush_type=BUF_FLUSH_LIST, n_flushed=18, n_to_flush=200) at /home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0flu.cc:1388 #9 0x000055a555c1abbb in buf_flush_page_and_try_neighbors (bpage=0x7f401040a7b0, flush_type=BUF_FLUSH_LIST, n_to_flush=200, count=0x7f4000ff88b8) at /home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0flu.cc:1460 #10 0x000055a555c1b7d4 in buf_do_flush_list_batch (buf_pool=0x55a558ed6060, min_n=200, lsn_limit=18446744073709551615) at /home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0flu.cc:1718 #11 0x000055a555c1bdcc in buf_flush_batch (buf_pool=0x55a558ed6060, flush_type=BUF_FLUSH_LIST, min_n=200, lsn_limit=18446744073709551615, n=0x7f4000ff8b60) at /home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0flu.cc:1788 #12 0x000055a555c1c48c in buf_flush_do_batch (buf_pool=0x55a558ed6060, type=BUF_FLUSH_LIST, min_n=200, lsn_limit=18446744073709551615, n=0x7f4000ff8b60) at /home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0flu.cc:1946 #13 0x000055a555c1c760 in buf_flush_lists (min_n=200, lsn_limit=18446744073709551615, n_processed=0x7f4000ff8bd0) at /home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0flu.cc:2052 #14 0x000055a555c204ab in buf_flush_page_cleaner_coordinator () at /home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0flu.cc:3204 #15 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #16 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 22 (Thread 0x7f4020515700 (LWP 41605)): #0 0x00007f402b0f0965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555f079a9 in safe_cond_wait (cond=0x7f4008016978, mp=0x7f40080168c8, file=0x55a556070a00 "/home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h", line=1178) at /home/stepan/galera/git/10.4/server/mysys/thr_mutex.c:492 #2 0x000055a55565dd06 in inline_mysql_cond_wait (that=0x7f4008016978, mutex=0x7f40080168c8, src_file=0x55a556070d20 "/home/stepan/galera/git/10.4/server/sql/wsrep_thd.h", src_line=69) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h:1178 #3 0x000055a55566099e in Wsrep_thd_queue::pop_front (this=0x7f4008016870) at /home/stepan/galera/git/10.4/server/sql/wsrep_thd.h:69 #4 0x000055a55565f3be in wsrep_rollback_process (rollbacker=0x7f4008001d50, arg=0x0) at /home/stepan/galera/git/10.4/server/sql/wsrep_thd.cc:143 #5 0x000055a55564ff01 in start_wsrep_THD (arg=0x55a558cfeba0) at /home/stepan/galera/git/10.4/server/sql/wsrep_mysqld.cc:2768 #6 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 21 (Thread 0x7f4003fff700 (LWP 41788)): #0 0x00007f402acbd644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055a555a3bba6 in LinuxAIOHandler::collect (this=0x7f4003ffeb00) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:1915 #2 0x000055a555a3c0cf in LinuxAIOHandler::poll (this=0x7f4003ffeb00, m1=0x7f4003ffeba8, m2=0x7f4003ffebb0, request=0x7f4003ffebe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2060 #3 0x000055a555a3c232 in os_aio_linux_handler (global_segment=0, m1=0x7f4003ffeba8, m2=0x7f4003ffebb0, request=0x7f4003ffebe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2114 #4 0x000055a555a40d56 in os_aio_handler (segment=0, m1=0x7f4003ffeba8, m2=0x7f4003ffebb0, request=0x7f4003ffebe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:5667 #5 0x000055a555c94bc1 in fil_aio_wait (segment=0) at /home/stepan/galera/git/10.4/server/storage/innobase/fil/fil0fil.cc:4402 #6 0x000055a555b3a12f in io_handler_thread (arg=0x55a556cc3420 ) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0start.cc:325 #7 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 20 (Thread 0x7f4001ffb700 (LWP 41792)): #0 0x00007f402acbd644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055a555a3bba6 in LinuxAIOHandler::collect (this=0x7f4001ffab00) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:1915 #2 0x000055a555a3c0cf in LinuxAIOHandler::poll (this=0x7f4001ffab00, m1=0x7f4001ffaba8, m2=0x7f4001ffabb0, request=0x7f4001ffabe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2060 #3 0x000055a555a3c232 in os_aio_linux_handler (global_segment=4, m1=0x7f4001ffaba8, m2=0x7f4001ffabb0, request=0x7f4001ffabe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2114 #4 0x000055a555a40d56 in os_aio_handler (segment=4, m1=0x7f4001ffaba8, m2=0x7f4001ffabb0, request=0x7f4001ffabe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:5667 #5 0x000055a555c94bc1 in fil_aio_wait (segment=4) at /home/stepan/galera/git/10.4/server/storage/innobase/fil/fil0fil.cc:4402 #6 0x000055a555b3a12f in io_handler_thread (arg=0x55a556cc3440 ) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0start.cc:325 #7 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7f4023b45700 (LWP 41601)): #0 0x00007f402b0f0d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555f07cab in safe_cond_timedwait (cond=0x55a5574e7440 , mp=0x55a5574e7380 , abstime=0x7f4023b44d70, file=0x55a556391360 "/home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/galera/git/10.4/server/mysys/thr_mutex.c:546 #2 0x000055a555f08c65 in inline_mysql_cond_timedwait (that=0x55a5574e7440 , mutex=0x55a5574e7380 , abstime=0x7f4023b44d70, src_file=0x55a5563913a8 "/home/stepan/galera/git/10.4/server/mysys/thr_timer.c", src_line=292) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h:1204 #3 0x000055a555f097c8 in timer_handler (arg=0x0) at /home/stepan/galera/git/10.4/server/mysys/thr_timer.c:292 #4 0x000055a555e9a471 in pfs_spawn_thread (arg=0x55a558c5e860) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #5 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7f4011855700 (LWP 41787)): #0 0x00007f402b0f0d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555f07cab in safe_cond_timedwait (cond=0x55a5574d4ca0 , mp=0x55a5574d4be0 , abstime=0x7f4011854cb0, file=0x55a55634d130 "/home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h", line=1204) at /home/stepan/galera/git/10.4/server/mysys/thr_mutex.c:546 #2 0x000055a555d71add in inline_mysql_cond_timedwait (that=0x55a5574d4ca0 , mutex=0x55a5574d4be0 , abstime=0x7f4011854cb0, src_file=0x55a55634d178 "/home/stepan/galera/git/10.4/server/storage/maria/ma_servicethread.c", src_line=116) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h:1204 #3 0x000055a555d72001 in my_service_thread_sleep (control=0x55a556a89900 , sleep_time=29000000000) at /home/stepan/galera/git/10.4/server/storage/maria/ma_servicethread.c:115 #4 0x000055a555d6649a in ma_checkpoint_background (arg=0x1e) at /home/stepan/galera/git/10.4/server/storage/maria/ma_checkpoint.c:707 #5 0x000055a555e9a471 in pfs_spawn_thread (arg=0x55a558da89d0) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #6 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 17 (Thread 0x7f402b4fd880 (LWP 41599)): #0 0x00007f40294a020d in poll () from /lib64/libc.so.6 #1 0x000055a5552e096a in handle_connections_sockets () at /home/stepan/galera/git/10.4/server/sql/mysqld.cc:6417 #2 0x000055a5552dfc05 in mysqld_main (argc=164, argv=0x55a558b16d20) at /home/stepan/galera/git/10.4/server/sql/mysqld.cc:5853 #3 0x000055a5552d3da5 in main (argc=25, argv=0x7ffc6f439f08) at /home/stepan/galera/git/10.4/server/sql/main.cc:25 Thread 16 (Thread 0x7f40101b8700 (LWP 41813)): #0 0x00007f402b0f0965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555f079a9 in safe_cond_wait (cond=0x55a556c47fe0 , mp=0x55a556c4b360 , file=0x55a555fd1b48 "/home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h", line=1167) at /home/stepan/galera/git/10.4/server/mysys/thr_mutex.c:492 #2 0x000055a5553053ce in inline_mysql_cond_wait (that=0x55a556c47fe0 , mutex=0x55a556c4b360 , src_file=0x55a555fd26b0 "/home/stepan/galera/git/10.4/server/sql/slave.cc", src_line=519) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h:1167 #3 0x000055a555306c60 in handle_slave_background (arg=0x0) at /home/stepan/galera/git/10.4/server/sql/slave.cc:519 #4 0x000055a555e9a471 in pfs_spawn_thread (arg=0x55a5590a8c20) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #5 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7f4010203700 (LWP 41812)): #0 0x00007f40293e440a in sigwaitinfo () from /lib64/libc.so.6 #1 0x000055a5552d3e24 in my_sigwait (set=0x7f4010202cf0, sig=0x7f4010202cb4, code=0x7f4010202cb8) at /home/stepan/galera/git/10.4/server/include/my_pthread.h:196 #2 0x000055a5552da464 in signal_hand (arg=0x0) at /home/stepan/galera/git/10.4/server/sql/mysqld.cc:3233 #3 0x000055a555e9a471 in pfs_spawn_thread (arg=0x55a559069a90) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #4 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7f4020070700 (LWP 41811)): #0 0x00007f402b0f0965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555f079a9 in safe_cond_wait (cond=0x55a556c80248 , mp=0x55a556c80198 , file=0x55a5561a2e08 "/home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h", line=1167) at /home/stepan/galera/git/10.4/server/mysys/thr_mutex.c:492 #2 0x000055a555854be4 in inline_mysql_cond_wait (that=0x55a556c80248 , mutex=0x55a556c80198 , src_file=0x55a5561a3810 "/home/stepan/galera/git/10.4/server/sql/log.cc", src_line=9926) at /home/stepan/galera/git/10.4/server/include/mysql/psi/mysql_thread.h:1167 #3 0x000055a555870aac in binlog_background_thread (arg=0x0) at /home/stepan/galera/git/10.4/server/sql/log.cc:9926 #4 0x000055a555e9a471 in pfs_spawn_thread (arg=0x55a559045900) at /home/stepan/galera/git/10.4/server/storage/perfschema/pfs.cc:1862 #5 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7f3fd2ffd700 (LWP 41807)): #0 0x00007f402b0f0965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555a48889 in os_event::wait (this=0x55a558df0860) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:159 #2 0x000055a555a4830f in os_event::wait_low (this=0x55a558df0860, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:326 #3 0x000055a555a48680 in os_event_wait_low (event=0x55a558df0860, reset_sig_count=0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:515 #4 0x000055a555c14dde in buf_dump_thread () at /home/stepan/galera/git/10.4/server/storage/innobase/buf/buf0dump.cc:835 #5 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7f3fd27fc700 (LWP 41808)): #0 0x00007f402b0f3e3d in nanosleep () from /lib64/libpthread.so.0 #1 0x000055a555a48b8b in os_thread_sleep (tm=1000000) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0thread.cc:225 #2 0x000055a555bef755 in btr_defragment_thread () at /home/stepan/galera/git/10.4/server/storage/innobase/btr/btr0defragment.cc:702 #3 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7f3fd3fff700 (LWP 41804)): #0 0x00007f402b0f0965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555a48889 in os_event::wait (this=0x55a558df06e0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:159 #2 0x000055a555a4830f in os_event::wait_low (this=0x55a558df06e0, reset_sig_count=41) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:326 #3 0x000055a555a48680 in os_event_wait_low (event=0x55a558df06e0, reset_sig_count=0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:515 #4 0x000055a555b345ff in srv_resume_thread (slot=0x55a556a855f0 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:903 #5 0x000055a555b38203 in srv_worker_thread (arg=0x0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:2485 #6 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7f3fcbfff700 (LWP 41806)): #0 0x00007f402b0f0965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555a48889 in os_event::wait (this=0x55a558df0660) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:159 #2 0x000055a555a4830f in os_event::wait_low (this=0x55a558df0660, reset_sig_count=32) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:326 #3 0x000055a555a48680 in os_event_wait_low (event=0x55a558df0660, reset_sig_count=0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:515 #4 0x000055a555b345ff in srv_resume_thread (slot=0x55a556a855b8 , sig_count=0, wait=true, timeout_usec=0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:903 #5 0x000055a555b38203 in srv_worker_thread (arg=0x0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:2485 #6 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7f3fe1ffb700 (LWP 41801)): #0 0x00007f402b0f0d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555a481a4 in os_event::timed_wait (this=0x55a558f982d0, abstime=0x7f3fe1ffab60) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:276 #2 0x000055a555a484bb in os_event::wait_time_low (this=0x55a558f982d0, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:398 #3 0x000055a555a4865b in os_event_wait_time_low (event=0x55a558f982d0, time_in_usec=5000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:498 #4 0x000055a555b96aad in ib_wqueue_timedwait (wq=0x55a558f97a60, wait_in_usecs=5000000) at /home/stepan/galera/git/10.4/server/storage/innobase/ut/ut0wqueue.cc:163 #5 0x000055a555cd8f11 in fts_optimize_thread (arg=0x55a558f97a60) at /home/stepan/galera/git/10.4/server/storage/innobase/fts/fts0opt.cc:2897 #6 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7f3fe0ff9700 (LWP 41803)): #0 0x00007f402b0f0965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555a48889 in os_event::wait (this=0x55a559019a80) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:159 #2 0x000055a555a4830f in os_event::wait_low (this=0x55a559019a80, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:326 #3 0x000055a555a48680 in os_event_wait_low (event=0x55a559019a80, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:515 #4 0x000055a555b4242e in sync_array_wait_event (arr=0x55a558dc79c0, cell=@0x7f3fe0ff85d0: 0x55a558dc7ab0) at /home/stepan/galera/git/10.4/server/storage/innobase/sync/sync0arr.cc:469 #5 0x000055a555993a9d in TTASEventMutex::enter (this=0x55a559019928, max_spins=60, max_delay=4, filename=0x55a5562947b0 "/home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0purge.cc", line=108) at /home/stepan/galera/git/10.4/server/storage/innobase/include/ib0mutex.h:478 #6 0x000055a555991cf8 in PolicyMutex >::enter (this=0x55a559019928, n_spins=30, n_delay=4, name=0x55a5562947b0 "/home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0purge.cc", line=108) at /home/stepan/galera/git/10.4/server/storage/innobase/include/ib0mutex.h:595 #7 0x000055a555b6368e in TrxUndoRsegsIterator::set_next (this=0x55a556a86018 ) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0purge.cc:108 #8 0x000055a555b61881 in trx_purge_choose_next_log () at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0purge.cc:969 #9 0x000055a555b61ad7 in trx_purge_get_next_rec (n_pages_handled=0x7f3fe0ff8ca0, heap=0x55a559015f10) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0purge.cc:1042 #10 0x000055a555b61d20 in trx_purge_fetch_next_rec (roll_ptr=0x55a559015fa0, n_pages_handled=0x7f3fe0ff8ca0, heap=0x55a559015f10) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0purge.cc:1112 #11 0x000055a555b62047 in trx_purge_attach_undo_recs (n_purge_threads=4) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0purge.cc:1185 #12 0x000055a555b6252d in trx_purge (n_purge_threads=4, truncate=false) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0purge.cc:1313 #13 0x000055a555b384d6 in srv_do_purge (n_total_purged=0x7f3fe0ff8d98) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:2579 #14 0x000055a555b38903 in srv_purge_coordinator_thread (arg=0x0) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:2702 #15 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #16 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7f3fe3fff700 (LWP 41798)): #0 0x00007f402b0f0d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555a481a4 in os_event::timed_wait (this=0x55a558df0760, abstime=0x7f3fe3ffeba0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:276 #2 0x000055a555a484bb in os_event::wait_time_low (this=0x55a558df0760, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:398 #3 0x000055a555a4865b in os_event_wait_time_low (event=0x55a558df0760, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:498 #4 0x000055a555b36808 in srv_error_monitor_thread () at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0srv.cc:1838 #5 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7f3fe27fc700 (LWP 41800)): #0 0x00007f402b0f0d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555a481a4 in os_event::timed_wait (this=0x55a558ffacd0, abstime=0x7f3fe27fbd60) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:276 #2 0x000055a555a484bb in os_event::wait_time_low (this=0x55a558ffacd0, time_in_usec=10000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:398 #3 0x000055a555a4865b in os_event_wait_time_low (event=0x55a558ffacd0, time_in_usec=10000000, reset_sig_count=0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:498 #4 0x000055a555c7e52c in dict_stats_thread () at /home/stepan/galera/git/10.4/server/storage/innobase/dict/dict0stats_bg.cc:460 #5 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7f3fe37fe700 (LWP 41797)): #0 0x00007f402b0f0d12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a555a481a4 in os_event::timed_wait (this=0x55a558fc8cb0, abstime=0x7f3fe37fdd40) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:276 #2 0x000055a555a484bb in os_event::wait_time_low (this=0x55a558fc8cb0, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:398 #3 0x000055a555a4865b in os_event_wait_time_low (event=0x55a558fc8cb0, time_in_usec=1000000, reset_sig_count=1) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0event.cc:498 #4 0x000055a555a15314 in lock_wait_timeout_thread () at /home/stepan/galera/git/10.4/server/storage/innobase/lock/lock0wait.cc:543 #5 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7f40017fa700 (LWP 41793)): #0 0x00007f402acbd644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055a555a3bba6 in LinuxAIOHandler::collect (this=0x7f40017f9b00) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:1915 #2 0x000055a555a3c0cf in LinuxAIOHandler::poll (this=0x7f40017f9b00, m1=0x7f40017f9ba8, m2=0x7f40017f9bb0, request=0x7f40017f9be0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2060 #3 0x000055a555a3c232 in os_aio_linux_handler (global_segment=5, m1=0x7f40017f9ba8, m2=0x7f40017f9bb0, request=0x7f40017f9be0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2114 #4 0x000055a555a40d56 in os_aio_handler (segment=5, m1=0x7f40017f9ba8, m2=0x7f40017f9bb0, request=0x7f40017f9be0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:5667 #5 0x000055a555c94bc1 in fil_aio_wait (segment=5) at /home/stepan/galera/git/10.4/server/storage/innobase/fil/fil0fil.cc:4402 #6 0x000055a555b3a12f in io_handler_thread (arg=0x55a556cc3448 ) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0start.cc:325 #7 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7f40027fc700 (LWP 41791)): #0 0x00007f402acbd644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055a555a3bba6 in LinuxAIOHandler::collect (this=0x7f40027fbb00) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:1915 #2 0x000055a555a3c0cf in LinuxAIOHandler::poll (this=0x7f40027fbb00, m1=0x7f40027fbba8, m2=0x7f40027fbbb0, request=0x7f40027fbbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2060 #3 0x000055a555a3c232 in os_aio_linux_handler (global_segment=3, m1=0x7f40027fbba8, m2=0x7f40027fbbb0, request=0x7f40027fbbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2114 #4 0x000055a555a40d56 in os_aio_handler (segment=3, m1=0x7f40027fbba8, m2=0x7f40027fbbb0, request=0x7f40027fbbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:5667 #5 0x000055a555c94bc1 in fil_aio_wait (segment=3) at /home/stepan/galera/git/10.4/server/storage/innobase/fil/fil0fil.cc:4402 #6 0x000055a555b3a12f in io_handler_thread (arg=0x55a556cc3438 ) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0start.cc:325 #7 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7f4002ffd700 (LWP 41790)): #0 0x00007f402acbd644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x000055a555a3bba6 in LinuxAIOHandler::collect (this=0x7f4002ffcb00) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:1915 #2 0x000055a555a3c0cf in LinuxAIOHandler::poll (this=0x7f4002ffcb00, m1=0x7f4002ffcba8, m2=0x7f4002ffcbb0, request=0x7f4002ffcbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2060 #3 0x000055a555a3c232 in os_aio_linux_handler (global_segment=2, m1=0x7f4002ffcba8, m2=0x7f4002ffcbb0, request=0x7f4002ffcbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:2114 #4 0x000055a555a40d56 in os_aio_handler (segment=2, m1=0x7f4002ffcba8, m2=0x7f4002ffcbb0, request=0x7f4002ffcbe0) at /home/stepan/galera/git/10.4/server/storage/innobase/os/os0file.cc:5667 #5 0x000055a555c94bc1 in fil_aio_wait (segment=2) at /home/stepan/galera/git/10.4/server/storage/innobase/fil/fil0fil.cc:4402 #6 0x000055a555b3a12f in io_handler_thread (arg=0x55a556cc3430 ) at /home/stepan/galera/git/10.4/server/storage/innobase/srv/srv0start.cc:325 #7 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #8 0x00007f40294aaead in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7f402047f700 (LWP 41607)): #0 0x00007f402b0f19d1 in pthread_kill () from /lib64/libpthread.so.0 #1 0x000055a555f0237a in my_write_core (sig=6) at /home/stepan/galera/git/10.4/server/mysys/stacktrace.c:481 #2 0x000055a55573ed65 in handle_fatal_signal (sig=6) at /home/stepan/galera/git/10.4/server/sql/signal_handler.cc:305 #3 #4 0x00007f40293e3207 in raise () from /lib64/libc.so.6 #5 0x00007f40293e48f8 in abort () from /lib64/libc.so.6 #6 0x00007f40293dc026 in __assert_fail_base () from /lib64/libc.so.6 #7 0x00007f40293dc0d2 in __assert_fail () from /lib64/libc.so.6 #8 0x000055a555b7a401 in trx_rseg_update_wsrep_checkpoint (rseg_header=0x7f40104f8026 "", xid=0x55a558de9420, mtr=0x7f402047b290) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0rseg.cc:92 #9 0x000055a555b5f0b4 in trx_purge_add_undo_to_history (trx=0x7f4010c55140, undo=@0x7f4010c56160: 0x55a559019b30, mtr=0x7f402047b290) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0purge.cc:286 #10 0x000055a555b84243 in trx_write_serialisation_history (trx=0x7f4010c55140, mtr=0x7f402047b290) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0trx.cc:1092 #11 0x000055a555b85d23 in trx_commit_low (trx=0x7f4010c55140, mtr=0x7f402047b290) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0trx.cc:1503 #12 0x000055a555b85e75 in trx_commit (trx=0x7f4010c55140) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0trx.cc:1570 #13 0x000055a555b8627f in trx_commit_for_mysql (trx=0x7f4010c55140) at /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0trx.cc:1706 #14 0x000055a55596a19c in innobase_commit_low (trx=0x7f4010c55140) at /home/stepan/galera/git/10.4/server/storage/innobase/handler/ha_innodb.cc:4371 #15 0x000055a55596a55c in innobase_commit_ordered_2 (trx=0x7f4010c55140, thd=0x7f3ffc000b00) at /home/stepan/galera/git/10.4/server/storage/innobase/handler/ha_innodb.cc:4493 #16 0x000055a55596a792 in innobase_commit_ordered (hton=0x55a558dc4b40, thd=0x7f3ffc000b00, all=true) at /home/stepan/galera/git/10.4/server/storage/innobase/handler/ha_innodb.cc:4553 #17 0x000055a55586dc52 in TC_LOG::run_commit_ordered (this=0x55a556c7f1c0 , thd=0x7f3ffc000b00, all=true) at /home/stepan/galera/git/10.4/server/sql/log.cc:8859 #18 0x000055a55586baeb in MYSQL_BIN_LOG::trx_group_commit_leader (this=0x55a556c7f1c0 , leader=0x7f402047bd00) at /home/stepan/galera/git/10.4/server/sql/log.cc:8109 #19 0x000055a55586a720 in MYSQL_BIN_LOG::write_transaction_to_binlog_events (this=0x55a556c7f1c0 , entry=0x7f402047bd00) at /home/stepan/galera/git/10.4/server/sql/log.cc:7700 #20 0x000055a555869d03 in MYSQL_BIN_LOG::write_transaction_to_binlog (this=0x55a556c7f1c0 , thd=0x7f3ffc000b00, cache_mngr=0x7f3ffc065ea0, end_ev=0x7f402047bea0, all=true, using_stmt_cache=true, using_trx_cache=true) at /home/stepan/galera/git/10.4/server/sql/log.cc:7370 #21 0x000055a555859e9e in binlog_flush_cache (thd=0x7f3ffc000b00, cache_mngr=0x7f3ffc065ea0, end_ev=0x7f402047bea0, all=true, using_stmt=true, using_trx=true) at /home/stepan/galera/git/10.4/server/sql/log.cc:1787 #22 0x000055a55585a4dc in binlog_commit_flush_xid_caches (thd=0x7f3ffc000b00, cache_mngr=0x7f3ffc065ea0, all=true, xid=11) at /home/stepan/galera/git/10.4/server/sql/log.cc:1893 #23 0x000055a55586fed7 in MYSQL_BIN_LOG::log_and_order (this=0x55a556c7f1c0 , thd=0x7f3ffc000b00, xid=11, all=true, need_prepare_ordered=false, need_commit_ordered=true) at /home/stepan/galera/git/10.4/server/sql/log.cc:9642 #24 0x000055a555743e2a in ha_commit_trans (thd=0x7f3ffc000b00, all=true) at /home/stepan/galera/git/10.4/server/sql/handler.cc:1591 #25 0x000055a555589a76 in trans_commit (thd=0x7f3ffc000b00) at /home/stepan/galera/git/10.4/server/sql/transaction.cc:313 #26 0x000055a55563d3cb in Wsrep_high_priority_service::commit (this=0x7f402047e4d0, ws_handle=..., ws_meta=...) at /home/stepan/galera/git/10.4/server/sql/wsrep_high_priority_service.cc:318 #27 0x000055a555fa51a6 in apply_write_set (server_state=..., high_priority_service=..., ws_handle=..., ws_meta=..., data=...) at /home/stepan/galera/git/10.4/server/wsrep-lib/src/server_state.cpp:194 #28 0x000055a555fa8731 in wsrep::server_state::on_apply (this=0x55a558c5f7d0, high_priority_service=..., ws_handle=..., ws_meta=..., data=...) at /home/stepan/galera/git/10.4/server/wsrep-lib/src/server_state.cpp:923 #29 0x000055a555fbcddb in wsrep::high_priority_service::apply (this=0x7f402047e4d0, ws_handle=..., ws_meta=..., data=...) at /home/stepan/galera/git/10.4/server/wsrep-lib/include/wsrep/high_priority_service.hpp:46 #30 0x000055a555fba68b in (anonymous namespace)::apply_cb (ctx=0x7f402047e4d0, wsh=0x7f402047d3e0, flags=65, buf=0x7f402047d420, meta=0x7f402047d6b0, exit_loop=0x7f402047d5ef) at /home/stepan/galera/git/10.4/server/wsrep-lib/src/wsrep_provider_v26.cpp:460 #31 0x00007f4022fe43b1 in galera::TrxHandleSlave::apply (this=this@entry=0x7f3ffc0263d0, recv_ctx=recv_ctx@entry=0x7f402047e4d0, apply_cb=0x55a555fba468 <(anonymous namespace)::apply_cb(void*, wsrep_ws_handle_t const*, uint32_t, wsrep_buf_t const*, wsrep_trx_meta_t const*, wsrep_bool_t*)>, meta=..., exit_loop=exit_loop@entry=@0x7f402047d5ef: false) at galera/src/trx_handle.cpp:418 #32 0x00007f4023016d92 in galera::ReplicatorSMM::apply_trx (this=this@entry=0x55a558c95250, recv_ctx=recv_ctx@entry=0x7f402047e4d0, ts=...) at galera/src/replicator_smm.cpp:489 #33 0x00007f402301ca40 in galera::ReplicatorSMM::process_trx (this=0x55a558c95250, recv_ctx=0x7f402047e4d0, ts_ptr=...) at galera/src/replicator_smm.cpp:2116 #34 0x00007f4022ffdc6b in galera::GcsActionSource::process_writeset (this=this@entry=0x55a558cd5ec0, recv_ctx=0x7f402047e4d0, act=..., exit_loop=@0x7f402047e29e: false) at galera/src/gcs_action_source.cpp:62 #35 0x00007f4022ffde45 in galera::GcsActionSource::dispatch (this=this@entry=0x55a558cd5ec0, recv_ctx=recv_ctx@entry=0x7f402047e4d0, act=..., exit_loop=@0x7f402047e29e: false) at galera/src/gcs_action_source.cpp:109 #36 0x00007f4022ffe21d in galera::GcsActionSource::process (this=0x55a558cd5ec0, recv_ctx=0x7f402047e4d0, exit_loop=@0x7f402047e29e: false) at galera/src/gcs_action_source.cpp:182 #37 0x00007f402301d033 in galera::ReplicatorSMM::async_recv (this=0x55a558c95250, recv_ctx=0x7f402047e4d0) at galera/src/replicator_smm.cpp:383 #38 0x000055a555fbb20e in wsrep::wsrep_provider_v26::run_applier (this=0x55a558c0aee0, applier_ctx=0x7f402047e4d0) at /home/stepan/galera/git/10.4/server/wsrep-lib/src/wsrep_provider_v26.cpp:646 #39 0x000055a55565e2b4 in wsrep_replication_process (thd=0x7f3ffc000b00, arg=0x0) at /home/stepan/galera/git/10.4/server/sql/wsrep_thd.cc:61 #40 0x000055a55564ff01 in start_wsrep_THD (arg=0x55a558cf5b40) at /home/stepan/galera/git/10.4/server/sql/wsrep_mysqld.cc:2768 #41 0x00007f402b0ecdd5 in start_thread () from /lib64/libpthread.so.0 #42 0x00007f40294aaead in clone () from /lib64/libc.so.6 Compressed file /home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.galera_sr_log_bin-innodb/mysqld.2/data/core.41599 - saving '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.galera_sr_log_bin-innodb/' to '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.galera_sr_log_bin-innodb/' ***Warnings generated in error logs during shutdown after running tests: galera_sr.galera_sr_log_bin mysqld: /home/stepan/galera/git/10.4/server/storage/innobase/trx/trx0rseg.cc:92: void trx_rseg_update_wsrep_checkpoint(trx_rsegf_t*, const XID*, mtr_t*): Assertion `xid_seqno > wsrep_seqno' failed. Attempting backtrace. You can use the following information to find out galera_sr.mysql-wsrep-features#136 'innodb' [ pass ] 2115 galera_sr.galera_sr_v1_row_events 'innodb' [ pass ] 2158 galera_sr.GCF-1018B 'innodb' [ pass ] 20944 galera_sr.GCF-437 'innodb' [ fail ] Test ended at 2019-02-04 16:28:34 CURRENT_TEST: galera_sr.GCF-437 mysqltest: At line 13: query 'INSERT INTO t1 (f2) SELECT REPEAT('x', 512) FROM ten AS a1, ten AS a2, ten AS a3, ten AS a4, ten AS a5' succeeded - should have failed with errno 1534... The result from queries just before the failure was: connection node_2; connection node_1; CREATE TABLE ten (f1 INTEGER) ENGINE=MyISAM; INSERT INTO ten VALUES (1), (2), (3), (4), (5), (6), (7), (8), (9), (10); CREATE TABLE t1 (f1 INTEGER PRIMARY KEY AUTO_INCREMENT, f2 VARCHAR(512)) ENGINE=InnoDB; SET SESSION wsrep_trx_fragment_size = 2 * 1024 * 1024; INSERT INTO t1 (f2) SELECT REPEAT('x', 512) FROM ten AS a1, ten AS a2, ten AS a3, ten AS a4, ten AS a5; - saving '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.GCF-437-innodb/' to '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.GCF-437-innodb/' galera_sr.galera_sr_kill_all_nobootstrap 'innodb' [ pass ] 18415 galera_sr.galera_sr_kill_all_pcrecovery 'innodb' [ pass ] 13500 galera_sr.galera_sr_load_data_splitting 'innodb' [ fail ] Test ended at 2019-02-04 16:34:56 CURRENT_TEST: galera_sr.galera_sr_load_data_splitting --- /home/stepan/galera/git/10.4/server/mysql-test/suite/galera_sr/r/galera_sr_load_data_splitting.result 2019-01-23 13:58:38.972427700 +0200 +++ /home/stepan/galera/git/10.4/server/mysql-test/suite/galera_sr/r/galera_sr_load_data_splitting.reject 2019-02-04 16:34:55.993265000 +0200 @@ -1,9 +1,15 @@ +connection node_2; +connection node_1; SET SESSION wsrep_trx_fragment_size = 512; SET GLOBAL wsrep_load_data_splitting = TRUE; CREATE TABLE t1 (f1 INTEGER PRIMARY KEY) ENGINE=InnoDB; +connection node_2; +connection node_1; +connection node_2; SELECT COUNT(*) = 95000 FROM t1; COUNT(*) = 95000 1 wsrep_last_committed_diff -1 +0 +connection node_1; DROP TABLE t1; mysqltest: Result length mismatch - saving '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.galera_sr_load_data_splitting-innodb/' to '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.galera_sr_load_data_splitting-innodb/' galera_sr.galera_sr_many_fragments 'innodb' [ pass ] 70449 galera_sr.mysql-wsrep-features#8 'innodb' [ pass ] 134842 galera_sr.mysql-wsrep-features#9 'innodb' [ pass ] 19326 galera_sr.GCF-1008 'innodb' [ pass ] 4278 galera_sr.GCF-1018 'innodb' [ pass ] 2140 galera_sr.GCF-1043A 'innodb' [ pass ] 77618 galera_sr.GCF-1043B 'innodb' [ pass ] 61039 galera_sr.GCF-1051 'innodb' [ pass ] 2247 galera_sr.GCF-1060 'innodb' [ pass ] 19193 galera_sr.GCF-561 'innodb' [ pass ] 2427 galera_sr.GCF-571 'innodb' [ pass ] 2325 galera_sr.GCF-572 'innodb' [ pass ] 2258 galera_sr.GCF-580 'innodb' [ pass ] 2191 galera_sr.GCF-585 'innodb' [ pass ] 6232 galera_sr.GCF-597 'innodb' [ pass ] 2149 galera_sr.GCF-620 'innodb' [ pass ] 2152 galera_sr.GCF-623 'innodb' [ pass ] 2128 galera_sr.GCF-627 'innodb' [ pass ] 2191 galera_sr.GCF-845 'innodb' [ pass ] 4131 galera_sr.GCF-851 'innodb' [ pass ] 2103 galera_sr.GCF-867 'innodb' [ pass ] 2989 galera_sr.GCF-889 'innodb' [ pass ] 2132 galera_sr.GCF-900 'innodb' [ pass ] 2121 galera_sr.galera-features#56 'innodb' [ pass ] 234001 galera_sr.galera_sr_bf_abort 'innodb' [ pass ] 3891 galera_sr.galera_sr_blob 'innodb' [ pass ] 2187 galera_sr.galera_sr_cc_master 'innodb' [ pass ] 18352 galera_sr.galera_sr_cc_slave 'innodb' [ pass ] 17493 galera_sr.galera_sr_concurrent 'innodb' [ pass ] 2209 galera_sr.galera_sr_conflict 'innodb' [ pass ] 2132 galera_sr.galera_sr_conflict_on_commit 'innodb' [ pass ] 2113 galera_sr.galera_sr_conflict_on_commit2 'innodb' [ pass ] 3120 galera_sr.galera_sr_conflict_with_rollback_master 'innodb' [ pass ] 2120 galera_sr.galera_sr_ddl_master 'innodb' [ pass ] 2195 galera_sr.galera_sr_ddl_schema 'innodb' [ pass ] 2160 galera_sr.galera_sr_ddl_slave 'innodb' [ pass ] 2192 galera_sr.galera_sr_ddl_unrelated 'innodb' [ pass ] 2197 galera_sr.galera_sr_dupkey_error 'innodb' [ pass ] 2163 galera_sr.galera_sr_fk_conflict 'innodb' [ pass ] 6077 galera_sr.galera_sr_insert_select 'innodb' [ pass ] 66314 galera_sr.galera_sr_kill_connection 'innodb' [ pass ] 2167 galera_sr.galera_sr_kill_query 'innodb' [ pass ] 2677 galera_sr.galera_sr_load_data 'innodb' [ pass ] 48475 galera_sr.galera_sr_myisam 'innodb' [ pass ] 2068 galera_sr.galera_sr_parallel_apply 'innodb' [ pass ] 2171 galera_sr.galera_sr_rollback 'innodb' [ pass ] 2199 galera_sr.galera_sr_rollback_retry 'innodb' [ pass ] 2131 galera_sr.galera_sr_rollback_savepoint 'innodb' [ pass ] 2348 galera_sr.galera_sr_rollback_statement 'innodb' [ fail ] Test ended at 2019-02-04 16:49:53 CURRENT_TEST: galera_sr.galera_sr_rollback_statement mysqltest: At line 34: query 'INSERT INTO t2 SELECT * FROM t1' succeeded - should have failed with errno 1062... The result from queries just before the failure was: connection node_2; connection node_1; connection node_1; CREATE TABLE ten (f1 INTEGER); INSERT INTO ten VALUES (1), (2), (3), (4), (5), (6), (7), (8), (9), (10); CREATE TABLE t1 (f1 INTEGER PRIMARY KEY AUTO_INCREMENT, f2 CHAR(255)) ENGINE=InnoDB; CREATE TABLE t2 (f1 INTEGER PRIMARY KEY, f2 CHAR(255)) ENGINE=InnoDB; INSERT INTO t1 (f2) SELECT REPEAT('a', 255) FROM ten AS a1, ten AS a2, ten AS a3; ALTER TABLE t1 CHANGE f1 f1 INTEGER; ALTER TABLE t1 DROP PRIMARY KEY; INSERT INTO t1 VALUES (1, 'abc'); SET SESSION wsrep_trx_fragment_size = 1; INSERT INTO t2 SELECT * FROM t1; - saving '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.galera_sr_rollback_statement-innodb/' to '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.galera_sr_rollback_statement-innodb/' galera_sr.galera_sr_shutdown_master 'innodb' [ pass ] 20635 galera_sr.galera_sr_shutdown_slave 'innodb' [ pass ] 19815 galera_sr.galera_sr_table_contents 'innodb' [ fail ] Test ended at 2019-02-04 16:50:42 CURRENT_TEST: galera_sr.galera_sr_table_contents cp: cannot stat 'std_data/binlog-header.log': No such file or directory mysqltest: In included file "./suite/galera/include/galera_dump_sr_table.inc": included from /home/stepan/galera/git/10.4/server/mysql-test/suite/galera_sr/t/galera_sr_table_contents.test at line 21: At line 20: exec of 'cp std_data/binlog-header.log /home/stepan/galera/git/10.4/server/mysql-test/var/tmp/sr_binlog.log' failed, error: 256, status: 1, errno: 11 Output from before failure: Warnings: Warning 1287 ' INTO FROM...' instead The result from queries just before the failure was: connection node_2; connection node_1; CREATE TABLE t1 (f1 INTEGER PRIMARY KEY) ENGINE=InnoDB; INSERT INTO t1 VALUES (1),(2),(3); CREATE TABLE t2 (f1 INTEGER PRIMARY KEY) ENGINE=InnoDB; INSERT INTO t2 VALUES (1),(2),(3); SET SESSION wsrep_trx_fragment_size = 1; SET AUTOCOMMIT=OFF; START TRANSACTION; Start of Simple Insert INSERT INTO t1 VALUES (4); Warnings: Warning 1287 ' INTO FROM...' instead - saving '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.galera_sr_table_contents-innodb/' to '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.galera_sr_table_contents-innodb/' galera_sr.galera_sr_transaction_replay 'innodb' [ pass ] 2233 galera_sr.galera_sr_unit_statements 'innodb' [ pass ] 2136 galera_sr.galera_sr_ws_size 'innodb' [ pass ] 2521 galera_sr.galera_sr_ws_size2 'innodb' [ pass ] 4163 galera_sr.galera_var_ignore_apply_errors_sr 'innodb' [ pass ] 2126 galera_sr.mysql-wsrep#215 'innodb' [ pass ] 2505 galera_sr.mysql-wsrep-features#138 'innodb' [ pass ] 2151 galera_sr.mysql-wsrep-features#14 'innodb' [ pass ] 2118 galera_sr.mysql-wsrep-features#148 'innodb' [ pass ] 2262 MTR's internal check of the test case 'galera_sr.mysql-wsrep-features#148' failed. This means that the test case does not preserve the state that existed before the test case was executed. Most likely the test case did not do a proper clean-up. It could also be caused by the previous test run by this thread, if the server wasn't restarted. This is the diff of the states of the servers before and after the test case was executed: mysqltest: Logging to '/home/stepan/galera/git/10.4/server/mysql-test/var/tmp/check-mysqld_2.log'. mysqltest: Results saved in '/home/stepan/galera/git/10.4/server/mysql-test/var/tmp/check-mysqld_2.result'. mysqltest: Connecting to server localhost:16001 (socket /home/stepan/galera/git/10.4/server/mysql-test/var/tmp/mysqld.2.sock) as 'root', connection 'default', attempt 0 ... mysqltest: ... Connected. mysqltest: Start processing test commands from './include/check-testcase.test' ... mysqltest: ... Done processing test commands. --- /home/stepan/galera/git/10.4/server/mysql-test/var/tmp/check-mysqld_2.result 2019-02-04 16:51:10.317265000 +0200 +++ /home/stepan/galera/git/10.4/server/mysql-test/var/tmp/check-mysqld_2.reject 2019-02-04 16:51:12.757265000 +0200 @@ -1098,4 +1098,4 @@ user_variables 1.0 DISABLED INFORMATION SCHEMA 100403.0 NULL NULL Sergey Vojtovich User-defined variables GPL OFF Gamma 1.0 partition 1.0 DISABLED STORAGE ENGINE 100403.0 NULL NULL Mikael Ronstrom, MySQL AB Partition Storage Engine Helper GPL OFF Stable 1.0 VARIABLE_NAME VARIABLE_VALUE -DEBUG_SYNC ON - current signal: '' +DEBUG_SYNC ON - current signal: 'signal.wsrep_apply_cb' mysqltest: Result length mismatch not ok galera_sr.mysql-wsrep-features#15 'innodb' [ pass ] 2132 galera_sr.mysql-wsrep-features#165 'innodb' [ fail ] Test ended at 2019-02-04 16:51:43 CURRENT_TEST: galera_sr.mysql-wsrep-features#165 mysqltest: In included file "/home/stepan/galera/git/10.4/server/mysql-test/suite/galera_sr/t/mysql-wsrep-features#165.inc": included from /home/stepan/galera/git/10.4/server/mysql-test/suite/galera_sr/t/mysql-wsrep-features#165.test at line 27: At line 101: query 'SELECT * FROM t1' failed: 1205: Lock wait timeout exceeded; try restarting transaction The result from queries just before the failure was: < snip > connection node_1; SET DEBUG_SYNC = 'now WAIT_FOR wait'; connection node_1; SET DEBUG_SYNC = 'now SIGNAL continue'; connection node_1c; UPDATE t1 SET f2 = 'x' WHERE f1 = 3; connection node_1a; COMMIT; connection node_1b; ERROR 40001: Deadlock found when trying to get lock; try restarting transaction connection node_1; SELECT * FROM t1; f1 f2 1 a 2 a 3 x 4 a 5 a connection node_2; SELECT * FROM t1; More results from queries before failure can be found in /home/stepan/galera/git/10.4/server/mysql-test/var/log/mysql-wsrep-features#165.log - saving '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.mysql-wsrep-features#165-innodb/' to '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.mysql-wsrep-features#165-innodb/' ***Warnings generated in error logs during shutdown after running tests: galera_sr.mysql-wsrep-features#165 galera_sr.mysql-wsrep-features#15 2019-02-04 16:51:33 2 [Warning] WSREP: Event 3 Write_rows_v1 apply failed: 121, seqno 12 galera_sr.mysql-wsrep-features#22 'innodb' [ pass ] 2216 galera_sr.mysql-wsrep-features#27 'innodb' [ pass ] 4168 galera_sr.mysql-wsrep-features#35 'innodb' [ pass ] 2145 galera_sr.mysql-wsrep-features#93 'innodb' [ pass ] 2122 galera_sr.mysql-wsrep-features#96 'innodb' [ pass ] 2172 galera_sr.galera_sr_kill_all_norecovery 'innodb' [ pass ] 13394 MTR's internal check of the test case 'galera_sr.galera_sr_kill_all_norecovery' failed. This means that the test case does not preserve the state that existed before the test case was executed. Most likely the test case did not do a proper clean-up. It could also be caused by the previous test run by this thread, if the server wasn't restarted. This is the diff of the states of the servers before and after the test case was executed: mysqltest: Logging to '/home/stepan/galera/git/10.4/server/mysql-test/var/tmp/check-mysqld_2.log'. mysqltest: Results saved in '/home/stepan/galera/git/10.4/server/mysql-test/var/tmp/check-mysqld_2.result'. mysqltest: Connecting to server localhost:16001 (socket /home/stepan/galera/git/10.4/server/mysql-test/var/tmp/mysqld.2.sock) as 'root', connection 'default', attempt 0 ... mysqltest: ... Connected. mysqltest: Start processing test commands from './include/check-testcase.test' ... mysqltest: ... Done processing test commands. --- /home/stepan/galera/git/10.4/server/mysql-test/var/tmp/check-mysqld_2.result 2019-02-04 16:52:19.280265000 +0200 +++ /home/stepan/galera/git/10.4/server/mysql-test/var/tmp/check-mysqld_2.reject 2019-02-04 16:52:32.900265000 +0200 @@ -78,7 +78,7 @@ AUTOCOMMIT ON AUTOMATIC_SP_PRIVILEGES ON AUTO_INCREMENT_INCREMENT 2 -AUTO_INCREMENT_OFFSET 2 +AUTO_INCREMENT_OFFSET 1 BACK_LOG 80 BASEDIR /home/stepan/galera/git/10.4/server BIG_TABLES OFF mysqltest: Result content mismatch not ok galera_sr.galera_sr_kill_slave 'innodb' [ pass ] 21079 galera_sr.galera_sr_mysqldump_sst 'innodb' [ fail ] Found warnings/errors in server log file! Test ended at 2019-02-04 16:53:54 line 2019-02-04 16:53:49 13 [Warning] WSREP: no THD for trx: 51 2019-02-04 16:53:49 13 [Warning] WSREP: no THD for trx: 51 ^ Found warnings in /home/stepan/galera/git/10.4/server/mysql-test/var/log/mysqld.2.err ok - saving '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.galera_sr_mysqldump_sst-innodb/' to '/home/stepan/galera/git/10.4/server/mysql-test/var/log/galera_sr.galera_sr_mysqldump_sst-innodb/' galera_sr.galera_sr_small_gcache 'innodb' [ pass ] 63558 -------------------------------------------------------------------------- The servers were restarted 16 times Spent 1174.883 of 1845 seconds executing testcases mysql-test-run: WARNING: Got errors/warnings while running tests, please examine '/home/stepan/galera/git/10.4/server/mysql-test/var/log/warnings' for details. Check of testcase failed for: galera_sr.mysql-wsrep-features#148 galera_sr.galera_sr_kill_all_norecovery Completed: Failed 7/83 tests, 91.57% were successful. Failing test(s): galera_sr.galera_sr_log_bin galera_sr.GCF-437 galera_sr.galera_sr_load_data_splitting galera_sr.galera_sr_rollback_statement galera_sr.galera_sr_table_contents galera_sr.mysql-wsrep-features#165 galera_sr.galera_sr_mysqldump_sst The log files in var/log may give you some hint of what went wrong. If you want to report this error, please read first the documentation at http://dev.mysql.com/doc/mysql/en/mysql-test-suite.html Errors/warnings were found in logfiles during server shutdown after running the following sequence(s) of tests: galera_sr.galera_sr_log_bin galera_sr.mysql-wsrep-features#165 galera_sr.mysql-wsrep-features#15 mysql-test-run: *** ERROR: there were failing test cases