perl ./runall-new.pl --grammar=conf/engines/engine_stress.yy --gendata=conf/engines/engine_stress.zz --duration=2000 --queries=100M --threads=16 --galera=mmm --basedir=/home/jan/mysql/10.0-galera --vardir=/home/jan/mysql/galera-test "--mysqld=--wsrep-provider=/usr/lib/libgalera_smm.so" "--mysqld=--wsrep_sst_method=rsync" "--mysqld=--wsrep-on=1" "--mysqld=--wsrep_causal_reads=ON"

jan@jan-GE70-0NC-0ND ~/mysql/mariadb-patches $ sh -x runit22.sh

+ perl ./runall-new.pl --grammar=conf/engines/engine_stress.yy --gendata=conf/engines/engine_stress.zz --duration=2000 --queries=100M --threads=16 --galera=mmm --basedir=/home/jan/mysql/10.0-galera --vardir=/home/jan/mysql/galera-test --mysqld=--wsrep-provider=/usr/lib/libgalera_smm.so --mysqld=--wsrep_sst_method=rsync --mysqld=--wsrep-on=1 --mysqld=--wsrep_causal_reads=ON

# 2014-10-03T11:23:21 [19165] Copyright (c) 2010,2011 Oracle and/or its affiliates. All rights reserved. Use is subject to license terms.

# 2014-10-03T11:23:21 [19165] Please see http://forge.mysql.com/wiki/Category:RandomQueryGenerator for more information on this test framework.

# 2014-10-03T11:23:21 [19165] Starting 

# 2014-10-03T11:23:21 [19165] # ./runall-new.pl \ 

# 2014-10-03T11:23:21 [19165] # --grammar=conf/engines/engine_stress.yy \ 

# 2014-10-03T11:23:21 [19165] # --gendata=conf/engines/engine_stress.zz \ 

# 2014-10-03T11:23:21 [19165] # --duration=2000 \ 

# 2014-10-03T11:23:21 [19165] # --queries=100M \ 

# 2014-10-03T11:23:21 [19165] # --threads=16 \ 

# 2014-10-03T11:23:21 [19165] # --galera=mmm \ 

# 2014-10-03T11:23:21 [19165] # --basedir=/home/jan/mysql/10.0-galera \ 

# 2014-10-03T11:23:21 [19165] # --vardir=/home/jan/mysql/galera-test \ 

# 2014-10-03T11:23:21 [19165] # --mysqld=--wsrep-provider=/usr/lib/libgalera_smm.so \ 

# 2014-10-03T11:23:21 [19165] # --mysqld=--wsrep_sst_method=rsync \ 

# 2014-10-03T11:23:21 [19165] # --mysqld=--wsrep-on=1 \ 

# 2014-10-03T11:23:21 [19165] # --mysqld=--wsrep_causal_reads=ON

# 2014-10-03T11:23:21 [19165] master_port : 19300 slave_port : 19302 ports : 19300 19302 MTR_BUILD_THREAD : 930 

# 2014-10-03T11:23:21 [19165] /home/jan/mysql/mariadb-patches Revno: 994

# 2014-10-03T11:23:21 [19165] /home/jan/mysql/mariadb-patches Revision-Id: elenst@montyprogram.com-20140927205339-ovi1rxegcvl9t8ed

# 2014-10-03T11:25:23 [19165] /home/jan/mysql/10.0-galera Revno: 3895

# 2014-10-03T11:25:23 [19165] /home/jan/mysql/10.0-galera Revision-Id: nirbhay@skysql.com-20140924161729-8ayjtmqjf0dplquf

# 2014-10-03T11:25:23 [19165] Final command line: 

# 2014-10-03T11:25:23 [19165] perl ./runall-new.pl --grammar=conf/engines/engine_stress.yy --gendata=conf/engines/engine_stress.zz --duration=2000 --queries=100M --threads=16 --galera=mmm --basedir=/home/jan/mysql/10.0-galera --vardir=/home/jan/mysql/galera-test --mysqld=--wsrep-provider=/usr/lib/libgalera_smm.so --mysqld=--wsrep_sst_method=rsync --mysqld=--wsrep-on=1 --mysqld=--wsrep_causal_reads=ON

# 2014-10-03T11:25:24 [19165] Found source directory at /home/jan/mysql/10.0-galera

# 2014-10-03T11:25:24 [19165] Creating MySQL 10.0.13 database at /home/jan/mysql/galera-test/node0/data

# 2014-10-03T11:25:24 [19165] Running bootstrap: "/home/jan/mysql/10.0-galera/sql/mysqld" "--no-defaults" "--bootstrap" "--basedir=/home/jan/mysql/10.0-galera" "--datadir=/home/jan/mysql/galera-test/node0/data" "--lc-messages-dir=/home/jan/mysql/10.0-galera/sql/share" "--character-sets-dir=/home/jan/mysql/10.0-galera/sql/share/charsets" "--tmpdir=/home/jan/mysql/galera-test/node0/tmp" "--wsrep_sst_method=rsync" "--innodb_autoinc_lock_mode=2" "--default-storage-engine=InnoDB" "--innodb_locks_unsafe_for_binlog=1" "--binlog-format=row" "--wsrep_cluster_address=gcomm://?gmcast.listen_addr=tcp://127.0.0.1:4800" "--wsrep-provider=/usr/lib/libgalera_smm.so" "--wsrep_sst_method=rsync" "--wsrep-on=1" "--wsrep_causal_reads=ON" "--sql-mode=no_engine_substitution" "--skip-log-bin" (and feeding /home/jan/mysql/galera-test/node0/boot.sql to it)

# 2014-10-03T11:25:45 [19165] Found source directory at /home/jan/mysql/10.0-galera

# 2014-10-03T11:25:45 [19165] Creating MySQL 10.0.13 database at /home/jan/mysql/galera-test/node1/data

# 2014-10-03T11:25:45 [19165] Running bootstrap: "/home/jan/mysql/10.0-galera/sql/mysqld" "--no-defaults" "--bootstrap" "--basedir=/home/jan/mysql/10.0-galera" "--datadir=/home/jan/mysql/galera-test/node1/data" "--lc-messages-dir=/home/jan/mysql/10.0-galera/sql/share" "--character-sets-dir=/home/jan/mysql/10.0-galera/sql/share/charsets" "--tmpdir=/home/jan/mysql/galera-test/node1/tmp" "--wsrep_sst_method=rsync" "--innodb_autoinc_lock_mode=2" "--default-storage-engine=InnoDB" "--innodb_locks_unsafe_for_binlog=1" "--binlog-format=row" "--wsrep_cluster_address=gcomm://127.0.0.1:4800?gmcast.listen_addr=tcp://127.0.0.1:4801" "--wsrep-provider=/usr/lib/libgalera_smm.so" "--wsrep_sst_method=rsync" "--wsrep-on=1" "--wsrep_causal_reads=ON" "--sql-mode=no_engine_substitution" "--skip-log-bin" (and feeding /home/jan/mysql/galera-test/node1/boot.sql to it)

# 2014-10-03T11:26:02 [19165] Found source directory at /home/jan/mysql/10.0-galera

# 2014-10-03T11:26:02 [19165] Creating MySQL 10.0.13 database at /home/jan/mysql/galera-test/node2/data

# 2014-10-03T11:26:02 [19165] Running bootstrap: "/home/jan/mysql/10.0-galera/sql/mysqld" "--no-defaults" "--bootstrap" "--basedir=/home/jan/mysql/10.0-galera" "--datadir=/home/jan/mysql/galera-test/node2/data" "--lc-messages-dir=/home/jan/mysql/10.0-galera/sql/share" "--character-sets-dir=/home/jan/mysql/10.0-galera/sql/share/charsets" "--tmpdir=/home/jan/mysql/galera-test/node2/tmp" "--wsrep_sst_method=rsync" "--innodb_autoinc_lock_mode=2" "--default-storage-engine=InnoDB" "--innodb_locks_unsafe_for_binlog=1" "--binlog-format=row" "--wsrep_cluster_address=gcomm://127.0.0.1:4800?gmcast.listen_addr=tcp://127.0.0.1:4802" "--wsrep-provider=/usr/lib/libgalera_smm.so" "--wsrep_sst_method=rsync" "--wsrep-on=1" "--wsrep_causal_reads=ON" "--sql-mode=no_engine_substitution" "--skip-log-bin" (and feeding /home/jan/mysql/galera-test/node2/boot.sql to it)

# 2014-10-03T11:26:20 [19165] MySQL Version:10.0.13

# 2014-10-03T11:26:20 [19165] Binary: /home/jan/mysql/10.0-galera/sql/mysqld

# 2014-10-03T11:26:20 [19165] Type: Debug

# 2014-10-03T11:26:20 [19165] Datadir: /home/jan/mysql/galera-test/node0/data

# 2014-10-03T11:26:20 [19165] Tmpdir: /home/jan/mysql/galera-test/node0/tmp

# 2014-10-03T11:26:20 [19165] Corefile: /home/jan/mysql/galera-test/node0/data/core.

# 2014-10-03T11:26:20 [19165] Starting MySQL 10.0.13: "/home/jan/mysql/10.0-galera/sql/mysqld" "--no-defaults" "--basedir=/home/jan/mysql/10.0-galera" "--datadir=/home/jan/mysql/galera-test/node0/data" "--lc-messages-dir=/home/jan/mysql/10.0-galera/sql/share" "--character-sets-dir=/home/jan/mysql/10.0-galera/sql/share/charsets" "--tmpdir=/home/jan/mysql/galera-test/node0/tmp" "--core-file" "--max-allowed-packet=128Mb" "--port=19300" "--socket=/home/jan/mysql/galera-test/node0/mysql.sock" "--pid-file=/home/jan/mysql/galera-test/node0/mysql.pid" "--general-log" "--general-log-file=/home/jan/mysql/galera-test/node0/mysql.log" --wsrep_sst_method=rsync --innodb_autoinc_lock_mode=2 --default-storage-engine=InnoDB --innodb_locks_unsafe_for_binlog=1 --binlog-format=row --wsrep_cluster_address=gcomm://?gmcast.listen_addr=tcp://127.0.0.1:4800 --wsrep-provider=/usr/lib/libgalera_smm.so --wsrep_sst_method=rsync --wsrep-on=1 --wsrep_causal_reads=ON --sql-mode=no_engine_substitution

# 2014-10-03T11:26:23 [19165] Connecting to 19300

# 2014-10-03T11:26:24 [19165] Cluster size after starting node 0: 1

# 2014-10-03T11:26:24 [19165] MySQL Version:10.0.13

# 2014-10-03T11:26:24 [19165] Binary: /home/jan/mysql/10.0-galera/sql/mysqld

# 2014-10-03T11:26:24 [19165] Type: Debug

# 2014-10-03T11:26:24 [19165] Datadir: /home/jan/mysql/galera-test/node1/data

# 2014-10-03T11:26:24 [19165] Tmpdir: /home/jan/mysql/galera-test/node1/tmp

# 2014-10-03T11:26:24 [19165] Corefile: /home/jan/mysql/galera-test/node1/data/core.

# 2014-10-03T11:26:24 [19165] Starting MySQL 10.0.13: "/home/jan/mysql/10.0-galera/sql/mysqld" "--no-defaults" "--basedir=/home/jan/mysql/10.0-galera" "--datadir=/home/jan/mysql/galera-test/node1/data" "--lc-messages-dir=/home/jan/mysql/10.0-galera/sql/share" "--character-sets-dir=/home/jan/mysql/10.0-galera/sql/share/charsets" "--tmpdir=/home/jan/mysql/galera-test/node1/tmp" "--core-file" "--max-allowed-packet=128Mb" "--port=19301" "--socket=/home/jan/mysql/galera-test/node1/mysql.sock" "--pid-file=/home/jan/mysql/galera-test/node1/mysql.pid" "--general-log" "--general-log-file=/home/jan/mysql/galera-test/node1/mysql.log" --wsrep_sst_method=rsync --innodb_autoinc_lock_mode=2 --default-storage-engine=InnoDB --innodb_locks_unsafe_for_binlog=1 --binlog-format=row --wsrep_cluster_address=gcomm://127.0.0.1:4800?gmcast.listen_addr=tcp://127.0.0.1:4801 --wsrep-provider=/usr/lib/libgalera_smm.so --wsrep_sst_method=rsync --wsrep-on=1 --wsrep_causal_reads=ON --sql-mode=no_engine_substitution

# 2014-10-03T11:26:40 [19165] Connecting to 19301

# 2014-10-03T11:26:40 [19165] Cluster size after starting node 1: 2

# 2014-10-03T11:26:40 [19165] MySQL Version:10.0.13

# 2014-10-03T11:26:40 [19165] Binary: /home/jan/mysql/10.0-galera/sql/mysqld

# 2014-10-03T11:26:40 [19165] Type: Debug

# 2014-10-03T11:26:40 [19165] Datadir: /home/jan/mysql/galera-test/node2/data

# 2014-10-03T11:26:40 [19165] Tmpdir: /home/jan/mysql/galera-test/node2/tmp

# 2014-10-03T11:26:40 [19165] Corefile: /home/jan/mysql/galera-test/node2/data/core.

# 2014-10-03T11:26:40 [19165] Starting MySQL 10.0.13: "/home/jan/mysql/10.0-galera/sql/mysqld" "--no-defaults" "--basedir=/home/jan/mysql/10.0-galera" "--datadir=/home/jan/mysql/galera-test/node2/data" "--lc-messages-dir=/home/jan/mysql/10.0-galera/sql/share" "--character-sets-dir=/home/jan/mysql/10.0-galera/sql/share/charsets" "--tmpdir=/home/jan/mysql/galera-test/node2/tmp" "--core-file" "--max-allowed-packet=128Mb" "--port=19302" "--socket=/home/jan/mysql/galera-test/node2/mysql.sock" "--pid-file=/home/jan/mysql/galera-test/node2/mysql.pid" "--general-log" "--general-log-file=/home/jan/mysql/galera-test/node2/mysql.log" --wsrep_sst_method=rsync --innodb_autoinc_lock_mode=2 --default-storage-engine=InnoDB --innodb_locks_unsafe_for_binlog=1 --binlog-format=row --wsrep_cluster_address=gcomm://127.0.0.1:4800?gmcast.listen_addr=tcp://127.0.0.1:4802 --wsrep-provider=/usr/lib/libgalera_smm.so --wsrep_sst_method=rsync --wsrep-on=1 --wsrep_causal_reads=ON --sql-mode=no_engine_substitution

# 2014-10-03T11:26:56 [19165] Connecting to 19302

# 2014-10-03T11:26:56 [19165] Cluster size after starting node 2: 3

# 2014-10-03T11:26:56 [19165] -------------------------------

# 2014-10-03T11:26:56 [19165] Configuration

# 2014-10-03T11:26:56 [19165]   debug_server => ['', '']

# 2014-10-03T11:26:56 [19165]   dsn => ['dbi:mysql:host=127.0.0.1:port=19300:user=root:database=test', 'dbi:mysql:host=127.0.0.1:port=19301:user=root:database=test', 'dbi:mysql:host=127.0.0.1:port=19302:user=root:database=test']

# 2014-10-03T11:26:56 [19165]   duration => 2000

# 2014-10-03T11:26:56 [19165]   gendata => conf/engines/engine_stress.zz

# 2014-10-03T11:26:56 [19165]   generator => FromGrammar

# 2014-10-03T11:26:56 [19165]   grammar => conf/engines/engine_stress.yy

# 2014-10-03T11:26:56 [19165]   multi-master => 1

# 2014-10-03T11:26:56 [19165]   queries => 100000000

# 2014-10-03T11:26:56 [19165]   servers => ['DBServer::MySQL::MySQLd=ARRAY(0x2f8f220)', 'DBServer::MySQL::MySQLd=ARRAY(0x2e58498)', 'DBServer::MySQL::MySQLd=ARRAY(0x2f93340)']

# 2014-10-03T11:26:56 [19165]   threads => 16

# 2014-10-03T11:26:56 [19165]   views => ['', '']

# 2014-10-03T11:26:56 [19165] Sleeping:::JAN

# 2014-10-03T11:27:41 [19165] Sleeping___done:::JAN

# 2014-10-03T11:27:41 [19165] # Creating MySQL table: test.table0_int_autoinc; engine: ; rows: 0 .

# 2014-10-03T11:27:45 [19165] # Creating MySQL table: test.table0_key_pk_parts_2_int_autoinc; engine: ; rows: 0 .

# 2014-10-03T11:27:51 [19165] # Creating MySQL table: test.table1_int_autoinc; engine: ; rows: 1 .

# 2014-10-03T11:27:57 [19165] # Creating MySQL table: test.table1_key_pk_parts_2_int_autoinc; engine: ; rows: 1 .

# 2014-10-03T11:28:11 [19165] # Creating MySQL table: test.table2_int_autoinc; engine: ; rows: 2 .

# 2014-10-03T11:28:18 [19165] # Creating MySQL table: test.table2_key_pk_parts_2_int_autoinc; engine: ; rows: 2 .

# 2014-10-03T11:28:27 [19165] # Creating MySQL table: test.table10_int_autoinc; engine: ; rows: 10 .

# 2014-10-03T11:28:34 [19165] # Creating MySQL table: test.table10_key_pk_parts_2_int_autoinc; engine: ; rows: 10 .

# 2014-10-03T11:28:42 [19165] # Creating MySQL table: test.table100_int_autoinc; engine: ; rows: 100 .

# 2014-10-03T11:28:48 [19165] # Creating MySQL table: test.table100_key_pk_parts_2_int_autoinc; engine: ; rows: 100 .

# 2014-10-03T11:29:01 [19165] Reporters: ErrorLog, Backtrace

# 2014-10-03T11:29:10 [19165] Validators: (none)

# 2014-10-03T11:29:10 [19165] Caching schema metadata for dbi:mysql:host=127.0.0.1:port=19300:user=root:database=test

# 2014-10-03T11:29:11 [19165] Caching schema metadata for dbi:mysql:host=127.0.0.1:port=19301:user=root:database=test

# 2014-10-03T11:29:11 [19165] Caching schema metadata for dbi:mysql:host=127.0.0.1:port=19302:user=root:database=test

# 2014-10-03T11:29:11 [19165] Starting 16 processes, 100000000 queries each, duration 2000 seconds.

# 2014-10-03T11:29:11 [19165] GenTest::ErrorFilter(20082) started

# 2014-10-03T11:29:13 [20083] Started periodic reporting process...

# 2014-10-03T11:29:13 [20082] Query: INSERT LOW_PRIORITY IGNORE INTO `table10_key_pk_parts_2_int_autoinc` ( `col_int` , `col_int` ) VALUES ( 'y' , 1639514112 ) , ( 6 , 1388707840 ) failed: 1110 Column '%s' specified twice. Further errors of this kind will be suppressed.

# 2014-10-03T11:29:21 [20082] Query: UPDATE LOW_PRIORITY IGNORE `table10_key_pk_parts_2_int_autoinc` AS X SET `col_char_12` = 'd'  ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 8 failed: 1213 Deadlock found when trying to get lock; try restarting transaction. Further errors of this kind will be suppressed.

# 2014-10-03T11:29:34 [20082] Query: DELETE LOW_PRIORITY  IGNORE FROM `table0_int_autoinc` WHERE `col_int_key` IN ( SELECT `col_char_12_key` FROM `table0_int_autoinc` WHERE `pk` = 4154130432 ) ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 2 failed: 1093 Table 'table%d_int_autoinc' is specified twice, both as a target for 'DELETE' and as a separate source for data. Further errors of this kind will be suppressed.

# 2014-10-03T11:30:07 [20082] Query: ROLLBACK TO SAVEPOINT A failed: 1305 SAVEPOINT %s does not exist. Further errors of this kind will be suppressed.

# 2014-10-03T11:31:16 [20082] Query: DELETE LOW_PRIORITY  IGNORE FROM `table0_key_pk_parts_2_int_autoinc` WHERE `col_char_12_key` IN ( SELECT `col_char_12_key` FROM `table0_key_pk_parts_2_int_autoinc` WHERE `pk` = 1 ) ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 3 failed: 1093 Table 'table%d_key_pk_parts_%d_int_autoinc' is specified twice, both as a target for 'DELETE' and as a separate source for data. Further errors of this kind will be suppressed.

# 2014-10-03T11:32:53 [20082] Query: UPDATE LOW_PRIORITY IGNORE `table0_key_pk_parts_2_int_autoinc` AS X SET `col_int` = 2  ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 5 failed: 1205 Lock wait timeout exceeded; try restarting transaction. Further errors of this kind will be suppressed.

# 2014-10-03T11:39:16 [20082] Query: UPDATE LOW_PRIORITY  `table100_int_autoinc` AS X SET `col_char_12_key` = 84 WHERE X . `col_int_key` = ( SELECT `col_int_key` FROM `table100_int_autoinc` WHERE `pk` = 151 ) ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 7 failed: 1093 Table 'X' is specified twice, both as a target for 'UPDATE' and as a separate source for data. Further errors of this kind will be suppressed.

# 2014-10-03T11:40:18 [20104] Query: SELECT X . `pk` FROM `table1_key_pk_parts_2_int_autoinc` AS X WHERE X . `col_int_key` IN ( 'b' , 't' , 5 , 929366016 , 0 ) LIMIT 5 LOCK IN SHARE MODE failed: 2013 Lost connection to MySQL server during query

# 2014-10-03T11:40:18 [20088] Query: SELECT * FROM `table1_key_pk_parts_2_int_autoinc` AS X WHERE X . `col_int_key` BETWEEN 2 AND 5 LIMIT 6 FOR UPDATE failed: 2013 Lost connection to MySQL server during query

# 2014-10-03T11:40:18 [20102] Query: SET AUTOCOMMIT=ON failed: 2013 Lost connection to MySQL server during query

# 2014-10-03T11:40:18 [20088] Server crash reported at dsn dbi:mysql:host=127.0.0.1:port=19301:user=root:database=test

# 2014-10-03T11:40:18 [20104] Server crash reported at dsn dbi:mysql:host=127.0.0.1:port=19301:user=root:database=test

# 2014-10-03T11:40:18 [20090] Query: SELECT X . `col_char_12` FROM `table0_int_autoinc` AS X WHERE X . `col_char_12_key` < 2074017792 LIMIT 7  failed: 2013 Lost connection to MySQL server during query

# 2014-10-03T11:40:18 [20100] Query: UPDATE LOW_PRIORITY  `table100_int_autoinc` AS X SET `col_char_12` = 7 WHERE X . `col_char_12_key` = ( SELECT `col_int_key` FROM `table0_int_autoinc` WHERE `pk` = 46 ) ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 6 failed: 2013 Lost connection to MySQL server during query

# 2014-10-03T11:40:18 [20117] Query: UPDATE LOW_PRIORITY IGNORE `table10_int_autoinc` AS X SET `col_char_12_key` = 4 WHERE X . `col_char_12_key` < 'w' ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 6 failed: 2013 Lost connection to MySQL server during query

# 2014-10-03T11:40:18 [20090] Server crash reported at dsn dbi:mysql:host=127.0.0.1:port=19301:user=root:database=test

# 2014-10-03T11:40:18 [20100] Server crash reported at dsn dbi:mysql:host=127.0.0.1:port=19301:user=root:database=test

# 2014-10-03T11:40:18 [20117] Server crash reported at dsn dbi:mysql:host=127.0.0.1:port=19301:user=root:database=test

# 2014-10-03T11:40:18 [20084] Query: SELECT X . `col_char_12_key` FROM `table2_key_pk_parts_2_int_autoinc` AS X WHERE X . `col_char_12_key` BETWEEN 78 AND 3518955520 LIMIT 7 FOR UPDATE failed: 2013 Lost connection to MySQL server during query

# 2014-10-03T11:40:18 [20084] Server crash reported at dsn dbi:mysql:host=127.0.0.1:port=19301:user=root:database=test

# 2014-10-03T11:40:18 [20106] Query: UPDATE LOW_PRIORITY IGNORE `table2_int_autoinc` AS X SET `col_char_12` = 'a' WHERE X . `col_char_12_key` IN ( 'u' , 0 , 3881566208 , 0 , 220 ) ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 5 failed: 2013 Lost connection to MySQL server during query

# 2014-10-03T11:40:18 [20106] Server crash reported at dsn dbi:mysql:host=127.0.0.1:port=19301:user=root:database=test

# 2014-10-03T11:40:18 [20102] Server crash reported at dsn dbi:mysql:host=127.0.0.1:port=19301:user=root:database=test

# 2014-10-03T11:40:18 [20108] Query: UPDATE LOW_PRIORITY  `table100_int_autoinc` AS X SET `col_int` = 104 WHERE X . `col_char_12_key` = ( SELECT `col_int_key` FROM `table10_key_pk_parts_2_int_autoinc` WHERE `pk` = 0 ) ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 6 failed: 2013 Lost connection to MySQL server during query

# 2014-10-03T11:40:18 [20108] Server crash reported at dsn dbi:mysql:host=127.0.0.1:port=19301:user=root:database=test

# 2014-10-03T11:40:18 [20123] Query: DELETE LOW_PRIORITY QUICK  FROM `table2_key_pk_parts_2_int_autoinc` WHERE `col_char_12_key` IN ( 332464128 , 3 , 25 , 'v' , 6 ) ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 3 failed: 2013 Lost connection to MySQL server during query

# 2014-10-03T11:40:18 [20121] Query: START TRANSACTION failed: 2013 Lost connection to MySQL server during query

# 2014-10-03T11:40:18 [20110] Query: DELETE LOW_PRIORITY QUICK  FROM `table1_key_pk_parts_2_int_autoinc`  ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 4 failed: 2013 Lost connection to MySQL server during query

# 2014-10-03T11:40:18 [19165] Process with pid 20088 ended with status STATUS_SERVER_CRASHED

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20123...

# 2014-10-03T11:40:18 [20121] Server crash reported at dsn dbi:mysql:host=127.0.0.1:port=19301:user=root:database=test

# 2014-10-03T11:40:18 [20110] Server crash reported at dsn dbi:mysql:host=127.0.0.1:port=19301:user=root:database=test

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20125...

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20108...

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20092...

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20110...

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20084...

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20102...

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20094...

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20090...

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20119...

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20117...

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20100...

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20121...

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20106...

# 2014-10-03T11:40:18 [19165] Killing remaining worker process with pid 20104...

# 2014-10-03T11:40:18 [20123] Server crash reported at dsn dbi:mysql:host=127.0.0.1:port=19301:user=root:database=test

# 2014-10-03T11:40:19 [19165] Killing periodic reporting process with pid 20083...

# 2014-10-03T11:40:19 [19165] For pid 20083 reporter status STATUS_OK

# 2014-10-03T11:40:19 [19165] Kill GenTest::ErrorFilter(20082)

# 2014-10-03T11:40:19 [19165] Server crash reported, initiating post-crash analysis...

# 2014-10-03T11:40:19 [19165] The last 100 lines from /home/jan/mysql/galera-test/node0/data//../mysql.err :

141003 11:26:42 [Note] WSREP: declaring f72324d3-4ad6-11e4-a5a3-5ef8d4dc6573 stable

141003 11:26:42 [Note] WSREP: Node f4b8ee21-4ad6-11e4-8d76-7640357fee10 state prim

141003 11:26:42 [Note] WSREP: view(view_id(PRIM,00c97b90-4ad7-11e4-9101-3ec8ad0f661d,3) memb {

	00c97b90-4ad7-11e4-9101-3ec8ad0f661d,0

	f4b8ee21-4ad6-11e4-8d76-7640357fee10,0

	f72324d3-4ad6-11e4-a5a3-5ef8d4dc6573,0

} joined {

} left {

} partitioned {

})

141003 11:26:42 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3

141003 11:26:42 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.

141003 11:26:42 [Note] WSREP: STATE EXCHANGE: sent state msg: 0116828d-4ad7-11e4-a9dc-fadf937215d1

141003 11:26:42 [Note] WSREP: STATE EXCHANGE: got state msg: 0116828d-4ad7-11e4-a9dc-fadf937215d1 from 0 (jan-GE70-0NC-0ND)

141003 11:26:42 [Note] WSREP: STATE EXCHANGE: got state msg: 0116828d-4ad7-11e4-a9dc-fadf937215d1 from 2 (jan-GE70-0NC-0ND)

141003 11:26:42 [Note] WSREP: STATE EXCHANGE: got state msg: 0116828d-4ad7-11e4-a9dc-fadf937215d1 from 1 (jan-GE70-0NC-0ND)

141003 11:26:42 [Note] WSREP: Quorum results:

	version    = 3,

	component  = PRIMARY,

	conf_id    = 2,

	members    = 2/3 (joined/total),

	act_id     = 0,

	last_appl. = 0,

	protocols  = 0/5/3 (gcs/repl/appl),

	group UUID = f4b9ca7d-4ad6-11e4-964b-5b14e3a83a76

141003 11:26:42 [Note] WSREP: Flow-control interval: [28, 28]

141003 11:26:42 [Note] WSREP: New cluster view: global state: f4b9ca7d-4ad6-11e4-964b-5b14e3a83a76:0, view# 3: Primary, number of nodes: 3, my index: 1, protocol version 3

141003 11:26:42 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.

141003 11:26:42 [Note] WSREP: REPL Protocols: 5 (3, 1)

141003 11:26:42 [Note] WSREP: Service thread queue flushed.

141003 11:26:42 [Note] WSREP: Assign initial position for certification: 0, protocol version: 3

141003 11:26:42 [Note] WSREP: Service thread queue flushed.

141003 11:26:44 [Note] WSREP: Member 0.0 (jan-GE70-0NC-0ND) requested state transfer from '*any*'. Selected 1.0 (jan-GE70-0NC-0ND)(SYNCED) as donor.

141003 11:26:44 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 0)

141003 11:26:44 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.

141003 11:26:44 [Note] WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '178.251.60.217:4444/rsync_sst' --auth '(null)' --socket '/home/jan/mysql/galera-test/node0/mysql.sock' --datadir '/home/jan/mysql/galera-test/node0/data/' --defaults-file ''   '' --gtid 'f4b9ca7d-4ad6-11e4-964b-5b14e3a83a76:0''

141003 11:26:44 [Note] WSREP: sst_donor_thread signaled with 0

141003 11:26:44 [Note] WSREP: Flushing tables for SST...

141003 11:26:44 [Note] WSREP: Provider paused at f4b9ca7d-4ad6-11e4-964b-5b14e3a83a76:0 (10)

141003 11:26:44 [Note] WSREP: Tables flushed.

141003 11:26:52 [Note] WSREP: resuming provider at 10

141003 11:26:52 [Note] WSREP: Provider resumed.

141003 11:26:52 [Note] WSREP: 1.0 (jan-GE70-0NC-0ND): State transfer to 0.0 (jan-GE70-0NC-0ND) complete.

141003 11:26:52 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 0)

141003 11:26:52 [Note] WSREP: Member 1.0 (jan-GE70-0NC-0ND) synced with group.

141003 11:26:52 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 0)

141003 11:26:52 [Note] WSREP: Synchronized with group, ready for connections

141003 11:26:52 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.

141003 11:26:56 [Note] WSREP: 0.0 (jan-GE70-0NC-0ND): State transfer from 1.0 (jan-GE70-0NC-0ND) complete.

141003 11:26:56 [Note] WSREP: Member 0.0 (jan-GE70-0NC-0ND) synced with group.

141003 11:30:43 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:31:01 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:31:01 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:31:13 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:31:13 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:31:53 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:31:53 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:31:53 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:32:02 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:32:02 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:32:02 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:32:53 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:32:53 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:32:54 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:32:55 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:32:56 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:32:58 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:32:58 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:33:05 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:34:35 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:34:35 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:34:35 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:34:35 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:34:58 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:35:44 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:35:45 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:35:45 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:35:46 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:35:49 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:35:54 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:36:28 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:36:36 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:37:21 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:38:09 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:38:18 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:38:18 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:38:21 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:38:23 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:38:28 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:38:29 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:39:00 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:39:08 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:19 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:44 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:50 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:53 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:55 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:56 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:40:17 [Note] WSREP: (f4b8ee21-4ad6-11e4-8d76-7640357fee10, 'tcp://127.0.0.1:4800') turning message relay requesting on, nonlive peers: tcp://127.0.0.1:4801 

141003 11:40:18 [Note] WSREP: (f4b8ee21-4ad6-11e4-8d76-7640357fee10, 'tcp://127.0.0.1:4800') reconnecting to f72324d3-4ad6-11e4-a5a3-5ef8d4dc6573 (tcp://127.0.0.1:4801), attempt 0

# 2014-10-03T11:40:19 [19165] datadir is /home/jan/mysql/galera-test/node0/data/

# 2014-10-03T11:40:19 [19165] binary is /home/jan/mysql/10.0-galera/sql/mysqld

# 2014-10-03T11:40:19 [19165] bindir is /home/jan/mysql/10.0-galera/sql

# 2014-10-03T11:40:19 [19165] WARNING: Core file not found!

gdb: /usr/local/lib/liblzma.so.5: no version information available (required by gdb)

"/home/jan/mysql/mariadb-patches" is not a core dump: Is a directory

warning: backtrace.gdb: No such file or directory

# 2014-10-03T11:40:30 [19165] 

gdb: /usr/local/lib/liblzma.so.5: no version information available (required by gdb)

"/home/jan/mysql/mariadb-patches" is not a core dump: Is a directory

warning: backtrace-all.gdb: No such file or directory

# 2014-10-03T11:40:31 [19165] 

# 2014-10-03T11:40:31 [19165] The last 100 lines from /home/jan/mysql/galera-test/node1/data//../mysql.err :

141003 11:36:40 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:36:45 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:37:19 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:38:18 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:39:00 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:39:09 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:39:09 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:39:12 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:12 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:42 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:42 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:44 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:49 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:49 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:50 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:50 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:53 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:56 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:56 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:40:00 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:40:00 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

2014-10-03 11:40:03 7f989d21c700  InnoDB: Assertion failure in thread 140293447993088 in file lock0lock.cc line 4033

InnoDB: Failing assertion: lock != ctx->wait_lock

InnoDB: We intentionally generate a memory trap.

InnoDB: Submit a detailed bug report to http://bugs.mysql.com.

InnoDB: If you get repeated assertion failures or crashes, even

InnoDB: immediately after the mysqld startup, there may be

InnoDB: corruption in the InnoDB tablespace. Please refer to

InnoDB: http://dev.mysql.com/doc/refman/5.6/en/forcing-innodb-recovery.html

InnoDB: about forcing recovery.

141003 11:40:03 [ERROR] mysqld got signal 6 ;

This could be because you hit a bug. It is also possible that this binary

or one of the libraries it was linked against is corrupt, improperly built,

or misconfigured. This error can also be caused by malfunctioning hardware.

To report this bug, see http://kb.askmonty.org/en/reporting-bugs

We will try our best to scrape up some info that will hopefully help

diagnose the problem, but since we have already crashed, 

something is definitely wrong and this may fail.

Server version: 10.0.13-MariaDB-wsrep-debug-log

key_buffer_size=134217728

read_buffer_size=131072

max_used_connections=17

max_threads=153

thread_count=19

It is possible that mysqld could use up to 

key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 467301 K  bytes of memory

Hope that's ok; if not, decrease some variables in the equation.

Thread pointer: 0x0x7f987c65e070

Attempting backtrace. You can use the following information to find out

where mysqld died. If you see no messages after this, something went

terribly wrong...

stack_bottom = 0x7f989d21be40 thread_stack 0x48000

mysys/stacktrace.c:246(my_print_stacktrace)[0xea276d]

sql/signal_handler.cc:155(handle_fatal_signal)[0x8976ec]

/lib/x86_64-linux-gnu/libpthread.so.0(+0x10340)[0x7f98a7f5d340]

/lib/x86_64-linux-gnu/libc.so.6(gsignal+0x39)[0x7f98a73afbb9]

/lib/x86_64-linux-gnu/libc.so.6(abort+0x148)[0x7f98a73b2fc8]

lock/lock0lock.cc:4034(lock_get_first_lock)[0xc27ce8]

lock/lock0lock.cc:4303(lock_deadlock_search)[0xc28742]

lock/lock0lock.cc:4467(lock_deadlock_check_and_resolve)[0xc28c92]

lock/lock0lock.cc:2259(lock_rec_enqueue_waiting)[0xc243ff]

lock/lock0lock.cc:2602(lock_rec_lock_slow)[0xc25000]

lock/lock0lock.cc:2670(lock_rec_lock)[0xc252af]

lock/lock0lock.cc:7028(lock_clust_rec_read_check_and_lock(unsigned long, buf_block_t const*, unsigned char const*, dict_index_t*, unsigned long const*, lock_mode, unsigned long, que_thr_t*))[0xc2f32f]

row/row0sel.cc:1011(sel_set_rec_lock)[0xcf4d27]

row/row0sel.cc:4513(row_search_for_mysql(unsigned char*, unsigned long, row_prebuilt_t*, unsigned long, unsigned long))[0xcfb432]

handler/ha_innodb.cc:9515(ha_innobase::general_fetch(unsigned char*, unsigned int, unsigned int))[0xbd286c]

handler/ha_innodb.cc:9732(ha_innobase::rnd_next(unsigned char*))[0xbd2dc2]

sql/handler.cc:2617(handler::ha_rnd_next(unsigned char*))[0x89db32]

sql/ha_partition.cc:4910(ha_partition::rnd_next(unsigned char*))[0xe6b464]

sql/handler.cc:2617(handler::ha_rnd_next(unsigned char*))[0x89db32]

sql/filesort.cc:757(find_all_keys)[0x8935ca]

sql/filesort.cc:299(filesort(THD*, TABLE*, st_sort_field*, unsigned int, SQL_SELECT*, unsigned long long, bool, unsigned long long*, unsigned long long*))[0x891fff]

sql/sql_delete.cc:480(mysql_delete(THD*, TABLE_LIST*, Item*, SQL_I_List<st_order>*, unsigned long long, unsigned long long, select_result*))[0x9facb3]

sql/sql_parse.cc:3931(mysql_execute_command(THD*))[0x6833ed]

sql/sql_parse.cc:7010(mysql_parse(THD*, char*, unsigned int, Parser_state*))[0x68c909]

sql/sql_parse.cc:6834(wsrep_mysql_parse)[0x68c07a]

sql/sql_parse.cc:1490(dispatch_command(enum_server_command, THD*, char*, unsigned int))[0x67d0b4]

sql/sql_parse.cc:1087(do_command(THD*))[0x67bda8]

sql/sql_connect.cc:1396(do_handle_one_connection(THD*))[0x7a6f4c]

sql/sql_connect.cc:1308(handle_one_connection)[0x7a6ca4]

/lib/x86_64-linux-gnu/libpthread.so.0(+0x8182)[0x7f98a7f55182]

/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f98a7473fbd]

Trying to get some variables.

Some pointers may be invalid and cause the dump to abort.

Query (0x7f986a022088): DELETE LOW_PRIORITY QUICK  FROM `table2_key_pk_parts_2_int_autoinc` WHERE `col_char_12_key` IN ( 332464128 , 3 , 25 , 'v' , 6 ) ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 3

Connection ID (thread ID): 19

Status: NOT_KILLED

Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on

The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains

information that should help you find out what is causing the crash.

Writing a core file

Aborted (core dumped)

# 2014-10-03T11:40:31 [19165] datadir is /home/jan/mysql/galera-test/node1/data/

# 2014-10-03T11:40:31 [19165] binary is /home/jan/mysql/10.0-galera/sql/mysqld

# 2014-10-03T11:40:31 [19165] bindir is /home/jan/mysql/10.0-galera/sql

# 2014-10-03T11:40:31 [19165] core is /home/jan/mysql/galera-test/node1/data/core

gdb: /usr/local/lib/liblzma.so.5: no version information available (required by gdb)

61	../nptl/sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.

warning: backtrace.gdb: No such file or directory

# 2014-10-03T11:40:43 [19165] [New LWP 20128]

# 2014-10-03T11:40:43 [19165] [New LWP 19702]

# 2014-10-03T11:40:43 [19165] [New LWP 20131]

# 2014-10-03T11:40:43 [19165] [New LWP 19704]

# 2014-10-03T11:40:43 [19165] [New LWP 19845]

# 2014-10-03T11:40:43 [19165] [New LWP 19846]

# 2014-10-03T11:40:43 [19165] [New LWP 19866]

# 2014-10-03T11:40:43 [19165] [New LWP 20133]

# 2014-10-03T11:40:43 [19165] [New LWP 19858]

# 2014-10-03T11:40:43 [19165] [New LWP 19848]

# 2014-10-03T11:40:43 [19165] [New LWP 20099]

# 2014-10-03T11:40:43 [19165] [New LWP 19700]

# 2014-10-03T11:40:43 [19165] [New LWP 20096]

# 2014-10-03T11:40:43 [19165] [New LWP 19853]

# 2014-10-03T11:40:43 [19165] [New LWP 19703]

# 2014-10-03T11:40:43 [19165] [New LWP 20112]

# 2014-10-03T11:40:43 [19165] [New LWP 20098]

# 2014-10-03T11:40:43 [19165] [New LWP 19854]

# 2014-10-03T11:40:43 [19165] [New LWP 20127]

# 2014-10-03T11:40:43 [19165] [New LWP 20115]

# 2014-10-03T11:40:43 [19165] [New LWP 19860]

# 2014-10-03T11:40:43 [19165] [New LWP 19693]

# 2014-10-03T11:40:43 [19165] [New LWP 19863]

# 2014-10-03T11:40:43 [19165] [New LWP 19851]

# 2014-10-03T11:40:43 [19165] [New LWP 19867]

# 2014-10-03T11:40:43 [19165] [New LWP 20113]

# 2014-10-03T11:40:43 [19165] [New LWP 20129]

# 2014-10-03T11:40:43 [19165] [New LWP 20111]

# 2014-10-03T11:40:43 [19165] [New LWP 20097]

# 2014-10-03T11:40:43 [19165] [New LWP 20086]

# 2014-10-03T11:40:43 [19165] [New LWP 20114]

# 2014-10-03T11:40:43 [19165] [New LWP 20132]

# 2014-10-03T11:40:43 [19165] [New LWP 19872]

# 2014-10-03T11:40:43 [19165] [New LWP 19868]

# 2014-10-03T11:40:43 [19165] [New LWP 19865]

# 2014-10-03T11:40:43 [19165] [New LWP 19864]

# 2014-10-03T11:40:43 [19165] [New LWP 19862]

# 2014-10-03T11:40:43 [19165] [New LWP 19861]

# 2014-10-03T11:40:43 [19165] [New LWP 19859]

# 2014-10-03T11:40:43 [19165] [New LWP 19855]

# 2014-10-03T11:40:43 [19165] [New LWP 19852]

# 2014-10-03T11:40:43 [19165] [New LWP 19850]

# 2014-10-03T11:40:43 [19165] [New LWP 19849]

# 2014-10-03T11:40:43 [19165] [New LWP 19847]

# 2014-10-03T11:40:43 [19165] [New LWP 19701]

# 2014-10-03T11:40:43 [19165] [Thread debugging using libthread_db enabled]

# 2014-10-03T11:40:43 [19165] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".

# 2014-10-03T11:40:43 [19165] Core was generated by `/home/jan/mysql/10.0-galera/sql/mysqld --no-defaults --basedir=/home/jan/mysql/'.

# 2014-10-03T11:40:43 [19165] Program terminated with signal SIGABRT, Aborted.

# 2014-10-03T11:40:43 [19165] #0  0x00007f98a7f5a621 in __pthread_kill (threadid=<optimized out>, signo=6) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61

gdb: /usr/local/lib/liblzma.so.5: no version information available (required by gdb)

61	../nptl/sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.

warning: backtrace-all.gdb: No such file or directory

# 2014-10-03T11:40:45 [19165] [New LWP 20128]

# 2014-10-03T11:40:45 [19165] [New LWP 19702]

# 2014-10-03T11:40:45 [19165] [New LWP 20131]

# 2014-10-03T11:40:45 [19165] [New LWP 19704]

# 2014-10-03T11:40:45 [19165] [New LWP 19845]

# 2014-10-03T11:40:45 [19165] [New LWP 19846]

# 2014-10-03T11:40:45 [19165] [New LWP 19866]

# 2014-10-03T11:40:45 [19165] [New LWP 20133]

# 2014-10-03T11:40:45 [19165] [New LWP 19858]

# 2014-10-03T11:40:45 [19165] [New LWP 19848]

# 2014-10-03T11:40:45 [19165] [New LWP 20099]

# 2014-10-03T11:40:45 [19165] [New LWP 19700]

# 2014-10-03T11:40:45 [19165] [New LWP 20096]

# 2014-10-03T11:40:45 [19165] [New LWP 19853]

# 2014-10-03T11:40:45 [19165] [New LWP 19703]

# 2014-10-03T11:40:45 [19165] [New LWP 20112]

# 2014-10-03T11:40:45 [19165] [New LWP 20098]

# 2014-10-03T11:40:45 [19165] [New LWP 19854]

# 2014-10-03T11:40:45 [19165] [New LWP 20127]

# 2014-10-03T11:40:45 [19165] [New LWP 20115]

# 2014-10-03T11:40:45 [19165] [New LWP 19860]

# 2014-10-03T11:40:45 [19165] [New LWP 19693]

# 2014-10-03T11:40:45 [19165] [New LWP 19863]

# 2014-10-03T11:40:45 [19165] [New LWP 19851]

# 2014-10-03T11:40:45 [19165] [New LWP 19867]

# 2014-10-03T11:40:45 [19165] [New LWP 20113]

# 2014-10-03T11:40:45 [19165] [New LWP 20129]

# 2014-10-03T11:40:45 [19165] [New LWP 20111]

# 2014-10-03T11:40:45 [19165] [New LWP 20097]

# 2014-10-03T11:40:45 [19165] [New LWP 20086]

# 2014-10-03T11:40:45 [19165] [New LWP 20114]

# 2014-10-03T11:40:45 [19165] [New LWP 20132]

# 2014-10-03T11:40:45 [19165] [New LWP 19872]

# 2014-10-03T11:40:45 [19165] [New LWP 19868]

# 2014-10-03T11:40:45 [19165] [New LWP 19865]

# 2014-10-03T11:40:45 [19165] [New LWP 19864]

# 2014-10-03T11:40:45 [19165] [New LWP 19862]

# 2014-10-03T11:40:45 [19165] [New LWP 19861]

# 2014-10-03T11:40:45 [19165] [New LWP 19859]

# 2014-10-03T11:40:45 [19165] [New LWP 19855]

# 2014-10-03T11:40:45 [19165] [New LWP 19852]

# 2014-10-03T11:40:45 [19165] [New LWP 19850]

# 2014-10-03T11:40:45 [19165] [New LWP 19849]

# 2014-10-03T11:40:45 [19165] [New LWP 19847]

# 2014-10-03T11:40:45 [19165] [New LWP 19701]

# 2014-10-03T11:40:45 [19165] [Thread debugging using libthread_db enabled]

# 2014-10-03T11:40:45 [19165] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".

# 2014-10-03T11:40:45 [19165] Core was generated by `/home/jan/mysql/10.0-galera/sql/mysqld --no-defaults --basedir=/home/jan/mysql/'.

# 2014-10-03T11:40:45 [19165] Program terminated with signal SIGABRT, Aborted.

# 2014-10-03T11:40:45 [19165] #0  0x00007f98a7f5a621 in __pthread_kill (threadid=<optimized out>, signo=6) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61

# 2014-10-03T11:40:45 [19165] The last 100 lines from /home/jan/mysql/galera-test/node2/data//../mysql.err :

141003 11:26:53 [Note] InnoDB: Database was not shutdown normally!

141003 11:26:53 [Note] InnoDB: Starting crash recovery.

141003 11:26:53 [Note] InnoDB: Reading tablespace information from the .ibd files...

141003 11:26:53 [Note] InnoDB: Restoring possible half-written data pages 

141003 11:26:53 [Note] InnoDB: from the doublewrite buffer...

141003 11:26:55 [Note] InnoDB: 128 rollback segment(s) are active.

141003 11:26:56 [Note] InnoDB: Waiting for purge to start

141003 11:26:56 [Note] InnoDB:  Percona XtraDB (http://www.percona.com) 5.6.19-67.0 started; log sequence number 1616871

141003 11:26:56 [Note] Server socket created on IP: '::'.

141003 11:26:56 [Note] Event Scheduler: Loaded 0 events

141003 11:26:56 [Note] WSREP: Signalling provider to continue.

141003 11:26:56 [Note] WSREP: SST received: f4b9ca7d-4ad6-11e4-964b-5b14e3a83a76:0

141003 11:26:56 [Note] WSREP: 0.0 (jan-GE70-0NC-0ND): State transfer from 1.0 (jan-GE70-0NC-0ND) complete.

141003 11:26:56 [Note] WSREP: Shifting JOINER -> JOINED (TO: 0)

141003 11:26:56 [Note] WSREP: Member 0.0 (jan-GE70-0NC-0ND) synced with group.

141003 11:26:56 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 0)

141003 11:26:56 [Note] WSREP: Synchronized with group, ready for connections

141003 11:26:56 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.

141003 11:26:56 [Note] /home/jan/mysql/10.0-galera/sql/mysqld: ready for connections.

Version: '10.0.13-MariaDB-wsrep-debug-log'  socket: '/home/jan/mysql/galera-test/node2/mysql.sock'  port: 19302  Source distribution, wsrep_25.10.r4123

141003 11:30:01 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:30:11 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:30:44 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:31:04 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:31:09 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:31:10 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:31:15 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:31:47 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:31:53 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:32:53 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:33:01 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:33:44 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:33:44 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:33:44 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:33:44 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:33:44 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:33:44 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:33:56 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:34:35 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:34:35 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:34:40 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:35:37 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:36:35 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:36:35 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:37:18 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:37:26 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:37:27 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:38:18 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:38:19 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:38:20 [ERROR] mysqld: Lock wait timeout exceeded; try restarting transaction

141003 11:39:12 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:12 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:43 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:50 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:50 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:50 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:51 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:55 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:56 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:39:56 [ERROR] mysqld: Deadlock found when trying to get lock; try restarting transaction

141003 11:40:17 [Note] WSREP: (00c97b90-4ad7-11e4-9101-3ec8ad0f661d, 'tcp://127.0.0.1:4802') turning message relay requesting on, nonlive peers: tcp://127.0.0.1:4801 

141003 11:40:18 [Note] WSREP: (00c97b90-4ad7-11e4-9101-3ec8ad0f661d, 'tcp://127.0.0.1:4802') reconnecting to f72324d3-4ad6-11e4-a5a3-5ef8d4dc6573 (tcp://127.0.0.1:4801), attempt 0

141003 11:40:19 [Note] WSREP: evs::proto(00c97b90-4ad7-11e4-9101-3ec8ad0f661d, OPERATIONAL, view_id(REG,00c97b90-4ad7-11e4-9101-3ec8ad0f661d,3)) suspecting node: f72324d3-4ad6-11e4-a5a3-5ef8d4dc6573

141003 11:40:20 [Note] WSREP: evs::proto(00c97b90-4ad7-11e4-9101-3ec8ad0f661d, GATHER, view_id(REG,00c97b90-4ad7-11e4-9101-3ec8ad0f661d,3)) suspecting node: f72324d3-4ad6-11e4-a5a3-5ef8d4dc6573

141003 11:40:20 [Note] WSREP: evs::proto(00c97b90-4ad7-11e4-9101-3ec8ad0f661d, GATHER, view_id(REG,00c97b90-4ad7-11e4-9101-3ec8ad0f661d,3)) suspecting node: f72324d3-4ad6-11e4-a5a3-5ef8d4dc6573

141003 11:40:21 [Note] WSREP: declaring f4b8ee21-4ad6-11e4-8d76-7640357fee10 stable

141003 11:40:22 [Note] WSREP: Node 00c97b90-4ad7-11e4-9101-3ec8ad0f661d state prim

141003 11:40:22 [Note] WSREP: view(view_id(PRIM,00c97b90-4ad7-11e4-9101-3ec8ad0f661d,4) memb {

	00c97b90-4ad7-11e4-9101-3ec8ad0f661d,0

	f4b8ee21-4ad6-11e4-8d76-7640357fee10,0

} joined {

} left {

} partitioned {

	f72324d3-4ad6-11e4-a5a3-5ef8d4dc6573,0

})

141003 11:40:22 [Note] WSREP: forgetting f72324d3-4ad6-11e4-a5a3-5ef8d4dc6573 (tcp://127.0.0.1:4801)

141003 11:40:22 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2

141003 11:40:22 [Note] WSREP: (00c97b90-4ad7-11e4-9101-3ec8ad0f661d, 'tcp://127.0.0.1:4802') turning message relay requesting off

141003 11:40:22 [Note] WSREP: STATE_EXCHANGE: sent state UUID: ea0a04c3-4ad8-11e4-8d50-829089ae2380

141003 11:40:22 [Note] WSREP: STATE EXCHANGE: sent state msg: ea0a04c3-4ad8-11e4-8d50-829089ae2380

141003 11:40:22 [Note] WSREP: STATE EXCHANGE: got state msg: ea0a04c3-4ad8-11e4-8d50-829089ae2380 from 0 (jan-GE70-0NC-0ND)

141003 11:40:22 [Note] WSREP: STATE EXCHANGE: got state msg: ea0a04c3-4ad8-11e4-8d50-829089ae2380 from 1 (jan-GE70-0NC-0ND)

141003 11:40:22 [Note] WSREP: Quorum results:

	version    = 3,

	component  = PRIMARY,

	conf_id    = 3,

	members    = 2/2 (joined/total),

	act_id     = 660,

	last_appl. = 640,

	protocols  = 0/5/3 (gcs/repl/appl),

	group UUID = f4b9ca7d-4ad6-11e4-964b-5b14e3a83a76

141003 11:40:22 [Note] WSREP: Flow-control interval: [23, 23]

141003 11:40:27 [Note] WSREP:  cleaning up f72324d3-4ad6-11e4-a5a3-5ef8d4dc6573 (tcp://127.0.0.1:4801)

141003 11:40:30 [Note] WSREP: New cluster view: global state: f4b9ca7d-4ad6-11e4-964b-5b14e3a83a76:660, view# 4: Primary, number of nodes: 2, my index: 0, protocol version 3

141003 11:40:30 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.

141003 11:40:30 [Note] WSREP: REPL Protocols: 5 (3, 1)

141003 11:40:30 [Note] WSREP: Service thread queue flushed.

141003 11:40:30 [Note] WSREP: Assign initial position for certification: 660, protocol version: 3

141003 11:40:30 [Note] WSREP: Service thread queue flushed.

141003 11:40:30 [Warning] WSREP: Releasing seqno 660 before 661 was assigned.

# 2014-10-03T11:40:45 [19165] datadir is /home/jan/mysql/galera-test/node2/data/

# 2014-10-03T11:40:45 [19165] binary is /home/jan/mysql/10.0-galera/sql/mysqld

# 2014-10-03T11:40:45 [19165] bindir is /home/jan/mysql/10.0-galera/sql

# 2014-10-03T11:40:45 [19165] WARNING: Core file not found!

gdb: /usr/local/lib/liblzma.so.5: no version information available (required by gdb)

"/home/jan/mysql/mariadb-patches" is not a core dump: Is a directory

warning: backtrace.gdb: No such file or directory

# 2014-10-03T11:40:45 [19165] 

gdb: /usr/local/lib/liblzma.so.5: no version information available (required by gdb)

"/home/jan/mysql/mariadb-patches" is not a core dump: Is a directory

warning: backtrace-all.gdb: No such file or directory

# 2014-10-03T11:40:46 [19165] 

# 2014-10-03T11:40:46 [19165] Test completed with failure status STATUS_SERVER_CRASHED (101)

# 2014-10-03T11:40:46 [19165] GenTest exited with exit status STATUS_SERVER_CRASHED (101)

# 2014-10-03T11:40:46 [19165] Stopping server on port 19300

# 2014-10-03T11:40:46 [19165] Stale connection to 19300. Reconnecting

# 2014-10-03T11:40:46 [19165] Stopping server on port 19301

# 2014-10-03T11:40:46 [19165] Stale connection to 19301. Reconnecting

# 2014-10-03T11:40:46 [19165] ERROR: (Re)connect to 19301 failed due to 2003: Can't connect to MySQL server on '127.0.0.1' (111)

# 2014-10-03T11:40:46 [19165] Server would not shut down properly. Terminate it

# 2014-10-03T11:40:46 [19165] Terminated process 19693

# 2014-10-03T11:40:46 [19165] Stopping server on port 19302

# 2014-10-03T11:40:46 [19165] Stale connection to 19302. Reconnecting

# 2014-10-03T11:40:46 [19165] [19165] ./runall-new.pl will exit with exit status STATUS_SERVER_CRASHED (101)

 (gdb) thread apply all bt

Thread 32 (Thread 0x7f848fbff700 (LWP 22091)):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00007f848e96899e in wait (this=0x7f848fbfece0, cond=...) at galerautils/src/gu_lock.hpp:56

#2  galera::ServiceThd::thd_func (arg=0x7f848fd1b320) at galera/src/galera_service_thd.cpp:30

#3  0x00007f8491189182 in start_thread (arg=0x7f848fbff700) at pthread_create.c:312

#4  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 31 (Thread 0x7f8483bff700 (LWP 22092)):

#0  0x00007f84908ac653 in epoll_wait () at ../sysdeps/unix/syscall-template.S:81

#1  0x00007f848e927834 in asio::detail::epoll_reactor::run (this=0x7f848fcb1d80, block=<optimized out>, ops=...) at asio/asio/detail/impl/epoll_reactor.ipp:239

#2  0x00007f848e928564 in do_one (this_idle_thread=<optimized out>, lock=..., this=<optimized out>) at asio/asio/detail/impl/task_io_service.ipp:263

#3  asio::detail::task_io_service::run (this=0x7f848fc887a0, ec=...) at asio/asio/detail/impl/task_io_service.ipp:129

#4  0x00007f848e926256 in run (this=0x7f848fc22d20) at asio/asio/impl/io_service.ipp:56

#5  gcomm::AsioProtonet::event_loop (this=0x7f848fc22c80, period=...) at gcomm/src/asio_protonet.cpp:244

#6  0x00007f848e93f916 in GCommConn::run (this=0x7f848feb9280) at gcs/src/gcs_gcomm.cpp:454

#7  0x00007f848e944919 in GCommConn::run_fn (arg=<optimized out>) at gcs/src/gcs_gcomm.cpp:207

#8  0x00007f8491189182 in start_thread (arg=0x7f8483bff700) at pthread_create.c:312

#9  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 30 (Thread 0x7f8482bff700 (LWP 22093)):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00007f848e93c4bb in wait (this=0x7f8482bfe180, cond=...) at galerautils/src/gu_lock.hpp:56

#2  front (timeout=..., this=0x7f848feb93e0) at gcs/src/gcs_gcomm.cpp:124

#3  gcomm_recv (backend=<optimized out>, msg=0x7f848fc27c60, timeout=9223372035999999999) at gcs/src/gcs_gcomm.cpp:591

#4  0x00007f848e932fb0 in core_msg_recv (timeout=9223372035999999999, recv_msg=0x7f848fc27c60, backend=0x7f848fc27d78) at gcs/src/gcs_core.c:461

#5  gcs_core_recv (conn=0x7f848fc27c00, recv_act=recv_act@entry=0x7f8482bfedf0, timeout=<optimized out>) at gcs/src/gcs_core.c:1046

#6  0x00007f848e93898b in gcs_recv_thread (arg=0x7f848fc27a00) at gcs/src/gcs.c:1115

#7  0x00007f8491189182 in start_thread (arg=0x7f8482bff700) at pthread_create.c:312

#8  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 29 (Thread 0x7f8491de4700 (LWP 22094)):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x0000000000678adf in inline_mysql_cond_wait (that=<optimized out>, mutex=<optimized out>, src_file=0xa969d8 "/home/jan/mysql/maria-5.5-galera/sql/wsrep_thd.cc", src_line=343) at /home/jan/mysql/maria-5.5-galera/include/mysql/psi/mysql_thread.h:986

#2  wsrep_rollback_process (thd=0x7f8481812000) at /home/jan/mysql/maria-5.5-galera/sql/wsrep_thd.cc:343

#3  0x000000000051ef15 in start_wsrep_THD (arg=0x6784f0 <wsrep_rollback_process(THD*)>) at /home/jan/mysql/maria-5.5-galera/sql/mysqld.cc:4887

#4  0x00007f8491189182 in start_thread (arg=0x7f8491de4700) at pthread_create.c:312

#5  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 28 (Thread 0x7f8491d9b700 (LWP 22095)):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00000000009b6716 in os_cond_wait (mutex=0x7f846fbc2c80, cond=0x7f846fbc2cb8) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0sync.c:207

#2  os_event_wait_low (event=event@entry=0x7f846fbc2c80, reset_sig_count=141, reset_sig_count@entry=0) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0sync.c:609

#3  0x00000000008e957f in srv_suspend_mysql_thread (thr=thr@entry=0x7f845bc18748) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0srv.c:1996

#4  0x00000000008d0781 in row_mysql_handle_errors (new_err=new_err@entry=0x7f8491d97a58, trx=trx@entry=0x7f84814a7478, thr=thr@entry=0x7f845bc18748, savept=savept@entry=0x0) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/row/row0mysql.c:600

#5  0x00000000008ddb95 in row_search_for_mysql (buf=<optimized out>, mode=2, prebuilt=0x7f845bc18078, match_mode=<optimized out>, direction=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/row/row0sel.c:4930

#6  0x00000000008b4058 in ha_innobase::index_read (this=0x7f845bc16018, buf=0x7f845bc24830 "\377\062\063\071        ", <incomplete sequence \320>, key_ptr=0x7f845bc85ee2 "\300\001", key_len=4, find_flag=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/handler/ha_innodb.cc:7729

#7  0x00000000008b6636 in ha_innobase::rnd_pos (this=0x7f845bc16018, buf=0x7f845bc24830 "\377\062\063\071        ", <incomplete sequence \320>, pos=0x7f845bc85ee2 "\300\001") at /home/jan/mysql/maria-5.5-galera/storage/xtradb/handler/ha_innodb.cc:8236

#8  0x000000000076da69 in ha_rnd_pos_by_record (buf=<optimized out>, this=0x7f845bc60618) at /home/jan/mysql/maria-5.5-galera/sql/sql_class.h:4413

#9  Rows_log_event::find_row (this=this@entry=0x7f8482c48500, rli=rli@entry=0x7f8481435000) at /home/jan/mysql/maria-5.5-galera/sql/log_event.cc:10642

#10 0x000000000076e29f in Update_rows_log_event::do_exec_row (this=0x7f8482c48500, rli=0x7f8481435000) at /home/jan/mysql/maria-5.5-galera/sql/log_event.cc:11114

#11 0x0000000000762b7d in Rows_log_event::do_apply_event (this=<optimized out>, rli=0x7f8481435000) at /home/jan/mysql/maria-5.5-galera/sql/log_event.cc:8639

#12 0x00000000006773bb in apply_event (rli=<optimized out>, this=<optimized out>) at /home/jan/mysql/maria-5.5-galera/sql/log_event.h:1256

#13 wsrep_apply_events (buf_len=577, events_buf=0x7f84861d8bdf, thd=0x7f8481412000) at /home/jan/mysql/maria-5.5-galera/sql/wsrep_applier.cc:128

#14 wsrep_apply_cb (ctx=0x7f8481412000, buf=0x7f84861d8bdf, buf_len=825, flags=<optimized out>, meta=<optimized out>) at /home/jan/mysql/maria-5.5-galera/sql/wsrep_applier.cc:230

#15 0x00007f848e9517c8 in galera::TrxHandle::apply (this=this@entry=0x7f848155b200, recv_ctx=recv_ctx@entry=0x7f8481412000, apply_cb=apply_cb@entry=0x676dc0 <wsrep_apply_cb(void*, void const*, unsigned long, unsigned int, wsrep_trx_meta const*)>, meta=...) at galera/src/trx_handle.cpp:304

#16 0x00007f848e98aeed in apply_trx_ws (recv_ctx=recv_ctx@entry=0x7f8481412000, apply_cb=0x676dc0 <wsrep_apply_cb(void*, void const*, unsigned long, unsigned int, wsrep_trx_meta const*)>, commit_cb=0x677840 <wsrep_commit_cb(void*, unsigned int, wsrep_trx_meta const*, bool*, bool)>, trx=..., meta=...) at galera/src/replicator_smm.cpp:39

#17 0x00007f848e98d6f2 in galera::ReplicatorSMM::apply_trx (this=this@entry=0x7f848fd1ae00, recv_ctx=recv_ctx@entry=0x7f8481412000, trx=trx@entry=0x7f848155b200) at galera/src/replicator_smm.cpp:421

#18 0x00007f848e99055e in galera::ReplicatorSMM::process_trx (this=0x7f848fd1ae00, recv_ctx=0x7f8481412000, trx=0x7f848155b200) at galera/src/replicator_smm.cpp:1213

#19 0x00007f848e96ea99 in galera::GcsActionSource::dispatch (this=this@entry=0x7f848fd1b3f0, recv_ctx=recv_ctx@entry=0x7f8481412000, act=..., exit_loop=@0x7f8491d9a1e0: false) at galera/src/gcs_action_source.cpp:118

#20 0x00007f848e96f98c in galera::GcsActionSource::process (this=0x7f848fd1b3f0, recv_ctx=0x7f8481412000, exit_loop=@0x7f8491d9a1e0: false) at galera/src/gcs_action_source.cpp:175

#21 0x00007f848e990abb in galera::ReplicatorSMM::async_recv (this=0x7f848fd1ae00, recv_ctx=0x7f8481412000) at galera/src/replicator_smm.cpp:356

#22 0x00007f848e99e628 in galera_recv (gh=<optimized out>, recv_ctx=<optimized out>) at galera/src/wsrep_provider.cpp:231

#23 0x0000000000677ef8 in wsrep_replication_process (thd=0x7f8481412000) at /home/jan/mysql/maria-5.5-galera/sql/wsrep_thd.cc:253

#24 0x000000000051ef15 in start_wsrep_THD (arg=0x677ea0 <wsrep_replication_process(THD*)>) at /home/jan/mysql/maria-5.5-galera/sql/mysqld.cc:4887

#25 0x00007f8491189182 in start_thread (arg=0x7f8491d9b700) at pthread_create.c:312

#26 0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 27 (Thread 0x7f84813ff700 (LWP 22241)):

#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238

#1  0x000000000080e77e in inline_mysql_cond_timedwait (src_file=0xb6b7e8 "/home/jan/mysql/maria-5.5-galera/storage/maria/ma_servicethread.c", src_line=119, abstime=0x7f84813feda0, mutex=0x19606c0 <LOCK_checkpoint>, that=0x1960680 <COND_checkpoint>) at /home/jan/mysql/maria-5.5-galera/include/mysql/psi/mysql_thread.h:1020

#2  my_service_thread_sleep (control=control@entry=0x111ec80 <checkpoint_control>, sleep_time=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/maria/ma_servicethread.c:118

#3  0x0000000000807d10 in ma_checkpoint_background (arg=0x1e) at /home/jan/mysql/maria-5.5-galera/storage/maria/ma_checkpoint.c:705

#4  0x00007f8491189182 in start_thread (arg=0x7f84813ff700) at pthread_create.c:312

#5  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 26 (Thread 0x7f8465bff700 (LWP 22242)):

#0  0x00007f84919f558a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1

#1  0x00000000009b4984 in os_aio_linux_collect (seg_size=256, segment=<optimized out>, array=0x7f848feb86f0) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4708

#2  os_aio_linux_handle (global_seg=global_seg@entry=0, message1=message1@entry=0x7f8465bfee00, message2=message2@entry=0x7f8465bfee08, type=type@entry=0x7f8465bfee10, space_id=space_id@entry=0x7f8465bfee18) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4854

#3  0x0000000000971515 in fil_aio_wait (segment=segment@entry=0) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/fil/fil0fil.c:5697

#4  0x00000000008ee698 in io_handler_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0start.c:493

#5  0x00007f8491189182 in start_thread (arg=0x7f8465bff700) at pthread_create.c:312

#6  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 25 (Thread 0x7f84653fe700 (LWP 22243)):

#0  0x00007f84919f558a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1

#1  0x00000000009b4984 in os_aio_linux_collect (seg_size=256, segment=<optimized out>, array=0x7f848feb87e0) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4708

#2  os_aio_linux_handle (global_seg=global_seg@entry=1, message1=message1@entry=0x7f84653fde00, message2=message2@entry=0x7f84653fde08, type=type@entry=0x7f84653fde10, space_id=space_id@entry=0x7f84653fde18) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4854

#3  0x0000000000971515 in fil_aio_wait (segment=segment@entry=1) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/fil/fil0fil.c:5697

#4  0x00000000008ee698 in io_handler_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0start.c:493

#5  0x00007f8491189182 in start_thread (arg=0x7f84653fe700) at pthread_create.c:312

#6  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 24 (Thread 0x7f8464bfd700 (LWP 22244)):

#0  0x00007f84919f558a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1

#1  0x00000000009b4984 in os_aio_linux_collect (seg_size=256, segment=<optimized out>, array=0x7f848feb8830) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4708

#2  os_aio_linux_handle (global_seg=global_seg@entry=2, message1=message1@entry=0x7f8464bfce00, message2=message2@entry=0x7f8464bfce08, type=type@entry=0x7f8464bfce10, space_id=space_id@entry=0x7f8464bfce18) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4854

#3  0x0000000000971515 in fil_aio_wait (segment=segment@entry=2) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/fil/fil0fil.c:5697

#4  0x00000000008ee698 in io_handler_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0start.c:493

#5  0x00007f8491189182 in start_thread (arg=0x7f8464bfd700) at pthread_create.c:312

#6  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 23 (Thread 0x7f84643fc700 (LWP 22245)):

#0  0x00007f84919f558a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1

#1  0x00000000009b4984 in os_aio_linux_collect (seg_size=256, segment=<optimized out>, array=0x7f848feb8830) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4708

#2  os_aio_linux_handle (global_seg=global_seg@entry=3, message1=message1@entry=0x7f84643fbe00, message2=message2@entry=0x7f84643fbe08, type=type@entry=0x7f84643fbe10, space_id=space_id@entry=0x7f84643fbe18) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4854

#3  0x0000000000971515 in fil_aio_wait (segment=segment@entry=3) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/fil/fil0fil.c:5697

#4  0x00000000008ee698 in io_handler_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0start.c:493

#5  0x00007f8491189182 in start_thread (arg=0x7f84643fc700) at pthread_create.c:312

#6  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 22 (Thread 0x7f8463bfb700 (LWP 22246)):

#0  0x00007f84919f558a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1

#1  0x00000000009b4984 in os_aio_linux_collect (seg_size=256, segment=<optimized out>, array=0x7f848feb8830) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4708

#2  os_aio_linux_handle (global_seg=global_seg@entry=4, message1=message1@entry=0x7f8463bfae00, message2=message2@entry=0x7f8463bfae08, type=type@entry=0x7f8463bfae10, space_id=space_id@entry=0x7f8463bfae18) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4854

#3  0x0000000000971515 in fil_aio_wait (segment=segment@entry=4) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/fil/fil0fil.c:5697

#4  0x00000000008ee698 in io_handler_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0start.c:493

#5  0x00007f8491189182 in start_thread (arg=0x7f8463bfb700) at pthread_create.c:312

#6  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 21 (Thread 0x7f84633fa700 (LWP 22247)):

#0  0x00007f84919f558a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1

#1  0x00000000009b4984 in os_aio_linux_collect (seg_size=256, segment=<optimized out>, array=0x7f848feb8830) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4708

#2  os_aio_linux_handle (global_seg=global_seg@entry=5, message1=message1@entry=0x7f84633f9e00, message2=message2@entry=0x7f84633f9e08, type=type@entry=0x7f84633f9e10, space_id=space_id@entry=0x7f84633f9e18) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4854

#3  0x0000000000971515 in fil_aio_wait (segment=segment@entry=5) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/fil/fil0fil.c:5697

#4  0x00000000008ee698 in io_handler_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0start.c:493

#5  0x00007f8491189182 in start_thread (arg=0x7f84633fa700) at pthread_create.c:312

#6  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 20 (Thread 0x7f8462bf9700 (LWP 22248)):

#0  0x00007f84919f558a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1

#1  0x00000000009b4984 in os_aio_linux_collect (seg_size=256, segment=<optimized out>, array=0x7f848feb8880) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4708

#2  os_aio_linux_handle (global_seg=global_seg@entry=6, message1=message1@entry=0x7f8462bf8e00, message2=message2@entry=0x7f8462bf8e08, type=type@entry=0x7f8462bf8e10, space_id=space_id@entry=0x7f8462bf8e18) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4854

#3  0x0000000000971515 in fil_aio_wait (segment=segment@entry=6) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/fil/fil0fil.c:5697

#4  0x00000000008ee698 in io_handler_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0start.c:493

#5  0x00007f8491189182 in start_thread (arg=0x7f8462bf9700) at pthread_create.c:312

#6  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 19 (Thread 0x7f84623f8700 (LWP 22249)):

#0  0x00007f84919f558a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1

#1  0x00000000009b4984 in os_aio_linux_collect (seg_size=256, segment=<optimized out>, array=0x7f848feb8880) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4708

#2  os_aio_linux_handle (global_seg=global_seg@entry=7, message1=message1@entry=0x7f84623f7e00, message2=message2@entry=0x7f84623f7e08, type=type@entry=0x7f84623f7e10, space_id=space_id@entry=0x7f84623f7e18) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4854

#3  0x0000000000971515 in fil_aio_wait (segment=segment@entry=7) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/fil/fil0fil.c:5697

#4  0x00000000008ee698 in io_handler_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0start.c:493

#5  0x00007f8491189182 in start_thread (arg=0x7f84623f8700) at pthread_create.c:312

#6  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 18 (Thread 0x7f8461bf7700 (LWP 22250)):

#0  0x00007f84919f558a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1

#1  0x00000000009b4984 in os_aio_linux_collect (seg_size=256, segment=<optimized out>, array=0x7f848feb8880) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4708

#2  os_aio_linux_handle (global_seg=global_seg@entry=8, message1=message1@entry=0x7f8461bf6e00, message2=message2@entry=0x7f8461bf6e08, type=type@entry=0x7f8461bf6e10, space_id=space_id@entry=0x7f8461bf6e18) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4854

#3  0x0000000000971515 in fil_aio_wait (segment=segment@entry=8) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/fil/fil0fil.c:5697

#4  0x00000000008ee698 in io_handler_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0start.c:493

#5  0x00007f8491189182 in start_thread (arg=0x7f8461bf7700) at pthread_create.c:312

#6  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 17 (Thread 0x7f84613f6700 (LWP 22251)):

#0  0x00007f84919f558a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1

#1  0x00000000009b4984 in os_aio_linux_collect (seg_size=256, segment=<optimized out>, array=0x7f848feb8880) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4708

#2  os_aio_linux_handle (global_seg=global_seg@entry=9, message1=message1@entry=0x7f84613f5e00, message2=message2@entry=0x7f84613f5e08, type=type@entry=0x7f84613f5e10, space_id=space_id@entry=0x7f84613f5e18) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0file.c:4854

#3  0x0000000000971515 in fil_aio_wait (segment=segment@entry=9) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/fil/fil0fil.c:5697

#4  0x00000000008ee698 in io_handler_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0start.c:493

#5  0x00007f8491189182 in start_thread (arg=0x7f84613f6700) at pthread_create.c:312

#6  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 16 (Thread 0x7f845f3fe700 (LWP 22253)):

#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238

#1  0x00000000009b67fd in os_cond_wait_timed (abstime=0x7f845f3fddd0, mutex=0x7f846f5cf480, cond=0x7f846f5cf4b8) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0sync.c:171

#2  os_event_wait_time_low (event=0x7f846f5cf480, time_in_usec=time_in_usec@entry=1000000, reset_sig_count=1) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0sync.c:716

#3  0x00000000008eb2c8 in srv_lock_timeout_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0srv.c:2936

#4  0x00007f8491189182 in start_thread (arg=0x7f845f3fe700) at pthread_create.c:312

#5  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 15 (Thread 0x7f845fbff700 (LWP 22254)):

#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238

#1  0x00000000009b67fd in os_cond_wait_timed (abstime=0x7f845fbfedc0, mutex=0x7f846f5cf400, cond=0x7f846f5cf438) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0sync.c:171

#2  os_event_wait_time_low (event=0x7f846f5cf400, time_in_usec=time_in_usec@entry=1000000, reset_sig_count=1) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0sync.c:716

#3  0x00000000008eb8bc in srv_error_monitor_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0srv.c:3168

#4  0x00007f8491189182 in start_thread (arg=0x7f845fbff700) at pthread_create.c:312

#5  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 14 (Thread 0x7f845ebfd700 (LWP 22255)):

#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238

#1  0x00000000009b67fd in os_cond_wait_timed (abstime=0x7f845ebfce30, mutex=0x7f846f5cf500, cond=0x7f846f5cf538) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0sync.c:171

#2  os_event_wait_time_low (event=0x7f846f5cf500, time_in_usec=time_in_usec@entry=5000000, reset_sig_count=1) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0sync.c:716

#3  0x00000000008eafdb in srv_monitor_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0srv.c:2765

#4  0x00007f8491189182 in start_thread (arg=0x7f845ebfd700) at pthread_create.c:312

#5  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 13 (Thread 0x7f845e3fc700 (LWP 22256)):

#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238

#1  0x00000000009b67fd in os_cond_wait_timed (abstime=0x7f845e3fbe60, mutex=0x7f846f5cf600, cond=0x7f846f5cf638) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0sync.c:171

#2  os_event_wait_time_low (event=0x7f846f5cf600, time_in_usec=time_in_usec@entry=5000000, reset_sig_count=1, reset_sig_count@entry=0) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0sync.c:716

#3  0x00000000008ebbe3 in srv_LRU_dump_restore_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0srv.c:3214

#4  0x00007f8491189182 in start_thread (arg=0x7f845e3fc700) at pthread_create.c:312

#5  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 12 (Thread 0x7f845dbfb700 (LWP 22257)):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00000000009b6716 in os_cond_wait (mutex=0x7f848fc77580, cond=0x7f848fc775b8) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0sync.c:207

#2  os_event_wait_low (event=0x7f848fc77580, reset_sig_count=89, reset_sig_count@entry=0) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0sync.c:609

#3  0x00000000008ec575 in srv_master_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0srv.c:4245

#4  0x00007f8491189182 in start_thread (arg=0x7f845dbfb700) at pthread_create.c:312

#5  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 11 (Thread 0x7f845d3fa700 (LWP 22258)):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00000000009b6716 in os_cond_wait (mutex=0x7f848fc77500, cond=0x7f848fc77538) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0sync.c:207

#2  os_event_wait_low (event=0x7f848fc77500, reset_sig_count=20, reset_sig_count@entry=0) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/os/os0sync.c:609

#3  0x00000000008ee313 in srv_purge_thread (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/storage/xtradb/srv/srv0srv.c:4314

#4  0x00007f8491189182 in start_thread (arg=0x7f845d3fa700) at pthread_create.c:312

#5  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 10 (Thread 0x7f8491d42700 (LWP 22259)):

#0  0x00007f84911910d1 in do_sigwait (sig=0x7f8491d41d7c, set=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:60

#1  __sigwait (set=0x7f8491d41dd0, sig=0x7f8491d41d7c) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:97

#2  0x000000000051c6af in signal_hand (arg=<optimized out>) at /home/jan/mysql/maria-5.5-galera/sql/mysqld.cc:3223

#3  0x00007f8491189182 in start_thread (arg=0x7f8491d42700) at pthread_create.c:312

#4  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 9 (Thread 0x7f8491cf9700 (LWP 22262)):

#0  0x00007f84911903bd in read () at ../sysdeps/unix/syscall-template.S:81

#1  0x0000000000a29cdd in read (__nbytes=4, __buf=0x7f8466b64000, __fd=<optimized out>) at /usr/include/x86_64-linux-gnu/bits/unistd.h:44

#2  vio_read (vio=0x7f848fc2a800, buf=0x7f8466b64000 "\a", size=4) at /home/jan/mysql/maria-5.5-galera/vio/viosocket.c:72

#3  0x000000000052732a in my_real_read (net=0x7f8466aec218, complen=complen@entry=0x7f8491cf8918) at /home/jan/mysql/maria-5.5-galera/sql/net_serv.cc:840

#4  0x0000000000527ef2 in my_net_read (net=0x7f8466aec218) at /home/jan/mysql/maria-5.5-galera/sql/net_serv.cc:1026

#5  0x000000000059eeb8 in do_command (thd=0x7f8466aec000) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:758

#6  0x000000000063d154 in do_handle_one_connection (thd_arg=thd_arg@entry=0x7f8466aec000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1283

#7  0x000000000063d2d2 in handle_one_connection (arg=0x7f8466aec000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1195

#8  0x00007f8491189182 in start_thread (arg=0x7f8491cf9700) at pthread_create.c:312

#9  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 8 (Thread 0x7f8491cb0700 (LWP 22455)):

#0  0x00007f84911903bd in read () at ../sysdeps/unix/syscall-template.S:81

#1  0x0000000000a29cdd in read (__nbytes=4, __buf=0x7f8466b6e000, __fd=<optimized out>) at /usr/include/x86_64-linux-gnu/bits/unistd.h:44

#2  vio_read (vio=0x7f848fc2ae00, buf=0x7f8466b6e000 "?", size=4) at /home/jan/mysql/maria-5.5-galera/vio/viosocket.c:72

#3  0x000000000052732a in my_real_read (net=0x7f8466b69218, complen=complen@entry=0x7f8491caf918) at /home/jan/mysql/maria-5.5-galera/sql/net_serv.cc:840

#4  0x0000000000527ef2 in my_net_read (net=0x7f8466b69218) at /home/jan/mysql/maria-5.5-galera/sql/net_serv.cc:1026

#5  0x000000000059eeb8 in do_command (thd=0x7f8466b69000) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:758

#6  0x000000000063d154 in do_handle_one_connection (thd_arg=thd_arg@entry=0x7f8466b69000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1283

#7  0x000000000063d2d2 in handle_one_connection (arg=0x7f8466b69000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1195

#8  0x00007f8491189182 in start_thread (arg=0x7f8491cb0700) at pthread_create.c:312

#9  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 7 (Thread 0x7f8491c67700 (LWP 22460)):

#0  0x00007f84911903bd in read () at ../sysdeps/unix/syscall-template.S:81

#1  0x0000000000a29cdd in read (__nbytes=4, __buf=0x7f8466b78000, __fd=<optimized out>) at /usr/include/x86_64-linux-gnu/bits/unistd.h:44

#2  vio_read (vio=0x7f848fc2b000, buf=0x7f8466b78000 "?", size=4) at /home/jan/mysql/maria-5.5-galera/vio/viosocket.c:72

#3  0x000000000052732a in my_real_read (net=0x7f8466b73218, complen=complen@entry=0x7f8491c66918) at /home/jan/mysql/maria-5.5-galera/sql/net_serv.cc:840

#4  0x0000000000527ef2 in my_net_read (net=0x7f8466b73218) at /home/jan/mysql/maria-5.5-galera/sql/net_serv.cc:1026

#5  0x000000000059eeb8 in do_command (thd=0x7f8466b73000) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:758

#6  0x000000000063d154 in do_handle_one_connection (thd_arg=thd_arg@entry=0x7f8466b73000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1283

#7  0x000000000063d2d2 in handle_one_connection (arg=0x7f8466b73000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1195

#8  0x00007f8491189182 in start_thread (arg=0x7f8491c67700) at pthread_create.c:312

#9  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 6 (Thread 0x7f849059a700 (LWP 22465)):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00007f848e995cde in wait (this=0x7f84905969a0, cond=...) at galerautils/src/gu_lock.hpp:56

#2  galera::Monitor<galera::ReplicatorSMM::LocalOrder>::enter (this=this@entry=0x7f848fd1b830, obj=...) at galera/src/monitor.hpp:120

#3  0x00007f848e98f423 in cert (trx=<optimized out>, this=0x7f848fd1ae00) at galera/src/replicator_smm.cpp:1661

#4  galera::ReplicatorSMM::cert_and_catch (this=this@entry=0x7f848fd1ae00, trx=trx@entry=0x7f845c52e000) at galera/src/replicator_smm.cpp:1759

#5  0x00007f848e98fb0b in galera::ReplicatorSMM::pre_commit (this=0x7f848fd1ae00, trx=0x7f845c52e000, meta=<optimized out>) at galera/src/replicator_smm.cpp:717

#6  0x00007f848e99f460 in galera_pre_commit (gh=<optimized out>, conn_id=9, trx_handle=<optimized out>, flags=<optimized out>, meta=0x7f8466b800c8) at galera/src/wsrep_provider.cpp:505

#7  0x000000000066a113 in wsrep_run_wsrep_commit (thd=0x7f8466b7d000, hton=<optimized out>, all=<optimized out>) at /home/jan/mysql/maria-5.5-galera/sql/wsrep_hton.cc:429

#8  0x00000000006bee34 in ha_commit_trans (thd=thd@entry=0x7f8466b7d000, all=all@entry=true) at /home/jan/mysql/maria-5.5-galera/sql/handler.cc:1311

#9  0x0000000000648cc1 in trans_commit (thd=thd@entry=0x7f8466b7d000) at /home/jan/mysql/maria-5.5-galera/sql/transaction.cc:199

#10 0x00000000005943df in mysql_execute_command (thd=thd@entry=0x7f8466b7d000) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:4235

#11 0x000000000059b9b9 in mysql_parse (thd=0x7f8466b7d000, rawbuf=<optimized out>, length=6, parser_state=0x7f8490599200) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:6394

#12 0x000000000059c21c in wsrep_mysql_parse (thd=thd@entry=0x7f8466b7d000, rawbuf=0x7f845c41e018 "COMMIT", length=6, parser_state=parser_state@entry=0x7f8490599200) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:6227

#13 0x000000000059e199 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x7f8466b7d000, packet=packet@entry=0x7f8466b82001 "COMMIT ", packet_length=packet_length@entry=7) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:1254

#14 0x000000000059eb8a in do_command (thd=0x7f8466b7d000) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:876

#15 0x000000000063d154 in do_handle_one_connection (thd_arg=thd_arg@entry=0x7f8466b7d000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1283

#16 0x000000000063d2d2 in handle_one_connection (arg=0x7f8466b7d000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1195

#17 0x00007f8491189182 in start_thread (arg=0x7f849059a700) at pthread_create.c:312

#18 0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 5 (Thread 0x7f8490508700 (LWP 22472)):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00007f848e995cde in wait (this=0x7f84905049a0, cond=...) at galerautils/src/gu_lock.hpp:56

#2  galera::Monitor<galera::ReplicatorSMM::LocalOrder>::enter (this=this@entry=0x7f848fd1b830, obj=...) at galera/src/monitor.hpp:120

#3  0x00007f848e98f423 in cert (trx=<optimized out>, this=0x7f848fd1ae00) at galera/src/replicator_smm.cpp:1661

#4  galera::ReplicatorSMM::cert_and_catch (this=this@entry=0x7f848fd1ae00, trx=trx@entry=0x7f845ad1d000) at galera/src/replicator_smm.cpp:1759

#5  0x00007f848e98fb0b in galera::ReplicatorSMM::pre_commit (this=0x7f848fd1ae00, trx=0x7f845ad1d000, meta=<optimized out>) at galera/src/replicator_smm.cpp:717

#6  0x00007f848e99f460 in galera_pre_commit (gh=<optimized out>, conn_id=11, trx_handle=<optimized out>, flags=<optimized out>, meta=0x7f8466b940c8) at galera/src/wsrep_provider.cpp:505

#7  0x000000000066a113 in wsrep_run_wsrep_commit (thd=0x7f8466b91000, hton=<optimized out>, all=<optimized out>) at /home/jan/mysql/maria-5.5-galera/sql/wsrep_hton.cc:429

#8  0x00000000006bee34 in ha_commit_trans (thd=thd@entry=0x7f8466b91000, all=all@entry=true) at /home/jan/mysql/maria-5.5-galera/sql/handler.cc:1311

#9  0x0000000000648cc1 in trans_commit (thd=thd@entry=0x7f8466b91000) at /home/jan/mysql/maria-5.5-galera/sql/transaction.cc:199

#10 0x00000000005943df in mysql_execute_command (thd=thd@entry=0x7f8466b91000) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:4235

#11 0x000000000059b9b9 in mysql_parse (thd=0x7f8466b91000, rawbuf=<optimized out>, length=6, parser_state=0x7f8490507200) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:6394

#12 0x000000000059c21c in wsrep_mysql_parse (thd=thd@entry=0x7f8466b91000, rawbuf=0x7f845ac1e018 "COMMIT", length=6, parser_state=parser_state@entry=0x7f8490507200) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:6227

#13 0x000000000059e199 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x7f8466b91000, packet=packet@entry=0x7f8466ba6001 "COMMIT ", packet_length=packet_length@entry=7) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:1254

#14 0x000000000059eb8a in do_command (thd=0x7f8466b91000) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:876

#15 0x000000000063d154 in do_handle_one_connection (thd_arg=thd_arg@entry=0x7f8466b91000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1283

#16 0x000000000063d2d2 in handle_one_connection (arg=0x7f8466b91000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1195

#17 0x00007f8491189182 in start_thread (arg=0x7f8490508700) at pthread_create.c:312

#18 0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 4 (Thread 0x7f84904bf700 (LWP 22473)):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00007f848e995cde in wait (this=0x7f84904bb990, cond=...) at galerautils/src/gu_lock.hpp:56

#2  galera::Monitor<galera::ReplicatorSMM::LocalOrder>::enter (this=this@entry=0x7f848fd1b830, obj=...) at galera/src/monitor.hpp:120

#3  0x00007f848e98f423 in cert (trx=<optimized out>, this=0x7f848fd1ae00) at galera/src/replicator_smm.cpp:1661

#4  galera::ReplicatorSMM::cert_and_catch (this=this@entry=0x7f848fd1ae00, trx=trx@entry=0x7f845a86f000) at galera/src/replicator_smm.cpp:1759

#5  0x00007f848e98fb0b in galera::ReplicatorSMM::pre_commit (this=0x7f848fd1ae00, trx=0x7f845a86f000, meta=<optimized out>) at galera/src/replicator_smm.cpp:717

#6  0x00007f848e99f460 in galera_pre_commit (gh=<optimized out>, conn_id=12, trx_handle=<optimized out>, flags=<optimized out>, meta=0x7f8466bae0c8) at galera/src/wsrep_provider.cpp:505

#7  0x000000000066a113 in wsrep_run_wsrep_commit (thd=0x7f8466bab000, hton=<optimized out>, all=<optimized out>) at /home/jan/mysql/maria-5.5-galera/sql/wsrep_hton.cc:429

#8  0x00000000006bee34 in ha_commit_trans (thd=thd@entry=0x7f8466bab000, all=all@entry=false) at /home/jan/mysql/maria-5.5-galera/sql/handler.cc:1311

#9  0x0000000000648ef4 in trans_commit_stmt (thd=thd@entry=0x7f8466bab000) at /home/jan/mysql/maria-5.5-galera/sql/transaction.cc:383

#10 0x0000000000593905 in mysql_execute_command (thd=thd@entry=0x7f8466bab000) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:5034

#11 0x000000000059b9b9 in mysql_parse (thd=0x7f8466bab000, rawbuf=<optimized out>, length=81, parser_state=0x7f84904be200) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:6394

#12 0x000000000059c21c in wsrep_mysql_parse (thd=thd@entry=0x7f8466bab000, rawbuf=0x7f845a81e018 "INSERT LOW_PRIORITY INTO `table0_key_pk_parts_2_int_autoinc` (`pk`) VALUES (NULL)", length=81, parser_state=parser_state@entry=0x7f84904be200) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:6227

#13 0x000000000059e199 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x7f8466bab000, packet=packet@entry=0x7f8466bb0001 "INSERT LOW_PRIORITY INTO `table0_key_pk_parts_2_int_autoinc` (`pk`) VALUES (NULL)", packet_length=packet_length@entry=81) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:1254

#14 0x000000000059eb8a in do_command (thd=0x7f8466bab000) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:876

#15 0x000000000063d154 in do_handle_one_connection (thd_arg=thd_arg@entry=0x7f8466bab000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1283

#16 0x000000000063d2d2 in handle_one_connection (arg=0x7f8466bab000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1195

#17 0x00007f8491189182 in start_thread (arg=0x7f84904bf700) at pthread_create.c:312

#18 0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 3 (Thread 0x7f8490476700 (LWP 22480)):

#0  0x00007f84911903bd in read () at ../sysdeps/unix/syscall-template.S:81

#1  0x0000000000a29cdd in read (__nbytes=4, __buf=0x7f8466bba000, __fd=<optimized out>) at /usr/include/x86_64-linux-gnu/bits/unistd.h:44

#2  vio_read (vio=0x7f848fc2ac00, buf=0x7f8466bba000 "-", size=4) at /home/jan/mysql/maria-5.5-galera/vio/viosocket.c:72

#3  0x000000000052732a in my_real_read (net=0x7f8466bb5218, complen=complen@entry=0x7f8490475918) at /home/jan/mysql/maria-5.5-galera/sql/net_serv.cc:840

#4  0x0000000000527ef2 in my_net_read (net=0x7f8466bb5218) at /home/jan/mysql/maria-5.5-galera/sql/net_serv.cc:1026

#5  0x000000000059eeb8 in do_command (thd=0x7f8466bb5000) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:758

#6  0x000000000063d154 in do_handle_one_connection (thd_arg=thd_arg@entry=0x7f8466bb5000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1283

#7  0x000000000063d2d2 in handle_one_connection (arg=0x7f8466bb5000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1195

#8  0x00007f8491189182 in start_thread (arg=0x7f8490476700) at pthread_create.c:312

#9  0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 2 (Thread 0x7f848f1f6700 (LWP 22482)):

#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

#1  0x00007f848e995cde in wait (this=0x7f848f1f2990, cond=...) at galerautils/src/gu_lock.hpp:56

#2  galera::Monitor<galera::ReplicatorSMM::LocalOrder>::enter (this=this@entry=0x7f848fd1b830, obj=...) at galera/src/monitor.hpp:120

#3  0x00007f848e98f423 in cert (trx=<optimized out>, this=0x7f848fd1ae00) at galera/src/replicator_smm.cpp:1661

#4  galera::ReplicatorSMM::cert_and_catch (this=this@entry=0x7f848fd1ae00, trx=trx@entry=0x7f845a12d000) at galera/src/replicator_smm.cpp:1759

#5  0x00007f848e98fb0b in galera::ReplicatorSMM::pre_commit (this=0x7f848fd1ae00, trx=0x7f845a12d000, meta=<optimized out>) at galera/src/replicator_smm.cpp:717

#6  0x00007f848e99f460 in galera_pre_commit (gh=<optimized out>, conn_id=14, trx_handle=<optimized out>, flags=<optimized out>, meta=0x7f8466bc20c8) at galera/src/wsrep_provider.cpp:505

#7  0x000000000066a113 in wsrep_run_wsrep_commit (thd=0x7f8466bbf000, hton=<optimized out>, all=<optimized out>) at /home/jan/mysql/maria-5.5-galera/sql/wsrep_hton.cc:429

#8  0x00000000006bee34 in ha_commit_trans (thd=thd@entry=0x7f8466bbf000, all=all@entry=false) at /home/jan/mysql/maria-5.5-galera/sql/handler.cc:1311

#9  0x0000000000648ef4 in trans_commit_stmt (thd=thd@entry=0x7f8466bbf000) at /home/jan/mysql/maria-5.5-galera/sql/transaction.cc:383

#10 0x0000000000593905 in mysql_execute_command (thd=thd@entry=0x7f8466bbf000) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:5034

#11 0x000000000059b9b9 in mysql_parse (thd=0x7f8466bbf000, rawbuf=<optimized out>, length=69, parser_state=0x7f848f1f5200) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:6394

#12 0x000000000059c21c in wsrep_mysql_parse (thd=thd@entry=0x7f8466bbf000, rawbuf=0x7f845a01e018 "REPLACE LOW_PRIORITY INTO `table100_int_autoinc` (`pk`) VALUES (NULL)", length=69, parser_state=parser_state@entry=0x7f848f1f5200) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:6227

#13 0x000000000059e199 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x7f8466bbf000, packet=packet@entry=0x7f8466bc4001 "REPLACE LOW_PRIORITY INTO `table100_int_autoinc` (`pk`) VALUES (NULL)", packet_length=packet_length@entry=69) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:1254

#14 0x000000000059eb8a in do_command (thd=0x7f8466bbf000) at /home/jan/mysql/maria-5.5-galera/sql/sql_parse.cc:876

#15 0x000000000063d154 in do_handle_one_connection (thd_arg=thd_arg@entry=0x7f8466bbf000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1283

#16 0x000000000063d2d2 in handle_one_connection (arg=0x7f8466bbf000) at /home/jan/mysql/maria-5.5-galera/sql/sql_connect.cc:1195

#17 0x00007f8491189182 in start_thread (arg=0x7f848f1f6700) at pthread_create.c:312

#18 0x00007f84908abfbd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111

Thread 1 (Thread 0x7f8491de67c0 (LWP 22083)):

#0  0x00007f849089ec6d in poll () at ../sysdeps/unix/syscall-template.S:81

#1  0x000000000052035e in poll (__timeout=-1, __nfds=2, __fds=0x7fff00446c20) at /usr/include/x86_64-linux-gnu/bits/poll2.h:41

#2  handle_connections_sockets () at /home/jan/mysql/maria-5.5-galera/sql/mysqld.cc:6347

#3  0x0000000000525ea5 in mysqld_main (argc=25, argv=0x7f848fc272b0) at /home/jan/mysql/maria-5.5-galera/sql/mysqld.cc:5790

#4  0x00007f84907d2ec5 in __libc_start_main (main=0x509510 <main(int, char**)>, argc=25, argv=0x7fff00447568, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7fff00447558) at libc-start.c:287

#5  0x000000000051b5d6 in _start ()

(gdb) 

=====================================

141003 16:21:20 INNODB MONITOR OUTPUT

=====================================

Per second averages calculated from the last 20 seconds

-----------------

BACKGROUND THREAD

-----------------

srv_master_thread loops: 872 1_second, 872 sleeps, 78 10_second, 95 background, 95 flush

srv_master_thread log flush and writes: 2095

----------

SEMAPHORES

----------

OS WAIT ARRAY INFO: reservation count 3244, signal count 3213

Mutex spin waits 1154, rounds 96727, OS waits 3089

RW-shared spins 108, rounds 2575, OS waits 80

RW-excl spins 6, rounds 2145, OS waits 65

Spin rounds per wait: 83.82 mutex, 23.84 RW-shared, 357.50 RW-excl

--------

FILE I/O

--------

I/O thread 0 state: waiting for completed aio requests (insert buffer thread)

I/O thread 1 state: waiting for completed aio requests (log thread)

I/O thread 2 state: waiting for completed aio requests (read thread)

I/O thread 3 state: waiting for completed aio requests (read thread)

I/O thread 4 state: waiting for completed aio requests (read thread)

I/O thread 5 state: waiting for completed aio requests (read thread)

I/O thread 6 state: waiting for completed aio requests (write thread)

I/O thread 7 state: waiting for completed aio requests (write thread)

I/O thread 8 state: waiting for completed aio requests (write thread)

I/O thread 9 state: waiting for completed aio requests (write thread)

Pending normal aio reads: 0 [0, 0, 0, 0] , aio writes: 0 [0, 0, 0, 0] ,

 ibuf aio reads: 0, log i/o's: 0, sync i/o's: 0

Pending flushes (fsync) log: 0; buffer pool: 0

284 OS file reads, 4958 OS file writes, 1823 OS fsyncs

0.00 reads/s, 0 avg bytes/read, 0.00 writes/s, 0.00 fsyncs/s

-------------------------------------

INSERT BUFFER AND ADAPTIVE HASH INDEX

-------------------------------------

Ibuf: size 1, free list len 0, seg size 2, 0 merges

merged operations:

 insert 0, delete mark 0, delete 0

discarded operations:

 insert 0, delete mark 0, delete 0

Hash table size 276671, node heap has 2 buffer(s)

0.00 hash searches/s, 0.00 non-hash searches/s

---

LOG

---

Log sequence number 2735953

Log flushed up to   2735953

Last checkpoint at  2735953

Max checkpoint age    7782360

Checkpoint age target 7539162

Modified age          0

Checkpoint age        0

0 pending log writes, 0 pending chkp writes

1654 log i/o's done, 0.00 log i/o's/second

----------------------

BUFFER POOL AND MEMORY

----------------------

Total memory allocated 137756672; in additional pool allocated 0

Total memory allocated by read views 760

Internal hash tables (constant factor + variable factor)

    Adaptive hash index 2250352 	(2213368 + 36984)

    Page hash           139112 (buffer pool 0 only)

    Dictionary cache    717229 	(554768 + 162461)

    File system         83536 	(82672 + 864)

    Lock system         344944 	(332872 + 12072)

    Recovery system     0 	(0 + 0)

Dictionary memory allocated 162461

Buffer pool size        8191

Buffer pool size, bytes 134201344

Free buffers            7745

Database pages          444

Old database pages      0

Modified db pages       0

Pending reads 0

Pending writes: LRU 0, flush list 0, single page 0

Pages made young 0, not young 0

0.00 youngs/s, 0.00 non-youngs/s

Pages read 145, created 299, written 3199

0.00 reads/s, 0.00 creates/s, 0.00 writes/s

No buffer pool page gets since the last printout

Pages read ahead 0.00/s, evicted without access 0.00/s, Random read ahead 0.00/s

LRU len: 444, unzip_LRU len: 0

I/O sum[0]:cur[0], unzip sum[0]:cur[0]

--------------

ROW OPERATIONS

--------------

0 queries inside InnoDB, 0 queries in queue

2 read views open inside InnoDB

5 transactions active inside InnoDB

5 out of 1000 descriptors used

---OLDEST VIEW---

Normal read view

Read view low limit trx n:o B2F

Read view up limit trx id AE4

Read view low limit trx id B2F

Read view individually stored trx ids:

Read view trx id B2E

Read view trx id B2D

Read view trx id B29

Read view trx id B1B

Read view trx id B02

Read view trx id AFF

Read view trx id AE4

-----------------

Main thread process no. 22083, id 140206485255936, state: waiting for server activity

Number of rows inserted 1650, updated 1450, deleted 491, read 45755

0.00 inserts/s, 0.00 updates/s, 0.00 deletes/s, 0.00 reads/s

------------------------

LATEST DETECTED DEADLOCK

------------------------

141003 13:41:06

*** (1) TRANSACTION:

TRANSACTION B1B, ACTIVE 306 sec starting index read

mysql tables in use 1, locked 1

LOCK WAIT 13 lock struct(s), heap size 3112, 5 row lock(s), undo log entries 3

MySQL thread id 9, OS thread handle 0x7f849059a700, query id 2846 localhost 127.0.0.1 root init

DELETE LOW_PRIORITY QUICK IGNORE FROM `table2_int_autoinc`  ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 2

*** (1) WAITING FOR THIS LOCK TO BE GRANTED:

RECORD LOCKS space id 0 page no 334 n bits 184 index `PRIMARY` of table `test`.`table2_int_autoinc` trx id B1B lock_mode X locks rec but not gap waiting

*** (2) TRANSACTION:

TRANSACTION AFF, ACTIVE 611 sec fetching rows

mysql tables in use 4, locked 4

32 lock struct(s), heap size 6960, 123 row lock(s), undo log entries 6

MySQL thread id 8, OS thread handle 0x7f8491c67700, query id 2849 localhost 127.0.0.1 root executing

DELETE LOW_PRIORITY   FROM `table1_key_pk_parts_2_int_autoinc` WHERE `col_char_12_key` IN ( SELECT `col_char_12_key` FROM `table2_key_pk_parts_2_int_autoinc` WHERE `pk` = 2 ) ORDER BY `col_char_12`,`col_char_12_key`,`col_int`,`col_int_key`,`pk` LIMIT 2

*** (2) HOLDS THE LOCK(S):

RECORD LOCKS space id 0 page no 334 n bits 176 index `PRIMARY` of table `test`.`table2_int_autoinc` trx id AFF lock_mode X locks rec but not gap

*** (2) WAITING FOR THIS LOCK TO BE GRANTED:

RECORD LOCKS space id 0 page no 329 n bits 144 index `PRIMARY` of table `test`.`table1_key_pk_parts_2_int_autoinc` /* Partition `p1` */ trx id AFF lock_mode X locks rec but not gap waiting

*** WE ROLL BACK TRANSACTION (1)

------------

TRANSACTIONS

------------

Trx id counter B37

Purge done for trx's n:o < B28 undo n:o < 0

History list length 211

LIST OF TRANSACTIONS FOR EACH SESSION:

---TRANSACTION B2F, ACTIVE 9736 sec

mysql tables in use 2, locked 2

2 lock struct(s), heap size 376, 1 row lock(s), undo log entries 1

MySQL thread id 12, OS thread handle 0x7f84904bf700, query id 2829 localhost 127.0.0.1 root query end

INSERT LOW_PRIORITY INTO `table0_key_pk_parts_2_int_autoinc` (`pk`) VALUES (NULL)

TABLE LOCK table `test`.`table0_key_pk_parts_2_int_autoinc` /* Partition `p1` */ trx id B2F lock mode IX

RECORD LOCKS space id 0 page no 315 n bits 152 index `PRIMARY` of table `test`.`table0_key_pk_parts_2_int_autoinc` /* Partition `p1` */ trx id B2F lock_mode X locks rec but not gap

---TRANSACTION B2E, ACTIVE 9767 sec

mysql tables in use 1, locked 1

1 lock struct(s), heap size 376, 0 row lock(s), undo log entries 1

MySQL thread id 14, OS thread handle 0x7f848f1f6700, query id 2826 localhost 127.0.0.1 root query end

REPLACE LOW_PRIORITY INTO `table100_int_autoinc` (`pk`) VALUES (NULL)

TABLE LOCK table `test`.`table100_int_autoinc` trx id B2E lock mode IX

---TRANSACTION B29, ACTIVE 9818 sec starting index read

mysql tables in use 2, locked 2

LOCK WAIT 3 lock struct(s), heap size 1248, 3 row lock(s), undo log entries 2

MySQL thread id 2, OS thread handle 0x7f8491d9b700, query id 2808 Update_rows_log_event::find_row(783)

------- TRX HAS BEEN WAITING 9818 SEC FOR THIS LOCK TO BE GRANTED:

RECORD LOCKS space id 0 page no 373 n bits 248 index `PRIMARY` of table `test`.`table100_key_pk_parts_2_int_autoinc` /* Partition `p1` */ trx id B29 lock_mode X locks rec but not gap waiting

------------------

TABLE LOCK table `test`.`table100_key_pk_parts_2_int_autoinc` /* Partition `p1` */ trx id B29 lock mode IX

RECORD LOCKS space id 0 page no 373 n bits 248 index `PRIMARY` of table `test`.`table100_key_pk_parts_2_int_autoinc` /* Partition `p1` */ trx id B29 lock_mode X locks rec but not gap

RECORD LOCKS space id 0 page no 373 n bits 248 index `PRIMARY` of table `test`.`table100_key_pk_parts_2_int_autoinc` /* Partition `p1` */ trx id B29 lock_mode X locks rec but not gap waiting

---TRANSACTION B1B, ACTIVE 9920 sec

16 lock struct(s), heap size 3112, 5 row lock(s), undo log entries 3

MySQL thread id 9, OS thread handle 0x7f849059a700, query id 2887 localhost 127.0.0.1 root sleeping

COMMIT

Trx read view will not see trx with id >= B30, sees < AE4

TABLE LOCK table `test`.`table100_key_pk_parts_2_int_autoinc` /* Partition `p0` */ trx id B1B lock mode IX

RECORD LOCKS space id 0 page no 371 n bits 128 index `col_int_key` of table `test`.`table100_key_pk_parts_2_int_autoinc` /* Partition `p0` */ trx id B1B lock_mode X locks rec but not gap

RECORD LOCKS space id 0 page no 368 n bits 120 index `PRIMARY` of table `test`.`table100_key_pk_parts_2_int_autoinc` /* Partition `p0` */ trx id B1B lock_mode X locks rec but not gap

TABLE LOCK table `test`.`table100_key_pk_parts_2_int_autoinc` /* Partition `p1` */ trx id B1B lock mode IX

RECORD LOCKS space id 0 page no 375 n bits 176 index `col_int_key` of table `test`.`table100_key_pk_parts_2_int_autoinc` /* Partition `p1` */ trx id B1B lock_mode X locks rec but not gap

RECORD LOCKS space id 0 page no 373 n bits 248 index `PRIMARY` of table `test`.`table100_key_pk_parts_2_int_autoinc` /* Partition `p1` */ trx id B1B lock_mode X locks rec but not gap

TABLE LOCK table `test`.`table1_key_pk_parts_2_int_autoinc` /* Partition `p0` */ trx id B1B lock mode IX

TABLE LOCK table `test`.`table10_key_pk_parts_2_int_autoinc` /* Partition `p0` */ trx id B1B lock mode IX

RECORD LOCKS space id 0 page no 355 n bits 112 index `col_char_12_key` of table `test`.`table10_key_pk_parts_2_int_autoinc` /* Partition `p0` */ trx id B1B lock_mode X locks rec but not gap

TABLE LOCK table `test`.`table1_key_pk_parts_2_int_autoinc` /* Partition `p1` */ trx id B1B lock mode IX

TOO MANY LOCKS PRINTED FOR THIS TRX: SUPPRESSING FURTHER PRINTS

---TRANSACTION AE4, ACTIVE 10276 sec

31 lock struct(s), heap size 6960, 247 row lock(s), undo log entries 26

MySQL thread id 11, OS thread handle 0x7f8490508700, query id 2825 localhost 127.0.0.1 root sleeping

COMMIT

TABLE LOCK table `test`.`table2_key_pk_parts_2_int_autoinc` /* Partition `p0` */ trx id AE4 lock mode IX

RECORD LOCKS space id 0 page no 341 n bits 112 index `col_int_key` of table `test`.`table2_key_pk_parts_2_int_autoinc` /* Partition `p0` */ trx id AE4 lock_mode X locks rec but not gap

RECORD LOCKS space id 0 page no 339 n bits 144 index `PRIMARY` of table `test`.`table2_key_pk_parts_2_int_autoinc` /* Partition `p0` */ trx id AE4 lock_mode X locks rec but not gap

TABLE LOCK table `test`.`table2_key_pk_parts_2_int_autoinc` /* Partition `p1` */ trx id AE4 lock mode IX

RECORD LOCKS space id 0 page no 345 n bits 112 index `col_int_key` of table `test`.`table2_key_pk_parts_2_int_autoinc` /* Partition `p1` */ trx id AE4 lock_mode X locks rec but not gap

RECORD LOCKS space id 0 page no 343 n bits 144 index `PRIMARY` of table `test`.`table2_key_pk_parts_2_int_autoinc` /* Partition `p1` */ trx id AE4 lock_mode X locks rec but not gap

TABLE LOCK table `test`.`table0_int_autoinc` trx id AE4 lock mode IX

TABLE LOCK table `test`.`table100_key_pk_parts_2_int_autoinc` /* Partition `p0` */ trx id AE4 lock mode IX

RECORD LOCKS space id 0 page no 371 n bits 128 index `col_int_key` of table `test`.`table100_key_pk_parts_2_int_autoinc` /* Partition `p0` */ trx id AE4 lock_mode X locks rec but not gap

RECORD LOCKS space id 0 page no 368 n bits 120 index `PRIMARY` of table `test`.`table100_key_pk_parts_2_int_autoinc` /* Partition `p0` */ trx id AE4 lock_mode X locks rec but not gap

TOO MANY LOCKS PRINTED FOR THIS TRX: SUPPRESSING FURTHER PRINTS

----------------------------

END OF INNODB MONITOR OUTPUT

============================

WSREP: BF lock wait long