[MDEV-9359] encryption.create_or_replace fails sporadically in buildbot: failing assertion: mutex->magic_n == MUTEX_MAGIC_N Created: 2016-01-04  Updated: 2018-04-23  Resolved: 2018-04-23

Status: Closed
Project: MariaDB Server
Component/s: Storage Engine - XtraDB
Affects Version/s: 10.1
Fix Version/s: 10.1.31

Type: Bug Priority: Major
Reporter: Elena Stepanova Assignee: Jan Lindström (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Attachments: File core.gz    
Issue Links:
Blocks
blocks MDEV-7069 Fix buildbot failures in main server ... Stalled
Relates
relates to MDEV-11638 Encryption causes race conditions in ... Closed
relates to MDEV-15983 Reduce fil_system.mutex contention fu... Closed
relates to MDEV-13516 encryption.create_or_replace test fai... Closed
Sprint: 10.1.15

 Description   

http://buildbot.askmonty.org/buildbot/builders/kvm-fulltest2/builds/4720/steps/test_3/logs/stdio

2015-12-31  9:18:41 3001334592 [Note] InnoDB: Creating #1 thread id 2814376768 total threads 1.
 
2015-12-31 09:18:47 a7bffb40  InnoDB: Assertion failure in thread 2814376768 in file sync0sync.cc line 485
 
InnoDB: Failing assertion: mutex->magic_n == MUTEX_MAGIC_N
 
InnoDB: We intentionally generate a memory trap.
 
InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
 
InnoDB: If you get repeated assertion failures or crashes, even
 
InnoDB: immediately after the mysqld startup, there may be
 
InnoDB: corruption in the InnoDB tablespace. Please refer to
 
InnoDB: http://dev.mysql.com/doc/refman/5.6/en/forcing-innodb-recovery.html
 
InnoDB: about forcing recovery.
 
151231  9:18:47 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see http://kb.askmonty.org/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.1.10-MariaDB-debug-log
 
key_buffer_size=1048576
 
read_buffer_size=131072
 
max_used_connections=1
 
max_threads=153
 
thread_count=1
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 61807 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0x0
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x0 thread_stack 0x48000
 
mysys/stacktrace.c:246(my_print_stacktrace)[0x8b04599]
 
sql/signal_handler.cc:160(handle_fatal_signal)[0x843561c]
 
[0xba0400]
 
[0xba0416]
 
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0x1471ef]
 
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0x14a835]
 
sync/sync0sync.cc:485(mutex_validate(ib_mutex_t const*))[0x8846334]
 
include/sync0sync.ic:254(mutex_enter_func)[0x895d2ab]
 
/lib/i386-linux-gnu/libpthread.so.0(+0x6d4c)[0x337d4c]
 
/lib/i386-linux-gnu/libc.so.6(clone+0x5e)[0x203ace]
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
Writing a core file



 Comments   
Comment by Jan Lindström (Inactive) [ 2016-01-05 ]

commit 111acb721ff7237ceb5f5c8fae8c10857ed7c36f
Author: Jan Lindström <jan.lindstrom@mariadb.com>
Date: Tue Jan 5 18:50:54 2016 +0200

MDEV-9359: encryption.create_or_replace fails sporadically in buildbot: failing assertion: mutex->magic_n == MUTEX_MAGIC_N

Make sure that encryption threads mutex is initialized before starting
encryption threads.

Comment by Elena Stepanova [ 2016-01-26 ]

Now it looks a bit different:
http://buildbot.askmonty.org/buildbot/builders/kvm-fulltest2/builds/4780/steps/test_2/logs/stdio

2016-01-25 12:04:30 2811231040 [ERROR] InnoDB: Mutex 0xaad44c28 not initialized file (null) line 0.
 
2016-01-25 12:04:30 a78ffb40  InnoDB: Assertion failure in thread 2811231040 in file sync0sync.cc line 491
 
InnoDB: Failing assertion: mutex->magic_n == 979585UL
 
InnoDB: We intentionally generate a memory trap.
 
InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
 
InnoDB: If you get repeated assertion failures or crashes, even
 
InnoDB: immediately after the mysqld startup, there may be
 
InnoDB: corruption in the InnoDB tablespace. Please refer to
 
InnoDB: http://dev.mysql.com/doc/refman/5.6/en/forcing-innodb-recovery.html
 
InnoDB: about forcing recovery.
 
160125 12:04:30 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see http://kb.askmonty.org/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.1.10-MariaDB-debug-log
 
key_buffer_size=1048576
 
read_buffer_size=131072
 
max_used_connections=1
 
max_threads=153
 
thread_count=1
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 61807 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0x0
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x0 thread_stack 0x48000
 
/mnt/buildbot/build/mariadb-10.1.10/sql/mysqld(my_print_stacktrace+0x29)[0x8b04979]
 
/mnt/buildbot/build/mariadb-10.1.10/sql/mysqld(handle_fatal_signal+0x53c)[0x843591c]
 
[0xb77b7400]
 
[0xb77b7424]
 
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xb74941ef]
 
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xb7497835]
 
/mnt/buildbot/build/mariadb-10.1.10/sql/mysqld[0x8846683]
 
/mnt/buildbot/build/mariadb-10.1.10/sql/mysqld[0x895d620]
 
/lib/i386-linux-gnu/libpthread.so.0(+0x6d4c)[0xb7741d4c]
 
/lib/i386-linux-gnu/libc.so.6(clone+0x5e)[0xb7550ace]
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
Writing a core file
 
----------SERVER LOG END-------------
 
 
 
 
 
 - saving '/mnt/buildbot/build/mariadb-10.1.10/mysql-test/var/1/log/encryption.create_or_replace-cbc,xtradb/' to '/mnt/buildbot/build/mariadb-10.1.10/mysql-test/var/log/encryption.create_or_replace-cbc,xtradb/'
 
 
 
Retrying test encryption.create_or_replace, attempt(2/3)...
 
 
 
worker[1] > Restart  - not started
 
***Warnings generated in error logs during shutdown after running tests: encryption.create_or_replace
 
 
 
2016-01-25 12:04:30 2811231040 [ERROR] InnoDB: Mutex 0xaad44c28 not initialized file (null) line 0.
 
Attempting backtrace. You can use the following information to find out

Comment by Elena Stepanova [ 2016-05-22 ]

See also http://buildbot.askmonty.org/buildbot/builders/kvm-fulltest/builds/5987/steps/test_2/logs/stdio

encryption.create_or_replace 'cbc,xtradb' w1 [ fail ]
 
        Test ended at 2016-05-21 20:43:46
 
 
 
CURRENT_TEST: encryption.create_or_replace
 
mysqltest: At line 38: query 'SET GLOBAL innodb_encryption_threads = 0' failed: 2013: Lost connection to MySQL server during query
 
 
 
The result from queries just before the failure was:
 
SET default_storage_engine = InnoDB;
 
CREATE TABLE t1 (pk INT PRIMARY KEY, c VARCHAR(256));
 
CREATE TABLE t2 AS SELECT * FROM t1;
 
drop table t1,t2;
 
SET GLOBAL innodb_encryption_threads = 0;
 
 
 
 
 
Server [mysqld.1 - pid: 615, winpid: 615, exit: 256] failed during test run
 
Server log from this test:
 
----------SERVER LOG START-----------
 
...
 
Version: '10.2.0-MariaDB'  socket: '/mnt/buildbot/build/mariadb-10.2.0/mysql-test/var/tmp/1/mysqld.1.sock'  port: 16000  Source distribution
 
2016-05-21 20:43:32 140278736822016 [Note] InnoDB: Creating #1 thread id 140278363043584 total threads 1.
 
160521 20:43:45 [ERROR] mysqld got signal 11 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.2.0-MariaDB
 
key_buffer_size=1048576
 
read_buffer_size=131072
 
max_used_connections=1
 
max_threads=153
 
thread_count=1
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 62930 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0x0
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x0 thread_stack 0x48800
 
/mnt/buildbot/build/mariadb-10.2.0/sql/mysqld(my_print_stacktrace+0x2b)[0xc27acb]
 
/mnt/buildbot/build/mariadb-10.2.0/sql/mysqld(handle_fatal_signal+0x3f4)[0x7575f4]
 
/lib/x86_64-linux-gnu/libpthread.so.0(+0xfcb0)[0x7f9536c62cb0]
 
/mnt/buildbot/build/mariadb-10.2.0/sql/mysqld[0x8c7b87]
 
/mnt/buildbot/build/mariadb-10.2.0/sql/mysqld[0xadda4d]
 
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a)[0x7f9536c5ae9a]
 
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f95361784bd]
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
Writing a core file
 
----------SERVER LOG END-------------

Comment by Elena Stepanova [ 2016-08-28 ]

Another flavor:
http://buildbot.askmonty.org/buildbot/builders/kvm-fulltest/builds/6470/steps/test_2/logs/stdio

encryption.create_or_replace 'cbc,xtradb' w2 [ fail ]  Found warnings/errors in server log file!
 
        Test ended at 2016-08-28 00:03:07
 
line
 
InnoDB: Error: trying to do an operation on a dropped tablespace 1009
 
^ Found warnings in /mnt/buildbot/build/mariadb-10.1.17/mysql-test/var/2/log/mysqld.1.err

Comment by Marko Mäkelä [ 2017-01-10 ]

I think that we should couple fil_space_t and fil_space_t::crypt_data tighter. We should remove or simplify the following:

  • remove the fil_space_crypt_struct::closing field and related functions fil_crypt_is_closing(), fil_space_crypt_mark_space_closing()
  • remove fil_inc_pending_ops() and fil_decr_pending_ops(); use fil_space_acquire_silent() and fil_space_release()
  • merge fil_space_crypt_close_tablespace() with fil_node_close_file() or its callers as appropriate
  • remove fil_space_get_crypt_data(); initialize the crypt_data in fil_node_open_file() if crypt_data==NULL at that point
  • move fil_space_crypt_struct::mutex to fil_space_t::mutex
Comment by Marko Mäkelä [ 2017-01-10 ]

I think that we should use fil_space_acquire() and fil_space_release() to protect against certain tablespace-wide operations while encryption threads are running. These operations include DROP, RENAME, TRUNCATE and EXPORT. Those operations should signal the encryption threads to exit, and wait for the reference count to go to 0. Maybe we do not need fil_space_crypt_struct::mutex at all. There already is fil_space_t::latch, after all.

Comment by Elena Stepanova [ 2017-01-10 ]

The failure first appeared on bb-10.1-mdev8139 commit ffb38c9771bc7, and later in 10.1 tree.
Again, it is not limited at all to P8, but P8 produces a better stack trace, hence it is used in the example below.

10.1 384f4d1e36cf2ba8791b15c83ac601b9

 
encryption.innodb_encryption-page-compression 'xtradb' w2 [ fail ]
 
        Test ended at 2017-01-07 19:49:05
 
 
 
CURRENT_TEST: encryption.innodb_encryption-page-compression
 
mysqltest: At line 127: query 'select count(*) from innodb_page_compressed3 where c1 < 500000' failed: 2013: Lost connection to MySQL server during query
 
 
 
The result from queries just before the failure was:
 
< snip >
 
variable_value >= 0
 
1
 
SELECT variable_value >= 0 FROM information_schema.global_status WHERE variable_name = 'innodb_num_pages_decrypted';
 
variable_value >= 0
 
1
 
SELECT variable_value >= 0 FROM information_schema.global_status WHERE variable_name = 'innodb_num_pages_page_compressed';
 
variable_value >= 0
 
1
 
SELECT variable_value >= 0 FROM information_schema.global_status WHERE variable_name = 'innodb_num_pages_page_decompressed';
 
variable_value >= 0
 
1
 
SET GLOBAL innodb_encryption_threads = 4;
 
SET GLOBAL innodb_encrypt_tables = off;
 
select count(*) from innodb_page_compressed1 where c1 < 500000;
 
count(*)
 
5000
 
select count(*) from innodb_page_compressed2 where c1 < 500000;
 
count(*)
 
5000
 
select count(*) from innodb_page_compressed3 where c1 < 500000;
 
 
 
More results from queries before failure can be found in /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/mysql-test/var/2/log/innodb_encryption-page-compression.log


Server [mysqld.1 - pid: 16847, winpid: 16847, exit: 256] failed during test run
 
Server log from this test:
 
----------SERVER LOG START-----------
 
2017-01-07 19:47:08 70367272794992 [Note] /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld (mysqld 10.1.21-MariaDB-debug) starting as process 16425 ...
 
2017-01-07 19:47:08 70367272794992 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4162)
 
2017-01-07 19:47:08 70367272794992 [Note] Plugin 'SEQUENCE' is disabled.
 
2017-01-07 19:47:08 70367272794992 [Note] Plugin 'partition' is disabled.
 
innodb_open_files should not be greater than the open_files_limit.
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB: innodb_empty_free_list_algorithm has been changed to legacy because of small buffer pool size. In order to use backoff, increase buffer pool at least up to 20MB.
 
 
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB: Using mutexes to ref count buffer pool pages
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB:  InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!!
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB:  InnoDB: !!!!!!!! UNIV_SYNC_DEBUG switched on !!!!!!!!!
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB: The InnoDB memory heap is disabled
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB: Compressed tables use zlib 1.2.8
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB: Using Linux native AIO
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB: Using POWER8 crc32 instructions
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB: Initializing buffer pool, size = 8.0M
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB: Completed initialization of buffer pool
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB: Created tablespace for space 0 name ./ibdata1 key_id 1 encryption 0.
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB: Created tablespace for space 4294967280 name ./ib_logfile0 key_id 0 encryption 0.
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB: Created tablespace for space 4294967281 name arch_log_space key_id 0 encryption 0.
 
2017-01-07 19:47:09 70367272794992 [Note] InnoDB: Highest supported file format is Barracuda.
 
2017-01-07 19:47:11 70367272794992 [Note] InnoDB: Created tablespace for space 2 name mysql/innodb_index_stats key_id 0 encryption 0.
 
2017-01-07 19:47:11 70367272794992 [Note] InnoDB: Created tablespace for space 1 name mysql/innodb_table_stats key_id 0 encryption 0.
 
2017-01-07 19:47:12 70367272794992 [Note] InnoDB: 128 rollback segment(s) are active.
 
2017-01-07 19:47:12 70367272794992 [Note] InnoDB: Waiting for purge to start
 
2017-01-07 19:47:12 70367272794992 [Note] InnoDB:  Percona XtraDB (http://www.percona.com) 5.6.34-79.1 started; log sequence number 1629767
 
2017-01-07 19:47:12 70367272794992 [Note] InnoDB: Creating #1 thread id 70366936428864 total threads 4.
 
2017-01-07 19:47:12 70367272794992 [Note] InnoDB: Creating #2 thread id 70366928040256 total threads 4.
 
2017-01-07 19:47:12 70367272794992 [Note] InnoDB: Creating #3 thread id 70366919651648 total threads 4.
 
2017-01-07 19:47:12 70367272794992 [Note] InnoDB: Creating #4 thread id 70366911263040 total threads 4.
 
2017-01-07 19:47:12 70366961594688 [Note] InnoDB: Dumping buffer pool(s) not yet started
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_SYS_INDEXES' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'XTRADB_RSEG' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'CHANGED_PAGE_BITMAPS' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_LOCK_WAITS' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'XTRADB_INTERNAL_HASH_TABLES' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_SYS_FIELDS' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'FEEDBACK' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_CMP' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_MUTEXES' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_CMP_RESET' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_SYS_COLUMNS' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_FT_CONFIG' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'XTRADB_READ_VIEW' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled.
 
2017-01-07 19:47:12 70367272794992 [Note] Plugin 'INNODB_CHANGED_PAGES' is disabled.
 
2017-01-07 19:47:13 70367272794992 [Note] Plugin 'INNODB_FT_DELETED' is disabled.
 
2017-01-07 19:47:13 70367272794992 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled.
 
2017-01-07 19:47:13 70367272794992 [Warning] /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld: unknown option '--loose-pam-debug'
 
2017-01-07 19:47:13 70367272794992 [Note] Server socket created on IP: '127.0.0.1'.
 
2017-01-07 19:47:13 70367272794992 [Note] /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld: ready for connections.
 
Version: '10.1.21-MariaDB-debug'  socket: '/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/mysql-test/var/tmp/2/mysqld.1.sock'  port: 16040  Source distribution
 
2017-01-07 19:47:14 70367261390144 [Note] InnoDB: Created tablespace for space 4 name test/innodb_normal key_id 1 encryption 0.
 
2017-01-07 19:47:14 70367261390144 [Note] InnoDB: Created tablespace for space 5 name test/innodb_page_compressed1 key_id 1 encryption 0.
 
2017-01-07 19:47:14 70367261390144 [Note] InnoDB: Created tablespace for space 6 name test/innodb_page_compressed2 key_id 1 encryption 0.
 
2017-01-07 19:47:14 70367261390144 [Note] InnoDB: Created tablespace for space 7 name test/innodb_page_compressed3 key_id 1 encryption 0.
 
2017-01-07 19:47:15 70367261390144 [Note] InnoDB: Created tablespace for space 8 name test/innodb_page_compressed4 key_id 1 encryption 0.
 
2017-01-07 19:47:15 70367261390144 [Note] InnoDB: Created tablespace for space 9 name test/innodb_page_compressed5 key_id 1 encryption 0.
 
2017-01-07 19:47:15 70367261390144 [Note] InnoDB: Created tablespace for space 10 name test/innodb_page_compressed6 key_id 1 encryption 0.
 
2017-01-07 19:47:15 70367261390144 [Note] InnoDB: Created tablespace for space 11 name test/innodb_page_compressed7 key_id 1 encryption 0.
 
2017-01-07 19:47:15 70367261390144 [Note] InnoDB: Created tablespace for space 12 name test/innodb_page_compressed8 key_id 1 encryption 0.
 
2017-01-07 19:47:16 70367261390144 [Note] InnoDB: Created tablespace for space 13 name test/innodb_page_compressed9 key_id 1 encryption 0.
 
2017-01-07 19:47:19 70366928040256 [Note] InnoDB: Read page 0 from tablespace for space 2 name mysql/innodb_index_stats key_id 0 encryption 0 handle 75.
 
2017-01-07 19:47:20 70366936428864 [Note] InnoDB: Read page 0 from tablespace for space 1 name mysql/innodb_table_stats key_id 0 encryption 0 handle 76.
 
2017-01-07 19:48:13 70367260996928 [Note] /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld: Normal shutdown
 
 
 
2017-01-07 19:48:13 70367260996928 [Note] Event Scheduler: Purging the queue. 0 events
 
2017-01-07 19:48:13 70366944817472 [Note] InnoDB: FTS optimize thread exiting.
 
2017-01-07 19:48:13 70367260996928 [Note] InnoDB: Starting shutdown...
 
2017-01-07 19:48:14 70367260996928 [Note] InnoDB: Waiting for page_cleaner to finish flushing of buffer pool
 
2017-01-07 19:48:15 70367260996928 [Note] InnoDB: Shutdown completed; log sequence number 5764705
 
2017-01-07 19:48:15 70367260996928 [Note] Debug sync points hit:                   567208
 
2017-01-07 19:48:15 70367260996928 [Note] Debug sync points executed:              0
 
2017-01-07 19:48:15 70367260996928 [Note] Debug sync points max active per thread: 0
 
2017-01-07 19:48:15 70367260996928 [Note] /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld: Shutdown complete
 
 
 
2017-01-07 19:48:16 70366796282736 [Note] /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld (mysqld 10.1.21-MariaDB-debug) starting as process 16849 ...
 
2017-01-07 19:48:16 70366796282736 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4162)
 
2017-01-07 19:48:16 70366796282736 [Note] Plugin 'SEQUENCE' is disabled.
 
2017-01-07 19:48:16 70366796282736 [Note] Plugin 'partition' is disabled.
 
innodb_open_files should not be greater than the open_files_limit.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: innodb_empty_free_list_algorithm has been changed to legacy because of small buffer pool size. In order to use backoff, increase buffer pool at least up to 20MB.
 
 
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Using mutexes to ref count buffer pool pages
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB:  InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!!
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB:  InnoDB: !!!!!!!! UNIV_SYNC_DEBUG switched on !!!!!!!!!
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: The InnoDB memory heap is disabled
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Compressed tables use zlib 1.2.8
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Using Linux native AIO
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Using POWER8 crc32 instructions
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Initializing buffer pool, size = 8.0M
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Completed initialization of buffer pool
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 0 name ./ibdata1 key_id 1 encryption 0.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 4294967280 name ./ib_logfile0 key_id 0 encryption 0.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 4294967281 name arch_log_space key_id 0 encryption 0.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Highest supported file format is Barracuda.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 2 name mysql/innodb_index_stats key_id 0 encryption 0.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 1 name mysql/innodb_table_stats key_id 0 encryption 0.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 4 name test/innodb_normal key_id 0 encryption 0.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 5 name test/innodb_page_compressed1 key_id 0 encryption 0.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 6 name test/innodb_page_compressed2 key_id 0 encryption 0.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 7 name test/innodb_page_compressed3 key_id 0 encryption 0.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 8 name test/innodb_page_compressed4 key_id 0 encryption 0.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 9 name test/innodb_page_compressed5 key_id 0 encryption 0.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 10 name test/innodb_page_compressed6 key_id 0 encryption 0.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 11 name test/innodb_page_compressed7 key_id 0 encryption 0.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 12 name test/innodb_page_compressed8 key_id 0 encryption 0.
 
2017-01-07 19:48:16 70366796282736 [Note] InnoDB: Created tablespace for space 13 name test/innodb_page_compressed9 key_id 0 encryption 0.
 
2017-01-07 19:48:17 70366796282736 [Note] InnoDB: 128 rollback segment(s) are active.
 
2017-01-07 19:48:17 70366796282736 [Note] InnoDB: Waiting for purge to start
 
2017-01-07 19:48:17 70366796282736 [Note] InnoDB:  Percona XtraDB (http://www.percona.com) 5.6.34-79.1 started; log sequence number 5764705
 
2017-01-07 19:48:18 70366796282736 [Note] InnoDB: Creating #1 thread id 70366462472512 total threads 4.
 
2017-01-07 19:48:18 70366796282736 [Note] InnoDB: Creating #2 thread id 70366454083904 total threads 4.
 
2017-01-07 19:48:18 70366796282736 [Note] InnoDB: Creating #3 thread id 70366445695296 total threads 4.
 
2017-01-07 19:48:18 70366796282736 [Note] InnoDB: Creating #4 thread id 70366437306688 total threads 4.
 
2017-01-07 19:48:18 70366487638336 [Note] InnoDB: Dumping buffer pool(s) not yet started
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_SYS_INDEXES' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'XTRADB_RSEG' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'CHANGED_PAGE_BITMAPS' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_LOCK_WAITS' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'XTRADB_INTERNAL_HASH_TABLES' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_SYS_FIELDS' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'FEEDBACK' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_CMP' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_MUTEXES' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_CMP_RESET' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_SYS_COLUMNS' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_FT_CONFIG' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'XTRADB_READ_VIEW' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_CHANGED_PAGES' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_FT_DELETED' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled.
 
2017-01-07 19:48:18 70366796282736 [Warning] /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld: unknown option '--loose-pam-debug'
 
2017-01-07 19:48:18 70366796282736 [Note] Server socket created on IP: '127.0.0.1'.
 
2017-01-07 19:48:18 70366796282736 [Note] /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld: ready for connections.
 
Version: '10.1.21-MariaDB-debug'  socket: '/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/mysql-test/var/tmp/2/mysqld.1.sock'  port: 16040  Source distribution
 
2017-01-07 19:48:18 70366578373952 [Note] InnoDB: Read page 0 from tablespace for space 5 name test/innodb_page_compressed1 key_id 1 encryption 0 handle 43.
 
2017-01-07 19:48:19 70366578373952 [Note] InnoDB: Read page 0 from tablespace for space 6 name test/innodb_page_compressed2 key_id 1 encryption 0 handle 44.
 
2017-01-07 19:48:19 70366578373952 [Note] InnoDB: Read page 0 from tablespace for space 7 name test/innodb_page_compressed3 key_id 1 encryption 0 handle 45.
 
2017-01-07 19:48:20 70366578373952 [Note] InnoDB: Read page 0 from tablespace for space 8 name test/innodb_page_compressed4 key_id 1 encryption 0 handle 46.
 
2017-01-07 19:48:20 70366578373952 [Note] InnoDB: Read page 0 from tablespace for space 9 name test/innodb_page_compressed5 key_id 1 encryption 0 handle 47.
 
2017-01-07 19:48:20 70366578373952 [Note] InnoDB: Read page 0 from tablespace for space 10 name test/innodb_page_compressed6 key_id 1 encryption 0 handle 48.
 
2017-01-07 19:48:21 70366578373952 [Note] InnoDB: Read page 0 from tablespace for space 11 name test/innodb_page_compressed7 key_id 1 encryption 0 handle 49.
 
2017-01-07 19:48:21 70366578373952 [Note] InnoDB: Read page 0 from tablespace for space 12 name test/innodb_page_compressed8 key_id 1 encryption 0 handle 50.
 
2017-01-07 19:48:22 70366578373952 [Note] InnoDB: Read page 0 from tablespace for space 13 name test/innodb_page_compressed9 key_id 1 encryption 0 handle 51.
 
2017-01-07 19:48:38 70366462472512 [Note] InnoDB: Read page 0 from tablespace for space 2 name mysql/innodb_index_stats key_id 1 encryption 0 handle 52.
 
2017-01-07 19:48:38 70366437306688 [Note] InnoDB: Read page 0 from tablespace for space 1 name mysql/innodb_table_stats key_id 1 encryption 0 handle 53.
 
2017-01-07 19:48:40 70366462472512 [Note] InnoDB: Read page 0 from tablespace for space 4 name test/innodb_normal key_id 1 encryption 0 handle 54.
 
2017-01-07 19:48:40 70366437306688 [Note] InnoDB: Read page 0 from tablespace for space 4 name test/innodb_normal key_id 1 encryption 0 handle 54.


2017-01-07 19:48:40 3fff77fff140  InnoDB: Assertion failure in thread 70366462472512 in file fil0crypt.cc line 2220
 
InnoDB: Failing assertion: crypt_data->rotate_state.active_threads > 0
 
InnoDB: We intentionally generate a memory trap.
 
InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
 
InnoDB: If you get repeated assertion failures or crashes, even
 
InnoDB: immediately after the mysqld startup, there may be
 
InnoDB: corruption in the InnoDB tablespace. Please refer to
 
InnoDB: http://dev.mysql.com/doc/refman/5.6/en/forcing-innodb-recovery.html
 
InnoDB: about forcing recovery.
 
170107 19:48:40 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.1.21-MariaDB-debug
 
key_buffer_size=1048576
 
read_buffer_size=131072
 
max_used_connections=1
 
max_threads=153
 
thread_count=1
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 62983 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0x0
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x0 thread_stack 0x48400
 
/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld(my_print_stacktrace+0x3c)[0x5718c578]
 
/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld(handle_fatal_signal+0x4f4)[0x56865db4]
 
linux-vdso64.so.1(__kernel_sigtramp_rt64+0x0)[0x3fff8bde0478]
 
/opt/at8.0/lib64/power8/libc.so.6(gsignal+0x48)[0x3fff8b56eeb8]
 
/opt/at8.0/lib64/power8/libc.so.6(abort+0x2ac)[0x3fff8b571a5c]
 
/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld(+0xe3405c)[0x56e7405c]
 
/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld(+0xe34504)[0x56e74504]
 
/opt/at8.0/lib64/power8/libpthread.so.0(+0x7cec)[0x3fff8bda7cec]
 
/opt/at8.0/lib64/power8/libc.so.6(clone+0x98)[0x3fff8b661140]
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
Writing a core file
 
----------SERVER LOG END-------------
 
 
 
 
 
 - saving '/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/mysql-test/var/2/log/encryption.innodb_encryption-page-compression-xtradb/' to '/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/mysql-test/var/log/encryption.innodb_encryption-page-compression-xtradb/'
 
 - found 'core' (1/5)
 
 
 
Trying 'dbx' to get a backtrace
 
 
 
Trying 'gdb' to get a backtrace
 
Core generated by '/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld'
 
Output from gdb follows. The first stack trace is from the failing thread.
 
The following stack traces are from all threads (so the failing one is
 
duplicated).
 



[Thread debugging using libthread_db enabled]
 
Using host libthread_db library "/opt/at8.0/lib64/power8/libthread_db.so.1".
 
Core was generated by `/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld --default'.
 
Program terminated with signal SIGABRT, Aborted.
 
#0  0x00003fff8bdb0ef0 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:60
 
60	../sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.
 
#0  0x00003fff8bdb0ef0 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:60
 
#1  0x000000005718c718 in my_write_core (sig=6) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/mysys/stacktrace.c:477
 
#2  0x0000000056866324 in handle_fatal_signal (sig=6) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/signal_handler.cc:296
 
#3  <signal handler called>
 
#4  0x00003fff8b56eeb8 in __GI_raise (sig=<optimized out>) at ../sysdeps/unix/sysv/linux/raise.c:55
 
#5  0x00003fff8b5719bc in __GI_abort () at abort.c:89
 
#6  0x0000000056e7405c in fil_crypt_complete_rotate_space (key_state=0x3fff77ffe694, state=0x3fff77ffe6a0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0crypt.cc:2220
 
#7  0x0000000056e74504 in fil_crypt_thread (arg=0x0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0crypt.cc:2355
 
#8  0x00003fff8bda7cec in start_thread (arg=0x3fff77fff140) at pthread_create.c:312
 
#9  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 27 (Thread 0x3fff7afff140 (LWP 16878)):
 
#0  0x00003fff8bdb4908 in fsync () at ../sysdeps/unix/syscall-template.S:81
 
#1  0x0000000056bd35a0 in os_file_fsync (file=6) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0file.cc:2698
 
#2  0x0000000056bd3780 in os_file_flush_func (file=6) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0file.cc:2798
 
#3  0x0000000056e52800 in pfs_os_file_flush_func (file=6, src_file=0x5742a500 "/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0fil.cc", src_line=1015) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/include/os0file.ic:371
 
#4  0x0000000056e598fc in fil_flush_low (space=0x3fff83660478) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0fil.cc:1015
 
#5  0x0000000056e65ee8 in fil_flush (space_id=0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0fil.cc:6340
 
#6  0x0000000056dca6f0 in buf_dblwr_flush_buffered_writes () at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/buf/buf0dblwr.cc:1027
 
#7  0x0000000056dd7010 in buf_flush_common (flush_type=BUF_FLUSH_LIST, page_count=20) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/buf/buf0flu.cc:1843
 
#8  0x0000000056dd7b60 in buf_flush_list (min_n=200, lsn_limit=18446744073709551615, n_processed=0x3fff7affe6c8) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/buf/buf0flu.cc:2126
 
#9  0x0000000056dd86e8 in page_cleaner_do_flush_batch (n_to_flush=200, lsn_limit=18446744073709551615) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/buf/buf0flu.cc:2410
 
#10 0x0000000056dd99e8 in buf_flush_page_cleaner_thread (arg=0x0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/buf/buf0flu.cc:2792
 
#11 0x00003fff8bda7cec in start_thread (arg=0x3fff7afff140) at pthread_create.c:312
 
#12 0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 26 (Thread 0x3fff7ee87540 (LWP 16890)):
 
#0  0x0000000056c188f8 in thr_get_trx (thr=0x3fff81f5c2c0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/include/que0que.ic:35
 
#1  0x0000000056c1aa34 in que_thr_stop_for_mysql_no_error (thr=0x3fff74b23708, trx=0x3fff74b60478) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/que/que0que.cc:883
 
#2  0x0000000056cbd160 in row_search_for_mysql (buf=0x3fff7e7e2488 "\375$\006", mode=1, prebuilt=0x3fff74b23078, match_mode=0, direction=1) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/row/row0sel.cc:5235
 
#3  0x0000000056b09584 in ha_innobase::general_fetch (this=0x3fff7eb93088, buf=0x3fff7e7e2488 "\375$\006", direction=1, match_mode=0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/handler/ha_innodb.cc:10244
 
#4  0x0000000056b09d98 in ha_innobase::rnd_next (this=0x3fff7eb93088, buf=0x3fff7e7e2488 "\375$\006") at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/handler/ha_innodb.cc:10456
 
#5  0x000000005686f70c in handler::ha_rnd_next (this=0x3fff7eb93088, buf=0x3fff7e7e2488 "\375$\006") at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/handler.cc:2578
 
#6  0x0000000056a583ac in rr_sequential (info=0x3fff7ea18510) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/records.cc:470
 
#7  0x00000000565e61d4 in sub_select (join=0x3fff7ea16d80, join_tab=0x3fff7ea18450, end_of_records=false) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/sql_select.cc:18323
 
#8  0x00000000565e55b8 in do_select (join=0x3fff7ea16d80, fields=0x3fff7ea17170, table=0x0, procedure=0x0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/sql_select.cc:17959
 
#9  0x00000000565b83a8 in JOIN::exec_inner (this=0x3fff7ea16d80) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/sql_select.cc:3215
 
#10 0x00000000565b56cc in JOIN::exec (this=0x3fff7ea16d80) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/sql_select.cc:2505
 
#11 0x00000000565b8e00 in mysql_select (thd=0x3fff85556070, rref_pointer_array=0x3fff8555a430, tables=0x3fff7ea163b0, wild_num=0, fields=..., conds=0x3fff7ea16b40, og_num=0, order=0x0, group=0x0, having=0x0, proc_param=0x0, select_options=2147748608, result=0x3fff7ea16d60, unit=0x3fff85559ab8, select_lex=0x3fff8555a1b8) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/sql_select.cc:3439
 
#12 0x00000000565adfac in handle_select (thd=0x3fff85556070, lex=0x3fff855599f0, result=0x3fff7ea16d60, setup_tables_done_option=0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/sql_select.cc:384
 
#13 0x000000005656b710 in execute_sqlcom_select (thd=0x3fff85556070, all_tables=0x3fff7ea163b0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/sql_parse.cc:5899
 
#14 0x00000000565613b4 in mysql_execute_command (thd=0x3fff85556070) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/sql_parse.cc:2971
 
#15 0x000000005656f814 in mysql_parse (thd=0x3fff85556070, rawbuf=0x3fff7ea16088 "select count(*) from innodb_page_compressed3 where c1 < 500000", length=62, parser_state=0x3fff7ee85dd0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/sql_parse.cc:7322
 
#16 0x000000005655c6c8 in dispatch_command (command=COM_QUERY, thd=0x3fff85556070, packet=0x3fff8a439071 "", packet_length=62) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/sql_parse.cc:1488
 
#17 0x000000005655b174 in do_command (thd=0x3fff85556070) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/sql_parse.cc:1109
 
#18 0x00000000566f39e8 in do_handle_one_connection (thd_arg=0x3fff85556070) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/sql_connect.cc:1350
 
#19 0x00000000566f3648 in handle_one_connection (arg=0x3fff85556070) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/sql_connect.cc:1262
 
#20 0x0000000057102fec in pfs_spawn_thread (arg=0x3fff8367d5f0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/perfschema/pfs.cc:1860
 
#21 0x00003fff8bda7cec in start_thread (arg=0x3fff7ee87540) at pthread_create.c:312
 
#22 0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 25 (Thread 0x3fff767ff140 (LWP 16886)):
 
#0  0x0000000056b248f8 in os_atomic_test_and_set (ptr=0x5793e5a8 <sync_thread_mutex+104> "\001") at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/include/os0sync.h:529
 
#1  0x0000000056cfdc80 in ib_mutex_test_and_set (mutex=0x5793e540 <sync_thread_mutex>) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/include/sync0sync.ic:86
 
#2  0x0000000056cfdf58 in mutex_enter_func (mutex=0x5793e540 <sync_thread_mutex>, file_name=0x573f15f0 "/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/sync/sync0sync.cc", line=1200) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/include/sync0sync.ic:268
 
#3  0x0000000056cfe0a4 in pfs_mutex_enter_func (mutex=0x5793e540 <sync_thread_mutex>, file_name=0x573f15f0 "/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/sync/sync0sync.cc", line=1200) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/include/sync0sync.ic:375
 
#4  0x0000000056d00124 in sync_thread_add_level (latch=0x3fff8a7d29b8, level=142, relock=0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/sync/sync0sync.cc:1200
 
#5  0x0000000056cff344 in mutex_set_debug_info (mutex=0x3fff8a7d29b8, file_name=0x57413b88 "/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/buf/buf0flu.cc", line=1869) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/sync/sync0sync.cc:729
 
#6  0x0000000056dce58c in mutex_enter_func (mutex=0x3fff8a7d29b8, file_name=0x57413b88 "/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/buf/buf0flu.cc", line=1869) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/include/sync0sync.ic:271
 
#7  0x0000000056dce88c in pfs_mutex_enter_func (mutex=0x3fff8a7d29b8, file_name=0x57413b88 "/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/buf/buf0flu.cc", line=1869) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/include/sync0sync.ic:375
 
#8  0x0000000056dd7128 in buf_flush_start (buf_pool=0x3fff8a7d2478, flush_type=BUF_FLUSH_LIST) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/buf/buf0flu.cc:1869
 
#9  0x0000000056dd791c in buf_flush_list (min_n=18446744073709551614, lsn_limit=9452341, n_processed=0x3fff767fe0a8) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/buf/buf0flu.cc:2090
 
#10 0x0000000056e73ca8 in fil_crypt_flush_space (state=0x3fff767fe6a0, space=4) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0crypt.cc:2150
 
#11 0x0000000056e741ec in fil_crypt_complete_rotate_space (key_state=0x3fff767fe694, state=0x3fff767fe6a0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0crypt.cc:2262
 
#12 0x0000000056e74504 in fil_crypt_thread (arg=0x0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0crypt.cc:2355
 
#13 0x00003fff8bda7cec in start_thread (arg=0x3fff767ff140) at pthread_create.c:312
 
#14 0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 24 (Thread 0x3fff787ff140 (LWP 16882)):
 
#0  0x00003fff8bdafcc0 in __pthread_cond_timedwait (cond=0x3fff85792188, mutex=0x3fff85792150, abstime=0x3fff787fe5f0) at pthread_cond_timedwait.c:199
 
#1  0x0000000056bdb58c in os_cond_wait_timed (cond=0x3fff85792188, fast_mutex=0x3fff85792150, abstime=0x3fff787fe5f0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:159
 
#2  0x0000000056bdbfa8 in os_event_wait_time_low (event=0x3fff85792150, time_in_usec=5000000, reset_sig_count=1) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:591
 
#3  0x0000000056d4b2c8 in ib_wqueue_timedwait (wq=0x3fff8aee3d78, wait_in_usecs=5000000) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/ut/ut0wqueue.cc:154
 
#4  0x0000000056eb2a88 in fts_optimize_thread (arg=0x3fff8aee3d78) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fts/fts0opt.cc:3065
 
#5  0x00003fff8bda7cec in start_thread (arg=0x3fff787ff140) at pthread_create.c:312
 
#6  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 23 (Thread 0x3fff78fff140 (LWP 16881)):
 
#0  0x00003fff8bdafcc0 in __pthread_cond_timedwait (cond=0x3fff85791b68, mutex=0x3fff85791b30, abstime=0x3fff78ffe700) at pthread_cond_timedwait.c:199
 
#1  0x0000000056bdb58c in os_cond_wait_timed (cond=0x3fff85791b68, fast_mutex=0x3fff85791b30, abstime=0x3fff78ffe700) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:159
 
#2  0x0000000056bdbfa8 in os_event_wait_time_low (event=0x3fff85791b30, time_in_usec=10000000, reset_sig_count=1) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:591
 
#3  0x0000000056e48a70 in dict_stats_thread () at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/dict/dict0stats_bg.cc:542
 
#4  0x00003fff8bda7cec in start_thread (arg=0x3fff78fff140) at pthread_create.c:312
 
#5  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 22 (Thread 0x3fff7c7ff140 (LWP 16876)):
 
#0  0x00003fff8b653c14 in select () at ../sysdeps/unix/syscall-template.S:81
 
#1  0x0000000056bdcc80 in os_thread_sleep (tm=1000000) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0thread.cc:303
 
#2  0x0000000056ce9274 in srv_master_sleep () at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/srv/srv0srv.cc:3139
 
#3  0x0000000056ce94a4 in srv_master_thread (arg=0x0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/srv/srv0srv.cc:3189
 
#4  0x00003fff8bda7cec in start_thread (arg=0x3fff7c7ff140) at pthread_create.c:312
 
#5  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 21 (Thread 0x3fff7cfff140 (LWP 16875)):
 
#0  0x00003fff8bdafcc0 in __pthread_cond_timedwait (cond=0x3fff85790358, mutex=0x3fff85790320, abstime=0x3fff7cffe670) at pthread_cond_timedwait.c:199
 
#1  0x0000000056bdb58c in os_cond_wait_timed (cond=0x3fff85790358, fast_mutex=0x3fff85790320, abstime=0x3fff7cffe670) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:159
 
#2  0x0000000056bdbfa8 in os_event_wait_time_low (event=0x3fff85790320, time_in_usec=5000000, reset_sig_count=1) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:591
 
#3  0x0000000056ce67c8 in srv_monitor_thread () at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/srv/srv0srv.cc:2135
 
#4  0x00003fff8bda7cec in start_thread (arg=0x3fff7cfff140) at pthread_create.c:312
 
#5  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 20 (Thread 0x3fff7d7ff140 (LWP 16874)):
 
#0  0x00003fff8bdafcc0 in __pthread_cond_timedwait (cond=0x3fff857902e8, mutex=0x3fff857902b0, abstime=0x3fff7d7fe650) at pthread_cond_timedwait.c:199
 
#1  0x0000000056bdb58c in os_cond_wait_timed (cond=0x3fff857902e8, fast_mutex=0x3fff857902b0, abstime=0x3fff7d7fe650) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:159
 
#2  0x0000000056bdbfa8 in os_event_wait_time_low (event=0x3fff857902b0, time_in_usec=1000000, reset_sig_count=1) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:591
 
#3  0x0000000056ce720c in srv_error_monitor_thread () at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/srv/srv0srv.cc:2406
 
#4  0x00003fff8bda7cec in start_thread (arg=0x3fff7d7ff140) at pthread_create.c:312
 
#5  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 19 (Thread 0x3fff7e3ff140 (LWP 16873)):
 
#0  0x00003fff8bdafcc0 in __pthread_cond_timedwait (cond=0x3fff857918c8, mutex=0x3fff85791890, abstime=0x3fff7e3fe6e0) at pthread_cond_timedwait.c:199
 
#1  0x0000000056bdb58c in os_cond_wait_timed (cond=0x3fff857918c8, fast_mutex=0x3fff85791890, abstime=0x3fff7e3fe6e0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:159
 
#2  0x0000000056bdbfa8 in os_event_wait_time_low (event=0x3fff85791890, time_in_usec=1000000, reset_sig_count=1) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:591
 
#3  0x0000000056b969d0 in lock_wait_timeout_thread () at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/lock/lock0wait.cc:531
 
#4  0x00003fff8bda7cec in start_thread (arg=0x3fff7e3ff140) at pthread_create.c:312
 
#5  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 18 (Thread 0x3fff7f74f140 (LWP 16868)):
 
#0  0x00003fff8bd60688 in ?? () from /lib/powerpc64le-linux-gnu/libaio.so.1
 
#1  0x00003fff8bd606f0 in io_getevents () from /lib/powerpc64le-linux-gnu/libaio.so.1
 
#2  0x0000000056bd7d58 in os_aio_linux_collect (array=0x3fff837401a0, segment=1, seg_size=256) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0file.cc:5432
 
#3  0x0000000056bd8278 in os_aio_linux_handle (global_seg=5, message1=0x3fff7f74e6d8, message2=0x3fff7f74e6e0, type=0x3fff7f74e6e8, space_id=0x3fff7f74e6f0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0file.cc:5585
 
#4  0x0000000056e65c68 in fil_aio_wait (segment=5) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0fil.cc:6276
 
#5  0x0000000056ceef48 in io_handler_thread (arg=0x57926c40 <n+40>) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/srv/srv0start.cc:546
 
#6  0x00003fff8bda7cec in start_thread (arg=0x3fff7f74f140) at pthread_create.c:312
 
#7  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 17 (Thread 0x3fff7ff4f140 (LWP 16867)):
 
#0  0x00003fff8bd60688 in ?? () from /lib/powerpc64le-linux-gnu/libaio.so.1
 
#1  0x00003fff8bd606f0 in io_getevents () from /lib/powerpc64le-linux-gnu/libaio.so.1
 
#2  0x0000000056bd7d58 in os_aio_linux_collect (array=0x3fff837401a0, segment=0, seg_size=256) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0file.cc:5432
 
#3  0x0000000056bd8278 in os_aio_linux_handle (global_seg=4, message1=0x3fff7ff4e6d8, message2=0x3fff7ff4e6e0, type=0x3fff7ff4e6e8, space_id=0x3fff7ff4e6f0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0file.cc:5585
 
#4  0x0000000056e65c68 in fil_aio_wait (segment=4) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0fil.cc:6276
 
#5  0x0000000056ceef48 in io_handler_thread (arg=0x57926c38 <n+32>) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/srv/srv0start.cc:546
 
#6  0x00003fff8bda7cec in start_thread (arg=0x3fff7ff4f140) at pthread_create.c:312
 
#7  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 16 (Thread 0x3fff8074f140 (LWP 16866)):
 
#0  0x00003fff8bd60688 in ?? () from /lib/powerpc64le-linux-gnu/libaio.so.1
 
#1  0x00003fff8bd606f0 in io_getevents () from /lib/powerpc64le-linux-gnu/libaio.so.1
 
#2  0x0000000056bd7d58 in os_aio_linux_collect (array=0x3fff837400b0, segment=1, seg_size=256) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0file.cc:5432
 
#3  0x0000000056bd8278 in os_aio_linux_handle (global_seg=3, message1=0x3fff8074e6d8, message2=0x3fff8074e6e0, type=0x3fff8074e6e8, space_id=0x3fff8074e6f0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0file.cc:5585
 
#4  0x0000000056e65c68 in fil_aio_wait (segment=3) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0fil.cc:6276
 
#5  0x0000000056ceef48 in io_handler_thread (arg=0x57926c30 <n+24>) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/srv/srv0start.cc:546
 
#6  0x00003fff8bda7cec in start_thread (arg=0x3fff8074f140) at pthread_create.c:312
 
#7  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 15 (Thread 0x3fff797ff140 (LWP 16880)):
 
#0  0x00003fff8bdaf7d0 in __pthread_cond_wait (cond=0x3fff857903c8, mutex=0x3fff85790390) at pthread_cond_wait.c:188
 
#1  0x0000000056bdb700 in os_cond_wait (cond=0x3fff857903c8, fast_mutex=0x3fff85790390) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:196
 
#2  0x0000000056bdbd14 in os_event_wait_low (event=0x3fff85790390, reset_sig_count=1) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:477
 
#3  0x0000000056dcde88 in buf_dump_thread () at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/buf/buf0dump.cc:699
 
#4  0x00003fff8bda7cec in start_thread (arg=0x3fff797ff140) at pthread_create.c:312
 
#5  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 14 (Thread 0x3fff80f4f140 (LWP 16865)):
 
#0  0x00003fff8bd60688 in ?? () from /lib/powerpc64le-linux-gnu/libaio.so.1
 
#1  0x00003fff8bd606f0 in io_getevents () from /lib/powerpc64le-linux-gnu/libaio.so.1
 
#2  0x0000000056bd7d58 in os_aio_linux_collect (array=0x3fff837400b0, segment=0, seg_size=256) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0file.cc:5432
 
#3  0x0000000056bd8278 in os_aio_linux_handle (global_seg=2, message1=0x3fff80f4e6d8, message2=0x3fff80f4e6e0, type=0x3fff80f4e6e8, space_id=0x3fff80f4e6f0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0file.cc:5585
 
#4  0x0000000056e65c68 in fil_aio_wait (segment=2) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0fil.cc:6276
 
#5  0x0000000056ceef48 in io_handler_thread (arg=0x57926c28 <n+16>) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/srv/srv0start.cc:546
 
#6  0x00003fff8bda7cec in start_thread (arg=0x3fff80f4f140) at pthread_create.c:312
 
#7  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 13 (Thread 0x3fff7a7ff140 (LWP 16879)):
 
#0  0x00003fff8b653c14 in select () at ../sysdeps/unix/syscall-template.S:81
 
#1  0x0000000056bdcc80 in os_thread_sleep (tm=286000) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0thread.cc:303
 
#2  0x0000000056dd9494 in page_cleaner_sleep_if_needed (next_loop_time=1483836520835) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/buf/buf0flu.cc:2645
 
#3  0x0000000056dd9f68 in buf_flush_lru_manager_thread (arg=0x0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/buf/buf0flu.cc:2919
 
#4  0x00003fff8bda7cec in start_thread (arg=0x3fff7a7ff140) at pthread_create.c:312
 
#5  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 12 (Thread 0x3fff8174f140 (LWP 16864)):
 
#0  0x00003fff8bd60688 in ?? () from /lib/powerpc64le-linux-gnu/libaio.so.1
 
#1  0x00003fff8bd606f0 in io_getevents () from /lib/powerpc64le-linux-gnu/libaio.so.1
 
#2  0x0000000056bd7d58 in os_aio_linux_collect (array=0x3fff83740100, segment=0, seg_size=256) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0file.cc:5432
 
#3  0x0000000056bd8278 in os_aio_linux_handle (global_seg=1, message1=0x3fff8174e6d8, message2=0x3fff8174e6e0, type=0x3fff8174e6e8, space_id=0x3fff8174e6f0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0file.cc:5585
 
#4  0x0000000056e65c68 in fil_aio_wait (segment=1) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0fil.cc:6276
 
#5  0x0000000056ceef48 in io_handler_thread (arg=0x57926c20 <n+8>) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/srv/srv0start.cc:546
 
#6  0x00003fff8bda7cec in start_thread (arg=0x3fff8174f140) at pthread_create.c:312
 
#7  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 11 (Thread 0x3fff7bfff140 (LWP 16877)):
 
#0  0x00003fff8bdaf7d0 in __pthread_cond_wait (cond=0x3fff85790278, mutex=0x3fff85790240) at pthread_cond_wait.c:188
 
#1  0x0000000056bdb700 in os_cond_wait (cond=0x3fff85790278, fast_mutex=0x3fff85790240) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:196
 
#2  0x0000000056bdbd14 in os_event_wait_low (event=0x3fff85790240, reset_sig_count=10) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:477
 
#3  0x0000000056cea2bc in srv_purge_coordinator_suspend (slot=0x3fff8ae482c8, rseg_history_len=9) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/srv/srv0srv.cc:3499
 
#4  0x0000000056cea9dc in srv_purge_coordinator_thread (arg=0x0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/srv/srv0srv.cc:3621
 
#5  0x00003fff8bda7cec in start_thread (arg=0x3fff7bfff140) at pthread_create.c:312
 
#6  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 10 (Thread 0x3fff81f4f140 (LWP 16863)):
 
#0  0x00003fff8bd60688 in ?? () from /lib/powerpc64le-linux-gnu/libaio.so.1
 
#1  0x00003fff8bd606f0 in io_getevents () from /lib/powerpc64le-linux-gnu/libaio.so.1
 
#2  0x0000000056bd7d58 in os_aio_linux_collect (array=0x3fff83740150, segment=0, seg_size=256) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0file.cc:5432
 
#3  0x0000000056bd8278 in os_aio_linux_handle (global_seg=0, message1=0x3fff81f4e6d8, message2=0x3fff81f4e6e0, type=0x3fff81f4e6e8, space_id=0x3fff81f4e6f0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0file.cc:5585
 
#4  0x0000000056e65c68 in fil_aio_wait (segment=0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0fil.cc:6276
 
#5  0x0000000056ceef48 in io_handler_thread (arg=0x57926c18 <n>) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/srv/srv0start.cc:546
 
#6  0x00003fff8bda7cec in start_thread (arg=0x3fff81f4f140) at pthread_create.c:312
 
#7  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 9 (Thread 0x3fff833ff140 (LWP 16858)):
 
#0  0x00003fff8bdafcc0 in __pthread_cond_timedwait (cond=0x581448a8 <COND_checkpoint>, mutex=0x58144820 <LOCK_checkpoint+40>, abstime=0x3fff833fe5e0) at pthread_cond_timedwait.c:199
 
#1  0x0000000057194470 in safe_cond_timedwait (cond=0x581448a8 <COND_checkpoint>, mp=0x581447f8 <LOCK_checkpoint>, abstime=0x3fff833fe5e0, file=0x57456eb0 "/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/include/mysql/psi/mysql_thread.h", line=1191) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/mysys/thr_mutex.c:547
 
#2  0x0000000056f56a88 in inline_mysql_cond_timedwait (that=0x581448a8 <COND_checkpoint>, mutex=0x581447f8 <LOCK_checkpoint>, abstime=0x3fff833fe5e0, src_file=0x57456f30 "/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/maria/ma_servicethread.c", src_line=116) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/include/mysql/psi/mysql_thread.h:1191
 
#3  0x0000000056f57198 in my_service_thread_sleep (control=0x576fa898 <checkpoint_control>, sleep_time=29000000000) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/maria/ma_servicethread.c:115
 
#4  0x0000000056f45dcc in ma_checkpoint_background (arg=0x1e) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/maria/ma_checkpoint.c:708
 
#5  0x0000000057102fec in pfs_spawn_thread (arg=0x3fff8aea3ff0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/perfschema/pfs.cc:1860
 
#6  0x00003fff8bda7cec in start_thread (arg=0x3fff833ff140) at pthread_create.c:312
 
#7  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 8 (Thread 0x3fff84bff140 (LWP 16857)):
 
#0  0x00003fff8bdafcc0 in __pthread_cond_timedwait (cond=0x58155e70 <COND_timer>, mutex=0x58155de8 <LOCK_timer+40>, abstime=0x3fff84bfe6e0) at pthread_cond_timedwait.c:199
 
#1  0x0000000057194470 in safe_cond_timedwait (cond=0x58155e70 <COND_timer>, mp=0x58155dc0 <LOCK_timer>, abstime=0x3fff84bfe6e0, file=0x57497f70 "/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/include/mysql/psi/mysql_thread.h", line=1191) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/mysys/thr_mutex.c:547
 
#2  0x0000000057195d34 in inline_mysql_cond_timedwait (that=0x58155e70 <COND_timer>, mutex=0x58155dc0 <LOCK_timer>, abstime=0x3fff84bfe6e0, src_file=0x57497fe0 "/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/mysys/thr_timer.c", src_line=292) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/include/mysql/psi/mysql_thread.h:1191
 
#3  0x0000000057196d4c in timer_handler (arg=0x0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/mysys/thr_timer.c:292
 
#4  0x0000000057102fec in pfs_spawn_thread (arg=0x3fff8aea1cf0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/perfschema/pfs.cc:1860
 
#5  0x00003fff8bda7cec in start_thread (arg=0x3fff84bff140) at pthread_create.c:312
 
#6  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 7 (Thread 0x3fff8be57b70 (LWP 16849)):
 
#0  0x00003fff8b651438 in poll () at ../sysdeps/unix/syscall-template.S:81
 
#1  0x000000005644cae8 in handle_connections_sockets () at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld.cc:6539
 
#2  0x000000005644b5e8 in mysqld_main (argc=151, argv=0x3fff8af510c0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld.cc:5964
 
#3  0x000000005643b148 in main (argc=27, argv=0x3fffc637e8f8) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/main.cc:25
 
 
 
Thread 6 (Thread 0x3fff7eee7540 (LWP 16889)):
 
#0  0x00003fff8bdaf7d0 in __pthread_cond_wait (cond=0x578b4c08 <COND_slave_background>, mutex=0x578b7be0 <LOCK_slave_background+40>) at pthread_cond_wait.c:188
 
#1  0x0000000057194098 in safe_cond_wait (cond=0x578b4c08 <COND_slave_background>, mp=0x578b7bb8 <LOCK_slave_background>, file=0x5727f2a0 "/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/include/mysql/psi/mysql_thread.h", line=1154) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/mysys/thr_mutex.c:493
 
#2  0x000000005647b968 in inline_mysql_cond_wait (that=0x578b4c08 <COND_slave_background>, mutex=0x578b7bb8 <LOCK_slave_background>, src_file=0x5727fc58 "/var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/slave.cc", src_line=341) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/include/mysql/psi/mysql_thread.h:1154
 
#3  0x000000005647d240 in handle_slave_background (arg=0x0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/slave.cc:341
 
#4  0x0000000057102fec in pfs_spawn_thread (arg=0x3fff8367c6f0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/perfschema/pfs.cc:1860
 
#5  0x00003fff8bda7cec in start_thread (arg=0x3fff7eee7540) at pthread_create.c:312
 
#6  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 5 (Thread 0x3fff7ef47540 (LWP 16888)):
 
#0  0x00003fff8bdb5714 in do_sigwait (sig=0x3fff7ef46a40, set=<optimized out>) at ../sysdeps/unix/sysv/linux/sigwait.c:61
 
#1  __sigwait (set=<optimized out>, sig=0x3fff7ef46a40) at ../sysdeps/unix/sysv/linux/sigwait.c:98
 
#2  0x0000000056444b90 in signal_hand (arg=0x0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/mysqld.cc:3465
 
#3  0x0000000057102fec in pfs_spawn_thread (arg=0x3fff8367b7f0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/perfschema/pfs.cc:1860
 
#4  0x00003fff8bda7cec in start_thread (arg=0x3fff7ef47540) at pthread_create.c:312
 
#5  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 4 (Thread 0x3fff75fff140 (LWP 16887)):
 
#0  0x00003fff8b653c14 in select () at ../sysdeps/unix/syscall-template.S:81
 
#1  0x0000000056bdcc80 in os_thread_sleep (tm=1000000) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0thread.cc:303
 
#2  0x0000000056daadf0 in btr_defragment_thread (arg=0x0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/btr/btr0defragment.cc:758
 
#3  0x00003fff8bda7cec in start_thread (arg=0x3fff75fff140) at pthread_create.c:312
 
#4  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 3 (Thread 0x3fff76fff140 (LWP 16885)):
 
#0  0x00003fff8bdafcc0 in __pthread_cond_timedwait (cond=0x3fff857915b8, mutex=0x3fff85791580, abstime=0x3fff76ffe030) at pthread_cond_timedwait.c:199
 
#1  0x0000000056bdb58c in os_cond_wait_timed (cond=0x3fff857915b8, fast_mutex=0x3fff85791580, abstime=0x3fff76ffe030) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:159
 
#2  0x0000000056bdbfa8 in os_event_wait_time_low (event=0x3fff85791580, time_in_usec=36000, reset_sig_count=1) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:591
 
#3  0x0000000056e73abc in fil_crypt_rotate_page (key_state=0x3fff76ffe694, state=0x3fff76ffe6a0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0crypt.cc:2094
 
#4  0x0000000056e73b9c in fil_crypt_rotate_pages (key_state=0x3fff76ffe694, state=0x3fff76ffe6a0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0crypt.cc:2125
 
#5  0x0000000056e7448c in fil_crypt_thread (arg=0x0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0crypt.cc:2348
 
#6  0x00003fff8bda7cec in start_thread (arg=0x3fff76fff140) at pthread_create.c:312
 
#7  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 2 (Thread 0x3fff777ff140 (LWP 16884)):
 
#0  0x00003fff8bdafcc0 in __pthread_cond_timedwait (cond=0x3fff857915b8, mutex=0x3fff85791580, abstime=0x3fff777fe030) at pthread_cond_timedwait.c:199
 
#1  0x0000000056bdb58c in os_cond_wait_timed (cond=0x3fff857915b8, fast_mutex=0x3fff85791580, abstime=0x3fff777fe030) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:159
 
#2  0x0000000056bdbfa8 in os_event_wait_time_low (event=0x3fff85791580, time_in_usec=35000, reset_sig_count=1) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/os/os0sync.cc:591
 
#3  0x0000000056e73abc in fil_crypt_rotate_page (key_state=0x3fff777fe694, state=0x3fff777fe6a0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0crypt.cc:2094
 
#4  0x0000000056e73b9c in fil_crypt_rotate_pages (key_state=0x3fff777fe694, state=0x3fff777fe6a0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0crypt.cc:2125
 
#5  0x0000000056e7448c in fil_crypt_thread (arg=0x0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0crypt.cc:2348
 
#6  0x00003fff8bda7cec in start_thread (arg=0x3fff777ff140) at pthread_create.c:312
 
#7  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96
 
 
 
Thread 1 (Thread 0x3fff77fff140 (LWP 16883)):
 
#0  0x00003fff8bdb0ef0 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:60
 
#1  0x000000005718c718 in my_write_core (sig=6) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/mysys/stacktrace.c:477
 
#2  0x0000000056866324 in handle_fatal_signal (sig=6) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/sql/signal_handler.cc:296
 
#3  <signal handler called>
 
#4  0x00003fff8b56eeb8 in __GI_raise (sig=<optimized out>) at ../sysdeps/unix/sysv/linux/raise.c:55
 
#5  0x00003fff8b5719bc in __GI_abort () at abort.c:89
 
#6  0x0000000056e7405c in fil_crypt_complete_rotate_space (key_state=0x3fff77ffe694, state=0x3fff77ffe6a0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0crypt.cc:2220
 
#7  0x0000000056e74504 in fil_crypt_thread (arg=0x0) at /var/lib/buildbot/maria-slave/p8-trusty-bintar-debug/build/storage/xtradb/fil/fil0crypt.cc:2355
 
#8  0x00003fff8bda7cec in start_thread (arg=0x3fff77fff140) at pthread_create.c:312
 
#9  0x00003fff8b661140 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:96

Comment by Marko Mäkelä [ 2017-01-10 ]

The posted crash does not occur at shutdown, but during normal processing. Before the crash, the server was restarted, and an UPDATE without any WHERE condition was performed on several tables. The crash occurs during a SELECT.

Commit ffb38c9771bc7 only modifies some tests (MDEV-8139) that were previously disabled.
Commit ffb38c9771bc7~ (719321e78e69) refactors the shutdown, addressing MDEV-11638.
Commit ffb38c9771bc7~2 (0f8e17af92cd0) cherry-picked a fix of Bug#24450908 from MySQL 5.7. That has nothing to do with encryption.

If any of these commits is to blame for the crash, that would be the shutdown refactoring. I carefully reviewed it again. It did not change fil_crypt_complete_rotate_space() or fil_crypt_thread(), and normal operation outside shutdown should not be affected by the change to rotate_thread_t::should_shutdown(), by the removal of fil_crypt_threads_end() or by exposing fil_crypt_threads_event so that logs_empty_and_mark_files_at_shutdown() can signal it.

One more change was related to moving the initialization and shutdown of the log_scrub_thread. It is now being initialized with the rest of the redo log subsystem. But, the test encryption.innodb_encryption-page-compression does not innodb_scrub_log, and the crash occurred very much after server startup.

Comment by Marko Mäkelä [ 2017-01-10 ]

I got the same assertion failure (crypt_data->rotate_state.active_threads > 0) a little earlier in the test when running ./mtr --valgrind --suite=encryption:

CURRENT_TEST: encryption.innodb_encryption_tables
 
mysqltest: At line 79: query 'update innodb_normal set c1 = c1 + 1' failed: 2013: Lost connection to MySQL server during query

This gives a clue how to repeat that crash. Maybe we can just bombard an encrypted table with such an UPDATE in a loop.

There was also a vgcore file generated by Valgrind. In that file, we can see the following interesting information:

(gdb) p *crypt_data
 
$2 = {<st_encryption_scheme> = {
 
    iv = "b\220P\202\362\312\063\334d\253VUI\360WP", key = {{
 
        version = 1484056211, 
        key = "\\z\372\"\275BxS\353\315\034JH\302", <incomplete sequence \342\253>}, {version = 0, key = '\000' <repeats 15 times>}, {version = 0, 
        key = '\000' <repeats 15 times>}}, keyserver_requests = 1, key_id = 1, 
    type = 1, 
    locker = 0xb4efff0 <crypt_data_scheme_locker(st_encryption_scheme*, int)>}, min_key_version = 1484056384, page0_offset = 10428, 
  encryption = FIL_SPACE_ENCRYPTION_DEFAULT, mutex = {event = 0x11a91f40, 
    lock_word = 1 '\001', waiters = 0, list = {prev = 0x0, next = 0xd0c5f68}, 
    level = 3000, 
    file_name = 0xb743809 "/home/marko/mariadb/server/storage/innobase/fil/fil0crypt.cc", line = 2205, 
    cfile_name = 0xb743ca6 "/home/marko/mariadb/server/storage/innobase/include/fil0crypt.h", cline = 137, count_os_wait = 0, 
    cmutex_name = 0xb743c9f "&mutex", thread_id = 392218368, magic_n = 979585, 
    ib_mutex_type = 0, pfs_psi = 0x0}, closing = false, 
  key_found = 1484056384, rotate_state = {start_time = 1484056387, 
    active_threads = 0, next_offset = 22, max_offset = 6, 
    min_key_version_found = 1484056384, end_lsn = 5469923, starting = false, 
    flushing = true, scrubbing = {is_active = false, 
      last_scrub_completed = 0}}}
 
(gdb) i lo
 
last = false
 
done = false
 
should_flush = false
 
space = 1
 
crypt_data = 0xd0c72f0
 
(gdb) symbol-file …/storage/innobase/ha_innodb.so 
…
 
(gdb) p fil_system.space_list.start.space_list.next.space_list.next.space_list.next.id
 
$7 = 1
 
(gdb) p fil_system.space_list.start.space_list.next.space_list.next.space_list.next.name
 
$8 = 0xd048af0 "mysql/innodb_table_stats"

Interestingly, it failed for a table that could be updated by a background thread, asynchronously triggered by the UPDATE statement from the SQL statement.

So far, I have not seen any other wrongdoing, but the tests are still running, and it is a known fact that the Valgrind virtual machine runs in single-threaded mode, reducing the possibility of race conditions. The only Valgrind messages so far are the 1177 memory leaks reported after the message ‘Writing a core file’ for the above crash.

Comment by Elena Stepanova [ 2017-01-15 ]

A failure similar to one of the above with encryption.innodb-missing-key test:
http://buildbot.askmonty.org/buildbot/builders/kvm-deb-yakkety-x86/builds/350/steps/test_5/logs/stdio

encryption.innodb-missing-key 'ctr,xtradb' w4 [ fail ]
 
        Test ended at 2017-01-05 11:27:24
 
 
 
CURRENT_TEST: encryption.innodb-missing-key
 
mysqltest: At line 47: query 'SELECT SLEEP(5)' failed: 2013: Lost connection to MySQL server during query
 
 
 
The result from queries just before the failure was:
 
< snip >
 
INSERT INTO t1(b) VALUES ('thisissecredmessage');
 
INSERT INTO t1(b) SELECT b FROM t1;
 
INSERT INTO t1(b) SELECT b FROM t1;
 
INSERT INTO t1(b) SELECT b FROM t1;
 
INSERT INTO t1(b) SELECT b FROM t1;
 
INSERT INTO t1(b) SELECT b FROM t1;
 
INSERT INTO t1(b) SELECT b FROM t1;
 
INSERT INTO t1(b) SELECT b FROM t1;
 
INSERT INTO t1(b) SELECT b FROM t1;
 
INSERT INTO t1(b) SELECT b FROM t1;
 
INSERT INTO t1(b) SELECT b FROM t1;
 
INSERT INTO t1(b) SELECT b FROM t1;
 
INSERT INTO t2 SELECT * FROM t1;
 
INSERT INTO t3 SELECT * FROM t1;
 
 
 
# Restart server with keys3.txt
 
set global innodb_encryption_rotate_key_age = 1;
 
use test;
 
CREATE TABLE t4(a int not null primary key auto_increment, b varchar(128)) engine=innodb ENCRYPTED=YES ENCRYPTION_KEY_ID=1;
 
SELECT SLEEP(5);
 
 
 
More results from queries before failure can be found in /dev/shm/var/4/log/innodb-missing-key.log
 
 
 
 
 
Server [mysqld.1 - pid: 2210, winpid: 2210, exit: 256] failed during test run
 
Server log from this test:
 
----------SERVER LOG START-----------
 
2017-01-05 11:27:01 3068643904 [Note] /usr/sbin/mysqld (mysqld 10.1.21-MariaDB-1~yakkety) starting as process 1968 ...
 
2017-01-05 11:27:01 3068643904 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4162)
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'partition' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'SEQUENCE' is disabled.
 
innodb_open_files should not be greater than the open_files_limit.
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: innodb_empty_free_list_algorithm has been changed to legacy because of small buffer pool size. In order to use backoff, increase buffer pool at least up to 20MB.
 
 
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: Using mutexes to ref count buffer pool pages
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: The InnoDB memory heap is disabled
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: Compressed tables use zlib 1.2.8
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: Using Linux native AIO
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: Using generic crc32 instructions
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: Initializing buffer pool, size = 8.0M
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: Completed initialization of buffer pool
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: Highest supported file format is Barracuda.
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: 128 rollback segment(s) are active.
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: Waiting for purge to start
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB:  Percona XtraDB (http://www.percona.com) 5.6.34-79.1 started; log sequence number 1629796
 
2017-01-05 11:27:01 2797587264 [Note] InnoDB: Dumping buffer pool(s) not yet started
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: Creating #1 thread id 2764045120 total threads 4.
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: Creating #2 thread id 2755652416 total threads 4.
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: Creating #3 thread id 2747259712 total threads 4.
 
2017-01-05 11:27:01 3068643904 [Note] InnoDB: Creating #4 thread id 2738867008 total threads 4.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_SYS_INDEXES' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'XTRADB_RSEG' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'CHANGED_PAGE_BITMAPS' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_LOCK_WAITS' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'XTRADB_INTERNAL_HASH_TABLES' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_SYS_FIELDS' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'FEEDBACK' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_CMP' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_MUTEXES' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_CMP_RESET' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_SYS_COLUMNS' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_FT_CONFIG' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'XTRADB_READ_VIEW' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_CHANGED_PAGES' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_FT_DELETED' is disabled.
 
2017-01-05 11:27:01 3068643904 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled.
 
2017-01-05 11:27:01 3068643904 [Warning] /usr/sbin/mysqld: unknown variable 'loose-feedback-debug-startup-interval=20'
 
2017-01-05 11:27:01 3068643904 [Warning] /usr/sbin/mysqld: unknown variable 'loose-feedback-debug-first-interval=60'
 
2017-01-05 11:27:01 3068643904 [Warning] /usr/sbin/mysqld: unknown variable 'loose-feedback-debug-interval=60'
 
2017-01-05 11:27:01 3068643904 [Warning] /usr/sbin/mysqld: unknown option '--loose-pam-debug'
 
2017-01-05 11:27:01 3068643904 [Warning] /usr/sbin/mysqld: unknown variable 'loose-debug-sync-timeout=300'
 
2017-01-05 11:27:01 3068643904 [Note] Server socket created on IP: '127.0.0.1'.
 
2017-01-05 11:27:01 3068643904 [Note] /usr/sbin/mysqld: ready for connections.
 
Version: '10.1.21-MariaDB-1~yakkety'  socket: '/dev/shm/var/tmp/4/mysqld.1.sock'  port: 16060  mariadb.org binary distribution
 
2017-01-05 11:27:01 3067883328 [Note] /usr/sbin/mysqld: Normal shutdown
 
 
 
2017-01-05 11:27:01 3067883328 [Note] Event Scheduler: Purging the queue. 0 events
 
2017-01-05 11:27:01 2780801856 [Note] InnoDB: FTS optimize thread exiting.
 
2017-01-05 11:27:01 3067883328 [Note] InnoDB: Starting shutdown...
 
2017-01-05 11:27:02 3067883328 [Note] InnoDB: Waiting for page_cleaner to finish flushing of buffer pool
 
2017-01-05 11:27:04 3067883328 [Note] InnoDB: Shutdown completed; log sequence number 1629806
 
2017-01-05 11:27:04 3067883328 [Note] /usr/sbin/mysqld: Shutdown complete
 
 
 
2017-01-05 11:27:04 3068418624 [Note] /usr/sbin/mysqld (mysqld 10.1.21-MariaDB-1~yakkety) starting as process 2097 ...
 
2017-01-05 11:27:04 3068418624 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4162)
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'partition' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'SEQUENCE' is disabled.
 
innodb_open_files should not be greater than the open_files_limit.
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: innodb_empty_free_list_algorithm has been changed to legacy because of small buffer pool size. In order to use backoff, increase buffer pool at least up to 20MB.
 
 
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: Using mutexes to ref count buffer pool pages
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: The InnoDB memory heap is disabled
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: Compressed tables use zlib 1.2.8
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: Using Linux native AIO
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: Using generic crc32 instructions
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: Initializing buffer pool, size = 8.0M
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: Completed initialization of buffer pool
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: Highest supported file format is Barracuda.
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: 128 rollback segment(s) are active.
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: Waiting for purge to start
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB:  Percona XtraDB (http://www.percona.com) 5.6.34-79.1 started; log sequence number 1629806
 
2017-01-05 11:27:05 2797595456 [Note] InnoDB: Dumping buffer pool(s) not yet started
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: Creating #1 thread id 2764041024 total threads 4.
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: Creating #2 thread id 2747267904 total threads 4.
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: Creating #3 thread id 2738875200 total threads 4.
 
2017-01-05 11:27:05 3068418624 [Note] InnoDB: Creating #4 thread id 2730482496 total threads 4.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_SYS_INDEXES' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'XTRADB_RSEG' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'CHANGED_PAGE_BITMAPS' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_LOCK_WAITS' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'XTRADB_INTERNAL_HASH_TABLES' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_SYS_FIELDS' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'FEEDBACK' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_CMP' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_MUTEXES' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_CMP_RESET' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_SYS_COLUMNS' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_FT_CONFIG' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'XTRADB_READ_VIEW' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_CHANGED_PAGES' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_FT_DELETED' is disabled.
 
2017-01-05 11:27:05 3068418624 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled.
 
2017-01-05 11:27:05 3068418624 [Warning] /usr/sbin/mysqld: unknown variable 'loose-feedback-debug-startup-interval=20'
 
2017-01-05 11:27:05 3068418624 [Warning] /usr/sbin/mysqld: unknown variable 'loose-feedback-debug-first-interval=60'
 
2017-01-05 11:27:05 3068418624 [Warning] /usr/sbin/mysqld: unknown variable 'loose-feedback-debug-interval=60'
 
2017-01-05 11:27:05 3068418624 [Warning] /usr/sbin/mysqld: unknown option '--loose-pam-debug'
 
2017-01-05 11:27:05 3068418624 [Warning] /usr/sbin/mysqld: unknown variable 'loose-debug-sync-timeout=300'
 
2017-01-05 11:27:05 3068418624 [Note] Server socket created on IP: '127.0.0.1'.
 
2017-01-05 11:27:05 3068418624 [Note] /usr/sbin/mysqld: ready for connections.
 
Version: '10.1.21-MariaDB-1~yakkety'  socket: '/dev/shm/var/tmp/4/mysqld.1.sock'  port: 16060  mariadb.org binary distribution
 
2017-01-05 11:27:05 3067658048 [Note] /usr/sbin/mysqld: Normal shutdown
 
 
 
2017-01-05 11:27:05 3067658048 [Note] Event Scheduler: Purging the queue. 0 events
 
2017-01-05 11:27:05 2772433728 [Note] InnoDB: FTS optimize thread exiting.
 
2017-01-05 11:27:05 3067658048 [Note] InnoDB: Starting shutdown...
 
2017-01-05 11:27:06 3067658048 [Note] InnoDB: Waiting for page_cleaner to finish flushing of buffer pool
 
2017-01-05 11:27:07 3067658048 [Note] InnoDB: Shutdown completed; log sequence number 2123897
 
2017-01-05 11:27:07 3067658048 [Note] /usr/sbin/mysqld: Shutdown complete
 
 
 
2017-01-05 11:27:08 3067910720 [Note] /usr/sbin/mysqld (mysqld 10.1.21-MariaDB-1~yakkety) starting as process 2211 ...
 
2017-01-05 11:27:08 3067910720 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4162)
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'partition' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'SEQUENCE' is disabled.
 
innodb_open_files should not be greater than the open_files_limit.
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: innodb_empty_free_list_algorithm has been changed to legacy because of small buffer pool size. In order to use backoff, increase buffer pool at least up to 20MB.
 
 
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: Using mutexes to ref count buffer pool pages
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: The InnoDB memory heap is disabled
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: Compressed tables use zlib 1.2.8
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: Using Linux native AIO
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: Using generic crc32 instructions
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: Initializing buffer pool, size = 8.0M
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: Completed initialization of buffer pool
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: Highest supported file format is Barracuda.
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: 128 rollback segment(s) are active.
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: Waiting for purge to start
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB:  Percona XtraDB (http://www.percona.com) 5.6.34-79.1 started; log sequence number 2123897
 
2017-01-05 11:27:09 2797579072 [Note] InnoDB: Dumping buffer pool(s) not yet started
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: Creating #1 thread id 2764016448 total threads 4.
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: Creating #2 thread id 2747267904 total threads 4.
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: Creating #3 thread id 2738875200 total threads 4.
 
2017-01-05 11:27:09 3067910720 [Note] InnoDB: Creating #4 thread id 2730482496 total threads 4.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_SYS_INDEXES' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'XTRADB_RSEG' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'CHANGED_PAGE_BITMAPS' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_LOCK_WAITS' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'XTRADB_INTERNAL_HASH_TABLES' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_SYS_FIELDS' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'FEEDBACK' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_CMP' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_MUTEXES' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_CMP_RESET' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_SYS_COLUMNS' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_FT_CONFIG' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'XTRADB_READ_VIEW' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_CHANGED_PAGES' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_FT_DELETED' is disabled.
 
2017-01-05 11:27:09 3067910720 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled.
 
2017-01-05 11:27:09 3067910720 [Warning] /usr/sbin/mysqld: unknown variable 'loose-feedback-debug-startup-interval=20'
 
2017-01-05 11:27:09 3067910720 [Warning] /usr/sbin/mysqld: unknown variable 'loose-feedback-debug-first-interval=60'
 
2017-01-05 11:27:09 3067910720 [Warning] /usr/sbin/mysqld: unknown variable 'loose-feedback-debug-interval=60'
 
2017-01-05 11:27:09 3067910720 [Warning] /usr/sbin/mysqld: unknown option '--loose-pam-debug'
 
2017-01-05 11:27:09 3067910720 [Warning] /usr/sbin/mysqld: unknown variable 'loose-debug-sync-timeout=300'
 
2017-01-05 11:27:09 3067910720 [Note] Server socket created on IP: '127.0.0.1'.
 
2017-01-05 11:27:09 3067910720 [Note] /usr/sbin/mysqld: ready for connections.
 
Version: '10.1.21-MariaDB-1~yakkety'  socket: '/dev/shm/var/tmp/4/mysqld.1.sock'  port: 16060  mariadb.org binary distribution
 
2017-01-05 11:27:14 a2bfdb40  InnoDB: Assertion failure in thread 2730482496 in file fil0crypt.cc line 2220
 
InnoDB: Failing assertion: crypt_data->rotate_state.active_threads > 0
 
InnoDB: We intentionally generate a memory trap.
 
InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
 
InnoDB: If you get repeated assertion failures or crashes, even
 
InnoDB: immediately after the mysqld startup, there may be
 
InnoDB: corruption in the InnoDB tablespace. Please refer to
 
InnoDB: http://dev.mysql.com/doc/refman/5.6/en/forcing-innodb-recovery.html
 
InnoDB: about forcing recovery.
 
170105 11:27:14 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.1.21-MariaDB-1~yakkety
 
key_buffer_size=1048576
 
read_buffer_size=131072
 
max_used_connections=1
 
max_threads=153
 
thread_count=1
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 61770 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0x0
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x0 thread_stack 0x48400
 
/usr/sbin/mysqld(my_print_stacktrace+0x28)[0x8094ccf8]
 
/usr/sbin/mysqld(handle_fatal_signal+0x3b7)[0x80479427]
 
[0xb76e9d10]
 
[0xb76e9d05]
 
/lib/i386-linux-gnu/libc.so.6(gsignal+0xb0)[0xb6f56050]
 
/lib/i386-linux-gnu/libc.so.6(abort+0x157)[0xb6f57577]
 
/usr/sbin/mysqld(+0x86d990)[0x808d3990]
 
/lib/i386-linux-gnu/libpthread.so.0(+0x62d5)[0xb73502d5]
 
/lib/i386-linux-gnu/libc.so.6(clone+0x6e)[0xb701347e]
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
Writing a core file

Comment by Lixun Peng [ 2017-01-23 ]

I got a new core (The core file in the attach file, named core.gz): core.gz

Compile command: cmake . -DCMAKE_BUILD_TYPE=Debug -DWITH_VALGRIND=1
Test command: ./mysql-test-run.pl --timer --force --comment=ps_row --vardir=var-ps_row --ps-protocol --big-test --max-test-fail=0 --parallel=24 --max-connections=2048

The fail message:

encryption.create_or_replace 'cbc,innodb' w12 [ fail ]
 
        Test ended at 2017-01-24 03:12:17
 
 
 
CURRENT_TEST: encryption.create_or_replace
 
mysqltest: At line 104: Cannot reap on a connection without pending send
 
 
 
The result from queries just before the failure was:
 
< snip >
 
SET GLOBAL innodb_encryption_threads = 0;
 
SET GLOBAL innodb_encryption_threads = 4;
 
CREATE TABLE `table10_int_autoinc` (`col_int_key` int, pk int auto_increment, `col_int` int, key (`col_int_key` ),primary key (pk)) engine=innodb;
 
INSERT /*! IGNORE */ INTO table10_int_autoinc VALUES  (NULL, NULL, -474021888) ,  (1, NULL, NULL) ,  (1141047296, NULL, NULL) ,  (NULL, NULL, NULL) ,  (NULL, NULL, 1) ,  (NULL, NULL, 9) ,  (0, NULL, 1225785344) ,  (NULL, NULL, 1574174720) ,  (2, NULL, NULL) ,  (6, NULL, 3);
 
CREATE TABLE `table1_int_autoinc` (`col_int_key` int, pk int auto_increment, `col_int` int,key (`col_int_key` ), primary key (pk)) engine=innodb;
 
CREATE TABLE `table0_int_autoinc` (`col_int_key` int, pk int auto_increment, `col_int` int, key (`col_int_key` ),primary key (pk)) engine=innodb;
 
INSERT /*! IGNORE */ INTO table1_int_autoinc VALUES  (4, NULL, NULL);
 
INSERT IGNORE INTO `table0_int_autoinc` ( `col_int_key` ) VALUES ( 1 ), ( 3 ), ( 4 ), ( 1 );
 
INSERT IGNORE INTO `table1_int_autoinc` ( `col_int` ) VALUES ( 1 ), ( 0 ), ( 7 ), ( 9 );
 
INSERT IGNORE INTO `table10_int_autoinc` ( `col_int` ) VALUES ( 6 ), ( 2 ), ( 3 ), ( 6 );
 
connect  con1,localhost,root,,test;
 
connect  con2,localhost,root,,test;
 
ERROR HY000: Lost connection to MySQL server during query
 
ERROR HY000: MySQL server has gone away
 
ERROR HY000: Lost connection to MySQL server during query
 
ERROR HY000: MySQL server has gone away
 
ERROR HY000: MySQL server has gone away
 
ERROR HY000: MySQL server has gone away
 
ERROR HY000: MySQL server has gone away
 
 
 
More results from queries before failure can be found in /u01/MariaDB/mysql-test/var-ps_row/12/log/create_or_replace.log
 
 
 
 
 
Server [mysqld.1 - pid: 19923, winpid: 19923, exit: 256] failed during test run
 
Server log from this test:
 
----------SERVER LOG START-----------
 
2017-01-24  3:12:06 140040809035648 [Note] /u01/MariaDB/sql/mysqld (mysqld 10.2.4-MariaDB-debug-log) starting as process 19925 ...
 
2017-01-24  3:12:06 140040809035648 [Warning] Could not increase number of max_open_files to more than 1024 (request: 4162)
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'SEQUENCE' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'partition' is disabled.
 
InnoDB: using atomic writes.
 
InnoDB: using O_DIRECT due to atomic writes.
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: PUNCH HOLE support available
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!!
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: Uses event mutexes
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: Compressed tables use zlib 1.2.8
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: Number of pools: 1
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: Using SSE2 crc32 instructions
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: Initializing buffer pool, total size = 8M, instances = 1, chunk size = 8M
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: Completed initialization of buffer pool
 
2017-01-24  3:12:06 140040344696576 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
 
open() failed!: No such file or directory
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: Highest supported file format is Barracuda.
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: Creating shared tablespace for temporary tables
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: Waiting for purge to start
 
2017-01-24  3:12:06 140040809035648 [Note] InnoDB: 5.7.14 started; log sequence number 1238758
 
2017-01-24  3:12:06 140040210478848 [Note] InnoDB: Loading buffer pool(s) from /u01/MariaDB/mysql-test/var-ps_row/12/mysqld.1/data/ib_buffer_pool
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_CMP' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_FT_DELETED' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_CMP_RESET' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_LOCK_WAITS' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'FEEDBACK' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_MUTEXES' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_FT_CONFIG' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Note] Plugin 'INNODB_TABLESPACES_SCRUBBING' is disabled.
 
2017-01-24  3:12:06 140040809035648 [Warning] /u01/MariaDB/sql/mysqld: unknown option '--loose-pam-debug'
 
2017-01-24  3:12:06 140040809035648 [Note] Server socket created on IP: '127.0.0.1'.
 
2017-01-24  3:12:06 140040210478848 [Note] InnoDB: Buffer pool(s) load completed at 170124  3:12:06
 
2017-01-24  3:12:06 140040809035648 [Note] /u01/MariaDB/sql/mysqld: ready for connections.
 
Version: '10.2.4-MariaDB-debug-log'  socket: '/u01/MariaDB/mysql-test/var-ps_row/tmp/12/mysqld.1.sock'  port: 16460  Source distribution
 
2017-01-24  3:12:06 140040808420096 [Note] InnoDB: Creating 1 encryption thread id 140040101426944 total threads 1.
 
2017-01-24  3:12:09 140040808420096 [Note] InnoDB: Creating 1 encryption thread id 140040101426944 total threads 4.
 
2017-01-24  3:12:09 140040808420096 [Note] InnoDB: Creating 2 encryption thread id 140040093034240 total threads 4.
 
2017-01-24  3:12:09 140040808420096 [Note] InnoDB: Creating 3 encryption thread id 140040084641536 total threads 4.
 
2017-01-24  3:12:09 140040808420096 [Note] InnoDB: Creating 4 encryption thread id 140040076248832 total threads 4.
 
InnoDB: Error: trying to do an operation on a dropped tablespace 882
 
2017-01-24 03:12:16 0x7f5d9fffe700  InnoDB: Assertion failure in file /home/plx/Code/MariaDB/storage/innobase/include/sync0policy.ic line 82
 
InnoDB: Failing assertion: m_context.m_thread_id == os_thread_id_t(((ulint)(-1)))
 
InnoDB: We intentionally generate a memory trap.
 
InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
 
InnoDB: If you get repeated assertion failures or crashes, even
 
InnoDB: immediately after the mysqld startup, there may be
 
InnoDB: corruption in the InnoDB tablespace. Please refer to
 
InnoDB: http://dev.mysql.com/doc/refman/5.7/en/forcing-innodb-recovery.html
 
InnoDB: about forcing recovery.
 
170124  3:12:16 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.2.4-MariaDB-debug-log
 
key_buffer_size=1048576
 
read_buffer_size=131072
 
max_used_connections=3
 
max_threads=153
 
thread_count=9
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 63109 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x0x0
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x0 thread_stack 0x48c00
 
/u01/MariaDB/sql/mysqld(my_print_stacktrace+0x38)[0x55b599745b01]
 
/u01/MariaDB/sql/mysqld(handle_fatal_signal+0x3a3)[0x55b598f6cef8]
 
/lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7f5dc9e40390]
 
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0x38)[0x7f5dc91fa428]
 
/lib/x86_64-linux-gnu/libc.so.6(abort+0x16a)[0x7f5dc91fc02a]
 
/u01/MariaDB/sql/mysqld(+0xc60d91)[0x55b5993b5d91]
 
mysys/stacktrace.c:267(my_print_stacktrace)[0x55b5991a7b36]
 
sql/signal_handler.cc:168(handle_fatal_signal)[0x55b5991a68d0]
 
/u01/MariaDB/sql/mysqld(+0xa4fe1c)[0x55b5991a4e1c]
 
/u01/MariaDB/sql/mysqld(+0xd79422)[0x55b5994ce422]
 
/u01/MariaDB/sql/mysqld(+0xd795b3)[0x55b5994ce5b3]
 
/u01/MariaDB/sql/mysqld(+0xd79e29)[0x55b5994cee29]
 
/u01/MariaDB/sql/mysqld(+0xd7b63d)[0x55b5994d063d]
 
/lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba)[0x7f5dc9e366ba]
 
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f5dc92cb82d]
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
Writing a core file
 
----------SERVER LOG END-------------
 
 
 
 
 
 - saving '/u01/MariaDB/mysql-test/var-ps_row/12/log/encryption.create_or_replace-cbc,innodb/' to '/u01/MariaDB/mysql-test/var-ps_row/log/encryption.create_or_replace-cbc,innodb/'
 
 - found 'core' (0/5)
 
 
 
Trying 'dbx' to get a backtrace
 
 
 
Trying 'gdb' to get a backtrace
 
Core generated by '/u01/MariaDB/sql/mysqld'
 
Output from gdb follows. The first stack trace is from the failing thread.
 
The following stack traces are from all threads (so the failing one is
 
duplicated).
 
--------------------------
 
[New LWP 21331]
 
[New LWP 19993]
 
[New LWP 19992]
 
[New LWP 20028]
 
[New LWP 19999]
 
[New LWP 21330]
 
[New LWP 20031]
 
[New LWP 19925]
 
[New LWP 20049]
 
[New LWP 19997]
 
[New LWP 20057]
 
[New LWP 20071]
 
[New LWP 19998]
 
[New LWP 20058]
 
[New LWP 20000]
 
[New LWP 20001]
 
[New LWP 20002]
 
[New LWP 20003]
 
[New LWP 20027]
 
[New LWP 20029]
 
[New LWP 20030]
 
[New LWP 20050]
 
[New LWP 20051]
 
[New LWP 20052]
 
[New LWP 20053]
 
[New LWP 20055]
 
[New LWP 21333]
 
[New LWP 21344]
 
[New LWP 21332]
 
[New LWP 20032]
 
[New LWP 20034]
 
[New LWP 20033]
 
[New LWP 21347]
 
[Thread debugging using libthread_db enabled]
 
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
 
 
 
warning: the debug information found in "/lib64/ld-2.23.so" does not match "/lib64/ld-linux-x86-64.so.2" (CRC mismatch).
 
 
 
Core was generated by `/u01/MariaDB/sql/mysqld --defaults-group-suffix=.1 --defaults-file=/u01/MariaDB'.
 
Program terminated with signal SIGABRT, Aborted.
 
#0  __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:62
 
62	../sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.
 
[Current thread is 1 (Thread 0x7f5d9fffe700 (LWP 21331))]
 
#0  __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:62
 
#1  0x000055b599745bf3 in my_write_core (sig=6) at /home/plx/Code/MariaDB/mysys/stacktrace.c:477
 
#2  0x000055b598f6d28a in handle_fatal_signal (sig=6) at /home/plx/Code/MariaDB/sql/signal_handler.cc:296
 
#3  <signal handler called>
 
#4  0x00007f5dc91fa428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
 
#5  0x00007f5dc91fc02a in __GI_abort () at abort.c:89
 
#6  0x000055b5993b5d91 in ut_dbg_assertion_failed (expr=0x55b599980488 "m_context.m_thread_id == os_thread_id_t(((ulint)(-1)))", file=0x55b599980438 "/home/plx/Code/MariaDB/storage/innobase/include/sync0policy.ic", line=82) at /home/plx/Code/MariaDB/storage/innobase/ut/ut0dbg.cc:59
 
#7  0x000055b5991a7b36 in MutexDebug<TTASEventMutex<GenericPolicy> >::locked (this=0x7f5d9dc0f308, mutex=0x7f5d9dc0f2f8, name=0x55b599a1fd30 "/home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc", line=1171) at /home/plx/Code/MariaDB/storage/innobase/include/sync0policy.ic:82
 
#8  0x000055b5991a68d0 in GenericPolicy<TTASEventMutex<GenericPolicy> >::locked (this=0x7f5d9dc0f308, mutex=..., filename=0x55b599a1fd30 "/home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc", line=1171) at /home/plx/Code/MariaDB/storage/innobase/include/sync0policy.h:360
 
#9  0x000055b5991a4e1c in PolicyMutex<TTASEventMutex<GenericPolicy> >::enter (this=0x7f5d9dc0f2f8, n_spins=30, n_delay=6, name=0x55b599a1fd30 "/home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc", line=1171) at /home/plx/Code/MariaDB/storage/innobase/include/ib0mutex.h:636
 
#10 0x000055b5994ce422 in fil_crypt_start_encrypting_space (space=882, recheck=0x7f5d9fffddeb) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:1171
 
#11 0x000055b5994ce5b3 in fil_crypt_space_needs_rotation (state=0x7f5d9fffde10, key_state=0x7f5d9fffde00, recheck=0x7f5d9fffddeb) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:1262
 
#12 0x000055b5994cee29 in fil_crypt_find_space_to_rotate (key_state=0x7f5d9fffde00, state=0x7f5d9fffde10, recheck=0x7f5d9fffddeb) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:1563
 
#13 0x000055b5994d063d in fil_crypt_thread (arg=0x0) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:2252
 
#14 0x00007f5dc9e366ba in start_thread (arg=0x7f5d9fffe700) at pthread_create.c:333
 
#15 0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 33 (Thread 0x7f5dca9a9300 (LWP 21347)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
 
#1  0x000055b59974bccd in safe_cond_timedwait (cond=0x7f5da18161b0, mp=0x7f5da1816100, abstime=0x7f5dca9a6c50, file=0x55b59989d380 "/home/plx/Code/MariaDB/include/mysql/psi/mysql_thread.h", line=1175) at /home/plx/Code/MariaDB/mysys/thr_mutex.c:545
 
#2  0x000055b598e4aef5 in inline_mysql_cond_timedwait (that=0x7f5da18161b0, mutex=0x7f5da1816100, abstime=0x7f5dca9a6c50, src_file=0x55b59989d6b0 "/home/plx/Code/MariaDB/sql/mdl.cc", src_line=1092) at /home/plx/Code/MariaDB/include/mysql/psi/mysql_thread.h:1175
 
#3  0x000055b598e4c317 in MDL_wait::timed_wait (this=0x7f5da1816100, owner=0x7f5da18160b8, abs_timeout=0x7f5dca9a6c50, set_status_on_timeout=false, wait_state_name=0x55b59a1101b0 <MDL_key::m_namespace_to_wait_state_name+48>) at /home/plx/Code/MariaDB/sql/mdl.cc:1092
 
#4  0x000055b598e4de95 in MDL_context::acquire_lock (this=0x7f5da1816100, mdl_request=0x7f5da1869a70, lock_wait_timeout=31536000) at /home/plx/Code/MariaDB/sql/mdl.cc:2137
 
#5  0x000055b598e4e327 in MDL_context::acquire_locks (this=0x7f5da1816100, mdl_requests=0x7f5dca9a6d90, lock_wait_timeout=31536000) at /home/plx/Code/MariaDB/sql/mdl.cc:2257
 
#6  0x000055b598c8950d in lock_table_names (thd=0x7f5da1816008, options=..., tables_start=0x7f5da1869620, tables_end=0x0, lock_wait_timeout=31536000, flags=0) at /home/plx/Code/MariaDB/sql/sql_base.cc:3660
 
#7  0x000055b598c89a51 in open_tables (thd=0x7f5da1816008, options=..., start=0x7f5dca9a70c8, counter=0x7f5dca9a70e4, flags=0, prelocking_strategy=0x7f5dca9a7160) at /home/plx/Code/MariaDB/sql/sql_base.cc:3878
 
#8  0x000055b598c8b332 in open_and_lock_tables (thd=0x7f5da1816008, options=..., tables=0x7f5da1869620, derived=true, flags=0, prelocking_strategy=0x7f5dca9a7160) at /home/plx/Code/MariaDB/sql/sql_base.cc:4664
 
#9  0x000055b598d0c71d in open_and_lock_tables (thd=0x7f5da1816008, options=..., tables=0x7f5da1869620, derived=true, flags=0) at /home/plx/Code/MariaDB/sql/sql_base.h:484
 
#10 0x000055b598cf9555 in mysql_execute_command (thd=0x7f5da1816008) at /home/plx/Code/MariaDB/sql/sql_parse.cc:3837
 
#11 0x000055b598d06177 in mysql_parse (thd=0x7f5da1816008, rawbuf=0x7f5da1821200 "CREATE OR REPLACE TABLE `create_or_replace_t` AS SELECT * FROM `table10_int_autoinc`", length=84, parser_state=0x7f5dca9a7dc0, is_com_multi=false, is_next_command=false) at /home/plx/Code/MariaDB/sql/sql_parse.cc:7842
 
#12 0x000055b598cf3fcb in dispatch_command (command=COM_QUERY, thd=0x7f5da1816008, packet=0x7f5da185c009 "CREATE OR REPLACE TABLE `create_or_replace_t` AS SELECT * FROM `table10_int_autoinc`", packet_length=84, is_com_multi=false, is_next_command=false) at /home/plx/Code/MariaDB/sql/sql_parse.cc:1800
 
#13 0x000055b598cf29bc in do_command (thd=0x7f5da1816008) at /home/plx/Code/MariaDB/sql/sql_parse.cc:1360
 
#14 0x000055b598e404a7 in do_handle_one_connection (connect=0x7f5dc8865408) at /home/plx/Code/MariaDB/sql/sql_connect.cc:1354
 
#15 0x000055b598e40227 in handle_one_connection (arg=0x7f5dc8865408) at /home/plx/Code/MariaDB/sql/sql_connect.cc:1260
 
#16 0x000055b5996e169e in pfs_spawn_thread (arg=0x7f5dc8833a08) at /home/plx/Code/MariaDB/storage/perfschema/pfs.cc:1862
 
#17 0x00007f5dc9e366ba in start_thread (arg=0x7f5dca9a9300) at pthread_create.c:333
 
#18 0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 32 (Thread 0x7f5da93fa700 (LWP 20033)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x000055b59924c462 in os_event::wait (this=0x7f5dc43f1800) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:166
 
#2  0x000055b59924be86 in os_event::wait_low (this=0x7f5dc43f1800, reset_sig_count=3723) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:336
 
#3  0x000055b59924c210 in os_event_wait_low (event=0x7f5dc43f1800, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:535
 
#4  0x000055b59934a1f5 in srv_worker_thread (arg=0x0) at /home/plx/Code/MariaDB/storage/innobase/srv/srv0srv.cc:2708
 
#5  0x00007f5dc9e366ba in start_thread (arg=0x7f5da93fa700) at pthread_create.c:333
 
#6  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 31 (Thread 0x7f5da8bf9700 (LWP 20034)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x000055b59924c462 in os_event::wait (this=0x7f5dc43f1780) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:166
 
#2  0x000055b59924be86 in os_event::wait_low (this=0x7f5dc43f1780, reset_sig_count=4478) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:336
 
#3  0x000055b59924c210 in os_event_wait_low (event=0x7f5dc43f1780, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:535
 
#4  0x000055b59934a1f5 in srv_worker_thread (arg=0x0) at /home/plx/Code/MariaDB/storage/innobase/srv/srv0srv.cc:2708
 
#5  0x00007f5dc9e366ba in start_thread (arg=0x7f5da8bf9700) at pthread_create.c:333
 
#6  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 30 (Thread 0x7f5da9bfb700 (LWP 20032)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x000055b59924c462 in os_event::wait (this=0x7f5dc43f1880) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:166
 
#2  0x000055b59924be86 in os_event::wait_low (this=0x7f5dc43f1880, reset_sig_count=3035) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:336
 
#3  0x000055b59924c210 in os_event_wait_low (event=0x7f5dc43f1880, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:535
 
#4  0x000055b59934a1f5 in srv_worker_thread (arg=0x0) at /home/plx/Code/MariaDB/storage/innobase/srv/srv0srv.cc:2708
 
#5  0x00007f5dc9e366ba in start_thread (arg=0x7f5da9bfb700) at pthread_create.c:333
 
#6  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 29 (Thread 0x7f5d9f7fd700 (LWP 21332)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
 
#1  0x000055b59924bcf0 in os_event::timed_wait (this=0x7f5dc43f2900, abstime=0x7f5d9f7fc790) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:286
 
#2  0x000055b59924c00d in os_event::wait_time_low (this=0x7f5dc43f2900, time_in_usec=24000, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:413
 
#3  0x000055b59924c1eb in os_event_wait_time_low (event=0x7f5dc43f2900, time_in_usec=24000, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:518
 
#4  0x000055b5994cfd33 in fil_crypt_rotate_page (key_state=0x7f5d9f7fce00, state=0x7f5d9f7fce10) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:2007
 
#5  0x000055b5994cfdff in fil_crypt_rotate_pages (key_state=0x7f5d9f7fce00, state=0x7f5d9f7fce10) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:2038
 
#6  0x000055b5994d06d9 in fil_crypt_thread (arg=0x0) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:2269
 
#7  0x00007f5dc9e366ba in start_thread (arg=0x7f5d9f7fd700) at pthread_create.c:333
 
#8  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 28 (Thread 0x7f5dca9f3300 (LWP 21344)):
 
#0  0x00007f5dc92bfb5d in poll () at ../sysdeps/unix/syscall-template.S:84
 
#1  0x000055b5997fe7da in vio_io_wait (vio=0x7f5dc8833408, event=VIO_IO_EVENT_READ, timeout=28800000) at /home/plx/Code/MariaDB/vio/viosocket.c:945
 
#2  0x000055b5997fcfe2 in vio_socket_io_wait (vio=0x7f5dc8833408, event=VIO_IO_EVENT_READ) at /home/plx/Code/MariaDB/vio/viosocket.c:108
 
#3  0x000055b5997fd199 in vio_read (vio=0x7f5dc8833408, buf=0x7f5da145c008 "\a", size=4) at /home/plx/Code/MariaDB/vio/viosocket.c:184
 
#4  0x000055b598c27977 in my_real_read (net=0x7f5da14162c8, complen=0x7f5dca9f2500, header=1 '\001') at /home/plx/Code/MariaDB/sql/net_serv.cc:888
 
#5  0x000055b598c28176 in my_net_read_packet_reallen (net=0x7f5da14162c8, read_from_server=1 '\001', reallen=0x7f5dca9f2568) at /home/plx/Code/MariaDB/sql/net_serv.cc:1158
 
#6  0x000055b598c2812a in my_net_read_packet (net=0x7f5da14162c8, read_from_server=1 '\001') at /home/plx/Code/MariaDB/sql/net_serv.cc:1142
 
#7  0x000055b598cf2495 in do_command (thd=0x7f5da1416008) at /home/plx/Code/MariaDB/sql/sql_parse.cc:1242
 
#8  0x000055b598e404a7 in do_handle_one_connection (connect=0x7f5dc88653a8) at /home/plx/Code/MariaDB/sql/sql_connect.cc:1354
 
#9  0x000055b598e40227 in handle_one_connection (arg=0x7f5dc88653a8) at /home/plx/Code/MariaDB/sql/sql_connect.cc:1260
 
#10 0x000055b5996e169e in pfs_spawn_thread (arg=0x7f5dc8833608) at /home/plx/Code/MariaDB/storage/perfschema/pfs.cc:1862
 
#11 0x00007f5dc9e366ba in start_thread (arg=0x7f5dca9f3300) at pthread_create.c:333
 
#12 0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 27 (Thread 0x7f5d9effc700 (LWP 21333)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
 
#1  0x000055b59924bcf0 in os_event::timed_wait (this=0x7f5dc43f2900, abstime=0x7f5d9effb790) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:286
 
#2  0x000055b59924c00d in os_event::wait_time_low (this=0x7f5dc43f2900, time_in_usec=49000, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:413
 
#3  0x000055b59924c1eb in os_event_wait_time_low (event=0x7f5dc43f2900, time_in_usec=49000, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:518
 
#4  0x000055b5994cfd33 in fil_crypt_rotate_page (key_state=0x7f5d9effbe00, state=0x7f5d9effbe10) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:2007
 
#5  0x000055b5994cfdff in fil_crypt_rotate_pages (key_state=0x7f5d9effbe00, state=0x7f5d9effbe10) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:2038
 
#6  0x000055b5994d06d9 in fil_crypt_thread (arg=0x0) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:2269
 
#7  0x00007f5dc9e366ba in start_thread (arg=0x7f5d9effc700) at pthread_create.c:333
 
#8  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 26 (Thread 0x7f5da2bff700 (LWP 20055)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
 
#1  0x000055b59974bccd in safe_cond_timedwait (cond=0x55b59ab69960 <COND_checkpoint>, mp=0x55b59ab698a0 <LOCK_checkpoint>, abstime=0x7f5da2bfedc0, file=0x55b599a4f9a0 "/home/plx/Code/MariaDB/include/mysql/psi/mysql_thread.h", line=1175) at /home/plx/Code/MariaDB/mysys/thr_mutex.c:545
 
#2  0x000055b5995a9405 in inline_mysql_cond_timedwait (that=0x55b59ab69960 <COND_checkpoint>, mutex=0x55b59ab698a0 <LOCK_checkpoint>, abstime=0x7f5da2bfedc0, src_file=0x55b599a4f9d8 "/home/plx/Code/MariaDB/storage/maria/ma_servicethread.c", src_line=116) at /home/plx/Code/MariaDB/include/mysql/psi/mysql_thread.h:1175
 
#3  0x000055b5995a9907 in my_service_thread_sleep (control=0x55b59a129740 <checkpoint_control>, sleep_time=29000000000) at /home/plx/Code/MariaDB/storage/maria/ma_servicethread.c:115
 
#4  0x000055b59959da4f in ma_checkpoint_background (arg=0x1e) at /home/plx/Code/MariaDB/storage/maria/ma_checkpoint.c:708
 
#5  0x000055b5996e169e in pfs_spawn_thread (arg=0x7f5dc8832408) at /home/plx/Code/MariaDB/storage/perfschema/pfs.cc:1862
 
#6  0x00007f5dc9e366ba in start_thread (arg=0x7f5da2bff700) at pthread_create.c:333
 
#7  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 25 (Thread 0x7f5da4ffb700 (LWP 20053)):
 
#0  0x00007f5dc9e3fc1d in nanosleep () at ../sysdeps/unix/syscall-template.S:84
 
#1  0x000055b59924c99a in os_thread_sleep (tm=1000000) at /home/plx/Code/MariaDB/storage/innobase/os/os0thread.cc:225
 
#2  0x000055b5994170b9 in btr_defragment_thread (arg=0x0) at /home/plx/Code/MariaDB/storage/innobase/btr/btr0defragment.cc:757
 
#3  0x00007f5dc9e366ba in start_thread (arg=0x7f5da4ffb700) at pthread_create.c:333
 
#4  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 24 (Thread 0x7f5da57fc700 (LWP 20052)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x000055b59924c462 in os_event::wait (this=0x7f5dc43f1b00) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:166
 
#2  0x000055b59924be86 in os_event::wait_low (this=0x7f5dc43f1b00, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:336
 
#3  0x000055b59924c210 in os_event_wait_low (event=0x7f5dc43f1b00, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:535
 
#4  0x000055b599424ce7 in buf_resize_thread () at /home/plx/Code/MariaDB/storage/innobase/buf/buf0buf.cc:3158
 
#5  0x00007f5dc9e366ba in start_thread (arg=0x7f5da57fc700) at pthread_create.c:333
 
#6  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 23 (Thread 0x7f5da5ffd700 (LWP 20051)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
 
#1  0x000055b59924bcf0 in os_event::timed_wait (this=0x7f5db73f9080, abstime=0x7f5da5ffcc30) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:286
 
#2  0x000055b59924c00d in os_event::wait_time_low (this=0x7f5db73f9080, time_in_usec=5000000, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:413
 
#3  0x000055b59924c1eb in os_event_wait_time_low (event=0x7f5db73f9080, time_in_usec=5000000, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:518
 
#4  0x000055b5993bb09d in ib_wqueue_timedwait (wq=0x7f5db6bfdf00, wait_in_usecs=5000000) at /home/plx/Code/MariaDB/storage/innobase/ut/ut0wqueue.cc:160
 
#5  0x000055b59951229a in fts_optimize_thread (arg=0x7f5db6bfdf00) at /home/plx/Code/MariaDB/storage/innobase/fts/fts0opt.cc:3046
 
#6  0x00007f5dc9e366ba in start_thread (arg=0x7f5da5ffd700) at pthread_create.c:333
 
#7  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 22 (Thread 0x7f5da67fe700 (LWP 20050)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
 
#1  0x000055b59924bcf0 in os_event::timed_wait (this=0x7f5db53f6900, abstime=0x7f5da67fde60) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:286
 
#2  0x000055b59924c00d in os_event::wait_time_low (this=0x7f5db53f6900, time_in_usec=10000000, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:413
 
#3  0x000055b59924c1eb in os_event_wait_time_low (event=0x7f5db53f6900, time_in_usec=10000000, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:518
 
#4  0x000055b5994a9129 in dict_stats_thread () at /home/plx/Code/MariaDB/storage/innobase/dict/dict0stats_bg.cc:421
 
#5  0x00007f5dc9e366ba in start_thread (arg=0x7f5da67fe700) at pthread_create.c:333
 
#6  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 21 (Thread 0x7f5daabfd700 (LWP 20030)):
 
#0  0x00007f5dc9e3fc1d in nanosleep () at ../sysdeps/unix/syscall-template.S:84
 
#1  0x000055b59924c99a in os_thread_sleep (tm=1000000) at /home/plx/Code/MariaDB/storage/innobase/os/os0thread.cc:225
 
#2  0x000055b599349ba1 in srv_master_sleep () at /home/plx/Code/MariaDB/storage/innobase/srv/srv0srv.cc:2513
 
#3  0x000055b599349cf1 in srv_master_thread (arg=0x0) at /home/plx/Code/MariaDB/storage/innobase/srv/srv0srv.cc:2560
 
#4  0x00007f5dc9e366ba in start_thread (arg=0x7f5daabfd700) at pthread_create.c:333
 
#5  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 20 (Thread 0x7f5dab3fe700 (LWP 20029)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
 
#1  0x000055b59924bcf0 in os_event::timed_wait (this=0x7f5dc43f1980, abstime=0x7f5dab3fde10) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:286
 
#2  0x000055b59924c00d in os_event::wait_time_low (this=0x7f5dc43f1980, time_in_usec=5000000, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:413
 
#3  0x000055b59924c1eb in os_event_wait_time_low (event=0x7f5dc43f1980, time_in_usec=5000000, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:518
 
#4  0x000055b599348115 in srv_monitor_thread () at /home/plx/Code/MariaDB/storage/innobase/srv/srv0srv.cc:1747
 
#5  0x00007f5dc9e366ba in start_thread (arg=0x7f5dab3fe700) at pthread_create.c:333
 
#6  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 19 (Thread 0x7f5dacbff700 (LWP 20027)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
 
#1  0x000055b59924bcf0 in os_event::timed_wait (this=0x7f5db53f6080, abstime=0x7f5dacbfee40) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:286
 
#2  0x000055b59924c00d in os_event::wait_time_low (this=0x7f5db53f6080, time_in_usec=1000000, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:413
 
#3  0x000055b59924c1eb in os_event_wait_time_low (event=0x7f5db53f6080, time_in_usec=1000000, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:518
 
#4  0x000055b599214b85 in lock_wait_timeout_thread () at /home/plx/Code/MariaDB/storage/innobase/lock/lock0wait.cc:529
 
#5  0x00007f5dc9e366ba in start_thread (arg=0x7f5dacbff700) at pthread_create.c:333
 
#6  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 18 (Thread 0x7f5daefff700 (LWP 20003)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
 
#1  0x000055b59924bcf0 in os_event::timed_wait (this=0x7f5dc43f1a80, abstime=0x7f5daeffebe0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:286
 
#2  0x000055b59924c00d in os_event::wait_time_low (this=0x7f5dc43f1a80, time_in_usec=936000, reset_sig_count=2) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:413
 
#3  0x000055b59924c1eb in os_event_wait_time_low (event=0x7f5dc43f1a80, time_in_usec=936000, reset_sig_count=2) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:518
 
#4  0x000055b5994463fa in pc_sleep_if_needed (next_loop_time=1485198736254, sig_count=2) at /home/plx/Code/MariaDB/storage/innobase/buf/buf0flu.cc:2716
 
#5  0x000055b5994474f8 in buf_flush_page_cleaner_coordinator (arg=0x0) at /home/plx/Code/MariaDB/storage/innobase/buf/buf0flu.cc:3218
 
#6  0x00007f5dc9e366ba in start_thread (arg=0x7f5daefff700) at pthread_create.c:333
 
#7  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 17 (Thread 0x7f5daffff700 (LWP 20002)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x000055b59924c462 in os_event::wait (this=0x7f5dc43f2780) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:166
 
#2  0x000055b59924be86 in os_event::wait_low (this=0x7f5dc43f2780, reset_sig_count=79) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:336
 
#3  0x000055b59924c210 in os_event_wait_low (event=0x7f5dc43f2780, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:535
 
#4  0x000055b59924625d in os_aio_simulated_handler (global_segment=5, m1=0x7f5dafffee20, m2=0x7f5dafffee28, type=0x7f5dafffee30) at /home/plx/Code/MariaDB/storage/innobase/os/os0file.cc:8034
 
#5  0x000055b59924456c in os_aio_handler (segment=5, m1=0x7f5dafffee20, m2=0x7f5dafffee28, request=0x7f5dafffee30) at /home/plx/Code/MariaDB/storage/innobase/os/os0file.cc:6353
 
#6  0x000055b5994c2d0f in fil_aio_wait (segment=5) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0fil.cc:5679
 
#7  0x000055b59934e7eb in io_handler_thread (arg=0x55b59a359588 <n+40>) at /home/plx/Code/MariaDB/storage/innobase/srv/srv0start.cc:327
 
#8  0x00007f5dc9e366ba in start_thread (arg=0x7f5daffff700) at pthread_create.c:333
 
#9  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 16 (Thread 0x7f5db0ffb700 (LWP 20001)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x000055b59924c462 in os_event::wait (this=0x7f5dc43f2700) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:166
 
#2  0x000055b59924be86 in os_event::wait_low (this=0x7f5dc43f2700, reset_sig_count=90) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:336
 
#3  0x000055b59924c210 in os_event_wait_low (event=0x7f5dc43f2700, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:535
 
#4  0x000055b59924625d in os_aio_simulated_handler (global_segment=4, m1=0x7f5db0ffae20, m2=0x7f5db0ffae28, type=0x7f5db0ffae30) at /home/plx/Code/MariaDB/storage/innobase/os/os0file.cc:8034
 
#5  0x000055b59924456c in os_aio_handler (segment=4, m1=0x7f5db0ffae20, m2=0x7f5db0ffae28, request=0x7f5db0ffae30) at /home/plx/Code/MariaDB/storage/innobase/os/os0file.cc:6353
 
#6  0x000055b5994c2d0f in fil_aio_wait (segment=4) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0fil.cc:5679
 
#7  0x000055b59934e7eb in io_handler_thread (arg=0x55b59a359580 <n+32>) at /home/plx/Code/MariaDB/storage/innobase/srv/srv0start.cc:327
 
#8  0x00007f5dc9e366ba in start_thread (arg=0x7f5db0ffb700) at pthread_create.c:333
 
#9  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 15 (Thread 0x7f5db17fc700 (LWP 20000)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x000055b59924c462 in os_event::wait (this=0x7f5dc43f2680) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:166
 
#2  0x000055b59924be86 in os_event::wait_low (this=0x7f5dc43f2680, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:336
 
#3  0x000055b59924c210 in os_event_wait_low (event=0x7f5dc43f2680, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:535
 
#4  0x000055b59924625d in os_aio_simulated_handler (global_segment=3, m1=0x7f5db17fbe20, m2=0x7f5db17fbe28, type=0x7f5db17fbe30) at /home/plx/Code/MariaDB/storage/innobase/os/os0file.cc:8034
 
#5  0x000055b59924456c in os_aio_handler (segment=3, m1=0x7f5db17fbe20, m2=0x7f5db17fbe28, request=0x7f5db17fbe30) at /home/plx/Code/MariaDB/storage/innobase/os/os0file.cc:6353
 
#6  0x000055b5994c2d0f in fil_aio_wait (segment=3) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0fil.cc:5679
 
#7  0x000055b59934e7eb in io_handler_thread (arg=0x55b59a359578 <n+24>) at /home/plx/Code/MariaDB/storage/innobase/srv/srv0start.cc:327
 
#8  0x00007f5dc9e366ba in start_thread (arg=0x7f5db17fc700) at pthread_create.c:333
 
#9  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 14 (Thread 0x7f5dcaa87300 (LWP 20058)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x000055b59974b9c3 in safe_cond_wait (cond=0x55b59a2e7940 <COND_slave_background>, mp=0x55b59a2eabc0 <LOCK_slave_background>, file=0x55b599851780 "/home/plx/Code/MariaDB/include/mysql/psi/mysql_thread.h", line=1138) at /home/plx/Code/MariaDB/mysys/thr_mutex.c:491
 
#2  0x000055b598c40e8e in inline_mysql_cond_wait (that=0x55b59a2e7940 <COND_slave_background>, mutex=0x55b59a2eabc0 <LOCK_slave_background>, src_file=0x55b599852070 "/home/plx/Code/MariaDB/sql/slave.cc", src_line=339) at /home/plx/Code/MariaDB/include/mysql/psi/mysql_thread.h:1138
 
#3  0x000055b598c41ac8 in handle_slave_background (arg=0x0) at /home/plx/Code/MariaDB/sql/slave.cc:339
 
#4  0x000055b5996e169e in pfs_spawn_thread (arg=0x7f5dc8832c08) at /home/plx/Code/MariaDB/storage/perfschema/pfs.cc:1862
 
#5  0x00007f5dc9e366ba in start_thread (arg=0x7f5dcaa87300) at pthread_create.c:333
 
#6  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 13 (Thread 0x7f5db27fe700 (LWP 19998)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x000055b59924c462 in os_event::wait (this=0x7f5dc43f2580) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:166
 
#2  0x000055b59924be86 in os_event::wait_low (this=0x7f5dc43f2580, reset_sig_count=4) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:336
 
#3  0x000055b59924c210 in os_event_wait_low (event=0x7f5dc43f2580, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:535
 
#4  0x000055b59924625d in os_aio_simulated_handler (global_segment=1, m1=0x7f5db27fde20, m2=0x7f5db27fde28, type=0x7f5db27fde30) at /home/plx/Code/MariaDB/storage/innobase/os/os0file.cc:8034
 
#5  0x000055b59924456c in os_aio_handler (segment=1, m1=0x7f5db27fde20, m2=0x7f5db27fde28, request=0x7f5db27fde30) at /home/plx/Code/MariaDB/storage/innobase/os/os0file.cc:6353
 
#6  0x000055b5994c2d0f in fil_aio_wait (segment=1) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0fil.cc:5679
 
#7  0x000055b59934e7eb in io_handler_thread (arg=0x55b59a359568 <n+8>) at /home/plx/Code/MariaDB/storage/innobase/srv/srv0start.cc:327
 
#8  0x00007f5dc9e366ba in start_thread (arg=0x7f5db27fe700) at pthread_create.c:333
 
#9  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 12 (Thread 0x7f5dcaa3d300 (LWP 20071)):
 
#0  __lll_lock_wait () at ../sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135
 
#1  0x00007f5dc9e3ac51 in __pthread_mutex_cond_lock (mutex=0x7f5dc43ee118) at ../nptl/pthread_mutex_lock.c:80
 
#2  0x00007f5dc9e3c3f0 in pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:259
 
#3  0x000055b59924c462 in os_event::wait (this=0x7f5dc43ee100) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:166
 
#4  0x000055b59924be86 in os_event::wait_low (this=0x7f5dc43ee100, reset_sig_count=60257) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:336
 
#5  0x000055b59924c210 in os_event_wait_low (event=0x7f5dc43ee100, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:535
 
#6  0x000055b599365176 in rw_lock_debug_mutex_enter () at /home/plx/Code/MariaDB/storage/innobase/sync/sync0debug.cc:1312
 
#7  0x000055b59935c353 in rw_lock_own (lock=0x7f5dc88bdce0, lock_type=5) at /home/plx/Code/MariaDB/storage/innobase/sync/sync0rw.cc:1042
 
#8  0x000055b59941b992 in buf_page_hash_get_low (buf_pool=0x7f5dc4378b00, page_id=...) at /home/plx/Code/MariaDB/storage/innobase/include/buf0buf.ic:1095
 
#9  0x000055b599427fc6 in buf_page_get_gen (page_id=..., page_size=..., rw_latch=1, guess=0x0, mode=10, file=0x55b5999b0fe8 "/home/plx/Code/MariaDB/storage/innobase/row/row0ins.cc", line=2532, mtr=0x7f5dcaa39d60, err=0x7f5dcaa38750) at /home/plx/Code/MariaDB/storage/innobase/buf/buf0buf.cc:4266
 
#10 0x000055b5993ede72 in btr_cur_search_to_nth_level (index=0x7f5d9d049d08, level=0, tuple=0x7f5da1112b88, mode=PAGE_CUR_LE, latch_mode=2, cursor=0x7f5dcaa39940, has_search_latch=0, file=0x55b5999b0fe8 "/home/plx/Code/MariaDB/storage/innobase/row/row0ins.cc", line=2532, mtr=0x7f5dcaa39d60, autoinc=0) at /home/plx/Code/MariaDB/storage/innobase/btr/btr0cur.cc:1112
 
#11 0x000055b5992abf02 in btr_pcur_open_low (index=0x7f5d9d049d08, level=0, tuple=0x7f5da1112b88, mode=PAGE_CUR_LE, latch_mode=2, cursor=0x7f5dcaa39940, file=0x55b5999b0fe8 "/home/plx/Code/MariaDB/storage/innobase/row/row0ins.cc", line=2532, autoinc=0, mtr=0x7f5dcaa39d60) at /home/plx/Code/MariaDB/storage/innobase/include/btr0pcur.ic:457
 
#12 0x000055b5992b20f7 in row_ins_clust_index_entry_low (flags=0, mode=2, index=0x7f5d9d049d08, n_uniq=0, entry=0x7f5da1112b88, n_ext=0, thr=0x7f5d9d3598a8, dup_chk_only=false) at /home/plx/Code/MariaDB/storage/innobase/row/row0ins.cc:2532
 
#13 0x000055b5992b3ebb in row_ins_clust_index_entry (index=0x7f5d9d049d08, entry=0x7f5da1112b88, thr=0x7f5d9d3598a8, n_ext=0, dup_chk_only=false) at /home/plx/Code/MariaDB/storage/innobase/row/row0ins.cc:3169
 
#14 0x000055b5992b4289 in row_ins_index_entry (index=0x7f5d9d049d08, entry=0x7f5da1112b88, thr=0x7f5d9d3598a8) at /home/plx/Code/MariaDB/storage/innobase/row/row0ins.cc:3276
 
#15 0x000055b5992b47e1 in row_ins_index_entry_step (node=0x7f5d9d359618, thr=0x7f5d9d3598a8) at /home/plx/Code/MariaDB/storage/innobase/row/row0ins.cc:3426
 
#16 0x000055b5992b4ba9 in row_ins (node=0x7f5d9d359618, thr=0x7f5d9d3598a8) at /home/plx/Code/MariaDB/storage/innobase/row/row0ins.cc:3568
 
#17 0x000055b5992b51bc in row_ins_step (thr=0x7f5d9d3598a8) at /home/plx/Code/MariaDB/storage/innobase/row/row0ins.cc:3752
 
#18 0x000055b5992d4070 in row_insert_for_mysql (mysql_rec=0x7f5da1af3ca0 "\375\004", prebuilt=0x7f5d9d359088) at /home/plx/Code/MariaDB/storage/innobase/row/row0mysql.cc:1511
 
#19 0x000055b599184b5d in ha_innobase::write_row (this=0x7f5d9d385020, record=0x7f5da1af3ca0 "\375\004") at /home/plx/Code/MariaDB/storage/innobase/handler/ha_innodb.cc:9079
 
#20 0x000055b598f7c1df in handler::ha_write_row (this=0x7f5d9d385020, buf=0x7f5da1af3ca0 "\375\004") at /home/plx/Code/MariaDB/sql/handler.cc:5960
 
#21 0x000055b598cd5b42 in write_record (thd=0x7f5da1016008, table=0x7f5da10fe408, info=0x7f5da101f268) at /home/plx/Code/MariaDB/sql/sql_insert.cc:1886
 
#22 0x000055b598cdacc3 in select_insert::send_data (this=0x7f5da101f220, values=...) at /home/plx/Code/MariaDB/sql/sql_insert.cc:3744
 
#23 0x000055b598d69b86 in end_send (join=0x7f5da1318420, join_tab=0x7f5d9d3863d0, end_of_records=false) at /home/plx/Code/MariaDB/sql/sql_select.cc:19508
 
#24 0x000055b598d676ff in evaluate_join_record (join=0x7f5da1318420, join_tab=0x7f5d9d386020, error=0) at /home/plx/Code/MariaDB/sql/sql_select.cc:18565
 
#25 0x000055b598d67007 in sub_select (join=0x7f5da1318420, join_tab=0x7f5d9d386020, end_of_records=false) at /home/plx/Code/MariaDB/sql/sql_select.cc:18343
 
#26 0x000055b598d665ae in do_select (join=0x7f5da1318420, procedure=0x0) at /home/plx/Code/MariaDB/sql/sql_select.cc:17887
 
#27 0x000055b598d41895 in JOIN::exec_inner (this=0x7f5da1318420) at /home/plx/Code/MariaDB/sql/sql_select.cc:3388
 
#28 0x000055b598d40dc8 in JOIN::exec (this=0x7f5da1318420) at /home/plx/Code/MariaDB/sql/sql_select.cc:3199
 
#29 0x000055b598d41f3c in mysql_select (thd=0x7f5da1016008, tables=0x7f5da10e4b20, wild_num=1, fields=..., conds=0x0, og_num=0, order=0x0, group=0x0, having=0x0, proc_param=0x0, select_options=2416184064, result=0x7f5da101f220, unit=0x7f5da1019ae0, select_lex=0x7f5da101a230) at /home/plx/Code/MariaDB/sql/sql_select.cc:3584
 
#30 0x000055b598d36e00 in handle_select (thd=0x7f5da1016008, lex=0x7f5da1019a18, result=0x7f5da101f220, setup_tables_done_option=0) at /home/plx/Code/MariaDB/sql/sql_select.cc:373
 
#31 0x000055b598cf9773 in mysql_execute_command (thd=0x7f5da1016008) at /home/plx/Code/MariaDB/sql/sql_parse.cc:3889
 
#32 0x000055b598d06177 in mysql_parse (thd=0x7f5da1016008, rawbuf=0x7f5da12d9340 "CREATE OR REPLACE TABLE `create_or_replace_t` AS SELECT * FROM `table1_int_autoinc`", length=83, parser_state=0x7f5dcaa3bdc0, is_com_multi=false, is_next_command=false) at /home/plx/Code/MariaDB/sql/sql_parse.cc:7842
 
#33 0x000055b598cf3fcb in dispatch_command (command=COM_QUERY, thd=0x7f5da1016008, packet=0x7f5da105c009 "CREATE OR REPLACE TABLE `create_or_replace_t` AS SELECT * FROM `table1_int_autoinc`", packet_length=83, is_com_multi=false, is_next_command=false) at /home/plx/Code/MariaDB/sql/sql_parse.cc:1800
 
#34 0x000055b598cf29bc in do_command (thd=0x7f5da1016008) at /home/plx/Code/MariaDB/sql/sql_parse.cc:1360
 
#35 0x000055b598e404a7 in do_handle_one_connection (connect=0x7f5dc88652e8) at /home/plx/Code/MariaDB/sql/sql_connect.cc:1354
 
#36 0x000055b598e40227 in handle_one_connection (arg=0x7f5dc88652e8) at /home/plx/Code/MariaDB/sql/sql_connect.cc:1260
 
#37 0x000055b5996e169e in pfs_spawn_thread (arg=0x7f5dc8833008) at /home/plx/Code/MariaDB/storage/perfschema/pfs.cc:1862
 
#38 0x00007f5dc9e366ba in start_thread (arg=0x7f5dcaa3d300) at pthread_create.c:333
 
#39 0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 11 (Thread 0x7f5dcaad1300 (LWP 20057)):
 
#0  do_sigwait (sig=0x7f5dcaad09c0, set=<optimized out>) at ../sysdeps/unix/sysv/linux/sigwait.c:64
 
#1  __sigwait (set=<optimized out>, sig=0x7f5dcaad09c0) at ../sysdeps/unix/sysv/linux/sigwait.c:96
 
#2  0x000055b598c193a9 in signal_hand (arg=0x0) at /home/plx/Code/MariaDB/sql/mysqld.cc:3560
 
#3  0x000055b5996e169e in pfs_spawn_thread (arg=0x7f5dc8832608) at /home/plx/Code/MariaDB/storage/perfschema/pfs.cc:1862
 
#4  0x00007f5dc9e366ba in start_thread (arg=0x7f5dcaad1300) at pthread_create.c:333
 
#5  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 10 (Thread 0x7f5db2fff700 (LWP 19997)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x000055b59924c462 in os_event::wait (this=0x7f5dc43f2500) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:166
 
#2  0x000055b59924be86 in os_event::wait_low (this=0x7f5dc43f2500, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:336
 
#3  0x000055b59924c210 in os_event_wait_low (event=0x7f5dc43f2500, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:535
 
#4  0x000055b59924625d in os_aio_simulated_handler (global_segment=0, m1=0x7f5db2ffee20, m2=0x7f5db2ffee28, type=0x7f5db2ffee30) at /home/plx/Code/MariaDB/storage/innobase/os/os0file.cc:8034
 
#5  0x000055b59924456c in os_aio_handler (segment=0, m1=0x7f5db2ffee20, m2=0x7f5db2ffee28, request=0x7f5db2ffee30) at /home/plx/Code/MariaDB/storage/innobase/os/os0file.cc:6353
 
#6  0x000055b5994c2d0f in fil_aio_wait (segment=0) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0fil.cc:5679
 
#7  0x000055b59934e7eb in io_handler_thread (arg=0x55b59a359560 <n>) at /home/plx/Code/MariaDB/storage/innobase/srv/srv0start.cc:327
 
#8  0x00007f5dc9e366ba in start_thread (arg=0x7f5db2fff700) at pthread_create.c:333
 
#9  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 9 (Thread 0x7f5da6fff700 (LWP 20049)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x000055b59924c462 in os_event::wait (this=0x7f5dc43f1a00) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:166
 
#2  0x000055b59924be86 in os_event::wait_low (this=0x7f5dc43f1a00, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:336
 
#3  0x000055b59924c210 in os_event_wait_low (event=0x7f5dc43f1a00, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:535
 
#4  0x000055b59943c9cb in buf_dump_thread () at /home/plx/Code/MariaDB/storage/innobase/buf/buf0dump.cc:799
 
#5  0x00007f5dc9e366ba in start_thread (arg=0x7f5da6fff700) at pthread_create.c:333
 
#6  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 8 (Thread 0x7f5dcaad3780 (LWP 19925)):
 
#0  0x00007f5dc92bfb5d in poll () at ../sysdeps/unix/syscall-template.S:84
 
#1  0x000055b598c1ec67 in handle_connections_sockets () at /home/plx/Code/MariaDB/sql/mysqld.cc:6618
 
#2  0x000055b598c1df3f in mysqld_main (argc=147, argv=0x7f5dc8879458) at /home/plx/Code/MariaDB/sql/mysqld.cc:6084
 
#3  0x000055b598c128a0 in main (argc=27, argv=0x7fff11f2ad78) at /home/plx/Code/MariaDB/sql/main.cc:25
 
 
 
Thread 7 (Thread 0x7f5daa3fc700 (LWP 20031)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
 
#1  0x000055b59924bcf0 in os_event::timed_wait (this=0x7f5dc43f1700, abstime=0x7f5daa3fbdd0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:286
 
#2  0x000055b59924c00d in os_event::wait_time_low (this=0x7f5dc43f1700, time_in_usec=10000, reset_sig_count=1479) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:413
 
#3  0x000055b59924c1eb in os_event_wait_time_low (event=0x7f5dc43f1700, time_in_usec=10000, reset_sig_count=1479) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:518
 
#4  0x000055b59934a727 in srv_purge_coordinator_suspend (thd=0x7f5da7c16008, slot=0x7f5dc53eadf8, rseg_history_len=40) at /home/plx/Code/MariaDB/storage/innobase/srv/srv0srv.cc:2870
 
#5  0x000055b59934ac60 in srv_purge_coordinator_thread (arg=0x0) at /home/plx/Code/MariaDB/storage/innobase/srv/srv0srv.cc:2987
 
#6  0x00007f5dc9e366ba in start_thread (arg=0x7f5daa3fc700) at pthread_create.c:333
 
#7  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 6 (Thread 0x7f5da07ff700 (LWP 21330)):
 
#0  TaoCrypt::AES::PreFetchTe (this=0x7f5da07fdd60) at /home/plx/Code/MariaDB/extra/yassl/taocrypt/include/aes.hpp:108
 
#1  0x000055b599793a60 in TaoCrypt::AES::encrypt (this=0x7f5da07fdd60, inBlock=0x7f5da07fdd80 "\232q\311?\201\061)u\357\247\233^x\224\227\035\320(~8T\270\270\253w\345V\340\025\360!\357", xorBlock=0x0, outBlock=0x7f5da07fdd80 "\232q\311?\201\061)u\357\247\233^x\224\227\035\320(~8T\270\270\253w\345V\340\025\360!\357") at /home/plx/Code/MariaDB/extra/yassl/taocrypt/src/aes.cpp:247
 
#2  0x000055b59979396f in TaoCrypt::AES::ProcessAndXorBlock (this=0x7f5da07fdd60, in=0x7f5da07fdd80 "\232q\311?\201\061)u\357\247\233^x\224\227\035\320(~8T\270\270\253w\345V\340\025\360!\357", xOr=0x0, out=0x7f5da07fdd80 "\232q\311?\201\061)u\357\247\233^x\224\227\035\320(~8T\270\270\253w\345V\340\025\360!\357") at /home/plx/Code/MariaDB/extra/yassl/taocrypt/src/aes.cpp:221
 
#3  0x000055b59976991d in TaoCrypt::Mode_BASE::CBC_Encrypt (this=0x7f5da07fdd60, out=0x7f5dad0a3d66 "u\n$\v\310\353\244!\372\373\310\216\331\\\237m\022\374\262K\026\177\277\252\236\330\210\316>\202@\376\277Q\247\343\260W-\372\331\027\001Ji\246\001&\223\066\203\202#B)\204\237\371\374\\\235\370\034(\323A\233\301\204i\261\337\310]\274\211<\213`'\311`$|8\306\346\326\177\200n\275.m\270\017\332\204&o\270G9\332\325\334x\352[\027\266.", in=0x7f5db3e3fd66 "", sz=16336) at /home/plx/Code/MariaDB/extra/yassl/taocrypt/include/modes.hpp:125
 
#4  0x000055b5997697ef in TaoCrypt::Mode_BASE::Process (this=0x7f5da07fdd60, out=0x7f5dad0a0026 "\"\f\315\031|\016\237R\274l\205R\234h\371\347\320\006&v\260J\375z\314>\242\312\036\300N\b?$\026th\365?\363A\301\031!\330>\002q],\210X\004\067t\212l\322\032\326p.\317\377\216\037\327;^\016M\027\342\370)\340\264Q\313~\360\017K\224\006u\353\342\357\316w\030\332\307P\341\063J\325&\276E/\360(\274\223K\246\344\203\365\t\300XY\226\205\364\002f\241HV\216\260O\311\262\231a\264(\235:L\r\305\314\237\222i\vUpftS\246\t\247\327\354\032\016\262V\016\273\066\204\230YI\267\235}\277\275\375I\257\211Y~~\a\342\367ovY\251(\345\071\317\330\326\033\317\001j\231\332\327/R\300B"..., in=0x7f5db3e3c026 "", sz=16336) at /home/plx/Code/MariaDB/extra/yassl/taocrypt/include/modes.hpp:98
 
#5  0x000055b599768fe8 in do_whole_blocks (ctx=0x7f5da07fdd48, out=0x7f5dad0a0026 "\"\f\315\031|\016\237R\274l\205R\234h\371\347\320\006&v\260J\375z\314>\242\312\036\300N\b?$\026th\365?\363A\301\031!\330>\002q],\210X\004\067t\212l\322\032\326p.\317\377\216\037\327;^\016M\027\342\370)\340\264Q\313~\360\017K\224\006u\353\342\357\316w\030\332\307P\341\063J\325&\276E/\360(\274\223K\246\344\203\365\t\300XY\226\205\364\002f\241HV\216\260O\311\262\231a\264(\235:L\r\305\314\237\222i\vUpftS\246\t\247\327\354\032\016\262V\016\273\066\204\230YI\267\235}\277\275\375I\257\211Y~~\a\342\367ovY\251(\345\071\317\330\326\033\317\001j\231\332\327/R\300B"..., outl=0x7f5da07fdf80, in=0x7f5db3e3c026 "", inl=16336) at /home/plx/Code/MariaDB/mysys_ssl/yassl.cc:127
 
#6  0x000055b599769232 in EVP_CipherUpdate (ctx=0x7f5da07fdd48, out=0x7f5dad0a0026 "\"\f\315\031|\016\237R\274l\205R\234h\371\347\320\006&v\260J\375z\314>\242\312\036\300N\b?$\026th\365?\363A\301\031!\330>\002q],\210X\004\067t\212l\322\032\326p.\317\377\216\037\327;^\016M\027\342\370)\340\264Q\313~\360\017K\224\006u\353\342\357\316w\030\332\307P\341\063J\325&\276E/\360(\274\223K\246\344\203\365\t\300XY\226\205\364\002f\241HV\216\260O\311\262\231a\264(\235:L\r\305\314\237\222i\vUpftS\246\t\247\327\354\032\016\262V\016\273\066\204\230YI\267\235}\277\275\375I\257\211Y~~\a\342\367ovY\251(\345\071\317\330\326\033\317\001j\231\332\327/R\300B"..., outl=0x7f5da07fdf80, in=0x7f5db3e3c026 "", inl=16336) at /home/plx/Code/MariaDB/mysys_ssl/yassl.cc:168
 
#7  0x000055b599769cfb in MyCTX::update (this=0x7f5da07fdd40, src=0x7f5db3e3c026 "", slen=16338, dst=0x7f5dad0a0026 "\"\f\315\031|\016\237R\274l\205R\234h\371\347\320\006&v\260J\375z\314>\242\312\036\300N\b?$\026th\365?\363A\301\031!\330>\002q],\210X\004\067t\212l\322\032\326p.\317\377\216\037\327;^\016M\027\342\370)\340\264Q\313~\360\017K\224\006u\353\342\357\316w\030\332\307P\341\063J\325&\276E/\360(\274\223K\246\344\203\365\t\300XY\226\205\364\002f\241HV\216\260O\311\262\231a\264(\235:L\r\305\314\237\222i\vUpftS\246\t\247\327\354\032\016\262V\016\273\066\204\230YI\267\235}\277\275\375I\257\211Y~~\a\342\367ovY\251(\345\071\317\330\326\033\317\001j\231\332\327/R\300B"..., dlen=0x7f5da07fdf80) at /home/plx/Code/MariaDB/mysys_ssl/my_crypt.cc:59
 
#8  0x000055b5997694e7 in my_aes_crypt_update (ctx=0x7f5da07fdd40, src=0x7f5db3e3c026 "", slen=16338, dst=0x7f5dad0a0026 "\"\f\315\031|\016\237R\274l\205R\234h\371\347\320\006&v\260J\375z\314>\242\312\036\300N\b?$\026th\365?\363A\301\031!\330>\002q],\210X\004\067t\212l\322\032\326p.\317\377\216\037\327;^\016M\027\342\370)\340\264Q\313~\360\017K\224\006u\353\342\357\316w\030\332\307P\341\063J\325&\276E/\360(\274\223K\246\344\203\365\t\300XY\226\205\364\002f\241HV\216\260O\311\262\231a\264(\235:L\r\305\314\237\222i\vUpftS\246\t\247\327\354\032\016\262V\016\273\066\204\230YI\267\235}\277\275\375I\257\211Y~~\a\342\367ovY\251(\345\071\317\330\326\033\317\001j\231\332\327/R\300B"..., dlen=0x7f5da07fdf80) at /home/plx/Code/MariaDB/mysys_ssl/my_crypt.cc:244
 
#9  0x000055b598ee9b59 in encryption_crypt (src=0x7f5db3e3c026 "", slen=16338, dst=0x7f5dad0a0026 "\"\f\315\031|\016\237R\274l\205R\234h\371\347\320\006&v\260J\375z\314>\242\312\036\300N\b?$\026th\365?\363A\301\031!\330>\002q],\210X\004\067t\212l\322\032\326p.\317\377\216\037\327;^\016M\027\342\370)\340\264Q\313~\360\017K\224\006u\353\342\357\316w\030\332\307P\341\063J\325&\276E/\360(\274\223K\246\344\203\365\t\300XY\226\205\364\002f\241HV\216\260O\311\262\231a\264(\235:L\r\305\314\237\222i\vUpftS\246\t\247\327\354\032\016\262V\016\273\066\204\230YI\267\235}\277\275\375I\257\211Y~~\a\342\367ovY\251(\345\071\317\330\326\033\317\001j\231\332\327/R\300B"..., dlen=0x7f5da07fe130, key=0x7f5da07fe044 "\213)RZ/\371\300\327\361\vD\005-A\212n]\177", klen=16, iv=0x7f5da07fe030 "\250", ivlen=16, flags=3, key_id=1, key_version=1) at /home/plx/Code/MariaDB/include/mysql/service_encryption.h:119
 
#10 0x000055b598eea4b2 in do_crypt (src=0x7f5db3e3c026 "", slen=16338, dst=0x7f5dad0a0026 "\"\f\315\031|\016\237R\274l\205R\234h\371\347\320\006&v\260J\375z\314>\242\312\036\300N\b?$\026th\365?\363A\301\031!\330>\002q],\210X\004\067t\212l\322\032\326p.\317\377\216\037\327;^\016M\027\342\370)\340\264Q\313~\360\017K\224\006u\353\342\357\316w\030\332\307P\341\063J\325&\276E/\360(\274\223K\246\344\203\365\t\300XY\226\205\364\002f\241HV\216\260O\311\262\231a\264(\235:L\r\305\314\237\222i\vUpftS\246\t\247\327\354\032\016\262V\016\273\066\204\230YI\267\235}\277\275\375I\257\211Y~~\a\342\367ovY\251(\345\071\317\330\326\033\317\001j\231\332\327/R\300B"..., dlen=0x7f5da07fe130, scheme=0x7f5d9d40f280, key_version=1, i32_1=168, i32_2=3, i64=5880391, flag=3) at /home/plx/Code/MariaDB/sql/encryption.cc:208
 
#11 0x000055b598eea517 in encryption_scheme_encrypt (src=0x7f5db3e3c026 "", slen=16338, dst=0x7f5dad0a0026 "\"\f\315\031|\016\237R\274l\205R\234h\371\347\320\006&v\260J\375z\314>\242\312\036\300N\b?$\026th\365?\363A\301\031!\330>\002q],\210X\004\067t\212l\322\032\326p.\317\377\216\037\327;^\016M\027\342\370)\340\264Q\313~\360\017K\224\006u\353\342\357\316w\030\332\307P\341\063J\325&\276E/\360(\274\223K\246\344\203\365\t\300XY\226\205\364\002f\241HV\216\260O\311\262\231a\264(\235:L\r\305\314\237\222i\vUpftS\246\t\247\327\354\032\016\262V\016\273\066\204\230YI\267\235}\277\275\375I\257\211Y~~\a\342\367ovY\251(\345\071\317\330\326\033\317\001j\231\332\327/R\300B"..., dlen=0x7f5da07fe130, scheme=0x7f5d9d40f280, key_version=1, i32_1=168, i32_2=3, i64=5880391) at /home/plx/Code/MariaDB/sql/encryption.cc:218
 
#12 0x000055b5994ccd4b in fil_encrypt_buf (crypt_data=0x7f5d9d40f280, space=168, offset=3, lsn=5880391, src_frame=0x7f5db3e3c000 "Na\027\241", page_size=..., dst_frame=0x7f5dad0a0000 "Na\027\241") at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:576
 
#13 0x000055b5994cd0dd in fil_space_encrypt (space=168, offset=3, lsn=5880391, src_frame=0x7f5db3e3c000 "Na\027\241", page_size=..., dst_frame=0x7f5dad0a0000 "Na\027\241") at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:648
 
#14 0x000055b599431d93 in buf_page_encrypt_before_write (bpage=0x7f5db37e4d70, src_frame=0x7f5db3e3c000 "Na\027\241", space_id=168) at /home/plx/Code/MariaDB/storage/innobase/buf/buf0buf.cc:7487
 
#15 0x000055b59944135c in buf_flush_write_block_low (bpage=0x7f5db37e4d70, flush_type=BUF_FLUSH_LIST, sync=false) at /home/plx/Code/MariaDB/storage/innobase/buf/buf0flu.cc:1079
 
#16 0x000055b599441a14 in buf_flush_page (buf_pool=0x7f5dc4378b00, bpage=0x7f5db37e4d70, flush_type=BUF_FLUSH_LIST, sync=false) at /home/plx/Code/MariaDB/storage/innobase/buf/buf0flu.cc:1238
 
#17 0x000055b5994422d3 in buf_flush_try_neighbors (page_id=..., flush_type=BUF_FLUSH_LIST, n_flushed=15, n_to_flush=18446744073709551614) at /home/plx/Code/MariaDB/storage/innobase/buf/buf0flu.cc:1461
 
#18 0x000055b599442643 in buf_flush_page_and_try_neighbors (bpage=0x7f5db37e4d70, flush_type=BUF_FLUSH_LIST, n_to_flush=18446744073709551614, count=0x7f5da07fe678) at /home/plx/Code/MariaDB/storage/innobase/buf/buf0flu.cc:1534
 
#19 0x000055b5994431a8 in buf_do_flush_list_batch (buf_pool=0x7f5dc4378b00, min_n=18446744073709551614, lsn_limit=5883792) at /home/plx/Code/MariaDB/storage/innobase/buf/buf0flu.cc:1794
 
#20 0x000055b599443660 in buf_flush_batch (buf_pool=0x7f5dc4378b00, flush_type=BUF_FLUSH_LIST, min_n=18446744073709551614, lsn_limit=5883792, n=0x7f5da07fe7a0) at /home/plx/Code/MariaDB/storage/innobase/buf/buf0flu.cc:1872
 
#21 0x000055b599443c3f in buf_flush_do_batch (buf_pool=0x7f5dc4378b00, type=BUF_FLUSH_LIST, min_n=18446744073709551614, lsn_limit=5883792, n=0x7f5da07fe7a0) at /home/plx/Code/MariaDB/storage/innobase/buf/buf0flu.cc:2043
 
#22 0x000055b599443f40 in buf_flush_lists (min_n=18446744073709551614, lsn_limit=5883792, n_processed=0x7f5da07fe840) at /home/plx/Code/MariaDB/storage/innobase/buf/buf0flu.cc:2149
 
#23 0x000055b5994cfeee in fil_crypt_flush_space (state=0x7f5da07fee10, space=167) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:2063
 
#24 0x000055b5994d0427 in fil_crypt_complete_rotate_space (key_state=0x7f5da07fee00, state=0x7f5da07fee10) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:2183
 
#25 0x000055b5994d0703 in fil_crypt_thread (arg=0x0) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:2276
 
#26 0x00007f5dc9e366ba in start_thread (arg=0x7f5da07ff700) at pthread_create.c:333
 
#27 0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 5 (Thread 0x7f5db1ffd700 (LWP 19999)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x000055b59924c462 in os_event::wait (this=0x7f5dc43f2600) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:166
 
#2  0x000055b59924be86 in os_event::wait_low (this=0x7f5dc43f2600, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:336
 
#3  0x000055b59924c210 in os_event_wait_low (event=0x7f5dc43f2600, reset_sig_count=0) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:535
 
#4  0x000055b59924625d in os_aio_simulated_handler (global_segment=2, m1=0x7f5db1ffce20, m2=0x7f5db1ffce28, type=0x7f5db1ffce30) at /home/plx/Code/MariaDB/storage/innobase/os/os0file.cc:8034
 
#5  0x000055b59924456c in os_aio_handler (segment=2, m1=0x7f5db1ffce20, m2=0x7f5db1ffce28, request=0x7f5db1ffce30) at /home/plx/Code/MariaDB/storage/innobase/os/os0file.cc:6353
 
#6  0x000055b5994c2d0f in fil_aio_wait (segment=2) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0fil.cc:5679
 
#7  0x000055b59934e7eb in io_handler_thread (arg=0x55b59a359570 <n+16>) at /home/plx/Code/MariaDB/storage/innobase/srv/srv0start.cc:327
 
#8  0x00007f5dc9e366ba in start_thread (arg=0x7f5db1ffd700) at pthread_create.c:333
 
#9  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 4 (Thread 0x7f5dabbff700 (LWP 20028)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
 
#1  0x000055b59924bcf0 in os_event::timed_wait (this=0x7f5dc43f1900, abstime=0x7f5dabbfec80) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:286
 
#2  0x000055b59924c00d in os_event::wait_time_low (this=0x7f5dc43f1900, time_in_usec=1000000, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:413
 
#3  0x000055b59924c1eb in os_event_wait_time_low (event=0x7f5dc43f1900, time_in_usec=1000000, reset_sig_count=1) at /home/plx/Code/MariaDB/storage/innobase/os/os0event.cc:518
 
#4  0x000055b599348791 in srv_error_monitor_thread () at /home/plx/Code/MariaDB/storage/innobase/srv/srv0srv.cc:1974
 
#5  0x00007f5dc9e366ba in start_thread (arg=0x7f5dabbff700) at pthread_create.c:333
 
#6  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 3 (Thread 0x7f5dc3bff700 (LWP 19992)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
 
#1  0x000055b59974bccd in safe_cond_timedwait (cond=0x55b59ab7b020 <COND_timer>, mp=0x55b59ab7af60 <LOCK_timer>, abstime=0x7f5dc3bfee70, file=0x55b599a8c6b0 "/home/plx/Code/MariaDB/include/mysql/psi/mysql_thread.h", line=1175) at /home/plx/Code/MariaDB/mysys/thr_mutex.c:545
 
#2  0x000055b59974d082 in inline_mysql_cond_timedwait (that=0x55b59ab7b020 <COND_timer>, mutex=0x55b59ab7af60 <LOCK_timer>, abstime=0x7f5dc3bfee70, src_file=0x55b599a8c6e8 "/home/plx/Code/MariaDB/mysys/thr_timer.c", src_line=292) at /home/plx/Code/MariaDB/include/mysql/psi/mysql_thread.h:1175
 
#3  0x000055b59974db8f in timer_handler (arg=0x0) at /home/plx/Code/MariaDB/mysys/thr_timer.c:292
 
#4  0x000055b5996e169e in pfs_spawn_thread (arg=0x7f5dc8831408) at /home/plx/Code/MariaDB/storage/perfschema/pfs.cc:1862
 
#5  0x00007f5dc9e366ba in start_thread (arg=0x7f5dc3bff700) at pthread_create.c:333
 
#6  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 2 (Thread 0x7f5dc2bff700 (LWP 19993)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x000055b59974b9c3 in safe_cond_wait (cond=0x55b59a316b20 <thd_destructor_cond>, mp=0x7f5dc2bfedc0, file=0x55b599970800 "/home/plx/Code/MariaDB/include/mysql/psi/mysql_thread.h", line=1149) at /home/plx/Code/MariaDB/mysys/thr_mutex.c:491
 
#2  0x000055b59917086e in inline_mysql_cond_wait (that=0x55b59a316b20 <thd_destructor_cond>, mutex=0x7f5dc2bfedc0, src_file=0x55b599972598 "/home/plx/Code/MariaDB/storage/innobase/handler/ha_innodb.cc", src_line=338) at /home/plx/Code/MariaDB/include/mysql/psi/mysql_thread.h:1149
 
#3  0x000055b599175f8b in thd_destructor_proxy () at /home/plx/Code/MariaDB/storage/innobase/handler/ha_innodb.cc:338
 
#4  0x000055b5996e169e in pfs_spawn_thread (arg=0x7f5dc8831808) at /home/plx/Code/MariaDB/storage/perfschema/pfs.cc:1862
 
#5  0x00007f5dc9e366ba in start_thread (arg=0x7f5dc2bff700) at pthread_create.c:333
 
#6  0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Thread 1 (Thread 0x7f5d9fffe700 (LWP 21331)):
 
#0  __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:62
 
#1  0x000055b599745bf3 in my_write_core (sig=6) at /home/plx/Code/MariaDB/mysys/stacktrace.c:477
 
#2  0x000055b598f6d28a in handle_fatal_signal (sig=6) at /home/plx/Code/MariaDB/sql/signal_handler.cc:296
 
#3  <signal handler called>
 
#4  0x00007f5dc91fa428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
 
#5  0x00007f5dc91fc02a in __GI_abort () at abort.c:89
 
#6  0x000055b5993b5d91 in ut_dbg_assertion_failed (expr=0x55b599980488 "m_context.m_thread_id == os_thread_id_t(((ulint)(-1)))", file=0x55b599980438 "/home/plx/Code/MariaDB/storage/innobase/include/sync0policy.ic", line=82) at /home/plx/Code/MariaDB/storage/innobase/ut/ut0dbg.cc:59
 
#7  0x000055b5991a7b36 in MutexDebug<TTASEventMutex<GenericPolicy> >::locked (this=0x7f5d9dc0f308, mutex=0x7f5d9dc0f2f8, name=0x55b599a1fd30 "/home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc", line=1171) at /home/plx/Code/MariaDB/storage/innobase/include/sync0policy.ic:82
 
#8  0x000055b5991a68d0 in GenericPolicy<TTASEventMutex<GenericPolicy> >::locked (this=0x7f5d9dc0f308, mutex=..., filename=0x55b599a1fd30 "/home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc", line=1171) at /home/plx/Code/MariaDB/storage/innobase/include/sync0policy.h:360
 
#9  0x000055b5991a4e1c in PolicyMutex<TTASEventMutex<GenericPolicy> >::enter (this=0x7f5d9dc0f2f8, n_spins=30, n_delay=6, name=0x55b599a1fd30 "/home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc", line=1171) at /home/plx/Code/MariaDB/storage/innobase/include/ib0mutex.h:636
 
#10 0x000055b5994ce422 in fil_crypt_start_encrypting_space (space=882, recheck=0x7f5d9fffddeb) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:1171
 
#11 0x000055b5994ce5b3 in fil_crypt_space_needs_rotation (state=0x7f5d9fffde10, key_state=0x7f5d9fffde00, recheck=0x7f5d9fffddeb) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:1262
 
#12 0x000055b5994cee29 in fil_crypt_find_space_to_rotate (key_state=0x7f5d9fffde00, state=0x7f5d9fffde10, recheck=0x7f5d9fffddeb) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:1563
 
#13 0x000055b5994d063d in fil_crypt_thread (arg=0x0) at /home/plx/Code/MariaDB/storage/innobase/fil/fil0crypt.cc:2252
 
#14 0x00007f5dc9e366ba in start_thread (arg=0x7f5d9fffe700) at pthread_create.c:333
 
#15 0x00007f5dc92cb82d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109
 
 
 
Compressed file /u01/MariaDB/mysql-test/var-ps_row/log/encryption.create_or_replace-cbc,innodb/mysqld.1/data/core

Comment by Daniel Black [ 2017-04-04 ]

https://github.com/MariaDB/server/pull/350 changes (hopefully fixes) fil_crypt_rotate_page which may or may not be related to this.

Generated at Thu Feb 08 07:34:04 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.