[MDEV-14624] [Draft] InnoDB: Failing assertion: state == PURGE_STATE_RUN || state == PURGE_STATE_STOP Created: 2017-12-11  Updated: 2023-09-24  Resolved: 2023-09-24

Status: Closed
Project: MariaDB Server
Component/s: Storage Engine - InnoDB
Affects Version/s: 10.3
Fix Version/s: N/A

Type: Bug Priority: Major
Reporter: Elena Stepanova Assignee: Elena Stepanova
Resolution: Cannot Reproduce Votes: 0
Labels: None


 Description   

travis log

10.3 8f581e8bf1d400be08995b1cf8c11e3b0f7ae283

 
2017-12-11  5:16:28 18 [Warning] Sort aborted, host: localhost, user: root, thread: 18, query: /*0*/ /* QProp.QUERY_IS_REPLICATION_SAFE */ INSERT INTO test.t1_is_tables_25781 SELECT TABLE_SCHEMA,TABLE_NAME,TABLE_TYPE,TABLE_ROWS,TABLE_COLLATION,TABLE_COMMENT FROM information_schema.tables WHERE TABLE_SCHEMA LIKE 'test%' ORDER BY 1,2  /* QNO 8877 CON_ID 18 */
 
Version: '10.3.3-MariaDB-debug-log'  socket: '/home/travis/logs/vardir1_3/mysql.sock'  port: 19300  Source distribution
 
Version: '10.3.3-MariaDB-debug-log'  socket: '/home/travis/logs/vardir1_3/mysql.sock'  port: 19300  Source distribution
 
2017-12-11  5:17:39 14 [ERROR] Fatal error: Can't open and lock privilege tables: Table 'user' was not locked with LOCK TABLES
 
2017-12-11  5:17:39 14 [ERROR] Can't open and lock privilege tables: Table 'user' was not locked with LOCK TABLES
 
2017-12-11 05:17:40 0x7ffa781f5700  InnoDB: Assertion failure in file /home/travis/src/storage/innobase/trx/trx0purge.cc line 1734
 
InnoDB: Failing assertion: state == PURGE_STATE_RUN || state == PURGE_STATE_STOP
 
InnoDB: We intentionally generate a memory trap.
 
InnoDB: Submit a detailed bug report to https://jira.mariadb.org/
 
InnoDB: If you get repeated assertion failures or crashes, even
 
InnoDB: immediately after the mysqld startup, there may be
 
InnoDB: corruption in the InnoDB tablespace. Please refer to
 
InnoDB: http://dev.mysql.com/doc/refman/5.7/en/forcing-innodb-recovery.html
 
InnoDB: about forcing recovery.
 
171211  5:17:40 [ERROR] mysqld got signal 6 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
Server version: 10.3.3-MariaDB-debug-log
 
key_buffer_size=134217728
 
read_buffer_size=131072
 
max_used_connections=8
 
max_threads=153
 
thread_count=8
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 467412 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
Thread pointer: 0x7ffa2c00d750
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x7ffa781f4e80 thread_stack 0x49000
 
/home/travis/server/bin/mysqld(my_print_stacktrace+0x40)[0x92e62c184f]
 
/home/travis/server/bin/mysqld(handle_fatal_signal+0x3a3)[0x92e5ae92b8]
 
/lib/x86_64-linux-gnu/libpthread.so.0(+0x10330)[0x7ffa7a39b330]
 
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0x37)[0x7ffa797d8c37]
 
/lib/x86_64-linux-gnu/libc.so.6(abort+0x148)[0x7ffa797dc028]
 
/home/travis/server/bin/mysqld(+0xe48d8f)[0x92e600dd8f]
 
/home/travis/server/bin/mysqld(+0xe12301)[0x92e5fd7301]
 
/home/travis/server/bin/mysqld(+0xdd22dc)[0x92e5f972dc]
 
mysys/stacktrace.c:269(my_print_stacktrace)[0x92e5de4d79]
 
row/row0quiesce.cc:527(row_quiesce_table_start(dict_table_t*, trx_t*))[0x92e5af8dd3]
 
sql/handler.cc:5967(handler::ha_external_lock(THD*, int))[0x92e5c0d2cc]
 
sql/lock.cc:340(mysql_lock_tables(THD*, st_mysql_lock*, unsigned int))[0x92e5c0cfbe]
 
sql/lock.cc:303(mysql_lock_tables(THD*, TABLE**, unsigned int, unsigned int))[0x92e5c0ce7a]
 
sql/sql_base.cc:5006(lock_tables(THD*, TABLE_LIST*, unsigned int, unsigned int))[0x92e579f2b9]
 
sql/sql_base.cc:4751(open_and_lock_tables(THD*, DDL_options_st const&, TABLE_LIST*, bool, unsigned int, Prelocking_strategy*))[0x92e579e945]
 
sql/sql_base.h:251(open_and_lock_tables)[0x92e59aaab6]
 
sql/sql_reload.cc:562(flush_tables_with_read_lock(THD*, TABLE_LIST*))[0x92e59aba02]
 
sql/sql_parse.cc:5547(mysql_execute_command(THD*))[0x92e5821ff4]
 
sql/sql_parse.cc:7959(mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool))[0x92e5828fcb]
 
sql/sql_parse.cc:1830(dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool))[0x92e581693e]
 
sql/sql_parse.cc:1370(do_command(THD*))[0x92e581536b]
 
sql/sql_connect.cc:1420(do_handle_one_connection(CONNECT*))[0x92e596e84a]
 
sql/sql_connect.cc:1327(handle_one_connection)[0x92e596e5d7]
 
/lib/x86_64-linux-gnu/libpthread.so.0(+0x8184)[0x7ffa7a393184]
 
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7ffa7989fffd]
 
Trying to get some variables.
 
Some pointers may be invalid and cause the dump to abort.
 
Query (0x7ffa2c01dd58): FLUSH TABLE `t1_base_innodb_25837` FOR EXPORT /* QNO 3412 CON_ID 16 */
 
Connection ID (thread ID): 16
 
Status: KILL_SERVER
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_grouping_derived=on
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
 
information that should help you find out what is causing the crash.
 
Writing a core file

10.3

 
[Thread debugging using libthread_db enabled]
 
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
 
Core was generated by `/home/travis/server/bin/mysqld --no-defaults --basedir=/home/travis/server --lc'.
 
Program terminated with signal SIGABRT, Aborted.
 
#0  0x00007ffa7a398611 in __pthread_kill (threadid=<optimized out>, signo=6) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61
 
61	../nptl/sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.
 
 
 
Thread 24 (Thread 0x7ffa783b1700 (LWP 25890)):
 
#0  0x00007ffa7a39b0c1 in do_sigwait (sig=0x7ffa783b0e10, set=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:60
 
#1  __sigwait (set=0x7ffa783b0e40, sig=0x7ffa783b0e10) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:97
 
#2  0x00000092e5727e7b in signal_hand (arg=0x0) at /home/travis/src/sql/mysqld.cc:3524
 
#3  0x00007ffa7a393184 in start_thread (arg=0x7ffa783b1700) at pthread_create.c:312
 
#4  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 23 (Thread 0x7ffa3e7fc700 (LWP 25886)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x00000092e5ea3c35 in os_event::wait (this=0x92e9161820) at /home/travis/src/storage/innobase/os/os0event.cc:166
 
#2  0x00000092e5ea3647 in os_event::wait_low (this=0x92e9161820, reset_sig_count=1) at /home/travis/src/storage/innobase/os/os0event.cc:336
 
#3  0x00000092e5ea39ed in os_event_wait_low (event=0x92e9161820, reset_sig_count=0) at /home/travis/src/storage/innobase/os/os0event.cc:535
 
#4  0x00000092e60906c5 in buf_dump_thread () at /home/travis/src/storage/innobase/buf/buf0dump.cc:777
 
#5  0x00007ffa7a393184 in start_thread (arg=0x7ffa3e7fc700) at pthread_create.c:312
 
#6  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 22 (Thread 0x7ffa4e9b5700 (LWP 25878)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
 
#1  0x00000092e5ea34dc in os_event::timed_wait (this=0x92e91617a0, abstime=0x7ffa4e9b4e10) at /home/travis/src/storage/innobase/os/os0event.cc:286
 
#2  0x00000092e5ea37e7 in os_event::wait_time_low (this=0x92e91617a0, time_in_usec=5000000, reset_sig_count=1) at /home/travis/src/storage/innobase/os/os0event.cc:413
 
#3  0x00000092e5ea39c8 in os_event_wait_time_low (event=0x92e91617a0, time_in_usec=5000000, reset_sig_count=1) at /home/travis/src/storage/innobase/os/os0event.cc:518
 
#4  0x00000092e5fa4766 in srv_monitor_thread () at /home/travis/src/storage/innobase/srv/srv0srv.cc:1722
 
#5  0x00007ffa7a393184 in start_thread (arg=0x7ffa4e9b5700) at pthread_create.c:312
 
#6  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 21 (Thread 0x7ffa780cd700 (LWP 25914)):
 
#0  0x00007ffa798978d3 in select () at ../sysdeps/unix/syscall-template.S:81
 
#1  0x00000092e62bd6f4 in my_sleep (m_seconds=20000) at /home/travis/src/mysys/my_sleep.c:29
 
#2  0x00000092e5724393 in close_connections () at /home/travis/src/sql/mysqld.cc:1761
 
#3  0x00000092e5724c7a in kill_server (sig_ptr=0x0) at /home/travis/src/sql/mysqld.cc:2009
 
#4  0x00000092e5724cf5 in kill_server_thread (arg=0x7ffa783b0e10) at /home/travis/src/sql/mysqld.cc:2041
 
#5  0x00007ffa7a393184 in start_thread (arg=0x7ffa780cd700) at pthread_create.c:312
 
#6  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 20 (Thread 0x7ffa501b8700 (LWP 25874)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
 
#1  0x00000092e5ea34dc in os_event::timed_wait (this=0x92e91618a0, abstime=0x7ffa501b7bf0) at /home/travis/src/storage/innobase/os/os0event.cc:286
 
#2  0x00000092e5ea37e7 in os_event::wait_time_low (this=0x92e91618a0, time_in_usec=876000, reset_sig_count=2) at /home/travis/src/storage/innobase/os/os0event.cc:413
 
#3  0x00000092e5ea39c8 in os_event_wait_time_low (event=0x92e91618a0, time_in_usec=876000, reset_sig_count=2) at /home/travis/src/storage/innobase/os/os0event.cc:518
 
#4  0x00000092e609adfa in pc_sleep_if_needed (next_loop_time=1512969461454, sig_count=2, cur_time=1512969460578) at /home/travis/src/storage/innobase/buf/buf0flu.cc:2711
 
#5  0x00000092e609bfff in buf_flush_page_cleaner_coordinator () at /home/travis/src/storage/innobase/buf/buf0flu.cc:3209
 
#6  0x00007ffa7a393184 in start_thread (arg=0x7ffa501b8700) at pthread_create.c:312
 
#7  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 19 (Thread 0x7ffa511ba700 (LWP 25872)):
 
#0  0x00007ffa7b23a58a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00000092e5e96ac2 in LinuxAIOHandler::collect (this=0x7ffa511b9c00) at /home/travis/src/storage/innobase/os/os0file.cc:1893
 
#2  0x00000092e5e96feb in LinuxAIOHandler::poll (this=0x7ffa511b9c00, m1=0x7ffa511b9ca8, m2=0x7ffa511b9cb0, request=0x7ffa511b9ce0) at /home/travis/src/storage/innobase/os/os0file.cc:2038
 
#3  0x00000092e5e9714e in os_aio_linux_handler (global_segment=8, m1=0x7ffa511b9ca8, m2=0x7ffa511b9cb0, request=0x7ffa511b9ce0) at /home/travis/src/storage/innobase/os/os0file.cc:2092
 
#4  0x00000092e5e9bdd4 in os_aio_handler (segment=8, m1=0x7ffa511b9ca8, m2=0x7ffa511b9cb0, request=0x7ffa511b9ce0) at /home/travis/src/storage/innobase/os/os0file.cc:5720
 
#5  0x00000092e6117676 in fil_aio_wait (segment=8) at /home/travis/src/storage/innobase/fil/fil0fil.cc:5317
 
#6  0x00000092e5fa9a59 in io_handler_thread (arg=0x92e7792920 <n+64>) at /home/travis/src/storage/innobase/srv/srv0start.cc:340
 
#7  0x00007ffa7a393184 in start_thread (arg=0x7ffa511ba700) at pthread_create.c:312
 
#8  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 18 (Thread 0x7ffa4f1b6700 (LWP 25877)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
 
#1  0x00000092e5ea34dc in os_event::timed_wait (this=0x92e9161720, abstime=0x7ffa4f1b5ca0) at /home/travis/src/storage/innobase/os/os0event.cc:286
 
#2  0x00000092e5ea37e7 in os_event::wait_time_low (this=0x92e9161720, time_in_usec=1000000, reset_sig_count=1) at /home/travis/src/storage/innobase/os/os0event.cc:413
 
#3  0x00000092e5ea39c8 in os_event_wait_time_low (event=0x92e9161720, time_in_usec=1000000, reset_sig_count=1) at /home/travis/src/storage/innobase/os/os0event.cc:518
 
#4  0x00000092e5fa4e39 in srv_error_monitor_thread () at /home/travis/src/storage/innobase/srv/srv0srv.cc:1947
 
#5  0x00007ffa7a393184 in start_thread (arg=0x7ffa4f1b6700) at pthread_create.c:312
 
#6  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 17 (Thread 0x7ffa4f9b7700 (LWP 25876)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
 
#1  0x00000092e5ea34dc in os_event::timed_wait (this=0x92e9c97370, abstime=0x7ffa4f9b6e40) at /home/travis/src/storage/innobase/os/os0event.cc:286
 
#2  0x00000092e5ea37e7 in os_event::wait_time_low (this=0x92e9c97370, time_in_usec=1000000, reset_sig_count=1) at /home/travis/src/storage/innobase/os/os0event.cc:413
 
#3  0x00000092e5ea39c8 in os_event_wait_time_low (event=0x92e9c97370, time_in_usec=1000000, reset_sig_count=1) at /home/travis/src/storage/innobase/os/os0event.cc:518
 
#4  0x00000092e5e6eb94 in lock_wait_timeout_thread () at /home/travis/src/storage/innobase/lock/lock0wait.cc:529
 
#5  0x00007ffa7a393184 in start_thread (arg=0x7ffa4f9b7700) at pthread_create.c:312
 
#6  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 16 (Thread 0x7ffa3d7fa700 (LWP 25888)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x00000092e5ea3c35 in os_event::wait (this=0x92e9161920) at /home/travis/src/storage/innobase/os/os0event.cc:166
 
#2  0x00000092e5ea3647 in os_event::wait_low (this=0x92e9161920, reset_sig_count=1) at /home/travis/src/storage/innobase/os/os0event.cc:336
 
#3  0x00000092e5ea39ed in os_event_wait_low (event=0x92e9161920, reset_sig_count=0) at /home/travis/src/storage/innobase/os/os0event.cc:535
 
#4  0x00000092e60786da in buf_resize_thread () at /home/travis/src/storage/innobase/buf/buf0buf.cc:3076
 
#5  0x00007ffa7a393184 in start_thread (arg=0x7ffa3d7fa700) at pthread_create.c:312
 
#6  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 15 (Thread 0x7ffa3dffb700 (LWP 25887)):
 
#0  0x00007ffa7a39ab9d in nanosleep () at ../sysdeps/unix/syscall-template.S:81
 
#1  0x00000092e5ea3f33 in os_thread_sleep (tm=1000000) at /home/travis/src/storage/innobase/os/os0thread.cc:230
 
#2  0x00000092e606a5ca in btr_defragment_thread () at /home/travis/src/storage/innobase/btr/btr0defragment.cc:762
 
#3  0x00007ffa7a393184 in start_thread (arg=0x7ffa3dffb700) at pthread_create.c:312
 
#4  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 14 (Thread 0x7ffa519bb700 (LWP 25871)):
 
#0  0x00007ffa7b23a58a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00000092e5e96ac2 in LinuxAIOHandler::collect (this=0x7ffa519bac00) at /home/travis/src/storage/innobase/os/os0file.cc:1893
 
#2  0x00000092e5e96feb in LinuxAIOHandler::poll (this=0x7ffa519bac00, m1=0x7ffa519baca8, m2=0x7ffa519bacb0, request=0x7ffa519bace0) at /home/travis/src/storage/innobase/os/os0file.cc:2038
 
#3  0x00000092e5e9714e in os_aio_linux_handler (global_segment=7, m1=0x7ffa519baca8, m2=0x7ffa519bacb0, request=0x7ffa519bace0) at /home/travis/src/storage/innobase/os/os0file.cc:2092
 
#4  0x00000092e5e9bdd4 in os_aio_handler (segment=7, m1=0x7ffa519baca8, m2=0x7ffa519bacb0, request=0x7ffa519bace0) at /home/travis/src/storage/innobase/os/os0file.cc:5720
 
#5  0x00000092e6117676 in fil_aio_wait (segment=7) at /home/travis/src/storage/innobase/fil/fil0fil.cc:5317
 
#6  0x00000092e5fa9a59 in io_handler_thread (arg=0x92e7792918 <n+56>) at /home/travis/src/storage/innobase/srv/srv0start.cc:340
 
#7  0x00007ffa7a393184 in start_thread (arg=0x7ffa519bb700) at pthread_create.c:312
 
#8  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 13 (Thread 0x7ffa4d1b2700 (LWP 25881)):
 
#0  0x00007ffa7a39ab9d in nanosleep () at ../sysdeps/unix/syscall-template.S:81
 
#1  0x00000092e5ea3f33 in os_thread_sleep (tm=1000000) at /home/travis/src/storage/innobase/os/os0thread.cc:230
 
#2  0x00000092e5fa61a7 in srv_master_sleep () at /home/travis/src/storage/innobase/srv/srv0srv.cc:2436
 
#3  0x00000092e5fa62e9 in srv_master_thread (arg=0x0) at /home/travis/src/storage/innobase/srv/srv0srv.cc:2481
 
#4  0x00007ffa7a393184 in start_thread (arg=0x7ffa4d1b2700) at pthread_create.c:312
 
#5  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 12 (Thread 0x7ffa521bc700 (LWP 25870)):
 
#0  0x00007ffa7b23a58a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00000092e5e96ac2 in LinuxAIOHandler::collect (this=0x7ffa521bbc00) at /home/travis/src/storage/innobase/os/os0file.cc:1893
 
#2  0x00000092e5e96feb in LinuxAIOHandler::poll (this=0x7ffa521bbc00, m1=0x7ffa521bbca8, m2=0x7ffa521bbcb0, request=0x7ffa521bbce0) at /home/travis/src/storage/innobase/os/os0file.cc:2038
 
#3  0x00000092e5e9714e in os_aio_linux_handler (global_segment=6, m1=0x7ffa521bbca8, m2=0x7ffa521bbcb0, request=0x7ffa521bbce0) at /home/travis/src/storage/innobase/os/os0file.cc:2092
 
#4  0x00000092e5e9bdd4 in os_aio_handler (segment=6, m1=0x7ffa521bbca8, m2=0x7ffa521bbcb0, request=0x7ffa521bbce0) at /home/travis/src/storage/innobase/os/os0file.cc:5720
 
#5  0x00000092e6117676 in fil_aio_wait (segment=6) at /home/travis/src/storage/innobase/fil/fil0fil.cc:5317
 
#6  0x00000092e5fa9a59 in io_handler_thread (arg=0x92e7792910 <n+48>) at /home/travis/src/storage/innobase/srv/srv0start.cc:340
 
#7  0x00007ffa7a393184 in start_thread (arg=0x7ffa521bc700) at pthread_create.c:312
 
#8  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 11 (Thread 0x7ffa509b9700 (LWP 25873)):
 
#0  0x00007ffa7b23a58a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00000092e5e96ac2 in LinuxAIOHandler::collect (this=0x7ffa509b8c00) at /home/travis/src/storage/innobase/os/os0file.cc:1893
 
#2  0x00000092e5e96feb in LinuxAIOHandler::poll (this=0x7ffa509b8c00, m1=0x7ffa509b8ca8, m2=0x7ffa509b8cb0, request=0x7ffa509b8ce0) at /home/travis/src/storage/innobase/os/os0file.cc:2038
 
#3  0x00000092e5e9714e in os_aio_linux_handler (global_segment=9, m1=0x7ffa509b8ca8, m2=0x7ffa509b8cb0, request=0x7ffa509b8ce0) at /home/travis/src/storage/innobase/os/os0file.cc:2092
 
#4  0x00000092e5e9bdd4 in os_aio_handler (segment=9, m1=0x7ffa509b8ca8, m2=0x7ffa509b8cb0, request=0x7ffa509b8ce0) at /home/travis/src/storage/innobase/os/os0file.cc:5720
 
#5  0x00000092e6117676 in fil_aio_wait (segment=9) at /home/travis/src/storage/innobase/fil/fil0fil.cc:5317
 
#6  0x00000092e5fa9a59 in io_handler_thread (arg=0x92e7792928 <n+72>) at /home/travis/src/storage/innobase/srv/srv0start.cc:340
 
#7  0x00007ffa7a393184 in start_thread (arg=0x7ffa509b9700) at pthread_create.c:312
 
#8  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 10 (Thread 0x7ffa531be700 (LWP 25868)):
 
#0  0x00007ffa7b23a58a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00000092e5e96ac2 in LinuxAIOHandler::collect (this=0x7ffa531bdc00) at /home/travis/src/storage/innobase/os/os0file.cc:1893
 
#2  0x00000092e5e96feb in LinuxAIOHandler::poll (this=0x7ffa531bdc00, m1=0x7ffa531bdca8, m2=0x7ffa531bdcb0, request=0x7ffa531bdce0) at /home/travis/src/storage/innobase/os/os0file.cc:2038
 
#3  0x00000092e5e9714e in os_aio_linux_handler (global_segment=4, m1=0x7ffa531bdca8, m2=0x7ffa531bdcb0, request=0x7ffa531bdce0) at /home/travis/src/storage/innobase/os/os0file.cc:2092
 
#4  0x00000092e5e9bdd4 in os_aio_handler (segment=4, m1=0x7ffa531bdca8, m2=0x7ffa531bdcb0, request=0x7ffa531bdce0) at /home/travis/src/storage/innobase/os/os0file.cc:5720
 
#5  0x00000092e6117676 in fil_aio_wait (segment=4) at /home/travis/src/storage/innobase/fil/fil0fil.cc:5317
 
#6  0x00000092e5fa9a59 in io_handler_thread (arg=0x92e7792900 <n+32>) at /home/travis/src/storage/innobase/srv/srv0start.cc:340
 
#7  0x00007ffa7a393184 in start_thread (arg=0x7ffa531be700) at pthread_create.c:312
 
#8  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 9 (Thread 0x7ffa529bd700 (LWP 25869)):
 
#0  0x00007ffa7b23a58a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00000092e5e96ac2 in LinuxAIOHandler::collect (this=0x7ffa529bcc00) at /home/travis/src/storage/innobase/os/os0file.cc:1893
 
#2  0x00000092e5e96feb in LinuxAIOHandler::poll (this=0x7ffa529bcc00, m1=0x7ffa529bcca8, m2=0x7ffa529bccb0, request=0x7ffa529bcce0) at /home/travis/src/storage/innobase/os/os0file.cc:2038
 
#3  0x00000092e5e9714e in os_aio_linux_handler (global_segment=5, m1=0x7ffa529bcca8, m2=0x7ffa529bccb0, request=0x7ffa529bcce0) at /home/travis/src/storage/innobase/os/os0file.cc:2092
 
#4  0x00000092e5e9bdd4 in os_aio_handler (segment=5, m1=0x7ffa529bcca8, m2=0x7ffa529bccb0, request=0x7ffa529bcce0) at /home/travis/src/storage/innobase/os/os0file.cc:5720
 
#5  0x00000092e6117676 in fil_aio_wait (segment=5) at /home/travis/src/storage/innobase/fil/fil0fil.cc:5317
 
#6  0x00000092e5fa9a59 in io_handler_thread (arg=0x92e7792908 <n+40>) at /home/travis/src/storage/innobase/srv/srv0start.cc:340
 
#7  0x00007ffa7a393184 in start_thread (arg=0x7ffa529bd700) at pthread_create.c:312
 
#8  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 8 (Thread 0x7ffa539bf700 (LWP 25867)):
 
#0  0x00007ffa7b23a58a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00000092e5e96ac2 in LinuxAIOHandler::collect (this=0x7ffa539bec00) at /home/travis/src/storage/innobase/os/os0file.cc:1893
 
#2  0x00000092e5e96feb in LinuxAIOHandler::poll (this=0x7ffa539bec00, m1=0x7ffa539beca8, m2=0x7ffa539becb0, request=0x7ffa539bece0) at /home/travis/src/storage/innobase/os/os0file.cc:2038
 
#3  0x00000092e5e9714e in os_aio_linux_handler (global_segment=3, m1=0x7ffa539beca8, m2=0x7ffa539becb0, request=0x7ffa539bece0) at /home/travis/src/storage/innobase/os/os0file.cc:2092
 
#4  0x00000092e5e9bdd4 in os_aio_handler (segment=3, m1=0x7ffa539beca8, m2=0x7ffa539becb0, request=0x7ffa539bece0) at /home/travis/src/storage/innobase/os/os0file.cc:5720
 
#5  0x00000092e6117676 in fil_aio_wait (segment=3) at /home/travis/src/storage/innobase/fil/fil0fil.cc:5317
 
#6  0x00000092e5fa9a59 in io_handler_thread (arg=0x92e77928f8 <n+24>) at /home/travis/src/storage/innobase/srv/srv0start.cc:340
 
#7  0x00007ffa7a393184 in start_thread (arg=0x7ffa539bf700) at pthread_create.c:312
 
#8  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 7 (Thread 0x7ffa60d7f700 (LWP 25866)):
 
#0  0x00007ffa7b23a58a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00000092e5e96ac2 in LinuxAIOHandler::collect (this=0x7ffa60d7ec00) at /home/travis/src/storage/innobase/os/os0file.cc:1893
 
#2  0x00000092e5e96feb in LinuxAIOHandler::poll (this=0x7ffa60d7ec00, m1=0x7ffa60d7eca8, m2=0x7ffa60d7ecb0, request=0x7ffa60d7ece0) at /home/travis/src/storage/innobase/os/os0file.cc:2038
 
#3  0x00000092e5e9714e in os_aio_linux_handler (global_segment=2, m1=0x7ffa60d7eca8, m2=0x7ffa60d7ecb0, request=0x7ffa60d7ece0) at /home/travis/src/storage/innobase/os/os0file.cc:2092
 
#4  0x00000092e5e9bdd4 in os_aio_handler (segment=2, m1=0x7ffa60d7eca8, m2=0x7ffa60d7ecb0, request=0x7ffa60d7ece0) at /home/travis/src/storage/innobase/os/os0file.cc:5720
 
#5  0x00000092e6117676 in fil_aio_wait (segment=2) at /home/travis/src/storage/innobase/fil/fil0fil.cc:5317
 
#6  0x00000092e5fa9a59 in io_handler_thread (arg=0x92e77928f0 <n+16>) at /home/travis/src/storage/innobase/srv/srv0start.cc:340
 
#7  0x00007ffa7a393184 in start_thread (arg=0x7ffa60d7f700) at pthread_create.c:312
 
#8  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 6 (Thread 0x7ffa61580700 (LWP 25865)):
 
#0  0x00007ffa7b23a58a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00000092e5e96ac2 in LinuxAIOHandler::collect (this=0x7ffa6157fc00) at /home/travis/src/storage/innobase/os/os0file.cc:1893
 
#2  0x00000092e5e96feb in LinuxAIOHandler::poll (this=0x7ffa6157fc00, m1=0x7ffa6157fca8, m2=0x7ffa6157fcb0, request=0x7ffa6157fce0) at /home/travis/src/storage/innobase/os/os0file.cc:2038
 
#3  0x00000092e5e9714e in os_aio_linux_handler (global_segment=1, m1=0x7ffa6157fca8, m2=0x7ffa6157fcb0, request=0x7ffa6157fce0) at /home/travis/src/storage/innobase/os/os0file.cc:2092
 
#4  0x00000092e5e9bdd4 in os_aio_handler (segment=1, m1=0x7ffa6157fca8, m2=0x7ffa6157fcb0, request=0x7ffa6157fce0) at /home/travis/src/storage/innobase/os/os0file.cc:5720
 
#5  0x00000092e6117676 in fil_aio_wait (segment=1) at /home/travis/src/storage/innobase/fil/fil0fil.cc:5317
 
#6  0x00000092e5fa9a59 in io_handler_thread (arg=0x92e77928e8 <n+8>) at /home/travis/src/storage/innobase/srv/srv0start.cc:340
 
#7  0x00007ffa7a393184 in start_thread (arg=0x7ffa61580700) at pthread_create.c:312
 
#8  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 5 (Thread 0x7ffa61d81700 (LWP 25864)):
 
#0  0x00007ffa7b23a58a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
 
#1  0x00000092e5e96ac2 in LinuxAIOHandler::collect (this=0x7ffa61d80c00) at /home/travis/src/storage/innobase/os/os0file.cc:1893
 
#2  0x00000092e5e96feb in LinuxAIOHandler::poll (this=0x7ffa61d80c00, m1=0x7ffa61d80ca8, m2=0x7ffa61d80cb0, request=0x7ffa61d80ce0) at /home/travis/src/storage/innobase/os/os0file.cc:2038
 
#3  0x00000092e5e9714e in os_aio_linux_handler (global_segment=0, m1=0x7ffa61d80ca8, m2=0x7ffa61d80cb0, request=0x7ffa61d80ce0) at /home/travis/src/storage/innobase/os/os0file.cc:2092
 
#4  0x00000092e5e9bdd4 in os_aio_handler (segment=0, m1=0x7ffa61d80ca8, m2=0x7ffa61d80cb0, request=0x7ffa61d80ce0) at /home/travis/src/storage/innobase/os/os0file.cc:5720
 
#5  0x00000092e6117676 in fil_aio_wait (segment=0) at /home/travis/src/storage/innobase/fil/fil0fil.cc:5317
 
#6  0x00000092e5fa9a59 in io_handler_thread (arg=0x92e77928e0 <n>) at /home/travis/src/storage/innobase/srv/srv0start.cc:340
 
#7  0x00007ffa7a393184 in start_thread (arg=0x7ffa61d81700) at pthread_create.c:312
 
#8  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 4 (Thread 0x7ffa64583700 (LWP 25863)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
 
#1  0x00000092e62c71ea in safe_cond_timedwait (cond=0x92e7750000 <COND_checkpoint>, mp=0x92e774ff40 <LOCK_checkpoint>, abstime=0x7ffa64582e10, file=0x92e6521750 "/home/travis/src/include/mysql/psi/mysql_thread.h", line=1186) at /home/travis/src/mysys/thr_mutex.c:546
 
#2  0x00000092e5d4073b in inline_mysql_cond_timedwait (that=0x92e7750000 <COND_checkpoint>, mutex=0x92e774ff40 <LOCK_checkpoint>, abstime=0x7ffa64582e10, src_file=0x92e6521788 "/home/travis/src/storage/maria/ma_servicethread.c", src_line=116) at /home/travis/src/include/mysql/psi/mysql_thread.h:1186
 
#3  0x00000092e5d40bfe in my_service_thread_sleep (control=0x92e6d4f7c0 <checkpoint_control>, sleep_time=30000000000) at /home/travis/src/storage/maria/ma_servicethread.c:115
 
#4  0x00000092e5d354b1 in ma_checkpoint_background (arg=0x1e) at /home/travis/src/storage/maria/ma_checkpoint.c:709
 
#5  0x00007ffa7a393184 in start_thread (arg=0x7ffa64583700) at pthread_create.c:312
 
#6  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 3 (Thread 0x7ffa797a1700 (LWP 25862)):
 
#0  pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:238
 
#1  0x00000092e62c71ea in safe_cond_timedwait (cond=0x92e77b2160 <COND_timer>, mp=0x92e77b20a0 <LOCK_timer>, abstime=0x7ffa797a0ec0, file=0x92e66b9150 "/home/travis/src/include/mysql/psi/mysql_thread.h", line=1186) at /home/travis/src/mysys/thr_mutex.c:546
 
#2  0x00000092e62c81cf in inline_mysql_cond_timedwait (that=0x92e77b2160 <COND_timer>, mutex=0x92e77b20a0 <LOCK_timer>, abstime=0x7ffa797a0ec0, src_file=0x92e66b9188 "/home/travis/src/mysys/thr_timer.c", src_line=292) at /home/travis/src/include/mysql/psi/mysql_thread.h:1186
 
#3  0x00000092e62c8cd1 in timer_handler (arg=0x0) at /home/travis/src/mysys/thr_timer.c:292
 
#4  0x00007ffa7a393184 in start_thread (arg=0x7ffa797a1700) at pthread_create.c:312
 
#5  0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111
 
 
 
Thread 2 (Thread 0x7ffa7ba76780 (LWP 25861)):
 
#0  pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
 
#1  0x00000092e62c6ee8 in safe_cond_wait (cond=0x92e6f1f9e0 <COND_thread_count>, mp=0x92e6f1e6e0 <LOCK_thread_count>, file=0x92e6356940 "/home/travis/src/include/mysql/psi/mysql_thread.h", line=1149) at /home/travis/src/mysys/thr_mutex.c:492
 
#2  0x00000092e5721dae in inline_mysql_cond_wait (that=0x92e6f1f9e0 <COND_thread_count>, mutex=0x92e6f1e6e0 <LOCK_thread_count>, src_file=0x92e63586f0 "/home/travis/src/sql/mysqld.cc", src_line=6161) at /home/travis/src/include/mysql/psi/mysql_thread.h:1149
 
#3  0x00000092e572d200 in mysqld_main (argc=16, argv=0x92e8fecdc0) at /home/travis/src/sql/mysqld.cc:6161
 
#4  0x00000092e5721695 in main (argc=16, argv=0x7ffec781d668) at /home/travis/src/sql/main.cc:25


Thread 1 (Thread 0x7ffa781f5700 (LWP 25906)):
 
#0  0x00007ffa7a398611 in __pthread_kill (threadid=<optimized out>, signo=6) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:61
 
#1  0x00000092e62c193d in my_write_core (sig=6) at /home/travis/src/mysys/stacktrace.c:481
 
#2  0x00000092e5ae9661 in handle_fatal_signal (sig=6) at /home/travis/src/sql/signal_handler.cc:303
 
#3  <signal handler called>
 
#4  0x00007ffa797d8c37 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
 
#5  0x00007ffa797dc028 in __GI_abort () at abort.c:89
 
#6  0x00000092e600dd8f in ut_dbg_assertion_failed (expr=0x92e65dda28 "state == PURGE_STATE_RUN || state == PURGE_STATE_STOP", file=0x92e65dd130 "/home/travis/src/storage/innobase/trx/trx0purge.cc", line=1734) at /home/travis/src/storage/innobase/ut/ut0dbg.cc:61
 
#7  0x00000092e5fd7301 in trx_purge_stop () at /home/travis/src/storage/innobase/trx/trx0purge.cc:1734
 
#8  0x00000092e5f972dc in row_quiesce_table_start (table=0x7ffa280e1c48, trx=0x7ffa783b45c8) at /home/travis/src/storage/innobase/row/row0quiesce.cc:524
 
#9  0x00000092e5de4d79 in ha_innobase::external_lock (this=0x7ffa303a5f38, thd=0x7ffa2c00d750, lock_type=0) at /home/travis/src/storage/innobase/handler/ha_innodb.cc:16002
 
#10 0x00000092e5af8dd3 in handler::ha_external_lock (this=0x7ffa303a5f38, thd=0x7ffa2c00d750, lock_type=0) at /home/travis/src/sql/handler.cc:5967
 
#11 0x00000092e5c0d2cc in lock_external (thd=0x7ffa2c00d750, tables=0x7ffa2c04c138, count=1) at /home/travis/src/sql/lock.cc:395
 
#12 0x00000092e5c0cfbe in mysql_lock_tables (thd=0x7ffa2c00d750, sql_lock=0x7ffa2c04c120, flags=4096) at /home/travis/src/sql/lock.cc:341
 
#13 0x00000092e5c0ce7a in mysql_lock_tables (thd=0x7ffa2c00d750, tables=0x7ffa2c01e508, count=1, flags=4096) at /home/travis/src/sql/lock.cc:303
 
#14 0x00000092e579f2b9 in lock_tables (thd=0x7ffa2c00d750, tables=0x7ffa2c01def0, count=1, flags=4096) at /home/travis/src/sql/sql_base.cc:5007
 
#15 0x00000092e579e945 in open_and_lock_tables (thd=0x7ffa2c00d750, options=..., tables=0x7ffa2c01def0, derived=false, flags=4096, prelocking_strategy=0x7ffa781f3450) at /home/travis/src/sql/sql_base.cc:4751
 
#16 0x00000092e59aaab6 in open_and_lock_tables (thd=0x7ffa2c00d750, tables=0x7ffa2c01def0, derived=false, flags=4096, prelocking_strategy=0x7ffa781f3450) at /home/travis/src/sql/sql_base.h:250
 
#17 0x00000092e59aba02 in flush_tables_with_read_lock (thd=0x7ffa2c00d750, all_tables=0x7ffa2c01def0) at /home/travis/src/sql/sql_reload.cc:562
 
#18 0x00000092e5821ff4 in mysql_execute_command (thd=0x7ffa2c00d750) at /home/travis/src/sql/sql_parse.cc:5547
 
#19 0x00000092e5828fcb in mysql_parse (thd=0x7ffa2c00d750, rawbuf=0x7ffa2c01dd58 "FLUSH TABLE `t1_base_innodb_25837` FOR EXPORT /* QNO 3412 CON_ID 16 */", length=70, parser_state=0x7ffa781f4620, is_com_multi=false, is_next_command=false) at /home/travis/src/sql/sql_parse.cc:7959
 
#20 0x00000092e581693e in dispatch_command (command=COM_QUERY, thd=0x7ffa2c00d750, packet=0x7ffa2c0156d1 "FLUSH TABLE `t1_base_innodb_25837` FOR EXPORT /* QNO 3412 CON_ID 16 */ ", packet_length=71, is_com_multi=false, is_next_command=false) at /home/travis/src/sql/sql_parse.cc:1828
 
#21 0x00000092e581536b in do_command (thd=0x7ffa2c00d750) at /home/travis/src/sql/sql_parse.cc:1370
 
#22 0x00000092e596e84a in do_handle_one_connection (connect=0x92e9bb4790) at /home/travis/src/sql/sql_connect.cc:1420
 
#23 0x00000092e596e5d7 in handle_one_connection (arg=0x92e9bb4790) at /home/travis/src/sql/sql_connect.cc:1326
 
#24 0x00007ffa7a393184 in start_thread (arg=0x7ffa781f5700) at pthread_create.c:312
 
#25 0x00007ffa7989fffd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111


# 2017-12-11T05:15:20 [25617] perl /home/travis/rqg//run-scenario.pl --grammar=conf/replication/replication-ddl_sql.yy --gendata=conf/replication/replication-ddl_data.zz --duration=400 --rpl-mode=mixed --threads=6 --queries=100M --redefine=/home/travis/rqg/conf/mariadb/instant_add.yy --mysqld=--max-statement-time=30 --reporters=Backtrace,ErrorLog,Deadlock --scenario=Restart --engine=InnoDB --mysqld=--innodb_stats_persistent=0 --seed=1512969320 --basedir=/home/travis/server --vardir=/home/travis/logs/vardir1_3



 Comments   
Comment by Marko Mäkelä [ 2018-02-21 ]

Some day we should clean up the FLUSH TABLE … FOR EXPORT code. Maybe multiple such statements cannot be run in parallel? Or not issued right before shutdown?

Generated at Thu Feb 08 08:15:01 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.