[MDEV-16635] sql_sequence.concurrent_create failed in buildbot, server crashed in open_table Created: 2018-06-30  Updated: 2023-04-27

Status: Open
Project: MariaDB Server
Component/s: Sequences, Server, Tests
Affects Version/s: 10.3
Fix Version/s: 10.4

Type: Bug Priority: Major
Reporter: Elena Stepanova Assignee: Michael Widenius
Resolution: Unresolved Votes: 0
Labels: None

Attachments: HTML File threads     HTML File threads_full    

 Description   

http://buildbot.askmonty.org/buildbot/builders/kvm-fulltest/builds/13540

10.3 83ec8c88c60767593025d4dde3d50f53

sql_sequence.concurrent_create 'innodb'  w4 [ fail ]
        Test ended at 2018-05-25 08:41:39
 
CURRENT_TEST: sql_sequence.concurrent_create
mysqltest: At line 50: query 'FLUSH TABLES' failed: 2013: Lost connection to MySQL server during query
 
The result from queries just before the failure was:
< snip >
connection con1;
disconnect con1;
connection default;
DROP SEQUENCE s1, s2, s3, s4;
CREATE SEQUENCE s1 ENGINE=InnoDB;
PREPARE stmt FROM "CREATE TABLE s2 LIKE s1";
execute stmt;
drop table s2;
execute stmt;
drop table s2;
execute stmt;
select * from s2;
next_not_cached_value	minimum_value	maximum_value	start_value	increment	cache_size	cycle_option	cycle_count
1	1	9223372036854775806	1	1	1000	0	0
DROP SEQUENCE s1, s2;
CREATE SEQUENCE s1 ENGINE=InnoDB;
connect  con1,localhost,root,,test;
CREATE TABLE s2 LIKE s1;;
connection default;
FLUSH TABLES;
 
More results from queries before failure can be found in /mnt/buildbot/build/mariadb-10.3.8/mysql-test/var/4/log/concurrent_create.log
 
 
Server [mysqld.1 - pid: 15972, winpid: 15972, exit: 256] failed during test run
Server log from this test:
----------SERVER LOG START-----------
180525  8:41:38 [ERROR] mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
Server version: 10.3.8-MariaDB-log
key_buffer_size=1048576
read_buffer_size=131072
max_used_connections=2
max_threads=153
thread_count=8
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 63163 K  bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
 
Thread pointer: 0x7fd2e80009a8
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0x7fd339c37cc8 thread_stack 0x49000
mysys/stacktrace.c:270(my_print_stacktrace)[0x55b05cfb2f8e]
sql/signal_handler.cc:168(handle_fatal_signal)[0x55b05ca5f4c7]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7fd342349390]
sql/sql_base.cc:1890(open_table(THD*, TABLE_LIST*, Open_table_context*))[0x55b05c82a1ea]
sql/sql_base.cc:3539(open_and_process_table)[0x55b05c82d84a]
sql/sql_base.cc:4931(open_and_lock_tables(THD*, DDL_options_st const&, TABLE_LIST*, bool, unsigned int, Prelocking_strategy*))[0x55b05c82de53]
sql/sql_sequence.cc:343(sequence_insert(THD*, LEX*, TABLE_LIST*))[0x55b05c9c9d5b]
sql/sql_table.cc:5092(mysql_create_table_no_lock(THD*, st_mysql_const_lex_string const*, st_mysql_const_lex_string const*, Table_specification_st*, Alter_info*, bool*, int, TABLE_LIST*))[0x55b05c912a3b]
sql/sql_table.cc:5618(mysql_create_like_table(THD*, TABLE_LIST*, TABLE_LIST*, Table_specification_st*))[0x55b05c91365e]
sql/sql_parse.cc:4256(mysql_execute_command(THD*))[0x55b05c88ce00]
sql/sql_parse.cc:8020(mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool))[0x55b05c88d6ba]
sql/sql_parse.cc:1846(dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool))[0x55b05c890003]
sql/sql_parse.cc:1393(do_command(THD*))[0x55b05c890abc]
sql/sql_connect.cc:1402(do_handle_one_connection(CONNECT*))[0x55b05c95ebc2]
sql/sql_connect.cc:1310(handle_one_connection)[0x55b05c95ed3d]
perfschema/pfs.cc:1865(pfs_spawn_thread)[0x55b05cbf20a1]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba)[0x7fd34233f6ba]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7fd3419ea82d]
 
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (0x7fd2e80117c8): CREATE TABLE s2 LIKE s1
Connection ID (thread ID): 33
Status: NOT_KILLED
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on
 
The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
information that should help you find out what is causing the crash.
Writing a core file at /mnt/buildbot/build/mariadb-10.3.8/mysql-test/var/4/mysqld.1/data/
----------SERVER LOG END-------------
 
 
 - found 'core' (1/0)
 
Trying 'dbx' to get a backtrace
 
Trying 'gdb' to get a backtrace from coredump /mnt/buildbot/build/mariadb-10.3.8/mysql-test/var/4/log/sql_sequence.concurrent_create-innodb/mysqld.1/data/core
Core generated by '/mnt/buildbot/build/mariadb-10.3.8/sql/mysqld'
Output from gdb follows. The first stack trace is from the failing thread.
The following stack traces are from all threads (so the failing one is
duplicated).
--------------------------
[New LWP 16025]
[New LWP 16006]
[New LWP 16008]
[New LWP 15990]
[New LWP 16007]
[New LWP 15973]
[New LWP 15991]
[New LWP 16009]
[New LWP 16037]
[New LWP 15992]
[New LWP 15993]
[New LWP 15994]
[New LWP 15995]
[New LWP 15996]
[New LWP 15997]
[New LWP 15998]
[New LWP 16000]
[New LWP 16001]
[New LWP 16002]
[New LWP 16003]
[New LWP 16004]
[New LWP 16005]
[New LWP 16012]
[New LWP 16021]
[New LWP 16018]
[New LWP 16014]
[New LWP 16013]
[New LWP 16011]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/mnt/buildbot/build/mariadb-10.3.8/sql/mysqld --defaults-group-suffix=.1 --defa'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x00007fd34234659f in pthread_kill () from /lib/x86_64-linux-gnu/libpthread.so.0
[Current thread is 1 (Thread 0x7fd339c38700 (LWP 16025))]
#0  0x00007fd34234659f in pthread_kill () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cfb2b57 in my_write_core (sig=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/mysys/stacktrace.c:481
#2  0x000055b05ca5f582 in handle_fatal_signal (sig=11) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/signal_handler.cc:305
#3  <signal handler called>
#4  open_table (thd=thd@entry=0x7fd2e80009a8, table_list=table_list@entry=0x7fd339c33e20, ot_ctx=ot_ctx@entry=0x7fd339c33a40) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_base.cc:1890
#5  0x000055b05c82d84a in open_and_process_table (ot_ctx=0x7fd339c33a40, has_prelocking_list=false, prelocking_strategy=0x7fd339c33cf0, flags=2080, counter=0x7fd339c33c9c, tables=0x7fd339c33e20, lex=0x7fd2e8004590, thd=0x7fd2e80009a8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_base.cc:3536
#6  open_tables (thd=thd@entry=0x7fd2e80009a8, options=..., start=start@entry=0x7fd339c33c88, counter=counter@entry=0x7fd339c33c9c, flags=flags@entry=2080, prelocking_strategy=prelocking_strategy@entry=0x7fd339c33cf0) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_base.cc:4056
#7  0x000055b05c82de53 in open_and_lock_tables (thd=thd@entry=0x7fd2e80009a8, options=..., tables=tables@entry=0x7fd339c33e20, derived=derived@entry=false, flags=flags@entry=2080, prelocking_strategy=prelocking_strategy@entry=0x7fd339c33cf0) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_base.cc:4931
#8  0x000055b05c9c9d5b in open_and_lock_tables (flags=2080, derived=false, tables=0x7fd339c33e20, thd=0x7fd2e80009a8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_base.h:497
#9  sequence_insert (thd=thd@entry=0x7fd2e80009a8, lex=0x7fd2e8004590, org_table_list=org_table_list@entry=0x7fd2e80118a0) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_sequence.cc:339
#10 0x000055b05c912a3b in mysql_create_table_no_lock (thd=thd@entry=0x7fd2e80009a8, db=db@entry=0x7fd2e80118b8, table_name=table_name@entry=0x7fd2e80118c8, create_info=create_info@entry=0x7fd339c348c0, alter_info=alter_info@entry=0x7fd339c34800, is_trans=is_trans@entry=0x7fd339c3479b, create_table_mode=0, table_list=0x7fd2e80118a0) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_table.cc:5092
#11 0x000055b05c91365e in mysql_create_like_table (thd=thd@entry=0x7fd2e80009a8, table=table@entry=0x7fd2e80118a0, src_table=src_table@entry=0x7fd2e8011f28, create_info=create_info@entry=0x7fd339c35e90) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_table.cc:5615
#12 0x000055b05c88ce00 in mysql_execute_command (thd=thd@entry=0x7fd2e80009a8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_parse.cc:4255
#13 0x000055b05c88d6ba in mysql_parse (thd=thd@entry=0x7fd2e80009a8, rawbuf=<optimized out>, length=23, parser_state=parser_state@entry=0x7fd339c37480, is_com_multi=is_com_multi@entry=false, is_next_command=is_next_command@entry=false) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_parse.cc:8020
#14 0x000055b05c890003 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x7fd2e80009a8, packet=packet@entry=0x7fd2e8009319 "CREATE TABLE s2 LIKE s1;", packet_length=packet_length@entry=24, is_com_multi=is_com_multi@entry=false, is_next_command=is_next_command@entry=false) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_parse.cc:1846
#15 0x000055b05c890abc in do_command (thd=0x7fd2e80009a8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_parse.cc:1391
#16 0x000055b05c95ebc2 in do_handle_one_connection (connect=connect@entry=0x55b05ef0b4b8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_connect.cc:1402
#17 0x000055b05c95ed3d in handle_one_connection (arg=arg@entry=0x55b05ef0b4b8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_connect.cc:1308
#18 0x000055b05cbf20a1 in pfs_spawn_thread (arg=0x55b05eed3788) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/perfschema/pfs.cc:1862
#19 0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#20 0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 28 (Thread 0x7fd30bfff700 (LWP 16011)):
#0  0x00007fd342345360 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cd1cbb6 in os_event::wait (this=0x55b05ecab6b0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:163
#2  os_event::wait_low (reset_sig_count=1, this=0x55b05ecab6b0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:333
#3  os_event_wait_low (event=0x55b05ecab6b0, reset_sig_count=reset_sig_count@entry=0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:522
#4  0x000055b05ce478b7 in buf_dump_thread () at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/buf/buf0dump.cc:837
#5  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#6  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 27 (Thread 0x7fd30affd700 (LWP 16013)):
#0  0x00007fd342345360 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cd1cbb6 in os_event::wait (this=0x55b05ecab7b0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:163
#2  os_event::wait_low (reset_sig_count=1, this=0x55b05ecab7b0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:333
#3  os_event_wait_low (event=0x55b05ecab7b0, reset_sig_count=reset_sig_count@entry=0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:522
#4  0x000055b05ce3fb2c in buf_resize_thread () at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/buf/buf0buf.cc:3131
#5  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#6  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 26 (Thread 0x7fd30a7fc700 (LWP 16014)):
#0  0x00007fd342345360 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cca008b in inline_mysql_cond_wait (src_file=0x55b05d161db0 "/home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/handler/ha_innodb.cc", src_line=312, mutex=0x7fd30a7fbcc0, that=0x7fd30a7fbcf0) at /home/buildbot/buildbot/build/mariadb-10.3.8/include/mysql/psi/mysql_thread.h:1178
#2  thd_destructor_proxy () at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/handler/ha_innodb.cc:312
#3  0x000055b05cbf20a1 in pfs_spawn_thread (arg=0x55b05ee29b48) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/perfschema/pfs.cc:1862
#4  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#5  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 25 (Thread 0x7fd339ccc700 (LWP 16018)):
#0  0x00007fd342349156 in sigwait () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05c7ca44b in signal_hand (arg=arg@entry=0x0) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc:3552
#2  0x000055b05cbf20a1 in pfs_spawn_thread (arg=0x55b05eec7438) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/perfschema/pfs.cc:1862
#3  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 24 (Thread 0x7fd339c82700 (LWP 16021)):
#0  0x00007fd342345360 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05c7ea074 in inline_mysql_cond_wait (that=<optimized out>, mutex=<optimized out>, src_file=0x55b05d044ee0 "/home/buildbot/buildbot/build/mariadb-10.3.8/sql/slave.cc", src_line=513) at /home/buildbot/buildbot/build/mariadb-10.3.8/include/mysql/psi/mysql_thread.h:1167
#2  handle_slave_background (arg=arg@entry=0x0) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/slave.cc:513
#3  0x000055b05cbf20a1 in pfs_spawn_thread (arg=0x55b05ef23d58) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/perfschema/pfs.cc:1862
#4  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#5  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 23 (Thread 0x7fd30b7fe700 (LWP 16012)):
#0  0x00007fd342348c1d in nanosleep () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cd1ce00 in os_thread_sleep (tm=tm@entry=1000000) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0thread.cc:230
#2  0x000055b05ce31cca in btr_defragment_thread () at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/btr/btr0defragment.cc:768
#3  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 22 (Thread 0x7fd326ffd700 (LWP 16005)):
#0  0x00007fd342348c1d in nanosleep () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cd1ce00 in os_thread_sleep (tm=tm@entry=1000000) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0thread.cc:230
#2  0x000055b05cdad538 in srv_master_sleep () at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0srv.cc:2325
#3  srv_master_thread (arg=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0srv.cc:2366
#4  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#5  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 21 (Thread 0x7fd3277fe700 (LWP 16004)):
#0  0x00007fd342345709 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cd1c582 in os_event::timed_wait (this=this@entry=0x55b05ee14a00, abstime=abstime@entry=0x7fd3277fdac0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:283
#2  0x000055b05cd1c7f1 in os_event::wait_time_low (this=0x55b05ee14a00, time_in_usec=time_in_usec@entry=5000000, reset_sig_count=reset_sig_count@entry=1) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:405
#3  0x000055b05cd1cb6a in os_event_wait_time_low (event=<optimized out>, time_in_usec=time_in_usec@entry=5000000, reset_sig_count=reset_sig_count@entry=1) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:505
#4  0x000055b05cdfdf92 in ib_wqueue_timedwait (wq=wq@entry=0x55b05ee863d0, wait_in_usecs=wait_in_usecs@entry=5000000) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/ut/ut0wqueue.cc:163
#5  0x000055b05cedf782 in fts_optimize_thread (arg=0x55b05ee863d0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/fts/fts0opt.cc:3035
#6  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#7  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 20 (Thread 0x7fd331ffb700 (LWP 16003)):
#0  0x00007fd342345709 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cd1c582 in os_event::timed_wait (this=this@entry=0x55b05ee7e610, abstime=abstime@entry=0x7fd331ffac10) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:283
#2  0x000055b05cd1c7f1 in os_event::wait_time_low (this=0x55b05ee7e610, time_in_usec=time_in_usec@entry=10000000, reset_sig_count=1, reset_sig_count@entry=0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:405
#3  0x000055b05cd1cb6a in os_event_wait_time_low (event=<optimized out>, time_in_usec=time_in_usec@entry=10000000, reset_sig_count=reset_sig_count@entry=0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:505
#4  0x000055b05ce97fa0 in dict_stats_thread () at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/dict/dict0stats_bg.cc:449
#5  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#6  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 19 (Thread 0x7fd327fff700 (LWP 16002)):
#0  0x00007fd342345709 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cd1c582 in os_event::timed_wait (this=this@entry=0x55b05ecab630, abstime=abstime@entry=0x7fd327ffec90) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:283
#2  0x000055b05cd1c7f1 in os_event::wait_time_low (this=0x55b05ecab630, time_in_usec=time_in_usec@entry=5000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:405
#3  0x000055b05cd1cb6a in os_event_wait_time_low (event=<optimized out>, time_in_usec=time_in_usec@entry=5000000, reset_sig_count=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:505
#4  0x000055b05cdabda9 in srv_monitor_thread () at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0srv.cc:1689
#5  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#6  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 18 (Thread 0x7fd330ff9700 (LWP 16001)):
#0  0x00007fd342345709 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cd1c582 in os_event::timed_wait (this=this@entry=0x55b05ecab5b0, abstime=abstime@entry=0x7fd330ff8b60) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:283
#2  0x000055b05cd1c7f1 in os_event::wait_time_low (this=0x55b05ecab5b0, time_in_usec=time_in_usec@entry=1000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:405
#3  0x000055b05cd1cb6a in os_event_wait_time_low (event=<optimized out>, time_in_usec=time_in_usec@entry=1000000, reset_sig_count=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:505
#4  0x000055b05cdac42b in srv_error_monitor_thread () at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0srv.cc:1853
#5  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#6  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 17 (Thread 0x7fd3317fa700 (LWP 16000)):
#0  0x00007fd342345709 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cd1c582 in os_event::timed_wait (this=this@entry=0x55b05ee4bc80, abstime=abstime@entry=0x7fd3317f9bf0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:283
#2  0x000055b05cd1c7f1 in os_event::wait_time_low (this=this@entry=0x55b05ee4bc80, time_in_usec=time_in_usec@entry=1000000, reset_sig_count=1) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:405
#3  0x000055b05cd1cb6a in os_event_wait_time_low (event=event@entry=0x55b05ee4bc80, time_in_usec=time_in_usec@entry=1000000, reset_sig_count=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:505
#4  0x000055b05ccf0e06 in lock_wait_timeout_thread () at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/lock/lock0wait.cc:543
#5  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#6  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 16 (Thread 0x7fd3327fc700 (LWP 15998)):
#0  0x00007fd342345709 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cd1c582 in os_event::timed_wait (this=this@entry=0x55b05ecab730, abstime=abstime@entry=0x7fd3327fb9a0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:283
#2  0x000055b05cd1c7f1 in os_event::wait_time_low (this=0x55b05ecab730, time_in_usec=time_in_usec@entry=996000, reset_sig_count=reset_sig_count@entry=2) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:405
#3  0x000055b05cd1cb6a in os_event_wait_time_low (event=<optimized out>, time_in_usec=time_in_usec@entry=996000, reset_sig_count=reset_sig_count@entry=2) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:505
#4  0x000055b05ce5286b in pc_sleep_if_needed (cur_time=1527252097348, sig_count=2, next_loop_time=1527252098344) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/buf/buf0flu.cc:2688
#5  buf_flush_page_cleaner_coordinator () at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/buf/buf0flu.cc:3147
#6  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#7  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 15 (Thread 0x7fd332ffd700 (LWP 15997)):
#0  0x00007fd34324964a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
#1  0x000055b05cd15c08 in LinuxAIOHandler::collect (this=this@entry=0x7fd332ffcaf0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:1918
#2  0x000055b05cd16152 in LinuxAIOHandler::poll (this=this@entry=0x7fd332ffcaf0, m1=m1@entry=0x7fd332ffcb90, m2=m2@entry=0x7fd332ffcb98, request=request@entry=0x7fd332ffcba0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:2063
#3  0x000055b05cd1afd9 in os_aio_linux_handler (request=0x7fd332ffcba0, m2=0x7fd332ffcb98, m1=0x7fd332ffcb90, global_segment=5) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:2117
#4  os_aio_handler (segment=segment@entry=5, m1=m1@entry=0x7fd332ffcb90, m2=m2@entry=0x7fd332ffcb98, request=request@entry=0x7fd332ffcba0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:5643
#5  0x000055b05cea5265 in fil_aio_wait (segment=segment@entry=5) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/fil/fil0fil.cc:4659
#6  0x000055b05cdb0ee8 in io_handler_thread (arg=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0start.cc:331
#7  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#8  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 14 (Thread 0x7fd3337fe700 (LWP 15996)):
#0  0x00007fd34324964a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
#1  0x000055b05cd15c08 in LinuxAIOHandler::collect (this=this@entry=0x7fd3337fdaf0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:1918
#2  0x000055b05cd16152 in LinuxAIOHandler::poll (this=this@entry=0x7fd3337fdaf0, m1=m1@entry=0x7fd3337fdb90, m2=m2@entry=0x7fd3337fdb98, request=request@entry=0x7fd3337fdba0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:2063
#3  0x000055b05cd1afd9 in os_aio_linux_handler (request=0x7fd3337fdba0, m2=0x7fd3337fdb98, m1=0x7fd3337fdb90, global_segment=4) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:2117
#4  os_aio_handler (segment=segment@entry=4, m1=m1@entry=0x7fd3337fdb90, m2=m2@entry=0x7fd3337fdb98, request=request@entry=0x7fd3337fdba0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:5643
#5  0x000055b05cea5265 in fil_aio_wait (segment=segment@entry=4) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/fil/fil0fil.cc:4659
#6  0x000055b05cdb0ee8 in io_handler_thread (arg=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0start.cc:331
#7  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#8  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 13 (Thread 0x7fd333fff700 (LWP 15995)):
#0  0x00007fd34324964a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
#1  0x000055b05cd15c08 in LinuxAIOHandler::collect (this=this@entry=0x7fd333ffeaf0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:1918
#2  0x000055b05cd16152 in LinuxAIOHandler::poll (this=this@entry=0x7fd333ffeaf0, m1=m1@entry=0x7fd333ffeb90, m2=m2@entry=0x7fd333ffeb98, request=request@entry=0x7fd333ffeba0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:2063
#3  0x000055b05cd1afd9 in os_aio_linux_handler (request=0x7fd333ffeba0, m2=0x7fd333ffeb98, m1=0x7fd333ffeb90, global_segment=3) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:2117
#4  os_aio_handler (segment=segment@entry=3, m1=m1@entry=0x7fd333ffeb90, m2=m2@entry=0x7fd333ffeb98, request=request@entry=0x7fd333ffeba0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:5643
#5  0x000055b05cea5265 in fil_aio_wait (segment=segment@entry=3) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/fil/fil0fil.cc:4659
#6  0x000055b05cdb0ee8 in io_handler_thread (arg=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0start.cc:331
#7  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#8  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 12 (Thread 0x7fd338ad0700 (LWP 15994)):
#0  0x00007fd34324964a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
#1  0x000055b05cd15c08 in LinuxAIOHandler::collect (this=this@entry=0x7fd338acfaf0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:1918
#2  0x000055b05cd16152 in LinuxAIOHandler::poll (this=this@entry=0x7fd338acfaf0, m1=m1@entry=0x7fd338acfb90, m2=m2@entry=0x7fd338acfb98, request=request@entry=0x7fd338acfba0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:2063
#3  0x000055b05cd1afd9 in os_aio_linux_handler (request=0x7fd338acfba0, m2=0x7fd338acfb98, m1=0x7fd338acfb90, global_segment=2) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:2117
#4  os_aio_handler (segment=segment@entry=2, m1=m1@entry=0x7fd338acfb90, m2=m2@entry=0x7fd338acfb98, request=request@entry=0x7fd338acfba0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:5643
#5  0x000055b05cea5265 in fil_aio_wait (segment=segment@entry=2) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/fil/fil0fil.cc:4659
#6  0x000055b05cdb0ee8 in io_handler_thread (arg=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0start.cc:331
#7  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#8  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 11 (Thread 0x7fd3392d1700 (LWP 15993)):
#0  0x00007fd34324964a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
#1  0x000055b05cd15c08 in LinuxAIOHandler::collect (this=this@entry=0x7fd3392d0af0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:1918
#2  0x000055b05cd16152 in LinuxAIOHandler::poll (this=this@entry=0x7fd3392d0af0, m1=m1@entry=0x7fd3392d0b90, m2=m2@entry=0x7fd3392d0b98, request=request@entry=0x7fd3392d0ba0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:2063
#3  0x000055b05cd1afd9 in os_aio_linux_handler (request=0x7fd3392d0ba0, m2=0x7fd3392d0b98, m1=0x7fd3392d0b90, global_segment=1) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:2117
#4  os_aio_handler (segment=segment@entry=1, m1=m1@entry=0x7fd3392d0b90, m2=m2@entry=0x7fd3392d0b98, request=request@entry=0x7fd3392d0ba0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:5643
#5  0x000055b05cea5265 in fil_aio_wait (segment=segment@entry=1) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/fil/fil0fil.cc:4659
#6  0x000055b05cdb0ee8 in io_handler_thread (arg=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0start.cc:331
#7  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#8  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 10 (Thread 0x7fd339ad2700 (LWP 15992)):
#0  0x00007fd34324964a in ?? () from /lib/x86_64-linux-gnu/libaio.so.1
#1  0x000055b05cd15c08 in LinuxAIOHandler::collect (this=this@entry=0x7fd339ad1af0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:1918
#2  0x000055b05cd16152 in LinuxAIOHandler::poll (this=this@entry=0x7fd339ad1af0, m1=m1@entry=0x7fd339ad1b90, m2=m2@entry=0x7fd339ad1b98, request=request@entry=0x7fd339ad1ba0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:2063
#3  0x000055b05cd1afd9 in os_aio_linux_handler (request=0x7fd339ad1ba0, m2=0x7fd339ad1b98, m1=0x7fd339ad1b90, global_segment=0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:2117
#4  os_aio_handler (segment=segment@entry=0, m1=m1@entry=0x7fd339ad1b90, m2=m2@entry=0x7fd339ad1b98, request=request@entry=0x7fd339ad1ba0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0file.cc:5643
#5  0x000055b05cea5265 in fil_aio_wait (segment=segment@entry=0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/fil/fil0fil.cc:4659
#6  0x000055b05cdb0ee8 in io_handler_thread (arg=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0start.cc:331
#7  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#8  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 9 (Thread 0x7fd339bee700 (LWP 16037)):
#0  0x00007fd342345709 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05c965dff in inline_mysql_cond_timedwait (src_file=0x55b05d05cc80 "/home/buildbot/buildbot/build/mariadb-10.3.8/sql/mdl.cc", src_line=1094, abstime=0x7fd339bebc30, mutex=0x7fd2ec000ae8, that=0x7fd2ec000b18) at /home/buildbot/buildbot/build/mariadb-10.3.8/include/mysql/psi/mysql_thread.h:1204
#2  MDL_wait::timed_wait (this=this@entry=0x7fd2ec000ae8, owner=owner@entry=0x7fd2ec000a78, abs_timeout=abs_timeout@entry=0x7fd339bebc30, set_status_on_timeout=set_status_on_timeout@entry=true, wait_state_name=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/mdl.cc:1094
#3  0x000055b05c931bcc in TABLE_SHARE::wait_for_old_version (this=0x7fd2ec0b2a00, thd=thd@entry=0x7fd2ec0009a8, abstime=abstime@entry=0x7fd339bebc30, deadlock_weight=deadlock_weight@entry=100) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/table.cc:4522
#4  0x000055b05c82b15a in close_cached_tables (thd=thd@entry=0x7fd2ec0009a8, tables=tables@entry=0x0, wait_for_refresh=wait_for_refresh@entry=true, timeout=86400) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_base.cc:456
#5  0x000055b05c97980e in reload_acl_and_cache (thd=thd@entry=0x7fd2ec0009a8, options=4, tables=tables@entry=0x0, write_to_binlog=write_to_binlog@entry=0x7fd339bebe90) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_reload.cc:335
#6  0x000055b05c885ead in mysql_execute_command (thd=thd@entry=0x7fd2ec0009a8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_parse.cc:5620
#7  0x000055b05c88d6ba in mysql_parse (thd=thd@entry=0x7fd2ec0009a8, rawbuf=<optimized out>, length=12, parser_state=parser_state@entry=0x7fd339bed480, is_com_multi=is_com_multi@entry=false, is_next_command=is_next_command@entry=false) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_parse.cc:8020
#8  0x000055b05c890003 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x7fd2ec0009a8, packet=packet@entry=0x7fd2ec009319 "FLUSH TABLES", packet_length=packet_length@entry=12, is_com_multi=is_com_multi@entry=false, is_next_command=is_next_command@entry=false) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_parse.cc:1846
#9  0x000055b05c890abc in do_command (thd=0x7fd2ec0009a8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_parse.cc:1391
#10 0x000055b05c95ebc2 in do_handle_one_connection (connect=connect@entry=0x55b05ef0b4b8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_connect.cc:1402
#11 0x000055b05c95ed3d in handle_one_connection (arg=arg@entry=0x55b05ef0b4b8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_connect.cc:1308
#12 0x000055b05cbf20a1 in pfs_spawn_thread (arg=0x55b05ef447e8) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/perfschema/pfs.cc:1862
#13 0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#14 0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 8 (Thread 0x7fd324ff9700 (LWP 16009)):
#0  0x00007fd342345360 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cd1cbb6 in os_event::wait (this=0x55b05ecab530) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:163
#2  os_event::wait_low (reset_sig_count=483, this=0x55b05ecab530) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:333
#3  os_event_wait_low (event=0x55b05ecab530, reset_sig_count=reset_sig_count@entry=0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:522
#4  0x000055b05cdae07f in srv_resume_thread (sig_count=0, timeout_usec=0, wait=true, slot=0x55b05d8a91a8 <srv_sys+360>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0srv.cc:915
#5  srv_worker_thread (arg=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0srv.cc:2483
#6  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#7  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 7 (Thread 0x7fd33b313700 (LWP 15991)):
#0  0x00007fd342345709 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cc392ac in inline_mysql_cond_timedwait (src_file=0x55b05d15e070 "/home/buildbot/buildbot/build/mariadb-10.3.8/storage/maria/ma_servicethread.c", src_line=116, abstime=0x7fd33b312c60, mutex=0x55b05e15c3c0 <LOCK_checkpoint>, that=0x55b05e15c380 <COND_checkpoint>) at /home/buildbot/buildbot/build/mariadb-10.3.8/include/mysql/psi/mysql_thread.h:1204
#2  my_service_thread_sleep (control=control@entry=0x55b05d89c780 <checkpoint_control>, sleep_time=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/maria/ma_servicethread.c:115
#3  0x000055b05cc30c37 in ma_checkpoint_background (arg=arg@entry=0x1e) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/maria/ma_checkpoint.c:707
#4  0x000055b05cbf20a1 in pfs_spawn_thread (arg=0x55b05eb95f88) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/perfschema/pfs.cc:1862
#5  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#6  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 6 (Thread 0x7fd3437e88c0 (LWP 15973)):
#0  0x00007fd3419deb5d in poll () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x000055b05c7d3fef in poll (__timeout=-1, __nfds=2, __fds=0x7ffe88cb7050) at /usr/include/x86_64-linux-gnu/bits/poll2.h:41
#2  handle_connections_sockets () at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc:6709
#3  0x000055b05c7d5863 in mysqld_main (argc=147, argv=0x55b05ea58e08) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/mysqld.cc:6178
#4  0x00007fd341904830 in __libc_start_main () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x000055b05c7c75d9 in _start ()
 
Thread 5 (Thread 0x7fd325ffb700 (LWP 16007)):
#0  0x00007fd342345360 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cd1cbb6 in os_event::wait (this=0x55b05ecab430) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:163
#2  os_event::wait_low (reset_sig_count=554, this=0x55b05ecab430) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:333
#3  os_event_wait_low (event=0x55b05ecab430, reset_sig_count=reset_sig_count@entry=0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:522
#4  0x000055b05cdae07f in srv_resume_thread (sig_count=0, timeout_usec=0, wait=true, slot=0x55b05d8a9138 <srv_sys+248>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0srv.cc:915
#5  srv_worker_thread (arg=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0srv.cc:2483
#6  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#7  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 4 (Thread 0x7fd33c67f700 (LWP 15990)):
#0  0x00007fd342345709 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cfb76dd in inline_mysql_cond_timedwait (that=0x55b05e1b7720 <COND_timer>, mutex=0x55b05e1b7760 <LOCK_timer>, src_file=0x55b05d1a43a8 "/home/buildbot/buildbot/build/mariadb-10.3.8/mysys/thr_timer.c", src_line=292, abstime=0x7fd33c67ece0) at /home/buildbot/buildbot/build/mariadb-10.3.8/include/mysql/psi/mysql_thread.h:1204
#2  timer_handler (arg=arg@entry=0x0) at /home/buildbot/buildbot/build/mariadb-10.3.8/mysys/thr_timer.c:292
#3  0x000055b05cbf20a1 in pfs_spawn_thread (arg=0x55b05eb95f88) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/perfschema/pfs.cc:1862
#4  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#5  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 3 (Thread 0x7fd3257fa700 (LWP 16008)):
#0  0x00007fd342345360 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cd1cbb6 in os_event::wait (this=0x55b05ecab4b0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:163
#2  os_event::wait_low (reset_sig_count=496, this=0x55b05ecab4b0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:333
#3  os_event_wait_low (event=0x55b05ecab4b0, reset_sig_count=reset_sig_count@entry=0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:522
#4  0x000055b05cdae07f in srv_resume_thread (sig_count=0, timeout_usec=0, wait=true, slot=0x55b05d8a9170 <srv_sys+304>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0srv.cc:915
#5  srv_worker_thread (arg=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0srv.cc:2483
#6  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#7  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 2 (Thread 0x7fd3267fc700 (LWP 16006)):
#0  0x00007fd342345360 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cd1cbb6 in os_event::wait (this=0x55b05ecab3b0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:163
#2  os_event::wait_low (reset_sig_count=117, this=0x55b05ecab3b0) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:333
#3  os_event_wait_low (event=0x55b05ecab3b0, reset_sig_count=reset_sig_count@entry=117) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/os/os0event.cc:522
#4  0x000055b05cdaf2b1 in srv_resume_thread (timeout_usec=0, wait=true, sig_count=117, slot=0x55b05d8a9100 <srv_sys+192>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0srv.cc:915
#5  srv_purge_coordinator_suspend (rseg_history_len=<optimized out>, slot=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0srv.cc:2628
#6  srv_purge_coordinator_thread (arg=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/innobase/srv/srv0srv.cc:2703
#7  0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#8  0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6
 
Thread 1 (Thread 0x7fd339c38700 (LWP 16025)):
#0  0x00007fd34234659f in pthread_kill () from /lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000055b05cfb2b57 in my_write_core (sig=<optimized out>) at /home/buildbot/buildbot/build/mariadb-10.3.8/mysys/stacktrace.c:481
#2  0x000055b05ca5f582 in handle_fatal_signal (sig=11) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/signal_handler.cc:305
#3  <signal handler called>
#4  open_table (thd=thd@entry=0x7fd2e80009a8, table_list=table_list@entry=0x7fd339c33e20, ot_ctx=ot_ctx@entry=0x7fd339c33a40) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_base.cc:1890
#5  0x000055b05c82d84a in open_and_process_table (ot_ctx=0x7fd339c33a40, has_prelocking_list=false, prelocking_strategy=0x7fd339c33cf0, flags=2080, counter=0x7fd339c33c9c, tables=0x7fd339c33e20, lex=0x7fd2e8004590, thd=0x7fd2e80009a8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_base.cc:3536
#6  open_tables (thd=thd@entry=0x7fd2e80009a8, options=..., start=start@entry=0x7fd339c33c88, counter=counter@entry=0x7fd339c33c9c, flags=flags@entry=2080, prelocking_strategy=prelocking_strategy@entry=0x7fd339c33cf0) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_base.cc:4056
#7  0x000055b05c82de53 in open_and_lock_tables (thd=thd@entry=0x7fd2e80009a8, options=..., tables=tables@entry=0x7fd339c33e20, derived=derived@entry=false, flags=flags@entry=2080, prelocking_strategy=prelocking_strategy@entry=0x7fd339c33cf0) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_base.cc:4931
#8  0x000055b05c9c9d5b in open_and_lock_tables (flags=2080, derived=false, tables=0x7fd339c33e20, thd=0x7fd2e80009a8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_base.h:497
#9  sequence_insert (thd=thd@entry=0x7fd2e80009a8, lex=0x7fd2e8004590, org_table_list=org_table_list@entry=0x7fd2e80118a0) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_sequence.cc:339
#10 0x000055b05c912a3b in mysql_create_table_no_lock (thd=thd@entry=0x7fd2e80009a8, db=db@entry=0x7fd2e80118b8, table_name=table_name@entry=0x7fd2e80118c8, create_info=create_info@entry=0x7fd339c348c0, alter_info=alter_info@entry=0x7fd339c34800, is_trans=is_trans@entry=0x7fd339c3479b, create_table_mode=0, table_list=0x7fd2e80118a0) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_table.cc:5092
#11 0x000055b05c91365e in mysql_create_like_table (thd=thd@entry=0x7fd2e80009a8, table=table@entry=0x7fd2e80118a0, src_table=src_table@entry=0x7fd2e8011f28, create_info=create_info@entry=0x7fd339c35e90) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_table.cc:5615
#12 0x000055b05c88ce00 in mysql_execute_command (thd=thd@entry=0x7fd2e80009a8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_parse.cc:4255
#13 0x000055b05c88d6ba in mysql_parse (thd=thd@entry=0x7fd2e80009a8, rawbuf=<optimized out>, length=23, parser_state=parser_state@entry=0x7fd339c37480, is_com_multi=is_com_multi@entry=false, is_next_command=is_next_command@entry=false) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_parse.cc:8020
#14 0x000055b05c890003 in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x7fd2e80009a8, packet=packet@entry=0x7fd2e8009319 "CREATE TABLE s2 LIKE s1;", packet_length=packet_length@entry=24, is_com_multi=is_com_multi@entry=false, is_next_command=is_next_command@entry=false) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_parse.cc:1846
#15 0x000055b05c890abc in do_command (thd=0x7fd2e80009a8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_parse.cc:1391
#16 0x000055b05c95ebc2 in do_handle_one_connection (connect=connect@entry=0x55b05ef0b4b8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_connect.cc:1402
#17 0x000055b05c95ed3d in handle_one_connection (arg=arg@entry=0x55b05ef0b4b8) at /home/buildbot/buildbot/build/mariadb-10.3.8/sql/sql_connect.cc:1308
#18 0x000055b05cbf20a1 in pfs_spawn_thread (arg=0x55b05eed3788) at /home/buildbot/buildbot/build/mariadb-10.3.8/storage/perfschema/pfs.cc:1862
#19 0x00007fd34233f6ba in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#20 0x00007fd3419ea82d in clone () from /lib/x86_64-linux-gnu/libc.so.6



 Comments   
Comment by Elena Stepanova [ 2018-07-06 ]

I had a similar failure in my travis tests:

10.3 1748a31ae8d69e4939336f644f884e9de3039e7f

#2  <signal handler called>
#3  0x00005572ceeb16da in open_table (thd=thd@entry=0x7fb7f4000a88, table_list=table_list@entry=0x7fb8302ee4e0, ot_ctx=ot_ctx@entry=0x7fb8302ee2d0) at /home/travis/src/sql/sql_base.cc:1900
#4  0x00005572ceeb4703 in open_and_process_table (ot_ctx=0x7fb8302ee2d0, has_prelocking_list=false, prelocking_strategy=0x7fb8302ee3b0, flags=2080, counter=0x7fb8302ee36c, tables=0x7fb8302ee4e0, lex=0x7fb7f40046a8, thd=0x7fb7f4000a88) at /home/travis/src/sql/sql_base.cc:3548
#5  open_tables (thd=thd@entry=0x7fb7f4000a88, options=..., start=start@entry=0x7fb8302ee358, counter=counter@entry=0x7fb8302ee36c, flags=flags@entry=2080, prelocking_strategy=prelocking_strategy@entry=0x7fb8302ee3b0) at /home/travis/src/sql/sql_base.cc:4068
#6  0x00005572ceeb4c2d in open_and_lock_tables (thd=thd@entry=0x7fb7f4000a88, options=..., tables=tables@entry=0x7fb8302ee4e0, derived=derived@entry=false, flags=flags@entry=2080, prelocking_strategy=prelocking_strategy@entry=0x7fb8302ee3b0) at /home/travis/src/sql/sql_base.cc:4943
#7  0x00005572cf031335 in open_and_lock_tables (flags=2080, derived=false, tables=0x7fb8302ee4e0, thd=0x7fb7f4000a88) at /home/travis/src/sql/sql_base.h:497
#8  sequence_insert (thd=thd@entry=0x7fb7f4000a88, lex=0x7fb7f40046a8, org_table_list=org_table_list@entry=0x7fb7f4011848) at /home/travis/src/sql/sql_sequence.cc:341
#9  0x00005572cef892ea in mysql_create_table_no_lock (thd=thd@entry=0x7fb7f4000a88, db=db@entry=0x7fb7f4011860, table_name=table_name@entry=0x7fb7f4011870, create_info=create_info@entry=0x7fb8302ef050, alter_info=alter_info@entry=0x7fb8302eef90, is_trans=is_trans@entry=0x7fb8302eee5f, create_table_mode=0, table_list=table_list@entry=0x7fb7f4011848) at /home/travis/src/sql/sql_table.cc:5103
#10 0x00005572cef894c7 in mysql_create_table (thd=thd@entry=0x7fb7f4000a88, create_table=create_table@entry=0x7fb7f4011848, create_info=create_info@entry=0x7fb8302ef050, alter_info=alter_info@entry=0x7fb8302eef90) at /home/travis/src/sql/sql_table.cc:5186
#11 0x00005572cef0c949 in mysql_execute_command (thd=thd@entry=0x7fb7f4000a88) at /home/travis/src/sql/sql_parse.cc:4275
#12 0x00005572cef0d9f1 in mysql_parse (thd=0x7fb7f4000a88, rawbuf=<optimized out>, length=61, parser_state=0x7fb8302f0650, is_com_multi=<optimized out>, is_next_command=<optimized out>) at /home/travis/src/sql/sql_parse.cc:8073
#13 0x00005572cef1039b in dispatch_command (command=command@entry=COM_QUERY, thd=thd@entry=0x7fb7f4000a88, packet=packet@entry=0x7fb7f4009429 "CREATE SEQUENCE IF NOT EXISTS seq1  /* QNO 63601 CON_ID 17 */ ", packet_length=packet_length@entry=62, is_com_multi=is_com_multi@entry=false, is_next_command=is_next_command@entry=false) at /home/travis/src/sql/sql_parse.cc:1847
#14 0x00005572cef111ce in do_command (thd=0x7fb7f4000a88) at /home/travis/src/sql/sql_parse.cc:1392
#15 0x00005572cefd552c in do_handle_one_connection (connect=connect@entry=0x5572d1bac5a8) at /home/travis/src/sql/sql_connect.cc:1402
#16 0x00005572cefd5644 in handle_one_connection (arg=0x5572d1bac5a8) at /home/travis/src/sql/sql_connect.cc:1308
#17 0x00007fb846952184 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
#18 0x00007fb845e5effd in clone () from /lib/x86_64-linux-gnu/libc.so.6

The test was run as below (*not yet confirmed whether it's reproducible but re-running it)

merge 8b07e28011e33305b40ddb441393bfccd7821213

perl /home/travis/rqg/runall-new.pl --vardir=/home/travis/logs/vardir --basedir=/home/travis/server --duration=350 --threads=6 --seed=1530799263 --reporters=Backtrace,ErrorLog,Deadlock --validators=TransformerNoComparator --views --redefine=conf/mariadb/versioning.yy --redefine=conf/mariadb/alter_table.yy --redefine=conf/mariadb/bulk_insert.yy --redefine=conf/mariadb/sequences.yy --mysqld=--log_output=FILE --mysqld=--max-statement-time=30 --mysqld=--lock-wait-timeout=10 --mysqld=--loose-innodb-lock-wait-timeout=5 --mysqld=--default-storage-engine=MyISAM --grammar=conf/mariadb/optimizer.yy --skip-gendata --gendata-advanced --vcols --transformers=ExecuteAsCTE,ExecuteAsDeleteReturning,ExecuteAsExcept,ExecuteAsExecuteImmediate,ExecuteAsInsertSelect,ExecuteAsIntersect,ExecuteAsUnion,ExecuteAsUpdateDelete,ExecuteAsView,ExecuteAsPreparedTwice,ExecuteAsSPTwice

Stack traces are attached as threads and threads_full.

Comment by Elena Stepanova [ 2018-12-12 ]

The MTR test still fails in buildbot on 10.3 and 10.4, although quite rarely (5 occurrences in the past 3 months).

Comment by Alice Sherepa [ 2020-07-20 ]

recent occurrence on 10.3 http://buildbot.askmonty.org/buildbot/builders/kvm-deb-stretch-x86/builds/7740/steps/mtr/logs/stdio

Generated at Thu Feb 08 08:30:24 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.