[MDEV-23420] rpl.rpl_sync_with_innodb_thd_conc failed in buildbot, server crashed in ilink::unlink - Jira

XML

Word

Printable

Details

Type: Bug
Status: Open (View Workflow)
Priority: Major
Resolution: Unresolved
Affects Version/s: 10.5
Fix Version/s: 10.5
Component/s: Server, Tests
Labels:
None

Description

http://buildbot.askmonty.org/buildbot/builders/kvm-deb-stretch-ppc64le/builds/6702

10.5 05fa4558e0e
rpl.rpl_sync_with_innodb_thd_conc 'innodb,stmt' w3 [ fail ]
Test ended at 2020-07-28 11:08:19

CURRENT_TEST: rpl.rpl_sync_with_innodb_thd_conc


The server [mysqld.1 - pid: 3812, winpid: 3812, exit: 256] crashed while running 'check warnings'
Server log from this test:
----------SERVER LOG START-----------
2020-07-28 11:08:18 0 [Note] /usr/sbin/mariadbd (mysqld 10.5.5-MariaDB-1:10.5.5+maria~stretch-log) starting as process 3813 ...
2020-07-28 11:08:18 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 32186)
2020-07-28 11:08:18 0 [Warning] Changed limits: max_open_files: 1024 max_connections: 151 (was 151) table_cache: 421 (was 2000)
2020-07-28 11:08:18 0 [Note] Plugin 'partition' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'SEQUENCE' is disabled.
2020-07-28 11:08:18 0 [Note] InnoDB: Using Linux native AIO
2020-07-28 11:08:18 0 [Note] InnoDB: Uses event mutexes
2020-07-28 11:08:18 0 [Note] InnoDB: Compressed tables use zlib 1.2.8
2020-07-28 11:08:18 0 [Note] InnoDB: Number of pools: 1
2020-07-28 11:08:18 0 [Note] InnoDB: Using POWER8 crc32 instructions
2020-07-28 11:08:18 0 [Note] mariadbd: O_TMPFILE is not supported on /dev/shm/var/tmp/3/mysqld.1 (disabling future attempts)
2020-07-28 11:08:18 0 [Note] InnoDB: Initializing buffer pool, total size = 8388608, chunk size = 8388608
2020-07-28 11:08:18 0 [Note] InnoDB: Completed initialization of buffer pool
2020-07-28 11:08:18 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2020-07-28 11:08:18 0 [Note] InnoDB: 128 rollback segments are active.
2020-07-28 11:08:18 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2020-07-28 11:08:18 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2020-07-28 11:08:18 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2020-07-28 11:08:18 0 [Note] InnoDB: 10.5.5 started; log sequence number 47235; transaction id 28
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_CMP' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'THREAD_POOL_WAITS' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'THREAD_POOL_QUEUES' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'FEEDBACK' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'THREAD_POOL_GROUPS' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_MUTEXES' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'user_variables' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'THREAD_POOL_STATS' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'unix_socket' is disabled.
2020-07-28 11:08:18 0 [Note] InnoDB: Loading buffer pool(s) from /dev/shm/var/3/mysqld.1/data/ib_buffer_pool
2020-07-28 11:08:18 0 [Note] InnoDB: Buffer pool(s) load completed at 200728 11:08:18
2020-07-28 11:08:18 0 [Warning] /usr/sbin/mariadbd: unknown variable 'loose-feedback-debug-startup-interval=20'
2020-07-28 11:08:18 0 [Warning] /usr/sbin/mariadbd: unknown variable 'loose-feedback-debug-first-interval=60'
2020-07-28 11:08:18 0 [Warning] /usr/sbin/mariadbd: unknown variable 'loose-feedback-debug-interval=60'
2020-07-28 11:08:18 0 [Warning] /usr/sbin/mariadbd: unknown option '--loose-pam-debug'
2020-07-28 11:08:18 0 [Warning] /usr/sbin/mariadbd: unknown option '--loose-aria'
2020-07-28 11:08:18 0 [Warning] /usr/sbin/mariadbd: unknown variable 'loose-debug-sync-timeout=300'
2020-07-28 11:08:18 0 [Note] Server socket created on IP: '127.0.0.1'.
2020-07-28 11:08:18 0 [Note] Reading of all Master_info entries succeeded
2020-07-28 11:08:18 0 [Note] Added new Master_info '' to hash table
2020-07-28 11:08:18 0 [Note] /usr/sbin/mariadbd: ready for connections.
Version: '10.5.5-MariaDB-1:10.5.5+maria~stretch-log' socket: '/dev/shm/var/tmp/3/mysqld.1.sock' port: 16000 mariadb.org binary distribution
2020-07-28 11:08:18 6 [Note] Deleted Master_info file '/dev/shm/var/3/mysqld.1/data/master.info'.
2020-07-28 11:08:18 6 [Note] Deleted Master_info file '/dev/shm/var/3/mysqld.1/data/relay-log.info'.
2020-07-28 11:08:18 8 [Note] Start binlog_dump to slave_server(2), pos(master-bin.000001, 4), using_gtid(0), gtid('')
2020-07-28 11:08:19 6 [Note] Master connection name: '' Master_info_file: 'master.info' Relay_info_file: 'relay-log.info'
2020-07-28 11:08:19 6 [Note] 'CHANGE MASTER TO executed'. Previous state master_host='', master_port='3306', master_log_file='', master_log_pos='4'. New state master_host='', master_port='3306', master_log_file='', master_log_pos='4'.
200728 11:08:19 [ERROR] mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.

To report this bug, see https://mariadb.com/kb/en/reporting-bugs

We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.

Server version: 10.5.5-MariaDB-1:10.5.5+maria~stretch-log
key_buffer_size=1048576
read_buffer_size=131072
max_used_connections=6
max_threads=153
thread_count=8
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 63579 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.

Thread pointer: 0x3fff300009b8
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0x3fff74227410 thread_stack 0x49000
Printing to addr2line failed
/usr/sbin/mariadbd(my_print_stacktrace+0x68)[0x26ddeba8]
/usr/sbin/mariadbd(handle_fatal_signal+0x444)[0x26680ae4]
linux-vdso64.so.1(__kernel_sigtramp_rt64+0x0)[0x3fff7b6a04d8]
/usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x5d4)[0x265174e4]
/usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x588)[0x26517498]
/usr/sbin/mariadbd(handle_one_connection+0x5c)[0x265179bc]
/usr/sbin/mariadbd(+0xcdff58)[0x2697ff58]
/lib/powerpc64le-linux-gnu/libpthread.so.0(+0x80fc)[0x3fff7b6580fc]
/lib/powerpc64le-linux-gnu/libc.so.6(clone+0x98)[0x3fff7ad21748]

Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (0x0):
Connection ID (thread ID): 11
Status: NOT_KILLED

Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off

The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains
information that should help you find out what is causing the crash.
Writing a core file...
Working directory at /dev/shm/var/3/mysqld.1/data
Resource Limits:
Limit Soft Limit Hard Limit Units
Max cpu time unlimited unlimited seconds
Max file size unlimited unlimited bytes
Max data size unlimited unlimited bytes
Max stack size 8388608 unlimited bytes
Max core file size unlimited unlimited bytes
Max resident set unlimited unlimited bytes
Max processes 24414 24414 processes
Max open files 1024 1024 files
Max locked memory 65536 65536 bytes
Max address space unlimited unlimited bytes
Max file locks unlimited unlimited locks
Max pending signals 24414 24414 signals
Max msgqueue size 819200 819200 bytes
Max nice priority 0 0
Max realtime priority 0 0
Max realtime timeout unlimited unlimited us
Core pattern: core

----------SERVER LOG END-------------
mysqltest failed but provided no output
The result from queries just before the failure was:
< snip >
include/master-slave.inc
[connection master]
connection slave;
SET @old_innodb_thread_concurrency := @@innodb_thread_concurrency;
SET @old_innodb_thread_sleep_delay := @@innodb_thread_sleep_delay;
SET GLOBAL innodb_thread_concurrency = 100;
connection master;
CREATE TABLE t(f INT) ENGINE=INNODB;
INSERT INTO t VALUES (10);
connection slave;
include/diff_tables.inc [master:t, slave:t]
"===== Clean up======="
connection master;
DROP TABLE t;
connection slave;
SET GLOBAL innodb_thread_concurrency = @old_innodb_thread_concurrency;
SET GLOBAL innodb_thread_sleep_delay = @old_innodb_thread_sleep_delay;
include/rpl_end.inc



- found 'core' (1/0)

Trying 'dbx' to get a backtrace

Trying 'gdb' to get a backtrace from coredump /dev/shm/var/3/log/rpl.rpl_sync_with_innodb_thd_conc-innodb,stmt/mysqld.1/data/core
Core generated by '/usr/sbin/mariadbd'
Output from gdb follows. The first stack trace is from the failing thread.
The following stack traces are from all threads (so the failing one is
duplicated).
--------------------------
[New LWP 3854]
[New LWP 3822]
[New LWP 3829]
[New LWP 3825]
[New LWP 3823]
[New LWP 3827]
[New LWP 3828]
[New LWP 3813]
[New LWP 3832]
[New LWP 3833]
[New LWP 3863]
[New LWP 3864]
[New LWP 3858]
[New LWP 3860]
[New LWP 3859]
[New LWP 3831]
[New LWP 3855]
[New LWP 3830]
[New LWP 3849]
[New LWP 3826]
[New LWP 3818]
[New LWP 3819]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/powerpc64le-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/sbin/mariadbd --defaults-group-suffix=.1 --defaults-file=/dev/shm/var/3/my'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0 0x00003fff7b662898 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:55
55 ../sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.
[Current thread is 1 (Thread 0x3fff74227fd0 (LWP 3854))]
#0 0x00003fff7b662898 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:55
#1 0x0000000026dde600 in my_write_core (sig=<optimized out>) at ./mysys/stacktrace.c:518
#2 0x0000000026680b54 in handle_fatal_signal (sig=<optimized out>) at ./sql/signal_handler.cc:330
#3 <signal handler called>
#4 0x00000000265174e4 in ilink::unlink (this=0x100027ddc98, this=0x100027ddc98) at ./sql/sql_list.h:696
#5 ilink::~ilink (this=0x100027ddc98, __in_chrg=<optimized out>) at ./sql/sql_list.h:707
#6 CONNECT::~CONNECT (this=0x100027ddc98, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#7 CONNECT::~CONNECT (this=0x100027ddc98, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#8 do_handle_one_connection (connect=0x100027ddc98, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1436
#9 0x00000000265179bc in handle_one_connection (arg=0x10002bd4458) at ./sql/sql_connect.cc:1312
#10 0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b55488) at ./storage/perfschema/pfs.cc:2201
#11 0x00003fff7b6580fc in start_thread (arg=0x3fff74227fd0) at pthread_create.c:458
#12 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 22 (Thread 0x3fff7522efd0 (LWP 3819)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x27efc120 <COND_checkpoint>, mutex=0x27efc0e8 <LOCK_checkpoint>, abstime=0x3fff7522e378) at pthread_cond_timedwait.c:200
#1 0x00000000268fddb0 in inline_mysql_cond_timedwait (src_file=0x27021ee0 "/home/buildbot/buildbot/build/mariadb-10.5.5/storage/maria/ma_servicethread.c", src_line=116, abstime=<optimized out>, mutex=0x27efc0e8 <LOCK_checkpoint>, that=0x27efc120 <COND_checkpoint>) at ./include/mysql/psi/mysql_thread.h:1257
#2 my_service_thread_sleep (control=0x2763a068 <checkpoint_control>, sleep_time=<optimized out>) at ./storage/maria/ma_servicethread.c:115
#3 0x00000000268f1870 in ma_checkpoint_background (arg=0x1e) at ./storage/maria/ma_checkpoint.c:707
#4 0x000000002697ff58 in pfs_spawn_thread (arg=0x10002421f78) at ./storage/perfschema/pfs.cc:2201
#5 0x00003fff7b6580fc in start_thread (arg=0x3fff7522efd0) at pthread_create.c:458
#6 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 21 (Thread 0x3fff765defd0 (LWP 3818)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x27fc60e0 <COND_timer>, mutex=0x27fc6078 <LOCK_timer>, abstime=0x3fff765de468) at pthread_cond_timedwait.c:200
#1 0x0000000026de5450 in inline_mysql_cond_timedwait (that=0x27fc60e0 <COND_timer>, mutex=0x27fc6078 <LOCK_timer>, src_file=0x27092cd0 "/home/buildbot/buildbot/build/mariadb-10.5.5/mysys/thr_timer.c", src_line=321, abstime=0x3fff765de468) at ./include/mysql/psi/mysql_thread.h:1257
#2 timer_handler (arg=<optimized out>) at ./mysys/thr_timer.c:321
#3 0x000000002697ff58 in pfs_spawn_thread (arg=0x100023760e8) at ./storage/perfschema/pfs.cc:2201
#4 0x00003fff7b6580fc in start_thread (arg=0x3fff765defd0) at pthread_create.c:458
#5 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 20 (Thread 0x3fff6d7befd0 (LWP 3826)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x100024774c0, mutex=0x10002467ac0, abstime=0x3fff6d7be410) at pthread_cond_timedwait.c:200
#1 0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff6d7be410, __mutex=<optimized out>, __cond=0x100024774c0) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2 std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024774c0) at /usr/include/c++/6/condition_variable:166
#3 std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024774c0) at /usr/include/c++/6/condition_variable:106
#4 std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x100024774c0) at /usr/include/c++/6/condition_variable:138
#5 tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x100024774c0) at ./tpool/tpool_generic.cc:418
#6 0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x100024774c0, t=0x3fff6d7be4f8) at ./tpool/tpool_generic.cc:471
#7 0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x100024774c0) at ./tpool/tpool_generic.cc:516
#8 0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9 std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::)(tpool::worker_data), true>::operator()<tpool::thread_pool_generic, tpool::worker_data>(tpool::thread_pool_generic&&, tpool::worker_data&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff6d7befd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 19 (Thread 0x3fff74297fd0 (LWP 3849)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x276c7498 <thread_cache>, mutex=0x276c7508 <thread_cache+112>, abstime=0x3fff74297418) at pthread_cond_timedwait.c:200
#1 0x0000000026517670 in inline_mysql_cond_timedwait (src_file=0x26ec4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff74297418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2 Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3 do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4 0x00000000265179bc in handle_one_connection (arg=0x10002bd4458) at ./sql/sql_connect.cc:1312
#5 0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b55488) at ./storage/perfschema/pfs.cc:2201
#6 0x00003fff7b6580fc in start_thread (arg=0x3fff74297fd0) at pthread_create.c:458
#7 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 18 (Thread 0x3fff4fffefd0 (LWP 3830)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x10002477340, mutex=0x10002467ac0, abstime=0x3fff4fffe410) at pthread_cond_timedwait.c:200
#1 0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff4fffe410, __mutex=<optimized out>, __cond=0x10002477340) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2 std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477340) at /usr/include/c++/6/condition_variable:166
#3 std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477340) at /usr/include/c++/6/condition_variable:106
#4 std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x10002477340) at /usr/include/c++/6/condition_variable:138
#5 tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x10002477340) at ./tpool/tpool_generic.cc:418
#6 0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x10002477340, t=0x3fff4fffe4f8) at ./tpool/tpool_generic.cc:471
#7 0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x10002477340) at ./tpool/tpool_generic.cc:516
#8 0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9 std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::)(tpool::worker_data), true>::operator()<tpool::thread_pool_generic, tpool::worker_data>(tpool::thread_pool_generic&&, tpool::worker_data&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff4fffefd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 17 (Thread 0x3fff741b7fd0 (LWP 3855)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x276c7498 <thread_cache>, mutex=0x276c7508 <thread_cache+112>, abstime=0x3fff741b7418) at pthread_cond_timedwait.c:200
#1 0x0000000026517670 in inline_mysql_cond_timedwait (src_file=0x26ec4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff741b7418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2 Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3 do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4 0x00000000265179bc in handle_one_connection (arg=0x10002bd4458) at ./sql/sql_connect.cc:1312
#5 0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b55488) at ./storage/perfschema/pfs.cc:2201
#6 0x00003fff7b6580fc in start_thread (arg=0x3fff741b7fd0) at pthread_create.c:458
#7 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 16 (Thread 0x3fff4f7eefd0 (LWP 3831)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x100024772c0, mutex=0x10002467ac0, abstime=0x3fff4f7ee410) at pthread_cond_timedwait.c:200
#1 0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff4f7ee410, __mutex=<optimized out>, __cond=0x100024772c0) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2 std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024772c0) at /usr/include/c++/6/condition_variable:166
#3 std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024772c0) at /usr/include/c++/6/condition_variable:106
#4 std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x100024772c0) at /usr/include/c++/6/condition_variable:138
#5 tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x100024772c0) at ./tpool/tpool_generic.cc:418
#6 0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x100024772c0, t=0x3fff4f7ee4f8) at ./tpool/tpool_generic.cc:471
#7 0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x100024772c0) at ./tpool/tpool_generic.cc:516
#8 0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9 std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::)(tpool::worker_data), true>::operator()<tpool::thread_pool_generic, tpool::worker_data>(tpool::thread_pool_generic&&, tpool::worker_data&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff4f7eefd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 15 (Thread 0x3fff740d7fd0 (LWP 3859)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x276c7498 <thread_cache>, mutex=0x276c7508 <thread_cache+112>, abstime=0x3fff740d7418) at pthread_cond_timedwait.c:200
#1 0x0000000026517670 in inline_mysql_cond_timedwait (src_file=0x26ec4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff740d7418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2 Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3 do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4 0x00000000265179bc in handle_one_connection (arg=0x100027ddc98) at ./sql/sql_connect.cc:1312
#5 0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b55488) at ./storage/perfschema/pfs.cc:2201
#6 0x00003fff7b6580fc in start_thread (arg=0x3fff740d7fd0) at pthread_create.c:458
#7 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 14 (Thread 0x3fff74067fd0 (LWP 3860)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x276c7498 <thread_cache>, mutex=0x276c7508 <thread_cache+112>, abstime=0x3fff74067418) at pthread_cond_timedwait.c:200
#1 0x0000000026517670 in inline_mysql_cond_timedwait (src_file=0x26ec4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff74067418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2 Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3 do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4 0x00000000265179bc in handle_one_connection (arg=0x100027ddc98) at ./sql/sql_connect.cc:1312
#5 0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b55488) at ./storage/perfschema/pfs.cc:2201
#6 0x00003fff7b6580fc in start_thread (arg=0x3fff74067fd0) at pthread_create.c:458
#7 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 13 (Thread 0x3fff74147fd0 (LWP 3858)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x276f9d00 <mysql_bin_log+1360>, mutex=0x276f9c30 <mysql_bin_log+1152>, abstime=0x3fff74143660) at pthread_cond_timedwait.c:200
#1 0x00000000267d1310 in inline_mysql_cond_timedwait (src_file=0x27014448 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/log.cc", src_line=8669, abstime=0x3fff74143660, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2 MYSQL_BIN_LOG::wait_for_update_binlog_end_pos (this=0x276f97b0 <mysql_bin_log>, thd=0x3fff280009b8, timeout=0x3fff74143660) at ./sql/log.cc:8669
#3 0x0000000026418374 in wait_new_events (end_pos_ptr=<synthetic pointer>, binlog_end_pos_filename=0x3fff741436d8 "./master-bin.000001", linfo=<optimized out>, info=<optimized out>) at ./sql/sql_repl.cc:2508
#4 get_binlog_end_pos (info=0x3fff74145058, log=0x3fff74143f60, linfo=0x3fff74144e38) at ./sql/sql_repl.cc:2628
#5 0x000000002641af58 in send_one_binlog_file (start_pos=<optimized out>, linfo=0x3fff74144e38, log=0x3fff74143f60, info=0x3fff74145058) at ./sql/sql_repl.cc:2788
#6 mysql_binlog_send (thd=0x3fff280009b8, log_ident=<optimized out>, pos=<optimized out>, flags=<optimized out>) at ./sql/sql_repl.cc:2933
#7 0x00000000263ede30 in dispatch_command (command=<optimized out>, thd=0x3fff280009b8, packet=0x3fff28007ea9 "", packet_length=<optimized out>, is_com_multi=<optimized out>, is_next_command=<optimized out>) at ./sql/sql_parse.cc:2128
#8 0x00000000263eb570 in do_command (thd=0x3fff280009b8) at ./sql/sql_parse.cc:1348
#9 0x00000000265172b4 in do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1410
#10 0x00000000265179bc in handle_one_connection (arg=0x100027ddc98) at ./sql/sql_connect.cc:1312
#11 0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b55488) at ./storage/perfschema/pfs.cc:2201
#12 0x00003fff7b6580fc in start_thread (arg=0x3fff74147fd0) at pthread_create.c:458
#13 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 12 (Thread 0x3fff4e7cefd0 (LWP 3864)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x100024771c0, mutex=0x10002467ac0, abstime=0x3fff4e7ce410) at pthread_cond_timedwait.c:200
#1 0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff4e7ce410, __mutex=<optimized out>, __cond=0x100024771c0) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2 std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024771c0) at /usr/include/c++/6/condition_variable:166
#3 std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024771c0) at /usr/include/c++/6/condition_variable:106
#4 std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x100024771c0) at /usr/include/c++/6/condition_variable:138
#5 tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x100024771c0) at ./tpool/tpool_generic.cc:418
#6 0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x100024771c0, t=0x3fff4e7ce4f8) at ./tpool/tpool_generic.cc:471
#7 0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x100024771c0) at ./tpool/tpool_generic.cc:516
#8 0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9 std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::)(tpool::worker_data), true>::operator()<tpool::thread_pool_generic, tpool::worker_data>(tpool::thread_pool_generic&&, tpool::worker_data&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff4e7cefd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 11 (Thread 0x3fff4efdefd0 (LWP 3863)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x10002477240, mutex=0x10002467ac0, abstime=0x3fff4efde410) at pthread_cond_timedwait.c:200
#1 0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff4efde410, __mutex=<optimized out>, __cond=0x10002477240) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2 std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477240) at /usr/include/c++/6/condition_variable:166
#3 std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477240) at /usr/include/c++/6/condition_variable:106
#4 std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x10002477240) at /usr/include/c++/6/condition_variable:138
#5 tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x10002477240) at ./tpool/tpool_generic.cc:418
#6 0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x10002477240, t=0x3fff4efde4f8) at ./tpool/tpool_generic.cc:471
#7 0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x10002477240) at ./tpool/tpool_generic.cc:516
#8 0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9 std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::)(tpool::worker_data), true>::operator()<tpool::thread_pool_generic, tpool::worker_data>(tpool::thread_pool_generic&&, tpool::worker_data&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff4efdefd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 10 (Thread 0x3fff74307fd0 (LWP 3833)):
#0 0x00003fff7b660ca4 in __pthread_cond_wait (cond=0x276c7440 <COND_slave_background>, mutex=0x276c4ab8 <LOCK_slave_background>) at pthread_cond_wait.c:188
#1 0x0000000026315fa0 in inline_mysql_cond_wait (that=<optimized out>, mutex=<optimized out>, src_file=0x26ecf620 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/slave.cc", src_line=525) at ./include/mysql/psi/mysql_thread.h:1220
#2 handle_slave_background (arg=<optimized out>) at ./sql/slave.cc:525
#3 0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b24e48) at ./storage/perfschema/pfs.cc:2201
#4 0x00003fff7b6580fc in start_thread (arg=0x3fff74307fd0) at pthread_create.c:458
#5 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 9 (Thread 0x3fff74377fd0 (LWP 3832)):
#0 0x00003fff7ac4d628 in __GI___sigwaitinfo (set=<optimized out>, info=0x3fff74377450) at ../sysdeps/unix/sysv/linux/sigwaitinfo.c:56
#1 0x00000000262ec15c in my_sigwait (code=<synthetic pointer>, sig=0x3fff743773c8, set=0x3fff743773d0) at ./include/my_pthread.h:196
#2 signal_hand (arg=<optimized out>) at ./sql/mysqld.cc:2987
#3 0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b38828) at ./storage/perfschema/pfs.cc:2201
#4 0x00003fff7b6580fc in start_thread (arg=0x3fff74377fd0) at pthread_create.c:458
#5 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 8 (Thread 0x3fff7b70a4f0 (LWP 3813)):
#0 0x00003fff7ad14238 in poll () at ../sysdeps/unix/syscall-template.S:84
#1 0x00003fff7ad3a634 in __poll_chk (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>, fdslen=<optimized out>) at poll_chk.c:27
#2 0x00000000262f6e20 in poll (__timeout=-1, __nfds=2, __fds=0x3fffd2ed6300) at /usr/include/powerpc64le-linux-gnu/bits/poll2.h:41
#3 handle_connections_sockets () at ./sql/mysqld.cc:6217
#4 0x00000000262f83f8 in mysqld_main (argc=<optimized out>, argv=<optimized out>) at ./sql/mysqld.cc:5666
#5 0x00000000262b55e0 in main (argc=<optimized out>, argv=<optimized out>) at ./sql/main.cc:25

Thread 7 (Thread 0x3fff743e7fd0 (LWP 3828)):
#0 0x00003fff7b660ca4 in __pthread_cond_wait (cond=0x276fa450 <mysql_bin_log+3232>, mutex=0x276fa420 <mysql_bin_log+3184>) at pthread_cond_wait.c:188
#1 0x00000000267d6b90 in inline_mysql_cond_wait (that=0x276fa450 <mysql_bin_log+3232>, mutex=0x276fa420 <mysql_bin_log+3184>, src_file=0x27014448 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/log.cc", src_line=10271) at ./include/mysql/psi/mysql_thread.h:1220
#2 binlog_background_thread (arg=<optimized out>) at ./sql/log.cc:10271
#3 0x000000002697ff58 in pfs_spawn_thread (arg=0x10002386258) at ./storage/perfschema/pfs.cc:2201
#4 0x00003fff7b6580fc in start_thread (arg=0x3fff743e7fd0) at pthread_create.c:458
#5 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 6 (Thread 0x3fff6e7defd0 (LWP 3827)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x10002477440, mutex=0x10002467ac0, abstime=0x3fff6e7de410) at pthread_cond_timedwait.c:200
#1 0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff6e7de410, __mutex=<optimized out>, __cond=0x10002477440) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2 std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477440) at /usr/include/c++/6/condition_variable:166
#3 std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477440) at /usr/include/c++/6/condition_variable:106
#4 std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x10002477440) at /usr/include/c++/6/condition_variable:138
#5 tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x10002477440) at ./tpool/tpool_generic.cc:418
#6 0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x10002477440, t=0x3fff6e7de4f8) at ./tpool/tpool_generic.cc:471
#7 0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x10002477440) at ./tpool/tpool_generic.cc:516
#8 0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9 std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::)(tpool::worker_data), true>::operator()<tpool::thread_pool_generic, tpool::worker_data>(tpool::thread_pool_generic&&, tpool::worker_data&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff6e7defd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 5 (Thread 0x3fff6efeefd0 (LWP 3823)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x1000248c0a0, mutex=0x1000248c078, abstime=0x3fff6efedef0) at pthread_cond_timedwait.c:200
#1 0x0000000026aee128 in os_event::timed_wait (this=<error reading variable: value has been optimized out>, abstime=<optimized out>) at ./storage/innobase/os/os0event.cc:275
#2 0x0000000026aee448 in os_event::wait_time_low (this=0x1000248c068, time_in_usec=<optimized out>, reset_sig_count=<optimized out>) at ./storage/innobase/os/os0event.cc:385
#3 0x0000000026c5b02c in pc_sleep_if_needed (cur_time=954929, sig_count=2, next_loop_time=955929) at ./storage/innobase/buf/buf0flu.cc:2305
#4 buf_flush_page_cleaner () at ./storage/innobase/buf/buf0flu.cc:2587
#5 0x00003fff7b6580fc in start_thread (arg=0x3fff6efeefd0) at pthread_create.c:458
#6 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 4 (Thread 0x3fff6dfcefd0 (LWP 3825)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x10002477540, mutex=0x10002467ac0, abstime=0x3fff6dfce410) at pthread_cond_timedwait.c:200
#1 0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff6dfce410, __mutex=<optimized out>, __cond=0x10002477540) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2 std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477540) at /usr/include/c++/6/condition_variable:166
#3 std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477540) at /usr/include/c++/6/condition_variable:106
#4 std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x10002477540) at /usr/include/c++/6/condition_variable:138
#5 tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x10002477540) at ./tpool/tpool_generic.cc:418
#6 0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x10002477540, t=0x3fff6dfce4f8) at ./tpool/tpool_generic.cc:471
#7 0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x10002477540) at ./tpool/tpool_generic.cc:516
#8 0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9 std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::)(tpool::worker_data), true>::operator()<tpool::thread_pool_generic, tpool::worker_data>(tpool::thread_pool_generic&&, tpool::worker_data&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff6dfcefd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 3 (Thread 0x3fff6cfaefd0 (LWP 3829)):
#0 0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x100024773c0, mutex=0x10002467ac0, abstime=0x3fff6cfae410) at pthread_cond_timedwait.c:200
#1 0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff6cfae410, __mutex=<optimized out>, __cond=0x100024773c0) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2 std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024773c0) at /usr/include/c++/6/condition_variable:166
#3 std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024773c0) at /usr/include/c++/6/condition_variable:106
#4 std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x100024773c0) at /usr/include/c++/6/condition_variable:138
#5 tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x100024773c0) at ./tpool/tpool_generic.cc:418
#6 0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x100024773c0, t=0x3fff6cfae4f8) at ./tpool/tpool_generic.cc:471
#7 0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x100024773c0) at ./tpool/tpool_generic.cc:516
#8 0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9 std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data), tpool::thread_pool_generic, tpool::worker_data>(void (tpool::thread_pool_generic:: const&)(tpool::worker_data), tpool::thread_pool_generic&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::)(tpool::worker_data), true>::operator()<tpool::thread_pool_generic, tpool::worker_data>(tpool::thread_pool_generic&&, tpool::worker_data&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::)(tpool::worker_data)> (tpool::thread_pool_generic, tpool::worker_data)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff6cfaefd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 2 (Thread 0x3fff6fffefd0 (LWP 3822)):
#0 0x00003fff7b4407f8 in ?? () from /lib/powerpc64le-linux-gnu/libaio.so.1
#1 0x00003fff7b440860 in io_getevents () from /lib/powerpc64le-linux-gnu/libaio.so.1
#2 0x0000000026d4f488 in tpool::aio_linux::getevent_thread_routine (aio=0x10002422110) at ./tpool/aio_linux.cc:53
#3 0x0000000026d4f3e0 in std::_Bind_simple<void ((tpool::aio_linux))(tpool::aio_linux*)>::_M_invoke<0ul>(std::_Index_tuple<0ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#4 std::_Bind_simple<void ((tpool::aio_linux))(tpool::aio_linux*)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#5 std::thread::_State_impl<std::_Bind_simple<void ((tpool::aio_linux))(tpool::aio_linux*)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#6 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#7 0x00003fff7b6580fc in start_thread (arg=0x3fff6fffefd0) at pthread_create.c:458
#8 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Thread 1 (Thread 0x3fff74227fd0 (LWP 3854)):
#0 0x00003fff7b662898 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:55
#1 0x0000000026dde600 in my_write_core (sig=<optimized out>) at ./mysys/stacktrace.c:518
#2 0x0000000026680b54 in handle_fatal_signal (sig=<optimized out>) at ./sql/signal_handler.cc:330
#3 <signal handler called>
#4 0x00000000265174e4 in ilink::unlink (this=0x100027ddc98, this=0x100027ddc98) at ./sql/sql_list.h:696
#5 ilink::~ilink (this=0x100027ddc98, __in_chrg=<optimized out>) at ./sql/sql_list.h:707
#6 CONNECT::~CONNECT (this=0x100027ddc98, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#7 CONNECT::~CONNECT (this=0x100027ddc98, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#8 do_handle_one_connection (connect=0x100027ddc98, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1436
#9 0x00000000265179bc in handle_one_connection (arg=0x10002bd4458) at ./sql/sql_connect.cc:1312
#10 0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b55488) at ./storage/perfschema/pfs.cc:2201
#11 0x00003fff7b6580fc in start_thread (arg=0x3fff74227fd0) at pthread_create.c:458
#12 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Compressed file /dev/shm/var/3/log/rpl.rpl_sync_with_innodb_thd_conc-innodb,stmt/mysqld.1/data/core
- skipping '/dev/shm/var/3/log/rpl.rpl_sync_with_innodb_thd_conc-innodb,stmt/'

Attachments

Activity

People

Assignee:: Oleksandr Byelkin

Reporter:: Elena Stepanova

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 2020-08-06 22:40

Updated:: 2021-02-16 13:34

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.