[MDEV-23420] rpl.rpl_sync_with_innodb_thd_conc failed in buildbot, server crashed in ilink::unlink Created: 2020-08-06  Updated: 2021-02-16

Status: Open
Project: MariaDB Server
Component/s: Server, Tests
Affects Version/s: 10.5
Fix Version/s: 10.5

Type: Bug Priority: Major
Reporter: Elena Stepanova Assignee: Oleksandr Byelkin
Resolution: Unresolved Votes: 0
Labels: None


 Description   

http://buildbot.askmonty.org/buildbot/builders/kvm-deb-stretch-ppc64le/builds/6702

10.5 05fa4558e0e

rpl.rpl_sync_with_innodb_thd_conc 'innodb,stmt' w3 [ fail ]
        Test ended at 2020-07-28 11:08:19
 
CURRENT_TEST: rpl.rpl_sync_with_innodb_thd_conc
 
 
The server [mysqld.1 - pid: 3812, winpid: 3812, exit: 256] crashed while running 'check warnings'
Server log from this test:
----------SERVER LOG START-----------
2020-07-28 11:08:18 0 [Note] /usr/sbin/mariadbd (mysqld 10.5.5-MariaDB-1:10.5.5+maria~stretch-log) starting as process 3813 ...
2020-07-28 11:08:18 0 [Warning] Could not increase number of max_open_files to more than 1024 (request: 32186)
2020-07-28 11:08:18 0 [Warning] Changed limits: max_open_files: 1024  max_connections: 151 (was 151)  table_cache: 421 (was 2000)
2020-07-28 11:08:18 0 [Note] Plugin 'partition' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'SEQUENCE' is disabled.
2020-07-28 11:08:18 0 [Note] InnoDB: Using Linux native AIO
2020-07-28 11:08:18 0 [Note] InnoDB: Uses event mutexes
2020-07-28 11:08:18 0 [Note] InnoDB: Compressed tables use zlib 1.2.8
2020-07-28 11:08:18 0 [Note] InnoDB: Number of pools: 1
2020-07-28 11:08:18 0 [Note] InnoDB: Using POWER8 crc32 instructions
2020-07-28 11:08:18 0 [Note] mariadbd: O_TMPFILE is not supported on /dev/shm/var/tmp/3/mysqld.1 (disabling future attempts)
2020-07-28 11:08:18 0 [Note] InnoDB: Initializing buffer pool, total size = 8388608, chunk size = 8388608
2020-07-28 11:08:18 0 [Note] InnoDB: Completed initialization of buffer pool
2020-07-28 11:08:18 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2020-07-28 11:08:18 0 [Note] InnoDB: 128 rollback segments are active.
2020-07-28 11:08:18 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2020-07-28 11:08:18 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2020-07-28 11:08:18 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2020-07-28 11:08:18 0 [Note] InnoDB: 10.5.5 started; log sequence number 47235; transaction id 28
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_SYS_DATAFILES' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_SYS_TABLESTATS' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_CMP' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'THREAD_POOL_WAITS' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_CMP_RESET' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'THREAD_POOL_QUEUES' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'FEEDBACK' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_FT_INDEX_TABLE' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'THREAD_POOL_GROUPS' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_CMP_PER_INDEX_RESET' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_FT_INDEX_CACHE' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_FT_BEING_DELETED' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_CMPMEM_RESET' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_FT_DEFAULT_STOPWORD' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_FT_CONFIG' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_SYS_TABLESPACES' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_SYS_SEMAPHORE_WAITS' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_MUTEXES' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'user_variables' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_TABLESPACES_ENCRYPTION' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'INNODB_FT_DELETED' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'THREAD_POOL_STATS' is disabled.
2020-07-28 11:08:18 0 [Note] Plugin 'unix_socket' is disabled.
2020-07-28 11:08:18 0 [Note] InnoDB: Loading buffer pool(s) from /dev/shm/var/3/mysqld.1/data/ib_buffer_pool
2020-07-28 11:08:18 0 [Note] InnoDB: Buffer pool(s) load completed at 200728 11:08:18
2020-07-28 11:08:18 0 [Warning] /usr/sbin/mariadbd: unknown variable 'loose-feedback-debug-startup-interval=20'
2020-07-28 11:08:18 0 [Warning] /usr/sbin/mariadbd: unknown variable 'loose-feedback-debug-first-interval=60'
2020-07-28 11:08:18 0 [Warning] /usr/sbin/mariadbd: unknown variable 'loose-feedback-debug-interval=60'
2020-07-28 11:08:18 0 [Warning] /usr/sbin/mariadbd: unknown option '--loose-pam-debug'
2020-07-28 11:08:18 0 [Warning] /usr/sbin/mariadbd: unknown option '--loose-aria'
2020-07-28 11:08:18 0 [Warning] /usr/sbin/mariadbd: unknown variable 'loose-debug-sync-timeout=300'
2020-07-28 11:08:18 0 [Note] Server socket created on IP: '127.0.0.1'.
2020-07-28 11:08:18 0 [Note] Reading of all Master_info entries succeeded
2020-07-28 11:08:18 0 [Note] Added new Master_info '' to hash table
2020-07-28 11:08:18 0 [Note] /usr/sbin/mariadbd: ready for connections.
Version: '10.5.5-MariaDB-1:10.5.5+maria~stretch-log'  socket: '/dev/shm/var/tmp/3/mysqld.1.sock'  port: 16000  mariadb.org binary distribution
2020-07-28 11:08:18 6 [Note] Deleted Master_info file '/dev/shm/var/3/mysqld.1/data/master.info'.
2020-07-28 11:08:18 6 [Note] Deleted Master_info file '/dev/shm/var/3/mysqld.1/data/relay-log.info'.
2020-07-28 11:08:18 8 [Note] Start binlog_dump to slave_server(2), pos(master-bin.000001, 4), using_gtid(0), gtid('')
2020-07-28 11:08:19 6 [Note] Master connection name: ''  Master_info_file: 'master.info'  Relay_info_file: 'relay-log.info'
2020-07-28 11:08:19 6 [Note] 'CHANGE MASTER TO executed'. Previous state master_host='', master_port='3306', master_log_file='', master_log_pos='4'. New state master_host='', master_port='3306', master_log_file='', master_log_pos='4'.
200728 11:08:19 [ERROR] mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
Server version: 10.5.5-MariaDB-1:10.5.5+maria~stretch-log
key_buffer_size=1048576
read_buffer_size=131072
max_used_connections=6
max_threads=153
thread_count=8
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 63579 K  bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
 
Thread pointer: 0x3fff300009b8
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0x3fff74227410 thread_stack 0x49000
Printing to addr2line failed
/usr/sbin/mariadbd(my_print_stacktrace+0x68)[0x26ddeba8]
/usr/sbin/mariadbd(handle_fatal_signal+0x444)[0x26680ae4]
linux-vdso64.so.1(__kernel_sigtramp_rt64+0x0)[0x3fff7b6a04d8]
/usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x5d4)[0x265174e4]
/usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x588)[0x26517498]
/usr/sbin/mariadbd(handle_one_connection+0x5c)[0x265179bc]
/usr/sbin/mariadbd(+0xcdff58)[0x2697ff58]
/lib/powerpc64le-linux-gnu/libpthread.so.0(+0x80fc)[0x3fff7b6580fc]
/lib/powerpc64le-linux-gnu/libc.so.6(clone+0x98)[0x3fff7ad21748]
 
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (0x0): 
Connection ID (thread ID): 11
Status: NOT_KILLED
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off
 
The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains
information that should help you find out what is causing the crash.
Writing a core file...
Working directory at /dev/shm/var/3/mysqld.1/data
Resource Limits:
Limit                     Soft Limit           Hard Limit           Units     
Max cpu time              unlimited            unlimited            seconds   
Max file size             unlimited            unlimited            bytes     
Max data size             unlimited            unlimited            bytes     
Max stack size            8388608              unlimited            bytes     
Max core file size        unlimited            unlimited            bytes     
Max resident set          unlimited            unlimited            bytes     
Max processes             24414                24414                processes 
Max open files            1024                 1024                 files     
Max locked memory         65536                65536                bytes     
Max address space         unlimited            unlimited            bytes     
Max file locks            unlimited            unlimited            locks     
Max pending signals       24414                24414                signals   
Max msgqueue size         819200               819200               bytes     
Max nice priority         0                    0                    
Max realtime priority     0                    0                    
Max realtime timeout      unlimited            unlimited            us        
Core pattern: core
 
----------SERVER LOG END-------------
mysqltest failed but provided no output
The result from queries just before the failure was:
< snip >
include/master-slave.inc
[connection master]
connection slave;
SET @old_innodb_thread_concurrency := @@innodb_thread_concurrency;
SET @old_innodb_thread_sleep_delay := @@innodb_thread_sleep_delay;
SET GLOBAL innodb_thread_concurrency = 100;
connection master;
CREATE TABLE t(f INT) ENGINE=INNODB;
INSERT INTO t VALUES (10);
connection slave;
include/diff_tables.inc [master:t, slave:t]
"===== Clean up======="
connection master;
DROP TABLE t;
connection slave;
SET GLOBAL innodb_thread_concurrency = @old_innodb_thread_concurrency;
SET GLOBAL innodb_thread_sleep_delay = @old_innodb_thread_sleep_delay;
include/rpl_end.inc
 
 
 
 - found 'core' (1/0)
 
Trying 'dbx' to get a backtrace
 
Trying 'gdb' to get a backtrace from coredump /dev/shm/var/3/log/rpl.rpl_sync_with_innodb_thd_conc-innodb,stmt/mysqld.1/data/core
Core generated by '/usr/sbin/mariadbd'
Output from gdb follows. The first stack trace is from the failing thread.
The following stack traces are from all threads (so the failing one is
duplicated).
--------------------------
[New LWP 3854]
[New LWP 3822]
[New LWP 3829]
[New LWP 3825]
[New LWP 3823]
[New LWP 3827]
[New LWP 3828]
[New LWP 3813]
[New LWP 3832]
[New LWP 3833]
[New LWP 3863]
[New LWP 3864]
[New LWP 3858]
[New LWP 3860]
[New LWP 3859]
[New LWP 3831]
[New LWP 3855]
[New LWP 3830]
[New LWP 3849]
[New LWP 3826]
[New LWP 3818]
[New LWP 3819]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/powerpc64le-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/sbin/mariadbd --defaults-group-suffix=.1 --defaults-file=/dev/shm/var/3/my'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x00003fff7b662898 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:55
55	../sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.
[Current thread is 1 (Thread 0x3fff74227fd0 (LWP 3854))]
#0  0x00003fff7b662898 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:55
#1  0x0000000026dde600 in my_write_core (sig=<optimized out>) at ./mysys/stacktrace.c:518
#2  0x0000000026680b54 in handle_fatal_signal (sig=<optimized out>) at ./sql/signal_handler.cc:330
#3  <signal handler called>
#4  0x00000000265174e4 in ilink::unlink (this=0x100027ddc98, this=0x100027ddc98) at ./sql/sql_list.h:696
#5  ilink::~ilink (this=0x100027ddc98, __in_chrg=<optimized out>) at ./sql/sql_list.h:707
#6  CONNECT::~CONNECT (this=0x100027ddc98, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#7  CONNECT::~CONNECT (this=0x100027ddc98, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#8  do_handle_one_connection (connect=0x100027ddc98, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1436
#9  0x00000000265179bc in handle_one_connection (arg=0x10002bd4458) at ./sql/sql_connect.cc:1312
#10 0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b55488) at ./storage/perfschema/pfs.cc:2201
#11 0x00003fff7b6580fc in start_thread (arg=0x3fff74227fd0) at pthread_create.c:458
#12 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 22 (Thread 0x3fff7522efd0 (LWP 3819)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x27efc120 <COND_checkpoint>, mutex=0x27efc0e8 <LOCK_checkpoint>, abstime=0x3fff7522e378) at pthread_cond_timedwait.c:200
#1  0x00000000268fddb0 in inline_mysql_cond_timedwait (src_file=0x27021ee0 "/home/buildbot/buildbot/build/mariadb-10.5.5/storage/maria/ma_servicethread.c", src_line=116, abstime=<optimized out>, mutex=0x27efc0e8 <LOCK_checkpoint>, that=0x27efc120 <COND_checkpoint>) at ./include/mysql/psi/mysql_thread.h:1257
#2  my_service_thread_sleep (control=0x2763a068 <checkpoint_control>, sleep_time=<optimized out>) at ./storage/maria/ma_servicethread.c:115
#3  0x00000000268f1870 in ma_checkpoint_background (arg=0x1e) at ./storage/maria/ma_checkpoint.c:707
#4  0x000000002697ff58 in pfs_spawn_thread (arg=0x10002421f78) at ./storage/perfschema/pfs.cc:2201
#5  0x00003fff7b6580fc in start_thread (arg=0x3fff7522efd0) at pthread_create.c:458
#6  0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 21 (Thread 0x3fff765defd0 (LWP 3818)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x27fc60e0 <COND_timer>, mutex=0x27fc6078 <LOCK_timer>, abstime=0x3fff765de468) at pthread_cond_timedwait.c:200
#1  0x0000000026de5450 in inline_mysql_cond_timedwait (that=0x27fc60e0 <COND_timer>, mutex=0x27fc6078 <LOCK_timer>, src_file=0x27092cd0 "/home/buildbot/buildbot/build/mariadb-10.5.5/mysys/thr_timer.c", src_line=321, abstime=0x3fff765de468) at ./include/mysql/psi/mysql_thread.h:1257
#2  timer_handler (arg=<optimized out>) at ./mysys/thr_timer.c:321
#3  0x000000002697ff58 in pfs_spawn_thread (arg=0x100023760e8) at ./storage/perfschema/pfs.cc:2201
#4  0x00003fff7b6580fc in start_thread (arg=0x3fff765defd0) at pthread_create.c:458
#5  0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 20 (Thread 0x3fff6d7befd0 (LWP 3826)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x100024774c0, mutex=0x10002467ac0, abstime=0x3fff6d7be410) at pthread_cond_timedwait.c:200
#1  0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff6d7be410, __mutex=<optimized out>, __cond=0x100024774c0) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2  std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024774c0) at /usr/include/c++/6/condition_variable:166
#3  std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024774c0) at /usr/include/c++/6/condition_variable:106
#4  std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x100024774c0) at /usr/include/c++/6/condition_variable:138
#5  tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x100024774c0) at ./tpool/tpool_generic.cc:418
#6  0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x100024774c0, t=0x3fff6d7be4f8) at ./tpool/tpool_generic.cc:471
#7  0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x100024774c0) at ./tpool/tpool_generic.cc:516
#8  0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9  std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::*)(tpool::worker_data*), true>::operator()<tpool::thread_pool_generic*, tpool::worker_data*>(tpool::thread_pool_generic*&&, tpool::worker_data*&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff6d7befd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 19 (Thread 0x3fff74297fd0 (LWP 3849)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x276c7498 <thread_cache>, mutex=0x276c7508 <thread_cache+112>, abstime=0x3fff74297418) at pthread_cond_timedwait.c:200
#1  0x0000000026517670 in inline_mysql_cond_timedwait (src_file=0x26ec4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff74297418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2  Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3  do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4  0x00000000265179bc in handle_one_connection (arg=0x10002bd4458) at ./sql/sql_connect.cc:1312
#5  0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b55488) at ./storage/perfschema/pfs.cc:2201
#6  0x00003fff7b6580fc in start_thread (arg=0x3fff74297fd0) at pthread_create.c:458
#7  0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 18 (Thread 0x3fff4fffefd0 (LWP 3830)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x10002477340, mutex=0x10002467ac0, abstime=0x3fff4fffe410) at pthread_cond_timedwait.c:200
#1  0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff4fffe410, __mutex=<optimized out>, __cond=0x10002477340) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2  std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477340) at /usr/include/c++/6/condition_variable:166
#3  std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477340) at /usr/include/c++/6/condition_variable:106
#4  std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x10002477340) at /usr/include/c++/6/condition_variable:138
#5  tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x10002477340) at ./tpool/tpool_generic.cc:418
#6  0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x10002477340, t=0x3fff4fffe4f8) at ./tpool/tpool_generic.cc:471
#7  0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x10002477340) at ./tpool/tpool_generic.cc:516
#8  0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9  std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::*)(tpool::worker_data*), true>::operator()<tpool::thread_pool_generic*, tpool::worker_data*>(tpool::thread_pool_generic*&&, tpool::worker_data*&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff4fffefd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 17 (Thread 0x3fff741b7fd0 (LWP 3855)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x276c7498 <thread_cache>, mutex=0x276c7508 <thread_cache+112>, abstime=0x3fff741b7418) at pthread_cond_timedwait.c:200
#1  0x0000000026517670 in inline_mysql_cond_timedwait (src_file=0x26ec4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff741b7418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2  Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3  do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4  0x00000000265179bc in handle_one_connection (arg=0x10002bd4458) at ./sql/sql_connect.cc:1312
#5  0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b55488) at ./storage/perfschema/pfs.cc:2201
#6  0x00003fff7b6580fc in start_thread (arg=0x3fff741b7fd0) at pthread_create.c:458
#7  0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 16 (Thread 0x3fff4f7eefd0 (LWP 3831)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x100024772c0, mutex=0x10002467ac0, abstime=0x3fff4f7ee410) at pthread_cond_timedwait.c:200
#1  0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff4f7ee410, __mutex=<optimized out>, __cond=0x100024772c0) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2  std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024772c0) at /usr/include/c++/6/condition_variable:166
#3  std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024772c0) at /usr/include/c++/6/condition_variable:106
#4  std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x100024772c0) at /usr/include/c++/6/condition_variable:138
#5  tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x100024772c0) at ./tpool/tpool_generic.cc:418
#6  0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x100024772c0, t=0x3fff4f7ee4f8) at ./tpool/tpool_generic.cc:471
#7  0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x100024772c0) at ./tpool/tpool_generic.cc:516
#8  0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9  std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::*)(tpool::worker_data*), true>::operator()<tpool::thread_pool_generic*, tpool::worker_data*>(tpool::thread_pool_generic*&&, tpool::worker_data*&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff4f7eefd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 15 (Thread 0x3fff740d7fd0 (LWP 3859)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x276c7498 <thread_cache>, mutex=0x276c7508 <thread_cache+112>, abstime=0x3fff740d7418) at pthread_cond_timedwait.c:200
#1  0x0000000026517670 in inline_mysql_cond_timedwait (src_file=0x26ec4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff740d7418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2  Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3  do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4  0x00000000265179bc in handle_one_connection (arg=0x100027ddc98) at ./sql/sql_connect.cc:1312
#5  0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b55488) at ./storage/perfschema/pfs.cc:2201
#6  0x00003fff7b6580fc in start_thread (arg=0x3fff740d7fd0) at pthread_create.c:458
#7  0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 14 (Thread 0x3fff74067fd0 (LWP 3860)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x276c7498 <thread_cache>, mutex=0x276c7508 <thread_cache+112>, abstime=0x3fff74067418) at pthread_cond_timedwait.c:200
#1  0x0000000026517670 in inline_mysql_cond_timedwait (src_file=0x26ec4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff74067418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2  Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3  do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4  0x00000000265179bc in handle_one_connection (arg=0x100027ddc98) at ./sql/sql_connect.cc:1312
#5  0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b55488) at ./storage/perfschema/pfs.cc:2201
#6  0x00003fff7b6580fc in start_thread (arg=0x3fff74067fd0) at pthread_create.c:458
#7  0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 13 (Thread 0x3fff74147fd0 (LWP 3858)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x276f9d00 <mysql_bin_log+1360>, mutex=0x276f9c30 <mysql_bin_log+1152>, abstime=0x3fff74143660) at pthread_cond_timedwait.c:200
#1  0x00000000267d1310 in inline_mysql_cond_timedwait (src_file=0x27014448 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/log.cc", src_line=8669, abstime=0x3fff74143660, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2  MYSQL_BIN_LOG::wait_for_update_binlog_end_pos (this=0x276f97b0 <mysql_bin_log>, thd=0x3fff280009b8, timeout=0x3fff74143660) at ./sql/log.cc:8669
#3  0x0000000026418374 in wait_new_events (end_pos_ptr=<synthetic pointer>, binlog_end_pos_filename=0x3fff741436d8 "./master-bin.000001", linfo=<optimized out>, info=<optimized out>) at ./sql/sql_repl.cc:2508
#4  get_binlog_end_pos (info=0x3fff74145058, log=0x3fff74143f60, linfo=0x3fff74144e38) at ./sql/sql_repl.cc:2628
#5  0x000000002641af58 in send_one_binlog_file (start_pos=<optimized out>, linfo=0x3fff74144e38, log=0x3fff74143f60, info=0x3fff74145058) at ./sql/sql_repl.cc:2788
#6  mysql_binlog_send (thd=0x3fff280009b8, log_ident=<optimized out>, pos=<optimized out>, flags=<optimized out>) at ./sql/sql_repl.cc:2933
#7  0x00000000263ede30 in dispatch_command (command=<optimized out>, thd=0x3fff280009b8, packet=0x3fff28007ea9 "", packet_length=<optimized out>, is_com_multi=<optimized out>, is_next_command=<optimized out>) at ./sql/sql_parse.cc:2128
#8  0x00000000263eb570 in do_command (thd=0x3fff280009b8) at ./sql/sql_parse.cc:1348
#9  0x00000000265172b4 in do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1410
#10 0x00000000265179bc in handle_one_connection (arg=0x100027ddc98) at ./sql/sql_connect.cc:1312
#11 0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b55488) at ./storage/perfschema/pfs.cc:2201
#12 0x00003fff7b6580fc in start_thread (arg=0x3fff74147fd0) at pthread_create.c:458
#13 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 12 (Thread 0x3fff4e7cefd0 (LWP 3864)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x100024771c0, mutex=0x10002467ac0, abstime=0x3fff4e7ce410) at pthread_cond_timedwait.c:200
#1  0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff4e7ce410, __mutex=<optimized out>, __cond=0x100024771c0) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2  std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024771c0) at /usr/include/c++/6/condition_variable:166
#3  std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024771c0) at /usr/include/c++/6/condition_variable:106
#4  std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x100024771c0) at /usr/include/c++/6/condition_variable:138
#5  tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x100024771c0) at ./tpool/tpool_generic.cc:418
#6  0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x100024771c0, t=0x3fff4e7ce4f8) at ./tpool/tpool_generic.cc:471
#7  0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x100024771c0) at ./tpool/tpool_generic.cc:516
#8  0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9  std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::*)(tpool::worker_data*), true>::operator()<tpool::thread_pool_generic*, tpool::worker_data*>(tpool::thread_pool_generic*&&, tpool::worker_data*&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff4e7cefd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 11 (Thread 0x3fff4efdefd0 (LWP 3863)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x10002477240, mutex=0x10002467ac0, abstime=0x3fff4efde410) at pthread_cond_timedwait.c:200
#1  0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff4efde410, __mutex=<optimized out>, __cond=0x10002477240) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2  std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477240) at /usr/include/c++/6/condition_variable:166
#3  std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477240) at /usr/include/c++/6/condition_variable:106
#4  std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x10002477240) at /usr/include/c++/6/condition_variable:138
#5  tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x10002477240) at ./tpool/tpool_generic.cc:418
#6  0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x10002477240, t=0x3fff4efde4f8) at ./tpool/tpool_generic.cc:471
#7  0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x10002477240) at ./tpool/tpool_generic.cc:516
#8  0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9  std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::*)(tpool::worker_data*), true>::operator()<tpool::thread_pool_generic*, tpool::worker_data*>(tpool::thread_pool_generic*&&, tpool::worker_data*&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff4efdefd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 10 (Thread 0x3fff74307fd0 (LWP 3833)):
#0  0x00003fff7b660ca4 in __pthread_cond_wait (cond=0x276c7440 <COND_slave_background>, mutex=0x276c4ab8 <LOCK_slave_background>) at pthread_cond_wait.c:188
#1  0x0000000026315fa0 in inline_mysql_cond_wait (that=<optimized out>, mutex=<optimized out>, src_file=0x26ecf620 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/slave.cc", src_line=525) at ./include/mysql/psi/mysql_thread.h:1220
#2  handle_slave_background (arg=<optimized out>) at ./sql/slave.cc:525
#3  0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b24e48) at ./storage/perfschema/pfs.cc:2201
#4  0x00003fff7b6580fc in start_thread (arg=0x3fff74307fd0) at pthread_create.c:458
#5  0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 9 (Thread 0x3fff74377fd0 (LWP 3832)):
#0  0x00003fff7ac4d628 in __GI___sigwaitinfo (set=<optimized out>, info=0x3fff74377450) at ../sysdeps/unix/sysv/linux/sigwaitinfo.c:56
#1  0x00000000262ec15c in my_sigwait (code=<synthetic pointer>, sig=0x3fff743773c8, set=0x3fff743773d0) at ./include/my_pthread.h:196
#2  signal_hand (arg=<optimized out>) at ./sql/mysqld.cc:2987
#3  0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b38828) at ./storage/perfschema/pfs.cc:2201
#4  0x00003fff7b6580fc in start_thread (arg=0x3fff74377fd0) at pthread_create.c:458
#5  0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 8 (Thread 0x3fff7b70a4f0 (LWP 3813)):
#0  0x00003fff7ad14238 in poll () at ../sysdeps/unix/syscall-template.S:84
#1  0x00003fff7ad3a634 in __poll_chk (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>, fdslen=<optimized out>) at poll_chk.c:27
#2  0x00000000262f6e20 in poll (__timeout=-1, __nfds=2, __fds=0x3fffd2ed6300) at /usr/include/powerpc64le-linux-gnu/bits/poll2.h:41
#3  handle_connections_sockets () at ./sql/mysqld.cc:6217
#4  0x00000000262f83f8 in mysqld_main (argc=<optimized out>, argv=<optimized out>) at ./sql/mysqld.cc:5666
#5  0x00000000262b55e0 in main (argc=<optimized out>, argv=<optimized out>) at ./sql/main.cc:25
 
Thread 7 (Thread 0x3fff743e7fd0 (LWP 3828)):
#0  0x00003fff7b660ca4 in __pthread_cond_wait (cond=0x276fa450 <mysql_bin_log+3232>, mutex=0x276fa420 <mysql_bin_log+3184>) at pthread_cond_wait.c:188
#1  0x00000000267d6b90 in inline_mysql_cond_wait (that=0x276fa450 <mysql_bin_log+3232>, mutex=0x276fa420 <mysql_bin_log+3184>, src_file=0x27014448 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/log.cc", src_line=10271) at ./include/mysql/psi/mysql_thread.h:1220
#2  binlog_background_thread (arg=<optimized out>) at ./sql/log.cc:10271
#3  0x000000002697ff58 in pfs_spawn_thread (arg=0x10002386258) at ./storage/perfschema/pfs.cc:2201
#4  0x00003fff7b6580fc in start_thread (arg=0x3fff743e7fd0) at pthread_create.c:458
#5  0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 6 (Thread 0x3fff6e7defd0 (LWP 3827)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x10002477440, mutex=0x10002467ac0, abstime=0x3fff6e7de410) at pthread_cond_timedwait.c:200
#1  0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff6e7de410, __mutex=<optimized out>, __cond=0x10002477440) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2  std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477440) at /usr/include/c++/6/condition_variable:166
#3  std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477440) at /usr/include/c++/6/condition_variable:106
#4  std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x10002477440) at /usr/include/c++/6/condition_variable:138
#5  tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x10002477440) at ./tpool/tpool_generic.cc:418
#6  0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x10002477440, t=0x3fff6e7de4f8) at ./tpool/tpool_generic.cc:471
#7  0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x10002477440) at ./tpool/tpool_generic.cc:516
#8  0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9  std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::*)(tpool::worker_data*), true>::operator()<tpool::thread_pool_generic*, tpool::worker_data*>(tpool::thread_pool_generic*&&, tpool::worker_data*&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff6e7defd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 5 (Thread 0x3fff6efeefd0 (LWP 3823)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x1000248c0a0, mutex=0x1000248c078, abstime=0x3fff6efedef0) at pthread_cond_timedwait.c:200
#1  0x0000000026aee128 in os_event::timed_wait (this=<error reading variable: value has been optimized out>, abstime=<optimized out>) at ./storage/innobase/os/os0event.cc:275
#2  0x0000000026aee448 in os_event::wait_time_low (this=0x1000248c068, time_in_usec=<optimized out>, reset_sig_count=<optimized out>) at ./storage/innobase/os/os0event.cc:385
#3  0x0000000026c5b02c in pc_sleep_if_needed (cur_time=954929, sig_count=2, next_loop_time=955929) at ./storage/innobase/buf/buf0flu.cc:2305
#4  buf_flush_page_cleaner () at ./storage/innobase/buf/buf0flu.cc:2587
#5  0x00003fff7b6580fc in start_thread (arg=0x3fff6efeefd0) at pthread_create.c:458
#6  0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 4 (Thread 0x3fff6dfcefd0 (LWP 3825)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x10002477540, mutex=0x10002467ac0, abstime=0x3fff6dfce410) at pthread_cond_timedwait.c:200
#1  0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff6dfce410, __mutex=<optimized out>, __cond=0x10002477540) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2  std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477540) at /usr/include/c++/6/condition_variable:166
#3  std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x10002477540) at /usr/include/c++/6/condition_variable:106
#4  std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x10002477540) at /usr/include/c++/6/condition_variable:138
#5  tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x10002477540) at ./tpool/tpool_generic.cc:418
#6  0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x10002477540, t=0x3fff6dfce4f8) at ./tpool/tpool_generic.cc:471
#7  0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x10002477540) at ./tpool/tpool_generic.cc:516
#8  0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9  std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::*)(tpool::worker_data*), true>::operator()<tpool::thread_pool_generic*, tpool::worker_data*>(tpool::thread_pool_generic*&&, tpool::worker_data*&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff6dfcefd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 3 (Thread 0x3fff6cfaefd0 (LWP 3829)):
#0  0x00003fff7b661264 in __pthread_cond_timedwait (cond=0x100024773c0, mutex=0x10002467ac0, abstime=0x3fff6cfae410) at pthread_cond_timedwait.c:200
#1  0x0000000026d4a19c in __gthread_cond_timedwait (__abs_timeout=0x3fff6cfae410, __mutex=<optimized out>, __cond=0x100024773c0) at /usr/include/powerpc64le-linux-gnu/c++/6/bits/gthr-default.h:871
#2  std::condition_variable::__wait_until_impl<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024773c0) at /usr/include/c++/6/condition_variable:166
#3  std::condition_variable::wait_until<std::chrono::duration<long, std::ratio<1l, 1000000000l> > > (__atime=..., __lock=..., this=0x100024773c0) at /usr/include/c++/6/condition_variable:106
#4  std::condition_variable::wait_for<long, std::ratio<1l, 1000l> > (__rtime=..., __lock=..., this=0x100024773c0) at /usr/include/c++/6/condition_variable:138
#5  tpool::thread_pool_generic::wait_for_tasks (this=0x100024679b0, lk=..., thread_data=0x100024773c0) at ./tpool/tpool_generic.cc:418
#6  0x0000000026d4a89c in tpool::thread_pool_generic::get_task (this=0x100024679b0, thread_var=0x100024773c0, t=0x3fff6cfae4f8) at ./tpool/tpool_generic.cc:471
#7  0x0000000026d4c71c in tpool::thread_pool_generic::worker_main (this=0x100024679b0, thread_var=0x100024773c0) at ./tpool/tpool_generic.cc:516
#8  0x0000000026d4cd44 in std::__invoke_impl<void, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(std::__invoke_memfun_deref, void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__t=<optimized out>, __f=<optimized out>) at /usr/include/c++/6/functional:227
#9  std::__invoke<void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*, tpool::worker_data*>(void (tpool::thread_pool_generic::* const&)(tpool::worker_data*), tpool::thread_pool_generic*&&, tpool::worker_data*&&) (__fn=<optimized out>) at /usr/include/c++/6/functional:251
#10 std::_Mem_fn_base<void (tpool::thread_pool_generic::*)(tpool::worker_data*), true>::operator()<tpool::thread_pool_generic*, tpool::worker_data*>(tpool::thread_pool_generic*&&, tpool::worker_data*&&) const (this=<optimized out>) at /usr/include/c++/6/functional:604
#11 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::_M_invoke<0ul, 1ul>(std::_Index_tuple<0ul, 1ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#12 std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#13 std::thread::_State_impl<std::_Bind_simple<std::_Mem_fn<void (tpool::thread_pool_generic::*)(tpool::worker_data*)> (tpool::thread_pool_generic*, tpool::worker_data*)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#14 0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#15 0x00003fff7b6580fc in start_thread (arg=0x3fff6cfaefd0) at pthread_create.c:458
#16 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 2 (Thread 0x3fff6fffefd0 (LWP 3822)):
#0  0x00003fff7b4407f8 in ?? () from /lib/powerpc64le-linux-gnu/libaio.so.1
#1  0x00003fff7b440860 in io_getevents () from /lib/powerpc64le-linux-gnu/libaio.so.1
#2  0x0000000026d4f488 in tpool::aio_linux::getevent_thread_routine (aio=0x10002422110) at ./tpool/aio_linux.cc:53
#3  0x0000000026d4f3e0 in std::_Bind_simple<void (*(tpool::aio_linux*))(tpool::aio_linux*)>::_M_invoke<0ul>(std::_Index_tuple<0ul>) (this=<optimized out>) at /usr/include/c++/6/functional:1391
#4  std::_Bind_simple<void (*(tpool::aio_linux*))(tpool::aio_linux*)>::operator()() (this=<optimized out>) at /usr/include/c++/6/functional:1380
#5  std::thread::_State_impl<std::_Bind_simple<void (*(tpool::aio_linux*))(tpool::aio_linux*)> >::_M_run() (this=<optimized out>) at /usr/include/c++/6/thread:197
#6  0x00003fff7af972d8 in ?? () from /usr/lib/powerpc64le-linux-gnu/libstdc++.so.6
#7  0x00003fff7b6580fc in start_thread (arg=0x3fff6fffefd0) at pthread_create.c:458
#8  0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 1 (Thread 0x3fff74227fd0 (LWP 3854)):
#0  0x00003fff7b662898 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:55
#1  0x0000000026dde600 in my_write_core (sig=<optimized out>) at ./mysys/stacktrace.c:518
#2  0x0000000026680b54 in handle_fatal_signal (sig=<optimized out>) at ./sql/signal_handler.cc:330
#3  <signal handler called>
#4  0x00000000265174e4 in ilink::unlink (this=0x100027ddc98, this=0x100027ddc98) at ./sql/sql_list.h:696
#5  ilink::~ilink (this=0x100027ddc98, __in_chrg=<optimized out>) at ./sql/sql_list.h:707
#6  CONNECT::~CONNECT (this=0x100027ddc98, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#7  CONNECT::~CONNECT (this=0x100027ddc98, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#8  do_handle_one_connection (connect=0x100027ddc98, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1436
#9  0x00000000265179bc in handle_one_connection (arg=0x10002bd4458) at ./sql/sql_connect.cc:1312
#10 0x000000002697ff58 in pfs_spawn_thread (arg=0x10002b55488) at ./storage/perfschema/pfs.cc:2201
#11 0x00003fff7b6580fc in start_thread (arg=0x3fff74227fd0) at pthread_create.c:458
#12 0x00003fff7ad21748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Compressed file /dev/shm/var/3/log/rpl.rpl_sync_with_innodb_thd_conc-innodb,stmt/mysqld.1/data/core
 - skipping '/dev/shm/var/3/log/rpl.rpl_sync_with_innodb_thd_conc-innodb,stmt/'



 Comments   
Comment by Elena Stepanova [ 2020-08-06 ]

http://buildbot.askmonty.org/buildbot/builders/kvm-deb-stretch-ppc64le/builds/6774

bb-10.5-release 1007c107fb2

main.having                              w1 [ fail ]
        Test ended at 2020-08-05 18:13:29
 
CURRENT_TEST: main.having
mysqltest: Could not open connection 'default': 2013 Lost connection to MySQL server at 'handshake: reading initial communication packet', system error: 11
 
 
Server [mysqld.1 - pid: 4060, winpid: 4060, exit: 256] failed during test run
Server log from this test:
----------SERVER LOG START-----------
200805 18:13:29 [ERROR] mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
Server version: 10.5.5-MariaDB-1:10.5.5+maria~stretch-log
key_buffer_size=1048576
read_buffer_size=131072
max_used_connections=1
max_threads=153
thread_count=9
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 63579 K  bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
 
Thread pointer: 0x3fff5c0009b8
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0x3fff744d7410 thread_stack 0x49000
/usr/sbin/mariadbd(my_print_stacktrace+0x68)[0x605bf178]
Printing to addr2line failed
/usr/sbin/mariadbd(handle_fatal_signal+0x444)[0x5fe620d4]
linux-vdso64.so.1(__kernel_sigtramp_rt64+0x0)[0x3fff7c4204d8]
/usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x5d4)[0x5fcf90c4]
/usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x588)[0x5fcf9078]
/usr/sbin/mariadbd(handle_one_connection+0x5c)[0x5fcf959c]
/usr/sbin/mariadbd(+0xce19d8)[0x601619d8]
/lib/powerpc64le-linux-gnu/libpthread.so.0(+0x80fc)[0x3fff7c3d80fc]
/lib/powerpc64le-linux-gnu/libc.so.6(clone+0x98)[0x3fff7baa1748]
 
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (0x0): 
Connection ID (thread ID): 366
Status: NOT_KILLED
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off
 
The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains
information that should help you find out what is causing the crash.
Writing a core file...
Working directory at /dev/shm/var/1/mysqld.1/data
Resource Limits:
Limit                     Soft Limit           Hard Limit           Units     
Max cpu time              unlimited            unlimited            seconds   
Max file size             unlimited            unlimited            bytes     
Max data size             unlimited            unlimited            bytes     
Max stack size            8388608              unlimited            bytes     
Max core file size        unlimited            unlimited            bytes     
Max resident set          unlimited            unlimited            bytes     
Max processes             24414                24414                processes 
Max open files            1024                 1024                 files     
Max locked memory         65536                65536                bytes     
Max address space         unlimited            unlimited            bytes     
Max file locks            unlimited            unlimited            locks     
Max pending signals       24414                24414                signals   
Max msgqueue size         819200               819200               bytes     
Max nice priority         0                    0                    
Max realtime priority     0                    0                    
Max realtime timeout      unlimited            unlimited            us        
Core pattern: core
 
----------SERVER LOG END-------------
 
 
 - found 'core' (0/0)
 
Trying 'dbx' to get a backtrace
 
Trying 'gdb' to get a backtrace from coredump /dev/shm/var/1/log/main.having/mysqld.1/data/core
Core generated by '/usr/sbin/mariadbd'
Output from gdb follows. The first stack trace is from the failing thread.
The following stack traces are from all threads (so the failing one is
duplicated).
--------------------------
[New LWP 4454]
[New LWP 4065]
[New LWP 4061]
[New LWP 4064]
[New LWP 4070]
[New LWP 4063]
[New LWP 5535]
[New LWP 4062]
[New LWP 5536]
[New LWP 5533]
[New LWP 4079]
[New LWP 5534]
[New LWP 5537]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/powerpc64le-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/sbin/mariadbd --defaults-group-suffix=.1 --defaults-file=/dev/shm/var/1/my'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x00003fff7c3e2898 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:55
55	../sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.
[Current thread is 1 (Thread 0x3fff744d7fd0 (LWP 4454))]
#0  0x00003fff7c3e2898 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:55
#1  0x00000000605beb90 in my_write_core (sig=<optimized out>) at ./mysys/stacktrace.c:519
#2  0x000000005fe62144 in handle_fatal_signal (sig=<optimized out>) at ./sql/signal_handler.cc:330
#3  <signal handler called>
#4  0x000000005fcf90c4 in ilink::unlink (this=0x1003452ca38, this=0x1003452ca38) at ./sql/sql_list.h:696
#5  ilink::~ilink (this=0x1003452ca38, __in_chrg=<optimized out>) at ./sql/sql_list.h:707
#6  CONNECT::~CONNECT (this=0x1003452ca38, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#7  CONNECT::~CONNECT (this=0x1003452ca38, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#8  do_handle_one_connection (connect=0x1003452ca38, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1436
#9  0x000000005fcf959c in handle_one_connection (arg=0x10034482c48) at ./sql/sql_connect.cc:1312
#10 0x00000000601619d8 in pfs_spawn_thread (arg=0x10034537d98) at ./storage/perfschema/pfs.cc:2201
#11 0x00003fff7c3d80fc in start_thread (arg=0x3fff744d7fd0) at pthread_create.c:458
#12 0x00003fff7baa1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 13 (Thread 0x3fff74387fd0 (LWP 5537)):
#0  0x00003fff7c3e1264 in __pthread_cond_timedwait (cond=0x60ea7298 <thread_cache>, mutex=0x60ea7308 <thread_cache+112>, abstime=0x3fff74387418) at pthread_cond_timedwait.c:200
#1  0x000000005fcf9250 in inline_mysql_cond_timedwait (src_file=0x606a4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff74387418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2  Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3  do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4  0x000000005fcf959c in handle_one_connection (arg=0x1003452ca38) at ./sql/sql_connect.cc:1312
#5  0x00000000601619d8 in pfs_spawn_thread (arg=0x10034537d98) at ./storage/perfschema/pfs.cc:2201
#6  0x00003fff7c3d80fc in start_thread (arg=0x3fff74387fd0) at pthread_create.c:458
#7  0x00003fff7baa1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 12 (Thread 0x3fff773e7fd0 (LWP 5534)):
#0  0x00003fff7c3e1264 in __pthread_cond_timedwait (cond=0x60ea7298 <thread_cache>, mutex=0x60ea7308 <thread_cache+112>, abstime=0x3fff773e7418) at pthread_cond_timedwait.c:200
#1  0x000000005fcf9250 in inline_mysql_cond_timedwait (src_file=0x606a4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff773e7418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2  Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3  do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4  0x000000005fcf959c in handle_one_connection (arg=0x1003452ca38) at ./sql/sql_connect.cc:1312
#5  0x00000000601619d8 in pfs_spawn_thread (arg=0x10034537d98) at ./storage/perfschema/pfs.cc:2201
#6  0x00003fff7c3d80fc in start_thread (arg=0x3fff773e7fd0) at pthread_create.c:458
#7  0x00003fff7baa1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 11 (Thread 0x3fff74d57fd0 (LWP 4079)):
#0  0x00003fff7c3e1264 in __pthread_cond_timedwait (cond=0x60ea7298 <thread_cache>, mutex=0x60ea7308 <thread_cache+112>, abstime=0x3fff74d57418) at pthread_cond_timedwait.c:200
#1  0x000000005fcf9250 in inline_mysql_cond_timedwait (src_file=0x606a4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff74d57418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2  Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3  do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4  0x000000005fcf959c in handle_one_connection (arg=0x100344c4608) at ./sql/sql_connect.cc:1312
#5  0x00000000601619d8 in pfs_spawn_thread (arg=0x10034537d98) at ./storage/perfschema/pfs.cc:2201
#6  0x00003fff7c3d80fc in start_thread (arg=0x3fff74d57fd0) at pthread_create.c:458
#7  0x00003fff7baa1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 10 (Thread 0x3fff77457fd0 (LWP 5533)):
#0  0x00003fff7c3e1264 in __pthread_cond_timedwait (cond=0x60ea7298 <thread_cache>, mutex=0x60ea7308 <thread_cache+112>, abstime=0x3fff77457418) at pthread_cond_timedwait.c:200
#1  0x000000005fcf9250 in inline_mysql_cond_timedwait (src_file=0x606a4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff77457418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2  Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3  do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4  0x000000005fcf959c in handle_one_connection (arg=0x1003452ca38) at ./sql/sql_connect.cc:1312
#5  0x00000000601619d8 in pfs_spawn_thread (arg=0x10034537d98) at ./storage/perfschema/pfs.cc:2201
#6  0x00003fff7c3d80fc in start_thread (arg=0x3fff77457fd0) at pthread_create.c:458
#7  0x00003fff7baa1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 9 (Thread 0x3fff743f7fd0 (LWP 5536)):
#0  0x00003fff7c3e1264 in __pthread_cond_timedwait (cond=0x60ea7298 <thread_cache>, mutex=0x60ea7308 <thread_cache+112>, abstime=0x3fff743f7418) at pthread_cond_timedwait.c:200
#1  0x000000005fcf9250 in inline_mysql_cond_timedwait (src_file=0x606a4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff743f7418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2  Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3  do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4  0x000000005fcf959c in handle_one_connection (arg=0x1003452ca38) at ./sql/sql_connect.cc:1312
#5  0x00000000601619d8 in pfs_spawn_thread (arg=0x10034537d98) at ./storage/perfschema/pfs.cc:2201
#6  0x00003fff7c3d80fc in start_thread (arg=0x3fff743f7fd0) at pthread_create.c:458
#7  0x00003fff7baa1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 8 (Thread 0x3fff7735efd0 (LWP 4062)):
#0  0x00003fff7c3e1264 in __pthread_cond_timedwait (cond=0x617a5ee8 <COND_timer>, mutex=0x617a5e80 <LOCK_timer>, abstime=0x3fff7735e468) at pthread_cond_timedwait.c:200
#1  0x00000000605c5a10 in inline_mysql_cond_timedwait (that=0x617a5ee8 <COND_timer>, mutex=0x617a5e80 <LOCK_timer>, src_file=0x60872a90 "/home/buildbot/buildbot/build/mariadb-10.5.5/mysys/thr_timer.c", src_line=321, abstime=0x3fff7735e468) at ./include/mysql/psi/mysql_thread.h:1257
#2  timer_handler (arg=<optimized out>) at ./mysys/thr_timer.c:321
#3  0x00000000601619d8 in pfs_spawn_thread (arg=0x100340d5b08) at ./storage/perfschema/pfs.cc:2201
#4  0x00003fff7c3d80fc in start_thread (arg=0x3fff7735efd0) at pthread_create.c:458
#5  0x00003fff7baa1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 7 (Thread 0x3fff74467fd0 (LWP 5535)):
#0  0x00003fff7c3e1264 in __pthread_cond_timedwait (cond=0x60ea7298 <thread_cache>, mutex=0x60ea7308 <thread_cache+112>, abstime=0x3fff74467418) at pthread_cond_timedwait.c:200
#1  0x000000005fcf9250 in inline_mysql_cond_timedwait (src_file=0x606a4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff74467418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2  Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3  do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4  0x000000005fcf959c in handle_one_connection (arg=0x1003452ca38) at ./sql/sql_connect.cc:1312
#5  0x00000000601619d8 in pfs_spawn_thread (arg=0x10034537d98) at ./storage/perfschema/pfs.cc:2201
#6  0x00003fff7c3d80fc in start_thread (arg=0x3fff74467fd0) at pthread_create.c:458
#7  0x00003fff7baa1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 6 (Thread 0x3fff75faefd0 (LWP 4063)):
#0  0x00003fff7c3e1264 in __pthread_cond_timedwait (cond=0x616dbfc0 <COND_checkpoint>, mutex=0x616dbf88 <LOCK_checkpoint>, abstime=0x3fff75fae378) at pthread_cond_timedwait.c:200
#1  0x00000000600df830 in inline_mysql_cond_timedwait (src_file=0x608024f0 "/home/buildbot/buildbot/build/mariadb-10.5.5/storage/maria/ma_servicethread.c", src_line=116, abstime=<optimized out>, mutex=0x616dbf88 <LOCK_checkpoint>, that=0x616dbfc0 <COND_checkpoint>) at ./include/mysql/psi/mysql_thread.h:1257
#2  my_service_thread_sleep (control=0x60e1a068 <checkpoint_control>, sleep_time=<optimized out>) at ./storage/maria/ma_servicethread.c:115
#3  0x00000000600d32f0 in ma_checkpoint_background (arg=0x1e) at ./storage/maria/ma_checkpoint.c:707
#4  0x00000000601619d8 in pfs_spawn_thread (arg=0x1003417f848) at ./storage/perfschema/pfs.cc:2201
#5  0x00003fff7c3d80fc in start_thread (arg=0x3fff75faefd0) at pthread_create.c:458
#6  0x00003fff7baa1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 5 (Thread 0x3fff756b7fd0 (LWP 4070)):
#0  0x00003fff7c3e1264 in __pthread_cond_timedwait (cond=0x60ea7298 <thread_cache>, mutex=0x60ea7308 <thread_cache+112>, abstime=0x3fff756b7418) at pthread_cond_timedwait.c:200
#1  0x000000005fcf9250 in inline_mysql_cond_timedwait (src_file=0x606a4be0 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/thread_cache.h", src_line=177, abstime=0x3fff756b7418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1257
#2  Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3  do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4  0x000000005fcf959c in handle_one_connection (arg=0x100344c4608) at ./sql/sql_connect.cc:1312
#5  0x00000000601619d8 in pfs_spawn_thread (arg=0x10034537d98) at ./storage/perfschema/pfs.cc:2201
#6  0x00003fff7c3d80fc in start_thread (arg=0x3fff756b7fd0) at pthread_create.c:458
#7  0x00003fff7baa1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 4 (Thread 0x3fff75797fd0 (LWP 4064)):
#0  0x00003fff7b9cd628 in __GI___sigwaitinfo (set=<optimized out>, info=0x3fff75797450) at ../sysdeps/unix/sysv/linux/sigwaitinfo.c:56
#1  0x000000005face33c in my_sigwait (code=<synthetic pointer>, sig=0x3fff757973c8, set=0x3fff757973d0) at ./include/my_pthread.h:196
#2  signal_hand (arg=<optimized out>) at ./sql/mysqld.cc:2987
#3  0x00000000601619d8 in pfs_spawn_thread (arg=0x100344a7428) at ./storage/perfschema/pfs.cc:2201
#4  0x00003fff7c3d80fc in start_thread (arg=0x3fff75797fd0) at pthread_create.c:458
#5  0x00003fff7baa1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 3 (Thread 0x3fff7c48a4f0 (LWP 4061)):
#0  0x00003fff7ba94238 in poll () at ../sysdeps/unix/syscall-template.S:84
#1  0x00003fff7baba634 in __poll_chk (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>, fdslen=<optimized out>) at poll_chk.c:27
#2  0x000000005fad9000 in poll (__timeout=-1, __nfds=2, __fds=0x3ffff5fd2710) at /usr/include/powerpc64le-linux-gnu/bits/poll2.h:41
#3  handle_connections_sockets () at ./sql/mysqld.cc:6217
#4  0x000000005fada5d8 in mysqld_main (argc=<optimized out>, argv=<optimized out>) at ./sql/mysqld.cc:5666
#5  0x000000005fa97670 in main (argc=<optimized out>, argv=<optimized out>) at ./sql/main.cc:25
 
Thread 2 (Thread 0x3fff75727fd0 (LWP 4065)):
#0  0x00003fff7c3e0ca4 in __pthread_cond_wait (cond=0x60ea7240 <COND_slave_background>, mutex=0x60ea48b8 <LOCK_slave_background>) at pthread_cond_wait.c:188
#1  0x000000005faf8080 in inline_mysql_cond_wait (that=<optimized out>, mutex=<optimized out>, src_file=0x606af650 "/home/buildbot/buildbot/build/mariadb-10.5.5/sql/slave.cc", src_line=525) at ./include/mysql/psi/mysql_thread.h:1220
#2  handle_slave_background (arg=<optimized out>) at ./sql/slave.cc:525
#3  0x00000000601619d8 in pfs_spawn_thread (arg=0x10034537d98) at ./storage/perfschema/pfs.cc:2201
#4  0x00003fff7c3d80fc in start_thread (arg=0x3fff75727fd0) at pthread_create.c:458
#5  0x00003fff7baa1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 1 (Thread 0x3fff744d7fd0 (LWP 4454)):
#0  0x00003fff7c3e2898 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:55
#1  0x00000000605beb90 in my_write_core (sig=<optimized out>) at ./mysys/stacktrace.c:519
#2  0x000000005fe62144 in handle_fatal_signal (sig=<optimized out>) at ./sql/signal_handler.cc:330
#3  <signal handler called>
#4  0x000000005fcf90c4 in ilink::unlink (this=0x1003452ca38, this=0x1003452ca38) at ./sql/sql_list.h:696
#5  ilink::~ilink (this=0x1003452ca38, __in_chrg=<optimized out>) at ./sql/sql_list.h:707
#6  CONNECT::~CONNECT (this=0x1003452ca38, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#7  CONNECT::~CONNECT (this=0x1003452ca38, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#8  do_handle_one_connection (connect=0x1003452ca38, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1436
#9  0x000000005fcf959c in handle_one_connection (arg=0x10034482c48) at ./sql/sql_connect.cc:1312
#10 0x00000000601619d8 in pfs_spawn_thread (arg=0x10034537d98) at ./storage/perfschema/pfs.cc:2201
#11 0x00003fff7c3d80fc in start_thread (arg=0x3fff744d7fd0) at pthread_create.c:458
#12 0x00003fff7baa1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Comment by Elena Stepanova [ 2021-02-16 ]

http://buildbot.askmonty.org/buildbot/builders/kvm-deb-stretch-ppc64le/builds/7311

10.5 97569d3c37

main.select_safe                         w4 [ fail ]
        Test ended at 2020-11-12 21:46:06
 
CURRENT_TEST: main.select_safe
mysqltest: Could not open connection 'default': 2013 Lost connection to MySQL server at 'handshake: reading initial communication packet', system error: 11
 
 
Server [mysqld.1 - pid: 11102, winpid: 11102, exit: 256] failed during test run
Server log from this test:
----------SERVER LOG START-----------
201112 21:46:05 [ERROR] mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
Server version: 10.5.9-MariaDB-1:10.5.9+maria~stretch-log
key_buffer_size=1048576
read_buffer_size=131072
max_used_connections=1
max_threads=153
thread_count=5
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 63636 K  bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
 
Thread pointer: 0x3fff580009b8
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0x3fff783d7410 thread_stack 0x49000
/usr/sbin/mariadbd(my_print_stacktrace+0x68)[0x2688ec18]
Printing to addr2line failed
/usr/sbin/mariadbd(handle_fatal_signal+0x444)[0x26147424]
linux-vdso64.so.1(__kernel_sigtramp_rt64+0x0)[0x3fff7ea504d8]
/usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x5d4)[0x25fdc1f4]
/usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x588)[0x25fdc1a8]
/usr/sbin/mariadbd(handle_one_connection+0x5c)[0x25fdc6cc]
/usr/sbin/mariadbd(+0xce80f8)[0x264480f8]
/lib/powerpc64le-linux-gnu/libpthread.so.0(+0x80fc)[0x3fff7ea080fc]
/lib/powerpc64le-linux-gnu/libc.so.6(clone+0x98)[0x3fff7e0d1748]
 
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (0x0): (null)
Connection ID (thread ID): 136
Status: NOT_KILLED
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off
 
The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains
information that should help you find out what is causing the crash.
 
We think the query pointer is invalid, but we will try to print it anyway. 
Query: 
 
Writing a core file...
Working directory at /dev/shm/var/4/mysqld.1/data
Resource Limits:
Limit                     Soft Limit           Hard Limit           Units     
Max cpu time              unlimited            unlimited            seconds   
Max file size             unlimited            unlimited            bytes     
Max data size             unlimited            unlimited            bytes     
Max stack size            8388608              unlimited            bytes     
Max core file size        unlimited            unlimited            bytes     
Max resident set          unlimited            unlimited            bytes     
Max processes             24414                24414                processes 
Max open files            1024                 1024                 files     
Max locked memory         65536                65536                bytes     
Max address space         unlimited            unlimited            bytes     
Max file locks            unlimited            unlimited            locks     
Max pending signals       24414                24414                signals   
Max msgqueue size         819200               819200               bytes     
Max nice priority         0                    0                    
Max realtime priority     0                    0                    
Max realtime timeout      unlimited            unlimited            us        
Core pattern: core
 
----------SERVER LOG END-------------
 
 
 - found 'core' (0/0)
 
Trying 'dbx' to get a backtrace
 
Trying 'gdb' to get a backtrace from coredump /dev/shm/var/4/log/main.select_safe/mysqld.1/data/core
Core generated by '/usr/sbin/mariadbd'
Output from gdb follows. The first stack trace is from the failing thread.
The following stack traces are from all threads (so the failing one is
duplicated).
--------------------------
[New LWP 11208]
[New LWP 11141]
[New LWP 11114]
[New LWP 11111]
[New LWP 11110]
[New LWP 11109]
[New LWP 11108]
[New LWP 11103]
[New LWP 11207]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/powerpc64le-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/sbin/mariadbd --defaults-group-suffix=.1 --defaults-file=/dev/shm/var/4/my'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x00003fff7ea12898 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:55
55	../sysdeps/unix/sysv/linux/pthread_kill.c: No such file or directory.
[Current thread is 1 (Thread 0x3fff783d7fd0 (LWP 11208))]
#0  0x00003fff7ea12898 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:55
#1  0x000000002688e910 in my_write_core (sig=<optimized out>) at ./mysys/stacktrace.c:424
#2  0x0000000026147494 in handle_fatal_signal (sig=<optimized out>) at ./sql/signal_handler.cc:330
#3  <signal handler called>
#4  0x0000000025fdc1f4 in ilink::unlink (this=0x100185877b8, this=0x100185877b8) at ./sql/sql_list.h:696
#5  ilink::~ilink (this=0x100185877b8, __in_chrg=<optimized out>) at ./sql/sql_list.h:707
#6  CONNECT::~CONNECT (this=0x100185877b8, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#7  CONNECT::~CONNECT (this=0x100185877b8, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#8  do_handle_one_connection (connect=0x100185877b8, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1436
#9  0x0000000025fdc6cc in handle_one_connection (arg=0x10018902508) at ./sql/sql_connect.cc:1312
#10 0x00000000264480f8 in pfs_spawn_thread (arg=0x10018937bc8) at ./storage/perfschema/pfs.cc:2201
#11 0x00003fff7ea080fc in start_thread (arg=0x3fff783d7fd0) at pthread_create.c:458
#12 0x00003fff7e0d1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 9 (Thread 0x3fff78447fd0 (LWP 11207)):
#0  0x00003fff7ea11264 in __pthread_cond_timedwait (cond=0x27177098 <thread_cache>, mutex=0x27177108 <thread_cache+112>, abstime=0x3fff78447418) at pthread_cond_timedwait.c:200
#1  0x0000000025fdc380 in inline_mysql_cond_timedwait (src_file=0x26975be0 "/home/buildbot/buildbot/build/mariadb-10.5.9/sql/thread_cache.h", src_line=177, abstime=0x3fff78447418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1259
#2  Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3  do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4  0x0000000025fdc6cc in handle_one_connection (arg=0x10018902508) at ./sql/sql_connect.cc:1312
#5  0x00000000264480f8 in pfs_spawn_thread (arg=0x10018937bc8) at ./storage/perfschema/pfs.cc:2201
#6  0x00003fff7ea080fc in start_thread (arg=0x3fff78447fd0) at pthread_create.c:458
#7  0x00003fff7e0d1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 8 (Thread 0x3fff7eaba4f0 (LWP 11103)):
#0  0x00003fff7e0c4238 in poll () at ../sysdeps/unix/syscall-template.S:84
#1  0x00003fff7e0ea634 in __poll_chk (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>, fdslen=<optimized out>) at poll_chk.c:27
#2  0x0000000025db8940 in poll (__timeout=-1, __nfds=2, __fds=0x3ffffc922330) at /usr/include/powerpc64le-linux-gnu/bits/poll2.h:41
#3  handle_connections_sockets () at ./sql/mysqld.cc:6219
#4  0x0000000025db9f18 in mysqld_main (argc=<optimized out>, argv=<optimized out>) at ./sql/mysqld.cc:5668
#5  0x0000000025d772b0 in main (argc=<optimized out>, argv=<optimized out>) at ./sql/main.cc:25
 
Thread 7 (Thread 0x3fff799befd0 (LWP 11108)):
#0  0x00003fff7ea11264 in __pthread_cond_timedwait (cond=0x27a755d0 <COND_timer>, mutex=0x27a75568 <LOCK_timer>, abstime=0x3fff799be468) at pthread_cond_timedwait.c:200
#1  0x00000000268954b0 in inline_mysql_cond_timedwait (that=0x27a755d0 <COND_timer>, mutex=0x27a75568 <LOCK_timer>, src_file=0x26b42790 "/home/buildbot/buildbot/build/mariadb-10.5.9/mysys/thr_timer.c", src_line=321, abstime=0x3fff799be468) at ./include/mysql/psi/mysql_thread.h:1259
#2  timer_handler (arg=<optimized out>) at ./mysys/thr_timer.c:321
#3  0x00000000264480f8 in pfs_spawn_thread (arg=0x100184c4ee8) at ./storage/perfschema/pfs.cc:2201
#4  0x00003fff7ea080fc in start_thread (arg=0x3fff799befd0) at pthread_create.c:458
#5  0x00003fff7e0d1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 6 (Thread 0x3fff73ffefd0 (LWP 11109)):
#0  0x00003fff7ea11264 in __pthread_cond_timedwait (cond=0x279abe50 <COND_checkpoint>, mutex=0x279abe18 <LOCK_checkpoint>, abstime=0x3fff73ffe378) at pthread_cond_timedwait.c:200
#1  0x00000000263c5c90 in inline_mysql_cond_timedwait (src_file=0x26ad2f40 "/home/buildbot/buildbot/build/mariadb-10.5.9/storage/maria/ma_servicethread.c", src_line=116, abstime=<optimized out>, mutex=0x279abe18 <LOCK_checkpoint>, that=0x279abe50 <COND_checkpoint>) at ./include/mysql/psi/mysql_thread.h:1259
#2  my_service_thread_sleep (control=0x270ea078 <checkpoint_control>, sleep_time=<optimized out>) at ./storage/maria/ma_servicethread.c:115
#3  0x00000000263b9750 in ma_checkpoint_background (arg=0x1e) at ./storage/maria/ma_checkpoint.c:707
#4  0x00000000264480f8 in pfs_spawn_thread (arg=0x1001857f5c8) at ./storage/perfschema/pfs.cc:2201
#5  0x00003fff7ea080fc in start_thread (arg=0x3fff73ffefd0) at pthread_create.c:458
#6  0x00003fff7e0d1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 5 (Thread 0x3fff78607fd0 (LWP 11110)):
#0  0x00003fff7dffd628 in __GI___sigwaitinfo (set=<optimized out>, info=0x3fff78607450) at ../sysdeps/unix/sysv/linux/sigwaitinfo.c:56
#1  0x0000000025dadc9c in my_sigwait (code=<synthetic pointer>, sig=0x3fff786073c8, set=0x3fff786073d0) at ./include/my_pthread.h:196
#2  signal_hand (arg=<optimized out>) at ./sql/mysqld.cc:2988
#3  0x00000000264480f8 in pfs_spawn_thread (arg=0x100188a7108) at ./storage/perfschema/pfs.cc:2201
#4  0x00003fff7ea080fc in start_thread (arg=0x3fff78607fd0) at pthread_create.c:458
#5  0x00003fff7e0d1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 4 (Thread 0x3fff78597fd0 (LWP 11111)):
#0  0x00003fff7ea10ca4 in __pthread_cond_wait (cond=0x27177040 <COND_slave_background>, mutex=0x271746b8 <LOCK_slave_background>) at pthread_cond_wait.c:188
#1  0x0000000025dd8320 in inline_mysql_cond_wait (that=<optimized out>, mutex=<optimized out>, src_file=0x26980660 "/home/buildbot/buildbot/build/mariadb-10.5.9/sql/slave.cc", src_line=525) at ./include/mysql/psi/mysql_thread.h:1222
#2  handle_slave_background (arg=<optimized out>) at ./sql/slave.cc:525
#3  0x00000000264480f8 in pfs_spawn_thread (arg=0x10018937bc8) at ./storage/perfschema/pfs.cc:2201
#4  0x00003fff7ea080fc in start_thread (arg=0x3fff78597fd0) at pthread_create.c:458
#5  0x00003fff7e0d1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 3 (Thread 0x3fff78527fd0 (LWP 11114)):
#0  0x00003fff7ea11264 in __pthread_cond_timedwait (cond=0x27177098 <thread_cache>, mutex=0x27177108 <thread_cache+112>, abstime=0x3fff78527418) at pthread_cond_timedwait.c:200
#1  0x0000000025fdc380 in inline_mysql_cond_timedwait (src_file=0x26975be0 "/home/buildbot/buildbot/build/mariadb-10.5.9/sql/thread_cache.h", src_line=177, abstime=0x3fff78527418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1259
#2  Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3  do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4  0x0000000025fdc6cc in handle_one_connection (arg=0x100188c4308) at ./sql/sql_connect.cc:1312
#5  0x00000000264480f8 in pfs_spawn_thread (arg=0x10018937bc8) at ./storage/perfschema/pfs.cc:2201
#6  0x00003fff7ea080fc in start_thread (arg=0x3fff78527fd0) at pthread_create.c:458
#7  0x00003fff7e0d1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 2 (Thread 0x3fff784b7fd0 (LWP 11141)):
#0  0x00003fff7ea11264 in __pthread_cond_timedwait (cond=0x27177098 <thread_cache>, mutex=0x27177108 <thread_cache+112>, abstime=0x3fff784b7418) at pthread_cond_timedwait.c:200
#1  0x0000000025fdc380 in inline_mysql_cond_timedwait (src_file=0x26975be0 "/home/buildbot/buildbot/build/mariadb-10.5.9/sql/thread_cache.h", src_line=177, abstime=0x3fff784b7418, mutex=<optimized out>, that=<optimized out>) at ./include/mysql/psi/mysql_thread.h:1259
#2  Thread_cache::park (this=<optimized out>) at ./sql/thread_cache.h:176
#3  do_handle_one_connection (connect=<optimized out>, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1422
#4  0x0000000025fdc6cc in handle_one_connection (arg=0x10018902508) at ./sql/sql_connect.cc:1312
#5  0x00000000264480f8 in pfs_spawn_thread (arg=0x10018937bc8) at ./storage/perfschema/pfs.cc:2201
#6  0x00003fff7ea080fc in start_thread (arg=0x3fff784b7fd0) at pthread_create.c:458
#7  0x00003fff7e0d1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85
 
Thread 1 (Thread 0x3fff783d7fd0 (LWP 11208)):
#0  0x00003fff7ea12898 in __pthread_kill (threadid=<optimized out>, signo=<optimized out>) at ../sysdeps/unix/sysv/linux/pthread_kill.c:55
#1  0x000000002688e910 in my_write_core (sig=<optimized out>) at ./mysys/stacktrace.c:424
#2  0x0000000026147494 in handle_fatal_signal (sig=<optimized out>) at ./sql/signal_handler.cc:330
#3  <signal handler called>
#4  0x0000000025fdc1f4 in ilink::unlink (this=0x100185877b8, this=0x100185877b8) at ./sql/sql_list.h:696
#5  ilink::~ilink (this=0x100185877b8, __in_chrg=<optimized out>) at ./sql/sql_list.h:707
#6  CONNECT::~CONNECT (this=0x100185877b8, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#7  CONNECT::~CONNECT (this=0x100185877b8, __in_chrg=<optimized out>) at ./sql/sql_connect.h:51
#8  do_handle_one_connection (connect=0x100185877b8, put_in_cache=<optimized out>) at ./sql/sql_connect.cc:1436
#9  0x0000000025fdc6cc in handle_one_connection (arg=0x10018902508) at ./sql/sql_connect.cc:1312
#10 0x00000000264480f8 in pfs_spawn_thread (arg=0x10018937bc8) at ./storage/perfschema/pfs.cc:2201
#11 0x00003fff7ea080fc in start_thread (arg=0x3fff783d7fd0) at pthread_create.c:458
#12 0x00003fff7e0d1748 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:85

Generated at Thu Feb 08 09:22:16 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.