[MCOL-4805] can't start PM2/PM3 node after signal 11 Created: 2021-07-08  Updated: 2021-12-09  Resolved: 2021-08-11

Status: Closed
Project: MariaDB ColumnStore
Component/s: MDB Plugin
Affects Version/s: 5.6.1
Fix Version/s: 5.6.3, 6.1.1

Type: Bug Priority: Major
Reporter: Allen Lee (Inactive) Assignee: Roman
Resolution: Fixed Votes: 1
Labels: None

Attachments: PNG File LDIF-Breaks.png     HTML File Steps to reproduce     File Test-SAS-sqlbin0-create-table.mov     File columnstore.cnf     Text File daffycs_future_bigsum_20210709.txt     PNG File image (1).png     File mariadb-enterprise.cnf     File massCp.csv     File massSchemas.sql     File server.cnf    
Issue Links:
Problem/Incident
causes MCOL-4806 log files for MCOL-4805 Closed
Relates
relates to MCOL-4769 Complete ColumnStore Insert Cache Part 1 Closed

 Description   

Customer could not start replica node(pm2 and pm3) out of 3 node columnstore cluster due to signal 11 after running cpimport job. At this point, primary node is only working.

2021-06-21 16:21:59 8 [Note] Previous Using_Gtid=No. New Using_Gtid=Slave_Pos
 
2021-06-21 16:22:00 10 [Note] Slave I/O thread: Start asynchronous replication to master 'replica@xx.xxx.xx.xxx:3306' in log '' at position 4
 
2021-06-21 16:22:00 11 [Note] Slave SQL thread initialized, starting replication in log 'FIRST' at position 4, relay log '/var/log/mariadb/mariadb-relay.000001' position: 4; GTID position ''
 
2021-06-21 16:22:00 10 [Note] Slave I/O thread: connected to master 'replica@xx.xxx.xx.xxx:3306',replication starts at GTID position ''
 
DBRM::send_recv caught: InetStreamSocket::connect: connect() error: Connection refused to: InetStreamSocket: sd: 50 inet: xx.xxx.xx.xxx port: 8616
 
DBRM::send_recv caught: InetStreamSocket::connect: connect() error: Connection refused to: InetStreamSocket: sd: 50 inet: xx.xxx.xx.xxx port: 8616
 
controllernode[18818]: 34.124080 |0|0|0| E 29 CAL0000: DBRM: error: SessionManager::getSystemState() failed (network)         
DBRM::send_recv caught: InetStreamSocket::connect: connect() error: Connection refused to: InetStreamSocket: sd: 50 inet: xx.xxx.xx.xxx port: 8616
 
DBRM::send_recv caught: InetStreamSocket::connect: connect() error: Connection refused to: InetStreamSocket: sd: 50 inet: xx.xxx.xx.xxx port: 8616
 
controllernode[18818]: 34.125666 |0|0|0| E 29 CAL0000: DBRM: error: SessionManager::getSystemState() failed (network)         
DBRM::send_recv caught: InetStreamSocket::connect: connect() error: Connection refused to: InetStreamSocket: sd: 50 inet: xx.xxx.xx.xxx port: 8616
 
DBRM::send_recv caught: InetStreamSocket::connect: connect() error: Connection refused to: InetStreamSocket: sd: 50 inet: xx.xxx.xx.xxx port: 8616
 
controllernode[18818]: 55.265120 |0|0|0| E 29 CAL0000: DBRM: error: SessionManager::getSystemState() failed (network)         
DBRM::send_recv caught: InetStreamSocket::connect: connect() error: Connection refused to: InetStreamSocket: sd: 50 inet: xx.xxx.xx.xxx port: 8616
 
DBRM::send_recv caught: InetStreamSocket::connect: connect() error: Connection refused to: InetStreamSocket: sd: 50 inet: xx.xxx.xx.xxx port: 8616
 
controllernode[18818]: 55.266705 |0|0|0| E 29 CAL0000: DBRM: error: SessionManager::getSystemState() failed (network)         
DBRM::send_recv caught: InetStreamSocket::connect: connect() error: Connection refused to: InetStreamSocket: sd: 67 inet: xx.xxx.xx.xxx port: 8616
 
DBRM::send_recv caught: InetStreamSocket::connect: connect() error: Connection refused to: InetStreamSocket: sd: 67 inet: xx.xxx.xx.xxx port: 8616
 
controllernode[18818]: 55.617737 |0|0|0| E 29 CAL0000: DBRM: error: SessionManager::getSystemState() failed (network)         
DBRM::send_recv caught: InetStreamSocket::connect: connect() error: Connection refused to: InetStreamSocket: sd: 67 inet: xx.xxx.xx.xxx port: 8616
 
DBRM::send_recv caught: InetStreamSocket::connect: connect() error: Connection refused to: InetStreamSocket: sd: 67 inet: xx.xxx.xx.xxx port: 8616
 
controllernode[18818]: 55.619377 |0|0|0| E 29 CAL0000: DBRM: error: SessionManager::getSystemState() failed (network)         
DBRM::send_recv: controller node closed the connection
 
DBRM::send_recv: controller node closed the connection
 
210622  5:05:06 [ERROR] mysqld got signal 11 ;
 
This could be because you hit a bug. It is also possible that this binary
 
or one of the libraries it was linked against is corrupt, improperly built,
 
or misconfigured. This error can also be caused by malfunctioning hardware.
 
 
 
To report this bug, see https://mariadb.com/kb/en/reporting-bugs
 
 
 
We will try our best to scrape up some info that will hopefully help
 
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
 
 
 
Server version: 10.5.10-7-MariaDB-enterprise-log
 
key_buffer_size=134217728
 
read_buffer_size=131072
 
max_used_connections=49
 
max_threads=1002
 
thread_count=38
 
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 2336988 K  bytes of memory
 
Hope that's ok; if not, decrease some variables in the equation.
 
 
 
Thread pointer: 0x7f0228009468
 
Attempting backtrace. You can use the following information to find out
 
where mysqld died. If you see no messages after this, something went
 
terribly wrong...
 
stack_bottom = 0x7f025c0ce410 thread_stack 0x49000
 
??:0(my_print_stacktrace)[0x558cff05b34e]
 
??:0(handle_fatal_signal)[0x558cfea2f627]
 
sigaction.c:0(__restore_rt)[0x7f0274bcc630]
 
??:0(ha_mcs_impl_write_row(unsigned char const*, TABLE*, unsigned long))[0x7f02713a423a]
 
??:0(ha_mcs::write_row(unsigned char const*))[0x7f027139de7f]
 
??:0(handler::ha_write_row(unsigned char const*))[0x558cfea3cbaf]
 
??:0(Rows_log_event::write_row(rpl_group_info*, bool))[0x558cfeb48655]
 
??:0(Write_rows_log_event::do_exec_row(rpl_group_info*))[0x558cfeb48abd]
 
??:0(Rows_log_event::do_apply_event(rpl_group_info*))[0x558cfeb3e284]
 
??:0(non-virtual thunk to Item_string_sys::~Item_string_sys())[0x558cfe76bbcf]
 
??:0(handle_slave_sql)[0x558cfe77620c]
 
??:0(MyCTX_nopad::finish(unsigned char*, unsigned int*))[0x558cfeca628d]
 
pthread_create.c:0(start_thread)[0x7f0274bc4ea5]
 
??:0(__clone)[0x7f02740df9fd]
 
 
 
Trying to get some variables.
 
Some pointers may be invalid and cause the dump to abort.
 
Query (0x7f02298e41cb): LOAD DATA LOCAL INFILE 'daffycs_future_bigsum_20210622.txt' INTO TABLE future_bigsum_tmp COLUMNS TERMINATED BY ','  (served,clicked,acted,date,flight_id,tier_id,size_id,site,area,geo_country,geo_region,geo_city,campaign_id,product_id,flight_type_id,advertiser_id,agency_id,trafficker_id,salesperson_id,exposure_policy_id,region_id,industry_id,team_id)
 
 
 
Connection ID (thread ID): 11
 
Status: NOT_KILLED
 
 
 
Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off
 
 
 
The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains
 
information that should help you find out what is causing the crash.
 
Writing a core file...
 
Working directory at /var/lib/mysql
 
Resource Limits:
 
Limit                     Soft Limit           Hard Limit           Units     
Max cpu time              unlimited            unlimited            seconds   
Max file size             unlimited            unlimited            bytes     
Max data size             unlimited            unlimited            bytes     
Max stack size            8388608              unlimited            bytes     
Max core file size        0                    unlimited            bytes     
Max resident set          unlimited            unlimited            bytes     
Max processes             126430               126430               processes 
Max open files            1048576              1048576              files     
Max locked memory         65536                65536                bytes     
Max address space         unlimited            unlimited            bytes     
Max file locks            unlimited            unlimited            locks     
Max pending signals       126430               126430               signals   
Max msgqueue size         819200               819200               bytes     
Max nice priority         0                    0                    
Max realtime priority     0                    0                    
Max realtime timeout      unlimited            unlimited            us        
Core pattern: |/usr/lib/systemd/systemd-coredump %p %u %g %s %t %c %e
 
 
 
210622  5:05:12 Columnstore: Started; Version: 5.6.1-1
 
2021-06-22  5:05:12 0 [Note] mariadbd: Aria engine: starting recovery
 
recovered pages: 0% 10% 20% 31% 41% 51% 61% 71% 81% 91% 100% (0.0 seconds); tables to flush: 3 2 1 0
 
 (0.0 seconds);

  • stacktrace in error log file

2021-06-26T05:05:52.920Z,mariadb-x5test74-pm3.us-west-2.dev.sasia.local,systemd-coredump,"Process 1769 (mariadbd) of user 988 dumped core.
 
 
 
Stack trace of thread 1769:
 
#0  0x00007f138e187ccd poll (libc.so.6)
 
#1  0x000055947099e867 _Z26handle_connections_socketsv (mariadbd)
 
#2  0x000055947099fa50 _Z11mysqld_mainiPPc (mariadbd)
 
#3  0x00007f138e0b6555 __libc_start_main (libc.so.6)
 
#4  0x0000559470993943 _start (mariadbd)
 
 
 
Stack trace of thread 26135:
 
#0  0x00007f138ec7bde2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000559471227149 _ZN5tpool19thread_pool_generic14wait_for_tasksERSt11unique_lockISt5mutexEPNS_11worker_dataE (mariadbd)
 
#2  0x000055947122780d _ZN5tpool19thread_pool_generic8get_taskEPNS_11worker_dataEPPNS_4taskE (mariadbd)
 
#3  0x000055947122900e _ZN5tpool19thread_pool_generic11worker_mainEPNS_11worker_dataE (mariadbd)
 
#4  0x00007f138e819330 n/a (libstdc++.so.6)
 
#5  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#6  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 17890:
 
#0  0x00007f138ec7bde2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000559470b62706 _ZN12Thread_cache4parkEv (mariadbd)
 
#2  0x0000559470b6220c _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#3  0x0000559470b62454 handle_one_connection (mariadbd)
 
#4  0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#5  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#6  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1770:
 
#0  0x00007f138ec7bde2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x00005594712a5646 timer_handler (mariadbd)
 
#2  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#3  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1779:
 
#0  0x00007f138e0cb58a sigwaitinfo (libc.so.6)
 
#1  0x00005594709968e3 signal_hand (mariadbd)
 
#2  0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#3  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#4  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 27311:
 
#0  0x00007f138ec7bde2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000559471227149 _ZN5tpool19thread_pool_generic14wait_for_tasksERSt11unique_lockISt5mutexEPNS_11worker_dataE (mariadbd)
 
#2  0x000055947122780d _ZN5tpool19thread_pool_generic8get_taskEPNS_11worker_dataEPPNS_4taskE (mariadbd)
 
#3  0x000055947122900e _ZN5tpool19thread_pool_generic11worker_mainEPNS_11worker_dataE (mariadbd)
 
#4  0x00007f138e819330 n/a (libstdc++.so.6)
 
#5  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#6  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 26840:
 
#0  0x00007f138ec7bde2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000559471227149 _ZN5tpool19thread_pool_generic14wait_for_tasksERSt11unique_lockISt5mutexEPNS_11worker_dataE (mariadbd)
 
#2  0x000055947122780d _ZN5tpool19thread_pool_generic8get_taskEPNS_11worker_dataEPPNS_4taskE (mariadbd)
 
#3  0x000055947122900e _ZN5tpool19thread_pool_generic11worker_mainEPNS_11worker_dataE (mariadbd)
 
#4  0x00007f138e819330 n/a (libstdc++.so.6)
 
#5  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#6  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 27246:
 
#0  0x00007f138ec7bde2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000559471227149 _ZN5tpool19thread_pool_generic14wait_for_tasksERSt11unique_lockISt5mutexEPNS_11worker_dataE (mariadbd)
 
#2  0x000055947122780d _ZN5tpool19thread_pool_generic8get_taskEPNS_11worker_dataEPPNS_4taskE (mariadbd)
 
#3  0x000055947122900e _ZN5tpool19thread_pool_generic11worker_mainEPNS_11worker_dataE (mariadbd)
 
#4  0x00007f138e819330 n/a (libstdc++.so.6)
 
#5  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#6  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 26132:
 
#0  0x00007f138ec7bde2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000559470b62706 _ZN12Thread_cache4parkEv (mariadbd)
 
#2  0x0000559470b6220c _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#3  0x0000559470b62454 handle_one_connection (mariadbd)
 
#4  0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#5  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#6  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 26227:
 
#0  0x00007f138ec7bde2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000559470b62706 _ZN12Thread_cache4parkEv (mariadbd)
 
#2  0x0000559470b6220c _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#3  0x0000559470b62454 handle_one_connection (mariadbd)
 
#4  0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#5  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#6  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1786:
 
#0  0x00007f138e187ccd poll (libc.so.6)
 
#1  0x0000559470e15f3e vio_io_wait (mariadbd)
 
#2  0x0000559470e16038 vio_socket_io_wait (mariadbd)
 
#3  0x0000559470e16104 vio_read (mariadbd)
 
#4  0x0000559470d97e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#5  0x0000559470d98d48 my_net_read_packet_reallen (mariadbd)
 
#6  0x0000559470d98e8d my_net_read_packet (mariadbd)
 
#7  0x0000559470a72b11 _Z10do_commandP3THD (mariadbd)
 
#8  0x0000559470b621b9 _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#9  0x0000559470b62454 handle_one_connection (mariadbd)
 
#10 0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#11 0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#12 0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1772:
 
#0  0x00007f138ec7bde2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000559470e7e376 my_service_thread_sleep (mariadbd)
 
#2  0x0000559470e75a7e ma_checkpoint_background (mariadbd)
 
#3  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#4  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1774:
 
#0  0x00007f138ec7ba35 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x000055947114ddf1 _ZL22buf_flush_page_cleanerPv (mariadbd)
 
#2  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#3  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1771:
 
#0  0x00007f138ec7bde2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x00007f13794dd3fa _ZN10threadpool10ThreadPool11pruneThreadEv (libthreadpool.so)
 
#2  0x00007f137a59a25a thread_proxy (libboost_thread-mt.so.1.53.0)
 
#3  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#4  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1780:
 
#0  0x00007f138ec7ba35 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000559470a5d87b handle_manager (mariadbd)
 
#2  0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#3  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#4  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1773:
 
#0  0x00007f138e18cd19 syscall (libc.so.6)
 
#1  0x000055947122b44c _ZN5tpool9aio_linux23getevent_thread_routineEPS0_ (mariadbd)
 
#2  0x00007f138e819330 n/a (libstdc++.so.6)
 
#3  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#4  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1778:
 
#0  0x00007f138ec7ba35 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000559470d6c0ff binlog_background_thread (mariadbd)
 
#2  0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#3  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#4  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1893:
 
#0  0x00007f138e187ccd poll (libc.so.6)
 
#1  0x0000559470e15f3e vio_io_wait (mariadbd)
 
#2  0x0000559470e16038 vio_socket_io_wait (mariadbd)
 
#3  0x0000559470e16104 vio_read (mariadbd)
 
#4  0x0000559470d97e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#5  0x0000559470d98d48 my_net_read_packet_reallen (mariadbd)
 
#6  0x0000559470d98e8d my_net_read_packet (mariadbd)
 
#7  0x0000559470a72b11 _Z10do_commandP3THD (mariadbd)
 
#8  0x0000559470b621b9 _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#9  0x0000559470b62454 handle_one_connection (mariadbd)
 
#10 0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#11 0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#12 0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1785:
 
#0  0x00007f138e187ccd poll (libc.so.6)
 
#1  0x0000559470e15f3e vio_io_wait (mariadbd)
 
#2  0x0000559470e16038 vio_socket_io_wait (mariadbd)
 
#3  0x0000559470e16104 vio_read (mariadbd)
 
#4  0x0000559470d97e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#5  0x0000559470d98d48 my_net_read_packet_reallen (mariadbd)
 
#6  0x0000559470d98e8d my_net_read_packet (mariadbd)
 
#7  0x0000559470a72b11 _Z10do_commandP3THD (mariadbd)
 
#8  0x0000559470b621b9 _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#9  0x0000559470b62454 handle_one_connection (mariadbd)
 
#10 0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#11 0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#12 0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1898:
 
#0  0x00007f138e187ccd poll (libc.so.6)
 
#1  0x0000559470e15f3e vio_io_wait (mariadbd)
 
#2  0x0000559470e16038 vio_socket_io_wait (mariadbd)
 
#3  0x0000559470e16104 vio_read (mariadbd)
 
#4  0x0000559470e16231 vio_read_buff (mariadbd)
 
#5  0x0000559470d97e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#6  0x0000559470d98d48 my_net_read_packet_reallen (mariadbd)
 
#7  0x0000559470c48b57 cli_safe_read_reallen (mariadbd)
 
#8  0x00005594709c0631 handle_slave_io (mariadbd)
 
#9  0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#10 0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#11 0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 26134:
 
#0  0x00007f138ec7bde2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000559471227149 _ZN5tpool19thread_pool_generic14wait_for_tasksERSt11unique_lockISt5mutexEPNS_11worker_dataE (mariadbd)
 
#2  0x000055947122780d _ZN5tpool19thread_pool_generic8get_taskEPNS_11worker_dataEPPNS_4taskE (mariadbd)
 
#3  0x000055947122900e _ZN5tpool19thread_pool_generic11worker_mainEPNS_11worker_dataE (mariadbd)
 
#4  0x00007f138e819330 n/a (libstdc++.so.6)
 
#5  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#6  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 29059:
 
#0  0x00007f138ec7bde2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000559471227149 _ZN5tpool19thread_pool_generic14wait_for_tasksERSt11unique_lockISt5mutexEPNS_11worker_dataE (mariadbd)
 
#2  0x000055947122780d _ZN5tpool19thread_pool_generic8get_taskEPNS_11worker_dataEPPNS_4taskE (mariadbd)
 
#3  0x000055947122900e _ZN5tpool19thread_pool_generic11worker_mainEPNS_11worker_dataE (mariadbd)
 
#4  0x00007f138e819330 n/a (libstdc++.so.6)
 
#5  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#6  0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 12864:
 
#0  0x00007f138e187ccd poll (libc.so.6)
 
#1  0x0000559470e15f3e vio_io_wait (mariadbd)
 
#2  0x0000559470e16038 vio_socket_io_wait (mariadbd)
 
#3  0x0000559470e16104 vio_read (mariadbd)
 
#4  0x0000559470d97e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#5  0x0000559470d98d48 my_net_read_packet_reallen (mariadbd)
 
#6  0x0000559470d98e8d my_net_read_packet (mariadbd)
 
#7  0x0000559470a72b11 _Z10do_commandP3THD (mariadbd)
 
#8  0x0000559470b621b9 _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#9  0x0000559470b62454 handle_one_connection (mariadbd)
 
#10 0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#11 0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#12 0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 5205:
 
#0  0x00007f138e187ccd poll (libc.so.6)
 
#1  0x0000559470e15f3e vio_io_wait (mariadbd)
 
#2  0x0000559470e16038 vio_socket_io_wait (mariadbd)
 
#3  0x0000559470e16104 vio_read (mariadbd)
 
#4  0x0000559470d97e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#5  0x0000559470d98d48 my_net_read_packet_reallen (mariadbd)
 
#6  0x0000559470d98e8d my_net_read_packet (mariadbd)
 
#7  0x0000559470a72b11 _Z10do_commandP3THD (mariadbd)
 
#8  0x0000559470b621b9 _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#9  0x0000559470b62454 handle_one_connection (mariadbd)
 
#10 0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#11 0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#12 0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1845:
 
#0  0x00007f138e187ccd poll (libc.so.6)
 
#1  0x0000559470e15f3e vio_io_wait (mariadbd)
 
#2  0x0000559470e16038 vio_socket_io_wait (mariadbd)
 
#3  0x0000559470e16104 vio_read (mariadbd)
 
#4  0x0000559470d97e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#5  0x0000559470d98d48 my_net_read_packet_reallen (mariadbd)
 
#6  0x0000559470d98e8d my_net_read_packet (mariadbd)
 
#7  0x0000559470a72b11 _Z10do_commandP3THD (mariadbd)
 
#8  0x0000559470b621b9 _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#9  0x0000559470b62454 handle_one_connection (mariadbd)
 
#10 0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#11 0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#12 0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8108:
 
#0  0x00007f138e187ccd poll (libc.so.6)
 
#1  0x0000559470e15f3e vio_io_wait (mariadbd)
 
#2  0x0000559470e16038 vio_socket_io_wait (mariadbd)
 
#3  0x0000559470e16104 vio_read (mariadbd)
 
#4  0x0000559470d97e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#5  0x0000559470d98d48 my_net_read_packet_reallen (mariadbd)
 
#6  0x0000559470d98e8d my_net_read_packet (mariadbd)
 
#7  0x0000559470a72b11 _Z10do_commandP3THD (mariadbd)
 
#8  0x0000559470b621b9 _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#9  0x0000559470b62454 handle_one_connection (mariadbd)
 
#10 0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#11 0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#12 0x00007f138e1929fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1899:
 
#0  0x00007f1389cfd23a _Z21ha_mcs_impl_write_rowPKhP5TABLEm (ha_columnstore.so)
 
#1  0x00007f1389cf6e7f _ZN6ha_mcs9write_rowEPKh (ha_columnstore.so)
 
#2  0x0000559470c82baf _ZN7handler12ha_write_rowEPKh (mariadbd)
 
#3  0x0000559470d8e655 _ZN14Rows_log_event9write_rowEP14rpl_group_infob (mariadbd)
 
#4  0x0000559470d8eabd _ZN20Write_rows_log_event11do_exec_rowEP14rpl_group_info (mariadbd)
 
#5  0x0000559470d84284 _ZN14Rows_log_event14do_apply_eventEP14rpl_group_info (mariadbd)
 
#6  0x00005594709b1bcf _ZL32apply_event_and_update_pos_applyP9Log_eventP3THDP14rpl_group_infoi (mariadbd)
 
#7  0x00005594709bc20c handle_slave_sql (mariadbd)
 
#8  0x0000559470eec28d pfs_spawn_thread (mariadbd)
 
#9  0x00007f138ec77ea5 start_thread (libpthread.so.0)
 
#10 0x00007f138e1929fd __clone (libc.so.6)"
 
2021-06-26T05:05:53.733Z,mariadb-x5test74-pm2.us-west-2.dev.sasia.local,systemd-coredump,"Process 8815 (mariadbd) of user 988 dumped core.
 
 
 
Stack trace of thread 8815:
 
#0  0x00007fd74dea2ccd poll (libc.so.6)
 
#1  0x00005569520ba867 _Z26handle_connections_socketsv (mariadbd)
 
#2  0x00005569520bba50 _Z11mysqld_mainiPPc (mariadbd)
 
#3  0x00007fd74ddd1555 __libc_start_main (libc.so.6)
 
#4  0x00005569520af943 _start (mariadbd)
 
 
 
Stack trace of thread 969:
 
#0  0x00007fd74e996de2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x000055695227e706 _ZN12Thread_cache4parkEv (mariadbd)
 
#2  0x000055695227e20c _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#3  0x000055695227e454 handle_one_connection (mariadbd)
 
#4  0x000055695260828d pfs_spawn_thread (mariadbd)
 
#5  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#6  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8819:
 
#0  0x00007fd74dea7d19 syscall (libc.so.6)
 
#1  0x000055695294744c _ZN5tpool9aio_linux23getevent_thread_routineEPS0_ (mariadbd)
 
#2  0x00007fd74e534330 n/a (libstdc++.so.6)
 
#3  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#4  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 25216:
 
#0  0x00007fd74e996de2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x000055695227e706 _ZN12Thread_cache4parkEv (mariadbd)
 
#2  0x000055695227e20c _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#3  0x000055695227e454 handle_one_connection (mariadbd)
 
#4  0x000055695260828d pfs_spawn_thread (mariadbd)
 
#5  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#6  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 3862:
 
#0  0x00007fd74e996de2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000556952943149 _ZN5tpool19thread_pool_generic14wait_for_tasksERSt11unique_lockISt5mutexEPNS_11worker_dataE (mariadbd)
 
#2  0x000055695294380d _ZN5tpool19thread_pool_generic8get_taskEPNS_11worker_dataEPPNS_4taskE (mariadbd)
 
#3  0x000055695294500e _ZN5tpool19thread_pool_generic11worker_mainEPNS_11worker_dataE (mariadbd)
 
#4  0x00007fd74e534330 n/a (libstdc++.so.6)
 
#5  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#6  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 852:
 
#0  0x00007fd74e996de2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x000055695227e706 _ZN12Thread_cache4parkEv (mariadbd)
 
#2  0x000055695227e20c _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#3  0x000055695227e454 handle_one_connection (mariadbd)
 
#4  0x000055695260828d pfs_spawn_thread (mariadbd)
 
#5  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#6  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8816:
 
#0  0x00007fd74e996de2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x00005569529c1646 timer_handler (mariadbd)
 
#2  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#3  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8817:
 
#0  0x00007fd74e996de2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x00007fd73909a3fa _ZN10threadpool10ThreadPool11pruneThreadEv (libthreadpool.so)
 
#2  0x00007fd73a15725a thread_proxy (libboost_thread-mt.so.1.53.0)
 
#3  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#4  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 2861:
 
#0  0x00007fd74e996de2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000556952943149 _ZN5tpool19thread_pool_generic14wait_for_tasksERSt11unique_lockISt5mutexEPNS_11worker_dataE (mariadbd)
 
#2  0x000055695294380d _ZN5tpool19thread_pool_generic8get_taskEPNS_11worker_dataEPPNS_4taskE (mariadbd)
 
#3  0x000055695294500e _ZN5tpool19thread_pool_generic11worker_mainEPNS_11worker_dataE (mariadbd)
 
#4  0x00007fd74e534330 n/a (libstdc++.so.6)
 
#5  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#6  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 2135:
 
#0  0x00007fd74e996de2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000556952943149 _ZN5tpool19thread_pool_generic14wait_for_tasksERSt11unique_lockISt5mutexEPNS_11worker_dataE (mariadbd)
 
#2  0x000055695294380d _ZN5tpool19thread_pool_generic8get_taskEPNS_11worker_dataEPPNS_4taskE (mariadbd)
 
#3  0x000055695294500e _ZN5tpool19thread_pool_generic11worker_mainEPNS_11worker_dataE (mariadbd)
 
#4  0x00007fd74e534330 n/a (libstdc++.so.6)
 
#5  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#6  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8930:
 
#0  0x00007fd74dea2ccd poll (libc.so.6)
 
#1  0x0000556952531f3e vio_io_wait (mariadbd)
 
#2  0x0000556952532038 vio_socket_io_wait (mariadbd)
 
#3  0x0000556952532104 vio_read (mariadbd)
 
#4  0x00005569524b3e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#5  0x00005569524b4d48 my_net_read_packet_reallen (mariadbd)
 
#6  0x00005569524b4e8d my_net_read_packet (mariadbd)
 
#7  0x000055695218eb11 _Z10do_commandP3THD (mariadbd)
 
#8  0x000055695227e1b9 _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#9  0x000055695227e454 handle_one_connection (mariadbd)
 
#10 0x000055695260828d pfs_spawn_thread (mariadbd)
 
#11 0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#12 0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 12368:
 
#0  0x00007fd74dea2ccd poll (libc.so.6)
 
#1  0x0000556952531f3e vio_io_wait (mariadbd)
 
#2  0x0000556952532038 vio_socket_io_wait (mariadbd)
 
#3  0x0000556952532104 vio_read (mariadbd)
 
#4  0x00005569524b3e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#5  0x00005569524b4d48 my_net_read_packet_reallen (mariadbd)
 
#6  0x00005569524b4e8d my_net_read_packet (mariadbd)
 
#7  0x000055695218eb11 _Z10do_commandP3THD (mariadbd)
 
#8  0x000055695227e1b9 _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#9  0x000055695227e454 handle_one_connection (mariadbd)
 
#10 0x000055695260828d pfs_spawn_thread (mariadbd)
 
#11 0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#12 0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8826:
 
#0  0x00007fd74e996a35 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x000055695217987b handle_manager (mariadbd)
 
#2  0x000055695260828d pfs_spawn_thread (mariadbd)
 
#3  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#4  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8824:
 
#0  0x00007fd74e996a35 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x00005569524880ff binlog_background_thread (mariadbd)
 
#2  0x000055695260828d pfs_spawn_thread (mariadbd)
 
#3  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#4  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 15216:
 
#0  0x00007fd74dea2ccd poll (libc.so.6)
 
#1  0x0000556952531f3e vio_io_wait (mariadbd)
 
#2  0x0000556952532038 vio_socket_io_wait (mariadbd)
 
#3  0x0000556952532104 vio_read (mariadbd)
 
#4  0x00005569524b3e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#5  0x00005569524b4d48 my_net_read_packet_reallen (mariadbd)
 
#6  0x00005569524b4e8d my_net_read_packet (mariadbd)
 
#7  0x000055695218eb11 _Z10do_commandP3THD (mariadbd)
 
#8  0x000055695227e1b9 _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#9  0x000055695227e454 handle_one_connection (mariadbd)
 
#10 0x000055695260828d pfs_spawn_thread (mariadbd)
 
#11 0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#12 0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 1557:
 
#0  0x00007fd74e996de2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000556952943149 _ZN5tpool19thread_pool_generic14wait_for_tasksERSt11unique_lockISt5mutexEPNS_11worker_dataE (mariadbd)
 
#2  0x000055695294380d _ZN5tpool19thread_pool_generic8get_taskEPNS_11worker_dataEPPNS_4taskE (mariadbd)
 
#3  0x000055695294500e _ZN5tpool19thread_pool_generic11worker_mainEPNS_11worker_dataE (mariadbd)
 
#4  0x00007fd74e534330 n/a (libstdc++.so.6)
 
#5  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#6  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8818:
 
#0  0x00007fd74e996de2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x000055695259a376 my_service_thread_sleep (mariadbd)
 
#2  0x0000556952591a7e ma_checkpoint_background (mariadbd)
 
#3  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#4  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8825:
 
#0  0x00007fd74dde658a sigwaitinfo (libc.so.6)
 
#1  0x00005569520b28e3 signal_hand (mariadbd)
 
#2  0x000055695260828d pfs_spawn_thread (mariadbd)
 
#3  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#4  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 2860:
 
#0  0x00007fd74e996de2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000556952943149 _ZN5tpool19thread_pool_generic14wait_for_tasksERSt11unique_lockISt5mutexEPNS_11worker_dataE (mariadbd)
 
#2  0x000055695294380d _ZN5tpool19thread_pool_generic8get_taskEPNS_11worker_dataEPPNS_4taskE (mariadbd)
 
#3  0x000055695294500e _ZN5tpool19thread_pool_generic11worker_mainEPNS_11worker_dataE (mariadbd)
 
#4  0x00007fd74e534330 n/a (libstdc++.so.6)
 
#5  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#6  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8820:
 
#0  0x00007fd74e996a35 pthread_cond_wait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000556952869df1 _ZL22buf_flush_page_cleanerPv (mariadbd)
 
#2  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#3  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8829:
 
#0  0x00007fd74dea2ccd poll (libc.so.6)
 
#1  0x0000556952531f3e vio_io_wait (mariadbd)
 
#2  0x0000556952532038 vio_socket_io_wait (mariadbd)
 
#3  0x0000556952532104 vio_read (mariadbd)
 
#4  0x00005569524b3e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#5  0x00005569524b4d48 my_net_read_packet_reallen (mariadbd)
 
#6  0x00005569524b4e8d my_net_read_packet (mariadbd)
 
#7  0x000055695218eb11 _Z10do_commandP3THD (mariadbd)
 
#8  0x000055695227e1b9 _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#9  0x000055695227e454 handle_one_connection (mariadbd)
 
#10 0x000055695260828d pfs_spawn_thread (mariadbd)
 
#11 0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#12 0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 855:
 
#0  0x00007fd74e996de2 pthread_cond_timedwait@@GLIBC_2.3.2 (libpthread.so.0)
 
#1  0x0000556952943149 _ZN5tpool19thread_pool_generic14wait_for_tasksERSt11unique_lockISt5mutexEPNS_11worker_dataE (mariadbd)
 
#2  0x000055695294380d _ZN5tpool19thread_pool_generic8get_taskEPNS_11worker_dataEPPNS_4taskE (mariadbd)
 
#3  0x000055695294500e _ZN5tpool19thread_pool_generic11worker_mainEPNS_11worker_dataE (mariadbd)
 
#4  0x00007fd74e534330 n/a (libstdc++.so.6)
 
#5  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#6  0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 20088:
 
#0  0x00007fd74dea2ccd poll (libc.so.6)
 
#1  0x0000556952531f3e vio_io_wait (mariadbd)
 
#2  0x0000556952532038 vio_socket_io_wait (mariadbd)
 
#3  0x0000556952532104 vio_read (mariadbd)
 
#4  0x00005569524b3e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#5  0x00005569524b4d48 my_net_read_packet_reallen (mariadbd)
 
#6  0x00005569524b4e8d my_net_read_packet (mariadbd)
 
#7  0x000055695218eb11 _Z10do_commandP3THD (mariadbd)
 
#8  0x000055695227e1b9 _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#9  0x000055695227e454 handle_one_connection (mariadbd)
 
#10 0x000055695260828d pfs_spawn_thread (mariadbd)
 
#11 0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#12 0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8876:
 
#0  0x00007fd74dea2ccd poll (libc.so.6)
 
#1  0x0000556952531f3e vio_io_wait (mariadbd)
 
#2  0x0000556952532038 vio_socket_io_wait (mariadbd)
 
#3  0x0000556952532104 vio_read (mariadbd)
 
#4  0x00005569524b3e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#5  0x00005569524b4d48 my_net_read_packet_reallen (mariadbd)
 
#6  0x00005569524b4e8d my_net_read_packet (mariadbd)
 
#7  0x000055695218eb11 _Z10do_commandP3THD (mariadbd)
 
#8  0x000055695227e1b9 _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#9  0x000055695227e454 handle_one_connection (mariadbd)
 
#10 0x000055695260828d pfs_spawn_thread (mariadbd)
 
#11 0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#12 0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8928:
 
#0  0x00007fd74dea2ccd poll (libc.so.6)
 
#1  0x0000556952531f3e vio_io_wait (mariadbd)
 
#2  0x0000556952532038 vio_socket_io_wait (mariadbd)
 
#3  0x0000556952532104 vio_read (mariadbd)
 
#4  0x0000556952532231 vio_read_buff (mariadbd)
 
#5  0x00005569524b3e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#6  0x00005569524b4d48 my_net_read_packet_reallen (mariadbd)
 
#7  0x0000556952364b57 cli_safe_read_reallen (mariadbd)
 
#8  0x00005569520dc631 handle_slave_io (mariadbd)
 
#9  0x000055695260828d pfs_spawn_thread (mariadbd)
 
#10 0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#11 0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8830:
 
#0  0x00007fd74dea2ccd poll (libc.so.6)
 
#1  0x0000556952531f3e vio_io_wait (mariadbd)
 
#2  0x0000556952532038 vio_socket_io_wait (mariadbd)
 
#3  0x0000556952532104 vio_read (mariadbd)
 
#4  0x00005569524b3e9b _ZL12my_real_readP6st_netPmc (mariadbd)
 
#5  0x00005569524b4d48 my_net_read_packet_reallen (mariadbd)
 
#6  0x00005569524b4e8d my_net_read_packet (mariadbd)
 
#7  0x000055695218eb11 _Z10do_commandP3THD (mariadbd)
 
#8  0x000055695227e1b9 _Z24do_handle_one_connectionP7CONNECTb (mariadbd)
 
#9  0x000055695227e454 handle_one_connection (mariadbd)
 
#10 0x000055695260828d pfs_spawn_thread (mariadbd)
 
#11 0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#12 0x00007fd74dead9fd __clone (libc.so.6)
 
 
 
Stack trace of thread 8929:
 
#0  0x00007fd749a1823a _Z21ha_mcs_impl_write_rowPKhP5TABLEm (ha_columnstore.so)
 
#1  0x00007fd749a11e7f _ZN6ha_mcs9write_rowEPKh (ha_columnstore.so)
 
#2  0x000055695239ebaf _ZN7handler12ha_write_rowEPKh (mariadbd)
 
#3  0x00005569524aa655 _ZN14Rows_log_event9write_rowEP14rpl_group_infob (mariadbd)
 
#4  0x00005569524aaabd _ZN20Write_rows_log_event11do_exec_rowEP14rpl_group_info (mariadbd)
 
#5  0x00005569524a0284 _ZN14Rows_log_event14do_apply_eventEP14rpl_group_info (mariadbd)
 
#6  0x00005569520cdbcf _ZL32apply_event_and_update_pos_applyP9Log_eventP3THDP14rpl_group_infoi (mariadbd)
 
#7  0x00005569520d820c handle_slave_sql (mariadbd)
 
#8  0x000055695260828d pfs_spawn_thread (mariadbd)
 
#9  0x00007fd74e992ea5 start_thread (libpthread.so.0)
 
#10 0x00007fd74dead9fd __clone (libc.so.6)"

  • DDL for cpimport job. 

    CREATE TABLE future_bigsum_tmp ( date date not null,
    		 
    flight_id int(11) not null,
    		 
    tier_id int(11) not null default '0',
    		 
    size_id int(11) not null default '0',
    		 
    site int(11) not null default '0',
    		 
    area int(11) not null default '0',
    		 
    geo_country int(11) not null default '0',
    		 
    geo_region int(11) not null default '0',
    		 
    geo_city int(11) not null default '0',
    		 
    campaign_id int(11) DEFAULT NULL,
    		 
    product_id int(11) DEFAULT NULL,
    		 
    flight_type_id int(11) DEFAULT NULL,
    		 
    advertiser_id int(11) DEFAULT NULL,
    		 
    agency_id int(11) DEFAULT NULL,
    		 
    trafficker_id int(11) DEFAULT NULL,
    		 
    salesperson_id int(11) DEFAULT NULL,
    		 
    exposure_policy_id int(11) DEFAULT NULL,
    		 
    region_id int(11) DEFAULT NULL,
    		 
    industry_id int(11) DEFAULT NULL,
    		 
    team_id int(11) DEFAULT 0,
    		 
    served bigint(20) not null default '0',
    		 
    clicked bigint(20) not null default '0',
    		 
    acted bigint(20) not null default '0') ENGINE=Columnstore;

Proposed to start the server with innodb_recovery_mode 1 to 6, but didn't work out.
Also tried to reproduce this crash, cpimport with test data worked just fine.
Generated at Thu Feb 08 02:53:08 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.