2020-12-12 13:09:12 215 [Note] WSREP: Starting applier thread 215 /usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x55cc330dfdae] /usr/sbin/mysqld(handle_fatal_signal+0x54d)[0x55cc32bd7e0d] /lib64/libpthread.so.0(+0x12dd0)[0x7f966c768dd0] /usr/sbin/mysqld(wsrep_thd_LOCK+0x14)[0x55cc32b5b124] /usr/sbin/mysqld(+0xa568f8)[0x55cc32d708f8] /usr/sbin/mysqld(+0xa9c7d2)[0x55cc32db67d2] /usr/sbin/mysqld(+0xa9f56c)[0x55cc32db956c] /usr/sbin/mysqld(+0xaa4882)[0x55cc32dbe882] /usr/sbin/mysqld(+0xb2afc6)[0x55cc32e44fc6] /usr/sbin/mysqld(+0xb31314)[0x55cc32e4b314] /usr/sbin/mysqld(+0xa5f9f8)[0x55cc32d799f8] /usr/sbin/mysqld(_ZN7handler10ha_rnd_posEPhS0_+0x77)[0x55cc32bde087] /usr/sbin/mysqld(_ZN14Rows_log_event8find_rowEP14rpl_group_info+0x675)[0x55cc32ccff55] /usr/sbin/mysqld(_ZN21Delete_rows_log_event11do_exec_rowEP14rpl_group_info+0x92)[0x55cc32cd0092] /usr/sbin/mysqld(_ZN14Rows_log_event14do_apply_eventEP14rpl_group_info+0x23c)[0x55cc32cc368c] /usr/sbin/mysqld(_Z18wsrep_apply_eventsP3THDP14Relay_log_infoPKvm+0x1c4)[0x55cc32b52e94] /usr/sbin/mysqld(_ZN21Wsrep_applier_service15apply_write_setERKN5wsrep7ws_metaERKNS0_12const_bufferERNS0_14mutable_bufferE+0x9c)[0x55cc32b3c26c] /usr/sbin/mysqld(+0xe59a22)[0x55cc33173a22] /usr/sbin/mysqld(_ZN5wsrep12server_state8on_applyERNS_21high_priority_serviceERKNS_9ws_handleERKNS_7ws_metaERKNS_12const_bufferE+0x15d)[0x55cc3317467d] /usr/sbin/mysqld(+0xe6e054)[0x55cc33188054] src/trx_handle.cpp:387(galera::TrxHandleSlave::apply(void*, wsrep_cb_status (*)(void*, wsrep_ws_handle const*, unsigned int, wsrep_buf const*, wsrep_trx_meta const*, bool*), wsrep_trx_meta const&, bool&))[0x7f96624e0224] src/replicator_smm.cpp:504(galera::ReplicatorSMM::apply_trx(void*, galera::TrxHandleSlave&))[0x7f966251de88] src/gu_logger.hpp:96(galera::ReplicatorSMM::process_IST_writeset(void*, boost::shared_ptr const&))[0x7f966252c9ef] src/replicator_str.cpp:1155(galera::ReplicatorSMM::recv_IST(void*))[0x7f966252eff1] src/replicator_smm.cpp:396(galera::ReplicatorSMM::async_recv(void*))[0x7f966252319b] src/wsrep_provider.cpp:263(galera_recv)[0x7f9662538528] /usr/sbin/mysqld(_ZN5wsrep18wsrep_provider_v2611run_applierEPNS_21high_priority_serviceE+0xe)[0x55cc3318871e] /usr/sbin/mysqld(+0x83ac7f)[0x55cc32b54c7f] /usr/sbin/mysqld(_Z15start_wsrep_THDPv+0x388)[0x55cc32b47258] /usr/sbin/mysqld(+0xd769ba)[0x55cc330909ba] pthread_create.c:0(start_thread)[0x7f966c75e2de] :0(__GI___clone)[0x7f966a8ec4b3] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x7f960538c513): DELETE FROM temp WHERE code = 24 AND url = 'Link 30' Connection ID (thread ID): 48 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /var/lib/mysql Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size unlimited unlimited bytes Max resident set unlimited unlimited bytes Max processes 376958 376958 processes Max open files 16384 16384 files Max locked memory 16777216 16777216 bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 376958 376958 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h %e INSERT Version: '10.4.17-MariaDB-log' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server 2020-12-12 15:00:40 76 [ERROR] InnoDB: Conflicting lock on table: `production`.`temp` index: temp_uindex that has lock RECORD LOCKS space id 4342281 page no 239 n bits 1936 index temp_uindex of table `production`.`temp` trx id 9452292933 lock_mode X locks rec but not gap Record lock, heap no 343 PHYSICAL RECORD: n_fields 5; compact format; info bits 32 0: len 4; hex 80000073; asc s;; 1: len 6; hex 436f6e203230; asc Con 20;; 2: len 6; hex 800000021d4c; asc L;; 3: len 6; hex 800000020000; asc ;; 4: len 4; hex 84c2d682; asc ;; 2020-12-12 15:00:40 76 [ERROR] InnoDB: WSREP state: 2020-12-12 15:00:40 76 [ERROR] WSREP: Thread BF trx_id: 9452292945 thread: 76 seqno: 14510 client_state: exec client_mode: high priority transaction_mode: executing applier: 1 toi: 0 local: 0 query: INSERT INTO temp( 2020-12-12 15:00:40 76 [ERROR] WSREP: Thread BF trx_id: 9452292933 thread: 113 seqno: 14515 client_state: exec client_mode: high priority transaction_mode: committing applier: 1 toi: 0 local: 0 query: NULL 2020-12-12 15:00:40 0x7f27d21be700 InnoDB: Assertion failure in file /home/buildbot/buildbot/padding_for_CPACK_RPM_BUILD_SOURCE_DIRS_PREFIX/mariadb-10.4.17/storage/innobase/lock/lock0lock.cc line 687 InnoDB: We intentionally generate a memory trap. InnoDB: Submit a detailed bug report to https://jira.mariadb.org/ InnoDB: If you get repeated assertion failures or crashes, even InnoDB: immediately after the mysqld startup, there may be InnoDB: corruption in the InnoDB tablespace. Please refer to InnoDB: https://mariadb.com/kb/en/library/innodb-recovery-modes/ InnoDB: about forcing recovery. 201212 15:00:40 [ERROR] mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.4.17-MariaDB-log key_buffer_size=262144 read_buffer_size=262144 max_used_connections=0 max_threads=102 thread_count=215 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 133313 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7f25e4000c08 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f27d21bdcc8 thread_stack 0x40000 /usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x5605e2d0bdae] /usr/sbin/mysqld(handle_fatal_signal+0x54d)[0x5605e2803e0d] sigaction.c:0(__restore_rt)[0x7f312c3b6dd0] :0(__GI_raise)[0x7f312a47599f] :0(__GI_abort)[0x7f312a45fcf5] /usr/sbin/mysqld(+0x5afd27)[0x5605e24f5d27] /usr/sbin/mysqld(+0x58e825)[0x5605e24d4825] /usr/sbin/mysqld(+0xa9f536)[0x5605e29e5536] /usr/sbin/mysqld(+0xaa4882)[0x5605e29ea882] /usr/sbin/mysqld(+0xaa550b)[0x5605e29eb50b] /usr/sbin/mysqld(+0xafea22)[0x5605e2a44a22] /usr/sbin/mysqld(+0xb0365e)[0x5605e2a4965e] /usr/sbin/mysqld(+0xb03d05)[0x5605e2a49d05] /usr/sbin/mysqld(+0xb15c4b)[0x5605e2a5bc4b] /usr/sbin/mysqld(+0xa5f1c6)[0x5605e29a51c6] /usr/sbin/mysqld(_ZN7handler12ha_write_rowEPKh+0x1df)[0x5605e281045f] /usr/sbin/mysqld(_ZN14Rows_log_event9write_rowEP14rpl_group_infob+0x16d)[0x5605e28fb06d] /usr/sbin/mysqld(_ZN20Write_rows_log_event11do_exec_rowEP14rpl_group_info+0x7d)[0x5605e28fb60d] /usr/sbin/mysqld(_ZN14Rows_log_event14do_apply_eventEP14rpl_group_info+0x23c)[0x5605e28ef68c] /usr/sbin/mysqld(_Z18wsrep_apply_eventsP3THDP14Relay_log_infoPKvm+0x1c4)[0x5605e277ee94] /usr/sbin/mysqld(_ZN21Wsrep_applier_service15apply_write_setERKN5wsrep7ws_metaERKNS0_12const_bufferERNS0_14mutable_bufferE+0x9c)[0x5605e276826c] /usr/sbin/mysqld(+0xe59a22)[0x5605e2d9fa22] /usr/sbin/mysqld(_ZN5wsrep12server_state8on_applyERNS_21high_priority_serviceERKNS_9ws_handleERKNS_7ws_metaERKNS_12const_bufferE+0x15d)[0x5605e2da067d] /usr/sbin/mysqld(+0xe6e054)[0x5605e2db4054] src/trx_handle.cpp:387(galera::TrxHandleSlave::apply(void*, wsrep_cb_status (*)(void*, wsrep_ws_handle const*, unsigned int, wsrep_buf const*, wsrep_trx_meta const*, bool*), wsrep_trx_meta const&, bool&))[0x7f3123d33224] src/replicator_smm.cpp:504(galera::ReplicatorSMM::apply_trx(void*, galera::TrxHandleSlave&))[0x7f3123d70e88] src/gu_logger.hpp:96(galera::ReplicatorSMM::process_IST_writeset(void*, boost::shared_ptr const&))[0x7f3123d7f9ef] src/replicator_str.cpp:1155(galera::ReplicatorSMM::recv_IST(void*))[0x7f3123d81ff1] src/replicator_smm.cpp:396(galera::ReplicatorSMM::async_recv(void*))[0x7f3123d7619b] src/wsrep_provider.cpp:263(galera_recv)[0x7f3123d8b528] /usr/sbin/mysqld(_ZN5wsrep18wsrep_provider_v2611run_applierEPNS_21high_priority_serviceE+0xe)[0x5605e2db471e] /usr/sbin/mysqld(+0x83ac7f)[0x5605e2780c7f] /usr/sbin/mysqld(_Z15start_wsrep_THDPv+0x388)[0x5605e2773258] pthread_create.c:0(start_thread)[0x7f312c3ac2de] :0(__GI___clone)[0x7f312a53a4b3] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x7f303c4ba373): INSERT INTO temp Connection ID (thread ID): 76 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /var/lib/mysql Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size unlimited unlimited bytes Max resident set unlimited unlimited bytes Max processes 376958 376958 processes Max open files 1048576 1048576 files Max locked memory unlimited unlimited bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 376958 376958 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h %e