2023-10-29 20:00:59 0 [Note] Starting MariaDB 10.11.4-MariaDB-1~deb12u1 source revision as process 2198129 2023-10-29 20:00:59 0 [Warning] You need to use --log-bin to make --log-slave-updates work. 2023-10-29 20:00:59 0 [Warning] You need to use --log-bin to make --binlog-format work. 2023-10-29 20:00:59 0 [Note] Initializing built-in plugins 2023-10-29 20:00:59 0 [Note] Initializing plugins specified on the command line 2023-10-29 20:00:59 0 [Note] Loaded 'type_mysql_json.so' with offset 0x7feb1d00e000 2023-10-29 20:00:59 0 [Note] InnoDB: Compressed tables use zlib 1.2.13 2023-10-29 20:00:59 0 [Note] InnoDB: Number of transaction pools: 1 2023-10-29 20:00:59 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions 2023-10-29 20:00:59 0 [Note] InnoDB: Using liburing 2023-10-29 20:00:59 0 [Note] InnoDB: Initializing buffer pool, total size = 60.000GiB, chunk size = 0.938GiB 2023-10-29 20:01:00 0 [Note] InnoDB: Completed initialization of buffer pool 2023-10-29 20:01:00 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2023-10-29 20:01:00 0 [Note] InnoDB: 128 rollback segments are active. 2023-10-29 20:01:00 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... 2023-10-29 20:01:00 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. 2023-10-29 20:01:00 0 [Note] InnoDB: log sequence number 285888507463469; transaction id 287199910236 2023-10-29 20:01:00 0 [Note] Plugin 'FEEDBACK' is disabled. 2023-10-29 20:01:00 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2023-10-29 20:01:00 0 [Note] Initializing installed plugins 2023-10-29 20:01:00 0 [Note] Loaded 'ha_archive.so' with offset 0x7feb1c0fc000 2023-10-29 20:01:00 0 [Note] Server socket created on IP: '0.0.0.0'. 2023-10-29 20:01:00 0 [Note] Server socket created on IP: '0.0.0.0'. 2023-10-29 20:01:00 0 [Note] Reading of all Master_info entries succeeded 2023-10-29 20:01:00 0 [Note] Added new Master_info '' to hash table 2023-10-29 20:01:00 0 [Warning] Recovery from master pos 707192892 and file mysql-bin.077798. 2023-10-29 20:01:00 4 [Note] Slave I/O thread: Start asynchronous replication to master 'repl@master.server:3306' in log 'mysql-bin.077798' at position 707192892 2023-10-29 20:01:00 0 [Note] /usr/sbin/mariadbd: ready for connections. Version: '10.11.4-MariaDB-1~deb12u1' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Debian 12 2023-10-29 20:01:00 5 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.077798' at position 707192892, relay log '/var/lib/mysql/replica-relay-bin.000001' position: 4; GTID position '0-9-97481947334' 2023-10-29 20:01:00 4 [Note] Slave I/O thread: connected to master 'repl@master.server:3306',replication starts at GTID position '0-9-97481947334' 2023-10-29 20:02:30 0 [Note] InnoDB: Buffer pool(s) load completed at 231029 20:02:30 2023-10-30 0:56:13 5 [Note] InnoDB: Online DDL : Start reading clustered index of the table and create temporary files 2023-10-30 0:56:13 5 [Note] InnoDB: Online DDL : End of reading clustered index of the table and create temporary files 2023-10-30 0:56:13 5 [Note] InnoDB: Online DDL : Applying log to index 2023-10-30 5:41:01 5 [Note] InnoDB: Online DDL : Start reading clustered index of the table and create temporary files 2023-10-30 5:41:01 5 [Note] InnoDB: Online DDL : End of reading clustered index of the table and create temporary files 231030 10:54:21 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.11.4-MariaDB-1~deb12u1 source revision: key_buffer_size=268435456 read_buffer_size=67108864 max_used_connections=86 max_threads=2059 thread_count=88 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 137363640 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7fd924000c68 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7fda05fe2cb8 thread_stack 0x1000000 /usr/sbin/mariadbd(my_print_stacktrace+0x2e)[0x55ef1fe384ae] /usr/sbin/mariadbd(handle_fatal_signal+0x2c3)[0x55ef1f9a5e03] /lib/x86_64-linux-gnu/libc.so.6(+0x3bfd0)[0x7feb2145afd0] /usr/sbin/mariadbd(_Z16best_access_pathP4JOINP13st_join_tableyPK8POSITIONjbdPS3_S6_+0x10bf)[0x55ef1f7b61df] /usr/sbin/mariadbd(+0x83be94)[0x55ef1f7b8e94] /usr/sbin/mariadbd(+0x8403fa)[0x55ef1f7bd3fa] /usr/sbin/mariadbd(_Z11choose_planP4JOINy+0x318)[0x55ef1f7be9e8] /usr/sbin/mariadbd(_ZN13st_join_table21choose_best_splittingEjyPK8POSITIONPy+0xc0e)[0x55ef1f929f7e] /usr/sbin/mariadbd(_Z16best_access_pathP4JOINP13st_join_tableyPK8POSITIONjbdPS3_S6_+0x170)[0x55ef1f7b5290] /usr/sbin/mariadbd(+0x83be94)[0x55ef1f7b8e94] /usr/sbin/mariadbd(+0x8403fa)[0x55ef1f7bd3fa] /usr/sbin/mariadbd(+0x84129f)[0x55ef1f7be29f] /usr/sbin/mariadbd(_Z11choose_planP4JOINy+0x318)[0x55ef1f7be9e8] /usr/sbin/mariadbd(+0x86375f)[0x55ef1f7e075f] /usr/sbin/mariadbd(_ZN4JOIN14optimize_innerEv+0x1395)[0x55ef1f7e5505] /usr/sbin/mariadbd(_ZN4JOIN8optimizeEv+0xaa)[0x55ef1f7e5a9a] /usr/sbin/mariadbd(+0x7b207e)[0x55ef1f72f07e] /usr/sbin/mariadbd(_Z27mysql_handle_single_derivedP3LEXP10TABLE_LISTj+0xa2)[0x55ef1f72e8a2] /usr/sbin/mariadbd(_ZN13st_select_lex14handle_derivedEP3LEXj+0x47)[0x55ef1f74a6a7] /usr/sbin/mariadbd(_ZN4JOIN14optimize_innerEv+0x10d6)[0x55ef1f7e5246] /usr/sbin/mariadbd(_ZN4JOIN8optimizeEv+0xaa)[0x55ef1f7e5a9a] /usr/sbin/mariadbd(_Z12mysql_selectP3THDP10TABLE_LISTR4ListI4ItemEPS4_jP8st_orderS9_S7_S9_yP13select_resultP18st_select_lex_unitP13st_select_lex+0xca)[0x55ef1f7e5b7a] /usr/sbin/mariadbd(_Z13handle_selectP3THDP3LEXP13select_resulty+0x13f)[0x55ef1f7e635f] /usr/sbin/mariadbd(+0x7e8fa0)[0x55ef1f765fa0] /usr/sbin/mariadbd(_Z21mysql_execute_commandP3THDb+0x3dc5)[0x55ef1f772865] /usr/sbin/mariadbd(_ZN18Prepared_statement7executeEP6Stringb+0x522)[0x55ef1f794f22] /usr/sbin/mariadbd(_ZN18Prepared_statement12execute_loopEP6StringbPhS2_+0x95)[0x55ef1f7950b5] /usr/sbin/mariadbd(+0x818f25)[0x55ef1f795f25] /usr/sbin/mariadbd(_Z19mysqld_stmt_executeP3THDPcj+0x2b)[0x55ef1f7960ab] /usr/sbin/mariadbd(_Z16dispatch_command19enum_server_commandP3THDPcjb+0x1911)[0x55ef1f776561] /usr/sbin/mariadbd(_Z10do_commandP3THDb+0x137)[0x55ef1f777267] /usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x3b7)[0x55ef1f887f27] /usr/sbin/mariadbd(handle_one_connection+0x5d)[0x55ef1f8882bd] /usr/sbin/mariadbd(+0xc2dc50)[0x55ef1fbaac50] /lib/x86_64-linux-gnu/libc.so.6(+0x89044)[0x7feb214a8044] /lib/x86_64-linux-gnu/libc.so.6(+0x10961c)[0x7feb2152861c] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. ***REMOVED QUERY Connection ID (thread ID): 4827439 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=on,index_condition_pushdown=on,derived_merge=on,derived_with_keys=off,firstmatch=on,loosescan=on,materialization=on,in_to_exists=off,semijoin=off,partial_match_rowid_merge=off,partial_match_table_scan=off,subquery_cache=off,mrr=on,mrr_cost_based=on,mrr_sort_keys=off,outer_join_with_cache=off,semijoin_with_cache=off,join_cache_incremental=off,join_cache_hashed=off,join_cache_bka=off,optimize_join_buffer_size=off,table_elimination=off,extended_keys=off,exists_to_in=off,orderby_uses_equalities=off,condition_pushdown_for_derived=off,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off,hash_join_cardinality=off The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /var/lib/mysql Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size 0 unlimited bytes Max resident set unlimited unlimited bytes Max processes 1030206 1030206 processes Max open files 1000000 1000000 files Max locked memory unlimited unlimited bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 1030206 1030206 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: core Kernel version: Linux version 6.1.0-13-amd64 (debian-kernel@lists.debian.org) (gcc-12 (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC Debian 6.1.55-1 (2023-09-29) 2023-10-30 10:54:48 0 [Note] Starting MariaDB 10.11.4-MariaDB-1~deb12u1 source revision as process 1445772 2023-10-30 10:54:48 0 [Warning] You need to use --log-bin to make --log-slave-updates work. 2023-10-30 10:54:48 0 [Warning] You need to use --log-bin to make --binlog-format work. 2023-10-30 10:54:48 0 [Note] Initializing built-in plugins 2023-10-30 10:54:48 0 [Note] Initializing plugins specified on the command line 2023-10-30 10:54:48 0 [Note] Loaded 'type_mysql_json.so' with offset 0x7fbce565e000 2023-10-30 10:54:48 0 [Note] InnoDB: Compressed tables use zlib 1.2.13 2023-10-30 10:54:48 0 [Note] InnoDB: Number of transaction pools: 1 2023-10-30 10:54:48 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions 2023-10-30 10:54:48 0 [Note] InnoDB: Using liburing 2023-10-30 10:54:48 0 [Note] InnoDB: Initializing buffer pool, total size = 60.000GiB, chunk size = 0.938GiB 2023-10-30 10:54:48 0 [Note] InnoDB: Completed initialization of buffer pool 2023-10-30 10:54:48 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2023-10-30 10:54:48 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=285923902325922 2023-10-30 10:54:56 0 [Note] InnoDB: Starting final batch to recover 216146 pages from redo log. 2023-10-30 10:55:03 0 [Note] InnoDB: To recover: 115979 pages from log 2023-10-30 10:55:10 0 [Note] InnoDB: Last binlog file '/var/log/mysql/mysql-bin.076850', position 750130032 2023-10-30 10:55:10 0 [Note] InnoDB: 128 rollback segments are active. 2023-10-30 10:55:10 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1" 2023-10-30 10:55:10 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... 2023-10-30 10:55:10 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. 2023-10-30 10:55:10 0 [Note] InnoDB: log sequence number 285925131040093; transaction id 287515279503 2023-10-30 10:55:10 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2023-10-30 10:55:10 0 [Note] Plugin 'FEEDBACK' is disabled. 2023-10-30 10:55:10 0 [Note] Initializing installed plugins 2023-10-30 10:55:10 0 [Note] Loaded 'ha_archive.so' with offset 0x7fbce4150000 2023-10-30 10:55:10 0 [Note] Server socket created on IP: '0.0.0.0'. 2023-10-30 10:55:10 0 [Note] Server socket created on IP: '0.0.0.0'. 2023-10-30 10:55:10 1 [ERROR] mariadbd: Table './mysql/gtid_slave_pos' is marked as crashed and should be repaired 2023-10-30 10:55:10 1 [Warning] Checking table: './mysql/gtid_slave_pos' 2023-10-30 10:55:10 1 [Warning] mysql.gtid_slave_pos: 1 client is using or hasn't closed the table properly 2023-10-30 10:55:10 1 [Note] mysql.gtid_slave_pos: Table is fixed 2023-10-30 10:55:10 0 [Note] Reading of all Master_info entries succeeded 2023-10-30 10:55:10 0 [Note] Added new Master_info '' to hash table 2023-10-30 10:55:10 0 [Warning] Recovery from master pos 4 and file mysql-bin.077930. 2023-10-30 10:55:10 4 [Note] Slave I/O thread: Start asynchronous replication to master 'repl@master.server:3306' in log 'mysql-bin.077930' at position 4 2023-10-30 10:55:10 5 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.077930' at position 4, relay log '/var/lib/mysql/replica-relay-bin.000001' position: 4; GTID position '0-9-97790819459' 2023-10-30 10:55:10 0 [Note] /usr/sbin/mariadbd: ready for connections. Version: '10.11.4-MariaDB-1~deb12u1' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Debian 12 2023-10-30 10:55:10 4 [Note] Slave I/O thread: connected to master 'repl@master.server:3306',replication starts at GTID position '0-9-97790819459' 2023-10-30 10:55:29 5 [ERROR] mariadbd: Table 'partner_logparser_2023' is marked as crashed and should be repaired 231030 10:56:16 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.11.4-MariaDB-1~deb12u1 source revision: key_buffer_size=268435456 read_buffer_size=67108864 max_used_connections=22 max_threads=2059 thread_count=24 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 137363640 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7faccc0a0168 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7fad99dd6cb8 thread_stack 0x1000000 /usr/sbin/mariadbd(my_print_stacktrace+0x2e)[0x5631ad3094ae] /usr/sbin/mariadbd(handle_fatal_signal+0x2c3)[0x5631ace76e03] /lib/x86_64-linux-gnu/libc.so.6(+0x3bfd0)[0x7fbce6c5afd0] /usr/sbin/mariadbd(_Z16best_access_pathP4JOINP13st_join_tableyPK8POSITIONjbdPS3_S6_+0x10bf)[0x5631acc871df] /usr/sbin/mariadbd(+0x83be94)[0x5631acc89e94] /usr/sbin/mariadbd(+0x8403fa)[0x5631acc8e3fa] /usr/sbin/mariadbd(_Z11choose_planP4JOINy+0x318)[0x5631acc8f9e8] /usr/sbin/mariadbd(_ZN13st_join_table21choose_best_splittingEjyPK8POSITIONPy+0xc0e)[0x5631acdfaf7e] /usr/sbin/mariadbd(_Z16best_access_pathP4JOINP13st_join_tableyPK8POSITIONjbdPS3_S6_+0x170)[0x5631acc86290] /usr/sbin/mariadbd(+0x83be94)[0x5631acc89e94] /usr/sbin/mariadbd(+0x8403fa)[0x5631acc8e3fa] /usr/sbin/mariadbd(+0x84129f)[0x5631acc8f29f] /usr/sbin/mariadbd(_Z11choose_planP4JOINy+0x318)[0x5631acc8f9e8] /usr/sbin/mariadbd(+0x86375f)[0x5631accb175f] /usr/sbin/mariadbd(_ZN4JOIN14optimize_innerEv+0x1395)[0x5631accb6505] /usr/sbin/mariadbd(_ZN4JOIN8optimizeEv+0xaa)[0x5631accb6a9a] /usr/sbin/mariadbd(+0x7b207e)[0x5631acc0007e] /usr/sbin/mariadbd(_Z27mysql_handle_single_derivedP3LEXP10TABLE_LISTj+0xa2)[0x5631acbff8a2] /usr/sbin/mariadbd(_ZN13st_select_lex14handle_derivedEP3LEXj+0x47)[0x5631acc1b6a7] /usr/sbin/mariadbd(_ZN4JOIN14optimize_innerEv+0x10d6)[0x5631accb6246] /usr/sbin/mariadbd(_ZN4JOIN8optimizeEv+0xaa)[0x5631accb6a9a] /usr/sbin/mariadbd(_Z12mysql_selectP3THDP10TABLE_LISTR4ListI4ItemEPS4_jP8st_orderS9_S7_S9_yP13select_resultP18st_select_lex_unitP13st_select_lex+0xca)[0x5631accb6b7a] /usr/sbin/mariadbd(_Z13handle_selectP3THDP3LEXP13select_resulty+0x13f)[0x5631accb735f] /usr/sbin/mariadbd(+0x7e8fa0)[0x5631acc36fa0] /usr/sbin/mariadbd(_Z21mysql_execute_commandP3THDb+0x3dc5)[0x5631acc43865] /usr/sbin/mariadbd(_ZN18Prepared_statement7executeEP6Stringb+0x522)[0x5631acc65f22] /usr/sbin/mariadbd(_ZN18Prepared_statement12execute_loopEP6StringbPhS2_+0x95)[0x5631acc660b5] /usr/sbin/mariadbd(+0x818f25)[0x5631acc66f25] /usr/sbin/mariadbd(_Z19mysqld_stmt_executeP3THDPcj+0x2b)[0x5631acc670ab] /usr/sbin/mariadbd(_Z16dispatch_command19enum_server_commandP3THDPcjb+0x1911)[0x5631acc47561] /usr/sbin/mariadbd(_Z10do_commandP3THDb+0x137)[0x5631acc48267] /usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x3b7)[0x5631acd58f27] /usr/sbin/mariadbd(handle_one_connection+0x5d)[0x5631acd592bd] /usr/sbin/mariadbd(+0xc2dc50)[0x5631ad07bc50] /lib/x86_64-linux-gnu/libc.so.6(+0x89044)[0x7fbce6ca8044] /lib/x86_64-linux-gnu/libc.so.6(+0x10961c)[0x7fbce6d2861c] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. *** REMOVED QUERY Connection ID (thread ID): 3953 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=on,index_condition_pushdown=on,derived_merge=on,derived_with_keys=off,firstmatch=on,loosescan=on,materialization=on,in_to_exists=off,semijoin=off,partial_match_rowid_merge=off,partial_match_table_scan=off,subquery_cache=off,mrr=on,mrr_cost_based=on,mrr_sort_keys=off,outer_join_with_cache=off,semijoin_with_cache=off,join_cache_incremental=off,join_cache_hashed=off,join_cache_bka=off,optimize_join_buffer_size=off,table_elimination=off,extended_keys=off,exists_to_in=off,orderby_uses_equalities=off,condition_pushdown_for_derived=off,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off,hash_join_cardinality=off The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /var/lib/mysql Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size 0 unlimited bytes Max resident set unlimited unlimited bytes Max processes 1030206 1030206 processes Max open files 1000000 1000000 files Max locked memory unlimited unlimited bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 1030206 1030206 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: core Kernel version: Linux version 6.1.0-13-amd64 (debian-kernel@lists.debian.org) (gcc-12 (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC Debian 6.1.55-1 (2023-09-29) 2023-10-30 10:56:23 0 [Note] Starting MariaDB 10.11.4-MariaDB-1~deb12u1 source revision as process 1465365 2023-10-30 10:56:23 0 [Warning] You need to use --log-bin to make --log-slave-updates work. 2023-10-30 10:56:23 0 [Warning] You need to use --log-bin to make --binlog-format work. 2023-10-30 10:56:23 0 [Note] Initializing built-in plugins 2023-10-30 10:56:23 0 [Note] Initializing plugins specified on the command line 2023-10-30 10:56:23 0 [Note] Loaded 'type_mysql_json.so' with offset 0x7f5989084000 2023-10-30 10:56:23 0 [Note] InnoDB: Compressed tables use zlib 1.2.13 2023-10-30 10:56:23 0 [Note] InnoDB: Number of transaction pools: 1 2023-10-30 10:56:23 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions 2023-10-30 10:56:23 0 [Note] InnoDB: Using liburing 2023-10-30 10:56:23 0 [Note] InnoDB: Initializing buffer pool, total size = 60.000GiB, chunk size = 0.938GiB 2023-10-30 10:56:24 0 [Note] InnoDB: Completed initialization of buffer pool 2023-10-30 10:56:24 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2023-10-30 10:56:24 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=285923902325922 2023-10-30 10:56:32 0 [Note] InnoDB: Starting final batch to recover 228084 pages from redo log. 2023-10-30 10:56:39 0 [Note] InnoDB: To recover: 143065 pages from log 2023-10-30 10:56:45 0 [Note] InnoDB: Last binlog file '/var/log/mysql/mysql-bin.076850', position 752019054 2023-10-30 10:56:45 0 [Note] InnoDB: 128 rollback segments are active. 2023-10-30 10:56:45 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1" 2023-10-30 10:56:45 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... 2023-10-30 10:56:45 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. 2023-10-30 10:56:45 0 [Note] InnoDB: log sequence number 285925205177469; transaction id 287515544637 2023-10-30 10:56:45 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2023-10-30 10:56:45 0 [Note] Plugin 'FEEDBACK' is disabled. 2023-10-30 10:56:45 0 [Note] Initializing installed plugins 2023-10-30 10:56:45 0 [Note] Loaded 'ha_archive.so' with offset 0x7f596c125000 2023-10-30 10:56:45 0 [Note] Server socket created on IP: '0.0.0.0'. 2023-10-30 10:56:45 0 [Note] Server socket created on IP: '0.0.0.0'. 2023-10-30 10:56:45 1 [ERROR] mariadbd: Table './mysql/gtid_slave_pos' is marked as crashed and should be repaired 2023-10-30 10:56:45 1 [Warning] Checking table: './mysql/gtid_slave_pos' 2023-10-30 10:56:45 1 [Warning] mysql.gtid_slave_pos: 1 client is using or hasn't closed the table properly 2023-10-30 10:56:45 1 [Note] mysql.gtid_slave_pos: Table is fixed 2023-10-30 10:56:45 0 [Note] Reading of all Master_info entries succeeded 2023-10-30 10:56:45 0 [Note] Added new Master_info '' to hash table 2023-10-30 10:56:45 0 [Warning] Recovery from master pos 4 and file mysql-bin.077930. 2023-10-30 10:56:45 4 [Note] Slave I/O thread: Start asynchronous replication to master 'repl@master.server:3306' in log 'mysql-bin.077930' at position 4 2023-10-30 10:56:45 5 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.077930' at position 4, relay log '/var/lib/mysql/replica-relay-bin.000001' position: 4; GTID position '0-9-97791068937' 2023-10-30 10:56:45 0 [Note] /usr/sbin/mariadbd: ready for connections. Version: '10.11.4-MariaDB-1~deb12u1' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Debian 12 2023-10-30 10:56:45 4 [Note] Slave I/O thread: connected to master 'repl@master.server:3306',replication starts at GTID position '0-9-97791068937' 2023-10-30 10:56:46 5 [ERROR] mariadbd: Can't find record in 'result' 2023-10-30 10:56:46 5 [ERROR] Slave SQL: Could not execute Update_rows_v1 event on table retriever.result; Can't find record in 'result', Error_code: 1032; handler error HA_ERR_KEY_NOT_FOUND; the event's master log mysql-bin.077930, end_log_pos 757004669, Gtid 0-9-97791069144, Internal MariaDB error code: 1032 2023-10-30 10:56:46 5 [Warning] Slave: Can't find record in 'result' Error_code: 1032 2023-10-30 10:56:46 5 [ERROR] Error running query, slave SQL thread aborted. Fix the problem, and restart the slave SQL thread with "SLAVE START". We stopped at log 'mysql-bin.077930' position 757000065; GTID position '0-9-97791069143' 2023-10-30 10:56:46 5 [Note] Slave SQL thread exiting, replication stopped in log 'mysql-bin.077930' at position 757000065; GTID position '0-9-97791069143', master: master.server:3306 2023-10-30 10:57:52 0 [Note] InnoDB: Buffer pool(s) load completed at 231030 10:57:52 231030 11:01:57 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.11.4-MariaDB-1~deb12u1 source revision: key_buffer_size=268435456 read_buffer_size=67108864 max_used_connections=68 max_threads=2059 thread_count=69 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 137363640 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7f4874000c68 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f487bffecb8 thread_stack 0x1000000 /usr/sbin/mariadbd(my_print_stacktrace+0x2e)[0x5583fb6514ae] /usr/sbin/mariadbd(handle_fatal_signal+0x2c3)[0x5583fb1bee03] /lib/x86_64-linux-gnu/libc.so.6(+0x3bfd0)[0x7f598a65afd0] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. ***REMOVED QUERY Connection ID (thread ID): 133 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=on,index_condition_pushdown=on,derived_merge=on,derived_with_keys=off,firstmatch=on,loosescan=on,materialization=on,in_to_exists=off,semijoin=off,partial_match_rowid_merge=off,partial_match_table_scan=off,subquery_cache=off,mrr=on,mrr_cost_based=on,mrr_sort_keys=off,outer_join_with_cache=off,semijoin_with_cache=off,join_cache_incremental=off,join_cache_hashed=off,join_cache_bka=off,optimize_join_buffer_size=off,table_elimination=off,extended_keys=off,exists_to_in=off,orderby_uses_equalities=off,condition_pushdown_for_derived=off,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off,hash_join_cardinality=off The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /var/lib/mysql Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size 0 unlimited bytes Max resident set unlimited unlimited bytes Max processes 1030206 1030206 processes Max open files 1000000 1000000 files Max locked memory unlimited unlimited bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 1030206 1030206 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: core Kernel version: Linux version 6.1.0-13-amd64 (debian-kernel@lists.debian.org) (gcc-12 (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC Debian 6.1.55-1 (2023-09-29) 2023-10-30 11:02:04 0 [Note] Starting MariaDB 10.11.4-MariaDB-1~deb12u1 source revision as process 1499490 2023-10-30 11:02:04 0 [Warning] You need to use --log-bin to make --log-slave-updates work. 2023-10-30 11:02:04 0 [Warning] You need to use --log-bin to make --binlog-format work. 2023-10-30 11:02:04 0 [Note] Initializing built-in plugins 2023-10-30 11:02:04 0 [Note] Initializing plugins specified on the command line 2023-10-30 11:02:04 0 [Note] Loaded 'type_mysql_json.so' with offset 0x7fdeb229f000 2023-10-30 11:02:04 0 [Note] InnoDB: Compressed tables use zlib 1.2.13 2023-10-30 11:02:04 0 [Note] InnoDB: Number of transaction pools: 1 2023-10-30 11:02:04 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions 2023-10-30 11:02:04 0 [Note] InnoDB: Using liburing 2023-10-30 11:02:04 0 [Note] InnoDB: Initializing buffer pool, total size = 60.000GiB, chunk size = 0.938GiB 2023-10-30 11:02:04 0 [Note] InnoDB: Completed initialization of buffer pool 2023-10-30 11:02:04 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2023-10-30 11:02:04 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=285923902325922 2023-10-30 11:02:12 0 [Note] InnoDB: Starting final batch to recover 228474 pages from redo log. 2023-10-30 11:02:19 0 [Note] InnoDB: To recover: 110703 pages from log 2023-10-30 11:02:23 0 [Note] InnoDB: Last binlog file '/var/log/mysql/mysql-bin.076850', position 752614178 2023-10-30 11:02:23 0 [Note] InnoDB: 128 rollback segments are active. 2023-10-30 11:02:23 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1" 2023-10-30 11:02:23 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... 2023-10-30 11:02:23 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. 2023-10-30 11:02:23 0 [Note] InnoDB: log sequence number 285925207990439; transaction id 287515545038 2023-10-30 11:02:23 0 [Note] Plugin 'FEEDBACK' is disabled. 2023-10-30 11:02:23 0 [Note] Initializing installed plugins 2023-10-30 11:02:23 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2023-10-30 11:02:23 0 [Note] Loaded 'ha_archive.so' with offset 0x7fdeb0186000 2023-10-30 11:02:23 0 [Note] Server socket created on IP: '0.0.0.0'. 2023-10-30 11:02:23 0 [Note] Server socket created on IP: '0.0.0.0'. 2023-10-30 11:02:23 1 [ERROR] mariadbd: Table './mysql/gtid_slave_pos' is marked as crashed and should be repaired 2023-10-30 11:02:23 1 [Warning] Checking table: './mysql/gtid_slave_pos' 2023-10-30 11:02:23 1 [Warning] mysql.gtid_slave_pos: 1 client is using or hasn't closed the table properly 2023-10-30 11:02:23 1 [Note] mysql.gtid_slave_pos: Table is fixed 2023-10-30 11:02:23 0 [Note] Reading of all Master_info entries succeeded 2023-10-30 11:02:23 0 [Note] Added new Master_info '' to hash table 2023-10-30 11:02:23 0 [Warning] Recovery from master pos 757000065 and file mysql-bin.077930. 2023-10-30 11:02:23 4 [Note] Slave I/O thread: Start asynchronous replication to master 'repl@master.server:3306' in log 'mysql-bin.077930' at position 757000065 2023-10-30 11:02:23 5 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.077930' at position 757000065, relay log '/var/lib/mysql/replica-relay-bin.000001' position: 4; GTID position '0-9-97791069143' 2023-10-30 11:02:23 0 [Note] /usr/sbin/mariadbd: ready for connections. Version: '10.11.4-MariaDB-1~deb12u1' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Debian 12 2023-10-30 11:02:23 4 [Note] Slave I/O thread: connected to master 'repl@master.server:3306',replication starts at GTID position '0-9-97791069143' 2023-10-30 11:02:24 5 [ERROR] mariadbd: Can't find record in 'result' 2023-10-30 11:02:24 5 [ERROR] Slave SQL: Could not execute Update_rows_v1 event on table retriever.result; Can't find record in 'result', Error_code: 1032; handler error HA_ERR_KEY_NOT_FOUND; the event's master log mysql-bin.077930, end_log_pos 757004669, Gtid 0-9-97791069144, Internal MariaDB error code: 1032 2023-10-30 11:02:24 5 [Warning] Slave: Can't find record in 'result' Error_code: 1032 2023-10-30 11:02:24 5 [ERROR] Error running query, slave SQL thread aborted. Fix the problem, and restart the slave SQL thread with "SLAVE START". We stopped at log 'mysql-bin.077930' position 757000065; GTID position '0-9-97791069143' 2023-10-30 11:02:24 5 [Note] Slave SQL thread exiting, replication stopped in log 'mysql-bin.077930' at position 757000065; GTID position '0-9-97791069143', master: master.server:3306 2023-10-30 11:02:49 0 [Note] InnoDB: Buffer pool(s) load completed at 231030 11:02:49 231030 11:06:05 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.11.4-MariaDB-1~deb12u1 source revision: key_buffer_size=268435456 read_buffer_size=67108864 max_used_connections=15 max_threads=2059 thread_count=16 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 137363640 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7fcdf4000c68 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7fcf65dd6cb8 thread_stack 0x1000000 /usr/sbin/mariadbd(my_print_stacktrace+0x2e)[0x555ad66304ae] /usr/sbin/mariadbd(handle_fatal_signal+0x2c3)[0x555ad619de03] /lib/x86_64-linux-gnu/libc.so.6(+0x3bfd0)[0x7fdeb385afd0] /usr/sbin/mariadbd(_Z16best_access_pathP4JOINP13st_join_tableyPK8POSITIONjbdPS3_S6_+0x10bf)[0x555ad5fae1df] /usr/sbin/mariadbd(+0x83be94)[0x555ad5fb0e94] /usr/sbin/mariadbd(+0x8403fa)[0x555ad5fb53fa] /usr/sbin/mariadbd(_Z11choose_planP4JOINy+0x318)[0x555ad5fb69e8] /usr/sbin/mariadbd(_ZN13st_join_table21choose_best_splittingEjyPK8POSITIONPy+0xc0e)[0x555ad6121f7e] /usr/sbin/mariadbd(_Z16best_access_pathP4JOINP13st_join_tableyPK8POSITIONjbdPS3_S6_+0x170)[0x555ad5fad290] /usr/sbin/mariadbd(+0x83be94)[0x555ad5fb0e94] /usr/sbin/mariadbd(+0x8403fa)[0x555ad5fb53fa] /usr/sbin/mariadbd(+0x84129f)[0x555ad5fb629f] /usr/sbin/mariadbd(_Z11choose_planP4JOINy+0x318)[0x555ad5fb69e8] /usr/sbin/mariadbd(+0x86375f)[0x555ad5fd875f] /usr/sbin/mariadbd(_ZN4JOIN14optimize_innerEv+0x1395)[0x555ad5fdd505] /usr/sbin/mariadbd(_ZN4JOIN8optimizeEv+0xaa)[0x555ad5fdda9a] /usr/sbin/mariadbd(+0x7b207e)[0x555ad5f2707e] /usr/sbin/mariadbd(_Z27mysql_handle_single_derivedP3LEXP10TABLE_LISTj+0xa2)[0x555ad5f268a2] /usr/sbin/mariadbd(_ZN13st_select_lex14handle_derivedEP3LEXj+0x47)[0x555ad5f426a7] /usr/sbin/mariadbd(_ZN4JOIN14optimize_innerEv+0x10d6)[0x555ad5fdd246] /usr/sbin/mariadbd(_ZN4JOIN8optimizeEv+0xaa)[0x555ad5fdda9a] /usr/sbin/mariadbd(_Z12mysql_selectP3THDP10TABLE_LISTR4ListI4ItemEPS4_jP8st_orderS9_S7_S9_yP13select_resultP18st_select_lex_unitP13st_select_lex+0xca)[0x555ad5fddb7a] /usr/sbin/mariadbd(_Z13handle_selectP3THDP3LEXP13select_resulty+0x13f)[0x555ad5fde35f] /usr/sbin/mariadbd(+0x7e8fa0)[0x555ad5f5dfa0] /usr/sbin/mariadbd(_Z21mysql_execute_commandP3THDb+0x3dc5)[0x555ad5f6a865] /usr/sbin/mariadbd(_ZN18Prepared_statement7executeEP6Stringb+0x522)[0x555ad5f8cf22] /usr/sbin/mariadbd(_ZN18Prepared_statement12execute_loopEP6StringbPhS2_+0x95)[0x555ad5f8d0b5] /usr/sbin/mariadbd(+0x818f25)[0x555ad5f8df25] /usr/sbin/mariadbd(_Z19mysqld_stmt_executeP3THDPcj+0x2b)[0x555ad5f8e0ab] /usr/sbin/mariadbd(_Z16dispatch_command19enum_server_commandP3THDPcjb+0x1911)[0x555ad5f6e561] /usr/sbin/mariadbd(_Z10do_commandP3THDb+0x137)[0x555ad5f6f267] /usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x3b7)[0x555ad607ff27] /usr/sbin/mariadbd(handle_one_connection+0x5d)[0x555ad60802bd] /usr/sbin/mariadbd(+0xc2dc50)[0x555ad63a2c50] /lib/x86_64-linux-gnu/libc.so.6(+0x89044)[0x7fdeb38a8044] /lib/x86_64-linux-gnu/libc.so.6(+0x10961c)[0x7fdeb392861c] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. ***REMOVED QUERY Connection ID (thread ID): 79 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=on,index_condition_pushdown=on,derived_merge=on,derived_with_keys=off,firstmatch=on,loosescan=on,materialization=on,in_to_exists=off,semijoin=off,partial_match_rowid_merge=off,partial_match_table_scan=off,subquery_cache=off,mrr=on,mrr_cost_based=on,mrr_sort_keys=off,outer_join_with_cache=off,semijoin_with_cache=off,join_cache_incremental=off,join_cache_hashed=off,join_cache_bka=off,optimize_join_buffer_size=off,table_elimination=off,extended_keys=off,exists_to_in=off,orderby_uses_equalities=off,condition_pushdown_for_derived=off,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off,hash_join_cardinality=off The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /var/lib/mysql Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size 0 unlimited bytes Max resident set unlimited unlimited bytes Max processes 1030206 1030206 processes Max open files 1000000 1000000 files Max locked memory unlimited unlimited bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 1030206 1030206 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: core Kernel version: Linux version 6.1.0-13-amd64 (debian-kernel@lists.debian.org) (gcc-12 (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC Debian 6.1.55-1 (2023-09-29) 2023-10-30 11:06:12 0 [Note] Starting MariaDB 10.11.4-MariaDB-1~deb12u1 source revision as process 1508822 2023-10-30 11:06:12 0 [Warning] You need to use --log-bin to make --log-slave-updates work. 2023-10-30 11:06:12 0 [Warning] You need to use --log-bin to make --binlog-format work. 2023-10-30 11:06:12 0 [Note] Initializing built-in plugins 2023-10-30 11:06:12 0 [Note] Initializing plugins specified on the command line 2023-10-30 11:06:12 0 [Note] Loaded 'type_mysql_json.so' with offset 0x7f71c84dc000 2023-10-30 11:06:12 0 [Note] InnoDB: Compressed tables use zlib 1.2.13 2023-10-30 11:06:12 0 [Note] InnoDB: Number of transaction pools: 1 2023-10-30 11:06:12 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions 2023-10-30 11:06:12 0 [Note] InnoDB: Using liburing 2023-10-30 11:06:12 0 [Note] InnoDB: Initializing buffer pool, total size = 60.000GiB, chunk size = 0.938GiB 2023-10-30 11:06:12 0 [Note] InnoDB: Completed initialization of buffer pool 2023-10-30 11:06:12 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2023-10-30 11:06:12 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=285923902325922 2023-10-30 11:06:21 0 [Note] InnoDB: Starting final batch to recover 228474 pages from redo log. 2023-10-30 11:06:27 0 [Note] InnoDB: To recover: 123828 pages from log 2023-10-30 11:06:31 0 [Note] InnoDB: Last binlog file '/var/log/mysql/mysql-bin.076850', position 752614178 2023-10-30 11:06:31 0 [Note] InnoDB: 128 rollback segments are active. 2023-10-30 11:06:31 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1" 2023-10-30 11:06:31 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... 2023-10-30 11:06:31 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. 2023-10-30 11:06:31 0 [Note] InnoDB: log sequence number 285925207994392; transaction id 287515545038 2023-10-30 11:06:31 0 [Note] Plugin 'FEEDBACK' is disabled. 2023-10-30 11:06:31 0 [Note] Initializing installed plugins 2023-10-30 11:06:31 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2023-10-30 11:06:31 0 [Note] Loaded 'ha_archive.so' with offset 0x7f71c8191000 2023-10-30 11:06:31 0 [Note] Server socket created on IP: '0.0.0.0'. 2023-10-30 11:06:31 0 [Note] Server socket created on IP: '0.0.0.0'. 2023-10-30 11:06:31 1 [ERROR] mariadbd: Table './mysql/gtid_slave_pos' is marked as crashed and should be repaired 2023-10-30 11:06:31 1 [Warning] Checking table: './mysql/gtid_slave_pos' 2023-10-30 11:06:31 1 [Warning] mysql.gtid_slave_pos: 1 client is using or hasn't closed the table properly 2023-10-30 11:06:31 1 [Note] mysql.gtid_slave_pos: Table is fixed 2023-10-30 11:06:31 0 [Note] Reading of all Master_info entries succeeded 2023-10-30 11:06:31 0 [Note] Added new Master_info '' to hash table 2023-10-30 11:06:31 0 [Warning] Recovery from master pos 757000065 and file mysql-bin.077930. 2023-10-30 11:06:31 4 [Note] Slave I/O thread: Start asynchronous replication to master 'repl@master.server:3306' in log 'mysql-bin.077930' at position 757000065 2023-10-30 11:06:31 5 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.077930' at position 757000065, relay log '/var/lib/mysql/replica-relay-bin.000001' position: 4; GTID position '0-9-97791069143' 2023-10-30 11:06:31 0 [Note] /usr/sbin/mariadbd: ready for connections. Version: '10.11.4-MariaDB-1~deb12u1' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Debian 12 2023-10-30 11:06:31 4 [Note] Slave I/O thread: connected to master 'repl@master.server:3306',replication starts at GTID position '0-9-97791069143' 2023-10-30 11:06:32 5 [ERROR] mariadbd: Can't find record in 'result' 2023-10-30 11:06:32 5 [ERROR] Slave SQL: Could not execute Update_rows_v1 event on table retriever.result; Can't find record in 'result', Error_code: 1032; handler error HA_ERR_KEY_NOT_FOUND; the event's master log mysql-bin.077930, end_log_pos 757004669, Gtid 0-9-97791069144, Internal MariaDB error code: 1032 2023-10-30 11:06:32 5 [Warning] Slave: Can't find record in 'result' Error_code: 1032 2023-10-30 11:06:32 5 [ERROR] Error running query, slave SQL thread aborted. Fix the problem, and restart the slave SQL thread with "SLAVE START". We stopped at log 'mysql-bin.077930' position 757000065; GTID position '0-9-97791069143' 2023-10-30 11:06:32 5 [Note] Slave SQL thread exiting, replication stopped in log 'mysql-bin.077930' at position 757000065; GTID position '0-9-97791069143', master: master.server:3306 2023-10-30 11:06:58 0 [Note] InnoDB: Buffer pool(s) load completed at 231030 11:06:58 231030 13:36:02 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.11.4-MariaDB-1~deb12u1 source revision: key_buffer_size=268435456 read_buffer_size=67108864 max_used_connections=88 max_threads=2059 thread_count=89 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 137363640 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7f6044000c68 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f60b1fb2cb8 thread_stack 0x1000000 /usr/sbin/mariadbd(my_print_stacktrace+0x2e)[0x5635fae1b4ae] /usr/sbin/mariadbd(handle_fatal_signal+0x2c3)[0x5635fa988e03] /lib/x86_64-linux-gnu/libc.so.6(+0x3bfd0)[0x7f71c9a5afd0] /usr/sbin/mariadbd(_Z16best_access_pathP4JOINP13st_join_tableyPK8POSITIONjbdPS3_S6_+0x10bf)[0x5635fa7991df] /usr/sbin/mariadbd(+0x83be94)[0x5635fa79be94] /usr/sbin/mariadbd(+0x8403fa)[0x5635fa7a03fa] /usr/sbin/mariadbd(_Z11choose_planP4JOINy+0x318)[0x5635fa7a19e8] /usr/sbin/mariadbd(_ZN13st_join_table21choose_best_splittingEjyPK8POSITIONPy+0xc0e)[0x5635fa90cf7e] /usr/sbin/mariadbd(_Z16best_access_pathP4JOINP13st_join_tableyPK8POSITIONjbdPS3_S6_+0x170)[0x5635fa798290] /usr/sbin/mariadbd(+0x83be94)[0x5635fa79be94] /usr/sbin/mariadbd(+0x8403fa)[0x5635fa7a03fa] /usr/sbin/mariadbd(+0x84129f)[0x5635fa7a129f] /usr/sbin/mariadbd(_Z11choose_planP4JOINy+0x318)[0x5635fa7a19e8] /usr/sbin/mariadbd(+0x86375f)[0x5635fa7c375f] /usr/sbin/mariadbd(_ZN4JOIN14optimize_innerEv+0x1395)[0x5635fa7c8505] /usr/sbin/mariadbd(_ZN4JOIN8optimizeEv+0xaa)[0x5635fa7c8a9a] /usr/sbin/mariadbd(+0x7b207e)[0x5635fa71207e] /usr/sbin/mariadbd(_Z27mysql_handle_single_derivedP3LEXP10TABLE_LISTj+0xa2)[0x5635fa7118a2] /usr/sbin/mariadbd(_ZN13st_select_lex14handle_derivedEP3LEXj+0x47)[0x5635fa72d6a7] /usr/sbin/mariadbd(_ZN4JOIN14optimize_innerEv+0x10d6)[0x5635fa7c8246] /usr/sbin/mariadbd(_ZN4JOIN8optimizeEv+0xaa)[0x5635fa7c8a9a] /usr/sbin/mariadbd(_Z12mysql_selectP3THDP10TABLE_LISTR4ListI4ItemEPS4_jP8st_orderS9_S7_S9_yP13select_resultP18st_select_lex_unitP13st_select_lex+0xca)[0x5635fa7c8b7a] /usr/sbin/mariadbd(_Z13handle_selectP3THDP3LEXP13select_resulty+0x13f)[0x5635fa7c935f] /usr/sbin/mariadbd(+0x7e8fa0)[0x5635fa748fa0] /usr/sbin/mariadbd(_Z21mysql_execute_commandP3THDb+0x3dc5)[0x5635fa755865] /usr/sbin/mariadbd(_ZN18Prepared_statement7executeEP6Stringb+0x522)[0x5635fa777f22] /usr/sbin/mariadbd(_ZN18Prepared_statement12execute_loopEP6StringbPhS2_+0x95)[0x5635fa7780b5] /usr/sbin/mariadbd(+0x818f25)[0x5635fa778f25] /usr/sbin/mariadbd(_Z19mysqld_stmt_executeP3THDPcj+0x2b)[0x5635fa7790ab] /usr/sbin/mariadbd(_Z16dispatch_command19enum_server_commandP3THDPcjb+0x1911)[0x5635fa759561] /usr/sbin/mariadbd(_Z10do_commandP3THDb+0x137)[0x5635fa75a267] /usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x3b7)[0x5635fa86af27] /usr/sbin/mariadbd(handle_one_connection+0x5d)[0x5635fa86b2bd] /usr/sbin/mariadbd(+0xc2dc50)[0x5635fab8dc50] /lib/x86_64-linux-gnu/libc.so.6(+0x89044)[0x7f71c9aa8044] /lib/x86_64-linux-gnu/libc.so.6(+0x10961c)[0x7f71c9b2861c] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. ***REMOVED QUERY Connection ID (thread ID): 934 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=on,index_condition_pushdown=on,derived_merge=on,derived_with_keys=off,firstmatch=on,loosescan=on,materialization=on,in_to_exists=off,semijoin=off,partial_match_rowid_merge=off,partial_match_table_scan=off,subquery_cache=off,mrr=on,mrr_cost_based=on,mrr_sort_keys=off,outer_join_with_cache=off,semijoin_with_cache=off,join_cache_incremental=off,join_cache_hashed=off,join_cache_bka=off,optimize_join_buffer_size=off,table_elimination=off,extended_keys=off,exists_to_in=off,orderby_uses_equalities=off,condition_pushdown_for_derived=off,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off,hash_join_cardinality=off The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /var/lib/mysql Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size 0 unlimited bytes Max resident set unlimited unlimited bytes Max processes 1030206 1030206 processes Max open files 1000000 1000000 files Max locked memory unlimited unlimited bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 1030206 1030206 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: core Kernel version: Linux version 6.1.0-13-amd64 (debian-kernel@lists.debian.org) (gcc-12 (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC Debian 6.1.55-1 (2023-09-29) 2023-10-30 13:36:17 0 [Note] Starting MariaDB 10.11.4-MariaDB-1~deb12u1 source revision as process 2038028 2023-10-30 13:36:17 0 [Warning] You need to use --log-bin to make --log-slave-updates work. 2023-10-30 13:36:17 0 [Warning] You need to use --log-bin to make --binlog-format work. 2023-10-30 13:36:17 0 [Note] Initializing built-in plugins 2023-10-30 13:36:17 0 [Note] Initializing plugins specified on the command line 2023-10-30 13:36:17 0 [Note] Loaded 'type_mysql_json.so' with offset 0x7f63309e0000 2023-10-30 13:36:17 0 [Note] InnoDB: Compressed tables use zlib 1.2.13 2023-10-30 13:36:17 0 [Note] InnoDB: Number of transaction pools: 1 2023-10-30 13:36:17 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions 2023-10-30 13:36:17 0 [Note] InnoDB: Using liburing 2023-10-30 13:36:17 0 [Note] InnoDB: Initializing buffer pool, total size = 60.000GiB, chunk size = 0.938GiB 2023-10-30 13:36:17 0 [Note] InnoDB: Completed initialization of buffer pool 2023-10-30 13:36:17 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2023-10-30 13:36:17 0 [Note] InnoDB: 128 rollback segments are active. 2023-10-30 13:36:17 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1" 2023-10-30 13:36:17 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... 2023-10-30 13:36:17 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. 2023-10-30 13:36:17 0 [Note] InnoDB: log sequence number 285925208002314; transaction id 287515545038 2023-10-30 13:36:17 0 [Note] Plugin 'FEEDBACK' is disabled. 2023-10-30 13:36:17 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2023-10-30 13:36:17 0 [Note] Initializing installed plugins 2023-10-30 13:36:17 0 [Note] Loaded 'ha_archive.so' with offset 0x7f63300d4000 2023-10-30 13:36:17 0 [Note] Server socket created on IP: '0.0.0.0'. 2023-10-30 13:36:17 0 [Note] Server socket created on IP: '0.0.0.0'. 2023-10-30 13:36:17 0 [Note] Reading of all Master_info entries succeeded 2023-10-30 13:36:17 0 [Note] Added new Master_info '' to hash table 2023-10-30 13:36:17 0 [Warning] Recovery from master pos 757000065 and file mysql-bin.077930. 2023-10-30 13:36:17 4 [Note] Slave I/O thread: Start asynchronous replication to master 'repl@master.server:3306' in log 'mysql-bin.077930' at position 757000065 2023-10-30 13:36:17 0 [Note] /usr/sbin/mariadbd: ready for connections. Version: '10.11.4-MariaDB-1~deb12u1' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Debian 12 2023-10-30 13:36:17 5 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.077930' at position 757000065, relay log '/var/lib/mysql/replica-relay-bin.000001' position: 4; GTID position '0-9-97791069143' 2023-10-30 13:36:17 4 [Note] Slave I/O thread: connected to master 'repl@master.server:3306',replication starts at GTID position '0-9-97791069143' 2023-10-30 13:36:18 5 [ERROR] mariadbd: Can't find record in 'result' 2023-10-30 13:36:18 5 [ERROR] Slave SQL: Could not execute Update_rows_v1 event on table retriever.result; Can't find record in 'result', Error_code: 1032; handler error HA_ERR_KEY_NOT_FOUND; the event's master log mysql-bin.077930, end_log_pos 757004669, Gtid 0-9-97791069144, Internal MariaDB error code: 1032 2023-10-30 13:36:18 5 [Warning] Slave: Can't find record in 'result' Error_code: 1032 2023-10-30 13:36:18 5 [ERROR] Error running query, slave SQL thread aborted. Fix the problem, and restart the slave SQL thread with "SLAVE START". We stopped at log 'mysql-bin.077930' position 757000065; GTID position '0-9-97791069143' 2023-10-30 13:36:18 5 [Note] Slave SQL thread exiting, replication stopped in log 'mysql-bin.077930' at position 757000065; GTID position '0-9-97791069143', master: master.server:3306 2023-10-30 13:36:58 0 [Note] InnoDB: Buffer pool(s) load completed at 231030 13:36:58 231030 13:37:38 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.11.4-MariaDB-1~deb12u1 source revision: key_buffer_size=268435456 read_buffer_size=67108864 max_used_connections=27 max_threads=2059 thread_count=28 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 137363640 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7f5204000c68 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f520fffecb8 thread_stack 0x1000000 /usr/sbin/mariadbd(my_print_stacktrace+0x2e)[0x55a7baeb74ae] /usr/sbin/mariadbd(handle_fatal_signal+0x2c3)[0x55a7baa24e03] /lib/x86_64-linux-gnu/libc.so.6(+0x3bfd0)[0x7f6334e5afd0] /usr/sbin/mariadbd(_Z16best_access_pathP4JOINP13st_join_tableyPK8POSITIONjbdPS3_S6_+0x10bf)[0x55a7ba8351df] /usr/sbin/mariadbd(+0x83be94)[0x55a7ba837e94] /usr/sbin/mariadbd(+0x8403fa)[0x55a7ba83c3fa] /usr/sbin/mariadbd(_Z11choose_planP4JOINy+0x318)[0x55a7ba83d9e8] /usr/sbin/mariadbd(_ZN13st_join_table21choose_best_splittingEjyPK8POSITIONPy+0xc0e)[0x55a7ba9a8f7e] /usr/sbin/mariadbd(_Z16best_access_pathP4JOINP13st_join_tableyPK8POSITIONjbdPS3_S6_+0x170)[0x55a7ba834290] /usr/sbin/mariadbd(+0x83be94)[0x55a7ba837e94] /usr/sbin/mariadbd(+0x8403fa)[0x55a7ba83c3fa] /usr/sbin/mariadbd(+0x84129f)[0x55a7ba83d29f] /usr/sbin/mariadbd(_Z11choose_planP4JOINy+0x318)[0x55a7ba83d9e8] /usr/sbin/mariadbd(+0x86375f)[0x55a7ba85f75f] /usr/sbin/mariadbd(_ZN4JOIN14optimize_innerEv+0x1395)[0x55a7ba864505] /usr/sbin/mariadbd(_ZN4JOIN8optimizeEv+0xaa)[0x55a7ba864a9a] /usr/sbin/mariadbd(+0x7b207e)[0x55a7ba7ae07e] /usr/sbin/mariadbd(_Z27mysql_handle_single_derivedP3LEXP10TABLE_LISTj+0xa2)[0x55a7ba7ad8a2] /usr/sbin/mariadbd(_ZN13st_select_lex14handle_derivedEP3LEXj+0x47)[0x55a7ba7c96a7] /usr/sbin/mariadbd(_ZN4JOIN14optimize_innerEv+0x10d6)[0x55a7ba864246] /usr/sbin/mariadbd(_ZN4JOIN8optimizeEv+0xaa)[0x55a7ba864a9a] /usr/sbin/mariadbd(_Z12mysql_selectP3THDP10TABLE_LISTR4ListI4ItemEPS4_jP8st_orderS9_S7_S9_yP13select_resultP18st_select_lex_unitP13st_select_lex+0xca)[0x55a7ba864b7a] /usr/sbin/mariadbd(_Z13handle_selectP3THDP3LEXP13select_resulty+0x13f)[0x55a7ba86535f] /usr/sbin/mariadbd(+0x7e8fa0)[0x55a7ba7e4fa0] /usr/sbin/mariadbd(_Z21mysql_execute_commandP3THDb+0x3dc5)[0x55a7ba7f1865] /usr/sbin/mariadbd(_ZN18Prepared_statement7executeEP6Stringb+0x522)[0x55a7ba813f22] /usr/sbin/mariadbd(_ZN18Prepared_statement12execute_loopEP6StringbPhS2_+0x95)[0x55a7ba8140b5] /usr/sbin/mariadbd(+0x818f25)[0x55a7ba814f25] /usr/sbin/mariadbd(_Z19mysqld_stmt_executeP3THDPcj+0x2b)[0x55a7ba8150ab] /usr/sbin/mariadbd(_Z16dispatch_command19enum_server_commandP3THDPcjb+0x1911)[0x55a7ba7f5561] /usr/sbin/mariadbd(_Z10do_commandP3THDb+0x137)[0x55a7ba7f6267] /usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x3b7)[0x55a7ba906f27] /usr/sbin/mariadbd(handle_one_connection+0x5d)[0x55a7ba9072bd] /usr/sbin/mariadbd(+0xc2dc50)[0x55a7bac29c50] /lib/x86_64-linux-gnu/libc.so.6(+0x89044)[0x7f6334ea8044] /lib/x86_64-linux-gnu/libc.so.6(+0x10961c)[0x7f6334f2861c] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. ***REMOVED QUERY Connection ID (thread ID): 74 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=on,index_condition_pushdown=on,derived_merge=on,derived_with_keys=off,firstmatch=on,loosescan=on,materialization=on,in_to_exists=off,semijoin=off,partial_match_rowid_merge=off,partial_match_table_scan=off,subquery_cache=off,mrr=on,mrr_cost_based=on,mrr_sort_keys=off,outer_join_with_cache=off,semijoin_with_cache=off,join_cache_incremental=off,join_cache_hashed=off,join_cache_bka=off,optimize_join_buffer_size=off,table_elimination=off,extended_keys=off,exists_to_in=off,orderby_uses_equalities=off,condition_pushdown_for_derived=off,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off,hash_join_cardinality=off The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /var/lib/mysql Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size 0 unlimited bytes Max resident set unlimited unlimited bytes Max processes 1030206 1030206 processes Max open files 1000000 1000000 files Max locked memory unlimited unlimited bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 1030206 1030206 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: core Kernel version: Linux version 6.1.0-13-amd64 (debian-kernel@lists.debian.org) (gcc-12 (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT_DYNAMIC Debian 6.1.55-1 (2023-09-29) 2023-10-30 13:37:44 0 [Note] Starting MariaDB 10.11.4-MariaDB-1~deb12u1 source revision as process 2044734 2023-10-30 13:37:44 0 [Warning] You need to use --log-bin to make --log-slave-updates work. 2023-10-30 13:37:44 0 [Warning] You need to use --log-bin to make --binlog-format work. 2023-10-30 13:37:44 0 [Note] Initializing built-in plugins 2023-10-30 13:37:44 0 [Note] Initializing plugins specified on the command line 2023-10-30 13:37:44 0 [Note] Loaded 'type_mysql_json.so' with offset 0x7fa11d248000 2023-10-30 13:37:44 0 [Note] InnoDB: Compressed tables use zlib 1.2.13 2023-10-30 13:37:44 0 [Note] InnoDB: Number of transaction pools: 1 2023-10-30 13:37:44 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions 2023-10-30 13:37:44 0 [Note] InnoDB: Using liburing 2023-10-30 13:37:44 0 [Note] InnoDB: Initializing buffer pool, total size = 60.000GiB, chunk size = 0.938GiB 2023-10-30 13:37:44 0 [Note] InnoDB: Completed initialization of buffer pool 2023-10-30 13:37:44 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) 2023-10-30 13:37:45 0 [Note] InnoDB: 128 rollback segments are active. 2023-10-30 13:37:45 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1" 2023-10-30 13:37:45 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... 2023-10-30 13:37:45 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. 2023-10-30 13:37:45 0 [Note] InnoDB: log sequence number 285925208002314; transaction id 287515545038 2023-10-30 13:37:45 0 [Note] Plugin 'FEEDBACK' is disabled. 2023-10-30 13:37:45 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2023-10-30 13:37:45 0 [Note] Initializing installed plugins 2023-10-30 13:37:45 0 [Note] Loaded 'ha_archive.so' with offset 0x7fa11c13b000 2023-10-30 13:37:45 0 [Note] Server socket created on IP: '0.0.0.0'. 2023-10-30 13:37:45 0 [Note] Server socket created on IP: '0.0.0.0'. 2023-10-30 13:37:45 0 [Note] Reading of all Master_info entries succeeded 2023-10-30 13:37:45 0 [Note] Added new Master_info '' to hash table 2023-10-30 13:37:45 0 [Warning] Recovery from master pos 757000065 and file mysql-bin.077930. 2023-10-30 13:37:45 4 [Note] Slave I/O thread: Start asynchronous replication to master 'repl@master.server:3306' in log 'mysql-bin.077930' at position 757000065 2023-10-30 13:37:45 0 [Note] /usr/sbin/mariadbd: ready for connections. Version: '10.11.4-MariaDB-1~deb12u1' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Debian 12 2023-10-30 13:37:45 5 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.077930' at position 757000065, relay log '/var/lib/mysql/replica-relay-bin.000001' position: 4; GTID position '0-9-97791069143' 2023-10-30 13:37:45 4 [Note] Slave I/O thread: connected to master 'repl@master.server:3306',replication starts at GTID position '0-9-97791069143' 2023-10-30 13:37:46 5 [ERROR] mariadbd: Can't find record in 'result' 2023-10-30 13:37:46 5 [ERROR] Slave SQL: Could not execute Update_rows_v1 event on table retriever.result; Can't find record in 'result', Error_code: 1032; handler error HA_ERR_KEY_NOT_FOUND; the event's master log mysql-bin.077930, end_log_pos 757004669, Gtid 0-9-97791069144, Internal MariaDB error code: 1032 2023-10-30 13:37:46 5 [Warning] Slave: Can't find record in 'result' Error_code: 1032 2023-10-30 13:37:46 5 [ERROR] Error running query, slave SQL thread aborted. Fix the problem, and restart the slave SQL thread with "SLAVE START". We stopped at log 'mysql-bin.077930' position 757000065; GTID position '0-9-97791069143' 2023-10-30 13:37:46 5 [Note] Slave SQL thread exiting, replication stopped in log 'mysql-bin.077930' at position 757000065; GTID position '0-9-97791069143', master: master.server:3306 2023-10-30 13:38:13 0 [Note] InnoDB: Buffer pool(s) load completed at 231030 13:38:13