Feb 3 03:32:14 node01 mariadbd[1055]: 2025-02-03 3:32:14 423885 [Warning] InnoDB: Retry attempts for writing partial data failed. Feb 3 03:32:14 node01 mariadbd[1055]: 2025-02-03 3:32:14 423885 [ERROR] [FATAL] InnoDB: Unknown error Temp file write failure Feb 3 03:32:14 node01 mariadbd[1055]: 250203 3:32:14 [ERROR] mysqld got signal 6 ; Feb 3 03:32:14 node01 mariadbd[1055]: Sorry, we probably made a mistake, and this is a bug. Feb 3 03:32:14 node01 mariadbd[1055]: Your assistance in bug reporting will enable us to fix this for the next release. Feb 3 03:32:14 node01 mariadbd[1055]: To report this bug, see https://mariadb.com/kb/en/reporting-bugs Feb 3 03:32:14 node01 mariadbd[1055]: We will try our best to scrape up some info that will hopefully help Feb 3 03:32:14 node01 mariadbd[1055]: diagnose the problem, but since we have already crashed, Feb 3 03:32:14 node01 mariadbd[1055]: something is definitely wrong and this may fail. Feb 3 03:32:14 node01 mariadbd[1055]: Server version: 10.11.10-MariaDB-ubu2004-log source revision: 3d0fb150289716ca75cd64d62823cf715ee47646 Feb 3 03:32:14 node01 mariadbd[1055]: key_buffer_size=131072 Feb 3 03:32:14 node01 mariadbd[1055]: read_buffer_size=131072 Feb 3 03:32:14 node01 mariadbd[1055]: max_used_connections=48 Feb 3 03:32:14 node01 mariadbd[1055]: max_threads=258 Feb 3 03:32:14 node01 mariadbd[1055]: thread_count=57 Feb 3 03:32:14 node01 mariadbd[1055]: It is possible that mysqld could use up to Feb 3 03:32:14 node01 mariadbd[1055]: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 568410 K bytes of memory Feb 3 03:32:14 node01 mariadbd[1055]: Hope that's ok; if not, decrease some variables in the equation. Feb 3 03:32:14 node01 mariadbd[1055]: WSREP: Suppressing further logging Feb 3 03:32:14 node01 mariadbd[1055]: WSREP: Shutting down network communications Feb 3 03:32:14 node01 mariadbd[1055]: Thread pointer: 0x7f4d78000c58 Feb 3 03:32:14 node01 mariadbd[1055]: Attempting backtrace. You can use the following information to find out Feb 3 03:32:14 node01 mariadbd[1055]: where mysqld died. If you see no messages after this, something went Feb 3 03:32:14 node01 mariadbd[1055]: terribly wrong... Feb 3 03:32:14 node01 mariadbd[1055]: stack_bottom = 0x7f4f1cd35000 thread_stack 0x49000 Feb 3 03:32:14 node01 mariadbd[1055]: Printing to addr2line failed Feb 3 03:32:14 node01 mariadbd[1055]: /usr/sbin/mariadbd(my_print_stacktrace+0x32)[0x561311c57092] Feb 3 03:32:14 node01 mariadbd[1055]: /usr/sbin/mariadbd(handle_fatal_signal+0x485)[0x561311701b05] Feb 3 03:32:14 node01 mariadbd[1055]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7f4f2052b420] Feb 3 03:32:15 node01 mariadbd[1055]: 2025-02-03 3:32:15 0 [Note] WSREP: (47d1fc80-b98d, 'ssl://0.0.0.0:4567') turning message relay requesting on, nonlive peers: ssl://10.96.37.0:4567 ssl://10.96.37.2:4567 Feb 3 03:32:15 node01 mariadbd[1055]: /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcb)[0x7f4f2001400b] Feb 3 03:32:15 node01 mariadbd[1055]: /lib/x86_64-linux-gnu/libc.so.6(abort+0x12b)[0x7f4f1fff3859] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(+0x6c61f1)[0x5613113111f1] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(+0x6b988d)[0x56131130488d] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(+0xe7a2f9)[0x561311ac52f9] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(+0xdbdf93)[0x561311a08f93] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(_ZN7handler12ha_write_rowEPKh+0x1f0)[0x561311711680] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(+0x90713e)[0x56131155213e] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(_Z17mysql_alter_tableP3THDPK25st_mysql_const_lex_stringS3_P22Table_specification_stP10TABLE_LISTP13Recreate_infoP10Alter_infojP8st_orderbb+0x4b6d)[0x56131155cb9d] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(_Z20mysql_recreate_tableP3THDP10TABLE_LISTP13Recreate_infob+0x403)[0x56131155e113] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(+0x9870f8)[0x5613115d20f8] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(+0x9894b8)[0x5613115d44b8] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(_ZN22Sql_cmd_optimize_table7executeEP3THD+0xed)[0x5613115d653d] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(_Z21mysql_execute_commandP3THDb+0xed6)[0x561311499616] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(_ZN18Prepared_statement7executeEP6Stringb+0x4aa)[0x5613114bcbea] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(_ZN18Prepared_statement12execute_loopEP6StringbPhS2_+0xa1)[0x5613114bce11] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(+0x872e95)[0x5613114bde95] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(_Z19mysqld_stmt_executeP3THDPcj+0x30)[0x5613114be070] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(_Z16dispatch_command19enum_server_commandP3THDPcjb+0x1d5b)[0x56131149617b] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(_Z10do_commandP3THDb+0x149)[0x561311497879] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x385)[0x5613115c6075] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(handle_one_connection+0x5d)[0x5613115c63cd] Feb 3 03:32:15 node01 mariadbd[1055]: /usr/sbin/mariadbd(+0xd01dd6)[0x56131194cdd6]Feb 3 03:32:15 node01 mariadbd[1055]: 2025-02-03 3:32:15 0 [Note] /usr/sbin/mariadbd (initiated by: unknown): Normal shutdown Feb 3 03:32:15 node01 mariadbd[1055]: 2025-02-03 3:32:15 0 [Note] WSREP: Shutdown replication Feb 3 03:32:15 node01 mariadbd[1055]: 2025-02-03 3:32:15 0 [Note] WSREP: Server status change synced -> disconnecting Feb 3 03:32:15 node01 mariadbd[1055]: 2025-02-03 3:32:15 0 [Note] WSREP: Closing send monitor... Feb 3 03:32:15 node01 mariadbd[1055]: 2025-02-03 3:32:15 0 [Note] WSREP: Closed send monitor. Feb 3 03:32:15 node01 mariadbd[1055]: 2025-02-03 3:32:15 0 [Note] WSREP: gcomm: terminating thread Feb 3 03:32:15 node01 mariadbd[1055]: 2025-02-03 3:32:15 0 [Note] WSREP: gcomm: joining thread Feb 3 03:32:15 node01 mariadbd[1055]: 2025-02-03 3:32:15 0 [Note] WSREP: gcomm: closing backend Feb 3 03:32:15 node01 mariadbd[1055]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609)[0x7f4f2051f609] Feb 3 03:32:15 node01 mariadbd[1055]: /lib/x86_64-linux-gnu/libc.so.6(clone+0x43)[0x7f4f200f0353] Feb 3 03:32:15 node01 mariadbd[1055]: Trying to get some variables. Feb 3 03:32:15 node01 mariadbd[1055]: Some pointers may be invalid and cause the dump to abort. Feb 3 03:32:15 node01 mariadbd[1055]: Query (0x7f4d7822a590): OPTIMIZE TABLE `authc`.`log` Feb 3 03:32:15 node01 mariadbd[1055]: Connection ID (thread ID): 423885 Feb 3 03:32:15 node01 mariadbd[1055]: Status: NOT_KILLED Feb 3 03:32:15 node01 mariadbd[1055]: Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off,hash_join_cardinality=off,cset_narrowing=off Feb 3 03:32:15 node01 mariadbd[1055]: The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mariadbd/ contains Feb 3 03:32:15 node01 mariadbd[1055]: information that should help you find out what is causing the crash. Feb 3 03:32:15 node01 mariadbd[1055]: Writing a core file... Feb 3 03:32:15 node01 mariadbd[1055]: Working directory at /database/mysql Feb 3 03:32:15 node01 mariadbd[1055]: Resource Limits: Feb 3 03:32:15 node01 mariadbd[1055]: Limit Soft Limit Hard Limit Units Feb 3 03:32:15 node01 mariadbd[1055]: Max cpu time unlimited unlimited seconds Feb 3 03:32:15 node01 mariadbd[1055]: Max file size unlimited unlimited bytes Feb 3 03:32:15 node01 mariadbd[1055]: Max data size unlimited unlimited bytes Feb 3 03:32:15 node01 mariadbd[1055]: Max stack size 8388608 unlimited bytes Feb 3 03:32:15 node01 mariadbd[1055]: Max core file size 0 unlimited bytes Feb 3 03:32:15 node01 mariadbd[1055]: Max resident set unlimited unlimited bytes Feb 3 03:32:15 node01 mariadbd[1055]: Max processes 63865 63865 processes Feb 3 03:32:15 node01 mariadbd[1055]: Max open files 131070 131070 files Feb 3 03:32:15 node01 mariadbd[1055]: Max locked memory 65536 65536 bytes Feb 3 03:32:15 node01 mariadbd[1055]: Max address space unlimited unlimited bytes Feb 3 03:32:15 node01 mariadbd[1055]: Max file locks unlimited unlimited locks Feb 3 03:32:15 node01 mariadbd[1055]: Max pending signals 63865 63865 signals Feb 3 03:32:15 node01 mariadbd[1055]: Max msgqueue size 819200 819200 bytes Feb 3 03:32:15 node01 mariadbd[1055]: Max nice priority 0 0 Feb 3 03:32:15 node01 mariadbd[1055]: Max realtime priority 0 0 Feb 3 03:32:15 node01 mariadbd[1055]: Max realtime timeout unlimited unlimited us Feb 3 03:32:15 node01 mariadbd[1055]: Core pattern: core Feb 3 03:32:15 node01 mariadbd[1055]: Kernel version: Linux version 5.4.0-205-generic (buildd@lcy02-amd64-055) (gcc version 9.4.0 (Ubuntu 9.4.0-1ubuntu1~20.04.2)) #225-Ubuntu SMP Fri Jan 10 22:23:35 UTC 2025 Feb 3 03:32:15 node01 systemd[1]: mariadb.service: Main process exited, code=killed, status=6/ABRT Feb 3 03:32:15 node01 systemd[1]: mariadb.service: Failed with result 'signal'.