Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: 240114 7:05:25 [ERROR] mysqld got signal 11 ; Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Sorry, we probably made a mistake, and this is a bug. Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Your assistance in bug reporting will enable us to fix this for the next release. Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: To report this bug, see https://mariadb.com/kb/en/reporting-bugs Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: We will try our best to scrape up some info that will hopefully help Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: diagnose the problem, but since we have already crashed, Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: something is definitely wrong and this may fail. Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Server version: 11.3.1-MariaDB-log source revision: 67a0224a3e0073c4e083a6f7e24380251bcb2361 Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: key_buffer_size=134217728 Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: read_buffer_size=131072 Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: max_used_connections=19 Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: max_threads=102 Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: thread_count=19 Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: It is possible that mysqld could use up to Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 53624203 K bytes of memory Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Hope that's ok; if not, decrease some variables in the equation. Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Thread pointer: 0x7fcd68000c58 Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Attempting backtrace. You can use the following information to find out Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: where mysqld died. If you see no messages after this, something went Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: terribly wrong... Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: stack_bottom = 0x7fcdfc106bf8 thread_stack 0x49000 Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(my_print_stacktrace+0x2e)[0x55731c5d601e] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(handle_fatal_signal+0x468)[0x55731c0b7ba8] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /lib64/libc.so.6(+0x54db0)[0x7fd4c1e54db0] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(handler_rowid_filter_check+0x54)[0x55731c0c5d74] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(+0xe5bfe4)[0x55731c460fe4] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(+0xe5f817)[0x55731c464817] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(+0xd9a188)[0x55731c39f188] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_ZN7handler10ha_rnd_posEPhS0_+0x225)[0x55731c0bfa45] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_Z16rr_from_pointersP11READ_RECORD+0x38)[0x55731bd74888] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_ZN12multi_delete16do_table_deletesEP5TABLEP9SORT_INFOb+0x94)[0x55731bdfb034] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_ZN12multi_delete10do_deletesEv+0x84)[0x55731bdfb2f4] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_ZN12multi_delete8send_eofEv+0x71)[0x55731bdfb3d1] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_ZN4JOIN10exec_innerEv+0xf4d)[0x55731bec2d9d] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_ZN4JOIN4execEv+0x3b)[0x55731bec323b] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_ZN11Sql_cmd_dml13execute_innerEP3THD+0x76)[0x55731bec3366] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_ZN14Sql_cmd_delete13execute_innerEP3THD+0x26)[0x55731bdfacc6] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_ZN11Sql_cmd_dml7executeEP3THD+0xdb)[0x55731be7e2bb] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_Z21mysql_execute_commandP3THDb+0x490e)[0x55731be4782e] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_Z11mysql_parseP3THDPcjP12Parser_state+0x211)[0x55731be48781] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_Z16dispatch_command19enum_server_commandP3THDPcjb+0x1685)[0x55731be4b175] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_Z10do_commandP3THDb+0x134)[0x55731be4cdc4] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x3bf)[0x55731bf71b3f] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(handle_one_connection+0x5d)[0x55731bf71e8d] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /usr/sbin/mariadbd(+0xcd90c2)[0x55731c2de0c2] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /lib64/libc.so.6(+0x9f802)[0x7fd4c1e9f802] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: /lib64/libc.so.6(+0x3f450)[0x7fd4c1e3f450] Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Trying to get some variables. Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Some pointers may be invalid and cause the dump to abort. Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Query (0x7fcd68010bc0): delete t from audit_comment_ids_to_cleanup$ inner join action_history t on audit_comment_ids_to_cleanup$.comment_id = t.comment_id where action in (0,1,3,4,9,10,23) Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Connection ID (thread ID): 29 Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Status: NOT_KILLED Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off,hash_join_cardinality=on,cset_narrowing=off,sargable_casefold=on Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mariadbd/ contains Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: information that should help you find out what is causing the crash. Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Writing a core file... Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Working directory at /var/lib/mysql Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Resource Limits: Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Limit Soft Limit Hard Limit Units Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max cpu time unlimited unlimited seconds Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max file size unlimited unlimited bytes Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max data size unlimited unlimited bytes Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max stack size 8388608 unlimited bytes Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max core file size 0 unlimited bytes Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max resident set unlimited unlimited bytes Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max processes 254671 254671 processes Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max open files 32768 32768 files Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max locked memory 8388608 8388608 bytes Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max address space unlimited unlimited bytes Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max file locks unlimited unlimited locks Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max pending signals 254671 254671 signals Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max msgqueue size 819200 819200 bytes Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max nice priority 0 0 Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max realtime priority 0 0 Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Max realtime timeout unlimited unlimited us Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Core pattern: |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h Jan 14 07:05:25 cognitive-teamcity-db mariadbd[294867]: Kernel version: Linux version 5.14.0-362.13.1.el9_3.x86_64 (mockbuild@x86-64-01.build.eng.rdu2.redhat.com) (gcc (GCC) 11.4.1 20230605 (Red Hat 11.4.1-2), GNU ld version 2.35.2-42.el9) #1 SMP PREEMPT_DYNAMIC Fri Nov 24 01:57:57 EST 2023 Jan 14 07:05:31 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:31 0 [Note] Starting MariaDB 11.3.1-MariaDB-log source revision 67a0224a3e0073c4e083a6f7e24380251bcb2361 as process 686685 Jan 14 07:05:31 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:31 0 [Warning] No argument was provided to --log-bin and neither --log-basename or --log-bin-index where used; This may cause repliction to break when this server acts as a master and has its hostname changed! Please use '--log-basename=cognitive-teamcity-db.cisco.com' or '--log-bin=cognitive-teamcity-db-bin' to avoid this problem. Jan 14 07:05:31 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:31 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 Jan 14 07:05:31 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:31 0 [Note] InnoDB: Number of transaction pools: 1 Jan 14 07:05:31 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:31 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions Jan 14 07:05:31 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:31 0 [Note] InnoDB: Using Linux native AIO Jan 14 07:05:31 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:31 0 [Note] InnoDB: Initializing buffer pool, total size = 26.000GiB, chunk size = 416.000MiB Jan 14 07:05:31 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:31 0 [Note] InnoDB: Completed initialization of buffer pool Jan 14 07:05:31 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:31 0 [Note] InnoDB: Resetting space id's in the doublewrite buffer Jan 14 07:05:31 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:31 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) Jan 14 07:05:32 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:32 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=348965435426 Jan 14 07:05:32 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:32 0 [Note] InnoDB: Ignoring data file './teamcity/#sql-alter-47fd3-14.ibd' with space ID 911. Another data file called ./teamcity/build_type_vcs_change.ibd exists with the same space ID. Jan 14 07:05:32 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:32 0 [Note] InnoDB: Ignoring data file './teamcity/#sql-alter-47fd3-14.ibd' with space ID 911. Another data file called ./teamcity/build_type_vcs_change.ibd exists with the same space ID. Jan 14 07:05:32 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:32 0 [Note] InnoDB: Ignoring data file './teamcity/#sql-alter-47fd3-14.ibd' with space ID 911. Another data file called ./teamcity/build_type_vcs_change.ibd exists with the same space ID. Jan 14 07:05:38 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:38 0 [Note] InnoDB: End of log at LSN=349710600592 Jan 14 07:05:39 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:39 0 [Note] InnoDB: 2 transaction(s) which must be rolled back or cleaned up in total 2724 row operations to undo Jan 14 07:05:39 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:39 0 [Note] InnoDB: Trx id counter is 347793715 Jan 14 07:05:39 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:39 0 [Note] InnoDB: To recover: 110357 pages Jan 14 07:05:54 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:05:54 0 [Note] InnoDB: To recover: 110357 pages Jan 14 07:06:09 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:09 0 [Note] InnoDB: To recover: 110357 pages Jan 14 07:06:24 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:24 0 [Note] InnoDB: To recover: 110357 pages Jan 14 07:06:39 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:39 0 [Note] InnoDB: To recover: 110357 pages Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] InnoDB: Last binlog file './cognitive-teamcity-db-bin.002254', position 158733628 Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] InnoDB: Opened 3 undo tablespaces Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] InnoDB: 128 rollback segments in 3 undo tablespaces are active. Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] InnoDB: Starting in background the rollback of recovered transactions Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1" Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] InnoDB: log sequence number 349710600592; transaction id 347793716 Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] Plugin 'FEEDBACK' is disabled. Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] Plugin 'wsrep-provider' is disabled. Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] InnoDB: Rolled back recovered transaction 347793709 Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Warning] 'innodb-log-files-in-group' was removed. It does nothing now and exists only for compatibility with old my.cnf files. Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Warning] 'innodb-log-files-in-group' was removed. It does nothing now and exists only for compatibility with old my.cnf files. Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] Recovering after a crash using cognitive-teamcity-db-bin Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] Starting table crash recovery... Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] Crash table recovery finished. Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] InnoDB: Rolled back recovered transaction 347793713 Jan 14 07:06:44 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:44 0 [Note] InnoDB: Rollback of non-prepared transactions completed Jan 14 07:06:45 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:45 0 [Note] Server socket created on IP: '0.0.0.0'. Jan 14 07:06:45 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:45 0 [Note] Server socket created on IP: '::'. Jan 14 07:06:45 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:45 0 [Note] mariadbd: Event Scheduler: Loaded 0 events Jan 14 07:06:45 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:06:45 0 [Note] /usr/sbin/mariadbd: ready for connections. Jan 14 07:06:45 cognitive-teamcity-db mariadbd[686685]: Version: '11.3.1-MariaDB-log' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server Jan 14 07:08:40 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 7:08:40 0 [Note] InnoDB: Buffer pool(s) load completed at 240114 7:08:40 Jan 14 20:00:22 cognitive-teamcity-db mariadbd[686685]: 2024-01-14 20:00:22 10 [Warning] Aborted connection 10 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 15:15:46 cognitive-teamcity-db mariadbd[686685]: 2024-01-15 15:15:46 0 [Note] /usr/sbin/mariadbd (initiated by: unknown): Normal shutdown Jan 15 15:15:46 cognitive-teamcity-db mariadbd[686685]: 2024-01-15 15:15:46 0 [Note] InnoDB: FTS optimize thread exiting. Jan 15 15:15:46 cognitive-teamcity-db mariadbd[686685]: 2024-01-15 15:15:46 0 [Note] InnoDB: Starting shutdown... Jan 15 15:15:46 cognitive-teamcity-db mariadbd[686685]: 2024-01-15 15:15:46 0 [Note] InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool Jan 15 15:15:46 cognitive-teamcity-db mariadbd[686685]: 2024-01-15 15:15:46 0 [Note] InnoDB: Restricted to 421840 pages due to innodb_buf_pool_dump_pct=25 Jan 15 15:15:46 cognitive-teamcity-db mariadbd[686685]: 2024-01-15 15:15:46 0 [Note] InnoDB: Buffer pool(s) dump completed at 240115 15:15:46 Jan 15 15:17:06 cognitive-teamcity-db mariadbd[686685]: 2024-01-15 15:17:06 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1" Jan 15 15:17:06 cognitive-teamcity-db mariadbd[686685]: 2024-01-15 15:17:06 0 [Note] InnoDB: Shutdown completed; log sequence number 350130705479; transaction id 348711034 Jan 15 15:17:06 cognitive-teamcity-db mariadbd[686685]: 2024-01-15 15:17:06 0 [Note] /usr/sbin/mariadbd: Shutdown complete Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] Starting MariaDB 11.3.1-MariaDB-log source revision 67a0224a3e0073c4e083a6f7e24380251bcb2361 as process 1004113 Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Warning] No argument was provided to --log-bin and neither --log-basename or --log-bin-index where used; This may cause repliction to break when this server acts as a master and has its hostname changed! Please use '--log-basename=cognitive-teamcity-db.cisco.com' or '--log-bin=cognitive-teamcity-db-bin' to avoid this problem. Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: Number of transaction pools: 1 Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: Using Linux native AIO Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: Initializing buffer pool, total size = 26.000GiB, chunk size = 416.000MiB Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: Completed initialization of buffer pool Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: Resetting space id's in the doublewrite buffer Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: End of log at LSN=350130705479 Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: Opened 3 undo tablespaces Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: 128 rollback segments in 3 undo tablespaces are active. Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: log sequence number 350130705479; transaction id 348711035 Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] Plugin 'FEEDBACK' is disabled. Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] Plugin 'wsrep-provider' is disabled. Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Warning] 'innodb-log-files-in-group' was removed. It does nothing now and exists only for compatibility with old my.cnf files. Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Warning] 'innodb-log-files-in-group' was removed. It does nothing now and exists only for compatibility with old my.cnf files. Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] Server socket created on IP: '0.0.0.0'. Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] Server socket created on IP: '::'. Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] mariadbd: Event Scheduler: Loaded 0 events Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:17:07 0 [Note] /usr/sbin/mariadbd: ready for connections. Jan 15 15:17:07 cognitive-teamcity-db mariadbd[1004113]: Version: '11.3.1-MariaDB-log' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server Jan 15 15:19:56 cognitive-teamcity-db mariadbd[1004113]: 2024-01-15 15:19:56 0 [Note] InnoDB: Buffer pool(s) load completed at 240115 15:19:56 Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: 240115 15:32:44 [ERROR] mysqld got signal 11 ; Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Sorry, we probably made a mistake, and this is a bug. Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Your assistance in bug reporting will enable us to fix this for the next release. Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: To report this bug, see https://mariadb.com/kb/en/reporting-bugs Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: We will try our best to scrape up some info that will hopefully help Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: diagnose the problem, but since we have already crashed, Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: something is definitely wrong and this may fail. Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Server version: 11.3.1-MariaDB-log source revision: 67a0224a3e0073c4e083a6f7e24380251bcb2361 Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: key_buffer_size=134217728 Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: read_buffer_size=131072 Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: max_used_connections=17 Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: max_threads=102 Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: thread_count=17 Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: It is possible that mysqld could use up to Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 53624203 K bytes of memory Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Hope that's ok; if not, decrease some variables in the equation. Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Thread pointer: 0x7f0c28000c58 Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Attempting backtrace. You can use the following information to find out Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: where mysqld died. If you see no messages after this, something went Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: terribly wrong... Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: stack_bottom = 0x7f0ccc270bf8 thread_stack 0x49000 Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(my_print_stacktrace+0x2e)[0x556bb157501e] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(handle_fatal_signal+0x468)[0x556bb1056ba8] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /lib64/libc.so.6(+0x54db0)[0x7f1381254db0] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(handler_rowid_filter_check+0x54)[0x556bb1064d74] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(+0xe5bfe4)[0x556bb13fffe4] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(+0xe5f817)[0x556bb1403817] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(+0xd9a188)[0x556bb133e188] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_ZN7handler10ha_rnd_posEPhS0_+0x225)[0x556bb105ea45] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_Z16rr_from_pointersP11READ_RECORD+0x38)[0x556bb0d13888] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_ZN12multi_delete16do_table_deletesEP5TABLEP9SORT_INFOb+0x94)[0x556bb0d9a034] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_ZN12multi_delete10do_deletesEv+0x84)[0x556bb0d9a2f4] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_ZN12multi_delete8send_eofEv+0x71)[0x556bb0d9a3d1] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_ZN4JOIN10exec_innerEv+0xf4d)[0x556bb0e61d9d] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_ZN4JOIN4execEv+0x3b)[0x556bb0e6223b] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_ZN11Sql_cmd_dml13execute_innerEP3THD+0x76)[0x556bb0e62366] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_ZN14Sql_cmd_delete13execute_innerEP3THD+0x26)[0x556bb0d99cc6] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_ZN11Sql_cmd_dml7executeEP3THD+0xdb)[0x556bb0e1d2bb] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_Z21mysql_execute_commandP3THDb+0x490e)[0x556bb0de682e] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_Z11mysql_parseP3THDPcjP12Parser_state+0x211)[0x556bb0de7781] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_Z16dispatch_command19enum_server_commandP3THDPcjb+0x1685)[0x556bb0dea175] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_Z10do_commandP3THDb+0x134)[0x556bb0debdc4] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x3bf)[0x556bb0f10b3f] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(handle_one_connection+0x5d)[0x556bb0f10e8d] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /usr/sbin/mariadbd(+0xcd90c2)[0x556bb127d0c2] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /lib64/libc.so.6(+0x9f802)[0x7f138129f802] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: /lib64/libc.so.6(+0x3f450)[0x7f138123f450] Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Trying to get some variables. Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Some pointers may be invalid and cause the dump to abort. Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Query (0x7f0c28010c30): delete t from audit_comment_ids_to_cleanup$ inner join action_history t on audit_comment_ids_to_cleanup$.comment_id = t.comment_id where action in (0,1,3,4,9,10,23) Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Connection ID (thread ID): 31 Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Status: NOT_KILLED Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off,hash_join_cardinality=on,cset_narrowing=off,sargable_casefold=on Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mariadbd/ contains Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: information that should help you find out what is causing the crash. Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Writing a core file... Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Working directory at /var/lib/mysql Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Resource Limits: Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Limit Soft Limit Hard Limit Units Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max cpu time unlimited unlimited seconds Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max file size unlimited unlimited bytes Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max data size unlimited unlimited bytes Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max stack size 8388608 unlimited bytes Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max core file size 0 unlimited bytes Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max resident set unlimited unlimited bytes Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max processes 254671 254671 processes Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max open files 32768 32768 files Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max locked memory 8388608 8388608 bytes Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max address space unlimited unlimited bytes Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max file locks unlimited unlimited locks Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max pending signals 254671 254671 signals Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max msgqueue size 819200 819200 bytes Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max nice priority 0 0 Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max realtime priority 0 0 Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Max realtime timeout unlimited unlimited us Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Core pattern: |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h Jan 15 15:32:44 cognitive-teamcity-db mariadbd[1004113]: Kernel version: Linux version 5.14.0-362.13.1.el9_3.x86_64 (mockbuild@x86-64-01.build.eng.rdu2.redhat.com) (gcc (GCC) 11.4.1 20230605 (Red Hat 11.4.1-2), GNU ld version 2.35.2-42.el9) #1 SMP PREEMPT_DYNAMIC Fri Nov 24 01:57:57 EST 2023 Jan 15 15:32:49 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:32:49 0 [Note] Starting MariaDB 11.3.1-MariaDB-log source revision 67a0224a3e0073c4e083a6f7e24380251bcb2361 as process 1007087 Jan 15 15:32:49 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:32:49 0 [Warning] No argument was provided to --log-bin and neither --log-basename or --log-bin-index where used; This may cause repliction to break when this server acts as a master and has its hostname changed! Please use '--log-basename=cognitive-teamcity-db.cisco.com' or '--log-bin=cognitive-teamcity-db-bin' to avoid this problem. Jan 15 15:32:49 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:32:49 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 Jan 15 15:32:49 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:32:49 0 [Note] InnoDB: Number of transaction pools: 1 Jan 15 15:32:49 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:32:49 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions Jan 15 15:32:49 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:32:49 0 [Note] InnoDB: Using Linux native AIO Jan 15 15:32:49 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:32:49 0 [Note] InnoDB: Initializing buffer pool, total size = 26.000GiB, chunk size = 416.000MiB Jan 15 15:32:50 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:32:50 0 [Note] InnoDB: Completed initialization of buffer pool Jan 15 15:32:50 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:32:50 0 [Note] InnoDB: Resetting space id's in the doublewrite buffer Jan 15 15:32:50 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:32:50 0 [Note] InnoDB: Buffered log writes (block size=512 bytes) Jan 15 15:32:50 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:32:50 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=350130705463 Jan 15 15:32:52 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:32:52 0 [Note] InnoDB: End of log at LSN=350380640767 Jan 15 15:32:52 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:32:52 0 [Note] InnoDB: To recover: 116189 pages Jan 15 15:33:07 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:33:07 0 [Note] InnoDB: To recover: 116189 pages Jan 15 15:33:22 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:33:22 0 [Note] InnoDB: To recover: 116189 pages Jan 15 15:33:37 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:33:37 0 [Note] InnoDB: To recover: 116189 pages Jan 15 15:33:52 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:33:52 0 [Note] InnoDB: To recover: 116189 pages Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] InnoDB: Last binlog file './cognitive-teamcity-db-bin.002259', position 62504457 Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] InnoDB: Opened 3 undo tablespaces Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] InnoDB: 128 rollback segments in 3 undo tablespaces are active. Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1" Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] InnoDB: log sequence number 350380640767; transaction id 348726612 Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] Plugin 'FEEDBACK' is disabled. Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] Plugin 'wsrep-provider' is disabled. Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Warning] 'innodb-log-files-in-group' was removed. It does nothing now and exists only for compatibility with old my.cnf files. Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Warning] 'innodb-log-files-in-group' was removed. It does nothing now and exists only for compatibility with old my.cnf files. Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] Recovering after a crash using cognitive-teamcity-db-bin Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] Starting table crash recovery... Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] Crash table recovery finished. Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] Server socket created on IP: '0.0.0.0'. Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] Server socket created on IP: '::'. Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] mariadbd: Event Scheduler: Loaded 0 events Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:34:00 0 [Note] /usr/sbin/mariadbd: ready for connections. Jan 15 15:34:00 cognitive-teamcity-db mariadbd[1007087]: Version: '11.3.1-MariaDB-log' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server Jan 15 15:36:36 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 15:36:36 0 [Note] InnoDB: Buffer pool(s) load completed at 240115 15:36:36 Jan 15 23:34:03 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:03 6 [Warning] Aborted connection 6 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:03 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:03 4 [Warning] Aborted connection 4 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:04 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:04 7 [Warning] Aborted connection 7 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:04 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:04 12 [Warning] Aborted connection 12 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:05 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:05 5 [Warning] Aborted connection 5 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:05 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:05 10 [Warning] Aborted connection 10 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:06 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:06 9 [Warning] Aborted connection 9 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:08 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:08 36 [Warning] Aborted connection 36 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:09 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:09 22 [Warning] Aborted connection 22 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:09 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:09 35 [Warning] Aborted connection 35 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:10 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:10 29 [Warning] Aborted connection 29 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:13 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:13 18 [Warning] Aborted connection 18 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:14 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:14 30 [Warning] Aborted connection 30 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:14 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:14 34 [Warning] Aborted connection 34 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:14 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:14 24 [Warning] Aborted connection 24 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:14 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:14 15 [Warning] Aborted connection 15 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:14 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:14 41 [Warning] Aborted connection 41 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:14 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:14 25 [Warning] Aborted connection 25 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:26 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:26 39 [Warning] Aborted connection 39 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 15 23:34:26 cognitive-teamcity-db mariadbd[1007087]: 2024-01-15 23:34:26 21 [Warning] Aborted connection 21 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 16 00:37:44 cognitive-teamcity-db mariadbd[1007087]: 2024-01-16 0:37:44 40 [Warning] Aborted connection 40 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 16 02:00:05 cognitive-teamcity-db mariadbd[1007087]: 2024-01-16 2:00:05 20 [Warning] Aborted connection 20 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 16 05:00:21 cognitive-teamcity-db mariadbd[1007087]: 2024-01-16 5:00:21 33 [Warning] Aborted connection 33 to db: 'teamcity' user: 'teamcity' host: 'cognitive-teamcity.cisco.com' (Got timeout reading communication packets) Jan 16 10:52:24 cognitive-teamcity-db cmd_history[1199488]: real_user=ptoman ; curr_user=root ; tty=/dev/pts/1 ; pwd=/ ; command=more /var/log/messages | fgrep "cognitive-teamcity-db mariadbd" Jan 16 10:52:24 cognitive-teamcity-db cmd_history[1199493]: real_user=ptoman ; curr_user=root ; tty=/dev/pts/1 ; pwd=/ ; command=more /var/log/messages | fgrep "cognitive-teamcity-db mariadbd" Jan 16 11:13:29 cognitive-teamcity-db mariadbd[1007087]: 2024-01-16 11:13:29 4759 [Warning] Access denied for user 'teamcity'@'localhost'