-- Logs begin at Sat 2023-05-27 13:06:32 CEST, end at Thu 2023-07-27 13:29:03 CEST. -- Jul 26 08:53:24 fra1pro-be-xtradb-3 mariadbd[1780620]: 2023-07-26 8:53:24 0 [Warning] InnoDB: Total InnoDB FTS size 8608767 for the table `data_2`.`tmp_x_rics` exceeds the innodb_ft_cache_size 8000000 Jul 26 08:53:53 fra1pro-be-xtradb-3 mariadbd[1780620]: 2023-07-26 8:53:53 0 [Warning] InnoDB: Total InnoDB FTS size 10344661 for the table `data_2`.`tmp_x_rics` exceeds the innodb_ft_cache_size 8000000 Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: 230726 8:58:14 [ERROR] mysqld got signal 11 ; Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: This could be because you hit a bug. It is also possible that this binary Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: or one of the libraries it was linked against is corrupt, improperly built, Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: or misconfigured. This error can also be caused by malfunctioning hardware. Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: To report this bug, see https://mariadb.com/kb/en/reporting-bugs Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: We will try our best to scrape up some info that will hopefully help Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: diagnose the problem, but since we have already crashed, Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: something is definitely wrong and this may fail. Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: Server version: 10.11.4-MariaDB-log source revision: 4e2b93dffef2414a11ca5edc8d215f57ee5010e5 Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: key_buffer_size=4194304 Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: read_buffer_size=2097152 Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: max_used_connections=409 Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: max_threads=1002 Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: thread_count=414 Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: It is possible that mysqld could use up to Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 2595703 K bytes of memory Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: Hope that's ok; if not, decrease some variables in the equation. Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: Thread pointer: 0x7ee9f8000c58 Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: Attempting backtrace. You can use the following information to find out Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: where mysqld died. If you see no messages after this, something went Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: terribly wrong... Jul 26 08:58:14 fra1pro-be-xtradb-3 mariadbd[1780620]: stack_bottom = 0x7eebfba66bd8 thread_stack 0x80000 Jul 26 08:58:15 fra1pro-be-xtradb-3 mariadbd[1780620]: Can't start addr2line Jul 26 08:58:15 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(my_print_stacktrace+0x2e)[0x55796fdf8d5e] Jul 26 08:58:15 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(handle_fatal_signal+0x485)[0x55796f8ed465] Jul 26 08:58:15 fra1pro-be-xtradb-3 mariadbd[1780620]: /lib64/libpthread.so.0(+0x12cf0)[0x7f00ff54bcf0] Jul 26 08:58:16 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(_ZN13st_join_table21choose_best_splittingEjyPK8POSITIONPy+0xa72)[0x55796f869e62] Jul 26 08:58:16 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(_Z16best_access_pathP4JOINP13st_join_tableyPK8POSITIONjbdPS3_S6_+0x16d)[0x55796f6f3b1d] Jul 26 08:58:16 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(_Z11choose_planP4JOINy+0xb02)[0x55796f6fd022] Jul 26 08:58:16 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(_ZN4JOIN14optimize_innerEv+0x3846)[0x55796f722606] Jul 26 08:58:17 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(_ZN4JOIN8optimizeEv+0xa0)[0x55796f722bf0] Jul 26 08:58:17 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(_Z12mysql_selectP3THDP10TABLE_LISTR4ListI4ItemEPS4_jP8st_orderS9_S7_S9_yP13select_resultP18st_select_lex_unitP13st_select_lex+0xce)[0x55796f722cde] Jul 26 08:58:17 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(_Z13handle_selectP3THDP3LEXP13select_resulty+0x14b)[0x55796f7234bb] Jul 26 08:58:18 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(+0x7eef63)[0x55796f6aaf63] Jul 26 08:58:18 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(_Z21mysql_execute_commandP3THDb+0x1244)[0x55796f6b33e8] Jul 26 08:58:18 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(_Z11mysql_parseP3THDPcjP12Parser_state+0x25c)[0x55796f6a6067] Jul 26 08:58:18 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(_Z16dispatch_command19enum_server_commandP3THDPcjb+0xf94)[0x55796f6afe40] Jul 26 08:58:19 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(_Z10do_commandP3THDb+0x12f)[0x55796f6b15f2] Jul 26 08:58:19 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x3f7)[0x55796f7c5de7] Jul 26 08:58:19 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(handle_one_connection+0x5d)[0x55796f7c612d] Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: /usr/sbin/mariadbd(+0xc4226d)[0x55796fafe26d] Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: /lib64/libpthread.so.0(+0x81ca)[0x7f00ff5411ca] Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: /lib64/libc.so.6(clone+0x43)[0x7f00fe892e73] Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Trying to get some variables. Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Some pointers may be invalid and cause the dump to abort. Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Query (0x7ee9f80113f0): SET STATEMENT max_statement_time=10 FOR SELECT STRAIGHT_JOIN `x_lgdf_fundcountry_0`.`LIPPERID`,`x_lgdf_fundcountry_0`.`ISIN`,`x_lgdf_fundcountry_0`.`LIPPERID`,`x_lgdf_fund_1`.`LIPPERID`,`x_lgdf_fund_1`.`ISIN`,`x_lgdf_fund_1`.`FUND_MANAGEMENT_COMPANY`,`x_lgdf_fund_1`.`LIPPERID`,`x_lgdf_fundstatistics_norm_2`.`PCTYTD`,`x_lgdf_fundstatistics_norm_2`.`CURRENCYCODE`,`x_lgdf_fundstatistics_norm_2`.`PCT5Y`,`x_instruments_3`.`_PRIMARY_RIC`,`x_instruments_3`.`_ID`,`x_instruments_3`.`_ID` FROM `data_view`.`x_lgdf_fundcountry` `x_lgdf_fundcountry_0` INNER JOIN (SELECT `x_lgdf_fund_1`.* FROM `data_view`.`x_lgdf_fund` AS `x_lgdf_fund_1` INNER JOIN (SELECT `x_lgdf_fund_1`.`LIPPERID` FROM `data_view`.`x_lgdf_fund` AS `x_lgdf_fund_1` GROUP BY `x_lgdf_fund_1`.`LIPPERID`) AS x_lgdf_fund_group ON ((`x_lgdf_fund_1`.`LIPPERID` = `x_lgdf_fund_group`.`LIPPERID`) AND (`x_lgdf_fund_1`.`LIPPERID` = (SELECT `x_lgdf_fund_limit`.`LIPPERID` FROM `data_view`.`x_lgdf_fund` AS `x_lgdf_fund_limit` WHERE (`x_lgdf_fund_group`.`LIPPERID` = `x_lgdf_fund_limit`.`LIPPERID`) LIMIT 1)))) AS `x_lgdf_fund_1` ON (`x_lgdf_fundcountry_0`.`LIPPERID` = `x_lgdf_fund_1`.`LIPPERID`) INNER JOIN `data_view`.`x_lgdf_fundstatistics_norm` `x_lgdf_fundstatistics_norm_2` ON ((`x_lgdf_fundcountry_0`.`LIPPERID` = `x_lgdf_fundstatistics_norm_2`.`LIPPERID`) AND (`x_lgdf_fundstatistics_norm_2`.`CURRENCYCODE` IN ('EUR','USD','GBP','JPY') )) LEFT OUTER JOIN `data_view`.`x_instruments` `x_instruments_3` ON ((`x_lgdf_fundcountry_0`.`LIPPERID` = `x_instruments_3`.`_LIPPER_ID`) AND (`x_instruments_3`.`_ID` = (SELECT `x_instruments_3_limit`.`_ID` FROM `data_view`.`x_instruments` AS x_instruments_3_limit WHERE (`x_lgdf_fundcountry_0`.`LIPPERID` = `x_instruments_3_limit`.`_LIPPER_ID`) LIMIT 1))) WHERE ((`x_lgdf_fundcountry_0`.`LIPPERID` IN (65078589,60054162,65103773,68132795,68398385,68147684,65097414,68581860,65082844,68046089,65055233,68015095,60034190,68432593,60001423,60091987,68012648,68239952,68305035,60056154,65009617,60058624,65082845,60056157,65080141,68115356,60038473,65111142,60033585,68321207,60077414,60034242,68048300,68398385,68547894,68583141,68585562) ) AND (`x_lgdf_fundcountry_0`.`COUNTRY_CD` IN ('LU','DE','IE','JE','FR') )) LIMIT 0, 100000 Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Connection ID (thread ID): 1397310 Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Status: KILL_TIMEOUT Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off,hash_join_cardinality=off Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: information that should help you find out what is causing the crash. Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Writing a core file... Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Working directory at /data/mysql Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Resource Limits: Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Limit Soft Limit Hard Limit Units Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max cpu time unlimited unlimited seconds Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max file size unlimited unlimited bytes Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max data size unlimited unlimited bytes Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max stack size 8388608 unlimited bytes Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max core file size 0 unlimited bytes Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max resident set unlimited unlimited bytes Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max processes 512050 512050 processes Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max open files 1000000 1000000 files Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max locked memory 65536 65536 bytes Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max address space unlimited unlimited bytes Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max file locks unlimited unlimited locks Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max pending signals 512050 512050 signals Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max msgqueue size 819200 819200 bytes Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max nice priority 0 0 Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max realtime priority 0 0 Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Max realtime timeout unlimited unlimited us Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Core pattern: |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h %e Jul 26 08:58:20 fra1pro-be-xtradb-3 mariadbd[1780620]: Kernel version: Linux version 4.18.0-448.el8.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-18) (GCC)) #1 SMP Wed Jan 18 15:02:46 UTC 2023 Jul 26 08:58:30 fra1pro-be-xtradb-3 systemd[1]: mariadb.service: Main process exited, code=dumped, status=11/SEGV Jul 26 08:58:30 fra1pro-be-xtradb-3 systemd[1]: mariadb.service: Failed with result 'core-dump'. Jul 26 08:58:35 fra1pro-be-xtradb-3 systemd[1]: mariadb.service: Service RestartSec=5s expired, scheduling restart. Jul 26 08:58:35 fra1pro-be-xtradb-3 systemd[1]: mariadb.service: Scheduled restart job, restart counter is at 1. Jul 26 08:58:35 fra1pro-be-xtradb-3 systemd[1]: Stopped MariaDB 10.11.4 database server. Jul 26 08:58:35 fra1pro-be-xtradb-3 systemd[1]: Starting MariaDB 10.11.4 database server... Jul 26 08:58:35 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 8:58:35 0 [Note] Starting MariaDB 10.11.4-MariaDB-log source revision 4e2b93dffef2414a11ca5edc8d215f57ee5010e5 as process 595660 Jul 26 08:58:35 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 8:58:35 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 Jul 26 08:58:35 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 8:58:35 0 [Note] InnoDB: Number of transaction pools: 1 Jul 26 08:58:35 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 8:58:35 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions Jul 26 08:58:35 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 8:58:35 0 [Note] InnoDB: Using Linux native AIO Jul 26 08:58:35 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 8:58:35 0 [Note] InnoDB: Initializing buffer pool, total size = 82.000GiB, chunk size = 1.281GiB Jul 26 08:58:36 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 8:58:36 0 [Note] InnoDB: Completed initialization of buffer pool Jul 26 08:58:36 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 8:58:36 0 [Note] InnoDB: File system buffers for log disabled (block size=4096 bytes) Jul 26 08:58:38 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 8:58:38 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=68564202975468 Jul 26 08:58:51 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 8:58:51 0 [Note] InnoDB: Read redo log up to LSN=68564538440859 Jul 26 08:59:06 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 8:59:06 0 [Note] InnoDB: Read redo log up to LSN=68564840359258 Jul 26 08:59:21 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 8:59:21 0 [Note] InnoDB: Read redo log up to LSN=68565377078377 Jul 26 08:59:36 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 8:59:36 0 [Note] InnoDB: Read redo log up to LSN=68566131845486 Jul 26 08:59:51 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 8:59:51 0 [Note] InnoDB: Read redo log up to LSN=68566886632444 Jul 26 09:00:06 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:00:06 0 [Note] InnoDB: Read redo log up to LSN=68567691730062 Jul 26 09:00:21 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:00:21 0 [Note] InnoDB: Read redo log up to LSN=68568463293592 Jul 26 09:00:36 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:00:36 0 [Note] InnoDB: Read redo log up to LSN=68569216404635 Jul 26 09:00:51 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:00:51 0 [Note] InnoDB: Read redo log up to LSN=68569719588601 Jul 26 09:01:02 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:02 0 [Note] InnoDB: 32 transaction(s) which must be rolled back or cleaned up in total 76106 row operations to undo Jul 26 09:01:02 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:02 0 [Note] InnoDB: Trx id counter is 77284559 Jul 26 09:01:02 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:02 0 [Note] InnoDB: Starting final batch to recover 468196 pages from redo log. Jul 26 09:01:06 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:06 0 [Note] InnoDB: To recover: 429308 pages from log Jul 26 09:01:21 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:21 0 [Note] InnoDB: To recover: 247845 pages from log Jul 26 09:01:36 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:36 0 [Note] InnoDB: To recover: 101066 pages from log Jul 26 09:01:45 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:45 0 [Note] InnoDB: Last binlog file '/data/mysql_binlog/extraserver-leader-1.000396', position 674898598 Jul 26 09:01:45 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:45 0 [Note] InnoDB: 128 rollback segments are active. Jul 26 09:01:45 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:45 0 [Note] InnoDB: Starting in background the rollback of recovered transactions Jul 26 09:01:45 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:45 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1" Jul 26 09:01:45 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:45 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... Jul 26 09:01:45 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:45 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. Jul 26 09:01:45 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:45 0 [Note] InnoDB: log sequence number 68570189791945; transaction id 77284560 Jul 26 09:01:45 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:45 0 [Note] InnoDB: Loading buffer pool(s) from /data/mysql/ib_buffer_pool Jul 26 09:01:45 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:45 0 [Note] Plugin 'FEEDBACK' is disabled. Jul 26 09:01:45 fra1pro-be-xtradb-3 mariadbd[595660]: 230726 9:01:45 server_audit: server_audit_excl_users set to 'lb,monitor,monitoring,backup,replication,replication_user,extraserver2-importer'. Jul 26 09:01:45 fra1pro-be-xtradb-3 mariadbd[595660]: 230726 9:01:45 server_audit: MariaDB Audit Plugin version 1.4.14 STARTED. Jul 26 09:01:45 fra1pro-be-xtradb-3 mariadbd[595660]: 230726 9:01:45 server_audit: logging started to the file server_audit.log. Jul 26 09:01:45 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:45 0 [Note] Server socket created on IP: '0.0.0.0'. Jul 26 09:01:46 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:46 0 [Note] InnoDB: Rolled back recovered transaction 77284487 Jul 26 09:01:46 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:46 0 [Note] InnoDB: Rolled back recovered transaction 77284503 Jul 26 09:01:46 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:46 0 [Note] InnoDB: Rolled back recovered transaction 77284471 Jul 26 09:01:47 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:47 0 [Note] InnoDB: Rolled back recovered transaction 77284451 Jul 26 09:01:47 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:47 0 [Note] InnoDB: Rolled back recovered transaction 77284507 Jul 26 09:01:48 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:48 0 [Note] InnoDB: Rolled back recovered transaction 77284447 Jul 26 09:01:48 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:48 0 [Note] InnoDB: Rolled back recovered transaction 77284539 Jul 26 09:01:48 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:48 0 [Note] InnoDB: Rolled back recovered transaction 77284511 Jul 26 09:01:48 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:48 0 [Note] InnoDB: Rolled back recovered transaction 77284555 Jul 26 09:01:48 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:48 0 [Note] InnoDB: Rolled back recovered transaction 77284525 Jul 26 09:01:48 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:48 0 [Note] InnoDB: Rolled back recovered transaction 77284557 Jul 26 09:01:49 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:49 0 [Note] InnoDB: Rolled back recovered transaction 77284437 Jul 26 09:01:49 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:49 0 [Note] InnoDB: Rolled back recovered transaction 77284501 Jul 26 09:01:49 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:49 0 [Note] InnoDB: Rolled back recovered transaction 77284536 Jul 26 09:01:49 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:49 0 [Note] InnoDB: Rolled back recovered transaction 77284520 Jul 26 09:01:50 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:50 0 [Note] InnoDB: Rolled back recovered transaction 77284456 Jul 26 09:01:50 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:50 0 [Note] InnoDB: Rolled back recovered transaction 77284484 Jul 26 09:01:50 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:50 0 [Note] InnoDB: Rolled back recovered transaction 77284548 Jul 26 09:01:50 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:50 0 [Note] InnoDB: Rolled back recovered transaction 77284516 Jul 26 09:01:51 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:51 0 [Note] InnoDB: To roll back: 13 transactions, 32806 rows Jul 26 09:01:51 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:51 0 [Note] InnoDB: Rolled back recovered transaction 77284468 Jul 26 09:01:51 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:51 0 [Note] InnoDB: Rolled back recovered transaction 77284466 Jul 26 09:01:51 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:51 0 [Note] InnoDB: Rolled back recovered transaction 77284546 Jul 26 09:01:51 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:51 0 [Note] InnoDB: Rolled back recovered transaction 77284530 Jul 26 09:01:52 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:52 0 [Note] InnoDB: Rolled back recovered transaction 77284434 Jul 26 09:01:52 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:52 0 [Note] InnoDB: Rolled back recovered transaction 77284474 Jul 26 09:01:52 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:52 4 [Note] Slave I/O thread: Start asynchronous replication to master 'replication@fra1pro-be-xtradb-1.db.fra1pro.financial.com:3306' in log 'extraserver-leader-1.026214' at position 770447601 Jul 26 09:01:52 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:52 4 [Note] Slave I/O thread: connected to master 'replication@fra1pro-be-xtradb-1.db.fra1pro.financial.com:3306',replication starts at GTID position '1-805435376-23139020' Jul 26 09:01:52 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:52 5 [Note] Slave SQL thread initialized, starting replication in log 'extraserver-leader-1.026214' at position 770447601, relay log '/data/mysql_relaylog/mariadb-relay-bin.000001' position: 4; GTID position '1-805435376-23139020' Jul 26 09:01:52 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:52 0 [Note] /usr/sbin/mariadbd: ready for connections. Jul 26 09:01:52 fra1pro-be-xtradb-3 mariadbd[595660]: Version: '10.11.4-MariaDB-log' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server Jul 26 09:01:52 fra1pro-be-xtradb-3 systemd[1]: Started MariaDB 10.11.4 database server. Jul 26 09:01:52 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:52 41 [Note] Detected table cache mutex contention at instance 1: 30% waits. Additional table cache instance activated. Number of instances after activation: 2. Jul 26 09:01:53 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:53 0 [Note] InnoDB: Buffer pool(s) load completed at 230726 9:01:53 Jul 26 09:01:54 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:54 0 [Note] InnoDB: Rolled back recovered transaction 77284442 Jul 26 09:01:54 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:54 0 [Note] InnoDB: Rolled back recovered transaction 77284522 Jul 26 09:01:55 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:55 0 [Note] InnoDB: Rolled back recovered transaction 77284490 Jul 26 09:01:55 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:55 0 [Note] InnoDB: Rolled back recovered transaction 77284458 Jul 26 09:01:55 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:55 0 [Note] InnoDB: Rolled back recovered transaction 77284494 Jul 26 09:01:55 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:55 0 [Note] InnoDB: Rolled back recovered transaction 77284478 Jul 26 09:01:55 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:55 0 [Note] InnoDB: Rolled back recovered transaction 77284542 Jul 26 09:01:55 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:55 0 [Note] InnoDB: Rollback of non-prepared transactions completed Jul 26 09:01:56 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:01:56 461 [Warning] Aborted connection 461 to db: 'unconnected' user: 'monitor' host: 'fra1pro-infra-2.adm.financial.com' (Got an error reading communication packets) Jul 26 09:03:31 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:03:31 0 [Warning] InnoDB: Total InnoDB FTS size 8180975 for the table `data_2`.`tmp_x_rics` exceeds the innodb_ft_cache_size 8000000 Jul 26 09:03:55 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:03:55 0 [Warning] InnoDB: Total InnoDB FTS size 8218471 for the table `data_2`.`tmp_x_rics` exceeds the innodb_ft_cache_size 8000000 Jul 26 09:03:59 fra1pro-be-xtradb-3 mariadbd[595660]: 2023-07-26 9:03:59 0 [Warning] InnoDB: Total InnoDB FTS size 10218953 for the table `data_2`.`tmp_x_rics` exceeds the innodb_ft_cache_size 8000000