-- Logs begin at Sat 2023-05-27 14:05:07 CEST, end at Thu 2023-07-27 13:29:32 CEST. -- Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: 230726 8:58:40 [ERROR] mysqld got signal 11 ; Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: This could be because you hit a bug. It is also possible that this binary Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: or one of the libraries it was linked against is corrupt, improperly built, Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: or misconfigured. This error can also be caused by malfunctioning hardware. Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: To report this bug, see https://mariadb.com/kb/en/reporting-bugs Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: We will try our best to scrape up some info that will hopefully help Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: diagnose the problem, but since we have already crashed, Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: something is definitely wrong and this may fail. Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: Server version: 10.11.2-MariaDB-log source revision: cafba8761af55ae16cc69c9b53a341340a845b36 Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: key_buffer_size=4194304 Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: read_buffer_size=2097152 Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: max_used_connections=272 Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: max_threads=1002 Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: thread_count=306 Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: It is possible that mysqld could use up to Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 2595687 K bytes of memory Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: Hope that's ok; if not, decrease some variables in the equation. Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: Thread pointer: 0x7ee628000c58 Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: Attempting backtrace. You can use the following information to find out Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: where mysqld died. If you see no messages after this, something went Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: terribly wrong... Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: stack_bottom = 0x7ee85c775bd8 thread_stack 0x80000 Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: Can't start addr2line Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(my_print_stacktrace+0x2e)[0x565256133d0e] Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(handle_fatal_signal+0x485)[0x565255c341c5] Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: /lib64/libpthread.so.0(+0x12cf0)[0x7f0d61b3ccf0] Jul 26 08:58:40 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(_ZN13st_join_table21choose_best_splittingEdy+0x5a3)[0x565255bb2443] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(_Z16best_access_pathP4JOINP13st_join_tableyPK8POSITIONjbdPS3_S6_+0x159)[0x565255a420b9] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(_Z11choose_planP4JOINy+0xa79)[0x565255a4aff9] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(_ZN4JOIN14optimize_innerEv+0x37fd)[0x565255a6f3ad] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(_ZN4JOIN8optimizeEv+0xa0)[0x565255a6f990] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(_Z12mysql_selectP3THDP10TABLE_LISTR4ListI4ItemEPS4_jP8st_orderS9_S7_S9_yP13select_resultP18st_select_lex_unitP13st_select_lex+0xce)[0x565255a6fa7e] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(_Z13handle_selectP3THDP3LEXP13select_resulty+0x14b)[0x565255a7025b] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(+0x7e9035)[0x5652559fa035] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(_Z21mysql_execute_commandP3THDb+0x1261)[0x565255a02474] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(_Z11mysql_parseP3THDPcjP12Parser_state+0x25c)[0x5652559f52d7] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(_Z16dispatch_command19enum_server_commandP3THDPcjb+0xf94)[0x5652559feeea] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(_Z10do_commandP3THDb+0x12f)[0x565255a00661] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(_Z24do_handle_one_connectionP7CONNECTb+0x3f7)[0x565255b11dc7] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(handle_one_connection+0x5d)[0x565255b1210d] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /usr/sbin/mariadbd(+0xc28a7d)[0x565255e39a7d] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /lib64/libpthread.so.0(+0x81ca)[0x7f0d61b321ca] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: /lib64/libc.so.6(clone+0x43)[0x7f0d60e83e73] Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Trying to get some variables. Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Some pointers may be invalid and cause the dump to abort. Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Query (0x7ee628011920): SET STATEMENT max_statement_time=10 FOR SELECT STRAIGHT_JOIN `x_lgdf_fundcountry_0`.`LIPPERID`,`x_lgdf_fundcountry_0`.`ISIN`,`x_lgdf_fundcountry_0`.`LIPPERID`,`x_lgdf_fund_1`.`LIPPERID`,`x_lgdf_fund_1`.`ISIN`,`x_lgdf_fund_1`.`FUND_MANAGEMENT_COMPANY`,`x_lgdf_fund_1`.`LIPPERID`,`x_lgdf_fundstatistics_norm_2`.`PCTYTD`,`x_lgdf_fundstatistics_norm_2`.`CURRENCYCODE`,`x_lgdf_fundstatistics_norm_2`.`PCT5Y`,`x_instruments_3`.`_PRIMARY_RIC`,`x_instruments_3`.`_ID`,`x_instruments_3`.`_ID` FROM `data_view`.`x_lgdf_fundcountry` `x_lgdf_fundcountry_0` INNER JOIN (SELECT `x_lgdf_fund_1`.* FROM `data_view`.`x_lgdf_fund` AS `x_lgdf_fund_1` INNER JOIN (SELECT `x_lgdf_fund_1`.`LIPPERID` FROM `data_view`.`x_lgdf_fund` AS `x_lgdf_fund_1` GROUP BY `x_lgdf_fund_1`.`LIPPERID`) AS x_lgdf_fund_group ON ((`x_lgdf_fund_1`.`LIPPERID` = `x_lgdf_fund_group`.`LIPPERID`) AND (`x_lgdf_fund_1`.`LIPPERID` = (SELECT `x_lgdf_fund_limit`.`LIPPERID` FROM `data_view`.`x_lgdf_fund` AS `x_lgdf_fund_limit` WHERE (`x_lgdf_fund_group`.`LIPPERID` = `x_lgdf_fund_limit`.`LIPPERID`) LIMIT 1)))) AS `x_lgdf_fund_1` ON (`x_lgdf_fundcountry_0`.`LIPPERID` = `x_lgdf_fund_1`.`LIPPERID`) INNER JOIN `data_view`.`x_lgdf_fundstatistics_norm` `x_lgdf_fundstatistics_norm_2` ON ((`x_lgdf_fundcountry_0`.`LIPPERID` = `x_lgdf_fundstatistics_norm_2`.`LIPPERID`) AND (`x_lgdf_fundstatistics_norm_2`.`CURRENCYCODE` IN ('EUR','USD','GBP','JPY') )) LEFT OUTER JOIN `data_view`.`x_instruments` `x_instruments_3` ON ((`x_lgdf_fundcountry_0`.`LIPPERID` = `x_instruments_3`.`_LIPPER_ID`) AND (`x_instruments_3`.`_ID` = (SELECT `x_instruments_3_limit`.`_ID` FROM `data_view`.`x_instruments` AS x_instruments_3_limit WHERE (`x_lgdf_fundcountry_0`.`LIPPERID` = `x_instruments_3_limit`.`_LIPPER_ID`) LIMIT 1))) WHERE ((`x_lgdf_fundcountry_0`.`LIPPERID` IN (65078589,60054162,65103773,68132795,68398385,68147684,65097414,68581860,65082844,68046089,65055233,68015095,60034190,68432593,60001423,60091987,68012648,68239952,68305035,60056154,65009617,60058624,65082845,60056157,65080141,68115356,60038473,65111142,60033585,68321207,60077414,60034242,68048300,68398385,68547894,68583141,68585562) ) AND (`x_lgdf_fundcountry_0`.`COUNTRY_CD` IN ('LU','DE','IE','JE','FR') )) LIMIT 0, 100000 Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Connection ID (thread ID): 716267 Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Status: KILL_TIMEOUT Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: information that should help you find out what is causing the crash. Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Writing a core file... Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Working directory at /data/mysql Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Resource Limits: Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Limit Soft Limit Hard Limit Units Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max cpu time unlimited unlimited seconds Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max file size unlimited unlimited bytes Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max data size unlimited unlimited bytes Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max stack size 8388608 unlimited bytes Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max core file size 0 unlimited bytes Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max resident set unlimited unlimited bytes Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max processes 1028104 1028104 processes Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max open files 500000 500000 files Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max locked memory 65536 65536 bytes Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max address space unlimited unlimited bytes Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max file locks unlimited unlimited locks Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max pending signals 1028104 1028104 signals Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max msgqueue size 819200 819200 bytes Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max nice priority 0 0 Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max realtime priority 0 0 Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Max realtime timeout unlimited unlimited us Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Core pattern: |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h %e Jul 26 08:58:41 fra1pro-be-xtradb-4 mariadbd[693673]: Kernel version: Linux version 4.18.0-448.el8.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-18) (GCC)) #1 SMP Wed Jan 18 15:02:46 UTC 2023 Jul 26 08:58:54 fra1pro-be-xtradb-4 systemd[1]: mariadb.service: Main process exited, code=dumped, status=11/SEGV Jul 26 08:58:54 fra1pro-be-xtradb-4 systemd[1]: mariadb.service: Failed with result 'core-dump'. Jul 26 08:58:59 fra1pro-be-xtradb-4 systemd[1]: mariadb.service: Service RestartSec=5s expired, scheduling restart. Jul 26 08:58:59 fra1pro-be-xtradb-4 systemd[1]: mariadb.service: Scheduled restart job, restart counter is at 5. Jul 26 08:58:59 fra1pro-be-xtradb-4 systemd[1]: Stopped MariaDB 10.11.2 database server. Jul 26 08:58:59 fra1pro-be-xtradb-4 systemd[1]: Starting MariaDB 10.11.2 database server... Jul 26 08:59:00 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 8:59:00 0 [Note] Starting MariaDB 10.11.2-MariaDB-log source revision cafba8761af55ae16cc69c9b53a341340a845b36 as process 2508634 Jul 26 08:59:00 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 8:59:00 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 Jul 26 08:59:00 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 8:59:00 0 [Note] InnoDB: Number of transaction pools: 1 Jul 26 08:59:00 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 8:59:00 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions Jul 26 08:59:00 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 8:59:00 0 [Note] InnoDB: Using Linux native AIO Jul 26 08:59:00 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 8:59:00 0 [Note] InnoDB: Initializing buffer pool, total size = 144.000GiB, chunk size = 2.250GiB Jul 26 08:59:00 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 8:59:00 0 [Note] InnoDB: Completed initialization of buffer pool Jul 26 08:59:00 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 8:59:00 0 [Note] InnoDB: File system buffers for log disabled (block size=4096 bytes) Jul 26 08:59:01 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 8:59:01 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=68440813736215 Jul 26 08:59:15 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 8:59:15 0 [Note] InnoDB: Read redo log up to LSN=68441233061236 Jul 26 08:59:31 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 8:59:31 0 [Note] InnoDB: Read redo log up to LSN=68441585296752 Jul 26 08:59:46 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 8:59:46 0 [Note] InnoDB: Read redo log up to LSN=68442239444286 Jul 26 09:00:01 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:00:01 0 [Note] InnoDB: Read redo log up to LSN=68442910348120 Jul 26 09:00:16 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:00:16 0 [Note] InnoDB: Read redo log up to LSN=68443514180980 Jul 26 09:00:31 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:00:31 0 [Note] InnoDB: Read redo log up to LSN=68444201873671 Jul 26 09:00:46 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:00:46 0 [Note] InnoDB: Read redo log up to LSN=68444990182768 Jul 26 09:01:01 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:01 0 [Note] InnoDB: Read redo log up to LSN=68445790512500 Jul 26 09:01:16 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:16 0 [Note] InnoDB: To recover: 461864 pages from log Jul 26 09:01:16 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:16 0 [Note] InnoDB: 33 transaction(s) which must be rolled back or cleaned up in total 88852 row operations to undo Jul 26 09:01:16 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:16 0 [Note] InnoDB: Trx id counter is 79529830 Jul 26 09:01:16 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:16 0 [Note] InnoDB: Starting final batch to recover 461740 pages from redo log. Jul 26 09:01:31 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:31 0 [Note] InnoDB: To recover: 276771 pages from log Jul 26 09:01:46 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:46 0 [Note] InnoDB: To recover: 127113 pages from log Jul 26 09:01:56 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:56 0 [Note] InnoDB: Last binlog file '/data/mysql_binlog/extraserver-leader-1.000002', position 23495820 Jul 26 09:01:56 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:56 0 [Note] InnoDB: 128 rollback segments are active. Jul 26 09:01:56 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:56 0 [Note] InnoDB: Starting in background the rollback of recovered transactions Jul 26 09:01:56 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:56 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1" Jul 26 09:01:56 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:56 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... Jul 26 09:01:56 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:56 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. Jul 26 09:01:56 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:56 0 [Note] InnoDB: log sequence number 68446858648763; transaction id 79529831 Jul 26 09:01:56 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:56 0 [Note] InnoDB: Loading buffer pool(s) from /data/mysql/ib_buffer_pool Jul 26 09:01:56 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:56 0 [Note] Plugin 'FEEDBACK' is disabled. Jul 26 09:01:56 fra1pro-be-xtradb-4 mariadbd[2508634]: 230726 9:01:56 server_audit: server_audit_excl_users set to 'lb,monitor,monitoring,backup,replication,replication_user,extraserver2-importer'. Jul 26 09:01:56 fra1pro-be-xtradb-4 mariadbd[2508634]: 230726 9:01:56 server_audit: MariaDB Audit Plugin version 1.4.14 STARTED. Jul 26 09:01:56 fra1pro-be-xtradb-4 mariadbd[2508634]: 230726 9:01:56 server_audit: logging started to the file server_audit.log. Jul 26 09:01:56 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:56 0 [Note] Server socket created on IP: '0.0.0.0'. Jul 26 09:01:58 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:58 0 [Note] InnoDB: Rolled back recovered transaction 79529707 Jul 26 09:01:58 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:58 0 [Note] InnoDB: Rolled back recovered transaction 79529699 Jul 26 09:01:58 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:58 0 [Note] InnoDB: Rolled back recovered transaction 79529719 Jul 26 09:01:59 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:59 0 [Note] InnoDB: Rolled back recovered transaction 79529727 Jul 26 09:01:59 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:01:59 0 [Note] InnoDB: Rolled back recovered transaction 79529686 Jul 26 09:02:00 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:00 0 [Note] InnoDB: Rolled back recovered transaction 79529730 Jul 26 09:02:00 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:00 0 [Note] InnoDB: Rolled back recovered transaction 79529689 Jul 26 09:02:00 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:00 0 [Note] InnoDB: Rolled back recovered transaction 79529716 Jul 26 09:02:01 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:01 0 [Note] InnoDB: Rolled back recovered transaction 79529782 Jul 26 09:02:01 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:01 0 [Note] InnoDB: To roll back: 24 transactions, 54086 rows Jul 26 09:02:01 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:01 0 [Note] InnoDB: Rolled back recovered transaction 79529762 Jul 26 09:02:01 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:01 0 [Note] InnoDB: Rolled back recovered transaction 79529775 Jul 26 09:02:01 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:01 0 [Note] InnoDB: Rolled back recovered transaction 79529802 Jul 26 09:02:01 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:01 0 [Note] InnoDB: Rolled back recovered transaction 79529815 Jul 26 09:02:01 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:01 4 [Note] Slave I/O thread: Start asynchronous replication to master 'replication@fra1pro-be-xtradb-1.db.fra1pro.financial.com:3306' in log 'extraserver-leader-1.026214' at position 543384254 Jul 26 09:02:01 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:01 4 [Note] Slave I/O thread: connected to master 'replication@fra1pro-be-xtradb-1.db.fra1pro.financial.com:3306',replication starts at GTID position '1-805435376-23138961' Jul 26 09:02:01 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:01 5 [Note] Slave SQL thread initialized, starting replication in log 'extraserver-leader-1.026214' at position 543384254, relay log '/data/mysql_relaylog/mariadb-relay-bin.000001' position: 4; GTID position '1-805435376-23138961' Jul 26 09:02:01 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:01 0 [Note] /usr/sbin/mariadbd: ready for connections. Jul 26 09:02:01 fra1pro-be-xtradb-4 mariadbd[2508634]: Version: '10.11.2-MariaDB-log' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server Jul 26 09:02:01 fra1pro-be-xtradb-4 systemd[1]: Started MariaDB 10.11.2 database server. Jul 26 09:02:03 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:03 0 [Note] InnoDB: Buffer pool(s) load completed at 230726 9:02:03 Jul 26 09:02:07 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:07 0 [Note] InnoDB: Rolled back recovered transaction 79529676 Jul 26 09:02:07 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:07 0 [Note] InnoDB: Rolled back recovered transaction 79529827 Jul 26 09:02:08 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:08 0 [Note] InnoDB: Rolled back recovered transaction 79529739 Jul 26 09:02:08 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:08 0 [Note] InnoDB: Rolled back recovered transaction 79529747 Jul 26 09:02:08 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:08 0 [Note] InnoDB: Rolled back recovered transaction 79529822 Jul 26 09:02:09 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:09 0 [Note] InnoDB: Rolled back recovered transaction 79529759 Jul 26 09:02:09 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:09 0 [Note] InnoDB: Rolled back recovered transaction 79529799 Jul 26 09:02:09 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:09 0 [Note] InnoDB: Rolled back recovered transaction 79529749 Jul 26 09:02:10 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:10 0 [Note] InnoDB: Rolled back recovered transaction 79529680 Jul 26 09:02:10 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:10 0 [Note] InnoDB: Rolled back recovered transaction 79529772 Jul 26 09:02:10 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:10 0 [Note] InnoDB: Rolled back recovered transaction 79529696 Jul 26 09:02:10 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:10 0 [Note] InnoDB: Rolled back recovered transaction 79529812 Jul 26 09:02:11 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:11 0 [Note] InnoDB: Rolled back recovered transaction 79529789 Jul 26 09:02:11 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:11 0 [Note] InnoDB: Rolled back recovered transaction 79529709 Jul 26 09:02:11 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:11 0 [Note] InnoDB: Rolled back recovered transaction 79529792 Jul 26 09:02:11 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:11 0 [Note] InnoDB: Rolled back recovered transaction 79529809 Jul 26 09:02:12 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:12 0 [Note] InnoDB: Rolled back recovered transaction 79529752 Jul 26 09:02:12 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:12 0 [Note] InnoDB: Rolled back recovered transaction 79529737 Jul 26 09:02:12 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:12 0 [Note] InnoDB: Rolled back recovered transaction 79529769 Jul 26 09:02:12 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:12 0 [Note] InnoDB: Rolled back recovered transaction 79529825 Jul 26 09:02:12 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:02:12 0 [Note] InnoDB: Rollback of non-prepared transactions completed Jul 26 09:05:51 fra1pro-be-xtradb-4 mariadbd[2508634]: 2023-07-26 9:05:51 586 [Warning] Aborted connection 586 to db: 'unconnected' user: 'monitor' host: 'fra1pro-infra-1.adm.financial.com' (Got an error reading communication packets) Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: 230726 9:06:38 [ERROR] mysqld got signal 11 ; Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: This could be because you hit a bug. It is also possible that this binary Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: or one of the libraries it was linked against is corrupt, improperly built, Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: or misconfigured. This error can also be caused by malfunctioning hardware. Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: To report this bug, see https://mariadb.com/kb/en/reporting-bugs Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: We will try our best to scrape up some info that will hopefully help Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: diagnose the problem, but since we have already crashed, Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: something is definitely wrong and this may fail. Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: Server version: 10.11.2-MariaDB-log source revision: cafba8761af55ae16cc69c9b53a341340a845b36 Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: key_buffer_size=4194304 Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: read_buffer_size=2097152 Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: max_used_connections=229 Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: max_threads=1002 Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: thread_count=263 Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: It is possible that mysqld could use up to Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 2595687 K bytes of memory Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: Hope that's ok; if not, decrease some variables in the equation. Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: Thread pointer: 0x7f83a4000c58 Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: Attempting backtrace. You can use the following information to find out Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: where mysqld died. If you see no messages after this, something went Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: terribly wrong... Jul 26 09:06:38 fra1pro-be-xtradb-4 mariadbd[2508634]: stack_bottom = 0x7f88d03e7bd8 thread_stack 0x80000 Jul 26 09:06:39 fra1pro-be-xtradb-4 mariadbd[2508634]: /usr/sbin/mariadbd(my_print_stacktrace+0x2e)[0x558b22ba8d0e] Jul 26 09:06:40 fra1pro-be-xtradb-4 mariadbd[2508634]: /usr/sbin/mariadbd(handle_fatal_signal+0x485)[0x558b226a91c5] Jul 26 09:06:41 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(__restore_rt)[0x7fae8ad3bcf0] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(st_join_table::choose_best_splitting(double, unsigned long long))[0x558b22627443] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(best_access_path(JOIN*, st_join_table*, unsigned long long, POSITION const*, unsigned int, bool, double, POSITION*, POSITION*))[0x558b224b70b9] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(choose_plan(JOIN*, unsigned long long))[0x558b224bfff9] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(JOIN::optimize_inner())[0x558b224e43ad] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(JOIN::optimize())[0x558b224e4990] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(mysql_select(THD*, TABLE_LIST*, List&, Item*, unsigned int, st_order*, st_order*, Item*, st_order*, unsigned long long, select_result*, st_select_lex_unit*, st_select_lex*))[0x558b224e4a7e] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(handle_select(THD*, LEX*, select_result*, unsigned long long))[0x558b224e525b] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(LEX::mark_first_table_as_inserting())[0x558b2246f035] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(mysql_execute_command(THD*, bool))[0x558b22477474] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(mysql_parse(THD*, char*, unsigned int, Parser_state*))[0x558b2246a2d7] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(dispatch_command(enum_server_command, THD*, char*, unsigned int, bool))[0x558b22473eea] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(do_command(THD*, bool))[0x558b22475661] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(do_handle_one_connection(CONNECT*, bool))[0x558b22586dc7] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(handle_one_connection)[0x558b2258710d] Jul 26 09:06:42 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(MyCTX_nopad::finish(unsigned char*, unsigned int*))[0x558b228aea7d] Jul 26 09:06:43 fra1pro-be-xtradb-4 mariadbd[2508634]: ??:0(start_thread)[0x7fae8ad311ca] Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: :0(__GI___clone)[0x7fae8a082e73] Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Trying to get some variables. Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Some pointers may be invalid and cause the dump to abort. Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Query (0x7f83a40113f0): SET STATEMENT max_statement_time=10 FOR SELECT STRAIGHT_JOIN `x_lgdf_fundcountry_0`.`LIPPERID`,`x_lgdf_fundcountry_0`.`ISIN`,`x_lgdf_fundcountry_0`.`LIPPERID`,`x_lgdf_fund_1`.`LIPPERID`,`x_lgdf_fund_1`.`ISIN`,`x_lgdf_fund_1`.`FUND_MANAGEMENT_COMPANY`,`x_lgdf_fund_1`.`LIPPERID`,`x_lgdf_fundstatistics_norm_2`.`PCTYTD`,`x_lgdf_fundstatistics_norm_2`.`CURRENCYCODE`,`x_lgdf_fundstatistics_norm_2`.`PCT5Y`,`x_instruments_3`.`_PRIMARY_RIC`,`x_instruments_3`.`_ID`,`x_instruments_3`.`_ID` FROM `data_view`.`x_lgdf_fundcountry` `x_lgdf_fundcountry_0` INNER JOIN (SELECT `x_lgdf_fund_1`.* FROM `data_view`.`x_lgdf_fund` AS `x_lgdf_fund_1` INNER JOIN (SELECT `x_lgdf_fund_1`.`LIPPERID` FROM `data_view`.`x_lgdf_fund` AS `x_lgdf_fund_1` GROUP BY `x_lgdf_fund_1`.`LIPPERID`) AS x_lgdf_fund_group ON ((`x_lgdf_fund_1`.`LIPPERID` = `x_lgdf_fund_group`.`LIPPERID`) AND (`x_lgdf_fund_1`.`LIPPERID` = (SELECT `x_lgdf_fund_limit`.`LIPPERID` FROM `data_view`.`x_lgdf_fund` AS `x_lgdf_fund_limit` WHERE (`x_lgdf_fund_group`.`LIPPERID` = `x_lgdf_fund_limit`.`LIPPERID`) LIMIT 1)))) AS `x_lgdf_fund_1` ON (`x_lgdf_fundcountry_0`.`LIPPERID` = `x_lgdf_fund_1`.`LIPPERID`) INNER JOIN `data_view`.`x_lgdf_fundstatistics_norm` `x_lgdf_fundstatistics_norm_2` ON ((`x_lgdf_fundcountry_0`.`LIPPERID` = `x_lgdf_fundstatistics_norm_2`.`LIPPERID`) AND (`x_lgdf_fundstatistics_norm_2`.`CURRENCYCODE` IN ('EUR','USD','GBP','JPY') )) LEFT OUTER JOIN `data_view`.`x_instruments` `x_instruments_3` ON ((`x_lgdf_fundcountry_0`.`LIPPERID` = `x_instruments_3`.`_LIPPER_ID`) AND (`x_instruments_3`.`_ID` = (SELECT `x_instruments_3_limit`.`_ID` FROM `data_view`.`x_instruments` AS x_instruments_3_limit WHERE (`x_lgdf_fundcountry_0`.`LIPPERID` = `x_instruments_3_limit`.`_LIPPER_ID`) LIMIT 1))) WHERE ((`x_lgdf_fundcountry_0`.`LIPPERID` IN (65078589,60054162,65103773,68132795,68398385,68147684,65097414,68581860,65082844,68046089,65055233,68015095,60034190,68432593,60001423,60091987,68012648,68239952,68305035,60056154,65009617,60058624,65082845,60056157,65080141,68115356,60038473,65111142,60033585,68321207,60077414,60034242,68048300,68398385,68547894,68583141,68585562) ) AND (`x_lgdf_fundcountry_0`.`COUNTRY_CD` IN ('LU','DE','IE','JE','FR') )) LIMIT 0, 100000 Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Connection ID (thread ID): 185 Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Status: KILL_TIMEOUT Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: information that should help you find out what is causing the crash. Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Writing a core file... Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Working directory at /data/mysql Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Resource Limits: Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Limit Soft Limit Hard Limit Units Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max cpu time unlimited unlimited seconds Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max file size unlimited unlimited bytes Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max data size unlimited unlimited bytes Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max stack size 8388608 unlimited bytes Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max core file size 0 unlimited bytes Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max resident set unlimited unlimited bytes Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max processes 1028104 1028104 processes Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max open files 500000 500000 files Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max locked memory 65536 65536 bytes Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max address space unlimited unlimited bytes Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max file locks unlimited unlimited locks Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max pending signals 1028104 1028104 signals Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max msgqueue size 819200 819200 bytes Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max nice priority 0 0 Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max realtime priority 0 0 Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Max realtime timeout unlimited unlimited us Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Core pattern: |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h %e Jul 26 09:06:44 fra1pro-be-xtradb-4 mariadbd[2508634]: Kernel version: Linux version 4.18.0-448.el8.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-18) (GCC)) #1 SMP Wed Jan 18 15:02:46 UTC 2023 Jul 26 09:06:45 fra1pro-be-xtradb-4 systemd[1]: mariadb.service: Main process exited, code=dumped, status=11/SEGV Jul 26 09:06:45 fra1pro-be-xtradb-4 systemd[1]: mariadb.service: Failed with result 'core-dump'. Jul 26 09:06:51 fra1pro-be-xtradb-4 systemd[1]: mariadb.service: Service RestartSec=5s expired, scheduling restart. Jul 26 09:06:51 fra1pro-be-xtradb-4 systemd[1]: mariadb.service: Scheduled restart job, restart counter is at 6. Jul 26 09:06:51 fra1pro-be-xtradb-4 systemd[1]: Stopped MariaDB 10.11.2 database server. Jul 26 09:06:51 fra1pro-be-xtradb-4 systemd[1]: Starting MariaDB 10.11.2 database server... Jul 26 09:06:51 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:06:51 0 [Note] Starting MariaDB 10.11.2-MariaDB-log source revision cafba8761af55ae16cc69c9b53a341340a845b36 as process 2510595 Jul 26 09:06:51 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:06:51 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 Jul 26 09:06:51 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:06:51 0 [Note] InnoDB: Number of transaction pools: 1 Jul 26 09:06:51 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:06:51 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions Jul 26 09:06:51 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:06:51 0 [Note] InnoDB: Using Linux native AIO Jul 26 09:06:51 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:06:51 0 [Note] InnoDB: Initializing buffer pool, total size = 144.000GiB, chunk size = 2.250GiB Jul 26 09:06:51 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:06:51 0 [Note] InnoDB: Completed initialization of buffer pool Jul 26 09:06:52 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:06:52 0 [Note] InnoDB: File system buffers for log disabled (block size=4096 bytes) Jul 26 09:06:52 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:06:52 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=68450695978188 Jul 26 09:07:06 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:07:06 0 [Note] InnoDB: Read redo log up to LSN=68451249456391 Jul 26 09:07:21 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:07:21 0 [Note] InnoDB: Read redo log up to LSN=68451735852417 Jul 26 09:07:36 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:07:36 0 [Note] InnoDB: Read redo log up to LSN=68452306126190 Jul 26 09:07:51 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:07:51 0 [Note] InnoDB: Read redo log up to LSN=68452775757178 Jul 26 09:08:06 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:08:06 0 [Note] InnoDB: Read redo log up to LSN=68453429904768 Jul 26 09:08:21 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:08:21 0 [Note] InnoDB: Read redo log up to LSN=68454346888557 Jul 26 09:08:36 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:08:36 0 [Note] InnoDB: Read redo log up to LSN=68455302911359 Jul 26 09:08:51 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:08:51 0 [Note] InnoDB: Read redo log up to LSN=68456460207490 Jul 26 09:08:55 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:08:55 0 [Note] InnoDB: 32 transaction(s) which must be rolled back or cleaned up in total 83400 row operations to undo Jul 26 09:08:55 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:08:55 0 [Note] InnoDB: Trx id counter is 79540972 Jul 26 09:08:55 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:08:55 0 [Note] InnoDB: Starting final batch to recover 448643 pages from redo log. Jul 26 09:09:06 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:06 0 [Note] InnoDB: To recover: 299889 pages from log Jul 26 09:09:21 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:21 0 [Note] InnoDB: To recover: 153889 pages from log Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 0 [Note] InnoDB: Last binlog file '/data/mysql_binlog/extraserver-leader-1.000002', position 25989315 Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 0 [Note] InnoDB: 128 rollback segments are active. Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 0 [Note] InnoDB: Starting in background the rollback of recovered transactions Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1" Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ... Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB. Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 0 [Note] InnoDB: log sequence number 68456756701036; transaction id 79540973 Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 0 [Note] InnoDB: Loading buffer pool(s) from /data/mysql/ib_buffer_pool Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 0 [Note] Plugin 'FEEDBACK' is disabled. Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 230726 9:09:34 server_audit: server_audit_excl_users set to 'lb,monitor,monitoring,backup,replication,replication_user,extraserver2-importer'. Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 230726 9:09:34 server_audit: MariaDB Audit Plugin version 1.4.14 STARTED. Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 230726 9:09:34 server_audit: logging started to the file server_audit.log. Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 0 [Note] Server socket created on IP: '0.0.0.0'. Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 4 [Note] Slave I/O thread: Start asynchronous replication to master 'replication@fra1pro-be-xtradb-1.db.fra1pro.financial.com:3306' in log 'extraserver-leader-1.026216' at position 547433769 Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 4 [Note] Slave I/O thread: connected to master 'replication@fra1pro-be-xtradb-1.db.fra1pro.financial.com:3306',replication starts at GTID position '1-805435376-23140647' Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 5 [Note] Slave SQL thread initialized, starting replication in log 'extraserver-leader-1.026216' at position 547433769, relay log '/data/mysql_relaylog/mariadb-relay-bin.000001' position: 4; GTID position '1-805435376-23140647' Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 0 [Note] /usr/sbin/mariadbd: ready for connections. Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: Version: '10.11.2-MariaDB-log' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server Jul 26 09:09:34 fra1pro-be-xtradb-4 systemd[1]: Started MariaDB 10.11.2 database server. Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 0 [Note] InnoDB: Rolled back recovered transaction 79540935 Jul 26 09:09:34 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:34 0 [Note] InnoDB: Rolled back recovered transaction 79540887 Jul 26 09:09:35 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:35 0 [Note] InnoDB: Rolled back recovered transaction 79540903 Jul 26 09:09:35 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:35 0 [Note] InnoDB: Rolled back recovered transaction 79540919 Jul 26 09:09:35 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:35 0 [Note] InnoDB: Rolled back recovered transaction 79540971 Jul 26 09:09:36 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:36 0 [Note] InnoDB: To roll back: 27 transactions, 71442 rows Jul 26 09:09:36 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:36 0 [Note] InnoDB: Rolled back recovered transaction 79540811 Jul 26 09:09:36 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:36 0 [Note] InnoDB: Rolled back recovered transaction 79540835 Jul 26 09:09:36 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:36 0 [Note] InnoDB: Buffer pool(s) load completed at 230726 9:09:36 Jul 26 09:09:36 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:36 0 [Note] InnoDB: Rolled back recovered transaction 79540842 Jul 26 09:09:37 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:37 0 [Note] InnoDB: Rolled back recovered transaction 79540922 Jul 26 09:09:37 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:37 0 [Note] InnoDB: Rolled back recovered transaction 79540894 Jul 26 09:09:37 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:37 0 [Note] InnoDB: Rolled back recovered transaction 79540794 Jul 26 09:09:38 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:38 0 [Note] InnoDB: Rolled back recovered transaction 79540954 Jul 26 09:09:38 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:38 0 [Note] InnoDB: Rolled back recovered transaction 79540866 Jul 26 09:09:38 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:38 0 [Note] InnoDB: Rolled back recovered transaction 79540850 Jul 26 09:09:38 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:38 0 [Note] InnoDB: Rolled back recovered transaction 79540957 Jul 26 09:09:39 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:39 0 [Note] InnoDB: Rolled back recovered transaction 79540900 Jul 26 09:09:39 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:39 0 [Note] InnoDB: Rolled back recovered transaction 79540804 Jul 26 09:09:39 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:39 0 [Note] InnoDB: Rolled back recovered transaction 79540964 Jul 26 09:09:39 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:39 0 [Note] InnoDB: Rolled back recovered transaction 79540932 Jul 26 09:09:40 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:40 0 [Note] InnoDB: Rolled back recovered transaction 79540820 Jul 26 09:09:40 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:40 0 [Note] InnoDB: Rolled back recovered transaction 79540909 Jul 26 09:09:40 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:40 0 [Note] InnoDB: Rolled back recovered transaction 79540860 Jul 26 09:09:40 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:40 0 [Note] InnoDB: Rolled back recovered transaction 79540852 Jul 26 09:09:41 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:41 0 [Note] InnoDB: Rolled back recovered transaction 79540916 Jul 26 09:09:41 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:41 0 [Note] InnoDB: Rolled back recovered transaction 79540828 Jul 26 09:09:41 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:41 0 [Note] InnoDB: Rolled back recovered transaction 79540880 Jul 26 09:09:42 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:42 0 [Note] InnoDB: Rolled back recovered transaction 79540929 Jul 26 09:09:42 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:42 0 [Note] InnoDB: Rolled back recovered transaction 79540944 Jul 26 09:09:42 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:42 0 [Note] InnoDB: Rolled back recovered transaction 79540801 Jul 26 09:09:43 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:43 0 [Note] InnoDB: Rolled back recovered transaction 79540792 Jul 26 09:09:43 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:43 0 [Note] InnoDB: Rolled back recovered transaction 79540872 Jul 26 09:09:43 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:43 0 [Note] InnoDB: Rolled back recovered transaction 79540825 Jul 26 09:09:43 fra1pro-be-xtradb-4 mariadbd[2510595]: 2023-07-26 9:09:43 0 [Note] InnoDB: Rollback of non-prepared transactions completed