-- Logs begin at Sat 2020-11-07 10:35:38 CET, end at Tue 2021-03-23 11:44:41 CET. -- Mar 23 09:02:07 srv2 mysqld[2345]: 2021-03-23 09:02:07 0x7f4fb2bf5700 InnoDB: Assertion failure in file /home/buildbot/buildbot/build/mariadb-10.4.18/storage/innobase/trx/trx0trx.cc line 1373 Mar 23 09:02:07 srv2 mysqld[2345]: InnoDB: Failing assertion: UT_LIST_GET_LEN(lock.trx_locks) == 0 Mar 23 09:02:07 srv2 mysqld[2345]: InnoDB: We intentionally generate a memory trap. Mar 23 09:02:07 srv2 mysqld[2345]: InnoDB: Submit a detailed bug report to https://jira.mariadb.org/ Mar 23 09:02:07 srv2 mysqld[2345]: InnoDB: If you get repeated assertion failures or crashes, even Mar 23 09:02:07 srv2 mysqld[2345]: InnoDB: immediately after the mysqld startup, there may be Mar 23 09:02:07 srv2 mysqld[2345]: InnoDB: corruption in the InnoDB tablespace. Please refer to Mar 23 09:02:07 srv2 mysqld[2345]: InnoDB: https://mariadb.com/kb/en/library/innodb-recovery-modes/ Mar 23 09:02:07 srv2 mysqld[2345]: InnoDB: about forcing recovery. Mar 23 09:02:07 srv2 mysqld[2345]: 210323 9:02:07 [ERROR] mysqld got signal 6 ; Mar 23 09:02:07 srv2 mysqld[2345]: This could be because you hit a bug. It is also possible that this binary Mar 23 09:02:07 srv2 mysqld[2345]: or one of the libraries it was linked against is corrupt, improperly built, Mar 23 09:02:07 srv2 mysqld[2345]: or misconfigured. This error can also be caused by malfunctioning hardware. Mar 23 09:02:07 srv2 mysqld[2345]: To report this bug, see https://mariadb.com/kb/en/reporting-bugs Mar 23 09:02:07 srv2 mysqld[2345]: We will try our best to scrape up some info that will hopefully help Mar 23 09:02:07 srv2 mysqld[2345]: diagnose the problem, but since we have already crashed, Mar 23 09:02:07 srv2 mysqld[2345]: something is definitely wrong and this may fail. Mar 23 09:02:07 srv2 mysqld[2345]: Server version: 10.4.18-MariaDB-1:10.4.18+maria~buster-log Mar 23 09:02:07 srv2 mysqld[2345]: key_buffer_size=134217728 Mar 23 09:02:07 srv2 mysqld[2345]: read_buffer_size=2097152 Mar 23 09:02:07 srv2 mysqld[2345]: max_used_connections=94 Mar 23 09:02:07 srv2 mysqld[2345]: max_threads=302 Mar 23 09:02:07 srv2 mysqld[2345]: thread_count=117 Mar 23 09:02:07 srv2 mysqld[2345]: It is possible that mysqld could use up to Mar 23 09:02:07 srv2 mysqld[2345]: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 1994007 K bytes of memory Mar 23 09:02:07 srv2 mysqld[2345]: Hope that's ok; if not, decrease some variables in the equation. Mar 23 09:02:07 srv2 mysqld[2345]: Thread pointer: 0x7f4d995f3138 Mar 23 09:02:07 srv2 mysqld[2345]: Attempting backtrace. You can use the following information to find out Mar 23 09:02:07 srv2 mysqld[2345]: where mysqld died. If you see no messages after this, something went Mar 23 09:02:07 srv2 mysqld[2345]: terribly wrong... Mar 23 09:02:07 srv2 mysqld[2345]: stack_bottom = 0x7f4fb2bf4dd8 thread_stack 0x100000 Mar 23 09:02:07 srv2 mysqld[2345]: /usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x5591ec8057fe] Mar 23 09:02:07 srv2 mysqld[2345]: /usr/sbin/mysqld(handle_fatal_signal+0x54d)[0x5591ec2f8b0d] Mar 23 09:02:07 srv2 mysqld[2345]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12730)[0x7f5b4a1ab730] Mar 23 09:02:07 srv2 mysqld[2345]: /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x10b)[0x7f5b495f37bb] Mar 23 09:02:07 srv2 mysqld[2345]: /lib/x86_64-linux-gnu/libc.so.6(abort+0x121)[0x7f5b495de535] Mar 23 09:02:07 srv2 mysqld[2345]: /usr/sbin/mysqld(+0x5ad704)[0x5591ebfed704] Mar 23 09:02:07 srv2 mysqld[2345]: /usr/sbin/mysqld(+0xb7714a)[0x5591ec5b714a] Mar 23 09:02:07 srv2 mysqld[2345]: /usr/sbin/mysqld(+0xb75dda)[0x5591ec5b5dda] Mar 23 09:02:07 srv2 mysqld[2345]: /usr/sbin/mysqld(+0xb75f83)[0x5591ec5b5f83] Mar 23 09:02:07 srv2 mysqld[2345]: /usr/sbin/mysqld(+0xa511de)[0x5591ec4911de] Mar 23 09:02:07 srv2 mysqld[2345]: /usr/sbin/mysqld(+0xa514eb)[0x5591ec4914eb] Mar 23 09:02:07 srv2 mysqld[2345]: /usr/sbin/mysqld(+0x8b97ae)[0x5591ec2f97ae] Mar 23 09:02:07 srv2 mysqld[2345]: /usr/sbin/mysqld(_Z15ha_commit_transP3THDb+0x67e)[0x5591ec2fd07e] Mar 23 09:02:07 srv2 mysqld[2345]: /usr/sbin/mysqld(_Z17trans_commit_stmtP3THD+0x3d)[0x5591ec1e786d] Mar 23 09:02:07 srv2 mysqld[2345]: /usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0xcad)[0x5591ec0eabed] Mar 23 09:02:08 srv2 mysqld[2345]: /usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_statebb+0x1c9)[0x5591ec0f25c9] Mar 23 09:02:08 srv2 mysqld[2345]: /usr/sbin/mysqld(+0x6b2e1c)[0x5591ec0f2e1c] Mar 23 09:02:08 srv2 mysqld[2345]: /usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0x218c)[0x5591ec0f565c] Mar 23 09:02:08 srv2 mysqld[2345]: /usr/sbin/mysqld(_Z10do_commandP3THD+0x124)[0x5591ec0f5f54] Mar 23 09:02:08 srv2 mysqld[2345]: /usr/sbin/mysqld(_Z24do_handle_one_connectionP7CONNECT+0x25e)[0x5591ec1d958e] Mar 23 09:02:08 srv2 mysqld[2345]: /usr/sbin/mysqld(handle_one_connection+0x3d)[0x5591ec1d965d] Mar 23 09:02:08 srv2 mysqld[2345]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x7fa3)[0x7f5b4a1a0fa3] Mar 23 09:02:08 srv2 mysqld[2345]: /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7f5b496b54cf] Mar 23 09:02:08 srv2 mysqld[2345]: Trying to get some variables. Mar 23 09:02:08 srv2 mysqld[2345]: Some pointers may be invalid and cause the dump to abort. Mar 23 09:02:08 srv2 mysqld[2345]: Query (0x7f4d98079650): SELECT `fulfillment_box`.`id`, `fulfillment_box`.`order_id`, `fulfillment_box`.`area_id`, `fulfillment_box`.`name`, `fulfillment_box`.`code`, `fulfillment_box`.`size`, `fulfillment_box`.`priority`, `fulfillment_box`.`date_active`, `fulfillment_box`.`date_ready`, `fulfillment_box`.`date_last`, `fulfillment_box`.`date_last_active`, `fulfillment_box`.`active`, `fulfillment_box`.`deferred` FROM `fulfillment_box` LEFT OUTER JOIN `fulfillment_boxcartlocation` ON (`fulfillment_box`.`id` = `fulfillment_boxcartlocation`.`box_id`) INNER JOIN `fulfillment_boxshelf_boxes` ON (`fulfillment_box`.`id` = `fulfillment_boxshelf_boxes`.`box_id`) WHERE (`fulfillment_box`.`active` AND `fulfillment_box`.`area_id` = 1 AND (`fulfillment_box`.`order_id` IS NULL OR `fulfillment_box`.`order_id` = 2934799) AND NOT (`fulfillment_box`.`id` IN (SELECT U0.`from_box_id` FROM `stocks_stockunitmovement` U0 WHERE (U0.`date_done` IS NULL AND U0.`from_box_id` IS NOT NULL))) AND NOT (`fulfillment_box`.`id` IN (SELECT U0.`to_box_id` FROM `stocks_stockunitmovement` U0 WHERE (U0.`date_done` IS NULL AND U0.`to_box_id` IS NOT NULL))) AND NOT (`fulfillment_box`.`code` LIKE 'A%') AND (`fulfillment_box`.`date_last` IS NULL OR `fulfillment_box`.`date_last` < '2021-03-23 06:02:05.803750') AND `fulfillment_boxcartlocation`.`id` IS NULL AND `fulfillment_box`.`size` IN (1, 2, 3, 4) AND `fulfillment_boxshelf_boxes`.`boxshelf_id` IN (26, 29, 32, 35, 36, 41, 46) AND `fulfillment_box`.`priority` > 40104) ORDER BY `fulfillment_box`.`priority` ASC LIMIT 21 Mar 23 09:02:08 srv2 mysqld[2345]: Connection ID (thread ID): 306417 Mar 23 09:02:08 srv2 mysqld[2345]: Status: NOT_KILLED Mar 23 09:02:08 srv2 mysqld[2345]: Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on Mar 23 09:02:08 srv2 mysqld[2345]: The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains Mar 23 09:02:08 srv2 mysqld[2345]: information that should help you find out what is causing the crash. Mar 23 09:02:08 srv2 mysqld[2345]: Writing a core file... Mar 23 09:02:08 srv2 mysqld[2345]: Working directory at /var/lib/mysql Mar 23 09:02:08 srv2 mysqld[2345]: Resource Limits: Mar 23 09:02:08 srv2 mysqld[2345]: Limit Soft Limit Hard Limit Units Mar 23 09:02:08 srv2 mysqld[2345]: Max cpu time unlimited unlimited seconds Mar 23 09:02:08 srv2 mysqld[2345]: Max file size unlimited unlimited bytes Mar 23 09:02:08 srv2 mysqld[2345]: Max data size unlimited unlimited bytes Mar 23 09:02:08 srv2 mysqld[2345]: Max stack size 8388608 unlimited bytes Mar 23 09:02:08 srv2 mysqld[2345]: Max core file size 0 unlimited bytes Mar 23 09:02:08 srv2 mysqld[2345]: Max resident set unlimited unlimited bytes Mar 23 09:02:08 srv2 mysqld[2345]: Max processes 257286 257286 processes Mar 23 09:02:08 srv2 mysqld[2345]: Max open files 16384 16384 files Mar 23 09:02:08 srv2 mysqld[2345]: Max locked memory 65536 65536 bytes Mar 23 09:02:08 srv2 mysqld[2345]: Max address space unlimited unlimited bytes Mar 23 09:02:08 srv2 mysqld[2345]: Max file locks unlimited unlimited locks Mar 23 09:02:08 srv2 mysqld[2345]: Max pending signals 257286 257286 signals Mar 23 09:02:08 srv2 mysqld[2345]: Max msgqueue size 819200 819200 bytes Mar 23 09:02:08 srv2 mysqld[2345]: Max nice priority 0 0 Mar 23 09:02:08 srv2 mysqld[2345]: Max realtime priority 0 0 Mar 23 09:02:08 srv2 mysqld[2345]: Max realtime timeout unlimited unlimited us Mar 23 09:02:08 srv2 mysqld[2345]: Core pattern: core Mar 23 09:02:08 srv2 systemd[1]: mariadb.service: Main process exited, code=killed, status=6/ABRT Mar 23 09:02:08 srv2 systemd[1]: mariadb.service: Failed with result 'signal'. Mar 23 09:02:14 srv2 systemd[1]: mariadb.service: Service RestartSec=5s expired, scheduling restart. Mar 23 09:02:14 srv2 systemd[1]: mariadb.service: Scheduled restart job, restart counter is at 1. Mar 23 09:02:14 srv2 systemd[1]: Stopped MariaDB 10.4.18 database server. Mar 23 09:02:14 srv2 systemd[1]: Starting MariaDB 10.4.18 database server... Mar 23 09:02:32 srv2 mysqld[30858]: WSREP: Recovered position bd401d28-f285-11ea-9c06-4e99d1c864f6:1647665857 Mar 23 09:02:32 srv2 mysqld[31168]: 2021-03-23 9:02:32 0 [Note] /usr/sbin/mysqld (mysqld 10.4.18-MariaDB-1:10.4.18+maria~buster-log) starting as process 31168 ... Mar 23 09:02:32 srv2 mysqld[31168]: 2021-03-23 9:02:32 0 [Note] WSREP: Loading provider /usr/lib/libgalera_smm.so initial position: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647665857 Mar 23 09:02:32 srv2 mysqld[31168]: 2021-03-23 9:02:32 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/libgalera_smm.so' Mar 23 09:02:32 srv2 mysqld[31168]: 2021-03-23 9:02:32 0 [Note] WSREP: wsrep_load(): Galera 4.7(ree4f10fc) by Codership Oy loaded successfully. Mar 23 09:02:32 srv2 mysqld[31168]: 2021-03-23 9:02:32 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration. Mar 23 09:02:32 srv2 mysqld[31168]: 2021-03-23 9:02:32 0 [Note] WSREP: Found saved state: bd401d28-f285-11ea-9c06-4e99d1c864f6:-1, safe_to_bootstrap: 0 Mar 23 09:02:32 srv2 mysqld[31168]: 2021-03-23 9:02:32 0 [Note] WSREP: GCache DEBUG: opened preamble: Mar 23 09:02:32 srv2 mysqld[31168]: Version: 2 Mar 23 09:02:32 srv2 mysqld[31168]: UUID: bd401d28-f285-11ea-9c06-4e99d1c864f6 Mar 23 09:02:32 srv2 mysqld[31168]: Seqno: -1 - -1 Mar 23 09:02:32 srv2 mysqld[31168]: Offset: -1 Mar 23 09:02:32 srv2 mysqld[31168]: Synced: 0 Mar 23 09:02:32 srv2 mysqld[31168]: 2021-03-23 9:02:32 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: bd401d28-f285-11ea-9c06-4e99d1c864f6, offset: -1 Mar 23 09:02:32 srv2 mysqld[31168]: 2021-03-23 9:02:32 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/4294967320 bytes) complete. Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (4294967320/4294967320 bytes) complete. Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 1644973714-1647665857 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: GCache::RingBuffer unused buffers scan... 0.0% ( 0/4294966280 bytes) complete. Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (4294966280/4294966280 bytes) complete. Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): found 0/2692144 locked buffers Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): free space: 1016/4294967296 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.0.1.3; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 4G; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = fa Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: Service thread queue flushed. Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: ####### Assign initial position for certification: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647665857, protocol version: -1 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: Start replication Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: Connecting with bootstrap option: 0 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: Setting GCS initial position to bd401d28-f285-11ea-9c06-4e99d1c864f6:1647665857 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: protonet asio version 0 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: Using CRC-32C for message checksums. Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: backend: asio Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: restore pc from disk successfully Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: GMCast version 0 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: (6552b06c-a6b2, 'ssl://0.0.0.0:4567') listening at ssl://0.0.0.0:4567 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: (6552b06c-a6b2, 'ssl://0.0.0.0:4567') multicast: , ttl: 1 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: EVS version 1 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: gcomm: connecting to group 'DS1', peer '10.0.1.2:,10.0.1.3:,10.0.1.4:' Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: (6552b06c-a6b2, 'ssl://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address ssl://10.0.1.3:4567 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: (6552b06c-a6b2, 'ssl://0.0.0.0:4567') connection established to 7d447799-915b ssl://10.0.1.2:4567 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: (6552b06c-a6b2, 'ssl://0.0.0.0:4567') connection established to fa61149d-9ae2 ssl://10.0.1.4:4567 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: (6552b06c-a6b2, 'ssl://0.0.0.0:4567') turning message relay requesting on, nonlive peers: Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: EVS version upgrade 0 -> 1 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: declaring 7d447799-915b at ssl://10.0.1.2:4567 stable Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: declaring fa61149d-9ae2 at ssl://10.0.1.4:4567 stable Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: PC protocol upgrade 0 -> 1 Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: Node 7d447799-915b state prim Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: view(view_id(PRIM,6552b06c-a6b2,160) memb { Mar 23 09:02:33 srv2 mysqld[31168]: 6552b06c-a6b2,0 Mar 23 09:02:33 srv2 mysqld[31168]: 7d447799-915b,0 Mar 23 09:02:33 srv2 mysqld[31168]: fa61149d-9ae2,0 Mar 23 09:02:33 srv2 mysqld[31168]: } joined { Mar 23 09:02:33 srv2 mysqld[31168]: } left { Mar 23 09:02:33 srv2 mysqld[31168]: } partitioned { Mar 23 09:02:33 srv2 mysqld[31168]: }) Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: save pc into disk Mar 23 09:02:33 srv2 mysqld[31168]: 2021-03-23 9:02:33 0 [Note] WSREP: clear restored view Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: gcomm: connected Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: Opened channel 'DS1' Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 2 [Note] WSREP: Starting rollbacker thread 2 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 20039b70-8bae-11eb-936b-5abdaa1c6f49 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: Starting applier thread 1 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 20039b70-8bae-11eb-936b-5abdaa1c6f49 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: STATE EXCHANGE: got state msg: 20039b70-8bae-11eb-936b-5abdaa1c6f49 from 0 (srv2) Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: STATE EXCHANGE: got state msg: 20039b70-8bae-11eb-936b-5abdaa1c6f49 from 1 (srv1) Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: STATE EXCHANGE: got state msg: 20039b70-8bae-11eb-936b-5abdaa1c6f49 from 2 (srv3) Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: Quorum results: Mar 23 09:02:34 srv2 mysqld[31168]: version = 6, Mar 23 09:02:34 srv2 mysqld[31168]: component = PRIMARY, Mar 23 09:02:34 srv2 mysqld[31168]: conf_id = 4, Mar 23 09:02:34 srv2 mysqld[31168]: members = 2/3 (joined/total), Mar 23 09:02:34 srv2 mysqld[31168]: act_id = 1647668374, Mar 23 09:02:34 srv2 mysqld[31168]: last_appl. = 1647665736, Mar 23 09:02:34 srv2 mysqld[31168]: protocols = 2/10/4 (gcs/repl/appl), Mar 23 09:02:34 srv2 mysqld[31168]: vote policy= 0, Mar 23 09:02:34 srv2 mysqld[31168]: group UUID = bd401d28-f285-11ea-9c06-4e99d1c864f6 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: Flow-control interval: [28, 28] Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 1647668375) Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: ####### processing CC 1647668375, local, ordered Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: Process first view: bd401d28-f285-11ea-9c06-4e99d1c864f6 my uuid: 6552b06c-87fd-11eb-a6b2-670c0c1acbe7 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: Server srv2 connected to cluster at position bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668375 with ID 6552b06c-87fd-11eb-a6b2-670c0c1acbe7 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: Server status change disconnected -> connected Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: ####### My UUID: 6552b06c-87fd-11eb-a6b2-670c0c1acbe7 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: Service thread queue flushed. Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: State transfer required: Mar 23 09:02:34 srv2 mysqld[31168]: Group state: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668375 Mar 23 09:02:34 srv2 mysqld[31168]: Local state: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647665857 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: Server status change connected -> joiner Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: Joiner monitor thread started to monitor Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '10.0.1.3' --datadir '/var/lib/mysql/' --parent '31168' --binlog '/var/log/mysql/mariadb-bin' --binlog-index '/var/log/mysql/mariadb-bin.index' --mysqld-args --wsrep_start_position=bd401d28-f285-11ea-9c06-4e99d1c864f6:1647665857' Mar 23 09:02:34 srv2 mysqld[31168]: WSREP_SST: [INFO] Logging all stderr of SST/Innobackupex to syslog (20210323 09:02:34.398) Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: Prepared SST request: mariabackup|10.0.1.3:4444/xtrabackup_sst//1 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: ####### IST uuid:bd401d28-f285-11ea-9c06-4e99d1c864f6 f: 1647665858, l: 1647668375, STRv: 3 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: IST receiver addr using ssl://10.0.1.3:4568 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: IST receiver using ssl Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: Prepared IST receiver for 1647665858-1647668375, listening at: ssl://10.0.1.3:4568 Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: Member 0.0 (srv2) requested state transfer from '*any*'. Selected 1.0 (srv1)(SYNCED) as donor. Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 1647668380) Mar 23 09:02:34 srv2 mysqld[31168]: 2021-03-23 9:02:34 1 [Note] WSREP: Requesting state transfer: success, donor: 1 Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 0 [Note] WSREP: 1.0 (srv1): State transfer to 0.0 (srv2) complete. Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 3 [Note] WSREP: SST received Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 3 [Note] WSREP: Server status change joiner -> initializing Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 0 [Note] InnoDB: Using Linux native AIO Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 0 [Note] InnoDB: Uses event mutexes Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 0 [Note] InnoDB: Number of pools: 1 Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 0 [Note] InnoDB: Using SSE2 crc32 instructions Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 0 [Note] mysqld: O_TMPFILE is not supported on /tmp (disabling future attempts) Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 0 [Note] InnoDB: Initializing buffer pool, total size = 40G, instances = 40, chunk size = 128M Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 0 [Note] InnoDB: Completed initialization of buffer pool Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 0 [Note] InnoDB: Setting log file ./ib_logfile101 size to 4294967296 bytes Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 0 [Note] InnoDB: Renaming log file ./ib_logfile101 to ./ib_logfile0 Mar 23 09:02:35 srv2 mysqld[31168]: 2021-03-23 9:02:35 0 [Note] InnoDB: New log files created, LSN=19511743041834 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] InnoDB: 128 out of 128 rollback segments are active. Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] InnoDB: Creating shared tablespace for temporary tables Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] InnoDB: Waiting for purge to start Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] InnoDB: 10.4.18 started; log sequence number 19511743042060; transaction id 26895089256 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] Plugin 'FEEDBACK' is disabled. Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [ERROR] mysqld: Plugin 'innodb' already installed Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Warning] Plugin 'FEDERATED' is of maturity level gamma while the server is stable Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] Server socket created on IP: '0.0.0.0'. Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: Server initialized Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: Server status change initializing -> initialized Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 3 [Note] WSREP: Server status change initialized -> joined Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 3 [Note] WSREP: Recovered position from storage: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647665857 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 19 [Note] WSREP: Starting applier thread 19 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 15 [Note] WSREP: Starting applier thread 15 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 17 [Note] WSREP: Starting applier thread 17 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 22 [Note] WSREP: Starting applier thread 22 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 23 [Note] WSREP: Starting applier thread 23 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 20 [Note] WSREP: Starting applier thread 20 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 16 [Note] WSREP: Starting applier thread 16 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 24 [Note] WSREP: Starting applier thread 24 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 18 [Note] WSREP: Starting applier thread 18 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 12 [Note] WSREP: Starting applier thread 12 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 13 [Note] WSREP: Starting applier thread 13 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 11 [Note] WSREP: Starting applier thread 11 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 14 [Note] WSREP: Starting applier thread 14 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 25 [Note] WSREP: Starting applier thread 25 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 21 [Note] WSREP: Starting applier thread 21 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] Reading of all Master_info entries succeeded Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] Added new Master_info '' to hash table Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] /usr/sbin/mysqld: ready for connections. Mar 23 09:02:36 srv2 mysqld[31168]: Version: '10.4.18-MariaDB-1:10.4.18+maria~buster-log' socket: '/var/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 3 [Note] WSREP: Recovered view from SST: Mar 23 09:02:36 srv2 mysqld[31168]: id: bd401d28-f285-11ea-9c06-4e99d1c864f6:1644950309 Mar 23 09:02:36 srv2 mysqld[31168]: status: primary Mar 23 09:02:36 srv2 mysqld[31168]: protocol_version: 4 Mar 23 09:02:36 srv2 mysqld[31168]: capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO Mar 23 09:02:36 srv2 mysqld[31168]: final: no Mar 23 09:02:36 srv2 mysqld[31168]: own_index: -1 Mar 23 09:02:36 srv2 mysqld[31168]: members(3): Mar 23 09:02:36 srv2 mysqld[31168]: 0: 6552b06c-87fd-11eb-a6b1-670c0c1acbe7, srv2 Mar 23 09:02:36 srv2 mysqld[31168]: 1: 7d447799-8b22-11eb-915b-468cb230a09e, srv1 Mar 23 09:02:36 srv2 mysqld[31168]: 2: fa61149d-87ed-11eb-9ae2-be4d05c83bf4, srv3 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 28 [Note] WSREP: Recovered cluster id bd401d28-f285-11ea-9c06-4e99d1c864f6 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 3 [Note] WSREP: SST received: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647665857 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 3 [Note] WSREP: SST succeeded for position bd401d28-f285-11ea-9c06-4e99d1c864f6:1647665857 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: Joiner monitor thread ended with total time 2 sec Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 1 [Note] WSREP: Installed new state from SST: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647665857 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 1 [Note] WSREP: Receiving IST: 2518 writesets, seqnos 1647665858-1647668375 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: ####### IST applying starts with 1647665858 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: ####### IST current seqno initialized to 1647665737 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: Receiving IST... 0.0% ( 0/2639 events) complete. Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: IST preload starting at 1647665737 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: Service thread queue flushed. Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:1647665736, protocol version: 5 Mar 23 09:02:36 srv2 systemd[1]: Started MariaDB 10.4.18 database server. Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: REPL Protocols: 10 (5) Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: ####### Adjusting cert position: 1647665871 -> 1647665872 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: Service thread queue flushed. Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 1647665737 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: Min available from gcache for CC from ist: 1644973750 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 21 [Note] WSREP: ================================================ Mar 23 09:02:36 srv2 mysqld[31168]: View: Mar 23 09:02:36 srv2 mysqld[31168]: id: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647665872 Mar 23 09:02:36 srv2 mysqld[31168]: status: primary Mar 23 09:02:36 srv2 mysqld[31168]: protocol_version: 4 Mar 23 09:02:36 srv2 mysqld[31168]: capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO Mar 23 09:02:36 srv2 mysqld[31168]: final: no Mar 23 09:02:36 srv2 mysqld[31168]: own_index: -1 Mar 23 09:02:36 srv2 mysqld[31168]: members(2): Mar 23 09:02:36 srv2 mysqld[31168]: 0: 7d447799-8b22-11eb-915b-468cb230a09e, srv1 Mar 23 09:02:36 srv2 mysqld[31168]: 1: fa61149d-87ed-11eb-9ae2-be4d05c83bf4, srv3 Mar 23 09:02:36 srv2 mysqld[31168]: ================================================= Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 21 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: (6552b06c-a6b2, 'ssl://0.0.0.0:4567') reconnecting to fa61149d-9ae2 (ssl://10.0.1.4:4567), attempt 0 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: REPL Protocols: 10 (5) Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: ####### Adjusting cert position: 1647668374 -> 1647668375 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: Service thread queue flushed. Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 1647665737 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: Min available from gcache for CC from ist: 1644976252 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 22 [Note] WSREP: ================================================ Mar 23 09:02:36 srv2 mysqld[31168]: View: Mar 23 09:02:36 srv2 mysqld[31168]: id: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668375 Mar 23 09:02:36 srv2 mysqld[31168]: status: primary Mar 23 09:02:36 srv2 mysqld[31168]: protocol_version: 4 Mar 23 09:02:36 srv2 mysqld[31168]: capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO Mar 23 09:02:36 srv2 mysqld[31168]: final: no Mar 23 09:02:36 srv2 mysqld[31168]: own_index: 0 Mar 23 09:02:36 srv2 mysqld[31168]: members(3): Mar 23 09:02:36 srv2 mysqld[31168]: 0: 6552b06c-87fd-11eb-a6b2-670c0c1acbe7, srv2 Mar 23 09:02:36 srv2 mysqld[31168]: 1: 7d447799-8b22-11eb-915b-468cb230a09e, srv1 Mar 23 09:02:36 srv2 mysqld[31168]: 2: fa61149d-87ed-11eb-9ae2-be4d05c83bf4, srv3 Mar 23 09:02:36 srv2 mysqld[31168]: ================================================= Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 0 [Note] WSREP: Receiving IST...100.0% (2639/2639 events) complete. Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 22 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:02:36 srv2 mysqld[31168]: 210323 9:02:36 [ERROR] mysqld got signal 11 ; Mar 23 09:02:36 srv2 mysqld[31168]: This could be because you hit a bug. It is also possible that this binary Mar 23 09:02:36 srv2 mysqld[31168]: or one of the libraries it was linked against is corrupt, improperly built, Mar 23 09:02:36 srv2 mysqld[31168]: or misconfigured. This error can also be caused by malfunctioning hardware. Mar 23 09:02:36 srv2 mysqld[31168]: To report this bug, see https://mariadb.com/kb/en/reporting-bugs Mar 23 09:02:36 srv2 mysqld[31168]: We will try our best to scrape up some info that will hopefully help Mar 23 09:02:36 srv2 mysqld[31168]: diagnose the problem, but since we have already crashed, Mar 23 09:02:36 srv2 mysqld[31168]: something is definitely wrong and this may fail. Mar 23 09:02:36 srv2 mysqld[31168]: Server version: 10.4.18-MariaDB-1:10.4.18+maria~buster-log Mar 23 09:02:36 srv2 mysqld[31168]: key_buffer_size=134217728 Mar 23 09:02:36 srv2 mysqld[31168]: read_buffer_size=2097152 Mar 23 09:02:36 srv2 mysqld[31168]: max_used_connections=2 Mar 23 09:02:36 srv2 mysqld[31168]: max_threads=302 Mar 23 09:02:36 srv2 mysqld[31168]: thread_count=25 Mar 23 09:02:36 srv2 mysqld[31168]: It is possible that mysqld could use up to Mar 23 09:02:36 srv2 mysqld[31168]: key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 1994007 K bytes of memory Mar 23 09:02:36 srv2 mysqld[31168]: Hope that's ok; if not, decrease some variables in the equation. Mar 23 09:02:36 srv2 mysqld[31168]: Thread pointer: 0x7f6670000c08 Mar 23 09:02:36 srv2 mysqld[31168]: Attempting backtrace. You can use the following information to find out Mar 23 09:02:36 srv2 mysqld[31168]: where mysqld died. If you see no messages after this, something went Mar 23 09:02:36 srv2 mysqld[31168]: terribly wrong... Mar 23 09:02:36 srv2 mysqld[31168]: stack_bottom = 0x7f67102ede08 thread_stack 0x100000 Mar 23 09:02:36 srv2 mysqld[31168]: 2021-03-23 9:02:36 1 [Note] WSREP: Draining apply monitors after IST up to 1647668375 Mar 23 09:02:36 srv2 mysqld[31168]: /usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x560b3e1047fe] Mar 23 09:02:36 srv2 mysqld[31168]: /usr/sbin/mysqld(handle_fatal_signal+0x54d)[0x560b3dbf7b0d] Mar 23 09:02:36 srv2 mysqld[31168]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12730)[0x7f7266795730] Mar 23 09:02:37 srv2 mysqld[31168]: /usr/sbin/mysqld(+0x64819d)[0x560b3d98719d] Mar 23 09:02:37 srv2 mysqld[31168]: /usr/sbin/mysqld(_Z11lock_tablesP3THDP10TABLE_LISTjj+0x4a8)[0x560b3d98cf78] Mar 23 09:02:37 srv2 mysqld[31168]: /usr/sbin/mysqld(_Z20open_and_lock_tablesP3THDRK14DDL_options_stP10TABLE_LISTbjP19Prelocking_strategy+0x8a)[0x560b3d98e6ba] Mar 23 09:02:37 srv2 mysqld[31168]: /usr/sbin/mysqld(_Z24open_n_lock_single_tableP3THDP10TABLE_LIST13thr_lock_typejP19Prelocking_strategy+0x41)[0x560b3d98e761] Mar 23 09:02:37 srv2 mysqld[31168]: /usr/sbin/mysqld(+0x8370c5)[0x560b3db760c5] Mar 23 09:02:37 srv2 mysqld[31168]: /usr/sbin/mysqld(_ZNK12Wsrep_schema12restore_viewEP3THDRKN5wsrep2idE+0xf8)[0x560b3db78d88] Mar 23 09:02:37 srv2 mysqld[31168]: /usr/sbin/mysqld(_ZN20Wsrep_server_service8log_viewEPN5wsrep21high_priority_serviceERKNS0_4viewE+0x4d4)[0x560b3dd740d4] Mar 23 09:02:37 srv2 mysqld[31168]: /usr/sbin/mysqld(_ZN5wsrep12server_state7on_viewERKNS_4viewEPNS_21high_priority_serviceE+0x39b)[0x560b3e17c95b] Mar 23 09:02:37 srv2 mysqld[31168]: /usr/sbin/mysqld(+0xe4facc)[0x560b3e18eacc] Mar 23 09:02:37 srv2 mysqld[31168]: src/replicator_smm.cpp:2429(galera::ReplicatorSMM::submit_view_info(void*, wsrep_view_info const*))[0x7f7265013cd9] Mar 23 09:02:37 srv2 mysqld[31168]: src/replicator_str.cpp:1164(galera::ReplicatorSMM::recv_IST(void*))[0x7f726502f5b5] Mar 23 09:02:37 srv2 mysqld[31168]: src/replicator_smm.cpp:396(galera::ReplicatorSMM::async_recv(void*))[0x7f726501dd53] Mar 23 09:02:37 srv2 mysqld[31168]: src/wsrep_provider.cpp:263(galera_recv)[0x7f7264ff948b] Mar 23 09:02:37 srv2 mysqld[31168]: /usr/sbin/mysqld(_ZN5wsrep18wsrep_provider_v2611run_applierEPNS_21high_priority_serviceE+0xe)[0x560b3e18c4fe] Mar 23 09:02:37 srv2 mysqld[31168]: /usr/sbin/mysqld(+0x836dff)[0x560b3db75dff] Mar 23 09:02:37 srv2 mysqld[31168]: /usr/sbin/mysqld(_Z15start_wsrep_THDPv+0x388)[0x560b3db67ac8] Mar 23 09:02:37 srv2 mysqld[31168]: /lib/x86_64-linux-gnu/libpthread.so.0(+0x7fa3)[0x7f726678afa3] Mar 23 09:02:37 srv2 mysqld[31168]: /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7f7265c9f4cf] Mar 23 09:02:37 srv2 mysqld[31168]: Trying to get some variables. Mar 23 09:02:37 srv2 mysqld[31168]: Some pointers may be invalid and cause the dump to abort. Mar 23 09:02:37 srv2 mysqld[31168]: Query (0x0): (null) Mar 23 09:02:37 srv2 mysqld[31168]: Connection ID (thread ID): 22 Mar 23 09:02:37 srv2 mysqld[31168]: Status: NOT_KILLED Mar 23 09:02:37 srv2 mysqld[31168]: Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=on,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,condition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on Mar 23 09:02:37 srv2 mysqld[31168]: The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains Mar 23 09:02:37 srv2 mysqld[31168]: information that should help you find out what is causing the crash. Mar 23 09:02:37 srv2 mysqld[31168]: We think the query pointer is invalid, but we will try to print it anyway. Mar 23 09:02:37 srv2 mysqld[31168]: Query: Mar 23 09:02:37 srv2 mysqld[31168]: Writing a core file... Mar 23 09:02:37 srv2 mysqld[31168]: Working directory at /var/lib/mysql Mar 23 09:02:37 srv2 mysqld[31168]: Resource Limits: Mar 23 09:02:37 srv2 mysqld[31168]: Limit Soft Limit Hard Limit Units Mar 23 09:02:37 srv2 mysqld[31168]: Max cpu time unlimited unlimited seconds Mar 23 09:02:37 srv2 mysqld[31168]: Max file size unlimited unlimited bytes Mar 23 09:02:37 srv2 mysqld[31168]: Max data size unlimited unlimited bytes Mar 23 09:02:37 srv2 mysqld[31168]: Max stack size 8388608 unlimited bytes Mar 23 09:02:37 srv2 mysqld[31168]: Max core file size 0 unlimited bytes Mar 23 09:02:37 srv2 mysqld[31168]: Max resident set unlimited unlimited bytes Mar 23 09:02:37 srv2 mysqld[31168]: Max processes 257286 257286 processes Mar 23 09:02:37 srv2 mysqld[31168]: Max open files 16384 16384 files Mar 23 09:02:37 srv2 mysqld[31168]: Max locked memory 65536 65536 bytes Mar 23 09:02:37 srv2 mysqld[31168]: Max address space unlimited unlimited bytes Mar 23 09:02:37 srv2 mysqld[31168]: Max file locks unlimited unlimited locks Mar 23 09:02:37 srv2 mysqld[31168]: Max pending signals 257286 257286 signals Mar 23 09:02:37 srv2 mysqld[31168]: Max msgqueue size 819200 819200 bytes Mar 23 09:02:37 srv2 mysqld[31168]: Max nice priority 0 0 Mar 23 09:02:37 srv2 mysqld[31168]: Max realtime priority 0 0 Mar 23 09:02:37 srv2 mysqld[31168]: Max realtime timeout unlimited unlimited us Mar 23 09:02:37 srv2 mysqld[31168]: Core pattern: core Mar 23 09:02:37 srv2 systemd[1]: mariadb.service: Main process exited, code=killed, status=11/SEGV Mar 23 09:02:37 srv2 systemd[1]: mariadb.service: Failed with result 'signal'. Mar 23 09:02:42 srv2 systemd[1]: mariadb.service: Service RestartSec=5s expired, scheduling restart. Mar 23 09:02:42 srv2 systemd[1]: mariadb.service: Scheduled restart job, restart counter is at 2. Mar 23 09:02:42 srv2 systemd[1]: Stopped MariaDB 10.4.18 database server. Mar 23 09:02:42 srv2 systemd[1]: Starting MariaDB 10.4.18 database server... Mar 23 09:02:47 srv2 mysqld[31568]: WSREP: Recovered position bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668374 Mar 23 09:02:47 srv2 mysqld[31869]: 2021-03-23 9:02:47 0 [Note] /usr/sbin/mysqld (mysqld 10.4.18-MariaDB-1:10.4.18+maria~buster-log) starting as process 31869 ... Mar 23 09:02:47 srv2 mysqld[31869]: 2021-03-23 9:02:47 0 [Note] WSREP: Loading provider /usr/lib/libgalera_smm.so initial position: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668374 Mar 23 09:02:47 srv2 mysqld[31869]: 2021-03-23 9:02:47 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/libgalera_smm.so' Mar 23 09:02:47 srv2 mysqld[31869]: 2021-03-23 9:02:47 0 [Note] WSREP: wsrep_load(): Galera 4.7(ree4f10fc) by Codership Oy loaded successfully. Mar 23 09:02:47 srv2 mysqld[31869]: 2021-03-23 9:02:47 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration. Mar 23 09:02:47 srv2 mysqld[31869]: 2021-03-23 9:02:47 0 [Note] WSREP: Found saved state: bd401d28-f285-11ea-9c06-4e99d1c864f6:-1, safe_to_bootstrap: 0 Mar 23 09:02:47 srv2 mysqld[31869]: 2021-03-23 9:02:47 0 [Note] WSREP: GCache DEBUG: opened preamble: Mar 23 09:02:47 srv2 mysqld[31869]: Version: 2 Mar 23 09:02:47 srv2 mysqld[31869]: UUID: bd401d28-f285-11ea-9c06-4e99d1c864f6 Mar 23 09:02:47 srv2 mysqld[31869]: Seqno: -1 - -1 Mar 23 09:02:47 srv2 mysqld[31869]: Offset: -1 Mar 23 09:02:47 srv2 mysqld[31869]: Synced: 0 Mar 23 09:02:47 srv2 mysqld[31869]: 2021-03-23 9:02:47 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: bd401d28-f285-11ea-9c06-4e99d1c864f6, offset: -1 Mar 23 09:02:47 srv2 mysqld[31869]: 2021-03-23 9:02:47 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/4294967320 bytes) complete. Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (4294967320/4294967320 bytes) complete. Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 1644976252-1647668375 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: GCache::RingBuffer unused buffers scan... 0.0% ( 0/4294966568 bytes) complete. Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (4294966568/4294966568 bytes) complete. Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): found 7/2692131 locked buffers Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): free space: 5808/4294967296 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.0.1.3; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 4G; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = fa Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: Service thread queue flushed. Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: ####### Assign initial position for certification: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668374, protocol version: -1 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: Start replication Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: Connecting with bootstrap option: 0 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: Setting GCS initial position to bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668374 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: protonet asio version 0 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: Using CRC-32C for message checksums. Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: backend: asio Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: restore pc from disk successfully Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: GMCast version 0 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: (6552b06c-a6b3, 'ssl://0.0.0.0:4567') listening at ssl://0.0.0.0:4567 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: (6552b06c-a6b3, 'ssl://0.0.0.0:4567') multicast: , ttl: 1 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: EVS version 1 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: gcomm: connecting to group 'DS1', peer '10.0.1.2:,10.0.1.3:,10.0.1.4:' Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: (6552b06c-a6b3, 'ssl://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address ssl://10.0.1.3:4567 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: (6552b06c-a6b3, 'ssl://0.0.0.0:4567') connection established to 7d447799-915b ssl://10.0.1.2:4567 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: (6552b06c-a6b3, 'ssl://0.0.0.0:4567') turning message relay requesting on, nonlive peers: Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: EVS version upgrade 0 -> 1 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: declaring 7d447799-915b at ssl://10.0.1.2:4567 stable Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: PC protocol upgrade 0 -> 1 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: view(view_id(NON_PRIM,6552b06c-a6b3,162) memb { Mar 23 09:02:48 srv2 mysqld[31869]: 6552b06c-a6b3,0 Mar 23 09:02:48 srv2 mysqld[31869]: 7d447799-915b,0 Mar 23 09:02:48 srv2 mysqld[31869]: } joined { Mar 23 09:02:48 srv2 mysqld[31869]: } left { Mar 23 09:02:48 srv2 mysqld[31869]: } partitioned { Mar 23 09:02:48 srv2 mysqld[31869]: 6552b06c-a6b2,0 Mar 23 09:02:48 srv2 mysqld[31869]: fa61149d-9ae2,0 Mar 23 09:02:48 srv2 mysqld[31869]: }) Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Warning] WSREP: node uuid: 6552b06c-a6b2 last_prim(type: 3, uuid: 6552b06c-a6b2) is inconsistent to restored view(type: V_NON_PRIM, uuid: 6552b06c-a6b2 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: gcomm: connected Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: Opened channel 'DS1' Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 2 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: Flow-control interval: [23, 23] Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 0 [Note] WSREP: Received NON-PRIMARY. Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 1 [Note] WSREP: Starting rollbacker thread 1 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 2 [Note] WSREP: Starting applier thread 2 Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 2 [Note] WSREP: ================================================ Mar 23 09:02:48 srv2 mysqld[31869]: View: Mar 23 09:02:48 srv2 mysqld[31869]: id: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668374 Mar 23 09:02:48 srv2 mysqld[31869]: status: non-primary Mar 23 09:02:48 srv2 mysqld[31869]: protocol_version: -1 Mar 23 09:02:48 srv2 mysqld[31869]: capabilities: Mar 23 09:02:48 srv2 mysqld[31869]: final: no Mar 23 09:02:48 srv2 mysqld[31869]: own_index: 0 Mar 23 09:02:48 srv2 mysqld[31869]: members(2): Mar 23 09:02:48 srv2 mysqld[31869]: 0: 6552b06c-87fd-11eb-a6b3-670c0c1acbe7, srv2 Mar 23 09:02:48 srv2 mysqld[31869]: 1: 7d447799-8b22-11eb-915b-468cb230a09e, unspecified Mar 23 09:02:48 srv2 mysqld[31869]: ================================================= Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 2 [Note] WSREP: Non-primary view Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 2 [Note] WSREP: Server status change disconnected -> connected Mar 23 09:02:48 srv2 mysqld[31869]: 2021-03-23 9:02:48 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:02:51 srv2 mysqld[31869]: 2021-03-23 9:02:51 0 [Note] WSREP: (6552b06c-a6b3, 'ssl://0.0.0.0:4567') turning message relay requesting off Mar 23 09:03:01 srv2 mysqld[31869]: 2021-03-23 9:03:01 0 [Note] WSREP: (6552b06c-a6b3, 'ssl://0.0.0.0:4567') connection established to fa61149d-9ae3 ssl://10.0.1.4:4567 Mar 23 09:03:01 srv2 mysqld[31869]: 2021-03-23 9:03:01 0 [Note] WSREP: (6552b06c-a6b3, 'ssl://0.0.0.0:4567') turning message relay requesting on, nonlive peers: Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: declaring 7d447799-915b at ssl://10.0.1.2:4567 stable Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: declaring fa61149d-9ae3 at ssl://10.0.1.4:4567 stable Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: re-bootstrapping prim from partitioned components Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: view(view_id(PRIM,6552b06c-a6b3,163) memb { Mar 23 09:03:02 srv2 mysqld[31869]: 6552b06c-a6b3,0 Mar 23 09:03:02 srv2 mysqld[31869]: 7d447799-915b,0 Mar 23 09:03:02 srv2 mysqld[31869]: fa61149d-9ae3,0 Mar 23 09:03:02 srv2 mysqld[31869]: } joined { Mar 23 09:03:02 srv2 mysqld[31869]: } left { Mar 23 09:03:02 srv2 mysqld[31869]: } partitioned { Mar 23 09:03:02 srv2 mysqld[31869]: 6552b06c-a6b2,0 Mar 23 09:03:02 srv2 mysqld[31869]: fa61149d-9ae2,0 Mar 23 09:03:02 srv2 mysqld[31869]: }) Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: save pc into disk Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: clear restored view Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3 Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 30a0e386-8bae-11eb-96b2-5a30bedc374f Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 30a0e386-8bae-11eb-96b2-5a30bedc374f Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: STATE EXCHANGE: got state msg: 30a0e386-8bae-11eb-96b2-5a30bedc374f from 0 (srv2) Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: STATE EXCHANGE: got state msg: 30a0e386-8bae-11eb-96b2-5a30bedc374f from 1 (srv1) Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: STATE EXCHANGE: got state msg: 30a0e386-8bae-11eb-96b2-5a30bedc374f from 2 (srv3) Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Warning] WSREP: Quorum: No node with complete state: Mar 23 09:03:02 srv2 mysqld[31869]: Version : 6 Mar 23 09:03:02 srv2 mysqld[31869]: Flags : 0x1 Mar 23 09:03:02 srv2 mysqld[31869]: Protocols : 2 / 10 / 4 Mar 23 09:03:02 srv2 mysqld[31869]: State : NON-PRIMARY Mar 23 09:03:02 srv2 mysqld[31869]: Desync count : 0 Mar 23 09:03:02 srv2 mysqld[31869]: Prim state : NON-PRIMARY Mar 23 09:03:02 srv2 mysqld[31869]: Prim UUID : 00000000-0000-0000-0000-000000000000 Mar 23 09:03:02 srv2 mysqld[31869]: Prim seqno : -1 Mar 23 09:03:02 srv2 mysqld[31869]: First seqno : 1644976252 Mar 23 09:03:02 srv2 mysqld[31869]: Last seqno : 1647668374 Mar 23 09:03:02 srv2 mysqld[31869]: Commit cut : 1647668374 Mar 23 09:03:02 srv2 mysqld[31869]: Last vote : -1.0 Mar 23 09:03:02 srv2 mysqld[31869]: Vote policy : 0 Mar 23 09:03:02 srv2 mysqld[31869]: Prim JOINED : 0 Mar 23 09:03:02 srv2 mysqld[31869]: State UUID : 30a0e386-8bae-11eb-96b2-5a30bedc374f Mar 23 09:03:02 srv2 mysqld[31869]: Group UUID : bd401d28-f285-11ea-9c06-4e99d1c864f6 Mar 23 09:03:02 srv2 mysqld[31869]: Name : 'srv2' Mar 23 09:03:02 srv2 mysqld[31869]: Incoming addr: 'AUTO' Mar 23 09:03:02 srv2 mysqld[31869]: Version : 6 Mar 23 09:03:02 srv2 mysqld[31869]: Flags : 0x2 Mar 23 09:03:02 srv2 mysqld[31869]: Protocols : 2 / 10 / 4 Mar 23 09:03:02 srv2 mysqld[31869]: State : NON-PRIMARY Mar 23 09:03:02 srv2 mysqld[31869]: Desync count : 0 Mar 23 09:03:02 srv2 mysqld[31869]: Prim state : JOINED Mar 23 09:03:02 srv2 mysqld[31869]: Prim UUID : 20039b70-8bae-11eb-936b-5abdaa1c6f49 Mar 23 09:03:02 srv2 mysqld[31869]: Prim seqno : 5 Mar 23 09:03:02 srv2 mysqld[31869]: First seqno : 1644976267 Mar 23 09:03:02 srv2 mysqld[31869]: Last seqno : 1647668380 Mar 23 09:03:02 srv2 mysqld[31869]: Commit cut : 1647665736 Mar 23 09:03:02 srv2 mysqld[31869]: Last vote : -1.0 Mar 23 09:03:02 srv2 mysqld[31869]: Vote policy : 0 Mar 23 09:03:02 srv2 mysqld[31869]: Prim JOINED : 2 Mar 23 09:03:02 srv2 mysqld[31869]: State UUID : 30a0e386-8bae-11eb-96b2-5a30bedc374f Mar 23 09:03:02 srv2 mysqld[31869]: Group UUID : bd401d28-f285-11ea-9c06-4e99d1c864f6 Mar 23 09:03:02 srv2 mysqld[31869]: Name : 'srv1' Mar 23 09:03:02 srv2 mysqld[31869]: Incoming addr: 'AUTO' Mar 23 09:03:02 srv2 mysqld[31869]: Version : 6 Mar 23 09:03:02 srv2 mysqld[31869]: Flags : 00 Mar 23 09:03:02 srv2 mysqld[31869]: Protocols : 2 / 10 / 4 Mar 23 09:03:02 srv2 mysqld[31869]: State : NON-PRIMARY Mar 23 09:03:02 srv2 mysqld[31869]: Desync count : 0 Mar 23 09:03:02 srv2 mysqld[31869]: Prim state : NON-PRIMARY Mar 23 09:03:02 srv2 mysqld[31869]: Prim UUID : 00000000-0000-0000-0000-000000000000 Mar 23 09:03:02 srv2 mysqld[31869]: Prim seqno : -1 Mar 23 09:03:02 srv2 mysqld[31869]: First seqno : 1644976253 Mar 23 09:03:02 srv2 mysqld[31869]: Last seqno : 1647668374 Mar 23 09:03:02 srv2 mysqld[31869]: Commit cut : 1647668374 Mar 23 09:03:02 srv2 mysqld[31869]: Last vote : -1.0 Mar 23 09:03:02 srv2 mysqld[31869]: Vote policy : 0 Mar 23 09:03:02 srv2 mysqld[31869]: Prim JOINED : 0 Mar 23 09:03:02 srv2 mysqld[31869]: State UUID : 30a0e386-8bae-11eb-96b2-5a30bedc374f Mar 23 09:03:02 srv2 mysqld[31869]: Group UUID : bd401d28-f285-11ea-9c06-4e99d1c864f6 Mar 23 09:03:02 srv2 mysqld[31869]: Name : 'srv3' Mar 23 09:03:02 srv2 mysqld[31869]: Incoming addr: 'AUTO' Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: Partial re-merge of primary 20039b70-8bae-11eb-936b-5abdaa1c6f49 found: 1 of 2. Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: Quorum results: Mar 23 09:03:02 srv2 mysqld[31869]: version = 6, Mar 23 09:03:02 srv2 mysqld[31869]: component = PRIMARY, Mar 23 09:03:02 srv2 mysqld[31869]: conf_id = 5, Mar 23 09:03:02 srv2 mysqld[31869]: members = 1/3 (joined/total), Mar 23 09:03:02 srv2 mysqld[31869]: act_id = 1647668380, Mar 23 09:03:02 srv2 mysqld[31869]: last_appl. = 1647665736, Mar 23 09:03:02 srv2 mysqld[31869]: protocols = 2/10/4 (gcs/repl/appl), Mar 23 09:03:02 srv2 mysqld[31869]: vote policy= 0, Mar 23 09:03:02 srv2 mysqld[31869]: group UUID = bd401d28-f285-11ea-9c06-4e99d1c864f6 Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: Flow-control interval: [28, 28] Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 1647668381) Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: ####### processing CC 1647668381, local, ordered Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: Process first view: bd401d28-f285-11ea-9c06-4e99d1c864f6 my uuid: 6552b06c-87fd-11eb-a6b3-670c0c1acbe7 Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: Server srv2 connected to cluster at position bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668381 with ID 6552b06c-87fd-11eb-a6b3-670c0c1acbe7 Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: Server status change connected -> connected Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: ####### My UUID: 6552b06c-87fd-11eb-a6b3-670c0c1acbe7 Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: Service thread queue flushed. Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1 Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: State transfer required: Mar 23 09:03:02 srv2 mysqld[31869]: Group state: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668381 Mar 23 09:03:02 srv2 mysqld[31869]: Local state: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668374 Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: Server status change connected -> joiner Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: Joiner monitor thread started to monitor Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '10.0.1.3' --datadir '/var/lib/mysql/' --parent '31869' --binlog '/var/log/mysql/mariadb-bin' --binlog-index '/var/log/mysql/mariadb-bin.index' --mysqld-args --wsrep_start_position=bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668374' Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 0 [Note] WSREP: Member 1.0 (srv1) synced with group. Mar 23 09:03:02 srv2 mysqld[31869]: WSREP_SST: [INFO] Logging all stderr of SST/Innobackupex to syslog (20210323 09:03:02.765) Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: Prepared SST request: mariabackup|10.0.1.3:4444/xtrabackup_sst//1 Mar 23 09:03:02 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: ####### IST uuid:bd401d28-f285-11ea-9c06-4e99d1c864f6 f: 1647668375, l: 1647668381, STRv: 3 Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: IST receiver addr using ssl://10.0.1.3:4568 Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: IST receiver using ssl Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:02 2 [Note] WSREP: Prepared IST receiver for 1647668375-1647668381, listening at: ssl://10.0.1.3:4568 Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] WSREP: Member 0.0 (srv2) requested state transfer from '*any*'. Selected 1.0 (srv1)(SYNCED) as donor. Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 1647668381) Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 2 [Note] WSREP: Requesting state transfer: success, donor: 1 Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Warning] WSREP: Member 2.0 (srv3) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] WSREP: 1.0 (srv1): State transfer to 0.0 (srv2) complete. Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] WSREP: Member 1.0 (srv1) synced with group. Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 3 [Note] WSREP: SST received Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 3 [Note] WSREP: Server status change joiner -> initializing Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] InnoDB: Using Linux native AIO Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] InnoDB: Uses event mutexes Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] InnoDB: Number of pools: 1 Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] InnoDB: Using SSE2 crc32 instructions Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] mysqld: O_TMPFILE is not supported on /tmp (disabling future attempts) Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] InnoDB: Initializing buffer pool, total size = 40G, instances = 40, chunk size = 128M Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] InnoDB: Completed initialization of buffer pool Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] InnoDB: Setting log file ./ib_logfile101 size to 4294967296 bytes Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] InnoDB: Renaming log file ./ib_logfile101 to ./ib_logfile0 Mar 23 09:03:03 srv2 mysqld[31869]: 2021-03-23 9:03:03 0 [Note] InnoDB: New log files created, LSN=19511745671393 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Member 2.0 (srv3) requested state transfer from '*any*'. Selected 1.0 (srv1)(SYNCED) as donor. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [ERROR] InnoDB: Operating system error number 2 in a file operation. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [ERROR] InnoDB: The error means the system cannot find the path specified. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [ERROR] InnoDB: Cannot open datafile for read-only: './dropshipping/#sql2-7260-e.ibd' OS error: 71 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [ERROR] InnoDB: Operating system error number 2 in a file operation. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [ERROR] InnoDB: The error means the system cannot find the path specified. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [ERROR] InnoDB: If you are installing InnoDB, remember that you must create directories yourself, InnoDB does not create them. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [ERROR] InnoDB: Could not find a valid tablespace file for ``dropshipping`.`#sql2-7260-e``. Please refer to https://mariadb.com/kb/en/innodb-data-dictionary-troubleshooting/ for how to resolve the issue. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Warning] InnoDB: Ignoring tablespace for `dropshipping`.`#sql2-7260-e` because it could not be opened. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] InnoDB: 128 out of 128 rollback segments are active. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] InnoDB: Creating shared tablespace for temporary tables Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] InnoDB: Waiting for purge to start Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: 1.0 (srv1): State transfer to 2.0 (srv3) complete. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Member 1.0 (srv1) synced with group. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] InnoDB: 10.4.18 started; log sequence number 19511745671692; transaction id 26895094391 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] Plugin 'FEEDBACK' is disabled. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [ERROR] mysqld: Plugin 'innodb' already installed Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Warning] Plugin 'FEDERATED' is of maturity level gamma while the server is stable Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] Server socket created on IP: '0.0.0.0'. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Server initialized Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Server status change initializing -> initialized Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 3 [Note] WSREP: Server status change initialized -> joined Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 3 [Note] WSREP: Recovered position from storage: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668374 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 20 [Note] WSREP: Starting applier thread 20 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 18 [Note] WSREP: Starting applier thread 18 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 12 [Note] WSREP: Starting applier thread 12 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 24 [Note] WSREP: Starting applier thread 24 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 14 [Note] WSREP: Starting applier thread 14 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 23 [Note] WSREP: Starting applier thread 23 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 21 [Note] WSREP: Starting applier thread 21 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 17 [Note] WSREP: Starting applier thread 17 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 19 [Note] WSREP: Starting applier thread 19 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 22 [Note] WSREP: Starting applier thread 22 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 13 [Note] WSREP: Starting applier thread 13 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 16 [Note] WSREP: Starting applier thread 16 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 11 [Note] WSREP: Starting applier thread 11 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 15 [Note] WSREP: Starting applier thread 15 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 25 [Note] WSREP: Starting applier thread 25 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] Reading of all Master_info entries succeeded Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] Added new Master_info '' to hash table Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] /usr/sbin/mysqld: ready for connections. Mar 23 09:03:04 srv2 mysqld[31869]: Version: '10.4.18-MariaDB-1:10.4.18+maria~buster-log' socket: '/var/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 3 [Note] WSREP: Recovered view from SST: Mar 23 09:03:04 srv2 mysqld[31869]: id: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647665872 Mar 23 09:03:04 srv2 mysqld[31869]: status: primary Mar 23 09:03:04 srv2 mysqld[31869]: protocol_version: 4 Mar 23 09:03:04 srv2 mysqld[31869]: capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO Mar 23 09:03:04 srv2 mysqld[31869]: final: no Mar 23 09:03:04 srv2 mysqld[31869]: own_index: -1 Mar 23 09:03:04 srv2 mysqld[31869]: members(2): Mar 23 09:03:04 srv2 mysqld[31869]: 0: 7d447799-8b22-11eb-915b-468cb230a09e, srv1 Mar 23 09:03:04 srv2 mysqld[31869]: 1: fa61149d-87ed-11eb-9ae2-be4d05c83bf4, srv3 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 28 [Note] WSREP: Recovered cluster id bd401d28-f285-11ea-9c06-4e99d1c864f6 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 3 [Note] WSREP: SST received: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668374 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 3 [Note] WSREP: SST succeeded for position bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668374 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Joiner monitor thread ended with total time 2 sec Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 2 [Note] WSREP: Installed new state from SST: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668374 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 2 [Note] WSREP: Receiving IST: 7 writesets, seqnos 1647668375-1647668381 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: ####### IST applying starts with 1647668375 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: ####### IST current seqno initialized to 1647665737 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Receiving IST... 0.0% ( 0/2645 events) complete. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: IST preload starting at 1647665737 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Service thread queue flushed. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:1647665736, protocol version: 5 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: REPL Protocols: 10 (5) Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: ####### Adjusting cert position: 1647665871 -> 1647665872 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Service thread queue flushed. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Lowest cert index boundary for CC from preload: 1647665737 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Min available from gcache for CC from preload: 1644976255 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: REPL Protocols: 10 (5) Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: ####### Adjusting cert position: 1647668374 -> 1647668375 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Service thread queue flushed. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 1647665737 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Min available from gcache for CC from ist: 1644976256 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 20 [Note] WSREP: ================================================ Mar 23 09:03:04 srv2 mysqld[31869]: View: Mar 23 09:03:04 srv2 mysqld[31869]: id: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668375 Mar 23 09:03:04 srv2 mysqld[31869]: status: primary Mar 23 09:03:04 srv2 mysqld[31869]: protocol_version: 4 Mar 23 09:03:04 srv2 mysqld[31869]: capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO Mar 23 09:03:04 srv2 mysqld[31869]: final: no Mar 23 09:03:04 srv2 mysqld[31869]: own_index: -1 Mar 23 09:03:04 srv2 mysqld[31869]: members(3): Mar 23 09:03:04 srv2 mysqld[31869]: 0: 6552b06c-87fd-11eb-a6b2-670c0c1acbe7, srv2 Mar 23 09:03:04 srv2 mysqld[31869]: 1: 7d447799-8b22-11eb-915b-468cb230a09e, srv1 Mar 23 09:03:04 srv2 mysqld[31869]: 2: fa61149d-87ed-11eb-9ae2-be4d05c83bf4, srv3 Mar 23 09:03:04 srv2 mysqld[31869]: ================================================= Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 20 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:03:04 srv2 systemd[1]: Started MariaDB 10.4.18 database server. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: REPL Protocols: 10 (5) Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: ####### Adjusting cert position: 1647668380 -> 1647668381 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Service thread queue flushed. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 1647665737 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Min available from gcache for CC from ist: 1644976266 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Receiving IST...100.0% (2645/2645 events) complete. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 21 [Note] WSREP: ================================================ Mar 23 09:03:04 srv2 mysqld[31869]: View: Mar 23 09:03:04 srv2 mysqld[31869]: id: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668381 Mar 23 09:03:04 srv2 mysqld[31869]: status: primary Mar 23 09:03:04 srv2 mysqld[31869]: protocol_version: 4 Mar 23 09:03:04 srv2 mysqld[31869]: capabilities: MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO Mar 23 09:03:04 srv2 mysqld[31869]: final: no Mar 23 09:03:04 srv2 mysqld[31869]: own_index: 0 Mar 23 09:03:04 srv2 mysqld[31869]: members(3): Mar 23 09:03:04 srv2 mysqld[31869]: 0: 6552b06c-87fd-11eb-a6b3-670c0c1acbe7, srv2 Mar 23 09:03:04 srv2 mysqld[31869]: 1: 7d447799-8b22-11eb-915b-468cb230a09e, srv1 Mar 23 09:03:04 srv2 mysqld[31869]: 2: fa61149d-87ed-11eb-9ae3-be4d05c83bf4, srv3 Mar 23 09:03:04 srv2 mysqld[31869]: ================================================= Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 21 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 2 [Note] WSREP: Draining apply monitors after IST up to 1647668381 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 2 [Note] WSREP: IST received: bd401d28-f285-11ea-9c06-4e99d1c864f6:1647668381 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 2 [Note] WSREP: Lowest cert index boundary for CC from sst: 1647665737 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 2 [Note] WSREP: Min available from gcache for CC from sst: 1644976266 Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: 0.0 (srv2): State transfer from 1.0 (srv1) complete. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 1647668382) Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Member 0.0 (srv2) synced with group. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 1647668382) Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 2 [Note] WSREP: Server srv2 synced with group Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 2 [Note] WSREP: Server status change joined -> synced Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 2 [Note] WSREP: Synchronized with group, ready for connections Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Mar 23 09:03:04 srv2 mysqld[31869]: 2021-03-23 9:03:04 0 [Note] WSREP: (6552b06c-a6b3, 'ssl://0.0.0.0:4567') turning message relay requesting off Mar 23 09:03:05 srv2 mysqld[31869]: 2021-03-23 9:03:05 0 [Note] WSREP: 2.0 (srv3): State transfer from 1.0 (srv1) complete. Mar 23 09:03:05 srv2 mysqld[31869]: 2021-03-23 9:03:05 0 [Note] WSREP: Member 2.0 (srv3) synced with group.