[MDEV-31377] Restarting replication slave in Galera cluster crashes repeatedly Created: 2023-05-31  Updated: 2023-08-30

Status: Open
Project: MariaDB Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Major
Reporter: COUNOTTE CEDRIC Assignee: Unassigned
Resolution: Unresolved Votes: 0
Labels: None


 Description   

We have a 3-nodes Galera cluster with one node being a replication slave of another cluster.
When we restart the 2 other nodes, all is ok.

When we restart the node being the replication slave, it keeps crashing or restarting over and over, until we stop the 2 other nodes.

Restarting the 2 other nodes leads to SST instead of IST those nodes being read-only.

Maria DB version is Ver 15.1 Distrib 10.6.13-MariaDB on all 3 nodes.

When running 10.6.12 there was no issue. Production cluster is still running 10.6.12 for that reason.

Here is latest logs. This has been reproduced twice already.

2023-05-31 15:09:45 3075 [Note] Error reading relay log event: slave SQL thread was killed
2023-05-31 15:09:45 3075 [Note] Slave SQL thread exiting, replication stopped in log 'mysql-bin.054856' at position 675285287, master: ovh7.vlan:3306
2023-05-31 15:09:45 157 [Note] Slave I/O thread exiting, read up to log 'mysql-bin.054856', position 675285287, master ovh7.vlan:3306
2023-05-31 15:10:27 0 [Note] WSREP: declaring 223bbcc7-ad09 at tcp://192.168.0.4:4567 stable
2023-05-31 15:10:27 0 [Note] WSREP: forgetting 3996cbad-a80e (tcp://192.168.0.3:4567)
2023-05-31 15:10:27 0 [Note] WSREP: Node 223bbcc7-ad09 state prim
2023-05-31 15:10:27 0 [Note] WSREP: view(view_id(PRIM,223bbcc7-ad09,6) memb {
2023-05-31 15:10:27 0 [Note] WSREP: save pc into disk
2023-05-31 15:10:27 0 [Note] WSREP: forgetting 3996cbad-a80e (tcp://192.168.0.3:4567)
2023-05-31 15:10:27 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2023-05-31 15:10:27 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2023-05-31 15:10:27 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 831e7f50-ffb4-11ed-9161-52a62274451d
2023-05-31 15:10:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 831e7f50-ffb4-11ed-9161-52a62274451d from 0 (ovh4.1check.com)
2023-05-31 15:10:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 831e7f50-ffb4-11ed-9161-52a62274451d from 1 (ovh5.1check.com)
2023-05-31 15:10:27 0 [Note] WSREP: Quorum results:
2023-05-31 15:10:27 0 [Note] WSREP: Flow-control interval: [23, 23]
2023-05-31 15:10:27 15 [Note] WSREP: ####### processing CC 149901140, local, ordered
2023-05-31 15:10:27 15 [Note] WSREP: ####### My UUID: 2a10acf7-f894-11ed-b597-b2733ba43458
2023-05-31 15:10:27 15 [Note] WSREP: Skipping cert index reset
2023-05-31 15:10:27 15 [Note] WSREP: REPL Protocols: 10 (5)
2023-05-31 15:10:27 15 [Note] WSREP: ####### Adjusting cert position: 149901139 -> 149901140
2023-05-31 15:10:27 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:10:27 15 [Note] WSREP: ================================================
2023-05-31 15:10:27 15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:10:27 15 [Note] WSREP: Lowest cert index boundary for CC from group: 149901047
2023-05-31 15:10:27 15 [Note] WSREP: Min available from gcache for CC from group: 149900591
2023-05-31 15:10:32 0 [Note] WSREP:  cleaning up 3996cbad-a80e (tcp://192.168.0.3:4567)
2023-05-31 15:10:51 0 [Note] WSREP: Deferred close timer started for socket with remote endpoint: tcp://192.168.0.4:52548
2023-05-31 15:10:51 0 [Note] WSREP: forgetting 223bbcc7-ad09 (tcp://192.168.0.4:4567)
2023-05-31 15:10:51 0 [Note] WSREP: Node 2a10acf7-b597 state prim
2023-05-31 15:10:51 0 [Note] WSREP: view(view_id(PRIM,2a10acf7-b597,7) memb {
2023-05-31 15:10:51 0 [Note] WSREP: save pc into disk
2023-05-31 15:10:51 0 [Note] WSREP: forgetting 223bbcc7-ad09 (tcp://192.168.0.4:4567)
2023-05-31 15:10:51 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1
2023-05-31 15:10:51 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 912e3659-ffb4-11ed-ba6a-5bfa6bfa10a0
2023-05-31 15:10:51 0 [Note] WSREP: Deferred close timer handle_wait Operation aborted. for 0x55c08f9db640
2023-05-31 15:10:51 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 912e3659-ffb4-11ed-ba6a-5bfa6bfa10a0
2023-05-31 15:10:51 0 [Note] WSREP: Deferred close timer destruct
2023-05-31 15:10:51 0 [Note] WSREP: STATE EXCHANGE: got state msg: 912e3659-ffb4-11ed-ba6a-5bfa6bfa10a0 from 0 (ovh5.1check.com)
2023-05-31 15:10:51 0 [Note] WSREP: Quorum results:
2023-05-31 15:10:51 0 [Note] WSREP: Flow-control interval: [16, 16]
2023-05-31 15:10:51 15 [Note] WSREP: ####### processing CC 149901141, local, ordered
2023-05-31 15:10:51 15 [Note] WSREP: ####### My UUID: 2a10acf7-f894-11ed-b597-b2733ba43458
2023-05-31 15:10:51 15 [Note] WSREP: Skipping cert index reset
2023-05-31 15:10:51 15 [Note] WSREP: REPL Protocols: 10 (5)
2023-05-31 15:10:51 15 [Note] WSREP: ####### Adjusting cert position: 149901140 -> 149901141
2023-05-31 15:10:51 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:10:51 15 [Note] WSREP: ================================================
2023-05-31 15:10:51 15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:10:51 15 [Note] WSREP: Lowest cert index boundary for CC from group: 149901047
2023-05-31 15:10:51 15 [Note] WSREP: Min available from gcache for CC from group: 149900591
2023-05-31 15:10:56 0 [Note] WSREP:  cleaning up 223bbcc7-ad09 (tcp://192.168.0.4:4567)
2023-05-31 15:13:38 0 [Note] WSREP: (2a10acf7-b597, 'tcp://0.0.0.0:4567') connection established to f4eb5d26-bd95 tcp://192.168.0.3:4567
2023-05-31 15:13:38 0 [Note] WSREP: (2a10acf7-b597, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2023-05-31 15:13:39 0 [Note] WSREP: declaring f4eb5d26-bd95 at tcp://192.168.0.3:4567 stable
2023-05-31 15:13:39 0 [Note] WSREP: Node 2a10acf7-b597 state prim
2023-05-31 15:13:39 0 [Note] WSREP: view(view_id(PRIM,2a10acf7-b597,8) memb {
2023-05-31 15:13:39 0 [Note] WSREP: save pc into disk
2023-05-31 15:13:39 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2
2023-05-31 15:13:39 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: f547a10b-ffb4-11ed-8bca-6b6b695d013f
2023-05-31 15:13:39 0 [Note] WSREP: STATE EXCHANGE: sent state msg: f547a10b-ffb4-11ed-8bca-6b6b695d013f
2023-05-31 15:13:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: f547a10b-ffb4-11ed-8bca-6b6b695d013f from 0 (ovh5.1check.com)
2023-05-31 15:13:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: f547a10b-ffb4-11ed-8bca-6b6b695d013f from 1 (ovh3.1check.com)
2023-05-31 15:13:39 0 [Note] WSREP: Quorum results:
2023-05-31 15:13:39 0 [Note] WSREP: Flow-control interval: [23, 23]
2023-05-31 15:13:39 15 [Note] WSREP: ####### processing CC 149901142, local, ordered
2023-05-31 15:13:39 15 [Note] WSREP: ####### My UUID: 2a10acf7-f894-11ed-b597-b2733ba43458
2023-05-31 15:13:39 15 [Note] WSREP: Skipping cert index reset
2023-05-31 15:13:39 15 [Note] WSREP: REPL Protocols: 10 (5)
2023-05-31 15:13:39 15 [Note] WSREP: ####### Adjusting cert position: 149901141 -> 149901142
2023-05-31 15:13:39 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:13:39 15 [Note] WSREP: ================================================
2023-05-31 15:13:39 15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:13:39 15 [Note] WSREP: Lowest cert index boundary for CC from group: 149901047
2023-05-31 15:13:39 15 [Note] WSREP: Min available from gcache for CC from group: 149900591
2023-05-31 15:13:39 0 [Note] WSREP: Member 1.0 (ovh3.1check.com) requested state transfer from '*any*'. Selected 0.0 (ovh5.1check.com)(SYNCED) as donor.
2023-05-31 15:13:39 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 149901142)
2023-05-31 15:13:39 15 [Note] WSREP: Detected STR version: 1, req_len: 141, req: STRv1
2023-05-31 15:13:39 15 [Note] WSREP: IST request: 66eb3498-d920-11ed-892c-0669747ecf70:149901139-149901142|tcp://192.168.0.3:4568
2023-05-31 15:13:39 15 [Note] WSREP: Server status change synced -> donor
2023-05-31 15:13:39 15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:13:39 0 [Note] WSREP: Donor monitor thread started to monitor
2023-05-31 15:13:39 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '192.168.0.3:4444/xtrabackup_sst//1' --local-port 3306 --socket '/run/mysqld/mysqld.sock' --progress 0 --datadir '/var/
lib/mysql/' --gtid '66eb3498-d920-11ed-892c-0669747ecf70:149901139' --gtid-domain-id 300 --binlog '/var/lib/mysql/mysql-bin' --binlog-index '/var/lib/mysql/mysql-bin.index' --bypass --mysqld-args --wsrep-new-clus
ter --wsrep_start_position=66eb3498-d920-11ed-892c-0669747ecf70:120869475,0-1-5143'
2023-05-31 15:13:39 15 [Note] WSREP: sst_donor_thread signaled with 0
2023-05-31 15:13:39 0 [Note] WSREP: async IST sender starting to serve tcp://192.168.0.3:4568 sending 149901047-149901142, preload starts from 149901047
2023-05-31 15:13:39 0 [Note] WSREP: IST sender 149901047 -> 149901142
2023-05-31 15:13:40 0 [Note] WSREP: SST sent: 66eb3498-d920-11ed-892c-0669747ecf70:149901139
2023-05-31 15:13:40 0 [Note] WSREP: Server status change donor -> joined
2023-05-31 15:13:40 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:13:40 0 [Note] WSREP: 0.0 (ovh5.1check.com): State transfer to 1.0 (ovh3.1check.com) complete.
2023-05-31 15:13:40 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 149901142)
2023-05-31 15:13:40 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete.
2023-05-31 15:13:40 0 [Note] WSREP: Member 0.0 (ovh5.1check.com) synced with group.
2023-05-31 15:13:40 0 [Note] WSREP: Processing event queue:...100.0% (1/1 events) complete.
2023-05-31 15:13:40 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 149901142)
2023-05-31 15:13:40 14 [Note] WSREP: Server ovh5.1check.com synced with group
2023-05-31 15:13:40 14 [Note] WSREP: Server status change joined -> synced
2023-05-31 15:13:40 14 [Note] WSREP: Synchronized with group, ready for connections
2023-05-31 15:13:40 14 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:13:40 0 [Note] WSREP: Donor monitor thread ended with total time 1 sec
2023-05-31 15:13:41 0 [Note] WSREP: async IST sender served
2023-05-31 15:13:41 0 [Note] WSREP: 1.0 (ovh3.1check.com): State transfer from 0.0 (ovh5.1check.com) complete.
2023-05-31 15:13:41 0 [Note] WSREP: Member 1.0 (ovh3.1check.com) synced with group.
2023-05-31 15:13:41 0 [Note] WSREP: (2a10acf7-b597, 'tcp://0.0.0.0:4567') turning message relay requesting off
2023-05-31 15:13:58 0 [Note] WSREP: (2a10acf7-b597, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://192.168.0.4:4567
2023-05-31 15:13:58 0 [Note] WSREP: (2a10acf7-b597, 'tcp://0.0.0.0:4567') connection established to 01049457-8651 tcp://192.168.0.4:4567
2023-05-31 15:13:59 0 [Note] WSREP: declaring 01049457-8651 at tcp://192.168.0.4:4567 stable
2023-05-31 15:13:59 0 [Note] WSREP: declaring f4eb5d26-bd95 at tcp://192.168.0.3:4567 stable
2023-05-31 15:13:59 0 [Note] WSREP: Node 2a10acf7-b597 state prim
2023-05-31 15:13:59 0 [Note] WSREP: view(view_id(PRIM,01049457-8651,9) memb {
2023-05-31 15:13:59 0 [Note] WSREP: save pc into disk
2023-05-31 15:13:59 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3
2023-05-31 15:13:59 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2023-05-31 15:13:59 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 015101ab-ffb5-11ed-92b0-8b7251ea1435
2023-05-31 15:13:59 0 [Note] WSREP: STATE EXCHANGE: got state msg: 015101ab-ffb5-11ed-92b0-8b7251ea1435 from 0 (ovh4.1check.com)
2023-05-31 15:13:59 0 [Note] WSREP: STATE EXCHANGE: got state msg: 015101ab-ffb5-11ed-92b0-8b7251ea1435 from 2 (ovh3.1check.com)
2023-05-31 15:13:59 0 [Note] WSREP: STATE EXCHANGE: got state msg: 015101ab-ffb5-11ed-92b0-8b7251ea1435 from 1 (ovh5.1check.com)
2023-05-31 15:13:59 0 [Note] WSREP: Quorum results:
2023-05-31 15:13:59 0 [Note] WSREP: Flow-control interval: [28, 28]
2023-05-31 15:13:59 6 [Note] WSREP: ####### processing CC 149901143, local, ordered
2023-05-31 15:13:59 6 [Note] WSREP: ####### My UUID: 2a10acf7-f894-11ed-b597-b2733ba43458
2023-05-31 15:13:59 6 [Note] WSREP: Skipping cert index reset
2023-05-31 15:13:59 6 [Note] WSREP: REPL Protocols: 10 (5)
2023-05-31 15:13:59 6 [Note] WSREP: ####### Adjusting cert position: 149901142 -> 149901143
2023-05-31 15:13:59 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:13:59 6 [Note] WSREP: ================================================
2023-05-31 15:13:59 6 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:13:59 6 [Note] WSREP: Lowest cert index boundary for CC from group: 149901047
2023-05-31 15:13:59 6 [Note] WSREP: Min available from gcache for CC from group: 149900591
2023-05-31 15:13:59 0 [Note] WSREP: Member 0.0 (ovh4.1check.com) requested state transfer from '*any*'. Selected 2.0 (ovh3.1check.com)(SYNCED) as donor.
2023-05-31 15:13:59 0 [Note] WSREP: 2.0 (ovh3.1check.com): State transfer to 0.0 (ovh4.1check.com) complete.
2023-05-31 15:13:59 0 [Note] WSREP: Member 2.0 (ovh3.1check.com) synced with group.
2023-05-31 15:14:01 0 [Note] WSREP: 0.0 (ovh4.1check.com): State transfer from 2.0 (ovh3.1check.com) complete.
2023-05-31 15:14:01 0 [Note] WSREP: Member 0.0 (ovh4.1check.com) synced with group.
2023-05-31 15:14:02 0 [Note] WSREP: (2a10acf7-b597, 'tcp://0.0.0.0:4567') turning message relay requesting off
2023-05-31 15:14:29 530113 [Note] Slave I/O thread: Start asynchronous replication to master 'mdb_control@ovh7.vlan:3306' in log 'mysql-bin.054856' at position 675285287
2023-05-31 15:14:29 530114 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.054856' at position 675285287, relay log './mysqld-relay-bin.035956' position: 675285586
2023-05-31 15:14:29 530113 [Note] Slave I/O thread: connected to master 'mdb_control@ovh7.vlan:3306',replication started in log 'mysql-bin.054856' at position 675285287
2023-05-31 15:14:46 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054857, end_log_pos 528362154, Gtid 0-2-647051573, Internal MariaDB error code: 1062
2023-05-31 15:14:46 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions'
2023-05-31 15:14:46 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032
2023-05-31 15:14:46 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_
NOT_FOUND; the event's master log mysql-bin.054857, end_log_pos 530069995, Gtid 0-2-647051585, Internal MariaDB error code: 1032
2023-05-31 15:15:08 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054858, end_log_pos 640262071, Gtid 0-2-647059201, Internal MariaDB error code: 1062
2023-05-31 15:15:08 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions'
2023-05-31 15:15:08 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032
2023-05-31 15:15:08 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_
NOT_FOUND; the event's master log mysql-bin.054858, end_log_pos 641129381, Gtid 0-2-647059208, Internal MariaDB error code: 1032
2023-05-31 15:15:12 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054858, end_log_pos 824520162, Gtid 0-2-647060375, Internal MariaDB error code: 1062
2023-05-31 15:15:12 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions'
2023-05-31 15:15:12 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032
2023-05-31 15:15:12 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_
NOT_FOUND; the event's master log mysql-bin.054858, end_log_pos 824547795, Gtid 0-2-647060379, Internal MariaDB error code: 1032
2023-05-31 15:15:17 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054859, end_log_pos 20649570, Gtid 0-2-647061814, Internal MariaDB error code: 1062
2023-05-31 15:15:17 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions'
2023-05-31 15:15:17 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032
2023-05-31 15:15:17 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_
NOT_FOUND; the event's master log mysql-bin.054859, end_log_pos 24415526, Gtid 0-2-647061824, Internal MariaDB error code: 1032
2023-05-31 15:15:23 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054859, end_log_pos 340624428, Gtid 0-2-647064414, Internal MariaDB error code: 1062
2023-05-31 15:15:23 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions'
2023-05-31 15:15:23 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032
2023-05-31 15:15:23 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_
NOT_FOUND; the event's master log mysql-bin.054859, end_log_pos 341076249, Gtid 0-2-647064421, Internal MariaDB error code: 1032
2023-05-31 15:16:19 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054860, end_log_pos 175089420, Gtid 0-2-647070286, Internal MariaDB error code: 1062
2023-05-31 15:16:19 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions'
2023-05-31 15:16:19 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032
2023-05-31 15:16:19 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_
NOT_FOUND; the event's master log mysql-bin.054860, end_log_pos 175547311, Gtid 0-2-647070292, Internal MariaDB error code: 1032
2023-05-31 15:16:33 530650 [Warning] Access denied for user 'root'@'localhost'
2023-05-31 15:16:33 530651 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: NO)
2023-05-31 15:16:46 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054860, end_log_pos 431957362, Gtid 0-2-647071445, Internal MariaDB error code: 1062
2023-05-31 15:16:46 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions'
2023-05-31 15:16:46 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032
2023-05-31 15:16:46 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_
NOT_FOUND; the event's master log mysql-bin.054860, end_log_pos 432702272, Gtid 0-2-647071456, Internal MariaDB error code: 1032
2023-05-31 15:20:23 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054862, end_log_pos 230852740, Gtid 0-2-647086708, Internal MariaDB error code: 1062
2023-05-31 15:20:23 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions'
2023-05-31 15:20:23 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032
2023-05-31 15:20:23 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_
NOT_FOUND; the event's master log mysql-bin.054862, end_log_pos 231691885, Gtid 0-2-647086716, Internal MariaDB error code: 1032
2023-05-31 15:20:51 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054862, end_log_pos 477392005, Gtid 0-2-647088020, Internal MariaDB error code: 1062
2023-05-31 15:20:51 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions'
2023-05-31 15:20:51 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032
2023-05-31 15:20:51 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_
NOT_FOUND; the event's master log mysql-bin.054862, end_log_pos 478002798, Gtid 0-2-647088028, Internal MariaDB error code: 1032
2023-05-31 15:21:22 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054862, end_log_pos 701364595, Gtid 0-2-647089892, Internal MariaDB error code: 1062
2023-05-31 15:21:22 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions'
2023-05-31 15:21:22 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032
2023-05-31 15:21:22 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_
NOT_FOUND; the event's master log mysql-bin.054862, end_log_pos 701417499, Gtid 0-2-647089899, Internal MariaDB error code: 1032
2023-05-31 15:24:15 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054863, end_log_pos 1069037395, Gtid 0-2-647098774, Internal MariaDB error code: 1062
2023-05-31 15:24:15 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions'
2023-05-31 15:24:15 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032
2023-05-31 15:24:15 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_
NOT_FOUND; the event's master log mysql-bin.054863, end_log_pos 1071375944, Gtid 0-2-647098783, Internal MariaDB error code: 1032
2023-05-31 15:24:25 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054864, end_log_pos 85774488, Gtid 0-2-647099211, Internal MariaDB error code: 1062
2023-05-31 15:24:25 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions'
2023-05-31 15:24:25 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032
2023-05-31 15:24:25 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_
NOT_FOUND; the event's master log mysql-bin.054864, end_log_pos 85802122, Gtid 0-2-647099215, Internal MariaDB error code: 1032
2023-05-31 15:25:06 0 [Note] /usr/sbin/mariadbd (initiated by: unknown): Normal shutdown
2023-05-31 15:25:06 0 [Note] WSREP: Shutdown replication
2023-05-31 15:25:06 0 [Note] WSREP: Server status change synced -> disconnecting
2023-05-31 15:25:06 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:06 0 [Note] WSREP: Closing send monitor...
2023-05-31 15:25:06 0 [Note] WSREP: Closed send monitor.
2023-05-31 15:25:06 0 [Note] WSREP: gcomm: terminating thread
2023-05-31 15:25:06 0 [Note] WSREP: gcomm: joining thread
2023-05-31 15:25:06 0 [Note] WSREP: gcomm: closing backend
2023-05-31 15:25:06 0 [Note] WSREP: view(view_id(NON_PRIM,01049457-8651,9) memb {
2023-05-31 15:25:06 0 [Note] WSREP: PC protocol downgrade 1 -> 0
2023-05-31 15:25:06 0 [Note] WSREP: view((empty))
2023-05-31 15:25:06 0 [Note] WSREP: gcomm: closed
2023-05-31 15:25:06 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
2023-05-31 15:25:06 0 [Note] WSREP: Flow-control interval: [16, 16]
2023-05-31 15:25:06 0 [Note] WSREP: Received NON-PRIMARY.
2023-05-31 15:25:06 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 149956352)
2023-05-31 15:25:06 0 [Note] WSREP: New SELF-LEAVE.
2023-05-31 15:25:06 0 [Note] WSREP: Flow-control interval: [0, 0]
2023-05-31 15:25:06 0 [Note] WSREP: Received SELF-LEAVE. Closing connection.
2023-05-31 15:25:06 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 149956352)
2023-05-31 15:25:06 0 [Note] WSREP: RECV thread exiting 0: Success
2023-05-31 15:25:06 11 [Note] WSREP: ================================================
2023-05-31 15:25:06 11 [Note] WSREP: Non-primary view
2023-05-31 15:25:06 11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:06 0 [Note] WSREP: recv_thread() joined.
2023-05-31 15:25:06 0 [Note] WSREP: Closing replication queue.
2023-05-31 15:25:06 0 [Note] WSREP: Closing slave action queue.
2023-05-31 15:25:06 11 [Note] WSREP: ================================================
2023-05-31 15:25:06 11 [Note] WSREP: Non-primary view
2023-05-31 15:25:06 11 [Note] WSREP: Server status change disconnecting -> disconnected
2023-05-31 15:25:06 11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:06 11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:06 11 [Note] WSREP: Applier thread exiting ret: 0 thd: 11
2023-05-31 15:25:06 11 [Warning] Aborted connection 11 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
2023-05-31 15:25:06 530114 [ERROR] Slave SQL: Node has dropped from cluster, Gtid 0-2-647101509, Internal MariaDB error code: 1047
2023-05-31 15:25:06 530114 [Note] Slave SQL thread exiting, replication stopped in log 'mysql-bin.054864' at position 447263261, master: ovh7.vlan:3306
2023-05-31 15:25:06 12 [Note] WSREP: Applier thread exiting ret: 6 thd: 12
2023-05-31 15:25:06 10 [Note] WSREP: Applier thread exiting ret: 6 thd: 10
2023-05-31 15:25:06 6 [Note] WSREP: Applier thread exiting ret: 6 thd: 6
2023-05-31 15:25:06 10 [Warning] Aborted connection 10 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
2023-05-31 15:25:06 12 [Warning] Aborted connection 12 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
2023-05-31 15:25:06 15 [Note] WSREP: Applier thread exiting ret: 6 thd: 15
2023-05-31 15:25:06 7 [Note] WSREP: Applier thread exiting ret: 6 thd: 7
2023-05-31 15:25:06 15 [Warning] Aborted connection 15 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
2023-05-31 15:25:06 7 [Warning] Aborted connection 7 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
2023-05-31 15:25:06 2 [Note] WSREP: Applier thread exiting ret: 6 thd: 2
2023-05-31 15:25:06 2 [Warning] Aborted connection 2 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
2023-05-31 15:25:06 9 [Note] WSREP: Applier thread exiting ret: 6 thd: 9
2023-05-31 15:25:06 9 [Warning] Aborted connection 9 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
2023-05-31 15:25:06 14 [Note] WSREP: Applier thread exiting ret: 6 thd: 14
2023-05-31 15:25:06 13 [Note] WSREP: Applier thread exiting ret: 6 thd: 13
2023-05-31 15:25:06 14 [Warning] Aborted connection 14 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
2023-05-31 15:25:06 13 [Warning] Aborted connection 13 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
2023-05-31 15:25:06 8 [Note] WSREP: Applier thread exiting ret: 6 thd: 8
2023-05-31 15:25:06 8 [Warning] Aborted connection 8 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
2023-05-31 15:25:06 17 [Note] WSREP: Applier thread exiting ret: 6 thd: 17
2023-05-31 15:25:06 6 [Warning] Aborted connection 6 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
2023-05-31 15:25:06 17 [Warning] Aborted connection 17 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
2023-05-31 15:25:07 1 [Note] WSREP: rollbacker thread exiting 1
2023-05-31 15:25:07 1 [Warning] Aborted connection 1 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication)
2023-05-31 15:25:07 530113 [Note] Slave I/O thread exiting, read up to log 'mysql-bin.054864', position 452844281, master ovh7.vlan:3306
2023-05-31 15:25:07 0 [Note] WSREP: dtor state: CLOSED
2023-05-31 15:25:07 0 [Note] WSREP: MemPool(TrxHandleSlave): hit ratio: 0.99996, misses: 1159, in use: 87, in pool: 1072
2023-05-31 15:25:07 0 [Note] WSREP: mon: entered 29086868 oooe fraction 0 oool fraction 0
2023-05-31 15:25:07 0 [Note] WSREP: mon: entered 29086868 oooe fraction 6.18836e-07 oool fraction 2.06279e-07
2023-05-31 15:25:07 0 [Note] WSREP: mon: entered 29746698 oooe fraction 0 oool fraction 0
2023-05-31 15:25:07 0 [Note] WSREP: cert index usage at exit 158
2023-05-31 15:25:07 0 [Note] WSREP: cert trx map usage at exit 87
2023-05-31 15:25:07 0 [Note] WSREP: deps set usage at exit 0
2023-05-31 15:25:07 0 [Note] WSREP: avg deps dist 67.436
2023-05-31 15:25:07 0 [Note] WSREP: avg cert interval 2.78476e-06
2023-05-31 15:25:07 0 [Note] WSREP: cert index size 158
2023-05-31 15:25:07 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:07 0 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0
2023-05-31 15:25:07 0 [Note] WSREP: MemPool(LocalTrxHandle): hit ratio: 1, misses: 2, in use: 0, in pool: 2
2023-05-31 15:25:07 0 [Note] WSREP: Flushing memory map to disk...
2023-05-31 15:25:07 0 [Note] InnoDB: FTS optimize thread exiting.
2023-05-31 15:25:07 0 [Note] InnoDB: Starting shutdown...
2023-05-31 15:25:07 0 [Note] InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool
2023-05-31 15:25:07 0 [Note] InnoDB: Restricted to 1297920 pages due to innodb_buf_pool_dump_pct=25
2023-05-31 15:25:08 0 [Note] InnoDB: Buffer pool(s) dump completed at 230531 15:25:08
2023-05-31 15:25:10 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1"
2023-05-31 15:25:10 0 [Note] InnoDB: Shutdown completed; log sequence number 27984233108946; transaction id 4332371053
2023-05-31 15:25:10 0 [Note] /usr/sbin/mariadbd: Shutdown complete
2023-05-31 15:25:12 0 [Note] Starting MariaDB 10.6.13-MariaDB-1:10.6.13+maria~ubu2204-log source revision a24f2bb50ba4a0dd4127455f7fcdfed584937f36 as process 1265409
2023-05-31 15:25:12 0 [Note] WSREP: Loading provider /usr/lib/galera/libgalera_smm.so initial position: 66eb3498-d920-11ed-892c-0669747ecf70:149956352
2023-05-31 15:25:12 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so'
2023-05-31 15:25:12 0 [Note] WSREP: wsrep_load(): Galera 26.4.14(r06a0c285) by Codership Oy <info@codership.com> loaded successfully.
2023-05-31 15:25:12 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration.
2023-05-31 15:25:12 0 [Note] WSREP: Found saved state: 66eb3498-d920-11ed-892c-0669747ecf70:149956352, safe_to_bootstrap: 0
2023-05-31 15:25:12 0 [Note] WSREP: GCache DEBUG: opened preamble:
2023-05-31 15:25:12 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 66eb3498-d920-11ed-892c-0669747ecf70, offset: 81647992
2023-05-31 15:25:12 0 [Note] WSREP: GCache::RingBuffer initial scan...  0.0% (        0/134217752 bytes) complete.
2023-05-31 15:25:12 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (134217752/134217752 bytes) complete.
2023-05-31 15:25:12 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 149955355-149956352
2023-05-31 15:25:12 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...  0.0% (        0/133563232 bytes) complete.
2023-05-31 15:25:12 0 [Note] WSREP: Recovering GCache ring buffer: found 0/998 locked buffers
2023-05-31 15:25:12 0 [Note] WSREP: Recovering GCache ring buffer: free space: 654496/134217728
2023-05-31 15:25:12 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (133563232/133563232 bytes) complete.
2023-05-31 15:25:12 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 192.168.0.5; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0;
 evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.
stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.keep_plaintext_size = 128M; gcac
he.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave
= no; gcs.fc_single_primary = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0;
2023-05-31 15:25:12 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:12 0 [Note] WSREP: ####### Assign initial position for certification: 66eb3498-d920-11ed-892c-0669747ecf70:149956352, protocol version: -1
2023-05-31 15:25:12 0 [Note] WSREP: Start replication
2023-05-31 15:25:12 0 [Note] WSREP: Connecting with bootstrap option: 0
2023-05-31 15:25:12 0 [Note] WSREP: Setting GCS initial position to 66eb3498-d920-11ed-892c-0669747ecf70:149956352
2023-05-31 15:25:12 0 [Note] WSREP: Using CRC-32C for message checksums.
2023-05-31 15:25:12 0 [Note] WSREP: backend: asio
2023-05-31 15:25:12 0 [Note] WSREP: gcomm thread scheduling priority set to other:0
2023-05-31 15:25:12 0 [Note] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory)
2023-05-31 15:25:12 0 [Note] WSREP: restore pc from disk failed
2023-05-31 15:25:12 0 [Note] WSREP: GMCast version 0
2023-05-31 15:25:12 0 [Note] WSREP: (926ef5ee-a06b, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
2023-05-31 15:25:12 0 [Note] WSREP: (926ef5ee-a06b, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
2023-05-31 15:25:12 0 [Note] WSREP: EVS version 1
2023-05-31 15:25:12 0 [Note] WSREP: gcomm: connecting to group 'MariaDB Galera Cluster', peer '192.168.0.3:,192.168.0.4:,192.168.0.5:'
2023-05-31 15:25:12 0 [Note] WSREP: (926ef5ee-a06b, 'tcp://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address tcp://192.168.0.5:4567
2023-05-31 15:25:12 0 [Note] WSREP: (926ef5ee-a06b, 'tcp://0.0.0.0:4567') connection established to f4eb5d26-bd95 tcp://192.168.0.3:4567
2023-05-31 15:25:12 0 [Note] WSREP: (926ef5ee-a06b, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2023-05-31 15:25:12 0 [Note] WSREP: (926ef5ee-a06b, 'tcp://0.0.0.0:4567') connection established to 01049457-8651 tcp://192.168.0.4:4567
2023-05-31 15:25:12 0 [Note] WSREP: EVS version upgrade 0 -> 1
2023-05-31 15:25:12 0 [Note] WSREP: declaring 01049457-8651 at tcp://192.168.0.4:4567 stable
2023-05-31 15:25:12 0 [Note] WSREP: declaring f4eb5d26-bd95 at tcp://192.168.0.3:4567 stable
2023-05-31 15:25:12 0 [Note] WSREP: PC protocol upgrade 0 -> 1
2023-05-31 15:25:12 0 [Note] WSREP: Node 01049457-8651 state prim
2023-05-31 15:25:12 0 [Note] WSREP: view(view_id(PRIM,01049457-8651,11) memb {
2023-05-31 15:25:12 0 [Note] WSREP: save pc into disk
2023-05-31 15:25:13 0 [Note] WSREP: gcomm: connected
2023-05-31 15:25:13 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
2023-05-31 15:25:13 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
2023-05-31 15:25:13 0 [Note] WSREP: Opened channel 'MariaDB Galera Cluster'
2023-05-31 15:25:13 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3
2023-05-31 15:25:13 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2023-05-31 15:25:13 1 [Note] WSREP: Starting rollbacker thread 1
2023-05-31 15:25:13 2 [Note] WSREP: Starting applier thread 2
2023-05-31 15:25:13 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 92bbbc43-ffb6-11ed-a9f5-e7fcd572ca28
2023-05-31 15:25:13 0 [Note] WSREP: STATE EXCHANGE: got state msg: 92bbbc43-ffb6-11ed-a9f5-e7fcd572ca28 from 0 (ovh4.1check.com)
2023-05-31 15:25:13 0 [Note] WSREP: STATE EXCHANGE: got state msg: 92bbbc43-ffb6-11ed-a9f5-e7fcd572ca28 from 2 (ovh3.1check.com)
2023-05-31 15:25:13 0 [Note] WSREP: STATE EXCHANGE: got state msg: 92bbbc43-ffb6-11ed-a9f5-e7fcd572ca28 from 1 (ovh5.1check.com)
2023-05-31 15:25:13 0 [Note] WSREP: Quorum results:
2023-05-31 15:25:13 0 [Note] WSREP: Flow-control interval: [28, 28]
2023-05-31 15:25:13 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 149956354)
2023-05-31 15:25:13 2 [Note] WSREP: ####### processing CC 149956354, local, ordered
2023-05-31 15:25:13 2 [Note] WSREP: Process first view: 66eb3498-d920-11ed-892c-0669747ecf70 my uuid: 926ef5ee-ffb6-11ed-a06b-7e62ca0df787
2023-05-31 15:25:13 2 [Note] WSREP: Server ovh5.1check.com connected to cluster at position 66eb3498-d920-11ed-892c-0669747ecf70:149956354 with ID 926ef5ee-ffb6-11ed-a06b-7e62ca0df787
2023-05-31 15:25:13 2 [Note] WSREP: Server status change disconnected -> connected
2023-05-31 15:25:13 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:13 2 [Note] WSREP: ####### My UUID: 926ef5ee-ffb6-11ed-a06b-7e62ca0df787
2023-05-31 15:25:13 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes
2023-05-31 15:25:13 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:13 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1
2023-05-31 15:25:13 2 [Note] WSREP: State transfer required:
2023-05-31 15:25:13 2 [Note] WSREP: Server status change connected -> joiner
2023-05-31 15:25:13 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:13 0 [Note] WSREP: Joiner monitor thread started to monitor
2023-05-31 15:25:13 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '192.168.0.5' --datadir '/var/lib/mysql/' --parent 1265409 --progress 0 --binlog '/var/lib/mysql/mysql-bin' --binlog-i
ndex '/var/lib/mysql/mysql-bin.index' --mysqld-args --wsrep_start_position=66eb3498-d920-11ed-892c-0669747ecf70:149956352,300-1-5681'
2023-05-31 15:25:14 2 [Note] WSREP: ####### IST uuid:66eb3498-d920-11ed-892c-0669747ecf70 f: 149956353, l: 149956354, STRv: 3
2023-05-31 15:25:14 2 [Note] WSREP: IST receiver addr using tcp://192.168.0.5:4568
2023-05-31 15:25:14 2 [Note] WSREP: Prepared IST receiver for 149956353-149956354, listening at: tcp://192.168.0.5:4568
2023-05-31 15:25:14 0 [Note] WSREP: Member 1.0 (ovh5.1check.com) requested state transfer from '*any*'. Selected 2.0 (ovh3.1check.com)(SYNCED) as donor.
2023-05-31 15:25:14 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 149956354)
2023-05-31 15:25:14 2 [Note] WSREP: Requesting state transfer: success, donor: 2
2023-05-31 15:25:14 0 [Note] WSREP: 2.0 (ovh3.1check.com): State transfer to 1.0 (ovh5.1check.com) complete.
2023-05-31 15:25:14 0 [Note] WSREP: Member 2.0 (ovh3.1check.com) synced with group.
2023-05-31 15:25:14 3 [Note] WSREP: SST received
2023-05-31 15:25:14 3 [Note] WSREP: Server status change joiner -> initializing
2023-05-31 15:25:14 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:14 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2023-05-31 15:25:14 0 [Note] InnoDB: Number of pools: 1
2023-05-31 15:25:14 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
2023-05-31 15:25:14 0 [Note] InnoDB: Initializing buffer pool, total size = 85899345920, chunk size = 134217728
2023-05-31 15:25:14 0 [Note] InnoDB: Completed initialization of buffer pool
2023-05-31 15:25:14 0 [Note] InnoDB: 128 rollback segments are active.
2023-05-31 15:25:15 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2023-05-31 15:25:15 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2023-05-31 15:25:15 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2023-05-31 15:25:15 0 [Note] InnoDB: 10.6.13 started; log sequence number 27984233111451; transaction id 4332371060
2023-05-31 15:25:15 0 [Note] Plugin 'FEEDBACK' is disabled.
2023-05-31 15:25:15 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2023-05-31 15:25:15 0 [Warning] 'innodb-adaptive-max-sleep-delay' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:15 0 [Warning] 'innodb-background-scrub-data-check-interval' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:15 0 [Warning] 'innodb-background-scrub-data-interval' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:15 0 [Warning] 'innodb-buffer-pool-instances' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:15 0 [Warning] 'innodb-concurrency-tickets' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:15 0 [Warning] 'innodb-buffer-pool-instances' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:15 0 [Note] Server socket created on IP: '0.0.0.0'.
2023-05-31 15:25:15 0 [Warning] 'proxies_priv' entry '@% root@ovh2.1check.com' ignored in --skip-name-resolve mode.
2023-05-31 15:25:15 0 [Note] WSREP: wsrep_init_schema_and_SR (nil)
2023-05-31 15:25:15 0 [Note] WSREP: Server initialized
2023-05-31 15:25:15 0 [Note] WSREP: Server status change initializing -> initialized
2023-05-31 15:25:15 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:15 3 [Note] WSREP: Recovered position from storage: 66eb3498-d920-11ed-892c-0669747ecf70:149956352
2023-05-31 15:25:15 10 [Note] WSREP: Starting applier thread 10
2023-05-31 15:25:15 11 [Note] WSREP: Starting applier thread 11
2023-05-31 15:25:15 8 [Note] WSREP: Starting applier thread 8
2023-05-31 15:25:15 14 [Note] WSREP: Starting applier thread 14
2023-05-31 15:25:15 6 [Note] WSREP: Starting applier thread 6
2023-05-31 15:25:15 7 [Note] WSREP: Starting applier thread 7
2023-05-31 15:25:15 15 [Note] WSREP: Starting applier thread 15
2023-05-31 15:25:15 9 [Note] WSREP: Starting applier thread 9
2023-05-31 15:25:15 12 [Note] WSREP: Starting applier thread 12
2023-05-31 15:25:15 13 [Note] WSREP: Starting applier thread 13
2023-05-31 15:25:15 17 [Note] WSREP: Starting applier thread 17
2023-05-31 15:25:15 0 [Warning] Neither --relay-log nor --relay-log-index were used; so replication may break when this MariaDB server acts as a replica and has its hostname changed. Please use '--log-basename=#'
 or '--relay-log=mysqld-relay-bin' to avoid this problem.
2023-05-31 15:25:15 20 [Note] Slave I/O thread: Start asynchronous replication to master 'mdb_control@ovh7.vlan:3306' in log 'mysql-bin.054864' at position 452844281
2023-05-31 15:25:15 0 [Note] /usr/sbin/mariadbd: ready for connections.
2023-05-31 15:25:15 21 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.054864' at position 447263261, relay log './mysqld-relay-bin.035980' position: 447263560
2023-05-31 15:25:15 3 [Note] WSREP: Recovered view from SST:
2023-05-31 15:25:15 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:15 22 [Note] WSREP: Recovered cluster id 66eb3498-d920-11ed-892c-0669747ecf70
2023-05-31 15:25:15 3 [Note] WSREP: SST received: 66eb3498-d920-11ed-892c-0669747ecf70:149956352
2023-05-31 15:25:15 3 [Note] WSREP: SST succeeded for position 66eb3498-d920-11ed-892c-0669747ecf70:149956352
2023-05-31 15:25:15 0 [Note] WSREP: Joiner monitor thread ended with total time 2 sec
2023-05-31 15:25:15 2 [Note] WSREP: Installed new state from SST: 66eb3498-d920-11ed-892c-0669747ecf70:149956352
2023-05-31 15:25:15 2 [Note] WSREP: Receiving IST: 2 writesets, seqnos 149956353-149956354
2023-05-31 15:25:15 0 [Note] WSREP: ####### IST applying starts with 149956353
2023-05-31 15:25:15 0 [Note] WSREP: ####### IST current seqno initialized to 149956266
2023-05-31 15:25:15 0 [Note] WSREP: Receiving IST...  0.0% ( 0/89 events) complete.
2023-05-31 15:25:15 0 [Note] WSREP: IST preload starting at 149956266
2023-05-31 15:25:15 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:15 0 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:149956265, protocol version: 5
2023-05-31 15:25:15 21 [ERROR] WSREP: Unknown writeset version: -1
2023-05-31 15:25:15 20 [Note] Slave I/O thread: connected to master 'mdb_control@ovh7.vlan:3306',replication started in log 'mysql-bin.054864' at position 452844281
2023-05-31 15:25:15 0 [Note] WSREP: REPL Protocols: 10 (5)
2023-05-31 15:25:15 0 [Note] WSREP: ####### Adjusting cert position: 149956352 -> 149956353
2023-05-31 15:25:15 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:15 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 149956266
2023-05-31 15:25:15 0 [Note] WSREP: Min available from gcache for CC from ist: 149955355
2023-05-31 15:25:15 10 [Note] WSREP: ================================================
2023-05-31 15:25:15 10 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:15 0 [Note] WSREP: REPL Protocols: 10 (5)
2023-05-31 15:25:15 0 [Note] WSREP: ####### Adjusting cert position: 149956353 -> 149956354
2023-05-31 15:25:15 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:15 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 149956266
2023-05-31 15:25:15 0 [Note] WSREP: Min available from gcache for CC from ist: 149955355
2023-05-31 15:25:15 0 [Note] WSREP: Receiving IST...100.0% (89/89 events) complete.
2023-05-31 15:25:15 11 [Note] WSREP: ================================================
2023-05-31 15:25:15 11 [Note] WSREP: Server status change initialized -> joined
2023-05-31 15:25:15 11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:15 11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:15 2 [Note] WSREP: Draining apply monitors after IST up to 149956354
2023-05-31 15:25:15 2 [Note] WSREP: IST received: 66eb3498-d920-11ed-892c-0669747ecf70:149956354
2023-05-31 15:25:15 2 [Note] WSREP: Lowest cert index boundary for CC from sst: 149956266
2023-05-31 15:25:15 2 [Note] WSREP: Min available from gcache for CC from sst: 149955355
2023-05-31 15:25:15 0 [Note] WSREP: 1.0 (ovh5.1check.com): State transfer from 2.0 (ovh3.1check.com) complete.
2023-05-31 15:25:15 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 149956354)
2023-05-31 15:25:15 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete.
2023-05-31 15:25:15 0 [Note] WSREP: Member 1.0 (ovh5.1check.com) synced with group.
2023-05-31 15:25:15 0 [Note] WSREP: Processing event queue:...100.0% (1/1 events) complete.
2023-05-31 15:25:15 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 149956354)
2023-05-31 15:25:15 2 [Note] WSREP: Server ovh5.1check.com synced with group
2023-05-31 15:25:15 2 [Note] WSREP: Server status change joined -> synced
2023-05-31 15:25:15 2 [Note] WSREP: Synchronized with group, ready for connections
2023-05-31 15:25:15 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:15 0 [Note] WSREP: (926ef5ee-a06b, 'tcp://0.0.0.0:4567') turning message relay requesting off
2023-05-31 15:25:38 0 [Note] Starting MariaDB 10.6.13-MariaDB-1:10.6.13+maria~ubu2204-log source revision a24f2bb50ba4a0dd4127455f7fcdfed584937f36 as process 1266704
2023-05-31 15:25:38 0 [Note] WSREP: Loading provider /usr/lib/galera/libgalera_smm.so initial position: 66eb3498-d920-11ed-892c-0669747ecf70:149956354
2023-05-31 15:25:38 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so'
2023-05-31 15:25:38 0 [Note] WSREP: wsrep_load(): Galera 26.4.14(r06a0c285) by Codership Oy <info@codership.com> loaded successfully.
2023-05-31 15:25:38 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration.
2023-05-31 15:25:38 0 [Note] WSREP: Found saved state: 66eb3498-d920-11ed-892c-0669747ecf70:-1, safe_to_bootstrap: 0
2023-05-31 15:25:38 0 [Note] WSREP: GCache DEBUG: opened preamble:
2023-05-31 15:25:38 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 66eb3498-d920-11ed-892c-0669747ecf70, offset: -1
2023-05-31 15:25:38 0 [Note] WSREP: GCache::RingBuffer initial scan...  0.0% (        0/134217752 bytes) complete.
2023-05-31 15:25:38 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (134217752/134217752 bytes) complete.
2023-05-31 15:25:38 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 149955355-149956354
2023-05-31 15:25:38 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...  0.0% (        0/133564336 bytes) complete.
2023-05-31 15:25:38 0 [Note] WSREP: Recovering GCache ring buffer: found 2/1002 locked buffers
2023-05-31 15:25:38 0 [Note] WSREP: Recovering GCache ring buffer: free space: 653912/134217728
2023-05-31 15:25:38 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (133564336/133564336 bytes) complete.
2023-05-31 15:25:38 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 192.168.0.5; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0;
 evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.
stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.keep_plaintext_size = 128M; gcac
he.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave
= no; gcs.fc_single_primary = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0;
2023-05-31 15:25:38 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:38 0 [Note] WSREP: ####### Assign initial position for certification: 66eb3498-d920-11ed-892c-0669747ecf70:149956354, protocol version: -1
2023-05-31 15:25:38 0 [Note] WSREP: Start replication
2023-05-31 15:25:38 0 [Note] WSREP: Connecting with bootstrap option: 0
2023-05-31 15:25:38 0 [Note] WSREP: Setting GCS initial position to 66eb3498-d920-11ed-892c-0669747ecf70:149956354
2023-05-31 15:25:38 0 [Note] WSREP: Using CRC-32C for message checksums.
2023-05-31 15:25:38 0 [Note] WSREP: backend: asio
2023-05-31 15:25:38 0 [Note] WSREP: gcomm thread scheduling priority set to other:0
2023-05-31 15:25:38 0 [Note] WSREP: restore pc from disk successfully
2023-05-31 15:25:38 0 [Note] WSREP: GMCast version 0
2023-05-31 15:25:38 0 [Note] WSREP: (926ef5ee-a06c, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
2023-05-31 15:25:38 0 [Note] WSREP: (926ef5ee-a06c, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
2023-05-31 15:25:38 0 [Note] WSREP: EVS version 1
2023-05-31 15:25:38 0 [Note] WSREP: gcomm: connecting to group 'MariaDB Galera Cluster', peer '192.168.0.3:,192.168.0.4:,192.168.0.5:'
2023-05-31 15:25:38 0 [Note] WSREP: (926ef5ee-a06c, 'tcp://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address tcp://192.168.0.5:4567
2023-05-31 15:25:38 0 [Note] WSREP: (926ef5ee-a06c, 'tcp://0.0.0.0:4567') connection established to f4eb5d26-bd95 tcp://192.168.0.3:4567
2023-05-31 15:25:38 0 [Note] WSREP: (926ef5ee-a06c, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2023-05-31 15:25:38 0 [Note] WSREP: (926ef5ee-a06c, 'tcp://0.0.0.0:4567') connection established to 01049457-8651 tcp://192.168.0.4:4567
2023-05-31 15:25:39 0 [Note] WSREP: gcomm: connected
2023-05-31 15:25:39 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
2023-05-31 15:25:39 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
2023-05-31 15:25:39 0 [Note] WSREP: Opened channel 'MariaDB Galera Cluster'
2023-05-31 15:25:39 1 [Note] WSREP: Starting rollbacker thread 1
2023-05-31 15:25:39 2 [Note] WSREP: Starting applier thread 2
2023-05-31 15:25:39 0 [Note] WSREP: EVS version upgrade 0 -> 1
2023-05-31 15:25:39 0 [Note] WSREP: declaring 01049457-8651 at tcp://192.168.0.4:4567 stable
2023-05-31 15:25:39 0 [Note] WSREP: declaring f4eb5d26-bd95 at tcp://192.168.0.3:4567 stable
2023-05-31 15:25:39 0 [Note] WSREP: PC protocol upgrade 0 -> 1
2023-05-31 15:25:39 0 [Note] WSREP: Node 01049457-8651 state prim
2023-05-31 15:25:39 0 [Note] WSREP: view(view_id(PRIM,01049457-8651,13) memb {
2023-05-31 15:25:39 0 [Note] WSREP: save pc into disk
2023-05-31 15:25:39 0 [Note] WSREP: clear restored view
2023-05-31 15:25:39 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a27d6d04-ffb6-11ed-b14e-4b8acb6c0e76
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: a27d6d04-ffb6-11ed-b14e-4b8acb6c0e76 from 0 (ovh4.1check.com)
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: a27d6d04-ffb6-11ed-b14e-4b8acb6c0e76 from 1 (ovh5.1check.com)
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: a27d6d04-ffb6-11ed-b14e-4b8acb6c0e76 from 2 (ovh3.1check.com)
2023-05-31 15:25:39 0 [Note] WSREP: Quorum results:
2023-05-31 15:25:39 0 [Note] WSREP: Flow-control interval: [28, 28]
2023-05-31 15:25:39 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 149956356)
2023-05-31 15:25:39 2 [Note] WSREP: ####### processing CC 149956356, local, ordered
2023-05-31 15:25:39 2 [Note] WSREP: Process first view: 66eb3498-d920-11ed-892c-0669747ecf70 my uuid: 926ef5ee-ffb6-11ed-a06c-7e62ca0df787
2023-05-31 15:25:39 2 [Note] WSREP: Server ovh5.1check.com connected to cluster at position 66eb3498-d920-11ed-892c-0669747ecf70:149956356 with ID 926ef5ee-ffb6-11ed-a06c-7e62ca0df787
2023-05-31 15:25:39 2 [Note] WSREP: Server status change disconnected -> connected
2023-05-31 15:25:39 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:39 2 [Note] WSREP: ####### My UUID: 926ef5ee-ffb6-11ed-a06c-7e62ca0df787
2023-05-31 15:25:39 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes
2023-05-31 15:25:39 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:39 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1
2023-05-31 15:25:39 2 [Note] WSREP: State transfer required:
2023-05-31 15:25:39 2 [Note] WSREP: Server status change connected -> joiner
2023-05-31 15:25:39 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:39 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '192.168.0.5' --datadir '/var/lib/mysql/' --parent 1266704 --progress 0 --binlog '/var/lib/mysql/mysql-bin' --binlog-i
ndex '/var/lib/mysql/mysql-bin.index' --mysqld-args --wsrep_start_position=66eb3498-d920-11ed-892c-0669747ecf70:149956354,300-1-5681'
2023-05-31 15:25:39 0 [Note] WSREP: Joiner monitor thread started to monitor
2023-05-31 15:25:39 0 [Note] WSREP: declaring f4eb5d26-bd95 at tcp://192.168.0.3:4567 stable
2023-05-31 15:25:39 0 [Note] WSREP: forgetting 01049457-8651 (tcp://192.168.0.4:4567)
2023-05-31 15:25:39 0 [Note] WSREP: Node 926ef5ee-a06c state prim
2023-05-31 15:25:39 0 [Note] WSREP: view(view_id(PRIM,926ef5ee-a06c,14) memb {
2023-05-31 15:25:39 0 [Note] WSREP: save pc into disk
2023-05-31 15:25:39 0 [Note] WSREP: forgetting 01049457-8651 (tcp://192.168.0.4:4567)
2023-05-31 15:25:39 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2
2023-05-31 15:25:39 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a2c26082-ffb6-11ed-b1d4-d74da8a0e12f
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a2c26082-ffb6-11ed-b1d4-d74da8a0e12f
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: a2c26082-ffb6-11ed-b1d4-d74da8a0e12f from 0 (ovh5.1check.com)
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: a2c26082-ffb6-11ed-b1d4-d74da8a0e12f from 1 (ovh3.1check.com)
2023-05-31 15:25:39 0 [Note] WSREP: Quorum results:
2023-05-31 15:25:39 0 [Note] WSREP: Flow-control interval: [23, 23]
2023-05-31 15:25:39 2 [Note] WSREP: ####### IST uuid:66eb3498-d920-11ed-892c-0669747ecf70 f: 149956355, l: 149956356, STRv: 3
2023-05-31 15:25:39 2 [Note] WSREP: IST receiver addr using tcp://192.168.0.5:4568
2023-05-31 15:25:39 2 [Note] WSREP: Prepared IST receiver for 149956355-149956356, listening at: tcp://192.168.0.5:4568
2023-05-31 15:25:39 0 [Note] WSREP: Member 0.0 (ovh5.1check.com) requested state transfer from '*any*'. Selected 1.0 (ovh3.1check.com)(SYNCED) as donor.
2023-05-31 15:25:39 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 149956357)
2023-05-31 15:25:39 2 [Note] WSREP: Requesting state transfer: success, donor: 1
2023-05-31 15:25:40 0 [Note] WSREP: 1.0 (ovh3.1check.com): State transfer to 0.0 (ovh5.1check.com) complete.
2023-05-31 15:25:40 0 [Note] WSREP: Member 1.0 (ovh3.1check.com) synced with group.
2023-05-31 15:25:40 3 [Note] WSREP: SST received
2023-05-31 15:25:40 3 [Note] WSREP: Server status change joiner -> initializing
2023-05-31 15:25:40 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:40 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2023-05-31 15:25:40 0 [Note] InnoDB: Number of pools: 1
2023-05-31 15:25:40 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
2023-05-31 15:25:40 0 [Note] InnoDB: Initializing buffer pool, total size = 85899345920, chunk size = 134217728
2023-05-31 15:25:40 0 [Note] InnoDB: Completed initialization of buffer pool
2023-05-31 15:25:40 0 [Note] InnoDB: 128 rollback segments are active.
2023-05-31 15:25:41 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2023-05-31 15:25:41 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2023-05-31 15:25:41 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2023-05-31 15:25:41 0 [Note] InnoDB: 10.6.13 started; log sequence number 27984233119487; transaction id 4332371087
2023-05-31 15:25:41 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2023-05-31 15:25:41 0 [Note] Plugin 'FEEDBACK' is disabled.
2023-05-31 15:25:41 0 [Warning] 'innodb-adaptive-max-sleep-delay' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:41 0 [Warning] 'innodb-background-scrub-data-check-interval' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:41 0 [Warning] 'innodb-background-scrub-data-interval' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:41 0 [Warning] 'innodb-buffer-pool-instances' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:41 0 [Warning] 'innodb-concurrency-tickets' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:41 0 [Warning] 'innodb-buffer-pool-instances' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:41 0 [Note] Server socket created on IP: '0.0.0.0'.
2023-05-31 15:25:41 0 [Warning] 'proxies_priv' entry '@% root@ovh2.1check.com' ignored in --skip-name-resolve mode.
2023-05-31 15:25:41 0 [Note] WSREP: wsrep_init_schema_and_SR (nil)
2023-05-31 15:25:41 0 [Note] WSREP: Server initialized
2023-05-31 15:25:41 0 [Note] WSREP: Server status change initializing -> initialized
2023-05-31 15:25:41 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:41 3 [Note] WSREP: Recovered position from storage: 66eb3498-d920-11ed-892c-0669747ecf70:149956354
2023-05-31 15:25:41 10 [Note] WSREP: Starting applier thread 10
2023-05-31 15:25:41 15 [Note] WSREP: Starting applier thread 15
2023-05-31 15:25:41 11 [Note] WSREP: Starting applier thread 11
2023-05-31 15:25:41 9 [Note] WSREP: Starting applier thread 9
2023-05-31 15:25:41 14 [Note] WSREP: Starting applier thread 14
2023-05-31 15:25:41 12 [Note] WSREP: Starting applier thread 12
2023-05-31 15:25:41 8 [Note] WSREP: Starting applier thread 8
2023-05-31 15:25:41 7 [Note] WSREP: Starting applier thread 7
2023-05-31 15:25:41 0 [Warning] Neither --relay-log nor --relay-log-index were used; so replication may break when this MariaDB server acts as a replica and has its hostname changed. Please use '--log-basename=#'
 or '--relay-log=mysqld-relay-bin' to avoid this problem.
2023-05-31 15:25:41 16 [Note] WSREP: Starting applier thread 16
2023-05-31 15:25:41 6 [Note] WSREP: Starting applier thread 6
2023-05-31 15:25:41 13 [Note] WSREP: Starting applier thread 13
2023-05-31 15:25:41 20 [Note] Slave I/O thread: Start asynchronous replication to master 'mdb_control@ovh7.vlan:3306' in log 'mysql-bin.054864' at position 565303427
2023-05-31 15:25:41 0 [Note] /usr/sbin/mariadbd: ready for connections.
2023-05-31 15:25:41 21 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.054864' at position 447263261, relay log './mysqld-relay-bin.035980' position: 447263560
2023-05-31 15:25:41 20 [Note] Slave I/O thread: connected to master 'mdb_control@ovh7.vlan:3306',replication started in log 'mysql-bin.054864' at position 565303427
2023-05-31 15:25:41 3 [Note] WSREP: Recovered view from SST:
2023-05-31 15:25:41 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:41 22 [Note] WSREP: Recovered cluster id 66eb3498-d920-11ed-892c-0669747ecf70
2023-05-31 15:25:41 21 [ERROR] WSREP: Unknown writeset version: -1
2023-05-31 15:25:41 3 [Note] WSREP: SST received: 66eb3498-d920-11ed-892c-0669747ecf70:149956354
2023-05-31 15:25:41 3 [Note] WSREP: SST succeeded for position 66eb3498-d920-11ed-892c-0669747ecf70:149956354
2023-05-31 15:25:41 0 [Note] WSREP: Joiner monitor thread ended with total time 2 sec
2023-05-31 15:25:41 2 [Note] WSREP: Installed new state from SST: 66eb3498-d920-11ed-892c-0669747ecf70:149956354
2023-05-31 15:25:41 2 [Note] WSREP: Receiving IST: 2 writesets, seqnos 149956355-149956356
2023-05-31 15:25:41 0 [Note] WSREP: ####### IST applying starts with 149956355
2023-05-31 15:25:41 0 [Note] WSREP: ####### IST current seqno initialized to 149956266
2023-05-31 15:25:41 0 [Note] WSREP: Receiving IST...  0.0% ( 0/91 events) complete.
2023-05-31 15:25:41 0 [Note] WSREP: IST preload starting at 149956266
2023-05-31 15:25:41 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:41 0 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:149956265, protocol version: 5
2023-05-31 15:25:41 0 [Note] WSREP: REPL Protocols: 10 (5)
2023-05-31 15:25:41 0 [Note] WSREP: ####### Adjusting cert position: 149956352 -> 149956353
2023-05-31 15:25:41 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:41 0 [Note] WSREP: Lowest cert index boundary for CC from preload: 149956266
2023-05-31 15:25:41 0 [Note] WSREP: Min available from gcache for CC from preload: 149955355
2023-05-31 15:25:41 0 [Note] WSREP: REPL Protocols: 10 (5)
2023-05-31 15:25:41 0 [Note] WSREP: ####### Adjusting cert position: 149956353 -> 149956354
2023-05-31 15:25:41 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:41 0 [Note] WSREP: Lowest cert index boundary for CC from preload: 149956266
2023-05-31 15:25:41 0 [Note] WSREP: Min available from gcache for CC from preload: 149955355
2023-05-31 15:25:41 0 [Note] WSREP: REPL Protocols: 10 (5)
2023-05-31 15:25:41 0 [Note] WSREP: ####### Adjusting cert position: 149956354 -> 149956355
2023-05-31 15:25:41 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:41 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 149956266
2023-05-31 15:25:41 0 [Note] WSREP: Min available from gcache for CC from ist: 149955355
2023-05-31 15:25:41 10 [Note] WSREP: ================================================
2023-05-31 15:25:41 10 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:41 0 [Note] WSREP: REPL Protocols: 10 (5)
2023-05-31 15:25:41 0 [Note] WSREP: ####### Adjusting cert position: 149956355 -> 149956356
2023-05-31 15:25:41 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:41 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 149956266
2023-05-31 15:25:41 0 [Note] WSREP: Min available from gcache for CC from ist: 149955355
2023-05-31 15:25:41 15 [Note] WSREP: ================================================
2023-05-31 15:25:41 15 [Note] WSREP: Server status change initialized -> joined
2023-05-31 15:25:41 15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:41 15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:41 0 [Note] WSREP: REPL Protocols: 10 (5)
2023-05-31 15:25:41 0 [Note] WSREP: ####### Adjusting cert position: 149956356 -> 149956357
2023-05-31 15:25:41 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:41 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 149956266
2023-05-31 15:25:41 0 [Note] WSREP: Min available from gcache for CC from ist: 149955355
2023-05-31 15:25:41 0 [Note] WSREP: Receiving IST...100.0% (91/91 events) complete.
2023-05-31 15:25:41 11 [Note] WSREP: ================================================
2023-05-31 15:25:41 11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:41 2 [Note] WSREP: Draining apply monitors after IST up to 149956357
2023-05-31 15:25:41 2 [Note] WSREP: IST received: 66eb3498-d920-11ed-892c-0669747ecf70:149956357
2023-05-31 15:25:41 2 [Note] WSREP: Lowest cert index boundary for CC from sst: 149956266
2023-05-31 15:25:41 2 [Note] WSREP: Min available from gcache for CC from sst: 149955355
2023-05-31 15:25:41 2 [Note] WSREP: ####### skipping local CC 149956357, keep in cache: false
2023-05-31 15:25:41 0 [Note] WSREP: 0.0 (ovh5.1check.com): State transfer from 1.0 (ovh3.1check.com) complete.
2023-05-31 15:25:41 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 149956357)
2023-05-31 15:25:41 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete.
2023-05-31 15:25:41 0 [Note] WSREP: Member 0.0 (ovh5.1check.com) synced with group.
2023-05-31 15:25:41 0 [Note] WSREP: Processing event queue:...100.0% (1/1 events) complete.
2023-05-31 15:25:41 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 149956357)
2023-05-31 15:25:41 2 [Note] WSREP: Server ovh5.1check.com synced with group
2023-05-31 15:25:41 2 [Note] WSREP: Server status change joined -> synced
2023-05-31 15:25:41 2 [Note] WSREP: Synchronized with group, ready for connections
2023-05-31 15:25:41 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:42 0 [Note] WSREP: (926ef5ee-a06c, 'tcp://0.0.0.0:4567') turning message relay requesting off
2023-05-31 15:25:43 0 [Note] WSREP: Deferred close timer started for socket with remote endpoint: tcp://192.168.0.3:4567
2023-05-31 15:25:43 0 [Note] WSREP: forgetting f4eb5d26-bd95 (tcp://192.168.0.3:4567)
2023-05-31 15:25:43 0 [Note] WSREP: Node 926ef5ee-a06c state prim
2023-05-31 15:25:43 0 [Note] WSREP: view(view_id(PRIM,926ef5ee-a06c,15) memb {
2023-05-31 15:25:43 0 [Note] WSREP: save pc into disk
2023-05-31 15:25:43 0 [Note] WSREP: forgetting 01049457-8651 (tcp://192.168.0.4:4567)
2023-05-31 15:25:43 0 [Note] WSREP: forgetting f4eb5d26-bd95 (tcp://192.168.0.3:4567)
2023-05-31 15:25:43 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1
2023-05-31 15:25:43 0 [Note] WSREP: Deferred close timer handle_wait Operation aborted. for 0x558ded050650
2023-05-31 15:25:43 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a4e8969e-ffb6-11ed-96dc-83893d590036
2023-05-31 15:25:43 0 [Note] WSREP: Deferred close timer destruct
2023-05-31 15:25:43 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a4e8969e-ffb6-11ed-96dc-83893d590036
2023-05-31 15:25:43 0 [Note] WSREP: STATE EXCHANGE: got state msg: a4e8969e-ffb6-11ed-96dc-83893d590036 from 0 (ovh5.1check.com)
2023-05-31 15:25:43 0 [Note] WSREP: Quorum results:
2023-05-31 15:25:43 0 [Note] WSREP: Flow-control interval: [16, 16]
2023-05-31 15:25:43 2 [Note] WSREP: ####### processing CC 149956358, local, ordered
2023-05-31 15:25:43 2 [Note] WSREP: ####### My UUID: 926ef5ee-ffb6-11ed-a06c-7e62ca0df787
2023-05-31 15:25:43 2 [Note] WSREP: Skipping cert index reset
2023-05-31 15:25:43 2 [Note] WSREP: REPL Protocols: 10 (5)
2023-05-31 15:25:43 2 [Note] WSREP: ####### Adjusting cert position: 149956357 -> 149956358
2023-05-31 15:25:43 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:43 2 [Note] WSREP: ================================================
2023-05-31 15:25:43 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:43 2 [Note] WSREP: Lowest cert index boundary for CC from group: 149956266
2023-05-31 15:25:43 2 [Note] WSREP: Min available from gcache for CC from group: 149955355
2023-05-31 15:25:52 0 [Note] Starting MariaDB 10.6.13-MariaDB-1:10.6.13+maria~ubu2204-log source revision a24f2bb50ba4a0dd4127455f7fcdfed584937f36 as process 1267782
2023-05-31 15:25:52 0 [Note] WSREP: Loading provider /usr/lib/galera/libgalera_smm.so initial position: 66eb3498-d920-11ed-892c-0669747ecf70:149956358
2023-05-31 15:25:52 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so'
2023-05-31 15:25:52 0 [Note] WSREP: wsrep_load(): Galera 26.4.14(r06a0c285) by Codership Oy <info@codership.com> loaded successfully.
2023-05-31 15:25:52 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration.
2023-05-31 15:25:52 0 [Note] WSREP: Found saved state: 66eb3498-d920-11ed-892c-0669747ecf70:-1, safe_to_bootstrap: 1
2023-05-31 15:25:52 0 [Note] WSREP: GCache DEBUG: opened preamble:
2023-05-31 15:25:52 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 66eb3498-d920-11ed-892c-0669747ecf70, offset: -1
2023-05-31 15:25:52 0 [Note] WSREP: GCache::RingBuffer initial scan...  0.0% (        0/134217752 bytes) complete.
2023-05-31 15:25:52 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (134217752/134217752 bytes) complete.
2023-05-31 15:25:52 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 149955355-149956358
2023-05-31 15:25:52 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...  0.0% (        0/133566128 bytes) complete.
2023-05-31 15:25:52 0 [Note] WSREP: Recovering GCache ring buffer: found 5/1009 locked buffers
2023-05-31 15:25:52 0 [Note] WSREP: Recovering GCache ring buffer: free space: 652896/134217728
2023-05-31 15:25:52 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (133566128/133566128 bytes) complete.
2023-05-31 15:25:52 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 192.168.0.5; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0;
 evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.
stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.keep_plaintext_size = 128M; gcac
he.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave
= no; gcs.fc_single_primary = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0;
2023-05-31 15:25:52 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:52 0 [Note] WSREP: ####### Assign initial position for certification: 66eb3498-d920-11ed-892c-0669747ecf70:149956358, protocol version: -1
2023-05-31 15:25:52 0 [Note] WSREP: Start replication
2023-05-31 15:25:52 0 [Note] WSREP: Connecting with bootstrap option: 0
2023-05-31 15:25:52 0 [Note] WSREP: Setting GCS initial position to 66eb3498-d920-11ed-892c-0669747ecf70:149956358
2023-05-31 15:25:52 0 [Note] WSREP: Using CRC-32C for message checksums.
2023-05-31 15:25:52 0 [Note] WSREP: backend: asio
2023-05-31 15:25:52 0 [Note] WSREP: gcomm thread scheduling priority set to other:0
2023-05-31 15:25:52 0 [Note] WSREP: restore pc from disk successfully
2023-05-31 15:25:52 0 [Note] WSREP: GMCast version 0
2023-05-31 15:25:52 0 [Note] WSREP: (926ef5ee-a06d, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
2023-05-31 15:25:52 0 [Note] WSREP: (926ef5ee-a06d, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
2023-05-31 15:25:52 0 [Note] WSREP: EVS version 1
2023-05-31 15:25:52 0 [Note] WSREP: gcomm: connecting to group 'MariaDB Galera Cluster', peer '192.168.0.3:,192.168.0.4:,192.168.0.5:'
2023-05-31 15:25:52 0 [Note] WSREP: (926ef5ee-a06d, 'tcp://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address tcp://192.168.0.5:4567
2023-05-31 15:25:55 0 [Note] WSREP: EVS version upgrade 0 -> 1
2023-05-31 15:25:55 0 [Note] WSREP: PC protocol upgrade 0 -> 1
2023-05-31 15:25:55 0 [Warning] WSREP: no nodes coming from prim view, prim not possible
2023-05-31 15:25:55 0 [Note] WSREP: view(view_id(NON_PRIM,926ef5ee-a06d,17) memb {
2023-05-31 15:25:55 0 [Note] WSREP: promote to primary component
2023-05-31 15:25:55 0 [Note] WSREP: view(view_id(PRIM,926ef5ee-a06d,17) memb {
2023-05-31 15:25:55 0 [Note] WSREP: save pc into disk
2023-05-31 15:25:55 0 [Note] WSREP: discarding pending addr without UUID: tcp://192.168.0.3:4567
2023-05-31 15:25:55 0 [Note] WSREP: discarding pending addr without UUID: tcp://192.168.0.4:4567
2023-05-31 15:25:55 0 [Note] WSREP: clear restored view
2023-05-31 15:25:55 0 [Note] WSREP: gcomm: connected
2023-05-31 15:25:55 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
2023-05-31 15:25:55 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
2023-05-31 15:25:55 0 [Note] WSREP: Opened channel 'MariaDB Galera Cluster'
2023-05-31 15:25:55 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
2023-05-31 15:25:55 0 [Note] WSREP: Flow-control interval: [16, 16]
2023-05-31 15:25:55 0 [Note] WSREP: Received NON-PRIMARY.
2023-05-31 15:25:55 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = yes, my_idx = 0, memb_num = 1
2023-05-31 15:25:55 1 [Note] WSREP: Starting rollbacker thread 1
2023-05-31 15:25:55 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: ac3a2da2-ffb6-11ed-ae03-fb57c8074e81
2023-05-31 15:25:55 0 [Note] WSREP: STATE EXCHANGE: sent state msg: ac3a2da2-ffb6-11ed-ae03-fb57c8074e81
2023-05-31 15:25:55 0 [Note] WSREP: STATE EXCHANGE: got state msg: ac3a2da2-ffb6-11ed-ae03-fb57c8074e81 from 0 (ovh5.1check.com)
2023-05-31 15:25:55 2 [Note] WSREP: Starting applier thread 2
2023-05-31 15:25:55 0 [Warning] WSREP: Quorum: No node with complete state:
2023-05-31 15:25:55 2 [Note] WSREP: ================================================
2023-05-31 15:25:55 0 [Warning] WSREP: No re-merged primary component found.
2023-05-31 15:25:55 2 [Note] WSREP: Non-primary view
2023-05-31 15:25:55 0 [Note] WSREP: Bootstrapped primary 00000000-0000-0000-0000-000000000000 found: 1.
2023-05-31 15:25:55 2 [Note] WSREP: Server status change disconnected -> connected
2023-05-31 15:25:55 0 [Note] WSREP: Quorum results:
2023-05-31 15:25:55 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:55 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:55 0 [Note] WSREP: Flow-control interval: [16, 16]
2023-05-31 15:25:55 0 [Note] WSREP: Restored state OPEN -> JOINED (149956359)
2023-05-31 15:25:55 0 [Note] WSREP: Member 0.0 (ovh5.1check.com) synced with group.
2023-05-31 15:25:55 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 149956359)
2023-05-31 15:25:55 2 [Note] WSREP: ####### processing CC 149956359, local, ordered
2023-05-31 15:25:55 2 [Note] WSREP: Process first view: 66eb3498-d920-11ed-892c-0669747ecf70 my uuid: 926ef5ee-ffb6-11ed-a06d-7e62ca0df787
2023-05-31 15:25:55 2 [Note] WSREP: Server ovh5.1check.com connected to cluster at position 66eb3498-d920-11ed-892c-0669747ecf70:149956359 with ID 926ef5ee-ffb6-11ed-a06d-7e62ca0df787
2023-05-31 15:25:55 2 [Note] WSREP: Server status change connected -> connected
2023-05-31 15:25:55 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:55 2 [Note] WSREP: ####### My UUID: 926ef5ee-ffb6-11ed-a06d-7e62ca0df787
2023-05-31 15:25:55 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: no
2023-05-31 15:25:55 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:55 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1
2023-05-31 15:25:55 2 [Note] WSREP: REPL Protocols: 10 (5)
2023-05-31 15:25:55 2 [Note] WSREP: ####### Adjusting cert position: -1 -> 149956359
2023-05-31 15:25:55 0 [Note] WSREP: Service thread queue flushed.
2023-05-31 15:25:55 2 [Note] WSREP: ================================================
2023-05-31 15:25:55 2 [Note] WSREP: Server status change connected -> joiner
2023-05-31 15:25:55 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:55 2 [Note] WSREP: Server status change joiner -> initializing
2023-05-31 15:25:55 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:55 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2023-05-31 15:25:55 0 [Note] InnoDB: Number of pools: 1
2023-05-31 15:25:55 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
2023-05-31 15:25:55 0 [Note] InnoDB: Initializing buffer pool, total size = 85899345920, chunk size = 134217728
2023-05-31 15:25:55 0 [Note] InnoDB: Completed initialization of buffer pool
2023-05-31 15:25:56 0 [Note] InnoDB: 128 rollback segments are active.
2023-05-31 15:25:56 0 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50269S), skipping check
2023-05-31 15:25:56 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2023-05-31 15:25:56 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2023-05-31 15:25:56 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2023-05-31 15:25:56 0 [Note] InnoDB: 10.6.13 started; log sequence number 27984233129382; transaction id 4332371118
2023-05-31 15:25:56 0 [Note] Plugin 'FEEDBACK' is disabled.
2023-05-31 15:25:56 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2023-05-31 15:25:56 0 [Warning] 'innodb-adaptive-max-sleep-delay' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:56 0 [Warning] 'innodb-background-scrub-data-check-interval' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:56 0 [Warning] 'innodb-background-scrub-data-interval' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:56 0 [Warning] 'innodb-buffer-pool-instances' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:56 0 [Warning] 'innodb-concurrency-tickets' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:56 0 [Warning] 'innodb-buffer-pool-instances' was removed. It does nothing now and exists only for compatibility with old my.cnf files.
2023-05-31 15:25:56 0 [Note] Server socket created on IP: '0.0.0.0'.
2023-05-31 15:25:56 0 [Warning] 'proxies_priv' entry '@% root@ovh2.1check.com' ignored in --skip-name-resolve mode.
2023-05-31 15:25:56 0 [Note] WSREP: wsrep_init_schema_and_SR (nil)
2023-05-31 15:25:56 0 [Note] WSREP: Server initialized
2023-05-31 15:25:56 0 [Note] WSREP: Server status change initializing -> initialized
2023-05-31 15:25:56 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:56 6 [Note] WSREP: Starting applier thread 6
2023-05-31 15:25:56 9 [Note] WSREP: Starting applier thread 9
2023-05-31 15:25:56 15 [Note] WSREP: Starting applier thread 15
2023-05-31 15:25:56 8 [Note] WSREP: Starting applier thread 8
2023-05-31 15:25:56 11 [Note] WSREP: Starting applier thread 11
2023-05-31 15:25:56 10 [Note] WSREP: Starting applier thread 10
2023-05-31 15:25:56 13 [Note] WSREP: Starting applier thread 13
2023-05-31 15:25:56 12 [Note] WSREP: Starting applier thread 12
2023-05-31 15:25:56 17 [Note] WSREP: Starting applier thread 17
2023-05-31 15:25:56 7 [Note] WSREP: Starting applier thread 7
2023-05-31 15:25:56 14 [Note] WSREP: Starting applier thread 14
2023-05-31 15:25:56 0 [Warning] Neither --relay-log nor --relay-log-index were used; so replication may break when this MariaDB server acts as a replica and has its hostname changed. Please use '--log-basename=#'
 or '--relay-log=mysqld-relay-bin' to avoid this problem.
2023-05-31 15:25:56 20 [Note] Slave I/O thread: Start asynchronous replication to master 'mdb_control@ovh7.vlan:3306' in log 'mysql-bin.054864' at position 758214120
2023-05-31 15:25:56 0 [Note] /usr/sbin/mariadbd: ready for connections.
2023-05-31 15:25:56 21 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.054864' at position 447263261, relay log './mysqld-relay-bin.035980' position: 447263560
2023-05-31 15:25:57 20 [Note] Slave I/O thread: connected to master 'mdb_control@ovh7.vlan:3306',replication started in log 'mysql-bin.054864' at position 758214120
2023-05-31 15:25:57 5 [Note] WSREP: Recovered cluster id 66eb3498-d920-11ed-892c-0669747ecf70
2023-05-31 15:25:57 2 [Note] WSREP: Server status change initialized -> joined
2023-05-31 15:25:57 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:57 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:25:57 2 [Note] WSREP: Lowest cert index boundary for CC from group: 149956359
2023-05-31 15:25:57 2 [Note] WSREP: Min available from gcache for CC from group: 149955355
2023-05-31 15:25:57 2 [Note] WSREP: Server ovh5.1check.com synced with group
2023-05-31 15:25:57 2 [Note] WSREP: Server status change joined -> synced
2023-05-31 15:25:57 2 [Note] WSREP: Synchronized with group, ready for connections
2023-05-31 15:25:57 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:26:03 21 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; handler
 error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054864, end_log_pos 822771838, Gtid 0-2-647104617, Internal MariaDB error code: 1062
2023-05-31 15:26:03 21 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions'
2023-05-31 15:26:03 21 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032
2023-05-31 15:26:03 21 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_NOT_
FOUND; the event's master log mysql-bin.054864, end_log_pos 824441663, Gtid 0-2-647104633, Internal MariaDB error code: 1032
2023-05-31 15:26:08 0 [Note] InnoDB: Buffer pool(s) load completed at 230531 15:26:08
2023-05-31 15:26:13 0 [Note] /usr/sbin/mariadbd (initiated by: unknown): Normal shutdown
2023-05-31 15:26:13 0 [Note] WSREP: Shutdown replication
2023-05-31 15:26:13 0 [Note] WSREP: Server status change synced -> disconnecting
2023-05-31 15:26:13 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2023-05-31 15:26:13 0 [Note] WSREP: Closing send monitor...
2023-05-31 15:26:13 0 [Note] WSREP: Closed send monitor.
2023-05-31 15:26:13 0 [Note] WSREP: gcomm: terminating thread
2023-05-31 15:26:13 0 [Note] WSREP: gcomm: joining thread
2023-05-31 15:26:13 0 [Note] WSREP: gcomm: closing backend
2023-05-31 15:26:13 0 [Note] WSREP: PC protocol downgrade 1 -> 0
2023-05-31 15:26:13 0 [Note] WSREP: view((empty))
2023-05-31 15:26:13 0 [Note] WSREP: gcomm: closed
2023-05-31 15:26:13 0 [Note] WSREP: New SELF-LEAVE.
2023-05-31 15:26:13 0 [Note] WSREP: Flow-control interval: [0, 0]
2023-05-31 15:26:13 0 [Note] WSREP: Received SELF-LEAVE. Closing connection.
2023-05-31 15:26:13 0 [Note] WSREP: Shifting SYNCED -> CLOSED (TO: 149960993)
2023-05-31 15:26:13 0 [Note] WSREP: RECV thread exiting 0: Success
2023-05-31 15:26:13 0 [Note] WSREP: recv_thread() joined.



 Comments   
Comment by COUNOTTE CEDRIC [ 2023-06-09 ]

Seems to be solved in 10.6.14 !? Upgraded all 3 nodes, replication slave restarted just fine.

Comment by Phil Sumner [ 2023-08-30 ]

I am having this issue with 10.6.15

I have just upgraded from 10.6.11 -> 10.6.15 in a rolling manner using MaxScale to Out of Service each server in turn.

When I did nodes 2/3 it was fine. On node 1 (the replica) I have to set "skip-slave-start" in the config file else it crashes with the same error. It looks like it's trying to start replication before it's caught up with the cluster.

2023-08-30 12:24:58 1 [Note] WSREP: Receiving IST: 124464 writesets, seqnos 40854195210-40854319673
2023-08-30 12:24:58 0 [Note] WSREP: ####### IST applying starts with 40854195210
2023-08-30 12:24:58 0 [Note] WSREP: ####### IST current seqno initialized to 40854195210
2023-08-30 12:24:58 0 [Note] WSREP: Receiving IST... 0.0% ( 0/124464 events) complete.
2023-08-30 12:24:58 0 [Note] WSREP: Service thread queue flushed.
2023-08-30 12:24:58 0 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:40854195209, protocol version: 5
2023-08-30 12:24:58 19 [Note] Slave I/O thread: Start asynchronous replication to master 'replication@<hostname>:3306' in log 'mysql-bin.000022' at position 4
2023-08-30 12:24:58 0 [Note] /usr/sbin/mariadbd: ready for connections.
Version: '10.6.15-MariaDB-log' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server
2023-08-30 12:24:58 20 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.000022' at position 4, relay log './<hostname>-relay-bin.000001' position: 4; GTID position '0-998-1873739337,127-10-17160,232-10-60310194229'
2023-08-30 12:24:58 19 [Note] Slave I/O thread: connected to master 'replication@<hostname>:3306',replication starts at GTID position '0-998-1873739337,232-10-60310194229,127-10-17160'
2023-08-30 12:24:59 20 [ERROR] WSREP: Unknown writeset version: -1
230830 12:24:59 [ERROR] mysqld got signal 6 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.

Server version: 10.6.15-MariaDB-log source revision: 0d16eb35bc981023ce2f4912e8ecde68ca381f4e
key_buffer_size=134217728
read_buffer_size=131072
max_used_connections=0
max_threads=1026
thread_count=13
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 2390522 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.

Thread pointer: 0x7f1c800008d8
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0x7f1a5c1124e0 thread_stack 0x49000
/usr/sbin/mariadbd(my_print_stacktrace+0x2e)[0x55fc2da0d37e]
/usr/sbin/mariadbd(handle_fatal_signal+0x307)[0x55fc2d45fcc7]
sigaction.c:0(__restore_rt)[0x7f1dee983630]
/lib64/libc.so.6(gsignal+0x37)[0x7f1deddce387]
/lib64/libc.so.6(abort+0x148)[0x7f1deddcfa78]
src/write_set_ng.hpp:167(galera::WriteSetNG::Header::size(galera::WriteSetNG::Version))[0x7f1de2be12c8]
src/write_set_ng.hpp:174(Header)[0x7f1de2be1cd7]
src/trx_handle.hpp:1011(galera::TrxHandleMaster::write_set_out())[0x7f1de2bdd048]
/usr/sbin/mariadbd(_ZN5wsrep18wsrep_provider_v2610append_keyERNS_9ws_handleERKNS_3keyE+0xb7)[0x55fc2daa7c87]
/usr/sbin/mariadbd(_ZN5wsrep11transaction10append_keyERKNS_3keyE+0x46)[0x55fc2daa07b6]
/usr/sbin/mariadbd(wsrep_thd_append_key+0xfd)[0x55fc2d730a1d]
/usr/sbin/mariadbd(+0xccf5bb)[0x55fc2d7435bb]
/usr/sbin/mariadbd(+0xcdb4d4)[0x55fc2d74f4d4]
/usr/sbin/mariadbd(+0xcea0b1)[0x55fc2d75e0b1]
/usr/sbin/mariadbd(_ZN7handler12ha_write_rowEPKh+0x27d)[0x55fc2d46ecfd]
/usr/sbin/mariadbd(_ZN14Rows_log_event9write_rowEP14rpl_group_infob+0x265)[0x55fc2d583215]
/usr/sbin/mariadbd(_ZN20Write_rows_log_event11do_exec_rowEP14rpl_group_info+0x10e)[0x55fc2d58370e]
/usr/sbin/mariadbd(_ZN14Rows_log_event14do_apply_eventEP14rpl_group_info+0x31d)[0x55fc2d57915d]
/usr/sbin/mariadbd(+0x70c5ff)[0x55fc2d1805ff]
/usr/sbin/mariadbd(handle_slave_sql+0x1aae)[0x55fc2d18adee]
/usr/sbin/mariadbd(+0xc3644c)[0x55fc2d6aa44c]
pthread_create.c:0(start_thread)[0x7f1dee97bea5]
2023-08-30 12:24:59 21 [Warning] IP address '192.168.235.78' could not be resolved: Name or service not known
/lib64/libc.so.6(clone+0x6d)[0x7f1dede96b0d

Generated at Thu Feb 08 10:23:23 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.