Details
-
Bug
-
Status: Open (View Workflow)
-
Major
-
Resolution: Unresolved
-
10.6
-
None
-
None
Description
We have a 3-nodes Galera cluster with one node being a replication slave of another cluster.
When we restart the 2 other nodes, all is ok.
When we restart the node being the replication slave, it keeps crashing or restarting over and over, until we stop the 2 other nodes.
Restarting the 2 other nodes leads to SST instead of IST those nodes being read-only.
Maria DB version is Ver 15.1 Distrib 10.6.13-MariaDB on all 3 nodes.
When running 10.6.12 there was no issue. Production cluster is still running 10.6.12 for that reason.
Here is latest logs. This has been reproduced twice already.
2023-05-31 15:09:45 3075 [Note] Error reading relay log event: slave SQL thread was killed |
2023-05-31 15:09:45 3075 [Note] Slave SQL thread exiting, replication stopped in log 'mysql-bin.054856' at position 675285287, master: ovh7.vlan:3306 |
2023-05-31 15:09:45 157 [Note] Slave I/O thread exiting, read up to log 'mysql-bin.054856', position 675285287, master ovh7.vlan:3306 |
2023-05-31 15:10:27 0 [Note] WSREP: declaring 223bbcc7-ad09 at tcp://192.168.0.4:4567 stable |
2023-05-31 15:10:27 0 [Note] WSREP: forgetting 3996cbad-a80e (tcp://192.168.0.3:4567) |
2023-05-31 15:10:27 0 [Note] WSREP: Node 223bbcc7-ad09 state prim |
2023-05-31 15:10:27 0 [Note] WSREP: view(view_id(PRIM,223bbcc7-ad09,6) memb { |
2023-05-31 15:10:27 0 [Note] WSREP: save pc into disk |
2023-05-31 15:10:27 0 [Note] WSREP: forgetting 3996cbad-a80e (tcp://192.168.0.3:4567) |
2023-05-31 15:10:27 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 |
2023-05-31 15:10:27 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. |
2023-05-31 15:10:27 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 831e7f50-ffb4-11ed-9161-52a62274451d |
2023-05-31 15:10:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 831e7f50-ffb4-11ed-9161-52a62274451d from 0 (ovh4.1check.com) |
2023-05-31 15:10:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 831e7f50-ffb4-11ed-9161-52a62274451d from 1 (ovh5.1check.com) |
2023-05-31 15:10:27 0 [Note] WSREP: Quorum results: |
2023-05-31 15:10:27 0 [Note] WSREP: Flow-control interval: [23, 23] |
2023-05-31 15:10:27 15 [Note] WSREP: ####### processing CC 149901140, local, ordered |
2023-05-31 15:10:27 15 [Note] WSREP: ####### My UUID: 2a10acf7-f894-11ed-b597-b2733ba43458 |
2023-05-31 15:10:27 15 [Note] WSREP: Skipping cert index reset |
2023-05-31 15:10:27 15 [Note] WSREP: REPL Protocols: 10 (5) |
2023-05-31 15:10:27 15 [Note] WSREP: ####### Adjusting cert position: 149901139 -> 149901140 |
2023-05-31 15:10:27 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:10:27 15 [Note] WSREP: ================================================ |
2023-05-31 15:10:27 15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:10:27 15 [Note] WSREP: Lowest cert index boundary for CC from group: 149901047 |
2023-05-31 15:10:27 15 [Note] WSREP: Min available from gcache for CC from group: 149900591 |
2023-05-31 15:10:32 0 [Note] WSREP: cleaning up 3996cbad-a80e (tcp://192.168.0.3:4567) |
2023-05-31 15:10:51 0 [Note] WSREP: Deferred close timer started for socket with remote endpoint: tcp://192.168.0.4:52548 |
2023-05-31 15:10:51 0 [Note] WSREP: forgetting 223bbcc7-ad09 (tcp://192.168.0.4:4567) |
2023-05-31 15:10:51 0 [Note] WSREP: Node 2a10acf7-b597 state prim |
2023-05-31 15:10:51 0 [Note] WSREP: view(view_id(PRIM,2a10acf7-b597,7) memb { |
2023-05-31 15:10:51 0 [Note] WSREP: save pc into disk |
2023-05-31 15:10:51 0 [Note] WSREP: forgetting 223bbcc7-ad09 (tcp://192.168.0.4:4567) |
2023-05-31 15:10:51 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 |
2023-05-31 15:10:51 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 912e3659-ffb4-11ed-ba6a-5bfa6bfa10a0 |
2023-05-31 15:10:51 0 [Note] WSREP: Deferred close timer handle_wait Operation aborted. for 0x55c08f9db640 |
2023-05-31 15:10:51 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 912e3659-ffb4-11ed-ba6a-5bfa6bfa10a0 |
2023-05-31 15:10:51 0 [Note] WSREP: Deferred close timer destruct |
2023-05-31 15:10:51 0 [Note] WSREP: STATE EXCHANGE: got state msg: 912e3659-ffb4-11ed-ba6a-5bfa6bfa10a0 from 0 (ovh5.1check.com) |
2023-05-31 15:10:51 0 [Note] WSREP: Quorum results: |
2023-05-31 15:10:51 0 [Note] WSREP: Flow-control interval: [16, 16] |
2023-05-31 15:10:51 15 [Note] WSREP: ####### processing CC 149901141, local, ordered |
2023-05-31 15:10:51 15 [Note] WSREP: ####### My UUID: 2a10acf7-f894-11ed-b597-b2733ba43458 |
2023-05-31 15:10:51 15 [Note] WSREP: Skipping cert index reset |
2023-05-31 15:10:51 15 [Note] WSREP: REPL Protocols: 10 (5) |
2023-05-31 15:10:51 15 [Note] WSREP: ####### Adjusting cert position: 149901140 -> 149901141 |
2023-05-31 15:10:51 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:10:51 15 [Note] WSREP: ================================================ |
2023-05-31 15:10:51 15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:10:51 15 [Note] WSREP: Lowest cert index boundary for CC from group: 149901047 |
2023-05-31 15:10:51 15 [Note] WSREP: Min available from gcache for CC from group: 149900591 |
2023-05-31 15:10:56 0 [Note] WSREP: cleaning up 223bbcc7-ad09 (tcp://192.168.0.4:4567) |
2023-05-31 15:13:38 0 [Note] WSREP: (2a10acf7-b597, 'tcp://0.0.0.0:4567') connection established to f4eb5d26-bd95 tcp://192.168.0.3:4567 |
2023-05-31 15:13:38 0 [Note] WSREP: (2a10acf7-b597, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: |
2023-05-31 15:13:39 0 [Note] WSREP: declaring f4eb5d26-bd95 at tcp://192.168.0.3:4567 stable |
2023-05-31 15:13:39 0 [Note] WSREP: Node 2a10acf7-b597 state prim |
2023-05-31 15:13:39 0 [Note] WSREP: view(view_id(PRIM,2a10acf7-b597,8) memb { |
2023-05-31 15:13:39 0 [Note] WSREP: save pc into disk |
2023-05-31 15:13:39 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 |
2023-05-31 15:13:39 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: f547a10b-ffb4-11ed-8bca-6b6b695d013f |
2023-05-31 15:13:39 0 [Note] WSREP: STATE EXCHANGE: sent state msg: f547a10b-ffb4-11ed-8bca-6b6b695d013f |
2023-05-31 15:13:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: f547a10b-ffb4-11ed-8bca-6b6b695d013f from 0 (ovh5.1check.com) |
2023-05-31 15:13:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: f547a10b-ffb4-11ed-8bca-6b6b695d013f from 1 (ovh3.1check.com) |
2023-05-31 15:13:39 0 [Note] WSREP: Quorum results: |
2023-05-31 15:13:39 0 [Note] WSREP: Flow-control interval: [23, 23] |
2023-05-31 15:13:39 15 [Note] WSREP: ####### processing CC 149901142, local, ordered |
2023-05-31 15:13:39 15 [Note] WSREP: ####### My UUID: 2a10acf7-f894-11ed-b597-b2733ba43458 |
2023-05-31 15:13:39 15 [Note] WSREP: Skipping cert index reset |
2023-05-31 15:13:39 15 [Note] WSREP: REPL Protocols: 10 (5) |
2023-05-31 15:13:39 15 [Note] WSREP: ####### Adjusting cert position: 149901141 -> 149901142 |
2023-05-31 15:13:39 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:13:39 15 [Note] WSREP: ================================================ |
2023-05-31 15:13:39 15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:13:39 15 [Note] WSREP: Lowest cert index boundary for CC from group: 149901047 |
2023-05-31 15:13:39 15 [Note] WSREP: Min available from gcache for CC from group: 149900591 |
2023-05-31 15:13:39 0 [Note] WSREP: Member 1.0 (ovh3.1check.com) requested state transfer from '*any*'. Selected 0.0 (ovh5.1check.com)(SYNCED) as donor. |
2023-05-31 15:13:39 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 149901142) |
2023-05-31 15:13:39 15 [Note] WSREP: Detected STR version: 1, req_len: 141, req: STRv1 |
2023-05-31 15:13:39 15 [Note] WSREP: IST request: 66eb3498-d920-11ed-892c-0669747ecf70:149901139-149901142|tcp://192.168.0.3:4568 |
2023-05-31 15:13:39 15 [Note] WSREP: Server status change synced -> donor |
2023-05-31 15:13:39 15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:13:39 0 [Note] WSREP: Donor monitor thread started to monitor |
2023-05-31 15:13:39 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '192.168.0.3:4444/xtrabackup_sst//1' --local-port 3306 --socket '/run/mysqld/mysqld.sock' --progress 0 --datadir '/var/ |
lib/mysql/' --gtid '66eb3498-d920-11ed-892c-0669747ecf70:149901139' --gtid-domain-id 300 --binlog '/var/lib/mysql/mysql-bin' --binlog-index '/var/lib/mysql/mysql-bin.index' --bypass --mysqld-args --wsrep-new-clus |
ter --wsrep_start_position=66eb3498-d920-11ed-892c-0669747ecf70:120869475,0-1-5143' |
2023-05-31 15:13:39 15 [Note] WSREP: sst_donor_thread signaled with 0 |
2023-05-31 15:13:39 0 [Note] WSREP: async IST sender starting to serve tcp://192.168.0.3:4568 sending 149901047-149901142, preload starts from 149901047 |
2023-05-31 15:13:39 0 [Note] WSREP: IST sender 149901047 -> 149901142 |
2023-05-31 15:13:40 0 [Note] WSREP: SST sent: 66eb3498-d920-11ed-892c-0669747ecf70:149901139 |
2023-05-31 15:13:40 0 [Note] WSREP: Server status change donor -> joined |
2023-05-31 15:13:40 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:13:40 0 [Note] WSREP: 0.0 (ovh5.1check.com): State transfer to 1.0 (ovh3.1check.com) complete. |
2023-05-31 15:13:40 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 149901142) |
2023-05-31 15:13:40 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete. |
2023-05-31 15:13:40 0 [Note] WSREP: Member 0.0 (ovh5.1check.com) synced with group. |
2023-05-31 15:13:40 0 [Note] WSREP: Processing event queue:...100.0% (1/1 events) complete. |
2023-05-31 15:13:40 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 149901142) |
2023-05-31 15:13:40 14 [Note] WSREP: Server ovh5.1check.com synced with group |
2023-05-31 15:13:40 14 [Note] WSREP: Server status change joined -> synced |
2023-05-31 15:13:40 14 [Note] WSREP: Synchronized with group, ready for connections |
2023-05-31 15:13:40 14 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:13:40 0 [Note] WSREP: Donor monitor thread ended with total time 1 sec |
2023-05-31 15:13:41 0 [Note] WSREP: async IST sender served |
2023-05-31 15:13:41 0 [Note] WSREP: 1.0 (ovh3.1check.com): State transfer from 0.0 (ovh5.1check.com) complete. |
2023-05-31 15:13:41 0 [Note] WSREP: Member 1.0 (ovh3.1check.com) synced with group. |
2023-05-31 15:13:41 0 [Note] WSREP: (2a10acf7-b597, 'tcp://0.0.0.0:4567') turning message relay requesting off |
2023-05-31 15:13:58 0 [Note] WSREP: (2a10acf7-b597, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://192.168.0.4:4567 |
2023-05-31 15:13:58 0 [Note] WSREP: (2a10acf7-b597, 'tcp://0.0.0.0:4567') connection established to 01049457-8651 tcp://192.168.0.4:4567 |
2023-05-31 15:13:59 0 [Note] WSREP: declaring 01049457-8651 at tcp://192.168.0.4:4567 stable |
2023-05-31 15:13:59 0 [Note] WSREP: declaring f4eb5d26-bd95 at tcp://192.168.0.3:4567 stable |
2023-05-31 15:13:59 0 [Note] WSREP: Node 2a10acf7-b597 state prim |
2023-05-31 15:13:59 0 [Note] WSREP: view(view_id(PRIM,01049457-8651,9) memb { |
2023-05-31 15:13:59 0 [Note] WSREP: save pc into disk |
2023-05-31 15:13:59 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 |
2023-05-31 15:13:59 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. |
2023-05-31 15:13:59 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 015101ab-ffb5-11ed-92b0-8b7251ea1435 |
2023-05-31 15:13:59 0 [Note] WSREP: STATE EXCHANGE: got state msg: 015101ab-ffb5-11ed-92b0-8b7251ea1435 from 0 (ovh4.1check.com) |
2023-05-31 15:13:59 0 [Note] WSREP: STATE EXCHANGE: got state msg: 015101ab-ffb5-11ed-92b0-8b7251ea1435 from 2 (ovh3.1check.com) |
2023-05-31 15:13:59 0 [Note] WSREP: STATE EXCHANGE: got state msg: 015101ab-ffb5-11ed-92b0-8b7251ea1435 from 1 (ovh5.1check.com) |
2023-05-31 15:13:59 0 [Note] WSREP: Quorum results: |
2023-05-31 15:13:59 0 [Note] WSREP: Flow-control interval: [28, 28] |
2023-05-31 15:13:59 6 [Note] WSREP: ####### processing CC 149901143, local, ordered |
2023-05-31 15:13:59 6 [Note] WSREP: ####### My UUID: 2a10acf7-f894-11ed-b597-b2733ba43458 |
2023-05-31 15:13:59 6 [Note] WSREP: Skipping cert index reset |
2023-05-31 15:13:59 6 [Note] WSREP: REPL Protocols: 10 (5) |
2023-05-31 15:13:59 6 [Note] WSREP: ####### Adjusting cert position: 149901142 -> 149901143 |
2023-05-31 15:13:59 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:13:59 6 [Note] WSREP: ================================================ |
2023-05-31 15:13:59 6 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:13:59 6 [Note] WSREP: Lowest cert index boundary for CC from group: 149901047 |
2023-05-31 15:13:59 6 [Note] WSREP: Min available from gcache for CC from group: 149900591 |
2023-05-31 15:13:59 0 [Note] WSREP: Member 0.0 (ovh4.1check.com) requested state transfer from '*any*'. Selected 2.0 (ovh3.1check.com)(SYNCED) as donor. |
2023-05-31 15:13:59 0 [Note] WSREP: 2.0 (ovh3.1check.com): State transfer to 0.0 (ovh4.1check.com) complete. |
2023-05-31 15:13:59 0 [Note] WSREP: Member 2.0 (ovh3.1check.com) synced with group. |
2023-05-31 15:14:01 0 [Note] WSREP: 0.0 (ovh4.1check.com): State transfer from 2.0 (ovh3.1check.com) complete. |
2023-05-31 15:14:01 0 [Note] WSREP: Member 0.0 (ovh4.1check.com) synced with group. |
2023-05-31 15:14:02 0 [Note] WSREP: (2a10acf7-b597, 'tcp://0.0.0.0:4567') turning message relay requesting off |
2023-05-31 15:14:29 530113 [Note] Slave I/O thread: Start asynchronous replication to master 'mdb_control@ovh7.vlan:3306' in log 'mysql-bin.054856' at position 675285287 |
2023-05-31 15:14:29 530114 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.054856' at position 675285287, relay log './mysqld-relay-bin.035956' position: 675285586 |
2023-05-31 15:14:29 530113 [Note] Slave I/O thread: connected to master 'mdb_control@ovh7.vlan:3306',replication started in log 'mysql-bin.054856' at position 675285287 |
2023-05-31 15:14:46 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han |
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054857, end_log_pos 528362154, Gtid 0-2-647051573, Internal MariaDB error code: 1062 |
2023-05-31 15:14:46 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions' |
2023-05-31 15:14:46 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032 |
2023-05-31 15:14:46 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_ |
NOT_FOUND; the event's master log mysql-bin.054857, end_log_pos 530069995, Gtid 0-2-647051585, Internal MariaDB error code: 1032 |
2023-05-31 15:15:08 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han |
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054858, end_log_pos 640262071, Gtid 0-2-647059201, Internal MariaDB error code: 1062 |
2023-05-31 15:15:08 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions' |
2023-05-31 15:15:08 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032 |
2023-05-31 15:15:08 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_ |
NOT_FOUND; the event's master log mysql-bin.054858, end_log_pos 641129381, Gtid 0-2-647059208, Internal MariaDB error code: 1032 |
2023-05-31 15:15:12 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han |
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054858, end_log_pos 824520162, Gtid 0-2-647060375, Internal MariaDB error code: 1062 |
2023-05-31 15:15:12 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions' |
2023-05-31 15:15:12 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032 |
2023-05-31 15:15:12 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_ |
NOT_FOUND; the event's master log mysql-bin.054858, end_log_pos 824547795, Gtid 0-2-647060379, Internal MariaDB error code: 1032 |
2023-05-31 15:15:17 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han |
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054859, end_log_pos 20649570, Gtid 0-2-647061814, Internal MariaDB error code: 1062 |
2023-05-31 15:15:17 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions' |
2023-05-31 15:15:17 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032 |
2023-05-31 15:15:17 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_ |
NOT_FOUND; the event's master log mysql-bin.054859, end_log_pos 24415526, Gtid 0-2-647061824, Internal MariaDB error code: 1032 |
2023-05-31 15:15:23 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han |
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054859, end_log_pos 340624428, Gtid 0-2-647064414, Internal MariaDB error code: 1062 |
2023-05-31 15:15:23 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions' |
2023-05-31 15:15:23 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032 |
2023-05-31 15:15:23 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_ |
NOT_FOUND; the event's master log mysql-bin.054859, end_log_pos 341076249, Gtid 0-2-647064421, Internal MariaDB error code: 1032 |
2023-05-31 15:16:19 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han |
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054860, end_log_pos 175089420, Gtid 0-2-647070286, Internal MariaDB error code: 1062 |
2023-05-31 15:16:19 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions' |
2023-05-31 15:16:19 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032 |
2023-05-31 15:16:19 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_ |
NOT_FOUND; the event's master log mysql-bin.054860, end_log_pos 175547311, Gtid 0-2-647070292, Internal MariaDB error code: 1032 |
2023-05-31 15:16:33 530650 [Warning] Access denied for user 'root'@'localhost' |
2023-05-31 15:16:33 530651 [Warning] Access denied for user 'root'@'127.0.0.1' (using password: NO) |
2023-05-31 15:16:46 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han |
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054860, end_log_pos 431957362, Gtid 0-2-647071445, Internal MariaDB error code: 1062 |
2023-05-31 15:16:46 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions' |
2023-05-31 15:16:46 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032 |
2023-05-31 15:16:46 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_ |
NOT_FOUND; the event's master log mysql-bin.054860, end_log_pos 432702272, Gtid 0-2-647071456, Internal MariaDB error code: 1032 |
2023-05-31 15:20:23 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han |
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054862, end_log_pos 230852740, Gtid 0-2-647086708, Internal MariaDB error code: 1062 |
2023-05-31 15:20:23 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions' |
2023-05-31 15:20:23 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032 |
2023-05-31 15:20:23 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_ |
NOT_FOUND; the event's master log mysql-bin.054862, end_log_pos 231691885, Gtid 0-2-647086716, Internal MariaDB error code: 1032 |
2023-05-31 15:20:51 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han |
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054862, end_log_pos 477392005, Gtid 0-2-647088020, Internal MariaDB error code: 1062 |
2023-05-31 15:20:51 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions' |
2023-05-31 15:20:51 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032 |
2023-05-31 15:20:51 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_ |
NOT_FOUND; the event's master log mysql-bin.054862, end_log_pos 478002798, Gtid 0-2-647088028, Internal MariaDB error code: 1032 |
2023-05-31 15:21:22 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han |
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054862, end_log_pos 701364595, Gtid 0-2-647089892, Internal MariaDB error code: 1062 |
2023-05-31 15:21:22 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions' |
2023-05-31 15:21:22 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032 |
2023-05-31 15:21:22 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_ |
NOT_FOUND; the event's master log mysql-bin.054862, end_log_pos 701417499, Gtid 0-2-647089899, Internal MariaDB error code: 1032 |
2023-05-31 15:24:15 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han |
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054863, end_log_pos 1069037395, Gtid 0-2-647098774, Internal MariaDB error code: 1062 |
2023-05-31 15:24:15 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions' |
2023-05-31 15:24:15 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032 |
2023-05-31 15:24:15 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_ |
NOT_FOUND; the event's master log mysql-bin.054863, end_log_pos 1071375944, Gtid 0-2-647098783, Internal MariaDB error code: 1032 |
2023-05-31 15:24:25 530114 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; han |
dler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054864, end_log_pos 85774488, Gtid 0-2-647099211, Internal MariaDB error code: 1062 |
2023-05-31 15:24:25 530114 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions' |
2023-05-31 15:24:25 530114 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032 |
2023-05-31 15:24:25 530114 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_ |
NOT_FOUND; the event's master log mysql-bin.054864, end_log_pos 85802122, Gtid 0-2-647099215, Internal MariaDB error code: 1032 |
2023-05-31 15:25:06 0 [Note] /usr/sbin/mariadbd (initiated by: unknown): Normal shutdown |
2023-05-31 15:25:06 0 [Note] WSREP: Shutdown replication |
2023-05-31 15:25:06 0 [Note] WSREP: Server status change synced -> disconnecting |
2023-05-31 15:25:06 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:06 0 [Note] WSREP: Closing send monitor... |
2023-05-31 15:25:06 0 [Note] WSREP: Closed send monitor. |
2023-05-31 15:25:06 0 [Note] WSREP: gcomm: terminating thread |
2023-05-31 15:25:06 0 [Note] WSREP: gcomm: joining thread |
2023-05-31 15:25:06 0 [Note] WSREP: gcomm: closing backend |
2023-05-31 15:25:06 0 [Note] WSREP: view(view_id(NON_PRIM,01049457-8651,9) memb { |
2023-05-31 15:25:06 0 [Note] WSREP: PC protocol downgrade 1 -> 0 |
2023-05-31 15:25:06 0 [Note] WSREP: view((empty)) |
2023-05-31 15:25:06 0 [Note] WSREP: gcomm: closed |
2023-05-31 15:25:06 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 |
2023-05-31 15:25:06 0 [Note] WSREP: Flow-control interval: [16, 16] |
2023-05-31 15:25:06 0 [Note] WSREP: Received NON-PRIMARY. |
2023-05-31 15:25:06 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 149956352) |
2023-05-31 15:25:06 0 [Note] WSREP: New SELF-LEAVE. |
2023-05-31 15:25:06 0 [Note] WSREP: Flow-control interval: [0, 0] |
2023-05-31 15:25:06 0 [Note] WSREP: Received SELF-LEAVE. Closing connection. |
2023-05-31 15:25:06 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 149956352) |
2023-05-31 15:25:06 0 [Note] WSREP: RECV thread exiting 0: Success |
2023-05-31 15:25:06 11 [Note] WSREP: ================================================ |
2023-05-31 15:25:06 11 [Note] WSREP: Non-primary view |
2023-05-31 15:25:06 11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:06 0 [Note] WSREP: recv_thread() joined. |
2023-05-31 15:25:06 0 [Note] WSREP: Closing replication queue. |
2023-05-31 15:25:06 0 [Note] WSREP: Closing slave action queue. |
2023-05-31 15:25:06 11 [Note] WSREP: ================================================ |
2023-05-31 15:25:06 11 [Note] WSREP: Non-primary view |
2023-05-31 15:25:06 11 [Note] WSREP: Server status change disconnecting -> disconnected |
2023-05-31 15:25:06 11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:06 11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:06 11 [Note] WSREP: Applier thread exiting ret: 0 thd: 11 |
2023-05-31 15:25:06 11 [Warning] Aborted connection 11 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) |
2023-05-31 15:25:06 530114 [ERROR] Slave SQL: Node has dropped from cluster, Gtid 0-2-647101509, Internal MariaDB error code: 1047 |
2023-05-31 15:25:06 530114 [Note] Slave SQL thread exiting, replication stopped in log 'mysql-bin.054864' at position 447263261, master: ovh7.vlan:3306 |
2023-05-31 15:25:06 12 [Note] WSREP: Applier thread exiting ret: 6 thd: 12 |
2023-05-31 15:25:06 10 [Note] WSREP: Applier thread exiting ret: 6 thd: 10 |
2023-05-31 15:25:06 6 [Note] WSREP: Applier thread exiting ret: 6 thd: 6 |
2023-05-31 15:25:06 10 [Warning] Aborted connection 10 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) |
2023-05-31 15:25:06 12 [Warning] Aborted connection 12 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) |
2023-05-31 15:25:06 15 [Note] WSREP: Applier thread exiting ret: 6 thd: 15 |
2023-05-31 15:25:06 7 [Note] WSREP: Applier thread exiting ret: 6 thd: 7 |
2023-05-31 15:25:06 15 [Warning] Aborted connection 15 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) |
2023-05-31 15:25:06 7 [Warning] Aborted connection 7 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) |
2023-05-31 15:25:06 2 [Note] WSREP: Applier thread exiting ret: 6 thd: 2 |
2023-05-31 15:25:06 2 [Warning] Aborted connection 2 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) |
2023-05-31 15:25:06 9 [Note] WSREP: Applier thread exiting ret: 6 thd: 9 |
2023-05-31 15:25:06 9 [Warning] Aborted connection 9 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) |
2023-05-31 15:25:06 14 [Note] WSREP: Applier thread exiting ret: 6 thd: 14 |
2023-05-31 15:25:06 13 [Note] WSREP: Applier thread exiting ret: 6 thd: 13 |
2023-05-31 15:25:06 14 [Warning] Aborted connection 14 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) |
2023-05-31 15:25:06 13 [Warning] Aborted connection 13 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) |
2023-05-31 15:25:06 8 [Note] WSREP: Applier thread exiting ret: 6 thd: 8 |
2023-05-31 15:25:06 8 [Warning] Aborted connection 8 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) |
2023-05-31 15:25:06 17 [Note] WSREP: Applier thread exiting ret: 6 thd: 17 |
2023-05-31 15:25:06 6 [Warning] Aborted connection 6 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) |
2023-05-31 15:25:06 17 [Warning] Aborted connection 17 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) |
2023-05-31 15:25:07 1 [Note] WSREP: rollbacker thread exiting 1 |
2023-05-31 15:25:07 1 [Warning] Aborted connection 1 to db: 'unconnected' user: 'unauthenticated' host: '' (This connection closed normally without authentication) |
2023-05-31 15:25:07 530113 [Note] Slave I/O thread exiting, read up to log 'mysql-bin.054864', position 452844281, master ovh7.vlan:3306 |
2023-05-31 15:25:07 0 [Note] WSREP: dtor state: CLOSED |
2023-05-31 15:25:07 0 [Note] WSREP: MemPool(TrxHandleSlave): hit ratio: 0.99996, misses: 1159, in use: 87, in pool: 1072 |
2023-05-31 15:25:07 0 [Note] WSREP: mon: entered 29086868 oooe fraction 0 oool fraction 0 |
2023-05-31 15:25:07 0 [Note] WSREP: mon: entered 29086868 oooe fraction 6.18836e-07 oool fraction 2.06279e-07 |
2023-05-31 15:25:07 0 [Note] WSREP: mon: entered 29746698 oooe fraction 0 oool fraction 0 |
2023-05-31 15:25:07 0 [Note] WSREP: cert index usage at exit 158 |
2023-05-31 15:25:07 0 [Note] WSREP: cert trx map usage at exit 87 |
2023-05-31 15:25:07 0 [Note] WSREP: deps set usage at exit 0 |
2023-05-31 15:25:07 0 [Note] WSREP: avg deps dist 67.436 |
2023-05-31 15:25:07 0 [Note] WSREP: avg cert interval 2.78476e-06 |
2023-05-31 15:25:07 0 [Note] WSREP: cert index size 158 |
2023-05-31 15:25:07 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:07 0 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0 |
2023-05-31 15:25:07 0 [Note] WSREP: MemPool(LocalTrxHandle): hit ratio: 1, misses: 2, in use: 0, in pool: 2 |
2023-05-31 15:25:07 0 [Note] WSREP: Flushing memory map to disk... |
2023-05-31 15:25:07 0 [Note] InnoDB: FTS optimize thread exiting. |
2023-05-31 15:25:07 0 [Note] InnoDB: Starting shutdown... |
2023-05-31 15:25:07 0 [Note] InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool |
2023-05-31 15:25:07 0 [Note] InnoDB: Restricted to 1297920 pages due to innodb_buf_pool_dump_pct=25 |
2023-05-31 15:25:08 0 [Note] InnoDB: Buffer pool(s) dump completed at 230531 15:25:08 |
2023-05-31 15:25:10 0 [Note] InnoDB: Removed temporary tablespace data file: "./ibtmp1" |
2023-05-31 15:25:10 0 [Note] InnoDB: Shutdown completed; log sequence number 27984233108946; transaction id 4332371053 |
2023-05-31 15:25:10 0 [Note] /usr/sbin/mariadbd: Shutdown complete |
2023-05-31 15:25:12 0 [Note] Starting MariaDB 10.6.13-MariaDB-1:10.6.13+maria~ubu2204-log source revision a24f2bb50ba4a0dd4127455f7fcdfed584937f36 as process 1265409 |
2023-05-31 15:25:12 0 [Note] WSREP: Loading provider /usr/lib/galera/libgalera_smm.so initial position: 66eb3498-d920-11ed-892c-0669747ecf70:149956352 |
2023-05-31 15:25:12 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' |
2023-05-31 15:25:12 0 [Note] WSREP: wsrep_load(): Galera 26.4.14(r06a0c285) by Codership Oy <info@codership.com> loaded successfully. |
2023-05-31 15:25:12 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration. |
2023-05-31 15:25:12 0 [Note] WSREP: Found saved state: 66eb3498-d920-11ed-892c-0669747ecf70:149956352, safe_to_bootstrap: 0 |
2023-05-31 15:25:12 0 [Note] WSREP: GCache DEBUG: opened preamble: |
2023-05-31 15:25:12 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 66eb3498-d920-11ed-892c-0669747ecf70, offset: 81647992 |
2023-05-31 15:25:12 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/134217752 bytes) complete. |
2023-05-31 15:25:12 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (134217752/134217752 bytes) complete. |
2023-05-31 15:25:12 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 149955355-149956352 |
2023-05-31 15:25:12 0 [Note] WSREP: GCache::RingBuffer unused buffers scan... 0.0% ( 0/133563232 bytes) complete. |
2023-05-31 15:25:12 0 [Note] WSREP: Recovering GCache ring buffer: found 0/998 locked buffers |
2023-05-31 15:25:12 0 [Note] WSREP: Recovering GCache ring buffer: free space: 654496/134217728 |
2023-05-31 15:25:12 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (133563232/133563232 bytes) complete. |
2023-05-31 15:25:12 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 192.168.0.5; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; |
evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs. |
stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.keep_plaintext_size = 128M; gcac |
he.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave |
= no; gcs.fc_single_primary = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; |
2023-05-31 15:25:12 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:12 0 [Note] WSREP: ####### Assign initial position for certification: 66eb3498-d920-11ed-892c-0669747ecf70:149956352, protocol version: -1 |
2023-05-31 15:25:12 0 [Note] WSREP: Start replication |
2023-05-31 15:25:12 0 [Note] WSREP: Connecting with bootstrap option: 0 |
2023-05-31 15:25:12 0 [Note] WSREP: Setting GCS initial position to 66eb3498-d920-11ed-892c-0669747ecf70:149956352 |
2023-05-31 15:25:12 0 [Note] WSREP: Using CRC-32C for message checksums. |
2023-05-31 15:25:12 0 [Note] WSREP: backend: asio |
2023-05-31 15:25:12 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 |
2023-05-31 15:25:12 0 [Note] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) |
2023-05-31 15:25:12 0 [Note] WSREP: restore pc from disk failed |
2023-05-31 15:25:12 0 [Note] WSREP: GMCast version 0 |
2023-05-31 15:25:12 0 [Note] WSREP: (926ef5ee-a06b, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 |
2023-05-31 15:25:12 0 [Note] WSREP: (926ef5ee-a06b, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 |
2023-05-31 15:25:12 0 [Note] WSREP: EVS version 1 |
2023-05-31 15:25:12 0 [Note] WSREP: gcomm: connecting to group 'MariaDB Galera Cluster', peer '192.168.0.3:,192.168.0.4:,192.168.0.5:' |
2023-05-31 15:25:12 0 [Note] WSREP: (926ef5ee-a06b, 'tcp://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address tcp://192.168.0.5:4567 |
2023-05-31 15:25:12 0 [Note] WSREP: (926ef5ee-a06b, 'tcp://0.0.0.0:4567') connection established to f4eb5d26-bd95 tcp://192.168.0.3:4567 |
2023-05-31 15:25:12 0 [Note] WSREP: (926ef5ee-a06b, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: |
2023-05-31 15:25:12 0 [Note] WSREP: (926ef5ee-a06b, 'tcp://0.0.0.0:4567') connection established to 01049457-8651 tcp://192.168.0.4:4567 |
2023-05-31 15:25:12 0 [Note] WSREP: EVS version upgrade 0 -> 1 |
2023-05-31 15:25:12 0 [Note] WSREP: declaring 01049457-8651 at tcp://192.168.0.4:4567 stable |
2023-05-31 15:25:12 0 [Note] WSREP: declaring f4eb5d26-bd95 at tcp://192.168.0.3:4567 stable |
2023-05-31 15:25:12 0 [Note] WSREP: PC protocol upgrade 0 -> 1 |
2023-05-31 15:25:12 0 [Note] WSREP: Node 01049457-8651 state prim |
2023-05-31 15:25:12 0 [Note] WSREP: view(view_id(PRIM,01049457-8651,11) memb { |
2023-05-31 15:25:12 0 [Note] WSREP: save pc into disk |
2023-05-31 15:25:13 0 [Note] WSREP: gcomm: connected |
2023-05-31 15:25:13 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 |
2023-05-31 15:25:13 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) |
2023-05-31 15:25:13 0 [Note] WSREP: Opened channel 'MariaDB Galera Cluster' |
2023-05-31 15:25:13 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 |
2023-05-31 15:25:13 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. |
2023-05-31 15:25:13 1 [Note] WSREP: Starting rollbacker thread 1 |
2023-05-31 15:25:13 2 [Note] WSREP: Starting applier thread 2 |
2023-05-31 15:25:13 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 92bbbc43-ffb6-11ed-a9f5-e7fcd572ca28 |
2023-05-31 15:25:13 0 [Note] WSREP: STATE EXCHANGE: got state msg: 92bbbc43-ffb6-11ed-a9f5-e7fcd572ca28 from 0 (ovh4.1check.com) |
2023-05-31 15:25:13 0 [Note] WSREP: STATE EXCHANGE: got state msg: 92bbbc43-ffb6-11ed-a9f5-e7fcd572ca28 from 2 (ovh3.1check.com) |
2023-05-31 15:25:13 0 [Note] WSREP: STATE EXCHANGE: got state msg: 92bbbc43-ffb6-11ed-a9f5-e7fcd572ca28 from 1 (ovh5.1check.com) |
2023-05-31 15:25:13 0 [Note] WSREP: Quorum results: |
2023-05-31 15:25:13 0 [Note] WSREP: Flow-control interval: [28, 28] |
2023-05-31 15:25:13 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 149956354) |
2023-05-31 15:25:13 2 [Note] WSREP: ####### processing CC 149956354, local, ordered |
2023-05-31 15:25:13 2 [Note] WSREP: Process first view: 66eb3498-d920-11ed-892c-0669747ecf70 my uuid: 926ef5ee-ffb6-11ed-a06b-7e62ca0df787 |
2023-05-31 15:25:13 2 [Note] WSREP: Server ovh5.1check.com connected to cluster at position 66eb3498-d920-11ed-892c-0669747ecf70:149956354 with ID 926ef5ee-ffb6-11ed-a06b-7e62ca0df787 |
2023-05-31 15:25:13 2 [Note] WSREP: Server status change disconnected -> connected |
2023-05-31 15:25:13 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:13 2 [Note] WSREP: ####### My UUID: 926ef5ee-ffb6-11ed-a06b-7e62ca0df787 |
2023-05-31 15:25:13 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes |
2023-05-31 15:25:13 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:13 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1 |
2023-05-31 15:25:13 2 [Note] WSREP: State transfer required: |
2023-05-31 15:25:13 2 [Note] WSREP: Server status change connected -> joiner |
2023-05-31 15:25:13 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:13 0 [Note] WSREP: Joiner monitor thread started to monitor |
2023-05-31 15:25:13 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '192.168.0.5' --datadir '/var/lib/mysql/' --parent 1265409 --progress 0 --binlog '/var/lib/mysql/mysql-bin' --binlog-i |
ndex '/var/lib/mysql/mysql-bin.index' --mysqld-args --wsrep_start_position=66eb3498-d920-11ed-892c-0669747ecf70:149956352,300-1-5681' |
2023-05-31 15:25:14 2 [Note] WSREP: ####### IST uuid:66eb3498-d920-11ed-892c-0669747ecf70 f: 149956353, l: 149956354, STRv: 3 |
2023-05-31 15:25:14 2 [Note] WSREP: IST receiver addr using tcp://192.168.0.5:4568 |
2023-05-31 15:25:14 2 [Note] WSREP: Prepared IST receiver for 149956353-149956354, listening at: tcp://192.168.0.5:4568 |
2023-05-31 15:25:14 0 [Note] WSREP: Member 1.0 (ovh5.1check.com) requested state transfer from '*any*'. Selected 2.0 (ovh3.1check.com)(SYNCED) as donor. |
2023-05-31 15:25:14 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 149956354) |
2023-05-31 15:25:14 2 [Note] WSREP: Requesting state transfer: success, donor: 2 |
2023-05-31 15:25:14 0 [Note] WSREP: 2.0 (ovh3.1check.com): State transfer to 1.0 (ovh5.1check.com) complete. |
2023-05-31 15:25:14 0 [Note] WSREP: Member 2.0 (ovh3.1check.com) synced with group. |
2023-05-31 15:25:14 3 [Note] WSREP: SST received |
2023-05-31 15:25:14 3 [Note] WSREP: Server status change joiner -> initializing |
2023-05-31 15:25:14 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:14 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 |
2023-05-31 15:25:14 0 [Note] InnoDB: Number of pools: 1 |
2023-05-31 15:25:14 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions |
2023-05-31 15:25:14 0 [Note] InnoDB: Initializing buffer pool, total size = 85899345920, chunk size = 134217728 |
2023-05-31 15:25:14 0 [Note] InnoDB: Completed initialization of buffer pool |
2023-05-31 15:25:14 0 [Note] InnoDB: 128 rollback segments are active. |
2023-05-31 15:25:15 0 [Note] InnoDB: Creating shared tablespace for temporary tables |
2023-05-31 15:25:15 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... |
2023-05-31 15:25:15 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. |
2023-05-31 15:25:15 0 [Note] InnoDB: 10.6.13 started; log sequence number 27984233111451; transaction id 4332371060 |
2023-05-31 15:25:15 0 [Note] Plugin 'FEEDBACK' is disabled. |
2023-05-31 15:25:15 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool |
2023-05-31 15:25:15 0 [Warning] 'innodb-adaptive-max-sleep-delay' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:15 0 [Warning] 'innodb-background-scrub-data-check-interval' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:15 0 [Warning] 'innodb-background-scrub-data-interval' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:15 0 [Warning] 'innodb-buffer-pool-instances' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:15 0 [Warning] 'innodb-concurrency-tickets' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:15 0 [Warning] 'innodb-buffer-pool-instances' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:15 0 [Note] Server socket created on IP: '0.0.0.0'. |
2023-05-31 15:25:15 0 [Warning] 'proxies_priv' entry '@% root@ovh2.1check.com' ignored in --skip-name-resolve mode. |
2023-05-31 15:25:15 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) |
2023-05-31 15:25:15 0 [Note] WSREP: Server initialized |
2023-05-31 15:25:15 0 [Note] WSREP: Server status change initializing -> initialized |
2023-05-31 15:25:15 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:15 3 [Note] WSREP: Recovered position from storage: 66eb3498-d920-11ed-892c-0669747ecf70:149956352 |
2023-05-31 15:25:15 10 [Note] WSREP: Starting applier thread 10 |
2023-05-31 15:25:15 11 [Note] WSREP: Starting applier thread 11 |
2023-05-31 15:25:15 8 [Note] WSREP: Starting applier thread 8 |
2023-05-31 15:25:15 14 [Note] WSREP: Starting applier thread 14 |
2023-05-31 15:25:15 6 [Note] WSREP: Starting applier thread 6 |
2023-05-31 15:25:15 7 [Note] WSREP: Starting applier thread 7 |
2023-05-31 15:25:15 15 [Note] WSREP: Starting applier thread 15 |
2023-05-31 15:25:15 9 [Note] WSREP: Starting applier thread 9 |
2023-05-31 15:25:15 12 [Note] WSREP: Starting applier thread 12 |
2023-05-31 15:25:15 13 [Note] WSREP: Starting applier thread 13 |
2023-05-31 15:25:15 17 [Note] WSREP: Starting applier thread 17 |
2023-05-31 15:25:15 0 [Warning] Neither --relay-log nor --relay-log-index were used; so replication may break when this MariaDB server acts as a replica and has its hostname changed. Please use '--log-basename=#' |
or '--relay-log=mysqld-relay-bin' to avoid this problem. |
2023-05-31 15:25:15 20 [Note] Slave I/O thread: Start asynchronous replication to master 'mdb_control@ovh7.vlan:3306' in log 'mysql-bin.054864' at position 452844281 |
2023-05-31 15:25:15 0 [Note] /usr/sbin/mariadbd: ready for connections. |
2023-05-31 15:25:15 21 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.054864' at position 447263261, relay log './mysqld-relay-bin.035980' position: 447263560 |
2023-05-31 15:25:15 3 [Note] WSREP: Recovered view from SST: |
2023-05-31 15:25:15 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:15 22 [Note] WSREP: Recovered cluster id 66eb3498-d920-11ed-892c-0669747ecf70 |
2023-05-31 15:25:15 3 [Note] WSREP: SST received: 66eb3498-d920-11ed-892c-0669747ecf70:149956352 |
2023-05-31 15:25:15 3 [Note] WSREP: SST succeeded for position 66eb3498-d920-11ed-892c-0669747ecf70:149956352 |
2023-05-31 15:25:15 0 [Note] WSREP: Joiner monitor thread ended with total time 2 sec |
2023-05-31 15:25:15 2 [Note] WSREP: Installed new state from SST: 66eb3498-d920-11ed-892c-0669747ecf70:149956352 |
2023-05-31 15:25:15 2 [Note] WSREP: Receiving IST: 2 writesets, seqnos 149956353-149956354 |
2023-05-31 15:25:15 0 [Note] WSREP: ####### IST applying starts with 149956353 |
2023-05-31 15:25:15 0 [Note] WSREP: ####### IST current seqno initialized to 149956266 |
2023-05-31 15:25:15 0 [Note] WSREP: Receiving IST... 0.0% ( 0/89 events) complete. |
2023-05-31 15:25:15 0 [Note] WSREP: IST preload starting at 149956266 |
2023-05-31 15:25:15 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:15 0 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:149956265, protocol version: 5 |
2023-05-31 15:25:15 21 [ERROR] WSREP: Unknown writeset version: -1 |
2023-05-31 15:25:15 20 [Note] Slave I/O thread: connected to master 'mdb_control@ovh7.vlan:3306',replication started in log 'mysql-bin.054864' at position 452844281 |
2023-05-31 15:25:15 0 [Note] WSREP: REPL Protocols: 10 (5) |
2023-05-31 15:25:15 0 [Note] WSREP: ####### Adjusting cert position: 149956352 -> 149956353 |
2023-05-31 15:25:15 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:15 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 149956266 |
2023-05-31 15:25:15 0 [Note] WSREP: Min available from gcache for CC from ist: 149955355 |
2023-05-31 15:25:15 10 [Note] WSREP: ================================================ |
2023-05-31 15:25:15 10 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:15 0 [Note] WSREP: REPL Protocols: 10 (5) |
2023-05-31 15:25:15 0 [Note] WSREP: ####### Adjusting cert position: 149956353 -> 149956354 |
2023-05-31 15:25:15 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:15 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 149956266 |
2023-05-31 15:25:15 0 [Note] WSREP: Min available from gcache for CC from ist: 149955355 |
2023-05-31 15:25:15 0 [Note] WSREP: Receiving IST...100.0% (89/89 events) complete. |
2023-05-31 15:25:15 11 [Note] WSREP: ================================================ |
2023-05-31 15:25:15 11 [Note] WSREP: Server status change initialized -> joined |
2023-05-31 15:25:15 11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:15 11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:15 2 [Note] WSREP: Draining apply monitors after IST up to 149956354 |
2023-05-31 15:25:15 2 [Note] WSREP: IST received: 66eb3498-d920-11ed-892c-0669747ecf70:149956354 |
2023-05-31 15:25:15 2 [Note] WSREP: Lowest cert index boundary for CC from sst: 149956266 |
2023-05-31 15:25:15 2 [Note] WSREP: Min available from gcache for CC from sst: 149955355 |
2023-05-31 15:25:15 0 [Note] WSREP: 1.0 (ovh5.1check.com): State transfer from 2.0 (ovh3.1check.com) complete. |
2023-05-31 15:25:15 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 149956354) |
2023-05-31 15:25:15 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete. |
2023-05-31 15:25:15 0 [Note] WSREP: Member 1.0 (ovh5.1check.com) synced with group. |
2023-05-31 15:25:15 0 [Note] WSREP: Processing event queue:...100.0% (1/1 events) complete. |
2023-05-31 15:25:15 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 149956354) |
2023-05-31 15:25:15 2 [Note] WSREP: Server ovh5.1check.com synced with group |
2023-05-31 15:25:15 2 [Note] WSREP: Server status change joined -> synced |
2023-05-31 15:25:15 2 [Note] WSREP: Synchronized with group, ready for connections |
2023-05-31 15:25:15 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:15 0 [Note] WSREP: (926ef5ee-a06b, 'tcp://0.0.0.0:4567') turning message relay requesting off |
2023-05-31 15:25:38 0 [Note] Starting MariaDB 10.6.13-MariaDB-1:10.6.13+maria~ubu2204-log source revision a24f2bb50ba4a0dd4127455f7fcdfed584937f36 as process 1266704 |
2023-05-31 15:25:38 0 [Note] WSREP: Loading provider /usr/lib/galera/libgalera_smm.so initial position: 66eb3498-d920-11ed-892c-0669747ecf70:149956354 |
2023-05-31 15:25:38 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' |
2023-05-31 15:25:38 0 [Note] WSREP: wsrep_load(): Galera 26.4.14(r06a0c285) by Codership Oy <info@codership.com> loaded successfully. |
2023-05-31 15:25:38 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration. |
2023-05-31 15:25:38 0 [Note] WSREP: Found saved state: 66eb3498-d920-11ed-892c-0669747ecf70:-1, safe_to_bootstrap: 0 |
2023-05-31 15:25:38 0 [Note] WSREP: GCache DEBUG: opened preamble: |
2023-05-31 15:25:38 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 66eb3498-d920-11ed-892c-0669747ecf70, offset: -1 |
2023-05-31 15:25:38 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/134217752 bytes) complete. |
2023-05-31 15:25:38 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (134217752/134217752 bytes) complete. |
2023-05-31 15:25:38 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 149955355-149956354 |
2023-05-31 15:25:38 0 [Note] WSREP: GCache::RingBuffer unused buffers scan... 0.0% ( 0/133564336 bytes) complete. |
2023-05-31 15:25:38 0 [Note] WSREP: Recovering GCache ring buffer: found 2/1002 locked buffers |
2023-05-31 15:25:38 0 [Note] WSREP: Recovering GCache ring buffer: free space: 653912/134217728 |
2023-05-31 15:25:38 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (133564336/133564336 bytes) complete. |
2023-05-31 15:25:38 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 192.168.0.5; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; |
evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs. |
stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.keep_plaintext_size = 128M; gcac |
he.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave |
= no; gcs.fc_single_primary = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; |
2023-05-31 15:25:38 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:38 0 [Note] WSREP: ####### Assign initial position for certification: 66eb3498-d920-11ed-892c-0669747ecf70:149956354, protocol version: -1 |
2023-05-31 15:25:38 0 [Note] WSREP: Start replication |
2023-05-31 15:25:38 0 [Note] WSREP: Connecting with bootstrap option: 0 |
2023-05-31 15:25:38 0 [Note] WSREP: Setting GCS initial position to 66eb3498-d920-11ed-892c-0669747ecf70:149956354 |
2023-05-31 15:25:38 0 [Note] WSREP: Using CRC-32C for message checksums. |
2023-05-31 15:25:38 0 [Note] WSREP: backend: asio |
2023-05-31 15:25:38 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 |
2023-05-31 15:25:38 0 [Note] WSREP: restore pc from disk successfully |
2023-05-31 15:25:38 0 [Note] WSREP: GMCast version 0 |
2023-05-31 15:25:38 0 [Note] WSREP: (926ef5ee-a06c, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 |
2023-05-31 15:25:38 0 [Note] WSREP: (926ef5ee-a06c, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 |
2023-05-31 15:25:38 0 [Note] WSREP: EVS version 1 |
2023-05-31 15:25:38 0 [Note] WSREP: gcomm: connecting to group 'MariaDB Galera Cluster', peer '192.168.0.3:,192.168.0.4:,192.168.0.5:' |
2023-05-31 15:25:38 0 [Note] WSREP: (926ef5ee-a06c, 'tcp://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address tcp://192.168.0.5:4567 |
2023-05-31 15:25:38 0 [Note] WSREP: (926ef5ee-a06c, 'tcp://0.0.0.0:4567') connection established to f4eb5d26-bd95 tcp://192.168.0.3:4567 |
2023-05-31 15:25:38 0 [Note] WSREP: (926ef5ee-a06c, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: |
2023-05-31 15:25:38 0 [Note] WSREP: (926ef5ee-a06c, 'tcp://0.0.0.0:4567') connection established to 01049457-8651 tcp://192.168.0.4:4567 |
2023-05-31 15:25:39 0 [Note] WSREP: gcomm: connected |
2023-05-31 15:25:39 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 |
2023-05-31 15:25:39 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) |
2023-05-31 15:25:39 0 [Note] WSREP: Opened channel 'MariaDB Galera Cluster' |
2023-05-31 15:25:39 1 [Note] WSREP: Starting rollbacker thread 1 |
2023-05-31 15:25:39 2 [Note] WSREP: Starting applier thread 2 |
2023-05-31 15:25:39 0 [Note] WSREP: EVS version upgrade 0 -> 1 |
2023-05-31 15:25:39 0 [Note] WSREP: declaring 01049457-8651 at tcp://192.168.0.4:4567 stable |
2023-05-31 15:25:39 0 [Note] WSREP: declaring f4eb5d26-bd95 at tcp://192.168.0.3:4567 stable |
2023-05-31 15:25:39 0 [Note] WSREP: PC protocol upgrade 0 -> 1 |
2023-05-31 15:25:39 0 [Note] WSREP: Node 01049457-8651 state prim |
2023-05-31 15:25:39 0 [Note] WSREP: view(view_id(PRIM,01049457-8651,13) memb { |
2023-05-31 15:25:39 0 [Note] WSREP: save pc into disk |
2023-05-31 15:25:39 0 [Note] WSREP: clear restored view |
2023-05-31 15:25:39 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 |
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. |
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a27d6d04-ffb6-11ed-b14e-4b8acb6c0e76 |
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: a27d6d04-ffb6-11ed-b14e-4b8acb6c0e76 from 0 (ovh4.1check.com) |
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: a27d6d04-ffb6-11ed-b14e-4b8acb6c0e76 from 1 (ovh5.1check.com) |
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: a27d6d04-ffb6-11ed-b14e-4b8acb6c0e76 from 2 (ovh3.1check.com) |
2023-05-31 15:25:39 0 [Note] WSREP: Quorum results: |
2023-05-31 15:25:39 0 [Note] WSREP: Flow-control interval: [28, 28] |
2023-05-31 15:25:39 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 149956356) |
2023-05-31 15:25:39 2 [Note] WSREP: ####### processing CC 149956356, local, ordered |
2023-05-31 15:25:39 2 [Note] WSREP: Process first view: 66eb3498-d920-11ed-892c-0669747ecf70 my uuid: 926ef5ee-ffb6-11ed-a06c-7e62ca0df787 |
2023-05-31 15:25:39 2 [Note] WSREP: Server ovh5.1check.com connected to cluster at position 66eb3498-d920-11ed-892c-0669747ecf70:149956356 with ID 926ef5ee-ffb6-11ed-a06c-7e62ca0df787 |
2023-05-31 15:25:39 2 [Note] WSREP: Server status change disconnected -> connected |
2023-05-31 15:25:39 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:39 2 [Note] WSREP: ####### My UUID: 926ef5ee-ffb6-11ed-a06c-7e62ca0df787 |
2023-05-31 15:25:39 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes |
2023-05-31 15:25:39 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:39 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1 |
2023-05-31 15:25:39 2 [Note] WSREP: State transfer required: |
2023-05-31 15:25:39 2 [Note] WSREP: Server status change connected -> joiner |
2023-05-31 15:25:39 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:39 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '192.168.0.5' --datadir '/var/lib/mysql/' --parent 1266704 --progress 0 --binlog '/var/lib/mysql/mysql-bin' --binlog-i |
ndex '/var/lib/mysql/mysql-bin.index' --mysqld-args --wsrep_start_position=66eb3498-d920-11ed-892c-0669747ecf70:149956354,300-1-5681' |
2023-05-31 15:25:39 0 [Note] WSREP: Joiner monitor thread started to monitor |
2023-05-31 15:25:39 0 [Note] WSREP: declaring f4eb5d26-bd95 at tcp://192.168.0.3:4567 stable |
2023-05-31 15:25:39 0 [Note] WSREP: forgetting 01049457-8651 (tcp://192.168.0.4:4567) |
2023-05-31 15:25:39 0 [Note] WSREP: Node 926ef5ee-a06c state prim |
2023-05-31 15:25:39 0 [Note] WSREP: view(view_id(PRIM,926ef5ee-a06c,14) memb { |
2023-05-31 15:25:39 0 [Note] WSREP: save pc into disk |
2023-05-31 15:25:39 0 [Note] WSREP: forgetting 01049457-8651 (tcp://192.168.0.4:4567) |
2023-05-31 15:25:39 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 |
2023-05-31 15:25:39 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a2c26082-ffb6-11ed-b1d4-d74da8a0e12f |
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a2c26082-ffb6-11ed-b1d4-d74da8a0e12f |
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: a2c26082-ffb6-11ed-b1d4-d74da8a0e12f from 0 (ovh5.1check.com) |
2023-05-31 15:25:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: a2c26082-ffb6-11ed-b1d4-d74da8a0e12f from 1 (ovh3.1check.com) |
2023-05-31 15:25:39 0 [Note] WSREP: Quorum results: |
2023-05-31 15:25:39 0 [Note] WSREP: Flow-control interval: [23, 23] |
2023-05-31 15:25:39 2 [Note] WSREP: ####### IST uuid:66eb3498-d920-11ed-892c-0669747ecf70 f: 149956355, l: 149956356, STRv: 3 |
2023-05-31 15:25:39 2 [Note] WSREP: IST receiver addr using tcp://192.168.0.5:4568 |
2023-05-31 15:25:39 2 [Note] WSREP: Prepared IST receiver for 149956355-149956356, listening at: tcp://192.168.0.5:4568 |
2023-05-31 15:25:39 0 [Note] WSREP: Member 0.0 (ovh5.1check.com) requested state transfer from '*any*'. Selected 1.0 (ovh3.1check.com)(SYNCED) as donor. |
2023-05-31 15:25:39 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 149956357) |
2023-05-31 15:25:39 2 [Note] WSREP: Requesting state transfer: success, donor: 1 |
2023-05-31 15:25:40 0 [Note] WSREP: 1.0 (ovh3.1check.com): State transfer to 0.0 (ovh5.1check.com) complete. |
2023-05-31 15:25:40 0 [Note] WSREP: Member 1.0 (ovh3.1check.com) synced with group. |
2023-05-31 15:25:40 3 [Note] WSREP: SST received |
2023-05-31 15:25:40 3 [Note] WSREP: Server status change joiner -> initializing |
2023-05-31 15:25:40 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:40 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 |
2023-05-31 15:25:40 0 [Note] InnoDB: Number of pools: 1 |
2023-05-31 15:25:40 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions |
2023-05-31 15:25:40 0 [Note] InnoDB: Initializing buffer pool, total size = 85899345920, chunk size = 134217728 |
2023-05-31 15:25:40 0 [Note] InnoDB: Completed initialization of buffer pool |
2023-05-31 15:25:40 0 [Note] InnoDB: 128 rollback segments are active. |
2023-05-31 15:25:41 0 [Note] InnoDB: Creating shared tablespace for temporary tables |
2023-05-31 15:25:41 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... |
2023-05-31 15:25:41 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. |
2023-05-31 15:25:41 0 [Note] InnoDB: 10.6.13 started; log sequence number 27984233119487; transaction id 4332371087 |
2023-05-31 15:25:41 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool |
2023-05-31 15:25:41 0 [Note] Plugin 'FEEDBACK' is disabled. |
2023-05-31 15:25:41 0 [Warning] 'innodb-adaptive-max-sleep-delay' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:41 0 [Warning] 'innodb-background-scrub-data-check-interval' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:41 0 [Warning] 'innodb-background-scrub-data-interval' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:41 0 [Warning] 'innodb-buffer-pool-instances' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:41 0 [Warning] 'innodb-concurrency-tickets' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:41 0 [Warning] 'innodb-buffer-pool-instances' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:41 0 [Note] Server socket created on IP: '0.0.0.0'. |
2023-05-31 15:25:41 0 [Warning] 'proxies_priv' entry '@% root@ovh2.1check.com' ignored in --skip-name-resolve mode. |
2023-05-31 15:25:41 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) |
2023-05-31 15:25:41 0 [Note] WSREP: Server initialized |
2023-05-31 15:25:41 0 [Note] WSREP: Server status change initializing -> initialized |
2023-05-31 15:25:41 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:41 3 [Note] WSREP: Recovered position from storage: 66eb3498-d920-11ed-892c-0669747ecf70:149956354 |
2023-05-31 15:25:41 10 [Note] WSREP: Starting applier thread 10 |
2023-05-31 15:25:41 15 [Note] WSREP: Starting applier thread 15 |
2023-05-31 15:25:41 11 [Note] WSREP: Starting applier thread 11 |
2023-05-31 15:25:41 9 [Note] WSREP: Starting applier thread 9 |
2023-05-31 15:25:41 14 [Note] WSREP: Starting applier thread 14 |
2023-05-31 15:25:41 12 [Note] WSREP: Starting applier thread 12 |
2023-05-31 15:25:41 8 [Note] WSREP: Starting applier thread 8 |
2023-05-31 15:25:41 7 [Note] WSREP: Starting applier thread 7 |
2023-05-31 15:25:41 0 [Warning] Neither --relay-log nor --relay-log-index were used; so replication may break when this MariaDB server acts as a replica and has its hostname changed. Please use '--log-basename=#' |
or '--relay-log=mysqld-relay-bin' to avoid this problem. |
2023-05-31 15:25:41 16 [Note] WSREP: Starting applier thread 16 |
2023-05-31 15:25:41 6 [Note] WSREP: Starting applier thread 6 |
2023-05-31 15:25:41 13 [Note] WSREP: Starting applier thread 13 |
2023-05-31 15:25:41 20 [Note] Slave I/O thread: Start asynchronous replication to master 'mdb_control@ovh7.vlan:3306' in log 'mysql-bin.054864' at position 565303427 |
2023-05-31 15:25:41 0 [Note] /usr/sbin/mariadbd: ready for connections. |
2023-05-31 15:25:41 21 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.054864' at position 447263261, relay log './mysqld-relay-bin.035980' position: 447263560 |
2023-05-31 15:25:41 20 [Note] Slave I/O thread: connected to master 'mdb_control@ovh7.vlan:3306',replication started in log 'mysql-bin.054864' at position 565303427 |
2023-05-31 15:25:41 3 [Note] WSREP: Recovered view from SST: |
2023-05-31 15:25:41 3 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:41 22 [Note] WSREP: Recovered cluster id 66eb3498-d920-11ed-892c-0669747ecf70 |
2023-05-31 15:25:41 21 [ERROR] WSREP: Unknown writeset version: -1 |
2023-05-31 15:25:41 3 [Note] WSREP: SST received: 66eb3498-d920-11ed-892c-0669747ecf70:149956354 |
2023-05-31 15:25:41 3 [Note] WSREP: SST succeeded for position 66eb3498-d920-11ed-892c-0669747ecf70:149956354 |
2023-05-31 15:25:41 0 [Note] WSREP: Joiner monitor thread ended with total time 2 sec |
2023-05-31 15:25:41 2 [Note] WSREP: Installed new state from SST: 66eb3498-d920-11ed-892c-0669747ecf70:149956354 |
2023-05-31 15:25:41 2 [Note] WSREP: Receiving IST: 2 writesets, seqnos 149956355-149956356 |
2023-05-31 15:25:41 0 [Note] WSREP: ####### IST applying starts with 149956355 |
2023-05-31 15:25:41 0 [Note] WSREP: ####### IST current seqno initialized to 149956266 |
2023-05-31 15:25:41 0 [Note] WSREP: Receiving IST... 0.0% ( 0/91 events) complete. |
2023-05-31 15:25:41 0 [Note] WSREP: IST preload starting at 149956266 |
2023-05-31 15:25:41 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:41 0 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:149956265, protocol version: 5 |
2023-05-31 15:25:41 0 [Note] WSREP: REPL Protocols: 10 (5) |
2023-05-31 15:25:41 0 [Note] WSREP: ####### Adjusting cert position: 149956352 -> 149956353 |
2023-05-31 15:25:41 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:41 0 [Note] WSREP: Lowest cert index boundary for CC from preload: 149956266 |
2023-05-31 15:25:41 0 [Note] WSREP: Min available from gcache for CC from preload: 149955355 |
2023-05-31 15:25:41 0 [Note] WSREP: REPL Protocols: 10 (5) |
2023-05-31 15:25:41 0 [Note] WSREP: ####### Adjusting cert position: 149956353 -> 149956354 |
2023-05-31 15:25:41 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:41 0 [Note] WSREP: Lowest cert index boundary for CC from preload: 149956266 |
2023-05-31 15:25:41 0 [Note] WSREP: Min available from gcache for CC from preload: 149955355 |
2023-05-31 15:25:41 0 [Note] WSREP: REPL Protocols: 10 (5) |
2023-05-31 15:25:41 0 [Note] WSREP: ####### Adjusting cert position: 149956354 -> 149956355 |
2023-05-31 15:25:41 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:41 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 149956266 |
2023-05-31 15:25:41 0 [Note] WSREP: Min available from gcache for CC from ist: 149955355 |
2023-05-31 15:25:41 10 [Note] WSREP: ================================================ |
2023-05-31 15:25:41 10 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:41 0 [Note] WSREP: REPL Protocols: 10 (5) |
2023-05-31 15:25:41 0 [Note] WSREP: ####### Adjusting cert position: 149956355 -> 149956356 |
2023-05-31 15:25:41 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:41 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 149956266 |
2023-05-31 15:25:41 0 [Note] WSREP: Min available from gcache for CC from ist: 149955355 |
2023-05-31 15:25:41 15 [Note] WSREP: ================================================ |
2023-05-31 15:25:41 15 [Note] WSREP: Server status change initialized -> joined |
2023-05-31 15:25:41 15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:41 15 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:41 0 [Note] WSREP: REPL Protocols: 10 (5) |
2023-05-31 15:25:41 0 [Note] WSREP: ####### Adjusting cert position: 149956356 -> 149956357 |
2023-05-31 15:25:41 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:41 0 [Note] WSREP: Lowest cert index boundary for CC from ist: 149956266 |
2023-05-31 15:25:41 0 [Note] WSREP: Min available from gcache for CC from ist: 149955355 |
2023-05-31 15:25:41 0 [Note] WSREP: Receiving IST...100.0% (91/91 events) complete. |
2023-05-31 15:25:41 11 [Note] WSREP: ================================================ |
2023-05-31 15:25:41 11 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:41 2 [Note] WSREP: Draining apply monitors after IST up to 149956357 |
2023-05-31 15:25:41 2 [Note] WSREP: IST received: 66eb3498-d920-11ed-892c-0669747ecf70:149956357 |
2023-05-31 15:25:41 2 [Note] WSREP: Lowest cert index boundary for CC from sst: 149956266 |
2023-05-31 15:25:41 2 [Note] WSREP: Min available from gcache for CC from sst: 149955355 |
2023-05-31 15:25:41 2 [Note] WSREP: ####### skipping local CC 149956357, keep in cache: false |
2023-05-31 15:25:41 0 [Note] WSREP: 0.0 (ovh5.1check.com): State transfer from 1.0 (ovh3.1check.com) complete. |
2023-05-31 15:25:41 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 149956357) |
2023-05-31 15:25:41 0 [Note] WSREP: Processing event queue:... -nan% (0/0 events) complete. |
2023-05-31 15:25:41 0 [Note] WSREP: Member 0.0 (ovh5.1check.com) synced with group. |
2023-05-31 15:25:41 0 [Note] WSREP: Processing event queue:...100.0% (1/1 events) complete. |
2023-05-31 15:25:41 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 149956357) |
2023-05-31 15:25:41 2 [Note] WSREP: Server ovh5.1check.com synced with group |
2023-05-31 15:25:41 2 [Note] WSREP: Server status change joined -> synced |
2023-05-31 15:25:41 2 [Note] WSREP: Synchronized with group, ready for connections |
2023-05-31 15:25:41 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:42 0 [Note] WSREP: (926ef5ee-a06c, 'tcp://0.0.0.0:4567') turning message relay requesting off |
2023-05-31 15:25:43 0 [Note] WSREP: Deferred close timer started for socket with remote endpoint: tcp://192.168.0.3:4567 |
2023-05-31 15:25:43 0 [Note] WSREP: forgetting f4eb5d26-bd95 (tcp://192.168.0.3:4567) |
2023-05-31 15:25:43 0 [Note] WSREP: Node 926ef5ee-a06c state prim |
2023-05-31 15:25:43 0 [Note] WSREP: view(view_id(PRIM,926ef5ee-a06c,15) memb { |
2023-05-31 15:25:43 0 [Note] WSREP: save pc into disk |
2023-05-31 15:25:43 0 [Note] WSREP: forgetting 01049457-8651 (tcp://192.168.0.4:4567) |
2023-05-31 15:25:43 0 [Note] WSREP: forgetting f4eb5d26-bd95 (tcp://192.168.0.3:4567) |
2023-05-31 15:25:43 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 |
2023-05-31 15:25:43 0 [Note] WSREP: Deferred close timer handle_wait Operation aborted. for 0x558ded050650 |
2023-05-31 15:25:43 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a4e8969e-ffb6-11ed-96dc-83893d590036 |
2023-05-31 15:25:43 0 [Note] WSREP: Deferred close timer destruct |
2023-05-31 15:25:43 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a4e8969e-ffb6-11ed-96dc-83893d590036 |
2023-05-31 15:25:43 0 [Note] WSREP: STATE EXCHANGE: got state msg: a4e8969e-ffb6-11ed-96dc-83893d590036 from 0 (ovh5.1check.com) |
2023-05-31 15:25:43 0 [Note] WSREP: Quorum results: |
2023-05-31 15:25:43 0 [Note] WSREP: Flow-control interval: [16, 16] |
2023-05-31 15:25:43 2 [Note] WSREP: ####### processing CC 149956358, local, ordered |
2023-05-31 15:25:43 2 [Note] WSREP: ####### My UUID: 926ef5ee-ffb6-11ed-a06c-7e62ca0df787 |
2023-05-31 15:25:43 2 [Note] WSREP: Skipping cert index reset |
2023-05-31 15:25:43 2 [Note] WSREP: REPL Protocols: 10 (5) |
2023-05-31 15:25:43 2 [Note] WSREP: ####### Adjusting cert position: 149956357 -> 149956358 |
2023-05-31 15:25:43 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:43 2 [Note] WSREP: ================================================ |
2023-05-31 15:25:43 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:43 2 [Note] WSREP: Lowest cert index boundary for CC from group: 149956266 |
2023-05-31 15:25:43 2 [Note] WSREP: Min available from gcache for CC from group: 149955355 |
2023-05-31 15:25:52 0 [Note] Starting MariaDB 10.6.13-MariaDB-1:10.6.13+maria~ubu2204-log source revision a24f2bb50ba4a0dd4127455f7fcdfed584937f36 as process 1267782 |
2023-05-31 15:25:52 0 [Note] WSREP: Loading provider /usr/lib/galera/libgalera_smm.so initial position: 66eb3498-d920-11ed-892c-0669747ecf70:149956358 |
2023-05-31 15:25:52 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' |
2023-05-31 15:25:52 0 [Note] WSREP: wsrep_load(): Galera 26.4.14(r06a0c285) by Codership Oy <info@codership.com> loaded successfully. |
2023-05-31 15:25:52 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration. |
2023-05-31 15:25:52 0 [Note] WSREP: Found saved state: 66eb3498-d920-11ed-892c-0669747ecf70:-1, safe_to_bootstrap: 1 |
2023-05-31 15:25:52 0 [Note] WSREP: GCache DEBUG: opened preamble: |
2023-05-31 15:25:52 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: 66eb3498-d920-11ed-892c-0669747ecf70, offset: -1 |
2023-05-31 15:25:52 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/134217752 bytes) complete. |
2023-05-31 15:25:52 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (134217752/134217752 bytes) complete. |
2023-05-31 15:25:52 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 149955355-149956358 |
2023-05-31 15:25:52 0 [Note] WSREP: GCache::RingBuffer unused buffers scan... 0.0% ( 0/133566128 bytes) complete. |
2023-05-31 15:25:52 0 [Note] WSREP: Recovering GCache ring buffer: found 5/1009 locked buffers |
2023-05-31 15:25:52 0 [Note] WSREP: Recovering GCache ring buffer: free space: 652896/134217728 |
2023-05-31 15:25:52 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (133566128/133566128 bytes) complete. |
2023-05-31 15:25:52 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 192.168.0.5; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; |
evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs. |
stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.keep_plaintext_size = 128M; gcac |
he.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave |
= no; gcs.fc_single_primary = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; |
2023-05-31 15:25:52 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:52 0 [Note] WSREP: ####### Assign initial position for certification: 66eb3498-d920-11ed-892c-0669747ecf70:149956358, protocol version: -1 |
2023-05-31 15:25:52 0 [Note] WSREP: Start replication |
2023-05-31 15:25:52 0 [Note] WSREP: Connecting with bootstrap option: 0 |
2023-05-31 15:25:52 0 [Note] WSREP: Setting GCS initial position to 66eb3498-d920-11ed-892c-0669747ecf70:149956358 |
2023-05-31 15:25:52 0 [Note] WSREP: Using CRC-32C for message checksums. |
2023-05-31 15:25:52 0 [Note] WSREP: backend: asio |
2023-05-31 15:25:52 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 |
2023-05-31 15:25:52 0 [Note] WSREP: restore pc from disk successfully |
2023-05-31 15:25:52 0 [Note] WSREP: GMCast version 0 |
2023-05-31 15:25:52 0 [Note] WSREP: (926ef5ee-a06d, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 |
2023-05-31 15:25:52 0 [Note] WSREP: (926ef5ee-a06d, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 |
2023-05-31 15:25:52 0 [Note] WSREP: EVS version 1 |
2023-05-31 15:25:52 0 [Note] WSREP: gcomm: connecting to group 'MariaDB Galera Cluster', peer '192.168.0.3:,192.168.0.4:,192.168.0.5:' |
2023-05-31 15:25:52 0 [Note] WSREP: (926ef5ee-a06d, 'tcp://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address tcp://192.168.0.5:4567 |
2023-05-31 15:25:55 0 [Note] WSREP: EVS version upgrade 0 -> 1 |
2023-05-31 15:25:55 0 [Note] WSREP: PC protocol upgrade 0 -> 1 |
2023-05-31 15:25:55 0 [Warning] WSREP: no nodes coming from prim view, prim not possible |
2023-05-31 15:25:55 0 [Note] WSREP: view(view_id(NON_PRIM,926ef5ee-a06d,17) memb { |
2023-05-31 15:25:55 0 [Note] WSREP: promote to primary component |
2023-05-31 15:25:55 0 [Note] WSREP: view(view_id(PRIM,926ef5ee-a06d,17) memb { |
2023-05-31 15:25:55 0 [Note] WSREP: save pc into disk |
2023-05-31 15:25:55 0 [Note] WSREP: discarding pending addr without UUID: tcp://192.168.0.3:4567 |
2023-05-31 15:25:55 0 [Note] WSREP: discarding pending addr without UUID: tcp://192.168.0.4:4567 |
2023-05-31 15:25:55 0 [Note] WSREP: clear restored view |
2023-05-31 15:25:55 0 [Note] WSREP: gcomm: connected |
2023-05-31 15:25:55 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 |
2023-05-31 15:25:55 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) |
2023-05-31 15:25:55 0 [Note] WSREP: Opened channel 'MariaDB Galera Cluster' |
2023-05-31 15:25:55 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 |
2023-05-31 15:25:55 0 [Note] WSREP: Flow-control interval: [16, 16] |
2023-05-31 15:25:55 0 [Note] WSREP: Received NON-PRIMARY. |
2023-05-31 15:25:55 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = yes, my_idx = 0, memb_num = 1 |
2023-05-31 15:25:55 1 [Note] WSREP: Starting rollbacker thread 1 |
2023-05-31 15:25:55 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: ac3a2da2-ffb6-11ed-ae03-fb57c8074e81 |
2023-05-31 15:25:55 0 [Note] WSREP: STATE EXCHANGE: sent state msg: ac3a2da2-ffb6-11ed-ae03-fb57c8074e81 |
2023-05-31 15:25:55 0 [Note] WSREP: STATE EXCHANGE: got state msg: ac3a2da2-ffb6-11ed-ae03-fb57c8074e81 from 0 (ovh5.1check.com) |
2023-05-31 15:25:55 2 [Note] WSREP: Starting applier thread 2 |
2023-05-31 15:25:55 0 [Warning] WSREP: Quorum: No node with complete state: |
2023-05-31 15:25:55 2 [Note] WSREP: ================================================ |
2023-05-31 15:25:55 0 [Warning] WSREP: No re-merged primary component found. |
2023-05-31 15:25:55 2 [Note] WSREP: Non-primary view |
2023-05-31 15:25:55 0 [Note] WSREP: Bootstrapped primary 00000000-0000-0000-0000-000000000000 found: 1. |
2023-05-31 15:25:55 2 [Note] WSREP: Server status change disconnected -> connected |
2023-05-31 15:25:55 0 [Note] WSREP: Quorum results: |
2023-05-31 15:25:55 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:55 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:55 0 [Note] WSREP: Flow-control interval: [16, 16] |
2023-05-31 15:25:55 0 [Note] WSREP: Restored state OPEN -> JOINED (149956359) |
2023-05-31 15:25:55 0 [Note] WSREP: Member 0.0 (ovh5.1check.com) synced with group. |
2023-05-31 15:25:55 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 149956359) |
2023-05-31 15:25:55 2 [Note] WSREP: ####### processing CC 149956359, local, ordered |
2023-05-31 15:25:55 2 [Note] WSREP: Process first view: 66eb3498-d920-11ed-892c-0669747ecf70 my uuid: 926ef5ee-ffb6-11ed-a06d-7e62ca0df787 |
2023-05-31 15:25:55 2 [Note] WSREP: Server ovh5.1check.com connected to cluster at position 66eb3498-d920-11ed-892c-0669747ecf70:149956359 with ID 926ef5ee-ffb6-11ed-a06d-7e62ca0df787 |
2023-05-31 15:25:55 2 [Note] WSREP: Server status change connected -> connected |
2023-05-31 15:25:55 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:55 2 [Note] WSREP: ####### My UUID: 926ef5ee-ffb6-11ed-a06d-7e62ca0df787 |
2023-05-31 15:25:55 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: no |
2023-05-31 15:25:55 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:55 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1 |
2023-05-31 15:25:55 2 [Note] WSREP: REPL Protocols: 10 (5) |
2023-05-31 15:25:55 2 [Note] WSREP: ####### Adjusting cert position: -1 -> 149956359 |
2023-05-31 15:25:55 0 [Note] WSREP: Service thread queue flushed. |
2023-05-31 15:25:55 2 [Note] WSREP: ================================================ |
2023-05-31 15:25:55 2 [Note] WSREP: Server status change connected -> joiner |
2023-05-31 15:25:55 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:55 2 [Note] WSREP: Server status change joiner -> initializing |
2023-05-31 15:25:55 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:55 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 |
2023-05-31 15:25:55 0 [Note] InnoDB: Number of pools: 1 |
2023-05-31 15:25:55 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions |
2023-05-31 15:25:55 0 [Note] InnoDB: Initializing buffer pool, total size = 85899345920, chunk size = 134217728 |
2023-05-31 15:25:55 0 [Note] InnoDB: Completed initialization of buffer pool |
2023-05-31 15:25:56 0 [Note] InnoDB: 128 rollback segments are active. |
2023-05-31 15:25:56 0 [Warning] WSREP: last inactive check more than PT1.5S ago (PT3.50269S), skipping check |
2023-05-31 15:25:56 0 [Note] InnoDB: Creating shared tablespace for temporary tables |
2023-05-31 15:25:56 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... |
2023-05-31 15:25:56 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. |
2023-05-31 15:25:56 0 [Note] InnoDB: 10.6.13 started; log sequence number 27984233129382; transaction id 4332371118 |
2023-05-31 15:25:56 0 [Note] Plugin 'FEEDBACK' is disabled. |
2023-05-31 15:25:56 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool |
2023-05-31 15:25:56 0 [Warning] 'innodb-adaptive-max-sleep-delay' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:56 0 [Warning] 'innodb-background-scrub-data-check-interval' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:56 0 [Warning] 'innodb-background-scrub-data-interval' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:56 0 [Warning] 'innodb-buffer-pool-instances' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:56 0 [Warning] 'innodb-concurrency-tickets' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:56 0 [Warning] 'innodb-buffer-pool-instances' was removed. It does nothing now and exists only for compatibility with old my.cnf files. |
2023-05-31 15:25:56 0 [Note] Server socket created on IP: '0.0.0.0'. |
2023-05-31 15:25:56 0 [Warning] 'proxies_priv' entry '@% root@ovh2.1check.com' ignored in --skip-name-resolve mode. |
2023-05-31 15:25:56 0 [Note] WSREP: wsrep_init_schema_and_SR (nil) |
2023-05-31 15:25:56 0 [Note] WSREP: Server initialized |
2023-05-31 15:25:56 0 [Note] WSREP: Server status change initializing -> initialized |
2023-05-31 15:25:56 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:56 6 [Note] WSREP: Starting applier thread 6 |
2023-05-31 15:25:56 9 [Note] WSREP: Starting applier thread 9 |
2023-05-31 15:25:56 15 [Note] WSREP: Starting applier thread 15 |
2023-05-31 15:25:56 8 [Note] WSREP: Starting applier thread 8 |
2023-05-31 15:25:56 11 [Note] WSREP: Starting applier thread 11 |
2023-05-31 15:25:56 10 [Note] WSREP: Starting applier thread 10 |
2023-05-31 15:25:56 13 [Note] WSREP: Starting applier thread 13 |
2023-05-31 15:25:56 12 [Note] WSREP: Starting applier thread 12 |
2023-05-31 15:25:56 17 [Note] WSREP: Starting applier thread 17 |
2023-05-31 15:25:56 7 [Note] WSREP: Starting applier thread 7 |
2023-05-31 15:25:56 14 [Note] WSREP: Starting applier thread 14 |
2023-05-31 15:25:56 0 [Warning] Neither --relay-log nor --relay-log-index were used; so replication may break when this MariaDB server acts as a replica and has its hostname changed. Please use '--log-basename=#' |
or '--relay-log=mysqld-relay-bin' to avoid this problem. |
2023-05-31 15:25:56 20 [Note] Slave I/O thread: Start asynchronous replication to master 'mdb_control@ovh7.vlan:3306' in log 'mysql-bin.054864' at position 758214120 |
2023-05-31 15:25:56 0 [Note] /usr/sbin/mariadbd: ready for connections. |
2023-05-31 15:25:56 21 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.054864' at position 447263261, relay log './mysqld-relay-bin.035980' position: 447263560 |
2023-05-31 15:25:57 20 [Note] Slave I/O thread: connected to master 'mdb_control@ovh7.vlan:3306',replication started in log 'mysql-bin.054864' at position 758214120 |
2023-05-31 15:25:57 5 [Note] WSREP: Recovered cluster id 66eb3498-d920-11ed-892c-0669747ecf70 |
2023-05-31 15:25:57 2 [Note] WSREP: Server status change initialized -> joined |
2023-05-31 15:25:57 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:57 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:25:57 2 [Note] WSREP: Lowest cert index boundary for CC from group: 149956359 |
2023-05-31 15:25:57 2 [Note] WSREP: Min available from gcache for CC from group: 149955355 |
2023-05-31 15:25:57 2 [Note] WSREP: Server ovh5.1check.com synced with group |
2023-05-31 15:25:57 2 [Note] WSREP: Server status change joined -> synced |
2023-05-31 15:25:57 2 [Note] WSREP: Synchronized with group, ready for connections |
2023-05-31 15:25:57 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:26:03 21 [Warning] Slave SQL: Could not execute Write_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Duplicate entry '_transient_doing_cron' for key 'option_name', Error_code: 1062; handler |
error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.054864, end_log_pos 822771838, Gtid 0-2-647104617, Internal MariaDB error code: 1062 |
2023-05-31 15:26:03 21 [ERROR] mariadbd: Can't find record in 'KuCOHYvNoptions' |
2023-05-31 15:26:03 21 [Warning] WSREP: Ignoring error 'Can't find record in 'KuCOHYvNoptions'' on Delete_rows_v1 event. Error_code: 1032 |
2023-05-31 15:26:03 21 [Warning] Slave SQL: Could not execute Delete_rows_v1 event on table 1check_front_uw.KuCOHYvNoptions; Can't find record in 'KuCOHYvNoptions', Error_code: 1032; handler error HA_ERR_KEY_NOT_ |
FOUND; the event's master log mysql-bin.054864, end_log_pos 824441663, Gtid 0-2-647104633, Internal MariaDB error code: 1032 |
2023-05-31 15:26:08 0 [Note] InnoDB: Buffer pool(s) load completed at 230531 15:26:08 |
2023-05-31 15:26:13 0 [Note] /usr/sbin/mariadbd (initiated by: unknown): Normal shutdown |
2023-05-31 15:26:13 0 [Note] WSREP: Shutdown replication |
2023-05-31 15:26:13 0 [Note] WSREP: Server status change synced -> disconnecting |
2023-05-31 15:26:13 0 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. |
2023-05-31 15:26:13 0 [Note] WSREP: Closing send monitor... |
2023-05-31 15:26:13 0 [Note] WSREP: Closed send monitor. |
2023-05-31 15:26:13 0 [Note] WSREP: gcomm: terminating thread |
2023-05-31 15:26:13 0 [Note] WSREP: gcomm: joining thread |
2023-05-31 15:26:13 0 [Note] WSREP: gcomm: closing backend |
2023-05-31 15:26:13 0 [Note] WSREP: PC protocol downgrade 1 -> 0 |
2023-05-31 15:26:13 0 [Note] WSREP: view((empty)) |
2023-05-31 15:26:13 0 [Note] WSREP: gcomm: closed |
2023-05-31 15:26:13 0 [Note] WSREP: New SELF-LEAVE. |
2023-05-31 15:26:13 0 [Note] WSREP: Flow-control interval: [0, 0] |
2023-05-31 15:26:13 0 [Note] WSREP: Received SELF-LEAVE. Closing connection. |
2023-05-31 15:26:13 0 [Note] WSREP: Shifting SYNCED -> CLOSED (TO: 149960993) |
2023-05-31 15:26:13 0 [Note] WSREP: RECV thread exiting 0: Success |
2023-05-31 15:26:13 0 [Note] WSREP: recv_thread() joined. |
|
Attachments
Issue Links
- relates to
-
-
- Open
-
Activity
Seems to be solved in 10.6.14 !? Upgraded all 3 nodes, replication slave restarted just fine.
I am having this issue with 10.6.15
I have just upgraded from 10.6.11 -> 10.6.15 in a rolling manner using MaxScale to Out of Service each server in turn.
When I did nodes 2/3 it was fine. On node 1 (the replica) I have to set "skip-slave-start" in the config file else it crashes with the same error. It looks like it's trying to start replication before it's caught up with the cluster.
2023-08-30 12:24:58 1 [Note] WSREP: Receiving IST: 124464 writesets, seqnos 40854195210-408543196732023-08-30 12:24:58 0 [Note] WSREP: ####### IST applying starts with 408541952102023-08-30 12:24:58 0 [Note] WSREP: ####### IST current seqno initialized to 408541952102023-08-30 12:24:58 0 [Note] WSREP: Receiving IST... 0.0% ( 0/124464 events) complete.2023-08-30 12:24:58 0 [Note] WSREP: Service thread queue flushed.2023-08-30 12:24:58 0 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:40854195209, protocol version: 52023-08-30 12:24:58 19 [Note] Slave I/O thread: Start asynchronous replication to master 'replication@<hostname>:3306' in log 'mysql-bin.000022' at position 42023-08-30 12:24:58 0 [Note] /usr/sbin/mariadbd: ready for connections.Version: '10.6.15-MariaDB-log' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server2023-08-30 12:24:58 20 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.000022' at position 4, relay log './<hostname>-relay-bin.000001' position: 4; GTID position '0-998-1873739337,127-10-17160,232-10-60310194229'2023-08-30 12:24:58 19 [Note] Slave I/O thread: connected to master 'replication@<hostname>:3306',replication starts at GTID position '0-998-1873739337,232-10-60310194229,127-10-17160'2023-08-30 12:24:59 20 [ERROR] WSREP: Unknown writeset version: -1230830 12:24:59 [ERROR] mysqld got signal 6 ;This could be because you hit a bug. It is also possible that this binaryor one of the libraries it was linked against is corrupt, improperly built,or misconfigured. This error can also be caused by malfunctioning hardware.Server version: 10.6.15-MariaDB-log source revision: 0d16eb35bc981023ce2f4912e8ecde68ca381f4ekey_buffer_size=134217728read_buffer_size=131072max_used_connections=0max_threads=1026thread_count=13It is possible that mysqld could use up tokey_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 2390522 K bytes of memoryHope that's ok; if not, decrease some variables in the equation.Thread pointer: 0x7f1c800008d8Attempting backtrace. You can use the following information to find outwhere mysqld died. If you see no messages after this, something wentterribly wrong...stack_bottom = 0x7f1a5c1124e0 thread_stack 0x49000/usr/sbin/mariadbd(my_print_stacktrace+0x2e)[0x55fc2da0d37e]/usr/sbin/mariadbd(handle_fatal_signal+0x307)[0x55fc2d45fcc7]sigaction.c:0(__restore_rt)[0x7f1dee983630]/lib64/libc.so.6(gsignal+0x37)[0x7f1deddce387]/lib64/libc.so.6(abort+0x148)[0x7f1deddcfa78]src/write_set_ng.hpp:167(galera::WriteSetNG::Header::size(galera::WriteSetNG::Version))[0x7f1de2be12c8]src/write_set_ng.hpp:174(Header)[0x7f1de2be1cd7]src/trx_handle.hpp:1011(galera::TrxHandleMaster::write_set_out())[0x7f1de2bdd048]/usr/sbin/mariadbd(_ZN5wsrep18wsrep_provider_v2610append_keyERNS_9ws_handleERKNS_3keyE+0xb7)[0x55fc2daa7c87]/usr/sbin/mariadbd(_ZN5wsrep11transaction10append_keyERKNS_3keyE+0x46)[0x55fc2daa07b6]/usr/sbin/mariadbd(wsrep_thd_append_key+0xfd)[0x55fc2d730a1d]/usr/sbin/mariadbd(+0xccf5bb)[0x55fc2d7435bb]/usr/sbin/mariadbd(+0xcdb4d4)[0x55fc2d74f4d4]/usr/sbin/mariadbd(+0xcea0b1)[0x55fc2d75e0b1]/usr/sbin/mariadbd(_ZN7handler12ha_write_rowEPKh+0x27d)[0x55fc2d46ecfd]/usr/sbin/mariadbd(_ZN14Rows_log_event9write_rowEP14rpl_group_infob+0x265)[0x55fc2d583215]/usr/sbin/mariadbd(_ZN20Write_rows_log_event11do_exec_rowEP14rpl_group_info+0x10e)[0x55fc2d58370e]/usr/sbin/mariadbd(_ZN14Rows_log_event14do_apply_eventEP14rpl_group_info+0x31d)[0x55fc2d57915d]/usr/sbin/mariadbd(+0x70c5ff)[0x55fc2d1805ff]/usr/sbin/mariadbd(handle_slave_sql+0x1aae)[0x55fc2d18adee]/usr/sbin/mariadbd(+0xc3644c)[0x55fc2d6aa44c]pthread_create.c:0(start_thread)[0x7f1dee97bea5]2023-08-30 12:24:59 21 [Warning] IP address '192.168.235.78' could not be resolved: Name or service not known/lib64/libc.so.6(clone+0x6d)[0x7f1dede96b0d