[MDEV-33089] IST Failes sporadically - IST started with wrong seqno - Jira

XML

Word

Printable

Details

Type: Bug
Status: Open (View Workflow)
Priority: Major
Resolution: Unresolved
Affects Version/s: 10.6.16
Fix Version/s: None
Component/s: Galera
Labels:
None
Environment:
Dockerhub Mariadb Image mariadb:10.6.16

Description

Background

We are running a 3 node Galera Cluster in Kubernetes, the nodes having names mariadb-0, mariadb-1 and mariadb-2. Every night, the mariadb-2 node is shutdown, a virtual machine backup is pulled and afterwards, the node is started again. After starting up again, the node normally receives an IST and is synched with the cluster again. Every ~14 days the IST fails with the below shown error and the node leaves the cluster. We need to manually restart the node such that it receives an SST an joines the cluster. We hoped that this behavior is fixed with 10.6.16 version that we updated to 1 month ago (coming from 10.6.10) but the error still occurs.

Do you have any feedback on the possible origin of this problem? Might it be a configuration problem or maybe a Galera bug?

Thank you for any help!

Environment Variables

MARIADB_AUTO_UPGRADE=true

LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libjemalloc.so.2

Mariadb Configuration

[mysqld]

port=3306

innodb_autoinc_lock_mode=2

innodb_flush_log_at_trx_commit=1

binlog_format=row

binlog_row_image=minimal

skip-log-bin

log_warnings=2

innodb_buffer_pool_size=8G

innodb_log_file_size=1G

innodb_log_buffer_size=256M

innodb_flush_method=O_DIRECT_NO_FSYNC

join_buffer_size=4M

read_buffer_size=128K

read_rnd_buffer_size=256K

max_connections=1000

max_allowed_packet=32M

max_heap_table_size=256M

tmp_table_size=256M

query_cache_size=0

query_cache_type=0

thread_stack=1M

wait_timeout=3600

tmp_table_size=134217728  # 128MB

tmpdir=/tmpdir/tmp_data_dir

plugin_load_add=query_response_time

query_response_time_stats=1

performance_schema=ON

## server_audit plugin and settings

plugin_load_add = server_audit

server_audit=FORCE_PLUS_PERMANENT

server_audit_logging=ON

server_audit_events = 'CONNECT,QUERY_DDL,QUERY_DCL'

server_audit_excl_users=''

server_audit_output_type=FILE

server_audit_file_path='/logs/server_audit.log'

server_audit_file_rotate_size=52430000

server_audit_file_rotations=3

[galera]

wsrep_on=ON

wsrep_provider=/usr/lib/libgalera_smm.so

wsrep_cluster_name=galera

wsrep_cluster_address=gcomm://mariadb-0.mariadb-headless.default,mariadb-1.mariadb-headless.default,mariadb-2.mariadb-headless.default

wsrep_sst_method=rsync

wsrep_sst_auth=root:<anonamized>

wsrep_trx_fragment_size=20971520

wsrep_log_conflicts=1

wsrep_provider_options="evs.auto_evict=10;evs.inactive_check_period=PT1S;evs.inactive_timeout=PT1M;evs.install_timeout=PT1M;evs.join_retrans_period=PT2S;evs.keepalive_period=PT3S;evs.send_window=128;evs.suspect_timeout=PT30S;evs.user_send_window=64;gcache.recover=yes;gcache.size=12G;gcs.fc_factor=0.8;gcs.fc_limit=60;gcs.max_packet_size=1048576;pc.announce_timeout=PT10S;pc.wait_prim_timeout=PT1M;gmcast.peer_timeout=PT30S"

wsrep_slave_threads=2

userstat=1

Logs mariadb-0

2023-12-17T01:00:54.814035894+01:00 - WSREP: declaring 6e84ca2d-bb68 at tcp://10.42.5.58:4567 stable

2023-12-17T01:00:54.814086902+01:00 - WSREP: forgetting 457604bf-ab05 (tcp://10.42.6.86:4567)

2023-12-17T01:00:54.814951683+01:00 - WSREP: Node 423537e6-ab31 state prim

2023-12-17T01:00:54.815692239+01:00 - WSREP: view(view_id(PRIM,423537e6-ab31,46) memb {

2023-12-17T01:00:54.815760478+01:00 - WSREP: save pc into disk

2023-12-17T01:00:54.848993287+01:00 - WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2

2023-12-17T01:00:54.849185351+01:00 - WSREP: STATE_EXCHANGE: sent state UUID: 594b8860-9c6f-11ee-80ea-becbcedbb290

2023-12-17T01:00:54.854458842+01:00 - WSREP: STATE EXCHANGE: sent state msg: 594b8860-9c6f-11ee-80ea-becbcedbb290

2023-12-17T01:00:54.855223299+01:00 - WSREP: STATE EXCHANGE: got state msg: 594b8860-9c6f-11ee-80ea-becbcedbb290 from 0 (mariadb-0)

2023-12-17T01:00:54.856199145+01:00 - WSREP: STATE EXCHANGE: got state msg: 594b8860-9c6f-11ee-80ea-becbcedbb290 from 1 (mariadb-1)

2023-12-17T01:00:54.856234296+01:00 - WSREP: Quorum results:

2023-12-17T01:00:54.858139187+01:00 - WSREP: Flow-control interval: [68, 85]

2023-12-17T01:00:54.934440499+01:00 - WSREP: declaring 3edcaea3-aef3 at tcp://10.42.3.33:4567 stable

2023-12-17T01:00:54.934522621+01:00 - WSREP: forgetting 46542ab2-818e (tcp://10.42.4.47:4567)

2023-12-17T01:00:54.935617760+01:00 - WSREP: Node 17e148d8-b4a9 state prim

2023-12-17T01:00:54.936518466+01:00 - WSREP: view(view_id(PRIM,17e148d8-b4a9,32) memb {

2023-12-17T01:00:54.940019513+01:00 - WSREP: STATE_EXCHANGE: sent state UUID: 595967b6-9c6f-11ee-87ca-cf74a8535f0c

2023-12-17T01:00:54.944058676+01:00 - WSREP: STATE EXCHANGE: sent state msg: 595967b6-9c6f-11ee-87ca-cf74a8535f0c

2023-12-17T01:00:54.944702156+01:00 - WSREP: STATE EXCHANGE: got state msg: 595967b6-9c6f-11ee-87ca-cf74a8535f0c from 0 (mariadb-0)

2023-12-17T01:00:54.944799365+01:00 - WSREP: STATE EXCHANGE: got state msg: 595967b6-9c6f-11ee-87ca-cf74a8535f0c from 1 (mariadb-1)

2023-12-17T01:00:54.944863997+01:00 - WSREP: ####### processing CC 71199416, local, ordered

2023-12-17T01:00:54.944867983+01:00 - WSREP: ####### My UUID: 17e148d8-98f7-11ee-b4a9-7f788a492eb6

2023-12-17T01:00:54.944873208+01:00 - WSREP: Skipping cert index reset

2023-12-17T01:00:54.944878622+01:00 - WSREP: REPL Protocols: 10 (5)

2023-12-17T01:00:54.944881890+01:00 - WSREP: ####### Adjusting cert position: 71199415 -> 71199416

2023-12-17T01:00:54.944900823+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:00:54.949900828+01:00 - WSREP: ================================================

2023-12-17T01:00:54.949920273+01:00 - b30e8559-60da-11ed-9d97-1f6b96427920:71199416

2023-12-17T01:00:54.949923536+01:00 - primary

2023-12-17T01:00:54.949926285+01:00 - 4

2023-12-17T01:00:54.949929508+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:00:54.949932205+01:00 - no

2023-12-17T01:00:54.949934878+01:00 - 0

2023-12-17T01:00:54.949952043+01:00 - =================================================

2023-12-17T01:00:54.949956317+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:00:54.951384930+01:00 - WSREP: Lowest cert index boundary for CC from group: 71199399

2023-12-17T01:00:54.951393857+01:00 - WSREP: Min available from gcache for CC from group: 69801726

2023-12-17T01:00:55.474487151+01:00 - WSREP: ####### processing CC 66857104, local, ordered

2023-12-17T01:00:55.475682361+01:00 - WSREP: ####### My UUID: 423537e6-98f7-11ee-ab31-7e28caf67b8d

2023-12-17T01:00:55.475711818+01:00 - WSREP: Skipping cert index reset

2023-12-17T01:00:55.475721449+01:00 - WSREP: REPL Protocols: 10 (5)

2023-12-17T01:00:55.475729352+01:00 - WSREP: ####### Adjusting cert position: 66857103 -> 66857104

2023-12-17T01:00:55.475738212+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:00:55.480563381+01:00 - WSREP: ================================================

2023-12-17T01:00:55.480660277+01:00 - 9d24779a-4d3a-11ee-8450-466b2f30be09:66857104

2023-12-17T01:00:55.480667934+01:00 - primary

2023-12-17T01:00:55.480674321+01:00 - 4

2023-12-17T01:00:55.480681434+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:00:55.480688009+01:00 - no

2023-12-17T01:00:55.480695106+01:00 - 0

2023-12-17T01:00:55.480720173+01:00 - =================================================

2023-12-17T01:00:55.480726765+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:00:55.485698903+01:00 - WSREP: Lowest cert index boundary for CC from group: 66857096

2023-12-17T01:00:55.485717117+01:00 - WSREP: Min available from gcache for CC from group: 66844793

2023-12-17T01:01:00.118836565+01:00 - WSREP:  cleaning up 457604bf-ab05 (tcp://10.42.6.86:4567)

2023-12-17T01:01:00.318328031+01:00 - WSREP:  cleaning up 46542ab2-818e (tcp://10.42.4.47:4567)

2023-12-17T01:01:38.013422927+01:00 - WSREP: (423537e6-ab31, 'tcp://0.0.0.0:4567') connection established to 73039e80-8bd8 tcp://10.42.6.87:4567

2023-12-17T01:01:38.013476742+01:00 - WSREP: (423537e6-ab31, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:

2023-12-17T01:01:38.51022650+01:00 - WSREP: declaring 6e84ca2d-bb68 at tcp://10.42.5.58:4567 stable

2023-12-17T01:01:38.510277672+01:00 - WSREP: declaring 73039e80-8bd8 at tcp://10.42.6.87:4567 stable

2023-12-17T01:01:38.511349665+01:00 - WSREP: Node 423537e6-ab31 state prim

2023-12-17T01:01:38.512454402+01:00 - WSREP: view(view_id(PRIM,423537e6-ab31,47) memb {

2023-12-17T01:01:38.512550083+01:00 - WSREP: save pc into disk

2023-12-17T01:01:38.527933607+01:00 - WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3

2023-12-17T01:01:38.528105136+01:00 - WSREP: STATE_EXCHANGE: sent state UUID: 73546a87-9c6f-11ee-a7db-23178c90ffc5

2023-12-17T01:01:38.528841120+01:00 - WSREP: Action message in non-primary configuration from member 1

2023-12-17T01:01:38.529342203+01:00 - WSREP: Last Applied Action message in non-primary configuration from member 0

2023-12-17T01:01:38.529410040+01:00 - WSREP: STATE EXCHANGE: sent state msg: 73546a87-9c6f-11ee-a7db-23178c90ffc5

2023-12-17T01:01:38.530265426+01:00 - WSREP: STATE EXCHANGE: got state msg: 73546a87-9c6f-11ee-a7db-23178c90ffc5 from 0 (mariadb-0)

2023-12-17T01:01:38.530333240+01:00 - WSREP: STATE EXCHANGE: got state msg: 73546a87-9c6f-11ee-a7db-23178c90ffc5 from 1 (mariadb-1)

2023-12-17T01:01:39.010554534+01:00 - WSREP: STATE EXCHANGE: got state msg: 73546a87-9c6f-11ee-a7db-23178c90ffc5 from 2 (mariadb-2)

2023-12-17T01:01:39.010640388+01:00 - WSREP: Quorum results:

2023-12-17T01:01:39.010756248+01:00 - WSREP: Flow-control interval: [83, 104]

2023-12-17T01:01:39.010962401+01:00 - WSREP: ####### processing CC 66857297, local, ordered

2023-12-17T01:01:39.010997255+01:00 - WSREP: ####### My UUID: 423537e6-98f7-11ee-ab31-7e28caf67b8d

2023-12-17T01:01:39.011006861+01:00 - WSREP: Skipping cert index reset

2023-12-17T01:01:39.011013697+01:00 - WSREP: REPL Protocols: 10 (5)

2023-12-17T01:01:39.011043034+01:00 - WSREP: ####### Adjusting cert position: 66857296 -> 66857297

2023-12-17T01:01:39.011226757+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:01:39.023035582+01:00 - WSREP: ================================================

2023-12-17T01:01:39.023072713+01:00 - 9d24779a-4d3a-11ee-8450-466b2f30be09:66857297

2023-12-17T01:01:39.023079670+01:00 - primary

2023-12-17T01:01:39.023086422+01:00 - 4

2023-12-17T01:01:39.023094028+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:01:39.023100727+01:00 - no

2023-12-17T01:01:39.023107231+01:00 - 0

2023-12-17T01:01:39.023138536+01:00 - =================================================

2023-12-17T01:01:39.023145508+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:01:39.040303499+01:00 - WSREP: Lowest cert index boundary for CC from group: 66857285

2023-12-17T01:01:39.040317649+01:00 - WSREP: Min available from gcache for CC from group: 66844863

2023-12-17T01:01:39.551996758+01:00 - WSREP: Member 2.0 (mariadb-2) requested state transfer from '*any*'. Selected 1.0 (mariadb-1)(SYNCED) as donor.

2023-12-17T01:01:39.90758450+01:00 - WSREP: 1.0 (mariadb-1): State transfer to 2.0 (mariadb-2) complete.

2023-12-17T01:01:39.910785435+01:00 - WSREP: Member 1.0 (mariadb-1) synced with group.

2023-12-17T01:01:41.220476621+01:00 - WSREP: (17e148d8-b4a9, 'tcp://0.0.0.0:4567') connection established to 74eb7de0-b539 tcp://10.42.4.48:4567

2023-12-17T01:01:41.220965251+01:00 - WSREP: (17e148d8-b4a9, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:

2023-12-17T01:01:41.716884658+01:00 - WSREP: declaring 3edcaea3-aef3 at tcp://10.42.3.33:4567 stable

2023-12-17T01:01:41.716970902+01:00 - WSREP: declaring 74eb7de0-b539 at tcp://10.42.4.48:4567 stable

2023-12-17T01:01:41.719496115+01:00 - WSREP: Node 17e148d8-b4a9 state prim

2023-12-17T01:01:41.720617515+01:00 - WSREP: view(view_id(PRIM,17e148d8-b4a9,33) memb {

2023-12-17T01:01:41.720719418+01:00 - WSREP: save pc into disk

2023-12-17T01:01:41.729534315+01:00 - WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3

2023-12-17T01:01:41.729565354+01:00 - WSREP: STATE_EXCHANGE: sent state UUID: 753ce697-9c6f-11ee-9719-8ecaf51c5116

2023-12-17T01:01:41.923898249+01:00 - WSREP: STATE EXCHANGE: sent state msg: 753ce697-9c6f-11ee-9719-8ecaf51c5116

2023-12-17T01:01:41.926834884+01:00 - WSREP: STATE EXCHANGE: got state msg: 753ce697-9c6f-11ee-9719-8ecaf51c5116 from 0 (mariadb-0)

2023-12-17T01:01:41.926861922+01:00 - WSREP: STATE EXCHANGE: got state msg: 753ce697-9c6f-11ee-9719-8ecaf51c5116 from 1 (mariadb-1)

2023-12-17T01:01:42.216217909+01:00 - WSREP: STATE EXCHANGE: got state msg: 753ce697-9c6f-11ee-9719-8ecaf51c5116 from 2 (mariadb-2)

2023-12-17T01:01:42.216249860+01:00 - WSREP: Quorum results:

2023-12-17T01:01:42.216285594+01:00 - WSREP: Flow-control interval: [83, 104]

2023-12-17T01:01:42.216302319+01:00 - WSREP: ####### processing CC 71199518, local, ordered

2023-12-17T01:01:42.216306310+01:00 - WSREP: ####### My UUID: 17e148d8-98f7-11ee-b4a9-7f788a492eb6

2023-12-17T01:01:42.216309858+01:00 - WSREP: Skipping cert index reset

2023-12-17T01:01:42.216313764+01:00 - WSREP: REPL Protocols: 10 (5)

2023-12-17T01:01:42.216318998+01:00 - WSREP: ####### Adjusting cert position: 71199517 -> 71199518

2023-12-17T01:01:42.216408248+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:01:42.219349145+01:00 - WSREP: ================================================

2023-12-17T01:01:42.219368933+01:00 - b30e8559-60da-11ed-9d97-1f6b96427920:71199518

2023-12-17T01:01:42.219372801+01:00 - primary

2023-12-17T01:01:42.219376245+01:00 - 4

2023-12-17T01:01:42.219381815+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:01:42.219385756+01:00 - no

2023-12-17T01:01:42.219388522+01:00 - 0

2023-12-17T01:01:42.219415887+01:00 - =================================================

2023-12-17T01:01:42.219418633+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:01:42.221431543+01:00 - WSREP: Lowest cert index boundary for CC from group: 71199399

2023-12-17T01:01:42.221436476+01:00 - WSREP: Min available from gcache for CC from group: 69801859

2023-12-17T01:01:43.231143602+01:00 - WSREP: Member 2.0 (mariadb-2) requested state transfer from '*any*'. Selected 0.0 (mariadb-0)(SYNCED) as donor.

2023-12-17T01:01:43.231174815+01:00 - WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 71199518)

2023-12-17T01:01:43.23118910+01:00 - WSREP: Detected STR version: 1, req_len: 123, req: STRv1

2023-12-17T01:01:43.231209818+01:00 - WSREP: IST request: b30e8559-60da-11ed-9d97-1f6b96427920:71199415-71199518|tcp://10.42.4.48:4568

2023-12-17T01:01:43.231246096+01:00 - WSREP: Server status change synced -> donor

2023-12-17T01:01:43.231264489+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:01:43.231620861+01:00 - WSREP: Donor monitor thread started to monitor

2023-12-17T01:01:43.231659297+01:00 - WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '10.42.4.48:4444/rsync_sst' --local-port 3306 --socket '/run/mysqld/mysqld.sock' --progress 0 --datadir '/var/lib/mysql/' --gtid 'b30e8559-60da-11ed-9d97-1f6b96427920:71199415' --gtid-domain-id 0 --bypass'

2023-12-17T01:01:43.232265120+01:00 - WSREP: sst_donor_thread signaled with 0

2023-12-17T01:01:43.232984913+01:00 - WSREP: async IST sender starting to serve tcp://10.42.4.48:4568 sending 71199399-71199518, preload starts from 71199399

2023-12-17T01:01:43.233837772+01:00 - WSREP: IST sender 71199399 -> 71199518

2023-12-17T01:01:43.452070085+01:00 - WSREP: SST sent: b30e8559-60da-11ed-9d97-1f6b96427920:71199415

2023-12-17T01:01:43.452088717+01:00 - WSREP: Server status change donor -> joined

2023-12-17T01:01:43.453620194+01:00 - WSREP: 0.0 (mariadb-0): State transfer to 2.0 (mariadb-2) complete.

2023-12-17T01:01:43.453646373+01:00 - WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 71199518)

2023-12-17T01:01:43.453668247+01:00 - WSREP: Processing event queue:... -nan% (0/0 events) complete.

2023-12-17T01:01:43.456346154+01:00 - WSREP: Member 0.0 (mariadb-0) synced with group.

2023-12-17T01:01:43.456360565+01:00 - WSREP: Processing event queue:...100.0% (1/1 events) complete.

2023-12-17T01:01:43.456364393+01:00 - WSREP: Shifting JOINED -> SYNCED (TO: 71199518)

2023-12-17T01:01:43.456431755+01:00 - WSREP: Server mariadb-0 synced with group

2023-12-17T01:01:43.456436628+01:00 - WSREP: Server status change joined -> synced

2023-12-17T01:01:43.456439981+01:00 - WSREP: Synchronized with group, ready for connections

2023-12-17T01:01:43.462813284+01:00 - WSREP: Donor monitor thread ended with total time 0 sec

2023-12-17T01:01:45.723802275+01:00 - WSREP: async IST sender served

2023-12-17T01:01:45.793050786+01:00 - WSREP: 2.0 (mariadb-2): State transfer from 0.0 (mariadb-0) complete.

2023-12-17T01:01:45.795613694+01:00 - WSREP: Member 2.0 (mariadb-2) synced with group.

2023-12-17T01:01:49.275507779+01:00 - WSREP: declaring 6e84ca2d-bb68 at tcp://10.42.5.58:4567 stable

2023-12-17T01:01:49.275589013+01:00 - WSREP: forgetting 73039e80-8bd8 (tcp://10.42.6.87:4567)

2023-12-17T01:01:49.276453207+01:00 - WSREP: Node 423537e6-ab31 state prim

2023-12-17T01:01:49.277400097+01:00 - WSREP: view(view_id(PRIM,423537e6-ab31,48) memb {

2023-12-17T01:01:49.277427042+01:00 - WSREP: save pc into disk

2023-12-17T01:01:49.279993245+01:00 - WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2

2023-12-17T01:01:49.280022860+01:00 - WSREP: STATE_EXCHANGE: sent state UUID: 79bd0b14-9c6f-11ee-98ea-0eac9554d33f

2023-12-17T01:01:49.288845129+01:00 - WSREP: STATE EXCHANGE: sent state msg: 79bd0b14-9c6f-11ee-98ea-0eac9554d33f

2023-12-17T01:01:49.288887728+01:00 - WSREP: Action message in non-primary configuration from member 1

2023-12-17T01:01:49.289296766+01:00 - WSREP: STATE EXCHANGE: got state msg: 79bd0b14-9c6f-11ee-98ea-0eac9554d33f from 0 (mariadb-0)

2023-12-17T01:01:49.289307753+01:00 - WSREP: STATE EXCHANGE: got state msg: 79bd0b14-9c6f-11ee-98ea-0eac9554d33f from 1 (mariadb-1)

2023-12-17T01:01:49.289310884+01:00 - WSREP: Quorum results:

2023-12-17T01:01:49.289389616+01:00 - WSREP: Flow-control interval: [68, 85]

2023-12-17T01:01:49.289485266+01:00 - WSREP: ####### processing CC 66857366, local, ordered

2023-12-17T01:01:49.289490209+01:00 - WSREP: ####### My UUID: 423537e6-98f7-11ee-ab31-7e28caf67b8d

2023-12-17T01:01:49.289495888+01:00 - WSREP: Skipping cert index reset

2023-12-17T01:01:49.289510272+01:00 - WSREP: REPL Protocols: 10 (5)

2023-12-17T01:01:49.289578619+01:00 - WSREP: ####### Adjusting cert position: 66857365 -> 66857366

2023-12-17T01:01:49.289648147+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:01:49.298684747+01:00 - WSREP: ================================================

2023-12-17T01:01:49.298743372+01:00 - 9d24779a-4d3a-11ee-8450-466b2f30be09:66857366

2023-12-17T01:01:49.298751314+01:00 - primary

2023-12-17T01:01:49.298757621+01:00 - 4

2023-12-17T01:01:49.298765986+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:01:49.298772493+01:00 - no

2023-12-17T01:01:49.298779011+01:00 - 0

2023-12-17T01:01:49.298823889+01:00 - =================================================

2023-12-17T01:01:49.298830592+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:01:49.305319744+01:00 - WSREP: Lowest cert index boundary for CC from group: 66857361

2023-12-17T01:01:49.305335962+01:00 - WSREP: Min available from gcache for CC from group: 66844881

2023-12-17T01:01:54.629033159+01:00 - WSREP:  cleaning up 73039e80-8bd8 (tcp://10.42.6.87:4567)

2023-12-17T01:01:55.132713239+01:00 - WSREP: (423537e6-ab31, 'tcp://0.0.0.0:4567') turning message relay requesting off

2023-12-17T01:02:11.335819474+01:00 - WSREP: (17e148d8-b4a9, 'tcp://0.0.0.0:4567') turning message relay requesting off

Logs mariadb-1

2023-12-17T01:00:54.814653386+01:00 - WSREP: declaring 423537e6-ab31 at tcp://10.42.4.58:4567 stable

2023-12-17T01:00:54.814727263+01:00 - WSREP: forgetting 457604bf-ab05 (tcp://10.42.6.86:4567)

2023-12-17T01:00:54.815376047+01:00 - WSREP: Node 423537e6-ab31 state prim

2023-12-17T01:00:54.849764814+01:00 - WSREP: view(view_id(PRIM,423537e6-ab31,46) memb {

2023-12-17T01:00:54.855074486+01:00 - WSREP: STATE EXCHANGE: sent state msg: 594b8860-9c6f-11ee-80ea-becbcedbb290

2023-12-17T01:00:54.855742018+01:00 - WSREP: STATE EXCHANGE: got state msg: 594b8860-9c6f-11ee-80ea-becbcedbb290 from 0 (mariadb-0)

2023-12-17T01:00:54.855811381+01:00 - WSREP: STATE EXCHANGE: got state msg: 594b8860-9c6f-11ee-80ea-becbcedbb290 from 1 (mariadb-1)

2023-12-17T01:00:54.859516147+01:00 - WSREP: ####### processing CC 66857104, local, ordered

2023-12-17T01:00:54.859527769+01:00 - WSREP: ####### My UUID: 6e84ca2d-99da-11ee-bb68-3b973b1b1e3a

2023-12-17T01:00:54.859535702+01:00 - WSREP: ####### Adjusting cert position: 66857103 -> 66857104

2023-12-17T01:00:54.866436799+01:00 - 9d24779a-4d3a-11ee-8450-466b2f30be09:66857104

2023-12-17T01:00:54.866439609+01:00 - primary

2023-12-17T01:00:54.866441675+01:00 - 4

2023-12-17T01:00:54.866444487+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:00:54.866447389+01:00 - no

2023-12-17T01:00:54.866449614+01:00 - 1

2023-12-17T01:00:54.866457947+01:00 - =================================================

2023-12-17T01:00:54.872649926+01:00 - WSREP: Lowest cert index boundary for CC from group: 66857096

2023-12-17T01:00:54.872668484+01:00 - WSREP: Min available from gcache for CC from group: 66844794

2023-12-17T01:00:54.935020610+01:00 - WSREP: (3edcaea3-aef3, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.42.4.47:4567

2023-12-17T01:00:54.935084237+01:00 - WSREP: declaring 17e148d8-b4a9 at tcp://10.42.2.35:4567 stable

2023-12-17T01:00:54.935091320+01:00 - WSREP: forgetting 46542ab2-818e (tcp://10.42.4.47:4567)

2023-12-17T01:00:54.935097729+01:00 - WSREP: (3edcaea3-aef3, 'tcp://0.0.0.0:4567') turning message relay requesting off

2023-12-17T01:00:54.935726228+01:00 - WSREP: Node 17e148d8-b4a9 state prim

2023-12-17T01:00:54.940294003+01:00 - WSREP: view(view_id(PRIM,17e148d8-b4a9,32) memb {

2023-12-17T01:00:54.940340436+01:00 - WSREP: save pc into disk

2023-12-17T01:00:54.943714081+01:00 - WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2

2023-12-17T01:00:54.943723375+01:00 - WSREP: STATE EXCHANGE: Waiting for state UUID.

2023-12-17T01:00:54.944258020+01:00 - WSREP: STATE EXCHANGE: sent state msg: 595967b6-9c6f-11ee-87ca-cf74a8535f0c

2023-12-17T01:00:54.944633058+01:00 - WSREP: STATE EXCHANGE: got state msg: 595967b6-9c6f-11ee-87ca-cf74a8535f0c from 0 (mariadb-0)

2023-12-17T01:00:54.944644391+01:00 - WSREP: STATE EXCHANGE: got state msg: 595967b6-9c6f-11ee-87ca-cf74a8535f0c from 1 (mariadb-1)

2023-12-17T01:00:54.944648368+01:00 - WSREP: Quorum results:

2023-12-17T01:00:54.944760642+01:00 - WSREP: Flow-control interval: [68, 85]

2023-12-17T01:00:54.945402282+01:00 - WSREP: ####### processing CC 71199416, local, ordered

2023-12-17T01:00:54.945414635+01:00 - WSREP: ####### My UUID: 3edcaea3-99c0-11ee-aef3-83dfcd3a0ad3

2023-12-17T01:00:54.945418266+01:00 - WSREP: Skipping cert index reset

2023-12-17T01:00:54.945421077+01:00 - WSREP: REPL Protocols: 10 (5)

2023-12-17T01:00:54.945423936+01:00 - WSREP: ####### Adjusting cert position: 71199415 -> 71199416

2023-12-17T01:00:54.945450453+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:00:54.949613218+01:00 - WSREP: ================================================

2023-12-17T01:00:54.949630181+01:00 - b30e8559-60da-11ed-9d97-1f6b96427920:71199416

2023-12-17T01:00:54.949633233+01:00 - primary

2023-12-17T01:00:54.949636119+01:00 - 4

2023-12-17T01:00:54.949639354+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:00:54.949642489+01:00 - no

2023-12-17T01:00:54.949645203+01:00 - 1

2023-12-17T01:00:54.949655810+01:00 - =================================================

2023-12-17T01:00:54.949659238+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:00:54.951498449+01:00 - WSREP: Lowest cert index boundary for CC from group: 71199399

2023-12-17T01:00:54.951507638+01:00 - WSREP: Min available from gcache for CC from group: 69796625

2023-12-17T01:01:00.168453431+01:00 - WSREP:  cleaning up 457604bf-ab05 (tcp://10.42.6.86:4567)

2023-12-17T01:01:00.314045906+01:00 - WSREP:  cleaning up 46542ab2-818e (tcp://10.42.4.47:4567)

2023-12-17T01:01:38.009954754+01:00 - WSREP: (6e84ca2d-bb68, 'tcp://0.0.0.0:4567') connection established to 73039e80-8bd8 tcp://10.42.6.87:4567

2023-12-17T01:01:38.010596354+01:00 - WSREP: (6e84ca2d-bb68, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:

2023-12-17T01:01:38.510941509+01:00 - WSREP: declaring 423537e6-ab31 at tcp://10.42.4.58:4567 stable

2023-12-17T01:01:38.510997217+01:00 - WSREP: declaring 73039e80-8bd8 at tcp://10.42.6.87:4567 stable

2023-12-17T01:01:38.512427783+01:00 - WSREP: Node 423537e6-ab31 state prim

2023-12-17T01:01:38.512875821+01:00 - WSREP: view(view_id(PRIM,423537e6-ab31,47) memb {

2023-12-17T01:01:38.513056441+01:00 - WSREP: save pc into disk

2023-12-17T01:01:38.526872171+01:00 - WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3

2023-12-17T01:01:38.526926579+01:00 - WSREP: STATE EXCHANGE: Waiting for state UUID.

2023-12-17T01:01:38.529732057+01:00 - WSREP: Last Applied Action message in non-primary configuration from member 0

2023-12-17T01:01:38.530111543+01:00 - WSREP: STATE EXCHANGE: sent state msg: 73546a87-9c6f-11ee-a7db-23178c90ffc5

2023-12-17T01:01:38.530533254+01:00 - WSREP: STATE EXCHANGE: got state msg: 73546a87-9c6f-11ee-a7db-23178c90ffc5 from 0 (mariadb-0)

2023-12-17T01:01:38.530552055+01:00 - WSREP: STATE EXCHANGE: got state msg: 73546a87-9c6f-11ee-a7db-23178c90ffc5 from 1 (mariadb-1)

2023-12-17T01:01:39.010786740+01:00 - WSREP: STATE EXCHANGE: got state msg: 73546a87-9c6f-11ee-a7db-23178c90ffc5 from 2 (mariadb-2)

2023-12-17T01:01:39.010869274+01:00 - WSREP: Quorum results:

2023-12-17T01:01:39.010968887+01:00 - WSREP: Flow-control interval: [83, 104]

2023-12-17T01:01:39.010989798+01:00 - WSREP: ####### processing CC 66857297, local, ordered

2023-12-17T01:01:39.011017614+01:00 - WSREP: ####### My UUID: 6e84ca2d-99da-11ee-bb68-3b973b1b1e3a

2023-12-17T01:01:39.011089990+01:00 - WSREP: Skipping cert index reset

2023-12-17T01:01:39.011098956+01:00 - WSREP: REPL Protocols: 10 (5)

2023-12-17T01:01:39.011126611+01:00 - WSREP: ####### Adjusting cert position: 66857296 -> 66857297

2023-12-17T01:01:39.011137823+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:01:39.018072983+01:00 - WSREP: ================================================

2023-12-17T01:01:39.018092611+01:00 - 9d24779a-4d3a-11ee-8450-466b2f30be09:66857297

2023-12-17T01:01:39.018096114+01:00 - primary

2023-12-17T01:01:39.018098316+01:00 - 4

2023-12-17T01:01:39.018102392+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:01:39.018104981+01:00 - no

2023-12-17T01:01:39.018107140+01:00 - 1

2023-12-17T01:01:39.018131223+01:00 - =================================================

2023-12-17T01:01:39.018133483+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:01:39.021447040+01:00 - WSREP: Lowest cert index boundary for CC from group: 66857285

2023-12-17T01:01:39.021476073+01:00 - WSREP: Min available from gcache for CC from group: 66844865

2023-12-17T01:01:39.552105226+01:00 - WSREP: Member 2.0 (mariadb-2) requested state transfer from '*any*'. Selected 1.0 (mariadb-1)(SYNCED) as donor.

2023-12-17T01:01:39.552147410+01:00 - WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 66857303)

2023-12-17T01:01:39.553182047+01:00 - WSREP: Detected STR version: 1, req_len: 123, req: STRv1

2023-12-17T01:01:39.554114212+01:00 - WSREP: IST request: 9d24779a-4d3a-11ee-8450-466b2f30be09:66857103-66857297|tcp://10.42.6.87:4568

2023-12-17T01:01:39.555455739+01:00 - WSREP: Server status change synced -> donor

2023-12-17T01:01:39.558360632+01:00 - WSREP: Donor monitor thread started to monitor

2023-12-17T01:01:39.559332899+01:00 - WSREP: Running: 'wsrep_sst_rsync --role 'donor' --address '10.42.6.87:4444/rsync_sst' --local-port 3306 --socket '/run/mysqld/mysqld.sock' --progress 0 --datadir '/var/lib/mysql/' --gtid '9d24779a-4d3a-11ee-8450-466b2f30be09:66857103' --gtid-domain-id 0 --bypass'

2023-12-17T01:01:39.562573341+01:00 - WSREP: sst_donor_thread signaled with 0

2023-12-17T01:01:39.570328178+01:00 - WSREP: async IST sender starting to serve tcp://10.42.6.87:4568 sending 66857104-66857297, preload starts from 66857285

2023-12-17T01:01:39.573547160+01:00 - WSREP: IST sender 66857104 -> 66857297

2023-12-17T01:01:39.906278565+01:00 - WSREP: SST sent: 9d24779a-4d3a-11ee-8450-466b2f30be09:66857103

2023-12-17T01:01:39.906323808+01:00 - WSREP: Server status change donor -> joined

2023-12-17T01:01:39.907747032+01:00 - WSREP: 1.0 (mariadb-1): State transfer to 2.0 (mariadb-2) complete.

2023-12-17T01:01:39.907765894+01:00 - WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 66857305)

2023-12-17T01:01:39.909930656+01:00 - WSREP: Processing event queue:... -nan% (0/0 events) complete.

2023-12-17T01:01:39.911051849+01:00 - WSREP: Member 1.0 (mariadb-1) synced with group.

2023-12-17T01:01:39.911063322+01:00 - WSREP: Processing event queue:...100.0% (1/1 events) complete.

2023-12-17T01:01:39.911066162+01:00 - WSREP: Shifting JOINED -> SYNCED (TO: 66857305)

2023-12-17T01:01:39.911170429+01:00 - WSREP: Server mariadb-1 synced with group

2023-12-17T01:01:39.911175404+01:00 - WSREP: Server status change joined -> synced

2023-12-17T01:01:39.911188882+01:00 - WSREP: Synchronized with group, ready for connections

2023-12-17T01:01:39.918427452+01:00 - WSREP: Donor monitor thread ended with total time 0 sec

2023-12-17T01:01:41.220477016+01:00 - WSREP: (3edcaea3-aef3, 'tcp://0.0.0.0:4567') connection established to 74eb7de0-b539 tcp://10.42.4.48:4567

2023-12-17T01:01:41.221336928+01:00 - WSREP: (3edcaea3-aef3, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:

2023-12-17T01:01:41.717374913+01:00 - WSREP: declaring 17e148d8-b4a9 at tcp://10.42.2.35:4567 stable

2023-12-17T01:01:41.717423648+01:00 - WSREP: declaring 74eb7de0-b539 at tcp://10.42.4.48:4567 stable

2023-12-17T01:01:41.719109859+01:00 - WSREP: Node 17e148d8-b4a9 state prim

2023-12-17T01:01:41.721424337+01:00 - WSREP: view(view_id(PRIM,17e148d8-b4a9,33) memb {

2023-12-17T01:01:41.721524896+01:00 - WSREP: save pc into disk

2023-12-17T01:01:41.734565063+01:00 - WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3

2023-12-17T01:01:41.734577409+01:00 - WSREP: STATE EXCHANGE: Waiting for state UUID.

2023-12-17T01:01:41.923660409+01:00 - WSREP: STATE EXCHANGE: sent state msg: 753ce697-9c6f-11ee-9719-8ecaf51c5116

2023-12-17T01:01:41.927026551+01:00 - WSREP: STATE EXCHANGE: got state msg: 753ce697-9c6f-11ee-9719-8ecaf51c5116 from 0 (mariadb-0)

2023-12-17T01:01:41.927068315+01:00 - WSREP: STATE EXCHANGE: got state msg: 753ce697-9c6f-11ee-9719-8ecaf51c5116 from 1 (mariadb-1)

2023-12-17T01:01:42.216419090+01:00 - WSREP: STATE EXCHANGE: got state msg: 753ce697-9c6f-11ee-9719-8ecaf51c5116 from 2 (mariadb-2)

2023-12-17T01:01:42.216456421+01:00 - WSREP: Quorum results:

2023-12-17T01:01:42.216494390+01:00 - WSREP: Flow-control interval: [83, 104]

2023-12-17T01:01:42.217099104+01:00 - WSREP: ####### processing CC 71199518, local, ordered

2023-12-17T01:01:42.217113988+01:00 - WSREP: ####### My UUID: 3edcaea3-99c0-11ee-aef3-83dfcd3a0ad3

2023-12-17T01:01:42.217118736+01:00 - WSREP: Skipping cert index reset

2023-12-17T01:01:42.217122443+01:00 - WSREP: REPL Protocols: 10 (5)

2023-12-17T01:01:42.217125765+01:00 - WSREP: ####### Adjusting cert position: 71199517 -> 71199518

2023-12-17T01:01:42.217129621+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:01:42.223099434+01:00 - WSREP: ================================================

2023-12-17T01:01:42.223145126+01:00 - b30e8559-60da-11ed-9d97-1f6b96427920:71199518

2023-12-17T01:01:42.223152684+01:00 - primary

2023-12-17T01:01:42.223158824+01:00 - 4

2023-12-17T01:01:42.223167950+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:01:42.223174308+01:00 - no

2023-12-17T01:01:42.223180302+01:00 - 1

2023-12-17T01:01:42.223210811+01:00 - =================================================

2023-12-17T01:01:42.223216861+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:01:42.225196288+01:00 - WSREP: Lowest cert index boundary for CC from group: 71199399

2023-12-17T01:01:42.225215762+01:00 - WSREP: Min available from gcache for CC from group: 69796725

2023-12-17T01:01:43.231159032+01:00 - WSREP: Member 2.0 (mariadb-2) requested state transfer from '*any*'. Selected 0.0 (mariadb-0)(SYNCED) as donor.

2023-12-17T01:01:43.453865948+01:00 - WSREP: 0.0 (mariadb-0): State transfer to 2.0 (mariadb-2) complete.

2023-12-17T01:01:43.456341925+01:00 - WSREP: Member 0.0 (mariadb-0) synced with group.

2023-12-17T01:01:45.792911584+01:00 - WSREP: 2.0 (mariadb-2): State transfer from 0.0 (mariadb-0) complete.

2023-12-17T01:01:45.795525846+01:00 - WSREP: Member 2.0 (mariadb-2) synced with group.

2023-12-17T01:01:49.276181306+01:00 - WSREP: declaring 423537e6-ab31 at tcp://10.42.4.58:4567 stable

2023-12-17T01:01:49.277548295+01:00 - WSREP: forgetting 73039e80-8bd8 (tcp://10.42.6.87:4567)

2023-12-17T01:01:49.277583153+01:00 - WSREP: Node 423537e6-ab31 state prim

2023-12-17T01:01:49.280740268+01:00 - WSREP: view(view_id(PRIM,423537e6-ab31,48) memb {

2023-12-17T01:01:49.280806088+01:00 - WSREP: save pc into disk

2023-12-17T01:01:49.286873370+01:00 - WSREP: async IST sender failed to serve tcp://10.42.6.87:4568: ist send failed: ', asio error 'Failed to write: Connection reset by peer: 104 (Connection reset by peer)

2023-12-17T01:01:49.286926713+01:00 - WSREP: async IST sender served

2023-12-17T01:01:49.288601041+01:00 - WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2

2023-12-17T01:01:49.288619990+01:00 - WSREP: STATE EXCHANGE: Waiting for state UUID.

2023-12-17T01:01:49.289332815+01:00 - WSREP: STATE EXCHANGE: sent state msg: 79bd0b14-9c6f-11ee-98ea-0eac9554d33f

2023-12-17T01:01:49.289869768+01:00 - WSREP: STATE EXCHANGE: got state msg: 79bd0b14-9c6f-11ee-98ea-0eac9554d33f from 0 (mariadb-0)

2023-12-17T01:01:49.289886997+01:00 - WSREP: STATE EXCHANGE: got state msg: 79bd0b14-9c6f-11ee-98ea-0eac9554d33f from 1 (mariadb-1)

2023-12-17T01:01:49.289897903+01:00 - WSREP: Quorum results:

2023-12-17T01:01:49.289995136+01:00 - WSREP: Flow-control interval: [68, 85]

2023-12-17T01:01:49.290076640+01:00 - WSREP: ####### processing CC 66857366, local, ordered

2023-12-17T01:01:49.290085945+01:00 - WSREP: ####### My UUID: 6e84ca2d-99da-11ee-bb68-3b973b1b1e3a

2023-12-17T01:01:49.290108218+01:00 - WSREP: Skipping cert index reset

2023-12-17T01:01:49.290111641+01:00 - WSREP: REPL Protocols: 10 (5)

2023-12-17T01:01:49.290120113+01:00 - WSREP: ####### Adjusting cert position: 66857365 -> 66857366

2023-12-17T01:01:49.290187215+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:01:49.312008867+01:00 - WSREP: ================================================

2023-12-17T01:01:49.312060033+01:00 - 9d24779a-4d3a-11ee-8450-466b2f30be09:66857366

2023-12-17T01:01:49.312064088+01:00 - primary

2023-12-17T01:01:49.312067563+01:00 - 4

2023-12-17T01:01:49.312072256+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:01:49.312076138+01:00 - no

2023-12-17T01:01:49.312079941+01:00 - 1

2023-12-17T01:01:49.312094425+01:00 - =================================================

2023-12-17T01:01:49.312099015+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:01:49.316511013+01:00 - WSREP: Lowest cert index boundary for CC from group: 66857361

2023-12-17T01:01:49.316548217+01:00 - WSREP: Min available from gcache for CC from group: 66844883

2023-12-17T01:01:54.678011913+01:00 - WSREP:  cleaning up 73039e80-8bd8 (tcp://10.42.6.87:4567)

2023-12-17T01:01:55.178296232+01:00 - WSREP: (6e84ca2d-bb68, 'tcp://0.0.0.0:4567') turning message relay requesting off

2023-12-17T01:02:11.329375363+01:00 - WSREP: (3edcaea3-aef3, 'tcp://0.0.0.0:4567') turning message relay requesting off

Logs mariadb-2

2023-12-17T01:00:54.805763670+01:00 - mysqld (initiated by: unknown): Normal shutdown

2023-12-17T01:00:54.805836878+01:00 - WSREP: Shutdown replication

2023-12-17T01:00:54.806685093+01:00 - WSREP: Server status change synced -> disconnecting

2023-12-17T01:00:54.806703555+01:00 - WSREP: Closing send monitor...

2023-12-17T01:00:54.806707630+01:00 - WSREP: Closed send monitor.

2023-12-17T01:00:54.806725549+01:00 - WSREP: gcomm: terminating thread

2023-12-17T01:00:54.806826301+01:00 - WSREP: gcomm: joining thread

2023-12-17T01:00:54.812134414+01:00 - WSREP: gcomm: closing backend

2023-12-17T01:00:54.813499126+01:00 - WSREP: view(view_id(NON_PRIM,423537e6-ab31,45) memb {

2023-12-17T01:00:54.813543135+01:00 - WSREP: PC protocol downgrade 1 -> 0

2023-12-17T01:00:54.813572527+01:00 - WSREP: view((empty))

2023-12-17T01:00:54.819225546+01:00 - WSREP: gcomm: closed

2023-12-17T01:00:54.819235675+01:00 - WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1

2023-12-17T01:00:54.819337981+01:00 - WSREP: Flow-control interval: [48, 60]

2023-12-17T01:00:54.819363943+01:00 - WSREP: Received NON-PRIMARY.

2023-12-17T01:00:54.819379642+01:00 - WSREP: Shifting SYNCED -> OPEN (TO: 66857103)

2023-12-17T01:00:54.819386334+01:00 - WSREP: New SELF-LEAVE.

2023-12-17T01:00:54.819393444+01:00 - WSREP: Flow-control interval: [0, 0]

2023-12-17T01:00:54.819399749+01:00 - WSREP: Received SELF-LEAVE. Closing connection.

2023-12-17T01:00:54.819405627+01:00 - WSREP: Shifting OPEN -> CLOSED (TO: 66857103)

2023-12-17T01:00:54.819428408+01:00 - WSREP: RECV thread exiting 0: Success

2023-12-17T01:00:54.819532468+01:00 - WSREP: recv_thread() joined.

2023-12-17T01:00:54.819537697+01:00 - WSREP: Closing replication queue.

2023-12-17T01:00:54.819539852+01:00 - WSREP: Closing slave action queue.

2023-12-17T01:00:54.934090108+01:00 - WSREP: view(view_id(NON_PRIM,17e148d8-b4a9,31) memb {

2023-12-17T01:00:54.934968056+01:00 - WSREP: Shifting SYNCED -> OPEN (TO: 71199415)

2023-12-17T01:00:54.934982917+01:00 - WSREP: Shifting OPEN -> CLOSED (TO: 71199415)

2023-12-17T01:00:54.935108514+01:00 - WSREP: ================================================

2023-12-17T01:00:54.935115969+01:00 - b30e8559-60da-11ed-9d97-1f6b96427920:71199415

2023-12-17T01:00:54.935119197+01:00 - non-primary

2023-12-17T01:00:54.935121905+01:00 - 4

2023-12-17T01:00:54.935125088+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:00:54.935127831+01:00 - no

2023-12-17T01:00:54.935130736+01:00 - 0

2023-12-17T01:00:54.935138794+01:00 - =================================================

2023-12-17T01:00:54.935141432+01:00 - WSREP: Non-primary view

2023-12-17T01:00:54.935154111+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:00:54.935439087+01:00 - b30e8559-60da-11ed-9d97-1f6b96427920:71199415

2023-12-17T01:00:54.935442627+01:00 - non-primary

2023-12-17T01:00:54.935445317+01:00 - 4

2023-12-17T01:00:54.935456810+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:00:54.935459780+01:00 - yes

2023-12-17T01:00:54.935462430+01:00 - -1

2023-12-17T01:00:54.935467786+01:00 - =================================================

2023-12-17T01:00:54.935473361+01:00 - WSREP: Server status change disconnecting -> disconnected

2023-12-17T01:00:54.943323477+01:00 - WSREP: Applier thread exiting ret: 0 thd: 6

2023-12-17T01:00:54.943341334+01:00 - WSREP: rollbacker thread exiting 1

2023-12-17T01:00:54.945293997+01:00 - WSREP: Applier thread exiting ret: 6 thd: 2

2023-12-17T01:00:54.945635939+01:00 - WSREP: dtor state: CLOSED

2023-12-17T01:00:54.945667707+01:00 - WSREP: MemPool(TrxHandleSlave): hit ratio: 0.998471, misses: 415, in use: 17, in pool: 398

2023-12-17T01:00:54.946335554+01:00 - WSREP: mon: entered 271351 oooe fraction 0 oool fraction 0

2023-12-17T01:00:54.946840811+01:00 - WSREP: mon: entered 271351 oooe fraction 0.0807847 oool fraction 0.000939742

2023-12-17T01:00:54.947852842+01:00 - WSREP: mon: entered 276032 oooe fraction 0 oool fraction 3.62277e-06

2023-12-17T01:00:54.947862187+01:00 - WSREP: cert index usage at exit 36

2023-12-17T01:00:54.947865641+01:00 - WSREP: cert trx map usage at exit 17

2023-12-17T01:00:54.947868781+01:00 - WSREP: deps set usage at exit 0

2023-12-17T01:00:54.947871457+01:00 - WSREP: avg deps dist 67.2046

2023-12-17T01:00:54.947874454+01:00 - WSREP: avg cert interval 12825.7

2023-12-17T01:00:54.947877203+01:00 - WSREP: cert index size 36

2023-12-17T01:00:54.947939820+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:00:54.949490695+01:00 - WSREP: wsdb trx map usage 0 conn query map usage 0

2023-12-17T01:00:54.949501908+01:00 - WSREP: MemPool(LocalTrxHandle): hit ratio: 0, misses: 0, in use: 0, in pool: 0

2023-12-17T01:00:54.952610784+01:00 - WSREP: Flushing memory map to disk...

2023-12-17T01:00:55.027582338+01:00 - InnoDB: FTS optimize thread exiting.

2023-12-17T01:00:55.032933753+01:00 - STOPPED

2023-12-17T01:00:55.032986385+01:00 - InnoDB: Starting shutdown...

2023-12-17T01:00:55.033046715+01:00 - InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool

2023-12-17T01:00:55.033115315+01:00 - InnoDB: Restricted to 32448 pages due to innodb_buf_pool_dump_pct=25

2023-12-17T01:00:55.042035470+01:00 - InnoDB: Buffer pool(s) dump completed at 231217  0:00:55

2023-12-17T01:00:55.429783873+01:00 - WSREP: Failed to report last committed 9d24779a-4d3a-11ee-8450-466b2f30be09:66857100, -77 (File descriptor in bad state)

2023-12-17T01:00:55.430426866+01:00 - WSREP: ================================================

2023-12-17T01:00:55.430449328+01:00 - 9d24779a-4d3a-11ee-8450-466b2f30be09:66857103

2023-12-17T01:00:55.430453849+01:00 - non-primary

2023-12-17T01:00:55.430457593+01:00 - 4

2023-12-17T01:00:55.430461851+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:00:55.430466130+01:00 - no

2023-12-17T01:00:55.430470332+01:00 - 0

2023-12-17T01:00:55.430482637+01:00 - =================================================

2023-12-17T01:00:55.430486804+01:00 - WSREP: Non-primary view

2023-12-17T01:00:55.430490522+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:00:55.437437191+01:00 - 9d24779a-4d3a-11ee-8450-466b2f30be09:66857103

2023-12-17T01:00:55.437445775+01:00 - non-primary

2023-12-17T01:00:55.437452479+01:00 - 4

2023-12-17T01:00:55.437461336+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:00:55.437469126+01:00 - yes

2023-12-17T01:00:55.437476648+01:00 - -1

2023-12-17T01:00:55.437491414+01:00 - =================================================

2023-12-17T01:00:56.899005999+01:00 - InnoDB: Removed temporary tablespace data file: "./ibtmp1"

2023-12-17T01:00:56.899067271+01:00 - InnoDB: Shutdown completed; log sequence number 627487528840; transaction id 241031191

2023-12-17T01:00:56.908765215+01:00 - mysqld: Shutdown complete

2023-12-17T01:00:59.100266350+01:00 - WSREP: Server status change disconnecting -> disconnected

2023-12-17T01:00:59.100310392+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:00:59.101366148+01:00 - WSREP: Applier thread exiting ret: 6 thd: 2

2023-12-17T01:00:59.102104305+01:00 - WSREP: Applier thread exiting ret: 0 thd: 6

2023-12-17T01:00:59.102412461+01:00 - WSREP: rollbacker thread exiting 1

2023-12-17T01:00:59.102764558+01:00 - WSREP: dtor state: CLOSED

2023-12-17T01:00:59.102776963+01:00 - WSREP: MemPool(TrxHandleSlave): hit ratio: 0.999516, misses: 301, in use: 8, in pool: 293

2023-12-17T01:00:59.103328614+01:00 - WSREP: mon: entered 622056 oooe fraction 0 oool fraction 0

2023-12-17T01:00:59.103921250+01:00 - WSREP: mon: entered 622056 oooe fraction 0.366136 oool fraction 0.0561782

2023-12-17T01:00:59.105681993+01:00 - WSREP: mon: entered 743077 oooe fraction 0 oool fraction 1.34576e-06

2023-12-17T01:00:59.105701454+01:00 - WSREP: cert index usage at exit 5753

2023-12-17T01:00:59.105711355+01:00 - WSREP: cert trx map usage at exit 8

2023-12-17T01:00:59.105714012+01:00 - WSREP: deps set usage at exit 0

2023-12-17T01:00:59.105722047+01:00 - WSREP: avg deps dist 24.6698

2023-12-17T01:00:59.105724151+01:00 - WSREP: avg cert interval 958.66

2023-12-17T01:00:59.105726430+01:00 - WSREP: cert index size 5753

2023-12-17T01:00:59.109276504+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:00:59.115405044+01:00 - WSREP: wsdb trx map usage 0 conn query map usage 0

2023-12-17T01:00:59.115422224+01:00 - WSREP: MemPool(LocalTrxHandle): hit ratio: 0, misses: 0, in use: 0, in pool: 0

2023-12-17T01:00:59.116196077+01:00 - WSREP: Flushing memory map to disk...

2023-12-17T01:00:59.640271561+01:00 - InnoDB: FTS optimize thread exiting.

2023-12-17T01:00:59.643853874+01:00 - STOPPED

2023-12-17T01:00:59.643917035+01:00 - InnoDB: Starting shutdown...

2023-12-17T01:00:59.644001089+01:00 - InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool

2023-12-17T01:00:59.644745269+01:00 - InnoDB: Restricted to 129792 pages due to innodb_buf_pool_dump_pct=25

2023-12-17T01:00:59.704236745+01:00 - InnoDB: Buffer pool(s) dump completed at 231217  0:00:59

2023-12-17T01:01:04.274113844+01:00 - InnoDB: Removed temporary tablespace data file: "./ibtmp1"

2023-12-17T01:01:04.274194070+01:00 - InnoDB: Shutdown completed; log sequence number 323947235057737; transaction id 5496100278

2023-12-17T01:01:04.281499845+01:00 - mysqld: Shutdown complete

2023-12-17T01:01:33.169086224+01:00 -

2023-12-17T01:01:33.662461720+01:00 -

2023-12-17T01:01:37.829446247+01:00 - WSREP: Found saved state: b30e8559-60da-11ed-9d97-1f6b96427920:71199415, safe_to_bootstrap: 0

2023-12-17T01:01:37.829566116+01:00 - WSREP: Recovering GCache ring buffer: version: 2, UUID: b30e8559-60da-11ed-9d97-1f6b96427920, offset: 2017781808

2023-12-17T01:01:37.830302813+01:00 - WSREP: GCache::RingBuffer initial scan...  0.0% (         0/4294967320 bytes) complete.

2023-12-17T01:01:37.941149048+01:00 - Starting MariaDB 10.6.16-MariaDB-1:10.6.16+maria~ubu2004 source revision b83c379420a8846ae4b28768d3c81fa354cca056 as process 1

2023-12-17T01:01:37.941307171+01:00 - WSREP: Loading provider /usr/lib/libgalera_smm.so initial position: 00000000-0000-0000-0000-000000000000:-1

2023-12-17T01:01:37.941321572+01:00 - WSREP: wsrep_load(): loading provider library '/usr/lib/libgalera_smm.so'

2023-12-17T01:01:37.943335904+01:00 - WSREP: wsrep_load(): Galera 26.4.16(r7dce5149) by Codership Oy <info@codership.com> loaded successfully.

2023-12-17T01:01:37.943356797+01:00 - WSREP: CRC-32C: using 64-bit x86 acceleration.

2023-12-17T01:01:37.946536165+01:00 - WSREP: Found saved state: 9d24779a-4d3a-11ee-8450-466b2f30be09:66857103, safe_to_bootstrap: 0

2023-12-17T01:01:37.946609846+01:00 - WSREP: GCache DEBUG: opened preamble:

2023-12-17T01:01:37.946650493+01:00 - WSREP: Recovering GCache ring buffer: version: 2, UUID: 9d24779a-4d3a-11ee-8450-466b2f30be09, offset: 12405684952

2023-12-17T01:01:37.947609116+01:00 - WSREP: GCache::RingBuffer initial scan...  0.0% (          0/12884901912 bytes) complete.

2023-12-17T01:01:37.979623821+01:00 - WSREP: GCache::RingBuffer initial scan...100.0% (12884901912/12884901912 bytes) complete.

2023-12-17T01:01:37.980125335+01:00 - WSREP: Recovering GCache ring buffer: found gapless sequence 66844794-66857103

2023-12-17T01:01:37.980134450+01:00 - WSREP: GCache::RingBuffer unused buffers scan...  0.0% (          0/12869734088 bytes) complete.

2023-12-17T01:01:37.981324717+01:00 - WSREP: Recovering GCache ring buffer: found 0/12310 locked buffers

2023-12-17T01:01:37.981336629+01:00 - WSREP: Recovering GCache ring buffer: free space: 15167800/12884901888

2023-12-17T01:01:37.981338893+01:00 - WSREP: GCache::RingBuffer unused buffers scan...100.0% (12869734088/12869734088 bytes) complete.

2023-12-17T01:01:37.984105526+01:00 - WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.42.6.87; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 10; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT1S; evs.inactive_timeout = PT1M; evs.install_timeout = PT1M; evs.join_retrans_period = PT2S; evs.keepalive_period = PT3S; evs.max_install_timeouts = 3; evs.send_window = 128; evs.stats_report_period = PT1M; evs.suspect_timeout = PT30S; evs.user_send_window = 64; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.keep_plaintext_size = 128M; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 12G; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 0.8; gcs.fc_limit = 60; gcs.fc_master_slave = no; gcs.fc_single_primary = no; gcs.max_packet_size = 1048576; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_s

2023-12-17T01:01:37.997985694+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:01:37.997997454+01:00 - WSREP: ####### Assign initial position for certification: 9d24779a-4d3a-11ee-8450-466b2f30be09:66857103, protocol version: -1

2023-12-17T01:01:37.998001271+01:00 - WSREP: Start replication

2023-12-17T01:01:37.998003278+01:00 - WSREP: Connecting with bootstrap option: 0

2023-12-17T01:01:37.998005518+01:00 - WSREP: Setting GCS initial position to 9d24779a-4d3a-11ee-8450-466b2f30be09:66857103

2023-12-17T01:01:37.998099262+01:00 - WSREP: protonet asio version 0

2023-12-17T01:01:37.998110598+01:00 - WSREP: Using CRC-32C for message checksums.

2023-12-17T01:01:37.998152165+01:00 - WSREP: backend: asio

2023-12-17T01:01:37.998320518+01:00 - WSREP: gcomm thread scheduling priority set to other:0

2023-12-17T01:01:37.998451803+01:00 - WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory)

2023-12-17T01:01:37.998456735+01:00 - WSREP: restore pc from disk failed

2023-12-17T01:01:37.998612091+01:00 - WSREP: GMCast version 0

2023-12-17T01:01:38.006685923+01:00 - WSREP: (73039e80-8bd8, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567

2023-12-17T01:01:38.006697711+01:00 - WSREP: (73039e80-8bd8, 'tcp://0.0.0.0:4567') multicast: , ttl: 1

2023-12-17T01:01:38.007051016+01:00 - WSREP: EVS version 1

2023-12-17T01:01:38.007184201+01:00 - WSREP: gcomm: connecting to group 'galera', peer 'mariadb-0.mariadb-headless.default:,mariadb-1.mariadb-headless.default:,mariadb-2.mariadb-headless.default:'

2023-12-17T01:01:38.008260607+01:00 - WSREP: (73039e80-8bd8, 'tcp://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address tcp://10.42.6.87:4567

2023-12-17T01:01:38.009897741+01:00 - WSREP: (73039e80-8bd8, 'tcp://0.0.0.0:4567') connection established to 6e84ca2d-bb68 tcp://10.42.5.58:4567

2023-12-17T01:01:38.009906863+01:00 - WSREP: (73039e80-8bd8, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:

2023-12-17T01:01:38.013527181+01:00 - WSREP: (73039e80-8bd8, 'tcp://0.0.0.0:4567') connection established to 423537e6-ab31 tcp://10.42.4.58:4567

2023-12-17T01:01:38.510395866+01:00 - WSREP: EVS version upgrade 0 -> 1

2023-12-17T01:01:38.510433246+01:00 - WSREP: declaring 423537e6-ab31 at tcp://10.42.4.58:4567 stable

2023-12-17T01:01:38.510440908+01:00 - WSREP: declaring 6e84ca2d-bb68 at tcp://10.42.5.58:4567 stable

2023-12-17T01:01:38.510447114+01:00 - WSREP: PC protocol upgrade 0 -> 1

2023-12-17T01:01:38.511588591+01:00 - WSREP: Node 423537e6-ab31 state prim

2023-12-17T01:01:38.512804988+01:00 - WSREP: view(view_id(PRIM,423537e6-ab31,47) memb {

2023-12-17T01:01:38.512888783+01:00 - WSREP: save pc into disk

2023-12-17T01:01:39.008268884+01:00 - WSREP: gcomm: connected

2023-12-17T01:01:39.008302949+01:00 - WSREP: Changing maximum packet size to 1048576, resulting msg size: 32636

2023-12-17T01:01:39.008355930+01:00 - WSREP: Shifting CLOSED -> OPEN (TO: 0)

2023-12-17T01:01:39.008385956+01:00 - WSREP: Opened channel 'galera'

2023-12-17T01:01:39.008675383+01:00 - WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3

2023-12-17T01:01:39.008687436+01:00 - WSREP: STATE EXCHANGE: Waiting for state UUID.

2023-12-17T01:01:39.008760683+01:00 - WSREP: Action message in non-primary configuration from member 1

2023-12-17T01:01:39.008786240+01:00 - WSREP: Last Applied Action message in non-primary configuration from member 0

2023-12-17T01:01:39.008900504+01:00 - WSREP: Starting rollbacker thread 1

2023-12-17T01:01:39.009087832+01:00 - WSREP: STATE EXCHANGE: sent state msg: 73546a87-9c6f-11ee-a7db-23178c90ffc5

2023-12-17T01:01:39.009143370+01:00 - WSREP: STATE EXCHANGE: got state msg: 73546a87-9c6f-11ee-a7db-23178c90ffc5 from 0 (mariadb-0)

2023-12-17T01:01:39.009185045+01:00 - WSREP: Starting applier thread 2

2023-12-17T01:01:39.009307892+01:00 - WSREP: STATE EXCHANGE: got state msg: 73546a87-9c6f-11ee-a7db-23178c90ffc5 from 1 (mariadb-1)

2023-12-17T01:01:39.010642801+01:00 - WSREP: STATE EXCHANGE: got state msg: 73546a87-9c6f-11ee-a7db-23178c90ffc5 from 2 (mariadb-2)

2023-12-17T01:01:39.010661091+01:00 - WSREP: Quorum results:

2023-12-17T01:01:39.010774860+01:00 - WSREP: Flow-control interval: [83, 104]

2023-12-17T01:01:39.010780031+01:00 - WSREP: Shifting OPEN -> PRIMARY (TO: 66857297)

2023-12-17T01:01:39.010952609+01:00 - WSREP: ####### processing CC 66857297, local, ordered

2023-12-17T01:01:39.010958208+01:00 - WSREP: Process first view: 9d24779a-4d3a-11ee-8450-466b2f30be09 my uuid: 73039e80-9c6f-11ee-8bd8-a3e27284018b

2023-12-17T01:01:39.011004936+01:00 - WSREP: Server mariadb-2 connected to cluster at position 9d24779a-4d3a-11ee-8450-466b2f30be09:66857297 with ID 73039e80-9c6f-11ee-8bd8-a3e27284018b

2023-12-17T01:01:39.011010248+01:00 - WSREP: Server status change disconnected -> connected

2023-12-17T01:01:39.011020019+01:00 - WSREP: ####### My UUID: 73039e80-9c6f-11ee-8bd8-a3e27284018b

2023-12-17T01:01:39.011090802+01:00 - WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes

2023-12-17T01:01:39.011281633+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:01:39.011344348+01:00 - WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1

2023-12-17T01:01:39.011355053+01:00 - WSREP: State transfer required:

2023-12-17T01:01:39.011382629+01:00 - WSREP: Server status change connected -> joiner

2023-12-17T01:01:39.011966883+01:00 - WSREP: Joiner monitor thread started to monitor

2023-12-17T01:01:39.011988816+01:00 - WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '10.42.6.87' --datadir '/var/lib/mysql/' --parent 1 --progress 0'

2023-12-17T01:01:39.541061452+01:00 - WSREP: ####### IST uuid:9d24779a-4d3a-11ee-8450-466b2f30be09 f: 66857104, l: 66857297, STRv: 3

2023-12-17T01:01:39.541136639+01:00 - WSREP: IST receiver addr using tcp://10.42.6.87:4568

2023-12-17T01:01:39.541471435+01:00 - WSREP: Prepared IST receiver for 66857104-66857297, listening at: tcp://10.42.6.87:4568

2023-12-17T01:01:39.551936003+01:00 - WSREP: Member 2.0 (mariadb-2) requested state transfer from '*any*'. Selected 1.0 (mariadb-1)(SYNCED) as donor.

2023-12-17T01:01:39.551969637+01:00 - WSREP: Shifting PRIMARY -> JOINER (TO: 66857303)

2023-12-17T01:01:39.552001832+01:00 - WSREP: Requesting state transfer: success, donor: 1

2023-12-17T01:01:39.907830188+01:00 - WSREP: 1.0 (mariadb-1): State transfer to 2.0 (mariadb-2) complete.

2023-12-17T01:01:39.910919857+01:00 - WSREP: Member 1.0 (mariadb-1) synced with group.

2023-12-17T01:01:40.511906978+01:00 - WSREP: GCache::RingBuffer initial scan...100.0% (4294967320/4294967320 bytes) complete.

2023-12-17T01:01:40.553017341+01:00 - WSREP: Recovering GCache ring buffer: found gapless sequence 69792911-71199415

2023-12-17T01:01:40.634403523+01:00 - WSREP: GCache::RingBuffer unused buffers scan...  0.0% (         0/4294964800 bytes) complete.

2023-12-17T01:01:40.762050504+01:00 - WSREP: Recovering GCache ring buffer: found 14/1406519 locked buffers

2023-12-17T01:01:40.762090930+01:00 - WSREP: Recovering GCache ring buffer: free space: 5776/4294967296

2023-12-17T01:01:40.762095947+01:00 - WSREP: GCache::RingBuffer unused buffers scan...100.0% (4294964800/4294964800 bytes) complete.

2023-12-17T01:01:40.852116645+01:00 - WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.42.4.48; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 10; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT1S; evs.inactive_timeout = PT1M; evs.install_timeout = PT1M; evs.join_retrans_period = PT2S; evs.keepalive_period = PT3S; evs.max_install_timeouts = 3; evs.send_window = 128; evs.stats_report_period = PT1M; evs.suspect_timeout = PT30S; evs.user_send_window = 64; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.keep_plaintext_size = 128M; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 4G; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 0.8; gcs.fc_limit = 60; gcs.fc_master_slave = no; gcs.fc_single_primary = no; gcs.max_packet_size = 1048576; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_so

2023-12-17T01:01:41.168341216+01:00 - WSREP: SST received

2023-12-17T01:01:41.168364466+01:00 - WSREP: Server status change joiner -> initializing

2023-12-17T01:01:41.194600653+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:01:41.194640352+01:00 - WSREP: ####### Assign initial position for certification: b30e8559-60da-11ed-9d97-1f6b96427920:71199415, protocol version: -1

2023-12-17T01:01:41.194746466+01:00 - WSREP: Start replication

2023-12-17T01:01:41.194755655+01:00 - WSREP: Connecting with bootstrap option: 0

2023-12-17T01:01:41.194762758+01:00 - WSREP: Setting GCS initial position to b30e8559-60da-11ed-9d97-1f6b96427920:71199415

2023-12-17T01:01:41.194961948+01:00 - WSREP: protonet asio version 0

2023-12-17T01:01:41.195167314+01:00 - WSREP: Using CRC-32C for message checksums.

2023-12-17T01:01:41.195175933+01:00 - WSREP: backend: asio

2023-12-17T01:01:41.195472356+01:00 - WSREP: gcomm thread scheduling priority set to other:0

2023-12-17T01:01:41.195719489+01:00 - InnoDB: Compressed tables use zlib 1.2.11

2023-12-17T01:01:41.195765476+01:00 - WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory)

2023-12-17T01:01:41.195779841+01:00 - WSREP: restore pc from disk failed

2023-12-17T01:01:41.196351254+01:00 - WSREP: GMCast version 0

2023-12-17T01:01:41.198223734+01:00 - InnoDB: Number of pools: 1

2023-12-17T01:01:41.198246680+01:00 - InnoDB: Using crc32 + pclmulqdq instructions

2023-12-17T01:01:41.213215173+01:00 - WSREP: (74eb7de0-b539, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567

2023-12-17T01:01:41.213238922+01:00 - WSREP: (74eb7de0-b539, 'tcp://0.0.0.0:4567') multicast: , ttl: 1

2023-12-17T01:01:41.213410173+01:00 - WSREP: EVS version 1

2023-12-17T01:01:41.213417865+01:00 - WSREP: gcomm: connecting to group 'galera', peer 'mariadb-0.mariadb-headless.default:,mariadb-1.mariadb-headless.default:,mariadb-2.mariadb-headless.default:'

2023-12-17T01:01:41.214131363+01:00 - WSREP: (74eb7de0-b539, 'tcp://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address tcp://10.42.4.48:4567

2023-12-17T01:01:41.221260499+01:00 - WSREP: (74eb7de0-b539, 'tcp://0.0.0.0:4567') connection established to 17e148d8-b4a9 tcp://10.42.2.35:4567

2023-12-17T01:01:41.221272885+01:00 - WSREP: (74eb7de0-b539, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers:

2023-12-17T01:01:41.221276758+01:00 - WSREP: (74eb7de0-b539, 'tcp://0.0.0.0:4567') connection established to 3edcaea3-aef3 tcp://10.42.3.33:4567

2023-12-17T01:01:41.250813406+01:00 - InnoDB: Using Linux native AIO

2023-12-17T01:01:41.251460104+01:00 - InnoDB: Initializing buffer pool, total size = 8589934592, chunk size = 134217728

2023-12-17T01:01:41.302741928+01:00 - InnoDB: Completed initialization of buffer pool

2023-12-17T01:01:41.398934611+01:00 - InnoDB: 128 rollback segments are active.

2023-12-17T01:01:41.413419240+01:00 - InnoDB: Creating shared tablespace for temporary tables

2023-12-17T01:01:41.413459202+01:00 - InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...

2023-12-17T01:01:41.413471647+01:00 - InnoDB: File './ibtmp1' size is now 12 MB.

2023-12-17T01:01:41.414846540+01:00 - InnoDB: 10.6.16 started; log sequence number 323947235057737; transaction id 5496100279

2023-12-17T01:01:41.414867477+01:00 - Plugin 'FEEDBACK' is disabled.

2023-12-17T01:01:41.415006439+01:00 - InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool

2023-12-17T01:01:41.415748868+01:00 - server_audit_excl_users set to ''.

2023-12-17T01:01:41.415761489+01:00 - MariaDB Audit Plugin version 1.4.14 STARTED.

2023-12-17T01:01:41.415768209+01:00 - logging started to the file /logs/server_audit.log.

2023-12-17T01:01:41.478423714+01:00 - You need to use --log-bin to make --expire-logs-days or --binlog-expire-logs-seconds work.

2023-12-17T01:01:41.502001621+01:00 - Server socket created on IP: '0.0.0.0'.

2023-12-17T01:01:41.502029036+01:00 - Server socket created on IP: '::'.

2023-12-17T01:01:41.717176061+01:00 - WSREP: EVS version upgrade 0 -> 1

2023-12-17T01:01:41.717219125+01:00 - WSREP: declaring 17e148d8-b4a9 at tcp://10.42.2.35:4567 stable

2023-12-17T01:01:41.717228203+01:00 - WSREP: declaring 3edcaea3-aef3 at tcp://10.42.3.33:4567 stable

2023-12-17T01:01:41.717235029+01:00 - WSREP: PC protocol upgrade 0 -> 1

2023-12-17T01:01:41.719791335+01:00 - WSREP: Node 17e148d8-b4a9 state prim

2023-12-17T01:01:41.721433607+01:00 - WSREP: view(view_id(PRIM,17e148d8-b4a9,33) memb {

2023-12-17T01:01:41.721531902+01:00 - WSREP: save pc into disk

2023-12-17T01:01:41.967902893+01:00 - WSREP: wsrep_init_schema_and_SR (nil)

2023-12-17T01:01:42.214325178+01:00 - WSREP: gcomm: connected

2023-12-17T01:01:42.214369773+01:00 - WSREP: Changing maximum packet size to 1048576, resulting msg size: 32636

2023-12-17T01:01:42.214401758+01:00 - WSREP: Shifting CLOSED -> OPEN (TO: 0)

2023-12-17T01:01:42.214410344+01:00 - WSREP: Opened channel 'galera'

2023-12-17T01:01:42.214709416+01:00 - WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3

2023-12-17T01:01:42.214729920+01:00 - WSREP: STATE EXCHANGE: Waiting for state UUID.

2023-12-17T01:01:42.214741895+01:00 - WSREP: STATE EXCHANGE: sent state msg: 753ce697-9c6f-11ee-9719-8ecaf51c5116

2023-12-17T01:01:42.214755716+01:00 - WSREP: STATE EXCHANGE: got state msg: 753ce697-9c6f-11ee-9719-8ecaf51c5116 from 0 (mariadb-0)

2023-12-17T01:01:42.214766646+01:00 - WSREP: STATE EXCHANGE: got state msg: 753ce697-9c6f-11ee-9719-8ecaf51c5116 from 1 (mariadb-1)

2023-12-17T01:01:42.215952745+01:00 - WSREP: Starting rollbacker thread 1

2023-12-17T01:01:42.216021036+01:00 - WSREP: Starting applier thread 2

2023-12-17T01:01:42.216719087+01:00 - WSREP: STATE EXCHANGE: got state msg: 753ce697-9c6f-11ee-9719-8ecaf51c5116 from 2 (mariadb-2)

2023-12-17T01:01:42.216734927+01:00 - WSREP: Quorum results:

2023-12-17T01:01:42.216853704+01:00 - WSREP: Flow-control interval: [83, 104]

2023-12-17T01:01:42.216920777+01:00 - WSREP: Shifting OPEN -> PRIMARY (TO: 71199518)

2023-12-17T01:01:42.217099459+01:00 - WSREP: ####### processing CC 71199518, local, ordered

2023-12-17T01:01:42.217157294+01:00 - WSREP: Process first view: b30e8559-60da-11ed-9d97-1f6b96427920 my uuid: 74eb7de0-9c6f-11ee-b539-5e124ccf7a66

2023-12-17T01:01:42.217166910+01:00 - WSREP: Server mariadb-2 connected to cluster at position b30e8559-60da-11ed-9d97-1f6b96427920:71199518 with ID 74eb7de0-9c6f-11ee-b539-5e124ccf7a66

2023-12-17T01:01:42.217172975+01:00 - WSREP: Server status change disconnected -> connected

2023-12-17T01:01:42.217178173+01:00 - WSREP: ####### My UUID: 74eb7de0-9c6f-11ee-b539-5e124ccf7a66

2023-12-17T01:01:42.217183952+01:00 - WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes

2023-12-17T01:01:42.217190428+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:01:42.217213580+01:00 - WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1

2023-12-17T01:01:42.217282843+01:00 - WSREP: State transfer required:

2023-12-17T01:01:42.217297688+01:00 - WSREP: Server status change connected -> joiner

2023-12-17T01:01:42.217784068+01:00 - WSREP: Joiner monitor thread started to monitor

2023-12-17T01:01:42.217804978+01:00 - WSREP: Running: 'wsrep_sst_rsync --role 'joiner' --address '10.42.4.48' --datadir '/var/lib/mysql/' --parent 1 --progress 0'

2023-12-17T01:01:42.229889868+01:00 - WSREP: Server initialized

2023-12-17T01:01:42.229908658+01:00 - WSREP: Server status change initializing -> initialized

2023-12-17T01:01:42.230214263+01:00 - WSREP: Recovered position from storage: 9d24779a-4d3a-11ee-8450-466b2f30be09:66857102

2023-12-17T01:01:42.230764054+01:00 - WSREP: Starting applier thread 6

2023-12-17T01:01:42.233145423+01:00 - WSREP: Recovered view from SST:

2023-12-17T01:01:42.233150769+01:00 - 9d24779a-4d3a-11ee-8450-466b2f30be09:66235212

2023-12-17T01:01:42.233153426+01:00 - primary

2023-12-17T01:01:42.233155933+01:00 - 4

2023-12-17T01:01:42.233158557+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:01:42.233160943+01:00 - no

2023-12-17T01:01:42.233163036+01:00 - -1

2023-12-17T01:01:42.233177964+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:01:42.233219444+01:00 - WSREP: Recovered cluster id 9d24779a-4d3a-11ee-8450-466b2f30be09

2023-12-17T01:01:42.267032283+01:00 - mysqld: ready for connections.

2023-12-17T01:01:43.223333621+01:00 - WSREP: ####### IST uuid:b30e8559-60da-11ed-9d97-1f6b96427920 f: 71199416, l: 71199518, STRv: 3

2023-12-17T01:01:43.223498682+01:00 - WSREP: IST receiver addr using tcp://10.42.4.48:4568

2023-12-17T01:01:43.223787203+01:00 - WSREP: Prepared IST receiver for 71199416-71199518, listening at: tcp://10.42.4.48:4568

2023-12-17T01:01:43.231207880+01:00 - WSREP: Member 2.0 (mariadb-2) requested state transfer from '*any*'. Selected 0.0 (mariadb-0)(SYNCED) as donor.

2023-12-17T01:01:43.231239110+01:00 - WSREP: Shifting PRIMARY -> JOINER (TO: 71199518)

2023-12-17T01:01:43.231307505+01:00 - WSREP: Requesting state transfer: success, donor: 0

2023-12-17T01:01:43.453907666+01:00 - WSREP: 0.0 (mariadb-0): State transfer to 2.0 (mariadb-2) complete.

2023-12-17T01:01:43.456339190+01:00 - WSREP: Member 0.0 (mariadb-0) synced with group.

2023-12-17T01:01:43.895174239+01:00 - InnoDB: Buffer pool(s) load completed at 231217  0:01:43

2023-12-17T01:01:44.843490760+01:00 - WSREP: SST received

2023-12-17T01:01:44.843506094+01:00 - WSREP: Server status change joiner -> initializing

2023-12-17T01:01:44.875635362+01:00 - InnoDB: Compressed tables use zlib 1.2.11

2023-12-17T01:01:44.878302564+01:00 - InnoDB: Number of pools: 1

2023-12-17T01:01:44.878357227+01:00 - InnoDB: Using crc32 + pclmulqdq instructions

2023-12-17T01:01:44.911720175+01:00 - InnoDB: Using Linux native AIO

2023-12-17T01:01:44.912371009+01:00 - InnoDB: Initializing buffer pool, total size = 2147483648, chunk size = 134217728

2023-12-17T01:01:44.931418577+01:00 - InnoDB: Completed initialization of buffer pool

2023-12-17T01:01:45.006344811+01:00 - InnoDB: 128 rollback segments are active.

2023-12-17T01:01:45.010313350+01:00 - InnoDB: Creating shared tablespace for temporary tables

2023-12-17T01:01:45.010327077+01:00 - InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...

2023-12-17T01:01:45.010338310+01:00 - InnoDB: File './ibtmp1' size is now 12 MB.

2023-12-17T01:01:45.012409665+01:00 - InnoDB: 10.6.16 started; log sequence number 627487528840; transaction id 241031192

2023-12-17T01:01:45.012594742+01:00 - Plugin 'FEEDBACK' is disabled.

2023-12-17T01:01:45.012859497+01:00 - InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool

2023-12-17T01:01:45.013118946+01:00 - server_audit_excl_users set to ''.

2023-12-17T01:01:45.013127250+01:00 - MariaDB Audit Plugin version 1.4.14 STARTED.

2023-12-17T01:01:45.013134147+01:00 - logging started to the file /logs/server_audit.log.

2023-12-17T01:01:45.045326983+01:00 - You need to use --log-bin to make --expire-logs-days or --binlog-expire-logs-seconds work.

2023-12-17T01:01:45.049303174+01:00 - Server socket created on IP: '0.0.0.0'.

2023-12-17T01:01:45.049320878+01:00 - Server socket created on IP: '::'.

2023-12-17T01:01:45.166281228+01:00 - WSREP: wsrep_init_schema_and_SR (nil)

2023-12-17T01:01:45.327261808+01:00 - WSREP: Server initialized

2023-12-17T01:01:45.327280826+01:00 - WSREP: Server status change initializing -> initialized

2023-12-17T01:01:45.327429939+01:00 - WSREP: Recovered position from storage: b30e8559-60da-11ed-9d97-1f6b96427920:71199415

2023-12-17T01:01:45.327872451+01:00 - WSREP: Recovered view from SST:

2023-12-17T01:01:45.327876665+01:00 - b30e8559-60da-11ed-9d97-1f6b96427920:70928481

2023-12-17T01:01:45.327879889+01:00 - primary

2023-12-17T01:01:45.327882558+01:00 - 4

2023-12-17T01:01:45.327887163+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:01:45.327890070+01:00 - no

2023-12-17T01:01:45.327892747+01:00 - -1

2023-12-17T01:01:45.327909201+01:00 - WSREP: wsrep_notify_cmd is not defined, skipping notification.

2023-12-17T01:01:45.328016480+01:00 - WSREP: Recovered cluster id b30e8559-60da-11ed-9d97-1f6b96427920

2023-12-17T01:01:45.328304791+01:00 - WSREP: SST received: b30e8559-60da-11ed-9d97-1f6b96427920:71199415

2023-12-17T01:01:45.328309909+01:00 - WSREP: SST succeeded for position b30e8559-60da-11ed-9d97-1f6b96427920:71199415

2023-12-17T01:01:45.328312627+01:00 - WSREP: Installed new state from SST: b30e8559-60da-11ed-9d97-1f6b96427920:71199415

2023-12-17T01:01:45.328424725+01:00 - WSREP: Joiner monitor thread ended with total time 3 sec

2023-12-17T01:01:45.328847485+01:00 - WSREP: Starting applier thread 7

2023-12-17T01:01:45.332677653+01:00 - mysqld: ready for connections.

2023-12-17T01:01:45.335519254+01:00 - WSREP: Receiving IST: 103 writesets, seqnos 71199416-71199518

2023-12-17T01:01:45.335741426+01:00 - WSREP: ####### IST applying starts with 71199416

2023-12-17T01:01:45.33575350+01:00 - WSREP: ####### IST current seqno initialized to 71199399

2023-12-17T01:01:45.335930158+01:00 - WSREP: Receiving IST...  0.0% (  0/120 events) complete.

2023-12-17T01:01:45.336042493+01:00 - WSREP: IST preload starting at 71199399

2023-12-17T01:01:45.336208410+01:00 - WSREP: Service thread queue flushed.

2023-12-17T01:01:45.336301913+01:00 - WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:71199398, protocol version: 5

2023-12-17T01:01:45.336645007+01:00 - WSREP: REPL Protocols: 10 (5)

2023-12-17T01:01:45.336713878+01:00 - WSREP: ####### Adjusting cert position: 71199415 -> 71199416

2023-12-17T01:01:45.336925876+01:00 - WSREP: Lowest cert index boundary for CC from ist: 71199399

2023-12-17T01:01:45.337003619+01:00 - WSREP: Min available from gcache for CC from ist: 69792913

2023-12-17T01:01:45.337321508+01:00 - WSREP: ================================================

2023-12-17T01:01:45.337329055+01:00 - b30e8559-60da-11ed-9d97-1f6b96427920:71199416

2023-12-17T01:01:45.337332207+01:00 - primary

2023-12-17T01:01:45.337334830+01:00 - 4

2023-12-17T01:01:45.337337916+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:01:45.33734060+01:00 - no

2023-12-17T01:01:45.337343270+01:00 - -1

2023-12-17T01:01:45.337354098+01:00 - =================================================

2023-12-17T01:01:45.722444852+01:00 - WSREP: ####### Adjusting cert position: 71199517 -> 71199518

2023-12-17T01:01:45.724201318+01:00 - WSREP: Min available from gcache for CC from ist: 69793024

2023-12-17T01:01:45.724210828+01:00 - b30e8559-60da-11ed-9d97-1f6b96427920:71199518

2023-12-17T01:01:45.724213733+01:00 - primary

2023-12-17T01:01:45.724216384+01:00 - 4

2023-12-17T01:01:45.724219796+01:00 - MULTI-MASTER, CERTIFICATION, PARALLEL_APPLYING, REPLAY, ISOLATION, PAUSE, CAUSAL_READ, INCREMENTAL_WS, UNORDERED, PREORDERED, STREAMING, NBO

2023-12-17T01:01:45.724222583+01:00 - no

2023-12-17T01:01:45.724235449+01:00 - 2

2023-12-17T01:01:45.724248889+01:00 - =================================================

2023-12-17T01:01:45.724251911+01:00 - WSREP: Server status change initialized -> joined

2023-12-17T01:01:45.724257352+01:00 - WSREP: Receiving IST...100.0% (120/120 events) complete.

2023-12-17T01:01:45.724260025+01:00 - WSREP: Draining apply monitors after IST up to 71199518

2023-12-17T01:01:45.783435829+01:00 - InnoDB: Buffer pool(s) load completed at 231217  0:01:45

2023-12-17T01:01:45.791499264+01:00 - WSREP: IST received: b30e8559-60da-11ed-9d97-1f6b96427920:71199518

2023-12-17T01:01:45.791541293+01:00 - WSREP: Lowest cert index boundary for CC from sst: 71199399

2023-12-17T01:01:45.791552299+01:00 - WSREP: Min available from gcache for CC from sst: 69793024

2023-12-17T01:01:45.793149751+01:00 - WSREP: 2.0 (mariadb-2): State transfer from 0.0 (mariadb-0) complete.

2023-12-17T01:01:45.793210517+01:00 - WSREP: Shifting JOINER -> JOINED (TO: 71199519)

2023-12-17T01:01:45.793371521+01:00 - WSREP: Processing event queue:... -nan% (0/0 events) complete.

2023-12-17T01:01:45.795468645+01:00 - WSREP: Member 2.0 (mariadb-2) synced with group.

2023-12-17T01:01:45.795495690+01:00 - WSREP: Processing event queue:...100.0% (1/1 events) complete.

2023-12-17T01:01:45.795509266+01:00 - WSREP: Shifting JOINED -> SYNCED (TO: 71199519)

2023-12-17T01:01:45.795546695+01:00 - WSREP: Server mariadb-2 synced with group

2023-12-17T01:01:45.795558755+01:00 - WSREP: Server status change joined -> synced

2023-12-17T01:01:45.795568921+01:00 - WSREP: Synchronized with group, ready for connections

2023-12-17T01:01:49.264271878+01:00 - WSREP: SST received: 9d24779a-4d3a-11ee-8450-466b2f30be09:66857102

2023-12-17T01:01:49.264297704+01:00 - WSREP: SST succeeded for position 9d24779a-4d3a-11ee-8450-466b2f30be09:66857103

2023-12-17T01:01:49.264301261+01:00 - WSREP: Resetting GCache seqno map due to seqno gap: 66857103..66857102

2023-12-17T01:01:49.264304070+01:00 - WSREP: Joiner monitor thread ended with total time 10 sec

2023-12-17T01:01:49.264349235+01:00 - WSREP: Installed new state from SST: 9d24779a-4d3a-11ee-8450-466b2f30be09:66857102

2023-12-17T01:01:49.270304657+01:00 - WSREP: Receiving IST: 195 writesets, seqnos 66857103-66857297

2023-12-17T01:01:49.270432915+01:00 - WSREP: ####### IST applying starts with 66857103

2023-12-17T01:01:49.270437627+01:00 - WSREP: IST started with wrong seqno: 66857104, expected <= 66857103

2023-12-17T01:01:49.270685379+01:00 - WSREP: IST didn't contain all write sets, expected last: 66857297 last received: -1

2023-12-17T01:01:49.272711103+01:00 - WSREP: Receiving IST failed, node restart required: IST receiver reported failure: 71 (Protocol error)

2023-12-17T01:01:49.272721891+01:00 - WSREP: Closing send monitor...

2023-12-17T01:01:49.272725953+01:00 - WSREP: Closed send monitor.

2023-12-17T01:01:49.272729282+01:00 - WSREP: gcomm: terminating thread

2023-12-17T01:01:49.272732712+01:00 - WSREP: gcomm: joining thread

2023-12-17T01:01:49.273605943+01:00 - WSREP: gcomm: closing backend

2023-12-17T01:01:49.275146866+01:00 - WSREP: view(view_id(NON_PRIM,423537e6-ab31,47) memb {

2023-12-17T01:01:49.275249068+01:00 - WSREP: PC protocol downgrade 1 -> 0

2023-12-17T01:01:49.275277520+01:00 - WSREP: view((empty))

2023-12-17T01:01:49.276024408+01:00 - WSREP: gcomm: closed

2023-12-17T01:01:49.276032212+01:00 - WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1

2023-12-17T01:01:49.276048449+01:00 - WSREP: Flow-control interval: [48, 60]

2023-12-17T01:01:49.276058163+01:00 - WSREP: Received NON-PRIMARY.

2023-12-17T01:01:49.276060781+01:00 - WSREP: Shifting JOINER -> OPEN (TO: 66857365)

2023-12-17T01:01:49.276099066+01:00 - WSREP: New SELF-LEAVE.

2023-12-17T01:01:49.276109974+01:00 - WSREP: Flow-control interval: [0, 0]

2023-12-17T01:01:49.276116907+01:00 - WSREP: Received SELF-LEAVE. Closing connection.

2023-12-17T01:01:49.276123379+01:00 - WSREP: Shifting OPEN -> CLOSED (TO: 66857365)

2023-12-17T01:01:49.276137528+01:00 - WSREP: RECV thread exiting 0: Success

2023-12-17T01:01:49.276260743+01:00 - WSREP: recv_thread() joined.

2023-12-17T01:01:49.276267449+01:00 - WSREP: Closing replication queue.

2023-12-17T01:01:49.276271011+01:00 - WSREP: Closing slave action queue.

2023-12-17T01:01:49.276738668+01:00 - WSREP: Draining apply monitors after IST up to -1

2023-12-17T01:01:49.276743753+01:00 - WSREP: last left 66857102 greater than drain seqno -1

2023-12-17T01:01:49.283144812+01:00 - WSREP: IST received: 9d24779a-4d3a-11ee-8450-466b2f30be09:-1

2023-12-17T01:01:49.283163921+01:00 - WSREP: /home/buildbot/buildbot/build/gcs/src/gcs.cpp:s_join():965: Sending JOIN failed: -103 (Software caused connection abort).

2023-12-17T01:01:49.283170312+01:00 - WSREP: Failed to JOIN the cluster after SST gcs_join(9d24779a-4d3a-11ee-8450-466b2f30be09:-1) failed: 103 (Software caused connection abort)

2023-12-17T01:01:49.283177930+01:00 - WSREP: Lowest cert index boundary for CC from sst: -1

2023-12-17T01:01:49.283181380+01:00 - WSREP: Min available from gcache for CC from sst: 66844821

2023-12-17T01:01:49.283185508+01:00 - WSREP: trx protocol version: 5 does not match certification protocol version: -1

2023-12-17T01:02:11.719713154+01:00 - WSREP: (74eb7de0-b539, 'tcp://0.0.0.0:4567') turning message relay requesting off

Attachments

Activity

People

Assignee:: Unassigned

Reporter:: Malte Lehmann

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 2023-12-20 12:34

Updated:: 2023-12-20 12:34

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.