Joiner Logs: 2024-07-08 19:58:09 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2024-07-08 19:58:09 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 6631c9ef-3d64-11ef-ae5a-a73a5959da0c 2024-07-08 19:58:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6631c9ef-3d64-11ef-ae5a-a73a5959da0c from 0 (node-240) 2024-07-08 19:58:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6631c9ef-3d64-11ef-ae5a-a73a5959da0c from 1 (node-242) 2024-07-08 19:58:09 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 3, members = 1/2 (joined/total), act_id = 210, last_appl. = 130, protocols = 2/10/4 (gcs/repl/appl), vote policy= 0, group UUID = 05b85e89-3d60-11ef-a7dc-7fe580428470 2024-07-08 19:58:09 0 [Note] WSREP: Flow-control interval: [18, 23] 2024-07-08 19:58:09 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 211) 2024-07-08 19:58:09 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 211) 2024-07-08 19:58:09 2 [Note] WSREP: ####### processing CC 211, local, ordered 2024-07-08 19:58:09 2 [Note] WSREP: Process first view: 05b85e89-3d60-11ef-a7dc-7fe580428470 my uuid: 65e318e6-3d64-11ef-b781-3b1e31d3c126 2024-07-08 19:58:09 2 [Note] WSREP: Server node-242 connected to cluster at position 05b85e89-3d60-11ef-a7dc-7fe580428470:211 with ID 65e318e6-3d64-11ef-b781-3b1e31d3c126 2024-07-08 19:58:09 2 [Note] WSREP: Server status change disconnected -> connected 2024-07-08 19:58:09 2 [Note] WSREP: ####### My UUID: 65e318e6-3d64-11ef-b781-3b1e31d3c126 2024-07-08 19:58:09 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes 2024-07-08 19:58:09 0 [Note] WSREP: Service thread queue flushed. 2024-07-08 19:58:09 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1 2024-07-08 19:58:09 2 [Note] WSREP: State transfer required: Group state: 05b85e89-3d60-11ef-a7dc-7fe580428470:211 Local state: 00000000-0000-0000-0000-000000000000:-1 2024-07-08 19:58:09 2 [Note] WSREP: Server status change connected -> joiner 2024-07-08 19:58:09 0 [Note] WSREP: Joiner monitor thread started to monitor 2024-07-08 19:58:09 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '10.1.11.242' --datadir '/var/lib/mysql/' --parent 18883 --progress 0 --binlog '/var/lib/mysql/mysql-bin' --mysqld-args --basedir=/usr --wsrep_start_position=53b03802-3d42-11ef-bdc9-9b83e6aba1c4:657' WSREP_SST: [INFO] mariabackup SST started on joiner (20240708 19:58:09.781) WSREP_SST: [INFO] SSL configuration: CA='/certs/mariadb/ca-cert.pem', CAPATH='', CERT='/Certs/mariadb/server-cert.pem', KEY='/Certs/mariadb/server-key.pem', MODE='DISABLED', encrypt='3' (20240708 19:58:09.995) WSREP_SST: [INFO] Progress reporting tool pv not found in path: /usr//bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/usr/sbin:/usr/bin:/sbin:/bin (20240708 19:58:10.246) WSREP_SST: [INFO] Disabling all progress/rate-limiting (20240708 19:58:10.251) WSREP_SST: [INFO] Moving '/var/lib/mysql/mariabackup.backup.log' to '//mariadb/mariabackup.backup.log.2024.07.08-19.58.10.282426237' (20240708 19:58:10.289) WSREP_SST: [INFO] Streaming with mbstream (20240708 19:58:10.314) WSREP_SST: [INFO] Using socat as streamer (20240708 19:58:10.318) WSREP_SST: [INFO] Using openssl based encryption with socat: with key and crt (20240708 19:58:10.341) WSREP_SST: [INFO] Decrypting with cert='/Certs/mariadb/server-cert.pem', key='/Certs/mariadb/server-key.pem', ca='/Certs/mariadb/ca-cert.pem', capath='' (20240708 19:58:10.473) WSREP_SST: [INFO] Evaluating timeout -k 310 300 socat -u openssl-listen:4444,reuseaddr,cert='/Certs/mariadb/server-cert.pem',key='/Certs/mariadb/server-key.pem', cafile='/Certs/mariadb/ca-cert.pem',commonname='' stdio | '/usr//bin/mbstream' -x; RC=( ${PIPESTATUS[@]} ) (20240708 19:58:10.547) 2024-07-08 19:58:12 0 [Note] WSREP: (65e318e6-b781, 'ssl://0.0.0.0:4567') turning message relay requesting off WSREP_SST: [ERROR] Possible timeout in receiving first data from donor in gtid stage: exit codes: 124 0 (20240708 20:03:10.560) WSREP_SST: [ERROR] Cleanup after exit with status: 32 (20240708 20:03:10.568) WSREP_SST: [ERROR] Removing /tmp/tmp.9nWF3ySGO6/xtrabackup_galera_info file due to signal (20240708 20:03:10.577) WSREP_SST: [INFO] Removing the sst_in_progress file (20240708 20:03:10.585) WSREP_SST: [INFO] Cleaning up temporary directories (20240708 20:03:10.597) 2024-07-08 20:04:39 0 [ERROR] WSREP: Failed to read 'ready ' from: wsrep_sst_mariabackup --role 'joiner' --address '10.1.11.242' --datadir '/var/lib/mysql/' --parent 18883 --progress 0 --binlog '/var/lib/mysql/mysql-bin' --mysqld-args --basedir=/usr --wsrep_start_position=53b03802-3d42-11ef-bdc9-9b83e6aba1c4:657 Read: '(null)' 2024-07-08 20:04:39 0 [ERROR] WSREP: Process completed with error: wsrep_sst_mariabackup --role 'joiner' --address '10.1.11.242' --datadir '/var/lib/mysql/' --parent 18883 --progress 0 --binlog '/var/lib/mysql/mysql-bin' --mysqld-args --basedir=/usr --wsrep_start_position=53b03802-3d42-11ef-bdc9-9b83e6aba1c4:657: 32 (Broken pipe) 2024-07-08 20:04:39 2 [ERROR] WSREP: Failed to prepare for 'mariabackup' SST. Unrecoverable. 2024-07-08 20:04:39 2 [ERROR] WSREP: SST request callback failed. This is unrecoverable, restart required. 2024-07-08 20:04:39 2 [Note] WSREP: ReplicatorSMM::abort() 2024-07-08 20:04:39 2 [Note] WSREP: Closing send monitor... 2024-07-08 20:04:39 2 [Note] WSREP: Closed send monitor. 2024-07-08 20:04:39 2 [Note] WSREP: gcomm: terminating thread 2024-07-08 20:04:39 2 [Note] WSREP: gcomm: joining thread 2024-07-08 20:04:39 2 [Note] WSREP: gcomm: closing backend 2024-07-08 20:04:40 2 [Note] WSREP: view(view_id(NON_PRIM,05b79a6d-b75b,4) memb { 65e318e6-b781,0 } joined { } left { } partitioned { 05b79a6d-b75b,0 }) 2024-07-08 20:04:40 2 [Note] WSREP: PC protocol downgrade 1 -> 0 2024-07-08 20:04:40 2 [Note] WSREP: view((empty)) 2024-07-08 20:04:40 2 [Note] WSREP: gcomm: closed 2024-07-08 20:04:40 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 2024-07-08 20:04:40 0 [Note] WSREP: Flow-control interval: [13, 16] 2024-07-08 20:04:40 0 [Note] WSREP: Received NON-PRIMARY. 2024-07-08 20:04:40 0 [Note] WSREP: Shifting PRIMARY -> OPEN (TO: 271) 2024-07-08 20:04:40 0 [Note] WSREP: New SELF-LEAVE. 2024-07-08 20:04:40 0 [Note] WSREP: Flow-control interval: [0, 0] 2024-07-08 20:04:40 0 [Note] WSREP: Received SELF-LEAVE. Closing connection. 2024-07-08 20:04:40 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 271) 2024-07-08 20:04:40 0 [Note] WSREP: RECV thread exiting 0: Success 2024-07-08 20:04:40 2 [Note] WSREP: recv_thread() joined. 2024-07-08 20:04:40 2 [Note] WSREP: Closing replication queue. 2024-07-08 20:04:40 2 [Note] WSREP: Closing slave action queue. 2024-07-08 20:04:40 2 [Note] WSREP: /usr/libexec/mariadbd: Terminated.