Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] /usr/sbin/mysqld (mysqld 10.4.19-MariaDB) starting as process 5832 ... Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Warning] Could not increase number of max_open_files to more than 32768 (request: 67571) Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: Loading provider /usr/lib64/galera-4/libgalera_smm.so initial position: c227de0f-f8aa-11e8-a038-ce7a6cae1f98:3585 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera-4/libgalera_smm.so' Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: wsrep_load(): Galera 26.4.8(r902dd26) by Codership Oy loaded successfully. Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration. Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: SSL cipher list set to 'AES128-SHA' Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: Found saved state: c227de0f-f8aa-11e8-a038-ce7a6cae1f98:3585, safe_to_bootstrap: 0 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: GCache DEBUG: opened preamble: Jun 25 12:26:47 sv1810950 mysqld: Version: 2 Jun 25 12:26:47 sv1810950 mysqld: UUID: c227de0f-f8aa-11e8-a038-ce7a6cae1f98 Jun 25 12:26:47 sv1810950 mysqld: Seqno: 2806 - 3585 Jun 25 12:26:47 sv1810950 mysqld: Offset: 524165272 Jun 25 12:26:47 sv1810950 mysqld: Synced: 1 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: c227de0f-f8aa-11e8-a038-ce7a6cae1f98, offset: 524165272 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/1073741848 bytes) complete. Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (1073741848/1073741848 bytes) complete. Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 2806-3585 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: GCache::RingBuffer unused buffers scan... 0.0% ( 0/1062080 bytes) complete. Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (1062080/1062080 bytes) complete. Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): found 67/847 locked buffers Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): free space: 1072693440/1073741824 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: Passing config to GCS: base_dir = /apps/database/mariadb/; base_host = sv1810950.example.org; base_port = 4567; cert.log_conflicts = YES; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /apps/database/mariadb/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 1G; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 1; gmcast.version = 0; pc.announce_ Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: SSL cipher list set to 'AES128-SHA' Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: Service thread queue flushed. Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: ####### Assign initial position for certification: c227de0f-f8aa-11e8-a038-ce7a6cae1f98:3585, protocol version: -1 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: Start replication Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: Connecting with bootstrap option: 0 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: Setting GCS initial position to c227de0f-f8aa-11e8-a038-ce7a6cae1f98:3585 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: protonet asio version 0 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: SSL cipher list set to 'AES128-SHA' Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: Using CRC-32C for message checksums. Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: backend: asio Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Warning] WSREP: access file(/apps/database/mariadb//gvwstate.dat) failed(No such file or directory) Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: restore pc from disk failed Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: GMCast version 0 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: (d8bc0ac8-af5a, 'ssl://0.0.0.0:4567') listening at ssl://0.0.0.0:4567 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: (d8bc0ac8-af5a, 'ssl://0.0.0.0:4567') multicast: , ttl: 1 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: EVS version 1 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: gcomm: connecting to group 'mariadb_cluster_test', peer 'sv1810949.example.org:,sv1810950.example.org:,sv1810951.example.org:' Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: (d8bc0ac8-af5a, 'ssl://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address ssl://1.1.1.154:4567 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: (d8bc0ac8-af5a, 'ssl://0.0.0.0:4567') connection established to cbb362d6-90b4 ssl://1.1.1.155:4567 Jun 25 12:26:47 sv1810950 mysqld: 2021-06-25 12:26:47 0 [Note] WSREP: (d8bc0ac8-af5a, 'ssl://0.0.0.0:4567') turning message relay requesting on, nonlive peers: Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: EVS version upgrade 0 -> 1 Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: declaring cbb362d6-90b4 at ssl://1.1.1.155:4567 stable Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: PC protocol upgrade 0 -> 1 Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: Node cbb362d6-90b4 state prim Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: view(view_id(PRIM,cbb362d6-90b4,2) memb { Jun 25 12:26:48 sv1810950 mysqld: cbb362d6-90b4,1 Jun 25 12:26:48 sv1810950 mysqld: d8bc0ac8-af5a,1 Jun 25 12:26:48 sv1810950 mysqld: } joined { Jun 25 12:26:48 sv1810950 mysqld: } left { Jun 25 12:26:48 sv1810950 mysqld: } partitioned { Jun 25 12:26:48 sv1810950 mysqld: }) Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: save pc into disk Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: discarding pending addr without UUID: ssl://1.1.1.152:4567 Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: gcomm: connected Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: Opened channel 'mariadb_cluster_test' Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 1 [Note] WSREP: Starting rollbacker thread 1 Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 2 [Note] WSREP: Starting applier thread 2 Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: STATE EXCHANGE: sent state msg: d909faa9-d59f-11eb-a8c3-be540aec85ae Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: STATE EXCHANGE: got state msg: d909faa9-d59f-11eb-a8c3-be540aec85ae from 0 (sv1810949) Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: STATE EXCHANGE: got state msg: d909faa9-d59f-11eb-a8c3-be540aec85ae from 1 (sv1810950) Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: Quorum results: Jun 25 12:26:48 sv1810950 mysqld: version = 6, Jun 25 12:26:48 sv1810950 mysqld: component = PRIMARY, Jun 25 12:26:48 sv1810950 mysqld: conf_id = 1, Jun 25 12:26:48 sv1810950 mysqld: members = 1/2 (joined/total), Jun 25 12:26:48 sv1810950 mysqld: act_id = 3588, Jun 25 12:26:48 sv1810950 mysqld: last_appl. = 3587, Jun 25 12:26:48 sv1810950 mysqld: protocols = 2/10/4 (gcs/repl/appl), Jun 25 12:26:48 sv1810950 mysqld: vote policy= 0, Jun 25 12:26:48 sv1810950 mysqld: group UUID = c227de0f-f8aa-11e8-a038-ce7a6cae1f98 Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: Flow-control interval: [23, 23] Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 3589) Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 2 [Note] WSREP: ####### processing CC 3589, local, ordered Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 2 [Note] WSREP: Process first view: c227de0f-f8aa-11e8-a038-ce7a6cae1f98 my uuid: d8bc0ac8-d59f-11eb-af5a-7b5dc8ac56bd Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 2 [Note] WSREP: Server sv1810950 connected to cluster at position c227de0f-f8aa-11e8-a038-ce7a6cae1f98:3589 with ID d8bc0ac8-d59f-11eb-af5a-7b5dc8ac56bd Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 2 [Note] WSREP: Server status change disconnected -> connected Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 2 [Note] WSREP: ####### My UUID: d8bc0ac8-d59f-11eb-af5a-7b5dc8ac56bd Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: Service thread queue flushed. Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1 Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 2 [Note] WSREP: State transfer required: Jun 25 12:26:48 sv1810950 mysqld: Group state: c227de0f-f8aa-11e8-a038-ce7a6cae1f98:3589 Jun 25 12:26:48 sv1810950 mysqld: Local state: c227de0f-f8aa-11e8-a038-ce7a6cae1f98:3585 Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 2 [Note] WSREP: Server status change connected -> joiner Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: Joiner monitor thread started to monitor Jun 25 12:26:48 sv1810950 mysqld: 2021-06-25 12:26:48 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address 'sv1810950.example.org' --datadir '/apps/database/mariadb/' --parent '5832' --mysqld-args --wsrep_start_position=c227de0f-f8aa-11e8-a038-ce7a6cae1f98:3585' Jun 25 12:26:48 sv1810950 mysqld: WSREP_SST: [INFO] Logging all stderr of SST/Innobackupex to syslog (20210625 12:26:48.918) Jun 25 12:26:48 sv1810950 -wsrep-sst-joiner: Streaming with xbstream Jun 25 12:26:48 sv1810950 -wsrep-sst-joiner: Using socat as streamer Jun 25 12:26:48 sv1810950 -wsrep-sst-joiner: Evaluating timeout -k 310 300 socat -u TCP-LISTEN:4444,reuseaddr stdio | mbstream -x; RC=( ${PIPESTATUS[@]} ) Jun 25 12:26:49 sv1810950 mysqld: 2021-06-25 12:26:49 2 [Note] WSREP: Prepared SST request: mariabackup|sv1810950.example.org:4444/xtrabackup_sst//1 Jun 25 12:26:49 sv1810950 mysqld: 2021-06-25 12:26:49 2 [Note] WSREP: ####### IST uuid:c227de0f-f8aa-11e8-a038-ce7a6cae1f98 f: 3586, l: 3589, STRv: 3 Jun 25 12:26:49 sv1810950 mysqld: 2021-06-25 12:26:49 2 [Note] WSREP: IST receiver addr using ssl://sv1810950.example.org:4568 Jun 25 12:26:49 sv1810950 mysqld: 2021-06-25 12:26:49 2 [Note] WSREP: IST receiver using ssl Jun 25 12:26:49 sv1810950 mysqld: 2021-06-25 12:26:49 2 [Note] WSREP: Prepared IST receiver for 3586-3589, listening at: ssl://1.1.1.154:4568 Jun 25 12:26:49 sv1810950 mysqld: 2021-06-25 12:26:49 0 [Note] WSREP: Member 1.1 (sv1810950) requested state transfer from '*any*'. Selected 0.1 (sv1810949)(SYNCED) as donor. Jun 25 12:26:49 sv1810950 mysqld: 2021-06-25 12:26:49 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 3589) Jun 25 12:26:49 sv1810950 mysqld: 2021-06-25 12:26:49 2 [Note] WSREP: Requesting state transfer: success, donor: 0 Jun 25 12:26:49 sv1810950 mysqld: 2021-06-25 12:26:49 0 [Warning] WSREP: 0.1 (sv1810949): State transfer to 1.1 (sv1810950) failed: -22 (Invalid argument) Jun 25 12:26:49 sv1810950 mysqld: 2021-06-25 12:26:49 0 [ERROR] WSREP: /home/buildbot/buildbot/build/gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1170: Will never receive state. Need to abort. Jun 25 12:26:49 sv1810950 mysqld: 2021-06-25 12:26:49 0 [Note] WSREP: gcomm: terminating thread Jun 25 12:26:49 sv1810950 mysqld: 2021-06-25 12:26:49 0 [Note] WSREP: gcomm: joining thread Jun 25 12:26:49 sv1810950 mysqld: 2021-06-25 12:26:49 0 [Note] WSREP: gcomm: closing backend Jun 25 12:26:50 sv1810950 mysqld: 2021-06-25 12:26:50 0 [Note] WSREP: view(view_id(NON_PRIM,cbb362d6-90b4,2) memb { Jun 25 12:26:50 sv1810950 mysqld: d8bc0ac8-af5a,1 Jun 25 12:26:50 sv1810950 mysqld: } joined { Jun 25 12:26:50 sv1810950 mysqld: } left { Jun 25 12:26:50 sv1810950 mysqld: } partitioned { Jun 25 12:26:50 sv1810950 mysqld: cbb362d6-90b4,1 Jun 25 12:26:50 sv1810950 mysqld: }) Jun 25 12:26:50 sv1810950 mysqld: 2021-06-25 12:26:50 0 [Note] WSREP: PC protocol downgrade 1 -> 0 Jun 25 12:26:50 sv1810950 mysqld: 2021-06-25 12:26:50 0 [Note] WSREP: view((empty)) Jun 25 12:26:50 sv1810950 mysqld: 2021-06-25 12:26:50 0 [Note] WSREP: gcomm: closed Jun 25 12:26:50 sv1810950 mysqld: 2021-06-25 12:26:50 0 [Note] WSREP: /usr/sbin/mysqld: Terminated. Jun 25 12:26:50 sv1810950 -wsrep-sst-joiner: Removing /tmp/tmp.W62Euqy65o/xtrabackup_galera_info file due to signal Jun 25 12:26:50 sv1810950 -wsrep-sst-joiner: Removing /tmp/tmp.W62Euqy65o/xtrabackup_galera_info file due to signal Jun 25 12:26:50 sv1810950 -wsrep-sst-joiner: Error while getting data from donor node: exit codes: 143 143 Jun 25 12:26:50 sv1810950 -wsrep-sst-joiner: Cleanup after exit with status:32 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] /usr/sbin/mysqld (mysqld 10.4.19-MariaDB) starting as process 6444 ... Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Warning] Could not increase number of max_open_files to more than 32768 (request: 67571) Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: Loading provider /usr/lib64/galera-4/libgalera_smm.so initial position: c227de0f-f8aa-11e8-a038-ce7a6cae1f98:3585 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera-4/libgalera_smm.so' Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: wsrep_load(): Galera 26.4.8(r902dd26) by Codership Oy loaded successfully. Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration. Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: SSL cipher list set to 'AES128-SHA' Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 0 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: GCache DEBUG: opened preamble: Jun 25 12:26:57 sv1810950 mysqld: Version: 2 Jun 25 12:26:57 sv1810950 mysqld: UUID: c227de0f-f8aa-11e8-a038-ce7a6cae1f98 Jun 25 12:26:57 sv1810950 mysqld: Seqno: -1 - -1 Jun 25 12:26:57 sv1810950 mysqld: Offset: -1 Jun 25 12:26:57 sv1810950 mysqld: Synced: 0 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: Recovering GCache ring buffer: version: 2, UUID: c227de0f-f8aa-11e8-a038-ce7a6cae1f98, offset: -1 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: GCache::RingBuffer initial scan... 0.0% ( 0/1073741848 bytes) complete. Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: GCache::RingBuffer initial scan...100.0% (1073741848/1073741848 bytes) complete. Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: Recovering GCache ring buffer: found gapless sequence 2806-3585 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: GCache::RingBuffer unused buffers scan... 0.0% ( 0/1062080 bytes) complete. Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: GCache::RingBuffer unused buffers scan...100.0% (1062080/1062080 bytes) complete. Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): found 67/847 locked buffers Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: GCache DEBUG: RingBuffer::recover(): free space: 1072693440/1073741824 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: Passing config to GCS: base_dir = /apps/database/mariadb/; base_host = sv1810950.example.org; base_port = 4567; cert.log_conflicts = YES; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /apps/database/mariadb/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = galera.cache; gcache.page_size = 128M; gcache.recover = yes; gcache.size = 1G; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 1; gmcast.version = 0; pc.announce_ Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: SSL cipher list set to 'AES128-SHA' Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: Start replication Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: Connecting with bootstrap option: 0 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: Setting GCS initial position to 00000000-0000-0000-0000-000000000000:-1 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: protonet asio version 0 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: SSL cipher list set to 'AES128-SHA' Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: Using CRC-32C for message checksums. Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: backend: asio Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Warning] WSREP: access file(/apps/database/mariadb//gvwstate.dat) failed(No such file or directory) Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: restore pc from disk failed Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: GMCast version 0 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: (de9ae2f4-a924, 'ssl://0.0.0.0:4567') listening at ssl://0.0.0.0:4567 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: (de9ae2f4-a924, 'ssl://0.0.0.0:4567') multicast: , ttl: 1 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: EVS version 1 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: gcomm: connecting to group 'mariadb_cluster_test', peer 'sv1810949.example.org:,sv1810950.example.org:,sv1810951.example.org:' Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: (de9ae2f4-a924, 'ssl://0.0.0.0:4567') Found matching local endpoint for a connection, blacklisting address ssl://1.1.1.154:4567 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: (de9ae2f4-a924, 'ssl://0.0.0.0:4567') connection established to cbb362d6-90b4 ssl://1.1.1.155:4567 Jun 25 12:26:57 sv1810950 mysqld: 2021-06-25 12:26:57 0 [Note] WSREP: (de9ae2f4-a924, 'ssl://0.0.0.0:4567') turning message relay requesting on, nonlive peers: Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: EVS version upgrade 0 -> 1 Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: declaring cbb362d6-90b4 at ssl://1.1.1.155:4567 stable Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: PC protocol upgrade 0 -> 1 Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: Node cbb362d6-90b4 state prim Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: view(view_id(PRIM,cbb362d6-90b4,4) memb { Jun 25 12:26:58 sv1810950 mysqld: cbb362d6-90b4,1 Jun 25 12:26:58 sv1810950 mysqld: de9ae2f4-a924,1 Jun 25 12:26:58 sv1810950 mysqld: } joined { Jun 25 12:26:58 sv1810950 mysqld: } left { Jun 25 12:26:58 sv1810950 mysqld: } partitioned { Jun 25 12:26:58 sv1810950 mysqld: }) Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: save pc into disk Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: discarding pending addr without UUID: ssl://1.1.1.152:4567 Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: gcomm: connected Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: Opened channel 'mariadb_cluster_test' Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 1 [Note] WSREP: Starting rollbacker thread 1 Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 2 [Note] WSREP: Starting applier thread 2 Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: STATE EXCHANGE: sent state msg: dee888e7-d59f-11eb-a3f1-8b3d39cb9e6f Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: STATE EXCHANGE: got state msg: dee888e7-d59f-11eb-a3f1-8b3d39cb9e6f from 0 (sv1810949) Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: STATE EXCHANGE: got state msg: dee888e7-d59f-11eb-a3f1-8b3d39cb9e6f from 1 (sv1810950) Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: Quorum results: Jun 25 12:26:58 sv1810950 mysqld: version = 6, Jun 25 12:26:58 sv1810950 mysqld: component = PRIMARY, Jun 25 12:26:58 sv1810950 mysqld: conf_id = 3, Jun 25 12:26:58 sv1810950 mysqld: members = 1/2 (joined/total), Jun 25 12:26:58 sv1810950 mysqld: act_id = 3590, Jun 25 12:26:58 sv1810950 mysqld: last_appl. = 3587, Jun 25 12:26:58 sv1810950 mysqld: protocols = 2/10/4 (gcs/repl/appl), Jun 25 12:26:58 sv1810950 mysqld: vote policy= 0, Jun 25 12:26:58 sv1810950 mysqld: group UUID = c227de0f-f8aa-11e8-a038-ce7a6cae1f98 Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: Flow-control interval: [23, 23] Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 3591) Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 2 [Note] WSREP: ####### processing CC 3591, local, ordered Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 2 [Note] WSREP: Process first view: c227de0f-f8aa-11e8-a038-ce7a6cae1f98 my uuid: de9ae2f4-d59f-11eb-a924-9360790bbca2 Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 2 [Note] WSREP: Server sv1810950 connected to cluster at position c227de0f-f8aa-11e8-a038-ce7a6cae1f98:3591 with ID de9ae2f4-d59f-11eb-a924-9360790bbca2 Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 2 [Note] WSREP: Server status change disconnected -> connected Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 2 [Note] WSREP: ####### My UUID: de9ae2f4-d59f-11eb-a924-9360790bbca2 Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 2 [Note] WSREP: Cert index reset to 00000000-0000-0000-0000-000000000000:-1 (proto: 10), state transfer needed: yes Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: Service thread queue flushed. Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 2 [Note] WSREP: ####### Assign initial position for certification: 00000000-0000-0000-0000-000000000000:-1, protocol version: -1 Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 2 [Note] WSREP: State transfer required: Jun 25 12:26:58 sv1810950 mysqld: Group state: c227de0f-f8aa-11e8-a038-ce7a6cae1f98:3591 Jun 25 12:26:58 sv1810950 mysqld: Local state: 00000000-0000-0000-0000-000000000000:-1 Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 2 [Note] WSREP: Server status change connected -> joiner Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 2 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: Joiner monitor thread started to monitor Jun 25 12:26:58 sv1810950 mysqld: 2021-06-25 12:26:58 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address 'sv1810950.example.org' --datadir '/apps/database/mariadb/' --parent '6444' --mysqld-args --wsrep_start_position=c227de0f-f8aa-11e8-a038-ce7a6cae1f98:3585' Jun 25 12:26:58 sv1810950 mysqld: WSREP_SST: [INFO] Logging all stderr of SST/Innobackupex to syslog (20210625 12:26:58.759) Jun 25 12:26:58 sv1810950 -wsrep-sst-joiner: Streaming with xbstream Jun 25 12:26:58 sv1810950 -wsrep-sst-joiner: Using socat as streamer Jun 25 12:26:58 sv1810950 -wsrep-sst-joiner: Stale sst_in_progress file: /apps/database/mariadb//sst_in_progress Jun 25 12:26:58 sv1810950 -wsrep-sst-joiner: Evaluating timeout -k 310 300 socat -u TCP-LISTEN:4444,reuseaddr stdio | mbstream -x; RC=( ${PIPESTATUS[@]} ) Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 2 [Note] WSREP: Prepared SST request: mariabackup|sv1810950.example.org:4444/xtrabackup_sst//1 Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 2 [Note] WSREP: ####### IST uuid:00000000-0000-0000-0000-000000000000 f: 0, l: 3591, STRv: 3 Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 2 [Note] WSREP: IST receiver addr using ssl://sv1810950.example.org:4568 Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 2 [Note] WSREP: IST receiver using ssl Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 2 [Note] WSREP: Prepared IST receiver for 0-3591, listening at: ssl://1.1.1.154:4568 Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 0 [Note] WSREP: Member 1.1 (sv1810950) requested state transfer from '*any*'. Selected 0.1 (sv1810949)(SYNCED) as donor. Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 3591) Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 2 [Note] WSREP: Requesting state transfer: success, donor: 0 Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 2 [Note] WSREP: Resetting GCache seqno map due to different histories. Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 2 [Note] WSREP: GCache history reset: c227de0f-f8aa-11e8-a038-ce7a6cae1f98:3585 -> c227de0f-f8aa-11e8-a038-ce7a6cae1f98:3591 Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 2 [Note] WSREP: GCache DEBUG: RingBuffer::seqno_reset(): discarded 1048168 bytes Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 2 [Note] WSREP: GCache DEBUG: RingBuffer::seqno_reset(): found 1/2 locked buffers Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 0 [Warning] WSREP: 0.1 (sv1810949): State transfer to 1.1 (sv1810950) failed: -22 (Invalid argument) Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 0 [ERROR] WSREP: /home/buildbot/buildbot/build/gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1170: Will never receive state. Need to abort. Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 0 [Note] WSREP: gcomm: terminating thread Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 0 [Note] WSREP: gcomm: joining thread Jun 25 12:26:59 sv1810950 mysqld: 2021-06-25 12:26:59 0 [Note] WSREP: gcomm: closing backend Jun 25 12:27:00 sv1810950 mysqld: 2021-06-25 12:27:00 0 [Note] WSREP: view(view_id(NON_PRIM,cbb362d6-90b4,4) memb { Jun 25 12:27:00 sv1810950 mysqld: de9ae2f4-a924,1 Jun 25 12:27:00 sv1810950 mysqld: } joined { Jun 25 12:27:00 sv1810950 mysqld: } left { Jun 25 12:27:00 sv1810950 mysqld: } partitioned { Jun 25 12:27:00 sv1810950 mysqld: cbb362d6-90b4,1 Jun 25 12:27:00 sv1810950 mysqld: }) Jun 25 12:27:00 sv1810950 mysqld: 2021-06-25 12:27:00 0 [Note] WSREP: PC protocol downgrade 1 -> 0 Jun 25 12:27:00 sv1810950 mysqld: 2021-06-25 12:27:00 0 [Note] WSREP: view((empty)) Jun 25 12:27:00 sv1810950 mysqld: 2021-06-25 12:27:00 0 [Note] WSREP: gcomm: closed Jun 25 12:27:00 sv1810950 mysqld: 2021-06-25 12:27:00 0 [Note] WSREP: /usr/sbin/mysqld: Terminated. Jun 25 12:27:00 sv1810950 -wsrep-sst-joiner: Removing /tmp/tmp.pu644An9Vz/xtrabackup_galera_info file due to signal Jun 25 12:27:00 sv1810950 -wsrep-sst-joiner: Removing /tmp/tmp.pu644An9Vz/xtrabackup_galera_info file due to signal Jun 25 12:27:00 sv1810950 -wsrep-sst-joiner: Error while getting data from donor node: exit codes: 143 143 Jun 25 12:27:00 sv1810950 -wsrep-sst-joiner: Cleanup after exit with status:32