2018-01-25 13:34:26 140511928027264 [Note] WSREP: Read nil XID from storage engines, skipping position init 2018-01-25 13:34:26 140511928027264 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' 2018-01-25 13:34:26 140511928027264 [Note] WSREP: wsrep_load(): Galera 25.3.22(r3764) by Codership Oy loaded successfully. 2018-01-25 13:34:26 140511928027264 [Note] WSREP: CRC-32C: using "slicing-by-8" algorithm. 2018-01-25 13:34:26 140511928027264 [Warning] WSREP: Could not open state file for reading: '/var/lib/mysql//grastate.dat' 2018-01-25 13:34:26 140511928027264 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1 2018-01-25 13:34:26 140511928027264 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 192.168.104.193; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; p 2018-01-25 13:34:26 140511928027264 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 00000000-0000-0000-0000-000000000000:-1 2018-01-25 13:34:26 140511928027264 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1 2018-01-25 13:34:26 140511928027264 [Note] WSREP: wsrep_sst_grab() 2018-01-25 13:34:26 140511928027264 [Note] WSREP: Start replication 2018-01-25 13:34:26 140511928027264 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 2018-01-25 13:34:26 140511928027264 [Note] WSREP: protonet asio version 0 2018-01-25 13:34:26 140511928027264 [Note] WSREP: Using CRC-32C for message checksums. 2018-01-25 13:34:26 140511928027264 [Note] WSREP: backend: asio 2018-01-25 13:34:26 140511928027264 [Note] WSREP: gcomm thread scheduling priority set to other:0 2018-01-25 13:34:26 140511928027264 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) 2018-01-25 13:34:26 140511928027264 [Note] WSREP: restore pc from disk failed 2018-01-25 13:34:26 140511928027264 [Note] WSREP: GMCast version 0 2018-01-25 13:34:26 140511928027264 [Note] WSREP: (b2a0fd6e, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 2018-01-25 13:34:26 140511928027264 [Note] WSREP: (b2a0fd6e, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 2018-01-25 13:34:26 140511928027264 [Note] WSREP: EVS version 0 2018-01-25 13:34:26 140511928027264 [Note] WSREP: gcomm: connecting to group 'cluster1', peer '192.168.104.193:,192.168.104.195:,192.168.104.196:,192.168.104.191:' 2018-01-25 13:34:26 140511928027264 [Note] WSREP: (b2a0fd6e, 'tcp://0.0.0.0:4567') connection established to b2a0fd6e tcp://192.168.104.193:4567 2018-01-25 13:34:26 140511928027264 [Warning] WSREP: (b2a0fd6e, 'tcp://0.0.0.0:4567') address 'tcp://192.168.104.193:4567' points to own listening address, blacklisting 2018-01-25 13:34:26 140511928027264 [Note] WSREP: (b2a0fd6e, 'tcp://0.0.0.0:4567') connection established to 14afa916 tcp://192.168.104.196:4567 2018-01-25 13:34:26 140511928027264 [Note] WSREP: (b2a0fd6e, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: 2018-01-25 13:34:26 140511928027264 [Note] WSREP: (b2a0fd6e, 'tcp://0.0.0.0:4567') connection established to 2fec1813 tcp://192.168.104.191:4567 2018-01-25 13:34:26 140511928027264 [Note] WSREP: declaring 14afa916 at tcp://192.168.104.196:4567 stable 2018-01-25 13:34:26 140511928027264 [Note] WSREP: declaring 2fec1813 at tcp://192.168.104.191:4567 stable 2018-01-25 13:34:26 140511928027264 [Note] WSREP: Node 14afa916 state prim 2018-01-25 13:34:26 140511928027264 [Note] WSREP: view(view_id(PRIM,14afa916,59) memb { 14afa916,0 2fec1813,0 b2a0fd6e,0 } joined { } left { } partitioned { }) 2018-01-25 13:34:26 140511928027264 [Note] WSREP: save pc into disk 2018-01-25 13:34:26 140511928027264 [Note] WSREP: discarding pending addr without UUID: tcp://192.168.104.195:4567 2018-01-25 13:34:27 140511928027264 [Note] WSREP: gcomm: connected 2018-01-25 13:34:27 140511928027264 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2018-01-25 13:34:27 140511928027264 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2018-01-25 13:34:27 140511928027264 [Note] WSREP: Opened channel 'cluster1' 2018-01-25 13:34:27 140511591520000 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3 2018-01-25 13:34:27 140511591520000 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2018-01-25 13:34:27 140511928027264 [Note] WSREP: Waiting for SST to complete. 2018-01-25 13:34:27 140511591520000 [Note] WSREP: STATE EXCHANGE: sent state msg: b6c44a81-01c3-11e8-94a3-d28120e785fc 2018-01-25 13:34:27 140511591520000 [Note] WSREP: STATE EXCHANGE: got state msg: b6c44a81-01c3-11e8-94a3-d28120e785fc from 0 (t4w6) 2018-01-25 13:34:27 140511591520000 [Note] WSREP: STATE EXCHANGE: got state msg: b6c44a81-01c3-11e8-94a3-d28120e785fc from 1 (t4w1) 2018-01-25 13:34:27 140511591520000 [Note] WSREP: STATE EXCHANGE: got state msg: b6c44a81-01c3-11e8-94a3-d28120e785fc from 2 (t4w3) 2018-01-25 13:34:27 140511591520000 [Note] WSREP: Quorum results: version = 4, component = PRIMARY, conf_id = 58, members = 2/3 (joined/total), act_id = 599, last_appl. = -1, protocols = 0/7/3 (gcs/repl/appl), group UUID = ca2bb6d4-ff5d-11e7-8871-7f48103f96c0 2018-01-25 13:34:27 140511591520000 [Note] WSREP: Flow-control interval: [28, 28] 2018-01-25 13:34:27 140511591520000 [Note] WSREP: Trying to continue unpaused monitor 2018-01-25 13:34:27 140511591520000 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 599) 2018-01-25 13:34:27 140511802365696 [Note] WSREP: State transfer required: Group state: ca2bb6d4-ff5d-11e7-8871-7f48103f96c0:599 Local state: 00000000-0000-0000-0000-000000000000:-1 2018-01-25 13:34:27 140511802365696 [Note] WSREP: New cluster view: global state: ca2bb6d4-ff5d-11e7-8871-7f48103f96c0:599, view# 59: Primary, number of nodes: 3, my index: 2, protocol version 3 2018-01-25 13:34:27 140511802365696 [Warning] WSREP: Gap in state sequence. Need state transfer. 2018-01-25 13:34:27 140511583127296 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '192.168.104.193' --datadir '/var/lib/mysql/' --parent '1995' '' ' WSREP_SST: [INFO] Streaming with xbstream (20180125 13:34:27.543) WSREP_SST: [INFO] Using socat as streamer (20180125 13:34:27.546) WSREP_SST: [INFO] Evaluating timeout -k 110 100 socat -u TCP-LISTEN:4444,reuseaddr stdio | mbstream -x; RC=( ${PIPESTATUS[@]} ) (20180125 13:34:27.606) 2018-01-25 13:34:27 140511802365696 [Note] WSREP: Prepared SST request: mariabackup|192.168.104.193:4444/xtrabackup_sst//1 2018-01-25 13:34:27 140511802365696 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2018-01-25 13:34:27 140511802365696 [Note] WSREP: REPL Protocols: 7 (3, 2) 2018-01-25 13:34:27 140511802365696 [Note] WSREP: Assign initial position for certification: 599, protocol version: 3 2018-01-25 13:34:27 140511835936512 [Note] WSREP: Service thread queue flushed. 2018-01-25 13:34:27 140511802365696 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (ca2bb6d4-ff5d-11e7-8871-7f48103f96c0): 1 (Operation not permitted) at galera/src/replicator_str.cpp:prepare_for_IST():482. IST will be unavailable. 2018-01-25 13:34:27 140511591520000 [Note] WSREP: Member 2.0 (t4w3) requested state transfer from '*any*'. Selected 0.0 (t4w6)(SYNCED) as donor. 2018-01-25 13:34:27 140511591520000 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 599) 2018-01-25 13:34:27 140511802365696 [Note] WSREP: Requesting state transfer: success, donor: 0 2018-01-25 13:34:27 140511802365696 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> ca2bb6d4-ff5d-11e7-8871-7f48103f96c0:599 WSREP_SST: [INFO] Proceeding with SST (20180125 13:34:28.326) WSREP_SST: [INFO] Evaluating socat -u TCP-LISTEN:4444,reuseaddr stdio | mbstream -x; RC=( ${PIPESTATUS[@]} ) (20180125 13:34:28.328) WSREP_SST: [INFO] Cleaning the existing datadir and innodb-data/log directories (20180125 13:34:28.332) removed ‘/var/lib/mysql/ibdata1’ removed ‘/var/lib/mysql/mysql/gtid_slave_pos.ibd’ removed ‘/var/lib/mysql/mysql/innodb_index_stats.ibd’ removed ‘/var/lib/mysql/mysql/innodb_table_stats.ibd’ removed ‘/var/lib/mysql/mysql/roles_mapping.MYI’ removed ‘/var/lib/mysql/mysql/column_stats.MYD’ removed ‘/var/lib/mysql/mysql/table_stats.MYI’ removed ‘/var/lib/mysql/mysql/column_stats.MYI’ removed ‘/var/lib/mysql/mysql/table_stats.frm’ removed ‘/var/lib/mysql/mysql/column_stats.frm’ removed ‘/var/lib/mysql/mysql/tables_priv.MYD’ removed ‘/var/lib/mysql/mysql/columns_priv.MYD’ removed ‘/var/lib/mysql/mysql/tables_priv.MYI’ removed ‘/var/lib/mysql/mysql/columns_priv.MYI’ removed ‘/var/lib/mysql/mysql/tables_priv.frm’ removed ‘/var/lib/mysql/mysql/columns_priv.frm’ removed ‘/var/lib/mysql/mysql/db.MYD’ removed ‘/var/lib/mysql/mysql/db.MYI’ removed ‘/var/lib/mysql/mysql/db.frm’ removed ‘/var/lib/mysql/mysql/event.MYD’ removed ‘/var/lib/mysql/mysql/event.MYI’ removed ‘/var/lib/mysql/mysql/event.frm’ removed ‘/var/lib/mysql/mysql/func.MYD’ removed ‘/var/lib/mysql/mysql/func.MYI’ removed ‘/var/lib/mysql/mysql/func.frm’ removed ‘/var/lib/mysql/mysql/time_zone.MYD’ removed ‘/var/lib/mysql/mysql/general_log.CSM’ removed ‘/var/lib/mysql/mysql/time_zone.MYI’ removed ‘/var/lib/mysql/mysql/general_log.CSV’ removed ‘/var/lib/mysql/mysql/time_zone.frm’ removed ‘/var/lib/mysql/mysql/general_log.frm’ removed ‘/var/lib/mysql/mysql/time_zone_leap_second.MYD’ removed ‘/var/lib/mysql/mysql/gtid_slave_pos.frm’ removed ‘/var/lib/mysql/mysql/time_zone_leap_second.MYI’ removed ‘/var/lib/mysql/mysql/time_zone_leap_second.frm’ removed ‘/var/lib/mysql/mysql/help_category.MYD’ removed ‘/var/lib/mysql/mysql/time_zone_name.MYD’ removed ‘/var/lib/mysql/mysql/help_category.MYI’ removed ‘/var/lib/mysql/mysql/time_zone_name.MYI’ removed ‘/var/lib/mysql/mysql/help_category.frm’ removed ‘/var/lib/mysql/mysql/time_zone_name.frm’ removed ‘/var/lib/mysql/mysql/help_keyword.MYD’ removed ‘/var/lib/mysql/mysql/time_zone_transition.MYD’ removed ‘/var/lib/mysql/mysql/help_keyword.MYI’ removed ‘/var/lib/mysql/mysql/time_zone_transition.MYI’ removed ‘/var/lib/mysql/mysql/help_keyword.frm’ removed ‘/var/lib/mysql/mysql/time_zone_transition.frm’ removed ‘/var/lib/mysql/mysql/help_relation.MYD’ removed ‘/var/lib/mysql/mysql/user.MYI’ removed ‘/var/lib/mysql/mysql/help_relation.MYI’ removed ‘/var/lib/mysql/mysql/user.MYD’ removed ‘/var/lib/mysql/mysql/help_relation.frm’ removed ‘/var/lib/mysql/mysql/user.frm’ removed ‘/var/lib/mysql/mysql/help_topic.MYD’ removed ‘/var/lib/mysql/mysql/help_topic.MYI’ removed ‘/var/lib/mysql/mysql/help_topic.frm’ removed ‘/var/lib/mysql/mysql/host.MYD’ removed ‘/var/lib/mysql/mysql/host.MYI’ removed ‘/var/lib/mysql/mysql/host.frm’ removed ‘/var/lib/mysql/mysql/index_stats.MYD’ removed ‘/var/lib/mysql/mysql/index_stats.MYI’ removed ‘/var/lib/mysql/mysql/index_stats.frm’ removed ‘/var/lib/mysql/mysql/time_zone_transition_type.MYD’ removed ‘/var/lib/mysql/mysql/innodb_index_stats.frm’ removed ‘/var/lib/mysql/mysql/proxies_priv.MYI’ removed ‘/var/lib/mysql/mysql/proxies_priv.frm’ removed ‘/var/lib/mysql/mysql/innodb_table_stats.frm’ removed ‘/var/lib/mysql/mysql/roles_mapping.MYD’ removed ‘/var/lib/mysql/mysql/plugin.MYD’ removed ‘/var/lib/mysql/mysql/plugin.MYI’ removed ‘/var/lib/mysql/mysql/plugin.frm’ removed ‘/var/lib/mysql/mysql/proc.MYD’ removed ‘/var/lib/mysql/mysql/proc.MYI’ removed ‘/var/lib/mysql/mysql/proc.frm’ removed ‘/var/lib/mysql/mysql/procs_priv.MYD’ removed ‘/var/lib/mysql/mysql/procs_priv.MYI’ removed ‘/var/lib/mysql/mysql/procs_priv.frm’ removed ‘/var/lib/mysql/mysql/proxies_priv.MYD’ removed ‘/var/lib/mysql/mysql/roles_mapping.frm’ removed ‘/var/lib/mysql/mysql/servers.MYD’ removed ‘/var/lib/mysql/mysql/servers.MYI’ removed ‘/var/lib/mysql/mysql/servers.frm’ removed ‘/var/lib/mysql/mysql/slow_log.CSM’ removed ‘/var/lib/mysql/mysql/slow_log.CSV’ removed ‘/var/lib/mysql/mysql/slow_log.frm’ removed ‘/var/lib/mysql/mysql/table_stats.MYD’ removed ‘/var/lib/mysql/mysql/time_zone_transition_type.MYI’ removed ‘/var/lib/mysql/mysql/time_zone_transition_type.frm’ removed directory: ‘/var/lib/mysql/mysql’ removed ‘/var/lib/mysql/boxoffice_mdb/dim_showtime.ibd’ removed ‘/var/lib/mysql/boxoffice_mdb/dim_theater_mdc.ibd’ removed ‘/var/lib/mysql/boxoffice_mdb/dim_theater.ibd’ removed ‘/var/lib/mysql/boxoffice_mdb/dim_ticket_type.ibd’ removed ‘/var/lib/mysql/boxoffice_mdb/dim_title.ibd’ removed ‘/var/lib/mysql/boxoffice_mdb/fact_tickets.ibd’ removed ‘/var/lib/mysql/boxoffice_mdb/db.opt’ removed ‘/var/lib/mysql/boxoffice_mdb/dim_showtime.frm’ removed ‘/var/lib/mysql/boxoffice_mdb/dim_theater_mdc.frm’ removed ‘/var/lib/mysql/boxoffice_mdb/dim_theater.frm’ removed ‘/var/lib/mysql/boxoffice_mdb/dim_ticket_type.frm’ removed ‘/var/lib/mysql/boxoffice_mdb/dim_title.frm’ removed ‘/var/lib/mysql/boxoffice_mdb/fact_tickets.frm’ removed directory: ‘/var/lib/mysql/boxoffice_mdb’ removed ‘/var/lib/mysql/performance_schema/db.opt’ removed directory: ‘/var/lib/mysql/performance_schema’ removed ‘/var/lib/mysql/test/db.opt’ removed directory: ‘/var/lib/mysql/test’ removed ‘/var/lib/mysql/aria_log.00000001’ removed ‘/var/lib/mysql/aria_log_control’ removed ‘/var/lib/mysql/ib_buffer_pool’ removed ‘/var/lib/mysql/xtrabackup_info’ removed ‘/var/lib/mysql/ib_logfile1’ removed ‘/var/lib/mysql/mysql.sock’ WSREP_SST: [INFO] Waiting for SST streaming to complete! (20180125 13:34:28.414) 2018-01-25 13:34:29 140511599912704 [Note] WSREP: (b2a0fd6e, 'tcp://0.0.0.0:4567') connection to peer b2a0fd6e with addr tcp://192.168.104.193:4567 timed out, no messages seen in PT3S 2018-01-25 13:34:29 140511599912704 [Note] WSREP: (b2a0fd6e, 'tcp://0.0.0.0:4567') turning message relay requesting off WSREP_SST: [ERROR] xtrabackup_checkpoints missing, failed innobackupex/SST on donor (20180125 13:34:47.474) WSREP_SST: [ERROR] Cleanup after exit with status:2 (20180125 13:34:47.477) 2018-01-25 13:34:47 140511583127296 [ERROR] WSREP: Process completed with error: wsrep_sst_mariabackup --role 'joiner' --address '192.168.104.193' --datadir '/var/lib/mysql/' --parent '1995' '' : 2 (No such file or directory) 2018-01-25 13:34:47 140511583127296 [ERROR] WSREP: Failed to read uuid:seqno and wsrep_gtid_domain_id from joiner script. 2018-01-25 13:34:47 140511928027264 [ERROR] WSREP: SST failed: 2 (No such file or directory) 2018-01-25 13:34:47 140511928027264 [ERROR] Aborting 2018-01-25 13:34:47 140511591520000 [Warning] WSREP: 0.0 (t4w6): State transfer to 2.0 (t4w3) failed: -22 (Invalid argument) 2018-01-25 13:34:47 140511591520000 [ERROR] WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():736: Will never receive state. Need to abort. 2018-01-25 13:34:55 139776740337792 [Note] WSREP: Read nil XID from storage engines, skipping position init 2018-01-25 13:34:55 139776740337792 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' 2018-01-25 13:34:55 139776740337792 [Note] WSREP: wsrep_load(): Galera 25.3.22(r3764) by Codership Oy loaded successfully. 2018-01-25 13:34:55 139776740337792 [Note] WSREP: CRC-32C: using "slicing-by-8" algorithm. 2018-01-25 13:34:55 139776740337792 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1 2018-01-25 13:34:55 139776740337792 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 192.168.104.193; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; p 2018-01-25 13:34:55 139776740337792 [Note] WSREP: GCache history reset: ca2bb6d4-ff5d-11e7-8871-7f48103f96c0:0 -> 00000000-0000-0000-0000-000000000000:-1 2018-01-25 13:34:55 139776740337792 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1 2018-01-25 13:34:55 139776740337792 [Note] WSREP: wsrep_sst_grab() 2018-01-25 13:34:55 139776740337792 [Note] WSREP: Start replication 2018-01-25 13:34:55 139776740337792 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 2018-01-25 13:34:55 139776740337792 [Note] WSREP: protonet asio version 0 2018-01-25 13:34:55 139776740337792 [Note] WSREP: Using CRC-32C for message checksums. 2018-01-25 13:34:55 139776740337792 [Note] WSREP: backend: asio 2018-01-25 13:34:55 139776740337792 [Note] WSREP: gcomm thread scheduling priority set to other:0 2018-01-25 13:34:55 139776740337792 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) 2018-01-25 13:34:55 139776740337792 [Note] WSREP: restore pc from disk failed 2018-01-25 13:34:55 139776740337792 [Note] WSREP: GMCast version 0 2018-01-25 13:34:55 139776740337792 [Note] WSREP: (c426681c, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 2018-01-25 13:34:55 139776740337792 [Note] WSREP: (c426681c, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 2018-01-25 13:34:55 139776740337792 [Note] WSREP: EVS version 0 2018-01-25 13:34:55 139776740337792 [Note] WSREP: gcomm: connecting to group 'cluster1', peer '192.168.104.193:,192.168.104.195:,192.168.104.196:,192.168.104.191:' 2018-01-25 13:34:55 139776740337792 [Note] WSREP: (c426681c, 'tcp://0.0.0.0:4567') connection established to c426681c tcp://192.168.104.193:4567 2018-01-25 13:34:55 139776740337792 [Warning] WSREP: (c426681c, 'tcp://0.0.0.0:4567') address 'tcp://192.168.104.193:4567' points to own listening address, blacklisting 2018-01-25 13:34:55 139776740337792 [Note] WSREP: (c426681c, 'tcp://0.0.0.0:4567') connection established to 14afa916 tcp://192.168.104.196:4567 2018-01-25 13:34:55 139776740337792 [Note] WSREP: (c426681c, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: 2018-01-25 13:34:55 139776740337792 [Note] WSREP: (c426681c, 'tcp://0.0.0.0:4567') connection established to 2fec1813 tcp://192.168.104.191:4567 2018-01-25 13:34:56 139776740337792 [Note] WSREP: declaring 14afa916 at tcp://192.168.104.196:4567 stable 2018-01-25 13:34:56 139776740337792 [Note] WSREP: declaring 2fec1813 at tcp://192.168.104.191:4567 stable 2018-01-25 13:34:56 139776740337792 [Note] WSREP: Node 14afa916 state prim 2018-01-25 13:34:56 139776740337792 [Note] WSREP: view(view_id(PRIM,14afa916,61) memb { 14afa916,0 2fec1813,0 c426681c,0 } joined { } left { } partitioned { }) 2018-01-25 13:34:56 139776740337792 [Note] WSREP: save pc into disk 2018-01-25 13:34:56 139776740337792 [Note] WSREP: discarding pending addr without UUID: tcp://192.168.104.195:4567 2018-01-25 13:34:56 139776740337792 [Note] WSREP: gcomm: connected 2018-01-25 13:34:56 139776740337792 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2018-01-25 13:34:56 139776740337792 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2018-01-25 13:34:56 139776740337792 [Note] WSREP: Opened channel 'cluster1' 2018-01-25 13:34:56 139776397129472 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3 2018-01-25 13:34:56 139776397129472 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2018-01-25 13:34:56 139776740337792 [Note] WSREP: Waiting for SST to complete. 2018-01-25 13:34:56 139776397129472 [Note] WSREP: STATE EXCHANGE: sent state msg: c849b060-01c3-11e8-86d6-03000d1d2065 2018-01-25 13:34:56 139776397129472 [Note] WSREP: STATE EXCHANGE: got state msg: c849b060-01c3-11e8-86d6-03000d1d2065 from 0 (t4w6) 2018-01-25 13:34:56 139776397129472 [Note] WSREP: STATE EXCHANGE: got state msg: c849b060-01c3-11e8-86d6-03000d1d2065 from 1 (t4w1) 2018-01-25 13:34:56 139776397129472 [Note] WSREP: STATE EXCHANGE: got state msg: c849b060-01c3-11e8-86d6-03000d1d2065 from 2 (t4w3) 2018-01-25 13:34:56 139776397129472 [Note] WSREP: Quorum results: version = 4, component = PRIMARY, conf_id = 60, members = 2/3 (joined/total), act_id = 599, last_appl. = -1, protocols = 0/7/3 (gcs/repl/appl), group UUID = ca2bb6d4-ff5d-11e7-8871-7f48103f96c0 2018-01-25 13:34:56 139776397129472 [Note] WSREP: Flow-control interval: [28, 28] 2018-01-25 13:34:56 139776397129472 [Note] WSREP: Trying to continue unpaused monitor 2018-01-25 13:34:56 139776397129472 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 599) 2018-01-25 13:34:56 139776631461632 [Note] WSREP: State transfer required: Group state: ca2bb6d4-ff5d-11e7-8871-7f48103f96c0:599 Local state: 00000000-0000-0000-0000-000000000000:-1 2018-01-25 13:34:56 139776631461632 [Note] WSREP: New cluster view: global state: ca2bb6d4-ff5d-11e7-8871-7f48103f96c0:599, view# 61: Primary, number of nodes: 3, my index: 2, protocol version 3 2018-01-25 13:34:56 139776631461632 [Warning] WSREP: Gap in state sequence. Need state transfer. 2018-01-25 13:34:56 139776388736768 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '192.168.104.193' --datadir '/var/lib/mysql/' --parent '2437' '' ' WSREP_SST: [INFO] Streaming with xbstream (20180125 13:34:56.940) WSREP_SST: [INFO] Using socat as streamer (20180125 13:34:56.942) WSREP_SST: [INFO] Stale sst_in_progress file: /var/lib/mysql//sst_in_progress (20180125 13:34:56.949) WSREP_SST: [INFO] Evaluating timeout -k 110 100 socat -u TCP-LISTEN:4444,reuseaddr stdio | mbstream -x; RC=( ${PIPESTATUS[@]} ) (20180125 13:34:57.006) 2018-01-25 13:34:57 139776631461632 [Note] WSREP: Prepared SST request: mariabackup|192.168.104.193:4444/xtrabackup_sst//1 2018-01-25 13:34:57 139776631461632 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2018-01-25 13:34:57 139776631461632 [Note] WSREP: REPL Protocols: 7 (3, 2) 2018-01-25 13:34:57 139776631461632 [Note] WSREP: Assign initial position for certification: 599, protocol version: 3 2018-01-25 13:34:57 139776648247040 [Note] WSREP: Service thread queue flushed. 2018-01-25 13:34:57 139776631461632 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (ca2bb6d4-ff5d-11e7-8871-7f48103f96c0): 1 (Operation not permitted) at galera/src/replicator_str.cpp:prepare_for_IST():482. IST will be unavailable. 2018-01-25 13:34:57 139776397129472 [Note] WSREP: Member 2.0 (t4w3) requested state transfer from '*any*'. Selected 0.0 (t4w6)(SYNCED) as donor. 2018-01-25 13:34:57 139776397129472 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 599) 2018-01-25 13:34:57 139776631461632 [Note] WSREP: Requesting state transfer: success, donor: 0 2018-01-25 13:34:57 139776631461632 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> ca2bb6d4-ff5d-11e7-8871-7f48103f96c0:599 WSREP_SST: [INFO] WARNING: Stale temporary SST directory: /var/lib/mysql//.sst from previous state transfer. Removing (20180125 13:34:57.673) WSREP_SST: [INFO] Proceeding with SST (20180125 13:34:57.691) WSREP_SST: [INFO] Evaluating socat -u TCP-LISTEN:4444,reuseaddr stdio | mbstream -x; RC=( ${PIPESTATUS[@]} ) (20180125 13:34:57.693) WSREP_SST: [INFO] Cleaning the existing datadir and innodb-data/log directories (20180125 13:34:57.695) removed ‘/var/lib/mysql/aria_log_control’ removed ‘/var/lib/mysql/aria_log.00000001’ removed ‘/var/lib/mysql/ibdata1’ removed ‘/var/lib/mysql/ib_logfile1’ removed ‘/var/lib/mysql/mysql.sock’ WSREP_SST: [INFO] Waiting for SST streaming to complete! (20180125 13:34:57.719) 2018-01-25 13:34:58 139776405522176 [Note] WSREP: (c426681c, 'tcp://0.0.0.0:4567') connection to peer c426681c with addr tcp://192.168.104.193:4567 timed out, no messages seen in PT3S 2018-01-25 13:34:59 139776405522176 [Note] WSREP: (c426681c, 'tcp://0.0.0.0:4567') turning message relay requesting off WSREP_SST: [ERROR] xtrabackup_checkpoints missing, failed innobackupex/SST on donor (20180125 13:35:16.829) WSREP_SST: [ERROR] Cleanup after exit with status:2 (20180125 13:35:16.832) 2018-01-25 13:35:16 139776388736768 [ERROR] WSREP: Process completed with error: wsrep_sst_mariabackup --role 'joiner' --address '192.168.104.193' --datadir '/var/lib/mysql/' --parent '2437' '' : 2 (No such file or directory) 2018-01-25 13:35:16 139776388736768 [ERROR] WSREP: Failed to read uuid:seqno and wsrep_gtid_domain_id from joiner script. 2018-01-25 13:35:16 139776740337792 [ERROR] WSREP: SST failed: 2 (No such file or directory) 2018-01-25 13:35:16 139776740337792 [ERROR] Aborting 2018-01-25 13:35:16 139776397129472 [Warning] WSREP: 0.0 (t4w6): State transfer to 2.0 (t4w3) failed: -22 (Invalid argument) 2018-01-25 13:35:16 139776397129472 [ERROR] WSREP: gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():736: Will never receive state. Need to abort.