150414  9:28:02 [Note] WSREP: Member 1.0 (sbserver08) desyncs itself from group
150414  9:28:29 [Note] WSREP: Member 1.0 (sbserver08) resyncs itself to group
150414  9:28:29 [Note] WSREP: Member 1.0 (sbserver08) synced with group.
150414  9:32:03 [Note] WSREP: Member 0.0 (sbserver03) desyncs itself from group
150414  9:32:03 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 5673399)
150414  9:32:03 [Note] WSREP: Provider paused at c58d6c6e-dc0f-11e4-bccb-225e15336614:5673399 (5591736)
150414  9:32:31 [Note] WSREP: resuming provider at 5591736
150414  9:32:31 [Note] WSREP: Provider resumed.
150414  9:32:31 [Note] WSREP: Member 0.0 (sbserver03) resyncs itself to group
150414  9:32:31 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 5673402)
150414  9:32:31 [Note] WSREP: Member 0.0 (sbserver03) synced with group.
150414  9:32:31 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 5673404)
150414  9:32:31 [Note] WSREP: Synchronized with group, ready for connections
!!!! probably time of second alter table execution - after this all connections halted
150415  7:58:16 [Note] WSREP: Member 0.0 (sbserver03) desyncs itself from group
150415  7:58:16 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 6262857)
150415  8:03:42 [Note] /usr/sbin/mysqld: Normal shutdown

150415  8:03:42 [Note] WSREP: Stop replication
150415  8:03:42 [Note] WSREP: Closing send monitor...
150415  8:03:42 [Note] WSREP: Closed send monitor.
150415  8:03:42 [Note] WSREP: gcomm: terminating thread
150415  8:03:42 [Note] WSREP: gcomm: joining thread
150415  8:03:42 [Note] WSREP: gcomm: closing backend
150415  8:03:48 [Note] WSREP: evs::proto(17b0f6e6, LEAVING, view_id(REG,17b0f6e6,8)) suspecting node: abe07522
150415  8:03:48 [Note] WSREP: evs::proto(17b0f6e6, LEAVING, view_id(REG,17b0f6e6,8)) suspected node without join message, declaring inactive
150415  8:03:48 [Note] WSREP: view(view_id(NON_PRIM,17b0f6e6,8) memb {
        17b0f6e6,0
} joined {
} left {
} partitioned {
        abe07522,0
})
150415  8:03:48 [Note] WSREP: view((empty))
150415  8:03:48 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
150415  8:03:48 [Note] WSREP: gcomm: closed
150415  8:03:48 [Note] WSREP: Flow-control interval: [16, 16]
150415  8:03:48 [Note] WSREP: Received NON-PRIMARY.
150415  8:03:48 [Note] WSREP: Shifting DONOR/DESYNCED -> OPEN (TO: 6262859)
150415  8:03:48 [Note] WSREP: Received self-leave message.
150415  8:03:48 [Note] WSREP: Flow-control interval: [0, 0]
150415  8:03:48 [Note] WSREP: Received SELF-LEAVE. Closing connection.
150415  8:03:48 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 6262859)
150415  8:03:48 [Note] WSREP: RECV thread exiting 0: Success
150415  8:03:48 [Note] WSREP: New cluster view: global state: c58d6c6e-dc0f-11e4-bccb-225e15336614:6262859, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version 3
150415  8:03:48 [Note] WSREP: recv_thread() joined.
150415  8:03:48 [Note] WSREP: Closing replication queue.
150415  8:03:48 [Note] WSREP: Closing slave action queue.
150415  8:03:49 [Note] WSREP: New cluster view: global state: c58d6c6e-dc0f-11e4-bccb-225e15336614:6262859, view# -1: non-Primary, number of nodes: 0, my index: -1, protocol version 3
150415  8:03:49 [Note] WSREP: applier thread exiting (code:0)
150415  8:03:49 [Note] WSREP: applier thread exiting (code:6)
150415  8:03:49 [Note] WSREP: applier thread exiting (code:6)
150415  8:03:49 [Note] WSREP: applier thread exiting (code:6)
150415  8:03:49 [Note] WSREP: applier thread exiting (code:6)
150415  8:03:49 [Note] WSREP: applier thread exiting (code:6)
150415  8:03:49 [Note] WSREP: applier thread exiting (code:6)
150415  8:03:49 [Note] WSREP: applier thread exiting (code:6)
150415  8:03:49 [Note] WSREP: applier thread exiting (code:6)
150415  8:03:49 [Note] WSREP: applier thread exiting (code:6)
!!!! after this kill -s 9 had to be issued to actually kill remains of the process before starting it again
150415 08:08:39 mysqld_safe Starting mysqld daemon with databases from /home/dbs/mysql
150415 08:08:39 mysqld_safe WSREP: Running position recovery with --log_error='/home/dbs/mysql/wsrep_recovery.AU7873' --pid-file='/home/dbs/mysql/sbserver03.smartbetting.eu-recover.pid'
150415  8:08:39 [Warning] option 'wsrep_max_ws_size': unsigned value 4294967296 adjusted to 4294901759
150415 08:08:48 mysqld_safe WSREP: Recovered position c58d6c6e-dc0f-11e4-bccb-225e15336614:6262859
150415  8:08:48 [Warning] option 'wsrep_max_ws_size': unsigned value 4294967296 adjusted to 4294901759
150415  8:08:48 [Note] WSREP: wsrep_start_position var submitted: 'c58d6c6e-dc0f-11e4-bccb-225e15336614:6262859'
150415  8:08:48 [Note] WSREP: Read nil XID from storage engines, skipping position init
150415  8:08:48 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so'
150415  8:08:48 [Note] WSREP: wsrep_load(): Galera 25.3.9(r3387) by Codership Oy <info@codership.com> loaded successfully.
150415  8:08:48 [Note] WSREP: CRC-32C: using "slicing-by-8" algorithm.
150415  8:08:48 [Note] WSREP: Found saved state: c58d6c6e-dc0f-11e4-bccb-225e15336614:6262859
150415  8:08:48 [Note] WSREP: Passing config to GCS: base_host = 10.10.10.103; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /home/dbs/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /home/dbs/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 256M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignore_quorum = false; pc.ignore_sb = false; pc.npvo = false; pc.recov
150415  8:08:48 [Note] WSREP: Service thread queue flushed.
150415  8:08:48 [Note] WSREP: Assign initial position for certification: 6262859, protocol version: -1
150415  8:08:48 [Note] WSREP: wsrep_sst_grab()
150415  8:08:48 [Note] WSREP: Start replication
150415  8:08:48 [Note] WSREP: Setting initial position to c58d6c6e-dc0f-11e4-bccb-225e15336614:6262859
150415  8:08:48 [Note] WSREP: protonet asio version 0
150415  8:08:48 [Note] WSREP: Using CRC-32C for message checksums.
150415  8:08:48 [Note] WSREP: backend: asio
150415  8:08:48 [Warning] WSREP: access file(gvwstate.dat) failed(No such file or directory)
150415  8:08:48 [Note] WSREP: restore pc from disk failed
150415  8:08:48 [Note] WSREP: GMCast version 0
150415  8:08:48 [Note] WSREP: (e1722bcc, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
150415  8:08:48 [Note] WSREP: (e1722bcc, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
150415  8:08:48 [Note] WSREP: EVS version 0
150415  8:08:48 [Note] WSREP: gcomm: connecting to group 'vtk_galera_cluster', peer ''
150415  8:08:48 [Note] WSREP: start_prim is enabled, turn off pc_recovery
150415  8:08:48 [Note] WSREP: Node e1722bcc state prim
150415  8:08:48 [Note] WSREP: view(view_id(PRIM,e1722bcc,1) memb {
        e1722bcc,0
} joined {
} left {
} partitioned {
})
150415  8:08:48 [Note] WSREP: save pc into disk
150415  8:08:48 [Note] WSREP: gcomm: connected
150415  8:08:48 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
150415  8:08:48 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
150415  8:08:48 [Note] WSREP: Opened channel 'vtk_galera_cluster'
150415  8:08:48 [Note] WSREP: Waiting for SST to complete.
150415  8:08:48 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1
150415  8:08:48 [Note] WSREP: STATE_EXCHANGE: sent state UUID: e172c51e-e335-11e4-b250-0280230d5019
150415  8:08:48 [Note] WSREP: STATE EXCHANGE: sent state msg: e172c51e-e335-11e4-b250-0280230d5019
150415  8:08:48 [Note] WSREP: STATE EXCHANGE: got state msg: e172c51e-e335-11e4-b250-0280230d5019 from 0 (sbserver03)
150415  8:08:48 [Note] WSREP: Quorum results:
        version    = 3,
        component  = PRIMARY,
        conf_id    = 0,
        members    = 1/1 (joined/total),
        act_id     = 6262859,
        last_appl. = -1,
        protocols  = 0/7/3 (gcs/repl/appl),
        group UUID = c58d6c6e-dc0f-11e4-bccb-225e15336614
150415  8:08:48 [Note] WSREP: Flow-control interval: [16, 16]
150415  8:08:48 [Note] WSREP: Restored state OPEN -> JOINED (6262859)
150415  8:08:48 [Note] WSREP: Member 0.0 (sbserver03) synced with group.
150415  8:08:48 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 6262859)
150415  8:08:48 [Note] WSREP: New cluster view: global state: c58d6c6e-dc0f-11e4-bccb-225e15336614:6262859, view# 1: Primary, number of nodes: 1, my index: 0, protocol version 3
150415  8:08:48 [Note] WSREP: SST complete, seqno: 6262859
150415  8:08:48 [Note] InnoDB: Using mutexes to ref count buffer pool pages
150415  8:08:48 [Note] InnoDB: The InnoDB memory heap is disabled
150415  8:08:48 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
150415  8:08:48 [Note] InnoDB: Memory barrier is not used
150415  8:08:48 [Note] InnoDB: Compressed tables use zlib 1.2.3
150415  8:08:48 [Note] InnoDB: Using Linux native AIO
150415  8:08:48 [Note] InnoDB: Not using CPU crc32 instructions
150415  8:08:48 [Note] InnoDB: Initializing buffer pool, size = 20.0G
150415  8:08:50 [Note] InnoDB: Completed initialization of buffer pool
150415  8:08:50 [Note] InnoDB: Highest supported file format is Barracuda.
150415  8:08:51 [Note] InnoDB: 128 rollback segment(s) are active.
150415  8:08:51 [Note] InnoDB: Waiting for purge to start
150415  8:08:51 [Note] InnoDB:  Percona XtraDB (http://www.percona.com) 5.6.22-72.0 started; log sequence number 106212457357
150415  8:08:51 [Note] Plugin 'FEEDBACK' is disabled.
150415  8:08:51 [ERROR] Failed to create a socket for IPv6 '::': errno: 97.
150415  8:08:51 [Note] Server socket created on IP: '0.0.0.0'.
150415  8:08:51 [Warning] 'proxies_priv' entry '@% root@sbserver03.smartbetting.eu' ignored in --skip-name-resolve mode.
150415  8:08:51 [Note] Event Scheduler: Loaded 0 events
150415  8:08:51 [Note] /usr/sbin/mysqld: ready for connections.
Version: '10.0.17-MariaDB-wsrep-log'  socket: '/home/dbs/mysql/mysqld.sock'  port: 3306  MariaDB Server, wsrep_25.10.r4144
150415  8:08:51 [Note] WSREP: REPL Protocols: 7 (3, 2)
150415  8:08:51 [Note] WSREP: Service thread queue flushed.
150415  8:08:51 [Note] WSREP: Assign initial position for certification: 6262859, protocol version: 3
150415  8:08:51 [Note] WSREP: Service thread queue flushed.
150415  8:08:51 [Note] WSREP: Synchronized with group, ready for connections
150415  8:13:00 [Note] WSREP: (e1722bcc, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: 
150415  8:13:01 [Note] WSREP: declaring 78a4917a at tcp://10.10.10.108:4567 stable
150415  8:13:01 [Note] WSREP: Node e1722bcc state prim
150415  8:13:01 [Note] WSREP: view(view_id(PRIM,78a4917a,2) memb {
        78a4917a,0
        e1722bcc,0
} joined {
} left {
} partitioned {
})
150415  8:13:01 [Note] WSREP: save pc into disk
150415  8:13:01 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
150415  8:13:01 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
150415  8:13:01 [Note] WSREP: STATE EXCHANGE: sent state msg: 78f14d87-e336-11e4-9fcf-d3d3b41eabeb
150415  8:13:01 [Note] WSREP: STATE EXCHANGE: got state msg: 78f14d87-e336-11e4-9fcf-d3d3b41eabeb from 0 (sbserver08)
150415  8:13:01 [Note] WSREP: STATE EXCHANGE: got state msg: 78f14d87-e336-11e4-9fcf-d3d3b41eabeb from 1 (sbserver03)
150415  8:13:01 [Note] WSREP: Quorum results:
        version    = 3,
        component  = PRIMARY,
        conf_id    = 1,
        members    = 1/2 (joined/total),
        act_id     = 6271193,
        last_appl. = 6271107,
        protocols  = 0/7/3 (gcs/repl/appl),
        group UUID = c58d6c6e-dc0f-11e4-bccb-225e15336614
150415  8:13:01 [Note] WSREP: Flow-control interval: [23, 23]
150415  8:13:01 [Note] WSREP: New cluster view: global state: c58d6c6e-dc0f-11e4-bccb-225e15336614:6271193, view# 2: Primary, number of nodes: 2, my index: 1, protocol version 3
150415  8:13:01 [Note] WSREP: REPL Protocols: 7 (3, 2)
150415  8:13:01 [Note] WSREP: Service thread queue flushed.
150415  8:13:01 [Note] WSREP: Assign initial position for certification: 6271193, protocol version: 3
150415  8:13:01 [Note] WSREP: Service thread queue flushed.
150415  8:13:01 [Note] WSREP: Member 0.0 (sbserver08) requested state transfer from '*any*'. Selected 1.0 (sbserver03)(SYNCED) as donor.
150415  8:13:01 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 6271198)
150415  8:13:01 [Note] WSREP: IST request: c58d6c6e-dc0f-11e4-bccb-225e15336614:6262859-6271193|tcp://10.10.10.108:4568
150415  8:13:01 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'donor' --address '10.10.10.108:4444/xtrabackup_sst' --auth 'sstuser:Pra46clo19VEK' --socket '/home/dbs/mysql/mysqld.sock' --datadir '/home/dbs/mysql/' --defaults-file '/etc/my.cnf'   '' --gtid 'c58d6c6e-dc0f-11e4-bccb-225e15336614:6262859' --bypass'
150415  8:13:01 [Note] WSREP: sst_donor_thread signaled with 0
150415  8:13:01 [Note] WSREP: async IST sender starting to serve tcp://10.10.10.108:4568 sending 6262860-6271193
WSREP_SST: [INFO] Streaming with tar (20150415 08:13:02.233)
WSREP_SST: [INFO] Using socat as streamer (20150415 08:13:02.335)
WSREP_SST: [INFO] Bypassing the SST for IST (20150415 08:13:02.341)
WSREP_SST: [INFO] Evaluating tar cf - ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.10.10.108:4444; RC=( ${PIPESTATUS[@]} ) (20150415 08:13:02.347)
150415  8:13:02 [Note] WSREP: 1.0 (sbserver03): State transfer to 0.0 (sbserver08) complete.
150415  8:13:02 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 6271203)
150415  8:13:02 [Note] WSREP: Member 1.0 (sbserver03) synced with group.
150415  8:13:02 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 6271203)
150415  8:13:02 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Total time on donor: 0 seconds (20150415 08:13:02.460)
150415  8:13:04 [Note] WSREP: (e1722bcc, 'tcp://0.0.0.0:4567') turning message relay requesting off
150415  8:13:09 [Note] WSREP: async IST sender served
150415  8:13:09 [Note] WSREP: 0.0 (sbserver08): State transfer from 1.0 (sbserver03) complete.
150415  8:13:09 [Note] WSREP: Member 0.0 (sbserver08) synced with group.