[MDEV-15536] I cant join cluster after upgrade to mariadb10.2 Created: 2018-03-10  Updated: 2021-05-03  Resolved: 2021-05-03

Status: Closed
Project: MariaDB Server
Component/s: Debug
Affects Version/s: 10.2.13
Fix Version/s: N/A

Type: Bug Priority: Critical
Reporter: Syamiera Assignee: Seppo Jaakola
Resolution: Not a Bug Votes: 0
Labels: None
Environment:

Centos 7.4 , Mariadb 10.2 , Galera 25.3.23


Attachments: HTML File wsrep_sst_common     HTML File wsrep_sst_xtrabackup-v2    

 Description   

I cant join 2nd node after I upgrade from 10.1.31 to Mariadb 10.2.13

this is the log from joiner:

WSREP_SST: [INFO] Evaluating timeout -k 110 100 socat -u TCP-LISTEN:4444,reuseaddr stdio | pv -f -i 10 -N joiner -F '%N => Rate:%r Avg:%a Elapsed:%t %e Bytes: %b %p' | gzip -dc | xbstream -x; RC=( ${PIPESTATUS[@]} ) (20180310 08:28:06.257)
2018-03-10 8:28:08 139921771714304 [Note] WSREP: (e62c1bbd, 'tcp://0.0.0.0:4567') connection to peer e62c1bbd with addr tcp://10.0.0.xx:4567 timed out, no messages seen in PT3S
2018-03-10 8:28:08 139921771714304 [Note] WSREP: (e62c1bbd, 'tcp://0.0.0.0:4567') turning message relay requesting off
joiner: => Rate:[ 0 B/s] Avg:[ 0 B/s] Elapsed:0:01:20
Terminated
WSREP_SST: [ERROR] Removing /tmp/tmp.qwniZF26Ha/xtrabackup_galera_info file due to signal (20180310 08:29:34.926)
WSREP_SST: [INFO] NOTE: Joiner-Recv-gtid took 88 seconds (20180310 08:29:34.932)
WSREP_SST: [ERROR] {color:red}Error while getting data from donor node: exit codes: 143 32 143 143{color} (20180310 08:29:34.934)
WSREP_SST: [ERROR] Cleanup after exit with status:32 (20180310 08:29:34.937)
2018-03-10 8:29:34 139921754928896 [ERROR] WSREP: Failed to read 'ready <addr>' from: wsrep_sst_xtrabackup-v2 --role 'joiner' --address '10.0.0.xx' --datadir '/var/lib/mysql/' --parent '66713' --binlog 'mysql-bin'
Read: '(null)'
2018-03-10 8:29:34 139921754928896 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup-v2 --role 'joiner' --address '10.0.0.xx' --datadir '/var/lib/mysql/' --parent '66713' --binlog 'mysql-bin' :{color:red} 32 (Broken pipe){color}
2018-03-10 8:29:34 139927220057856 [ERROR] WSREP: Failed to prepare for 'xtrabackup-v2' SST. Unrecoverable.
2018-03-10 8:29:34 139927220057856 [ERROR] Aborting

this is from /var/lib/mysql//innobackup.backup.log

180309 11:41:20 [04]        ...done
180309 11:41:20 [04] Compressing and streaming ./genapi/sms_mo.ibd
180309 11:41:20 >> log scanned up to (150710542218)
{color:red}innobackupex: Error writing file 'UNOPENED' (Errcode: 32 - Broken pipe){color}
xb_stream_write_data() failed.
compress: write to the destination stream failed.
innobackupex: Error writing file 'UNOPENED' (Errcode: 32 - Broken pipe)
[05] xtrabackup: Error: xtrabackup_copy_datafile() failed.
[05] xtrabackup: Error: failed to copy datafile.

Please help me how to fix the broken pipe issue.
Thank you!



 Comments   
Comment by Syamiera [ 2018-03-15 ]

Hi Support,

Any update?

Comment by Jasper Krijgsman [ 2018-04-25 ]

This is likely caused by MDEV-15606
I had the same error and disabling the timeout solved the issue.

Comment by Syamiera [ 2018-04-26 ]

yeah true. edit the timeout helps. Now can sync the cluster.Thanks alot!

Generated at Thu Feb 08 08:22:04 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.