[MDEV-13879] galera.galera_wan fails in buildbot with Stray state UUID msg or with "Transport endpoint is not connected" or with a failure to start a node Created: 2017-09-22  Updated: 2021-05-13  Resolved: 2018-09-17

Status: Closed
Project: MariaDB Server
Component/s: Galera, Tests
Affects Version/s: 10.1, 10.2
Fix Version/s: 10.2.18, 10.3.10, 10.1.37

Type: Bug Priority: Major
Reporter: Elena Stepanova Assignee: Jan Lindström (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Blocks
blocks MDEV-13549 Galera 3 test failures Closed

 Description   

http://buildbot.askmonty.org/buildbot/builders/kvm-deb-wheezy-amd64/builds/10391

galera.galera_wan 'xtradb'               w1 [ fail ]  Found warnings/errors in server log file!
 
        Test ended at 2017-09-20 05:02:06
 
line
 
2017-09-20  5:01:58 139778875975424 [Warning] WSREP: Stray state UUID msg: 5b8a7142-9de2-11e7-92fd-7653705dc645 from node 139775415681025 (unspecified), current group state WAIT_STATE_UUID
 
^ Found warnings in /run/shm/var/1/log/mysqld.2.err
 
ok
 
line
 
2017-09-20  5:01:58 140461477975808 [Warning] WSREP: Stray state UUID msg: 5b8a7142-9de2-11e7-92fd-7653705dc645 from node 140458315481089 (unspecified), current group state WAIT_STATE_UUID
 
^ Found warnings in /run/shm/var/1/log/mysqld.3.err
 
ok
 
line
 
2017-09-20  5:01:58 140114248324864 [Warning] WSREP: Stray state UUID msg: 5b8a7142-9de2-11e7-92fd-7653705dc645 from node 140110423130113 (unspecified), current group state WAIT_STATE_UUID
 
^ Found warnings in /run/shm/var/1/log/mysqld.4.err
 
ok
 
line
 
2017-09-20  5:01:58 140116865570560 [Warning] WSREP: Stray state UUID msg: 5b8a7142-9de2-11e7-92fd-7653705dc645 from node 140114718097409 (debian7-wheezy-amd64), current group state WAIT_STATE_UUID
 
^ Found warnings in /run/shm/var/1/log/mysqld.1.err
 
ok


galera.galera_wan 'innodb_plugin'        w2 [ fail ]  Found warnings/errors in server log file!
 
        Test ended at 2017-10-22 21:07:40
 
line
 
2017-10-22 21:07:31 140509163022080 [Warning] WSREP: Sending JOIN failed: -107 (Transport endpoint is not connected). Will retry in new primary component.
 
^ Found warnings in /run/shm/var/2/log/mysqld.1.err
 
ok

http://buildbot.askmonty.org/buildbot/builders/kvm-deb-wheezy-amd64/builds/10716/steps/mtr/logs/stdio

galera.galera_wan 'innodb'               w4 [ fail ]
 
        Test ended at 2017-10-12 07:26:02
 
 
 
CURRENT_TEST: galera.galera_wan
 
 
 
 
 
Failed to start mysqld.3
 
mysqltest failed but provided no output
 
 
 
 
 
 - saving '/run/shm/var/4/log/galera.galera_wan-innodb/' to '/run/shm/var/log/galera.galera_wan-innodb/'
 
 
 
Retrying test galera.galera_wan, attempt(2/3)...
 
 
 
worker[4] > Restart  - not started
 
worker[4] > Restart  - not started
 
worker[4] > Restart  - not started
 
worker[4] > Restart  - not started
 
***Warnings generated in error logs during shutdown after running tests: galera.galera_wan


2017-10-12  7:26:00 139893572536096 [Note] WSREP: (0e4a956d, 'tcp://0.0.0.0:16050') turning message relay requesting on, nonlive peers: tcp://127.0.0.1:16044 tcp://127.0.0.1:16047 tcp://127.0.0.1:16053 
2017-10-12  7:26:01 139893572536096 [Note] WSREP: (0e4a956d, 'tcp://0.0.0.0:16050') reconnecting to 0e3c3aaa (tcp://127.0.0.1:16044), attempt 0
 
2017-10-12  7:26:01 139893572536096 [Note] WSREP: (0e4a956d, 'tcp://0.0.0.0:16050') reconnecting to 0e42b217 (tcp://127.0.0.1:16047), attempt 0
 
2017-10-12  7:26:01 139893572536096 [Note] WSREP: (0e4a956d, 'tcp://0.0.0.0:16050') reconnecting to 0e48f79a (tcp://127.0.0.1:16053), attempt 0
 
2017-10-12  7:26:01 139893572536096 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out)
 
	 at gcomm/src/pc.cpp:connect():158
 
2017-10-12  7:26:01 139893572536096 [ERROR] WSREP: gcs/src/gcs_core.cpp:gcs_core_open():208: Failed to open backend connection: -110 (Connection timed out)
 
2017-10-12  7:26:01 139893572536096 [ERROR] WSREP: gcs/src/gcs.cpp:gcs_open():1404: Failed to open channel 'my_wsrep_cluster' at 'gcomm://127.0.0.1:16044': -110 (Connection timed out)
 
2017-10-12  7:26:01 139893572536096 [ERROR] WSREP: gcs connect failed: Connection timed out
 
2017-10-12  7:26:01 139893572536096 [ERROR] WSREP: wsrep::connect(gcomm://127.0.0.1:16044) failed: 7
 
2017-10-12  7:26:01 139893572536096 [ERROR] Aborting



 Comments   
Comment by Alice Sherepa [ 2017-11-27 ]

on 10.2 http://buildbot.askmonty.org/buildbot/builders/kvm-deb-xenial-x86/builds/4433/steps/mtr/logs/stdio

galera.galera_wan 'innodb'               w3 [ fail ]  Found warnings/errors in server log file!
 
        Test ended at 2017-11-24 15:55:41
 
line
 
2017-11-24 15:55:28 2937555776 [Warning] WSREP: Sending JOIN failed: -107 (Transport endpoint is not connected). Will retry in new primary component.
 
^ Found warnings in /dev/shm/var/3/log/mysqld.4.err
 
ok

Comment by Jan Lindström (Inactive) [ 2018-09-17 ]

on http://buildbot.askmonty.org/buildbot/builders/kvm-deb-bionic-ppc64le/builds/271/steps/mtr/logs/stdio

galera.galera_wan 'innodb'               w3 [ fail ]
 
        Test ended at 2018-07-02 05:49:29
 
 
 
CURRENT_TEST: galera.galera_wan
 
 
 
 
 
Could not execute 'check-testcase' before testcase 'galera.galera_wan' (res: 1):
 
mysqltest: Logging to '/dev/shm/var/3/tmp/check-mysqld_1.log'.
 
mysqltest: Results saved in '/dev/shm/var/3/tmp/check-mysqld_1.result'.
 
mysqltest: Connecting to server localhost:16020 (socket /dev/shm/var/tmp/3/mysqld.1.sock) as 'root', connection 'default', attempt 0 ...
 
mysqltest: ... Connected.
 
mysqltest: Start processing test commands from './include/check-testcase.test' ...
 
mysqltest: At line 19: query 'let $tmp= `SELECT '$tmp' = 'No such row'`' failed: 1205: Lock wait timeout exceeded; try restarting transaction
 
not ok
 
mysqltest failed but provided no output

Generated at Thu Feb 08 08:09:05 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.