[MDEV-21655] galera.galera_wan_restart_ist MTR fails sporadically: WSREP did not transition to state READY - Jira

Details

Type: Bug
Status: Closed (View Workflow)
Priority: Critical
Resolution: Fixed
Affects Version/s: 10.5.2, 10.2(EOL), 10.3(EOL), 10.4(EOL)
Fix Version/s: 10.2.35, 10.3.26, 10.4.16, 10.5.7, 10.6.0
Component/s: Galera, Tests
Labels:
None
Environment:
TestTarball_2 debian-8

Description

galera.galera_wan_restart_ist MTR fails sporadically on CI, 10.4/10.3/10.2 ES.
stdio.log:

10.4.12-6 90c709bf592e624ca1ee63e0ea8adad05e53d5d8
2020-02-04T06:02:25.3587995Z galera.galera_wan_restart_ist 'innodb' w2 [ fail ]
2020-02-04T06:02:25.3590196Z Test ended at 2020-02-04 06:02:25
2020-02-04T06:02:25.3590791Z
2020-02-04T06:02:25.3591183Z WSREP did not transition to state READY
2020-02-04T06:02:25.3591469Z
2020-02-04T06:02:25.3707824Z - saving '/var/tmp/mtr/2/log/galera.galera_wan_restart_ist-innodb/' to '/var/tmp/mtr/log/galera.galera_wan_restart_ist-innodb/'
2020-02-04T06:02:25.4115885Z ***Warnings generated in error logs during shutdown after running tests: galera.galera_wan_restart_ist
2020-02-04T06:02:25.4117222Z
2020-02-04T06:02:25.4118561Z 2020-02-04 5:58:24 0 [ERROR] WSREP: IST didn't contain all write sets, expected last: 3 last received: -1
2020-02-04T06:02:25.4119390Z 2020-02-04 5:58:24 1 [ERROR] WSREP: Receiving IST failed, node restart required: IST receiver reported failure: 71 (Protocol error)
2020-02-04T06:02:25.4120567Z 2020-02-04 5:58:24 1 [Warning] WSREP: Sending JOIN failed: -103 (Software caused connection abort). Will retry in new primary component.
2020-02-04T06:02:25.4121251Z 2020-02-04 5:58:24 1 [ERROR] WSREP: Failed to JOIN the cluster after SST

Attachments

Issue Links

relates to

MDEV-33778 galera.galera_wan_restart_ist test failure

Closed

Activity

Ascending order - Click to sort in descending order

Stepan Patryshev (Inactive) created issue - 2020-02-04 10:09

Stepan Patryshev (Inactive) made changes - 2020-02-04 10:09

Field	Original Value	New Value
Link		This issue blocks ~~MDEV-19937~~ [ ~~MDEV-19937~~ ]

Stepan Patryshev (Inactive) made changes - 2020-02-04 10:10

Link

This issue blocks MENT-565 [ MENT-565 ]

Stepan Patryshev (Inactive) made changes - 2020-02-04 10:12

Assignee

Stepan Patryshev [ stepan.patryshev ]

Jan Lindström [ jplindst ]

Sergei Golubchik made changes - 2020-02-11 13:45

Fix Version/s		10.4 [ 22408 ]
Fix Version/s	10.4.12 [ 24019 ]

Stepan Patryshev (Inactive) made changes - 2020-04-01 14:43

Affects Version/s

10.4 [ 22408 ]

Stepan Patryshev (Inactive) made changes - 2020-04-15 10:05

Description

galera.galera_wan_restart_ist MTR fails sporadically on [Azure|https://dev.azure.com/mariadbe/MariaDB%20Enterprise/_build/results?buildId=4396&view=logs&j=14a9a36b-ac1b-572f-6fe9-a19e26ccd30a&t=55ad7609-3f7a-570d-99ad-0a947e8a25e7&l=591]. It fails also on 10.2 (run #20200128.1) and on 10.3 (run #20200204.2).

*[stdio.log|https://dev.azure.com/mariadbe/550599d3-6165-4abd-8c86-e3f7e53a1847/_apis/build/builds/4396/logs/392]*:
{code:title=10.4.12-6 90c709bf592e624ca1ee63e0ea8adad05e53d5d8}
2020-02-04T06:02:25.3587995Z galera.galera_wan_restart_ist 'innodb' w2 [ fail ]
2020-02-04T06:02:25.3590196Z Test ended at 2020-02-04 06:02:25
2020-02-04T06:02:25.3590791Z
2020-02-04T06:02:25.3591183Z WSREP did not transition to state READY
2020-02-04T06:02:25.3591469Z
2020-02-04T06:02:25.3707824Z - saving '/var/tmp/mtr/2/log/galera.galera_wan_restart_ist-innodb/' to '/var/tmp/mtr/log/galera.galera_wan_restart_ist-innodb/'
2020-02-04T06:02:25.4115885Z ***Warnings generated in error logs during shutdown after running tests: galera.galera_wan_restart_ist
2020-02-04T06:02:25.4117222Z
2020-02-04T06:02:25.4118561Z 2020-02-04 5:58:24 0 [ERROR] WSREP: IST didn't contain all write sets, expected last: 3 last received: -1
2020-02-04T06:02:25.4119390Z 2020-02-04 5:58:24 1 [ERROR] WSREP: Receiving IST failed, node restart required: IST receiver reported failure: 71 (Protocol error)
2020-02-04T06:02:25.4120567Z 2020-02-04 5:58:24 1 [Warning] WSREP: Sending JOIN failed: -103 (Software caused connection abort). Will retry in new primary component.
2020-02-04T06:02:25.4121251Z 2020-02-04 5:58:24 1 [ERROR] WSREP: Failed to JOIN the cluster after SST
{code}

galera.galera_wan_restart_ist MTR fails sporadically on CI, 10.4/10.3/10.2 ES.
*stdio.log*:
{code:title=10.4.12-6 90c709bf592e624ca1ee63e0ea8adad05e53d5d8}
2020-02-04T06:02:25.3587995Z galera.galera_wan_restart_ist 'innodb' w2 [ fail ]
2020-02-04T06:02:25.3590196Z Test ended at 2020-02-04 06:02:25
2020-02-04T06:02:25.3590791Z
2020-02-04T06:02:25.3591183Z WSREP did not transition to state READY
2020-02-04T06:02:25.3591469Z
2020-02-04T06:02:25.3707824Z - saving '/var/tmp/mtr/2/log/galera.galera_wan_restart_ist-innodb/' to '/var/tmp/mtr/log/galera.galera_wan_restart_ist-innodb/'
2020-02-04T06:02:25.4115885Z ***Warnings generated in error logs during shutdown after running tests: galera.galera_wan_restart_ist
2020-02-04T06:02:25.4117222Z
2020-02-04T06:02:25.4118561Z 2020-02-04 5:58:24 0 [ERROR] WSREP: IST didn't contain all write sets, expected last: 3 last received: -1
2020-02-04T06:02:25.4119390Z 2020-02-04 5:58:24 1 [ERROR] WSREP: Receiving IST failed, node restart required: IST receiver reported failure: 71 (Protocol error)
2020-02-04T06:02:25.4120567Z 2020-02-04 5:58:24 1 [Warning] WSREP: Sending JOIN failed: -103 (Software caused connection abort). Will retry in new primary component.
2020-02-04T06:02:25.4121251Z 2020-02-04 5:58:24 1 [ERROR] WSREP: Failed to JOIN the cluster after SST
{code}

Stepan Patryshev (Inactive) added a comment - 2020-04-29 16:18

It failed also on Jenkins, 10.5 ES, e7ca9ec6f6bd93883eeb35ebb2b09ffcbde35ad6, Build Debug, sles-15.

Stepan Patryshev (Inactive) added a comment - 2020-04-29 16:18 It failed also on Jenkins, 10.5 ES, e7ca9ec6f6bd93883eeb35ebb2b09ffcbde35ad6, Build Debug, sles-15.

Stepan Patryshev (Inactive) made changes - 2020-04-29 16:19

Affects Version/s

10.5.2 [ 24030 ]

Stepan Patryshev (Inactive) made changes - 2020-04-29 16:19

Fix Version/s

10.5 [ 23123 ]

Jan Lindström (Inactive) made changes - 2020-09-16 11:14

Status

Open [ 1 ]

In Progress [ 3 ]

Jan Lindström (Inactive) made changes - 2020-09-17 12:15

issue.field.resolutiondate

2020-09-17 12:15:33.0

2020-09-17 12:15:33.993

Jan Lindström (Inactive) made changes - 2020-09-17 12:15

Fix Version/s		10.2.34 [ 24505 ]
Fix Version/s		10.3.25 [ 24506 ]
Fix Version/s		10.4.15 [ 24507 ]
Fix Version/s		10.5.6 [ 24508 ]
Fix Version/s		10.6.0 [ 24431 ]
Fix Version/s	10.2 [ 14601 ]
Fix Version/s	10.3 [ 22126 ]
Fix Version/s	10.4 [ 22408 ]
Fix Version/s	10.5 [ 23123 ]
Resolution		Fixed [ 1 ]
Status	In Progress [ 3 ]	Closed [ 6 ]

Stepan Patryshev (Inactive) made changes - 2020-09-17 13:11

Link

This issue blocks ~~MDEV-19937~~ [ ~~MDEV-19937~~ ]

Stepan Patryshev (Inactive) made changes - 2020-09-17 13:11

Link

This issue blocks MENT-565 [ MENT-565 ]

Ralf Gebhardt made changes - 2020-10-06 18:35

Fix Version/s

10.5.7 [ 25019 ]

Ralf Gebhardt made changes - 2020-10-06 18:37

Fix Version/s

10.5.6 [ 24508 ]

Ralf Gebhardt made changes - 2020-10-06 18:40

Fix Version/s

10.4.16 [ 25020 ]

Ralf Gebhardt made changes - 2020-10-06 18:42

Fix Version/s

10.4.15 [ 24507 ]

Ralf Gebhardt made changes - 2020-10-06 18:44

Fix Version/s

10.3.26 [ 25021 ]

Ralf Gebhardt made changes - 2020-10-06 18:45

Fix Version/s

10.3.25 [ 24506 ]

Ralf Gebhardt made changes - 2020-10-06 18:47

Fix Version/s

10.2.35 [ 25022 ]

Ralf Gebhardt made changes - 2020-10-06 18:48

Fix Version/s

10.2.34 [ 24505 ]

Sergei Golubchik made changes - 2021-12-06 21:50

Workflow

MariaDB v3 [ 103652 ]

MariaDB v4 [ 157288 ]

Daniel Black made changes - 2024-03-27 02:09

Link

This issue relates to ~~MDEV-33778~~ [ ~~MDEV-33778~~ ]

People

Assignee:: Jan Lindström (Inactive)

Reporter:: Stepan Patryshev (Inactive)

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 2020-02-04 10:09

Updated:: 2024-03-27 02:09

Resolved:: 2020-09-17 12:15

Git Integration

Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.

MariaDB Server

Details

Description

Attachments

Issue Links

Activity

People

Dates

Git Integration