[MDEV-22273] JUnit patch: xml test result differs from MTR output in case if retry Created: 2020-04-11  Updated: 2020-06-03  Resolved: 2020-05-04

Status: Closed
Project: MariaDB Server
Component/s: Tests
Affects Version/s: 10.1, 10.2, 10.3, 10.4, 10.5
Fix Version/s: 10.1.45

Type: Bug Priority: Major
Reporter: Alexey Bychko (Inactive) Assignee: Rasmus Johansson (Inactive)
Resolution: Fixed Votes: 0
Labels: None

Issue Links:
Blocks

 Description   

MTR xml result must show the same result as MTR prints to stdout.
in case of retry-pass or retry-fail test result should be recorded in xml as failed.

if test failed on 1st attempt and passed on 2nd and 3rd it should be recorded in xml as failed. MTR does the same for stdout output and sets exit code accordingly.

I see 2 ways for it:
1 - do not update failed test result if test is already counted as failed
2 - count all attempts and choose worst case for xml



 Comments   
Comment by Alexey Bychko (Inactive) [ 2020-04-11 ]

julien.fritsch tturenko ^^^

Generated at Thu Feb 08 09:13:30 UTC 2024 using Jira 8.20.16#820016-sha1:9d11dbea5f4be3d4cc21f03a88dd11d8c8687422.