Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-22273

JUnit patch: xml test result differs from MTR output in case if retry

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 10.1, 10.2, 10.3, 10.4, 10.5
    • Fix Version/s: 10.1.45
    • Component/s: Tests
    • Labels:
      None

      Description

      MTR xml result must show the same result as MTR prints to stdout.
      in case of retry-pass or retry-fail test result should be recorded in xml as failed.

      if test failed on 1st attempt and passed on 2nd and 3rd it should be recorded in xml as failed. MTR does the same for stdout output and sets exit code accordingly.

      I see 2 ways for it:
      1 - do not update failed test result if test is already counted as failed
      2 - count all attempts and choose worst case for xml

        Attachments

          Activity

            People

            Assignee:
            ratzpo Rasmus Johansson
            Reporter:
            abychko Alexey Bychko
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: