Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-22273

JUnit patch: xml test result differs from MTR output in case if retry

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • 10.1(EOL), 10.2(EOL), 10.3(EOL), 10.4(EOL), 10.5
    • 10.1.45
    • Tests
    • None

    Description

      MTR xml result must show the same result as MTR prints to stdout.
      in case of retry-pass or retry-fail test result should be recorded in xml as failed.

      if test failed on 1st attempt and passed on 2nd and 3rd it should be recorded in xml as failed. MTR does the same for stdout output and sets exit code accordingly.

      I see 2 ways for it:
      1 - do not update failed test result if test is already counted as failed
      2 - count all attempts and choose worst case for xml

      Attachments

        Activity

          People

            ratzpo Rasmus Johansson (Inactive)
            abychko Alexey Bychko (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Git Integration

                Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.