Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-22273

JUnit patch: xml test result differs from MTR output in case if retry

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • 10.1(EOL), 10.2(EOL), 10.3(EOL), 10.4(EOL), 10.5
    • 10.1.45
    • Tests
    • None

    Description

      MTR xml result must show the same result as MTR prints to stdout.
      in case of retry-pass or retry-fail test result should be recorded in xml as failed.

      if test failed on 1st attempt and passed on 2nd and 3rd it should be recorded in xml as failed. MTR does the same for stdout output and sets exit code accordingly.

      I see 2 ways for it:
      1 - do not update failed test result if test is already counted as failed
      2 - count all attempts and choose worst case for xml

      Attachments

        People

          ratzpo Rasmus Johansson (Inactive)
          abychko Alexey Bychko (Inactive)
          Votes:
          0 Vote for this issue
          Watchers:
          2 Start watching this issue

          Dates

            Created:
            Updated:
            Resolved:

            Git Integration

              Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.