Uploaded image for project: 'MariaDB Server'
  1. MariaDB Server
  2. MDEV-22273

JUnit patch: xml test result differs from MTR output in case if retry

    XMLWordPrintable

Details

    • Bug
    • Status: Closed (View Workflow)
    • Major
    • Resolution: Fixed
    • 10.1(EOL), 10.2(EOL), 10.3(EOL), 10.4(EOL), 10.5(EOL)
    • 10.1.45
    • Tests, MTR
    • None

    Description

      MTR xml result must show the same result as MTR prints to stdout.
      in case of retry-pass or retry-fail test result should be recorded in xml as failed.

      if test failed on 1st attempt and passed on 2nd and 3rd it should be recorded in xml as failed. MTR does the same for stdout output and sets exit code accordingly.

      I see 2 ways for it:
      1 - do not update failed test result if test is already counted as failed
      2 - count all attempts and choose worst case for xml

      Attachments

        Activity

          People

            ratzpo Rasmus Johansson (Inactive)
            abychko Alexey Bychko (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0d
                0d
                Logged:
                Time Spent - 4h 5m
                4h 5m

                Git Integration

                  Error rendering 'com.xiplink.jira.git.jira_git_plugin:git-issue-webpanel'. Please contact your Jira administrators.