[MDEV-16455] Re-verify alternative test cases and probable duplicates after original bugs are closed Created: 2018-06-10 Updated: 2023-11-26 Due: 2023-09-30 |
|
| Status: | Open |
| Project: | MariaDB Server |
| Component/s: | Tests |
| Fix Version/s: | N/A |
| Type: | Task | Priority: | Major |
| Reporter: | Elena Stepanova | Assignee: | Elena Stepanova |
| Resolution: | Unresolved | Votes: | 0 |
| Labels: | None | ||
| Attachments: |
|
||||||||
| Issue Links: |
|
||||||||
| Description |
|
See notes below explaining what this task is about and how it is to be used. Note: items in "Report to re-check" column can be crossed as closed. It is normal and does not mean that nothing needs to be done – they are closed because they are alleged duplicates, which is the whole point.
Done
Notes:It is going to be an on-going task until we find a better solution. Quite often we get or create bug reports which are in all likelihood duplicates of some existing ones, but we can't be 100% sure until the original ones are fixed (even if the alleged duplicate has a test case). Keeping duplicates open is not really a solution, because original ones can stay open for months and years, and duplicates only add up the noise; and even when originals are fixed, unfortunately nobody goes through the alleged duplicates to re-verify and close them, so they stay orphans or get closed without any confirmation. Another variation of the same problem is even when we have everything within the same bug report, the original test case can be huge and/or inconvenient for debugging, so we naturally try to simplify it. Often enough, we end up oversimplifying test cases, so when the small one gets fixed, the original one still fails. Again, unfortunately despite comments and requests to double-check before closing, it doesn't usually happen. So, for now, I'm going to add here cases of both kinds which go through my hands. Every occurrence will be represented by a JIRA item which needs re-verification after some JIRA item gets closed. They can be either different items, or the same ones. The task will be revised "on timer", triggered by moving due date, and notes will be added accordingly. Everyone is welcome to add their own notes of the same kind, but please follow the pattern and do it only if the report which needs re-verification has a decently reproducible test case. This activity doesn't cover bugs which were not reproducible to begin with, and we are just guessing based on a stack trace or other effects that they might be duplicates of something. |