Page History
...
- This takes into account Test Runs in version V (as a result of Test Executions in version V) or Test Runs in Test Plan TP (within Test Executions associated with Test Plan TP)
- If Test Environment is chosen, then only Tests Runs on that Environment (e.g. TE) will be considered
- If "Final statuses have precedence over non-final statuses" is true, then:
- final Test Run statuses will have higher ranking than non-final ones
- only the latest Test Run is taken into account based on its "finished on" date
- If "Final statuses have precedence over non-final statuses" is false, then:
- only the latest Test Run is taken into account based on its "created" date (i.e. the creation date of the related Test ExecutionRun entity - this happens when a Test Run is first executed, or when the user navigates into the execution screen)
Calculate the status of some Test, in version V or Test Plan TP, for "All Environments"
...
| Example # | Statuses of the Test Runs (ordered by time of execution/creation, ascending) | Final statuses have precedence over non-final statuses | Calculated value for the status of the Test | Why? |
|---|---|---|---|---|
| 1a |
| true | PASS | Latest executed Test Run (2) having a final status was PASS. |
| 1b |
| false | TODO | Latest created Test Run (3) was TODO. |
| 2a |
| true | XPASSMYPASS2 | Latest executed final Test Runs on each environment were PASS, MYPASS2, and PASS respectively. Since MYPASS2 (2) has a higher ranking then the calculated status will be MYPASS2. |
| 2b |
| false | TODO | Latest created Test Runs on each environment were PASS, TODO, and PASS respectively. Since PASS has the lowest ranking, then TODO (3) will "win" and then the calculated status will be TODO |
| 3 |
| true | TODO | Latest created Test Runs on each environment were PASS, TODO, and PASS respectively. Although Test Environment "env2" has only a non-final Test Run, since there is no other Run for that environment, then it will be considered as the calculated status for that environment. Since PASS has the lowest ranking, then TODO (32) will "win" and then the calculated status will be TODO. |
| 4 |
| true (or false) | FAIL | Latest executed (or created) final Test Runs on each environment were PASS, FAIL, and PASS respectively. Since the calculated status for one of the environments is FAIL, then the calculated status will be FAIL. |
| 5 |
| true | MYPASS2 | Latest executed final Test Runs on each environment were PASS, MYPASS2, and MYFAIL respectively. MYPASS2 has a higher ranking than the other ones, thus the overall calculated value will be MYPASS2. |
| 6 |
| false | MYFAIL | Latest created Test Runs on each environment were PASS, TODO, and MYFAIL respectively. MYFAIL has a higher ranking than the other ones, thus the overall calculated value will be MYFAIL. |
...