Page History
...
Creating new Test Step statuses may be done in the Manage Test Step Statuses configuration section of Xray.
Whenever creating/editing a Test Step status, we have to identify the Test status we want this step status to map to.
Note that native Test Step statuses can’t be modified nor deleted.
...
Example # | Statuses of the Test Runs (ordered by time of execution/creation, ascending) | Final statuses have precedence over non-final statuses | Calculated value for the status of the Test | Why? |
---|---|---|---|---|
1a |
| true | PASS | Latest executed Test Run (2) having a final status was PASS. |
1b |
| false | TODO | Latest created Test Run (3) was TODO. |
2a |
| true | MYPASS2 | Latest executed final Test Runs on each environment were PASS, MYPASS2, and PASS respectively. Since MYPASS2 (2) has a higher ranking then the calculated status will be MYPASS2. |
2b |
| false | TODO | Latest created Test Runs on each environment were PASS, TODO, and PASS respectively. Since PASS has the lowest ranking, then TODO (3) will "win" and then the calculated status will be TODO |
3 |
| true | TODO | Latest created Test Runs on each environment were PASS, TODO, and PASS respectively. Although Test Environment "env2" has only a non-final Test Run, since there is no other Run for that environment, then it will be considered as the calculated status for that environment. Since PASS has the lowest ranking, then TODO (2) will "win" and then the calculated status will be TODO. |
4 |
| true (or false) | FAIL | Latest executed (or created) final Test Runs on each environment were PASS, FAIL, and PASS respectively. Since the calculated status for one of the environments is FAIL, then the calculated status will be FAIL. |
5 |
| true | MYPASS2 | Latest executed final Test Runs on each environment were PASS, MYPASS2, and MYFAIL respectively. MYPASS2 has a higher ranking than the other ones, thus the overall calculated value will be MYPASS2. |
6 |
| false | MYFAIL | Latest created Test Runs on each environment were PASS, TODO, and MYFAIL respectively. MYFAIL has a higher ranking than the other ones, thus the overall calculated value will be MYFAIL. |
...