Shows a list of Test Executions with some metrics related with each execution, such as the tests count per run status, per test type, overall progress and linked defects.
Please note
To be able to use this report your project must have the Test Execution or Sub Test Execution issue types in the issue type scheme.
Aim
This report allows users to evaluate some relevant metrics of Test Executions and compare them between different cycles.
Some possible usage scenarios:
- analyze both the progress of the Test Execution and the success rate (i.e. the % of Tests contributing to the requirement's OK status)
- see the amount of manual Tests vs others in the Test Execution
- see the overall execution status (i.e. the current status of the Test Runs)
- see the amount of linked defects, in the context of the Test Execution, currently opened/closed
How to use
This report is either accessible from "Xray Reports" icon on the project left side bar or from the standard "Reports" icon, which includes other kind of reports besides Xray.
Source Test Execution issues can be directly provided using a saved filter or by specifying some Test Execution related fields:
- Saved filter: A saved filter containing Test Execution issues
- Fix Version: version assigned to the Test Plan
- Assignee: Test Execution issue assignee
- Status: Test Execution issue Status
- Resolution: Test Execution issue Resolution
- Test Plan: assigned Test Plan
- Environment: assigned Test Environment
Please note
Only Test Executions from the current project are shown.
Metrics
| Metric | Notes |
|---|---|
total tests | Number of Tests in the Test Execution; it also corresponds to the amount of test runs |
number of tests by status | Amount of Tests/Test Runs, per Test Run status |
number of tests by test type | Amount of Test Execution's Tests, per Test Type |
progress | Overall progress; % of Test Runs whose status is a final status |
success rate | % of "successful" Tests (i.e whose latest status contributes to the OK requirement status; the "PASS" Test Run status is an example of such a status) |
| Elapsed time | Sum of the elapsed time of Test Runs that have been or are being executed. |
| linked defects (open/closed) | Defects directly associated with the related Test Runs. Will count as unique Defects (if the same Defect issue is added multiple times in the same Test Run or multiple times within Test Runs of the same Test Execution, it will count as one). Defects having Resolution will be counted in the Closed column, every others will be counted in the Open column. |
Example
Note: the report may be a bit wide so you will scroll it horizontaly to see further information.
Exporting the Report
The report can be exported to a CSV file, which will include all report rows (and not just the visible ones).
Click on Export and select To csv like in the image bellow.
