To open this report your current project must satisfy the following conditon
Test Plan issue type is required in the issue type scheme.
Shows a list of Test Plans with consolidated information for each one, such as test statuses count, overall progress and Test Environments related metrics.
Aim
This report allows users to evaluate some relevant metrics of Test Plans and, eventualy, compare with other Test Plans.
Some possible usage scenarios:
- analyze both the progress of the Test Plan and the success rate (i.e. the % of Tests contributing to the requirement's OK status)
- analyze the success rate by Test Environment
- see the amount of manual Tests vs others in the Test Plan
- see the overall execution status (i.e. the latest status of the Tests of the Test Plan)
- see the amount of linked defects, in the context of the Test Plan, currently opened/closed
How to use
This report is either accessible from "Xray Reports" icon on the project left side bar or from the standard "Reports" icon, which includes other kind of reports besides Xray.
Source Test Plan issues can be directly provided using a saved filter or by specificiend some Test Plan fields:
- Saved filter: A saved filter containing Test Plan issues
- Fix Version: version assigned to the Test Plan
- Assignee: Test Plan's assignee
- Status: workflow status
- Resolution: workflow resoluton
Please note
Only Test Plans from the current project are shown.
Metrics
| Metric | Notes |
|---|---|
total test executions | Number of Test Executions related with this Test Plan |
total test runs | Total amount of Test Runs, from all related Test Executions |
total tests | Number of Tests being tracked by the Test Plan |
number of tests by status | Amount of Test Plan's Tests, per latest status |
number of tests by test type | Amount of Test Plan's Tests, per Test Type |
progress | Overall progress; % of Tests whose latest status is a final status |
success rate | % of "successful" Tests (i.e whose latest status contributes to the OK requirement status; the "PASS" Test Run status is an example of such a status) |
success rate by Test Environment | % of "successful" Tests (i.e. whose latest status contributes to the OK requirement status), per Test Environment |
| linked defects (open/closed) | Defects directly associated with the related Test Runs (i.e. that were created in the context of Test Executions of a given Test Plan). Will count as unique Defects (if the same Defect issue is added multiple times in the same Test Run or multiple times within Test Runs in the context of the same Test Plan, it will count as one). Defects having Resolution will be counted in the Closed column, every others will be counted in the Open column. |
Example
The report may be a bit wide so you will scroll it horizontaly to see further information.
Exporting the Report
The report can be exported to a CSV file, which will include all report rows (and not just the visible ones).
Click on Export and select To csv like in the image bellow.
