This report allows shows some relevant metrics about that enable you to evaluate a Test Plan and eventually compare it with others.
Possible usage scenarios:
analyze both the progress of the Test Plan and its success rate (i.e., the % of Tests contributing to the requirement's OK status)
analyze the success rate by Test Environment
see the number of manual Tests vs. others in the Test Plan
see the overall execution status (i.e., the latest status of the Tests of the Test Plan)
see the number of linked defects opened/closed, in the context of the Test Plan
The Test Plans List Report shows a list of Test Plan issues and their corresponding consolidated execution status. The status is shown as a progress bar with the consolidated status (e.g., typically the latest test run status) from each Test issue that is part of that Test Plan.
Possible usage scenarios:
analyze the progress of each Test Plan
see the planned Test Plans for some version and get an overview of the progress of each one of them
UI Step
How to Use
This report is accessible either from theXray
Reportsicon
icon on the project left sidebar or from the standardReportsicon, which includes other kinds of reports besides Xray.
At the top of the report you'll find two areas related with the report and with the data shown in the report.
Image Removed
A: Filter, for selecting the source data
B: visualization information and options
UI Step
Defining Scope
Source Test Plan issues can be directly provided
(within section A)
using a
saved
advanced filter or by specifying some Test Plan-related fields:
Saved filter
Advanced: a
saved filter containing Test Plan issues Fix Version: the version assigned to the Test Plan
JQL query to filter the coverable issues
Basic:
Project:project
Assignee: the
Test Plan
issue's assignee
Status: the workflow status
Component: the component assigned to the issue
Fix Versions: versions assigned to the issue
Resolution: the workflow resolution
Image Removed
Status: the workflow status
Contains: the full issue key or part of the summary
Image Added
A: Filter, for selecting the source data
B: visualization information and options
Image Added
UI Step
Columns
Aside from the available custom fields for Test Plan issues, there are some special columns that can be included:
Metric
Notes
Begin Date
Planned begin date for the Test Plan
End Date
Planned end date for the Test Plan
Status
The progress
UI Step
Metrics
Metric
Notes
total test executions
Number of Test Executions related with this Test Plan
total test runs
Total number of Test Runs from all related Test Executions
total tests
Number of Tests being tracked by the Test Plan
number of tests by status
Number of Test Plan's Tests, per latest status
number of tests by test type
Number of Test Plan's Tests, per Test Type
progress
Overall progress; % of Tests with a final status
success rate
% of "successful" Tests (i.e., whose latest status contributes to the OK requirement status; the PASS Test Run status is an example of such a status)
success rate by Test Environment
% of "successful" Tests
(i.e.,
whose latest status contributes to the OK requirement status), per Test Environment
linked defects (open/closed)
Defects directly associated with the related Test Runs (i.e., that were created within the context of Test Executions of a given Test Plan). Will count unique Defects (i.e., if the same Defect issue is added multiple times in the same Test Run or added multiple times within Test Runs within the same Test Plan, it will count as one)
Defects with Resolution will be counted in the Closed column; all others will be counted in the Open column.
the overall execution status of the Test Plan)
UI Step
Example
Image RemovedImage Added
The report may be a bit wide for some screen resolutions so you will need to scroll horizontally to see the rest of the information.
Some values provide a link, so you can be redirected to the respective entities.
UI Step
Export and Share
The report can be exported to a CSV file, which will
include all report rows (
export up to 1000 issues and not just the visible ones
)
.
Click on Export
and
and select To csv.
Image Added
Image Removed
The report can be shared by copying and sending the URL located in the browser's address bar.
When opening the report the Filter will be automatically populated with the values provided in the URL.
