Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Shows a list of Test Plans with consolidated information for each one, such as including the test statuses count, overall progress and Test Environments Environment-related metrics.


Note
titlePlease note

To be able to use this report, your project must have the Test Plan issue type in the issue type scheme.

...

Purpose

This report allows users to evaluate shows some relevant metrics of Test Plans and, eventualy, compare with other Test Plans.about that enable you to evaluate a Test Plan and eventually compare it with others.

Possible Some possible usage scenarios:

  • analyze both the progress of the Test Plan and the its success rate (i.e., the % of Tests contributing to the requirement's OK status)
  • analyze the success rate by Test Environment
  • see the amount number of manual Tests vs. others in the Test Plan
  • see the overall execution status (i.e., the latest status of the Tests of the Test Plan)
  • see the amount number of linked defects opened/closed, in the context of the Test Plan, currently opened/closed

How to use

This report is accessible either accessible from "the Xray Reports" icon on the project left side bar sidebar or from the standard "Reports" icon, which includes other kind kinds of reports besides Xray. 

Source Test Plan issues can be directly provided using a saved filter or by specificiend specifying some Test Plan fields:

  • Saved filter: A a saved filter containing Test Plan issues

  • Fix Version: the version assigned to the Test Plan
  • Assignee: the Test Plan's assignee
  • Status: the workflow status
  • Resolution: the workflow resolutonresolution

 


Info
titlePlease note

Only Test Plans from the current project are shown.

Metrics

...


MetricNotes

total test executions

Number of Test Executions related with this Test Plan

total test runs

Total amount number of Test Runs , from all related Test Executions

total tests

Number of Tests being tracked by the Test Plan

number of tests by status

Amount of Number of Test Plan's Tests, per latest status

number of tests by test type

Amount Number of Test Plan's Tests, per Test Type

progress

Overall progress; % of Tests whose latest status is Tests with a final status

success rate

% of "successful" Tests (i.e., whose latest status contributes to the OK requirement status; the " PASS " Test Run status is an example of such a status)

success rate by Test Environment

% of "successful" Tests (i.e., whose latest status contributes to the OK requirement status), per Test Environment
linked defects (open/closed)

Defects directly associated with the related Test Runs (i.e., that were created in within the context of Test Executions of a given Test Plan). Will count as unique Defects (i.e., if the same Defect issue is added multiple times in the same Test Run or added multiple times within Test Runs in the context of Runs within the same Test Plan, it will count as one).

Defects having Defects with Resolution will be counted in the Closed column, every ; all others will be counted in the Open column.

 


Example

 


 

The report may be a bit wide so you will need to scroll it horizontaly horizontally to see further the rest of the information.

 


Exporting the Report

The report can be exported to a CSV file, which will include all report rows (and not just the visible ones).

Click on Export and select To csv like in the image bellow.csv.