Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Note
titlePlease note

To use this report, you must enable Requirement Coverage for your project. See how in Configure Jira project to be used as Requirements project.


Table of Contents

Purpose

This report enables you to follow the life of a requirement in both forwards and backwards direction (i.e., from its origin all the way through tests, test runs and defects). It facilitates analysis of the overall requirements coverage status.

...

  • Saved filter: a saved filter containing requirement issues

  • Fix Version: version assigned to requirements
  • Assignee: the requirement's assignee
  • Key or Summary: the requirement's key or summary
  • Status: the workflow status
  • Resolution: the workflow resoluton
  • Include Previous Versions: take into account previous versions when searching for a requirement

...


 


It's also possible to configure the report with additional parameters:

  • Hide Test Runs: hides the Test Runs column; this is quite useful when you are using Continuous Integration and you have multiple runs 

 


Analysis

On the left side, it's possible to define the analysis strategy, i.e., the way you want to analyze the selected/filtered requirements. You can choose to analyze either by Version or Test Plan, and complement it with a Test Environment.

...

The report not only shows the traceability between entities, but it also presents some calculated values for the selected options. For example, the requirement status and the Test status that are shown in the Requirements and Tests columns, respectively. 


ColumnNotes

Requirements

"requirements" and the calculated requirement status, taking into account the options selected for analysis
TestsTests and the calculated status, taking into account the options selected for analysis

Test Runs

Test Runs and their status from all related Test Executions
Defects

defects directly associated with the Test Runs as well as those directly linked to the Tests (via a "created" issue link) for the given version (through the AffectsVersion).

...

Info
titlePlease note

The defects that appear on a separate row (i.e., that are not related with a specific Test Run) contain all defects associated with the Test. In other words, it contains all defects linked to the Test, including the ones reported for Test Runs done on a different environment. This allows you to see all "related defects" which may or not impact your version.

Image Removed

Example

 

.


Image Added

Performance

In Continuous Integration scenarios, with thousands of runs, showing all those Test Runs at the same time in this report may take some time and may overload your browser.

Xray will warn you beforehand whenever the total amount of Test Runs exceeds a certain threshold.

Therefore, we advise you to:

  • use carefuly the "Load all" option especially if "Hide Test Runs" is unchecked (this option is available at the top-right side of the report page);
  • hide Test Runs column in the report, if the number of runs is considerable high (e.g. > 1000);  the amount of information may overload your browser and it will be hard for you to analyse the report with all that information.


Image Added

Examples


Image Added

Image AddedImage Removed


 Note: Requirements with Labels or Statuses configured to be ignored in the Requirements Coverage settings will not appear on this report.

Exporting the Report

The report can be exported to a CSV file, which will include all report rows (and not just the visible ones).

Click on Export and select To csv.

Image Added