Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Shows a list of Test Sets and their attributtesattributes, along with an overview of the calculated status for the Tests that are part of the Test Set, for the selected version or Test Plan, and/or Test Environment.

Image RemovedImage Added

Purpose

The Test Executions List Report shows a list of Test Execution issues and their corresponding execution status. A Test Execution status is shown as a progress bar with the latest Test Run status from each Test issue that is associated with that Test Execution.The Test Sets List Report shows a list of Test Sets Set issues and their corresponding execution status, for some defined scope. A The status is shown as a progress bar and is calculated based on the analysis & scope (i.e., on how you want to analyze the Tests).  This allows a transversal analysis of the Tests Sets for a project in a particular version and environment.

The status of a Test Set (i.e., status of the Tests belonging to a Test Set) is calculated based on the latest consolidate consolidated results obtained for the Tests (see how the status of a Test is calculated here).

...

  • see what Test Sets exist for a project, based on some additional criteria
  • quickly analyze how certain Tests belonging to some Test Sets are doing, for some version or/and for some Test Environment

...

This report is accessible either from the Xray icon on the project left sidebar or from the standard Reports icon, which includes other kinds of reports besides Xray. 

Source Test Set issues can be directly provided using a saved filter or by specifying some Test Set-related fields:

Image Added

At the top of the report, you have some options that need to be configured.

  • Analysis & Scope: how to analyze the issues (more info on Coverage Analysis)
  • Filters: the source data for the report (e.g. Test Set issues) and how to evaluate the status for each one of the item being shown. 
      • Advanced: a JQL query to filter the coverable issues
      • Basic:
        • Project: project
        • Assignee: the issue's
  • Saved filter: a saved filter containing Test Set issues
  • Project: the project containing Test Sets
  • Fix Version: the version assigned to the Test Set
  • Assignee: the Test Set issue
        • assignee
        • Component: the component assigned to the
    Test Set
        • issue
    Status
        • Fix Versions: versions assigned to the
    Test Execution
        • issue
    workflow Status
        • Resolution: the
    Test Status issue Resolution
        • workflow resolution
        • Status: the workflow status
        • Contains:
    search based on
        • the full issue key or part of the summary
    of the Test Set
  • Include Previous Versions: filter Test Sets older or equal than the given Fix Version 

Image AddedImage Removed


Info
titlePlease note

Only By default, only the Test Sets from the selected project are shown by default. For showing . To show the Test Sets from different projects, you have to use a saved filter.

Columns

Besides all Aside from the available custom fields for Test Sets issues, there are also some special columns that can be included:


Metric

Notes

Test CountAmount Number of Tests within each Test Set
StatusThe calculated status for the Tests that are part of the Test Set, based on the defined Analysis & Scope


Example

Image Added

Exporting the Report

The report can be exported to a CSV file, which will export up to 1000 issues and not just the visible ones.

Click on Export and select To csv.


 Image Added

Share

To share the report click the Share button and then click the copy icon to copy the link to clipboard after this you can send the link to other users who can then view the report with the same filters. This link will be deleted if it's not used for more than 6 months.


Image Added

Image AddedImage Removed