Besides the reports, we have presented Xray also makes available the following reports:


ReportPurposeExample
Test List Report

The Tests List Report shows a list of Test issues and their corresponding execution status, for some defined scope. The status depends on the Analysis & Scope (i.e., on how you want to analyze the Tests). This allows a transversal analysis of the Tests for a project in a particular version and environment.

The status of a Test is calculated based on the latest consolidated result obtained for each Test.


Possible usage scenarios:

  • see what Tests exist for a project, based on some additional criteria
  • quickly analyze how certain Tests are doing for some version or/and for some Test Environment


Test Sets List Report

The Test Sets List Report shows a list of Test Set issues and their corresponding execution status, for some defined scope. The status is shown as a progress bar and is calculated based on the analysis & scope (i.e., on how you want to analyze the Tests).  This allows a transversal analysis of the Tests Sets for a project in a particular version and environment.

The status of a Test Set (i.e., status of the Tests belonging to a Test Set) is calculated based on the latest consolidated results obtained for the Tests.


Possible usage scenarios:

  • see what Test Sets exist for a project, based on some additional criteria
  • quickly analyze how certain Tests belonging to some Test Sets are doing, for some version or/and for some Test Environment

Test Executions List Report

The Test Executions List Report shows a list of Test Execution issues and their corresponding execution status. A Test Execution status is shown as a progress bar with the latest Test Run status from each Test issue that is associated with that Test Execution.

Possible usage scenarios:

  • analyze both the progress of each Test Execution and the success rate
  • analyze the number of defects opened in each Test Execution
  • analyze the testing results for some revisions of the SUT
  • see the planned Test Executions for some version, for some Test Environment and get an overview of the progress of each one of them

Test Plans List

The Test Plans List Report shows a list of Test Plan issues and their corresponding consolidated execution status. The status is shown as a progress bar with the consolidated status (e.g., typically the latest test run status) from each Test issue that is part of that Test Plan.

Possible usage scenarios:

  • analyze the progress of each Test Plan
  • see the planned Test Plans for some version and get an overview of the progress of each one of them

Test Runs List Report

This report enables you to see which tests were or are going to be executed, along with the corresponding result and key metrics.

Possible usage scenarios:

  • see all the runs of a given Test Execution
  • see all the runs of all Test Executions related with a Test Plan
  • see the number of opened/closed linked defects, in the context of a given run
  • see the elapsed time since the execution has started
  • see the executions performed by or assigned to a given user

Test Plan Metrics

This report allows shows some relevant metrics about that enable you to evaluate a Test Plan and eventually compare it with others.

Possible usage scenarios:

  • analyze both the progress of the Test Plan and its success rate (i.e., the % of Tests contributing to the requirement's OK status)
  • analyze the success rate by Test Environment
  • see the number of manual Tests vs. others in the Test Plan
  • see the overall execution status (i.e., the latest status of the Tests of the Test Plan)
  • see the number of linked defects opened/closed, in the context of the Test Plan

You can get more information about each report at the "General Reporting" module from the Tester Course.







  • No labels