Overview

Most of the following reports are made using the "Filter Results" JIRA gadget, which returns issues in a table layout.

The "Pie Chart" and the "Two Dimensional Filter Statistics" are also two interesting gadgets that may be used for building reports.

Independently of the gadget you use, the important aspect is filtering out the relevant issues and this may be obtained using JQL (see Enhanced querying with JQL).

A special note related with custom fields (e.g. "TestRunStatus", "Test Set Status") whose behavior depends on the Xray's configuration and not the JQL query.

Sample reports

List of Requirements, with coverage info

Lists requirements with current coverage status, based on latest executed tests.

Gadget used: Filter Results

Sample JQL for: list requirements of project "CALC" for version "v3.0".

project = CALC AND issuetype = Story and fixVersion = "v3.0"

Sample JQL for:  list requirements of project "CALC" of a previous version "v3.0", which are NOK in the newer version "V4.0"

project = CALC AND issuetype = Story and fixVersion = "v3.0" and issue in requirements('NOK', 'CALC', 'V4.0')

List of Tests

Lists tests for a given project version.

Gadget used: Filter Results

Sample JQL for: list Tests for project "CALC", version "v1.0".

issuetype = 'Test' and issue in testsWithReqVersion('CALC', 'v1.0')

Sample JQL for: list Tests for Test Sets, of project "CALC", that have fixVersion "v1.0".

issuetype = 'Test' and issue in testsWithTestSetVersion('CALC', 'v1.0')

If you want to include the Test status, then you just need to add the column "TestRunStatus" in the gadget's configuration.

List of Test Sets, with status

Lists test sets for a given project version.

Gadget used: Filter Results

Sample JQL for: all Test Sets of project "CALC"

project = 'CALC' and issuetype = 'Test Set'

Sample JQL for: all Test Sets of project "CALC" explicitly marked with fixVersion "1.0"

project = 'CALC' and issuetype = 'Test Set' and fixVersion = 'v1.0'

If you want to include the Test status, then you just need to add the column "Test Set Status" in the gadget's configuration.

List of Test Executions, with status

Lists Test Executions for a given project version.

Gadget used: Filter Results

Sample JQL for: all Test Executions of project "CALC" ran in version "v3.0", build (i.e Revision) 100

project = 'CALC' and issuetype = 'Test Execution' and fixVersion = 'v3.0' and Revision ~ 100

Sample JQL for: all Test Executions of project "CALC", latest ones executed first

project = 'CALC' and issuetype = 'Test Execution' ORDER BY created DESC

Additional columns can be appended to this gadget like:

• Begin date: the planned begin date for the start of the execution
• End date: the due date for the execution completion
• Test Execution Status: shows the last execution status for all the Test issues in the Test Execution

List of Test Plans, with status

Lists Test Plans, optionally for a given project version.

Gadget used: Filter Results

Sample JQL for: all Test Executions of project "CALC" ran in version "v3.0", build (i.e Revision) 100

project = 'XRAYF' and issuetype = 'Test Plan'

Tests to be executed by a user

Lists tests to be executed by a given user.

Gadget used: Filter Results

Sample JQL for: list Tests yet to be executed (i.e. in status TODO) by user "admin"

issuetype = 'Test' and issue in testExecutionTests('Calculator Test Executions', 'TODO', 'admin')

If you want to include the Test status, then you just need to add the column "TestRunStatus" in the gadget's configuration.

Test distribution by status

Tests distributition by status (percentage and absolute values).

Gadget used: Pie Chart

Statistic Type: "TestRunStatus"

Test distribution by test type

Tests distributition by status (percentage and absolute values).

Gadget used: Pie Chart

Statistic Type: "Test Type"

Test distribution by component

Display percentage and absolute number of tests, per component.

Gadget used: Pie Chart

Statistic Type: Component

Sample JQL for: test distribution based on the component assigned to the Test itself

project = 'CALC' and issuetype = 'Test'

Test status grouped per assignee

Number of Tests, per Test status, based on latest run, grouped per assignee of the Test Execution itself

Gadget used: Two Dimensional Filter Statistics

Test status grouped per component

Number of Tests, per Test status, based on latest run, grouped per component

Gadget used: Two Dimensional Filter Statistics