This report enables you to extract the detailed specification of Tests, so that you can generate a document that contains a snapshot of the latest specification. This can be used for revision/approval, or even to share it with someone else that hasn't access to Jira and wishes to pursue testing.
Possible usage scenarios:
The following screenshots shows an example of the sections you should expect in this report.
This report can be generated from the Issue details screen, from the Issue Search/navigator page, from the Test Repository, or from the Test Plan board.
General information about all the existing places available to export from, and how to perform it, is available in the Exporting page. |
This report is applicable to:
The standard output format is .DOCX, so you can open it in Microsoft Word, Google Docs, and other tools compatible with this format. You can also export it to .PDF.
The template has a set of assumptions that you make sure that your Jira/Xray environment complies with:
If any of these assumptions is not met, you need to update the template accordingly.
The report shows detailed information about the Tests, focused on their specification (e.g., manual steps, Gherkin, test charter).
The report is composed by several sections. Two major sections are available: Introduction and Test Executions details.
By default, and to avoid overload/redundancy of information, only the "Introduction" section will be rendered; you can change this behavior on the template (more info ahead).
This section is divided into 3 sub-sections:
Each of these sections is explained below.
Brief description of what you will find in this report and how it was generated.
In this section, the total tests are grouped by their test type and a count is shown.
Test Type | Number of Tests |
---|---|
Manual | Number of tests that are step/script based; usually these are known by "manual" (even though "manual" is a rough simplification) |
Gherkin | Number of Gherkin based tests; usually these correspond to Cucumber test scenarios, with Test Type "Cucumber", but may also refer to other Gherkin based frameworks |
Other | Number of tests that are neither scripted nor Gherkin based; usually these correspond to unstructured tests; this includes the tests having Test Type "Generic". Generic automated test scripts are usually included here; exploratory tests also. |
If you wish to count Tests by custom Test Types, you can do so. See more information ahead on how to customize this report. |
The output will have the following information.
In this section we have an overview of all the requirements that are covered by the Tests in this report.
Field | Description | Code |
---|---|---|
Key | Key of the requirement (in this case we are adding it as link) | @{title=${Links[j].Key}|href=${BaseURL}/browse/${Links[j].Key}} |
Summary | Summary of the requirement | ${Links[j].Summary} |
Version | Project version assigned to the requirement | ${Links[j].FixVersions} |
Workflow Status | Workflow Status of the requirement | ${Links[j].Status} |
The requirements are listed in a table as follows.
This section will gather all the information related to each Test, focused on its specification.
It is composed with several sub-sections that will be filled with information if it is available or be filled with a message showing that no information is available.
This section have a table with information regarding each Test in this report (and will repeat these sections for each Test). The information is presented as a table with the following fields:
Field | Description | Code |
---|---|---|
Test Type | Test Type | ${TestType} |
Label(s) | Labels assigned to the Test issue | ${Labels} |
Component(s) | Components assigned to the Test issue | ${Components} |
Priority | Priority assigned to the Test issue | ${Priority} |
The resulting table look like the one below.
The description of the Test (${wiki:Description}).
This section only appears if you have any attachments associated to the Test.
Key | Description |
---|---|
File Name | File Name of the Attachment |
Author | The Author of the attachment |
File Size | File Size of the attachments in bytes. |
This appears in the document in a table form. A thumbnail is shown for images.
This section shows the last execution status for the Test.
In this section we have an overview of all the requirements that are covered by the Test.
Field | Description | Code |
---|---|---|
Key | Key of the requirement (in this case we are adding it as link) | @{title=${Links[j].key}|href=${BaseURL}/browse/${Links[j].Key}} |
Summary | Summary of the requirement | ${Links[j].Summary} |
Version | Project version assigned to the requirement | ${Links[j].FixVersions} |
Workflow Status | Workflow Status of the requirement | ${Links[j].Status} |
The requirements are listed in a table as follows.
If the Test requires any Preconditions, they will be shown.
Key | Description | Code |
---|---|---|
Key | Jira Key of the Precondition in the form of a link | @{title=${PreConditions[n].Key}|href=${BaseURL}/browse/${PreConditions[n].Key}} |
Summary | Summary of the Precondition | ${PreConditions[n].Summary} |
Condition | Condition | ${wiki:PreConditions[n].Definition} |
The Preconditions are listed in a table as follows.
This section shows the Test details; for that we are considering the different possible Test Types we can have in Xray. For each type we will fetch different information.
Type | Key | Description | Code | Output |
---|---|---|---|---|
Unstructured (e.g., "Generic") | Test Type | Test Type field | ${TestType} | |
Specification | Definition of the Generic test | ${Generic Test Definition} | ||
Gherkin (e.g., "Cucumber") | Test Type | Test Type field | ${TestType} | |
Gherkin Specification | Gherkin specification of the Test | ${Cucumber Scenario} | ||
Structured (e.g., "Manual") | (Step) | Step Number | ${TestSteps[m].StepNumber} | |
Action | Action of the Test Step | ${TestSteps[m].Action} | ||
Step Custom Fields | Step Custom Fields | ${TestSteps[m].StepCustomFieldXX} Note: needs to be explicitly defined on the template; by default, no step custom fields will be shown. | ||
Data | Data of the Test Step | ${TestSteps[m].Data} | ||
Expected Result | Expected Result of the Test Step | ${TestSteps[m].ExpectedResult} | ||
Attachments | Attachment of the Test Step; images will be rendered | @{title=${TestSteps[m].Attachments[sa].Name}|href=${TestSteps[m].Attachments[sa].FileURL}} !{${TestSteps[m].Attachments[sa].Attachment}|maxwidth=100} |
If a step calls another Test passing it parameters, then the called Test key is mentioned and a table is shown with the parameters for the called Test.
|
If the Test is part of Test Sets, they will be shown.
Key | Description | Code |
---|---|---|
Key | Key of the Test Set in the form of a link | @{title=${TestSets[x].Key}|href=${BaseURL}/browse/${TestSets[x].Key}} |
Summary | Summary of the Test Set | ${TestSets[x].Summary} |
Version | Project version assigned to the Test Set | ${TestSets[x].FixVersions} |
The Test Sets are listed in a table as follows.
If the Test is part of Test Plans, they will be shown.
Key | Description | Code |
---|---|---|
Key | Key of the Test Plan in the form of a link | @{title=${TestPlans[x].Key}|href=${BaseURL}/browse/${TestPlans[x].Key}} |
Summary | Summary of the Test Plan | ${TestPlans[x].Summary} |
Version | Project version assigned to the Test Plan | ${TestPlans[x].FixVersions} |
The Test Plans are listed in a table as follows.
This section is added for the cases where you need to have a signature validating the document.
To add additional information, usually we're thinking of adding:
Let's say we have a "Severity" field on the "requirement" (i.e., covered issue) that is linked to the Test, and that we want to show it on the report.
We can copy the column "Summary" from the "Requirements" section and adapt it.
Let's say we have a "StepField1" test step custom filed configured for our project and that it might be used in some test steps, of some Tests.
Performance can be impacted by the information that is rendered and by how that information is collected/processed.
|