Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The following screenshots shows an example of the sections you should expect in this report.

Image RemovedImage RemovedImage RemovedImage RemovedImage AddedImage AddedImage AddedImage Added



How to use

This report can be generated from the Issue details screen, or from the Issue Search/navigator page.

...

  1. open the Issue Search/navigator (go to Filters > Advanced issue search)
  2. search by component "Account", or by other criteria based on the Test issue's fields
    1.  Image RemovedImage Added
  3. Select the "Xporter" action and export it using this template
    1. Image RemovedImage Added

Export the test specification for all Tests contained in a Test Repository folder

  1. select a folder in the Test Repository
  2. Select the "View Issues" action; you'll be redirected to the Issue Search/Navigator
    1. Image RemovedImage Added
  3. The generated query will include all Tests in all sub-folders; to just include the Tests on the selected folder, change the 'true' to 'false' on the last argument of the TestRepositoryFolder() JQL function
  4. On the Issue Search/Navigator, select the "Xporter" action and export it using this template
    1. Image RemovedImage Added

Export the test specification for all Tests contained in a Test Plan or in one of its folders (including sub-folders)

  1. select a folder in the Test Plan
  2. Select the "View Issues" action; you'll be redirected to the Issue Search/Navigator
    1. Image RemovedImage Added
  3. The generated query will include all Tests in all sub-folders; to just include the Tests on the selected folder, change the 'true' to 'false' on the last argument of the testPlanFolderTests() JQL function
  4. On the Issue Search/Navigator, select the "Xporter" action and export it using this template
    1. Image RemovedImage Added


Understanding the report

...

In this section, the total tests are grouped by their test type and a count is shown.

Test TypeNumber of Tests
Manual

Number of tests that are step/script based; usually these are known by "manual" (even though "manual" is a rough simplification)

GherkinNumber of Gherkin based tests; usually these correspond to Cucumber test scenarios, with Test Type "Cucumber", but may also refer to other Gherkin based frameworks
OtherNumber of tests that are neither scripted nor Gherkin based; usually these correspond to unstructured tests; this includes the tests having Test Type "Generic". Generic automated test scripts are usually included here; exploratory tests also.
Info
titlePlease note

If you wish to count Tests by custom Test Types, you can do so. See more information ahead on how to customize this report.

...

The output will have the following information.

Image RemovedImage Added

Requirements covered by these Tests

In this section we have an overview of all the requirements that are covered by the Tests in this report.

FieldDescriptionCode
KeyKey of the requirement (in this case we are adding it as link)@{title=${Links[j].Key}|href=${BaseURL}/browse/${Links[j].Key}}
SummarySummary of the requirement${Links[j].Summary}
VersionProject version assigned to the requirement${Links[j].FixVersions}
Workflow StatusWorkflow Status of the requirement${Links[j].Status}


The requirements are listed in a table as follows.

Image RemovedImage Added

Tests

This section will gather all the information related to each Test, focused on its specification.

...

This section have a table with information regarding each Test in this report (and will repeat these sections for each Test). The information is presented as a table with the following fields:

FieldDescriptionCode
Test TypeTest Type${TestType}
Test Repository FolderFolder where Test is at in the Test Repository${TestRepositoryPath}
Label(s)Labels assigned to the Test issue${Labels}
Component(s)Components assigned to the Test issue${Components}
PriorityPriority assigned to the Test issue${Priority}


The resulting table look like the one below.

Image RemovedImage Added

Test Description

The description of the Test (${wiki:Description}).


Image RemovedImage Added

Test Issue Attachments

This section only appears if you have any attachments associated to the Test.

KeyDescription
File NameFile Name of the attachment
AuthorThe Author of the attachment
File SizeFile Size of the attachments in bytes


This appears in the document in a table form. A thumbnail is shown for images.

Image RemovedImage Added

Status of the last execution

This section shows the last execution status for the Test.


Image RemovedImage Added

Requirements

In this section we have an overview of all the requirements that are covered by the Test.

FieldDescriptionCode
KeyKey of the requirement (in this case we are adding it as link)@{title=${Links[j].Key}|href=${BaseURL}/browse/${Links[j].Key}}
SummarySummary of the requirement${Links[j].Summary}
VersionProject version assigned to the requirement${Links[j].FixVersions}
Workflow StatusWorkflow Status of the requirement${Links[j].Status}


The requirements are listed in a table as follows.

Image RemovedImage Added

Preconditions

If the Test requires any Preconditions, they will be shown.

KeyDescriptionCode
KeyKey of the Precondition in the form of a link@{title=${PreConditions[n].Key}|href=${BaseURL}/browse/${PreConditions[n].Key}}
SummarySummary of the Precondition${PreConditions[n].Summary}
ConditionCondition${wiki:PreConditions[n].Conditions}


The Preconditions are listed in a table as follows.

Image RemovedImage Added

Test Details

This section shows the Test details; for that we are considering the different possible Test Types we can have in Xray. For each type we will fetch different information.


TypeKeyDescriptionCodeOutput

Unstructured

(e.g., "Generic")

Test TypeTest Type field

${Test Type}

Image Removed

Image Added

SpecificationDefinition of the Generic test${Generic Test Definition}

Gherkin

(e.g., "Cucumber")

Test TypeTest Type field

${Test Type}

Image Removed

Image Added

Gherkin SpecificationGherkin specification of the Test

${Cucumber Scenario}

Structured

(e.g., "Manual")

(Step)Step Number${TestSteps[m].StepNumber}
Image Removed

Image Added

ActionAction of the Test Step${TestSteps[m].Action}
Step Custom Fields
Stpe
Step custom field(s)

${TestSteps[m].<step_custom_field>}


Note: Test Step Custom Fields are not rendered by default; they need to be specified explicitly

DataData of the Test Step${TestSteps[m].Data}
Expected ResultExpected Result of the Test Step${TestSteps[m].ExpectedResult}
AttachmentsAttachment of the Test Step; images will be rendered

@{title=${TestSteps[m].Attachments[sa].Name}|href=${TestSteps[m].Attachments[sa].FileURL}}
!{${TestSteps[m].Attachments[sa].FileURL}|width=100}


Test Sets

If the Test is part of Test Sets, they will be shown.

KeyDescriptionCode
Key

Key of the Test Set in the form of a link

@{title=${JQLIssues[y].Key}|href=${BaseURL}/browse/${JQLIssues[y].Key}}
SummarySummary of the Test Set${JQLIssues[y].Summary}
VersionProject version assigned to the Test Set${JQLIssues[y].FixVersions}


The Test Sets are listed in a table as follows.

Image RemovedImage Added

Test Plans

If the Test is part of Test Plans, they will be shown.

KeyDescriptionCode
KeyKey of the Test Plan in the form of a link@{title=${JQLIssues[x].Key}|href=${BaseURL}/browse/${JQLIssues[x].Key}}
SummarySummary of the Test Plan${JQLIssues[x].Summary}
VersionProject version assigned to the Test Plan${JQLIssues[x].FixVersions}


The Test Plans are listed in a table as follows.

Image RemovedImage Added

Appendix A: Approval

This section is added for the cases where you need to have a signature validating the document.

Image RemovedImage Added


Customizing the report

...