A Test Set is a collection of Tests. It often contains detailed instructions or goals as well as information on the configuration to be used during testing.
Test Sets are simple, flat lists of Tests that you can use as a basis for creating Test Executions or Test Plans. Since the Tests are grouped in some logical way, such as grouping all Tests related with regression testing or security, or all Tests for a specific component or some high-level feature/business case, a Test can be part of different Test Sets. Test Sets can also be used as a dynamic way to cover requirements.
Actions
Create
To create a new Test Set issue:
Step 1: Click the Create Issue at the top of the screen to open the Create Issue dialog / page.
Step 2: Select the Project and on Issue Type, select Test Set.
Step 3: Type a Summary for the Test Set and complete all appropriate fields — at least, the required ones marked by an asterisk.
Step 4: When you are satisfied with the content of your Test Set, click the Create button.
If you selected the Create another checkbox (below), a new Create Issue dialog appears. This issue is automatically pre-populated with your previous Test Set details, while leaving the Summary field blank.
Edit
To edit an existing Test Set issue:
Step 1: Locate the Test Set you want to edit.
Step 2: Click the Edit button (at the top-left of the 'view issue' page) to open the Edit Issue dialog box.
Alternatively, hover over a field and click the pencil icon to edit it inline.
Step 3: Modify your Test Set's details in the appropriate fields of the Edit Issue view.
Step 4: Click the Update button to save your changes.
Clone
When cloning a Test Set issue, all the Test issue associations will also be cloned. Also:
- If the test set contains links to other issue(s), you can select whether or not to include the links in the new clone test set.
- If the test set contains sub-tasks, you can select whether or not to create the sub-tasks in the new clone test set.
- If the test set contains attachments, you can select whether or not to include the attachments in the new clone test set.
To clone an existing Test Set issue:
Step 1: Open the Test Set you wish to clone.
Step 2: Select More > Clone. The Clone Issue screen will appear.
Step 3: Edit the clone Test Set's Summary if you wish.
Step 4: Click Create.
Configure Test Columns
Xray provides the ability to configure columns for the Tests table. This configuration is specific to each user and can be restored to the default configuration defined in the Global Preferences page in the Xray app administration.
The first column (Test Rank) is fixed and cannot be removed from the table.
To configure columns for the Tests table,
Step 1: Open the Test Set issue.
Step 2: Click on Columns ,select the dropdown that appears in the Tests section above the table in the top-right corner. A list of the current configure columns and all available columns appears.
Step 3: Add or remove columns by clicking the checkboxes next to each field.
Step 4: Click the Done button when finished or Cancel to abort this operation. The table refreshes with the configured columns.
Restoring Columns to Default Configuration
To restore columns in the Tests table to the default configuration,
Step 1: Open the Test Set issue.
Step 2: Click on Columns, select the dropdown that appears in the Tests section, above the table in the top-right corner. A list of the current configure columns and all available columns appears.
Step 3: Click the Restore Columns link above the columns list. The table refreshes with the default configured columns.
Change Columns Order
To reorder columns in the Tests table,
Step 1: Open the Test Set issue.
Step 2: Hover over the desired column header.
Step 3: Click in the column header and drag it to the desired position.
Associate Tests
Tests can be associated with Test Set issues:
From the Test Set issue view screen
To associate Tests with a Test Set from the Test Set issue view screen:
Step 1: Open the Test Set you wish to associate a Test with.
Step 2: Click the Add Tests button (under the Tests tab on the view page) to open the Add Tests dialog box.
Step 3: Select or search the Test issues to be associated with the Test Set:
Select Test Issues - In order to select the Tests to be associated you can, under the Select tab:
- Input the desired Test Issue Key on the Tests field.
- Click on the Down Arrow on the Tests field and select the Test from its History Search list.
- Click on the + button wich will prompt an Issue Selector Pop-Up.
- Click on the Search tab to use the Find Jira issues browser (more here).
Search Test Issues - In order to search for Tests to be associated you can, under the Search tab:
- Browse for the desired Test Project, Type or terms it Contains
- Click on the More button to add more browse fields such as Label, Test Set, Test Set Fix Version, Requirement and Requirement Fix Version.
- Click on the Magnifier button after filling out the browse fields to get a list of matching entries.
- Click on the Advanced button to perform a JQL search (more here).
Step 4: Click Add.
From the Test issue view screen
To associate Tests with a Test Set from the Test issue view screen:
Step 1: Open the Test you wish to associate a Test Set with.
Step 2: Click the Associate Test Sets button (under the Test Sets tab on the view page) to open the Associate Test Sets dialog box.
Step 3: Select or search the Test Set issues to be associated with the Test Set:
Select Test Set Issues - In order to select the Tests Sets to be associated you can:
- Input the desired Test Set Issue Key on the Tests Sets field.
- Click on the Down Arrow on the Tests Sets field and select the Test Set from its History Search list.
- Click on the + button wich will prompt an Issue Selector Pop-Up.
- Click on the Search tab to use the Find Jira issues browser.
Search Test Issues - In order to search for Test Sets to be associated you can, under the Search tab:
- Browse for the desired Test Set Project or terms it Contains.
- Click on the More button to add more browse fields such as Label and Fix Version.
- Click on the Magnifier button after filling out the browse fields, to get a list of matching entries.
- Click on the Advanced button to perform a JQL search.
Step 4: Click Add.
From the Create Test screen
To associate Test Sets with a Test from the Create/Edit issue screen:
Step 1: On a Test Issue Type of Create Issue dialog / page, click on the Test Sets tab
Step 2: In order to select the Tests Sets to be associated you can:
- Input the desired Test Set Issue Key on the Tests Sets field.
- Click on the Down Arrow on the Tests Sets field and select the Test Set from its History Search list.
- Click on the + button which will prompt an Issue Selector Pop-Up.
Step 3: Click Add.
Remove Tests
Tests can be removed from Test Set issues:
From the Test Set issue view screen
To remove Tests from a Test Set from the Test Set issue view screen:
Step 1: Open the Test Set you wish to remove a Test.
Step 2: On the Tests table, hover over the desired Test row and click on the Trash button that appears at the end of the row. You will be prompted with a confirmation dialog.
From the Test issue view screen
To remove a Test Set association from the Test issue view screen:
Step 1: Open the Test you wish to remove the Test Set association.
Step 2: On the Tests Sets table, hover over the desired Test Set row and click on the Trash button that appears at the end of the row. You will be prompted with a confirmation dialog.
Reorder Tests
There are two ways of changing the order of Tests within a Test Set:
Drag-and-Drop
To reorder Tests,
Step 1: Open the Test Set issue.
Step 2: Hover over the desired Test row (under the Tests section on the view page) and the drag handle column.
Step 3: Click the drag handle and move the Test up or down in the current page.
Change Rank Action
This action allows users to change the Rank of a Test between pages.
To change the rank of a Test,
Step 1: Open the Test Set issue.
Step 2: Hover over the desired Test (under the Tests section on the view page)
Step 3: Click the gear that appears in the last column. The actions menu should pop up with the available actions.
Step 4: Click the Move To action. The change rank dialog appears.
Step 5: Enter the desired index number (1-based) and click OK.
Bulk Operations
Xray provides the following bulk operations on the Tests table:
- Remove - Deletes all the selected Tests associations with a Test Set.
To execute these bulk actions:
Step 1: Open the Test Set issue.
Step 2: Click on the Bulk button to activate the bulk edit mode (under the Tests section on the view page). A checkbox appears on each Test row and also the bulk actions button in the actions column header.
Step 3: Selected the desired Test issues.
Step 4: Click the bulk actions gear located on the actions column header and choose one of the available actions.
Export to Cucumber
Cucumber Test Sets in Jira can be exported to feature files ready to be executed in Cucumber. The generated feature files follow the rules defined in Export Cucumber Features and take into account the context of the Jira Test Set issue.
A single Cucumber feature file should be generated and prompted to be downloaded for the Automated[Cucumber] Test contained on the Test Set, unless the target Test Set contains multiple Automated[Cucumber] Tests or the Automated[Cucumber] Test is associated with multiple Requirements. In this case, a FeatureBundle zip file will be generated containing a single Cucumber feature file for every Requirement associated with the target Automated[Cucumber] Test contained on the Test Set.
To export a Test Set issue containing Cucumber Tests to feature files,
Step 1: Open the Test Set issue view page.
Step 2: Select More > Export to Cucumber. The file will be downloaded from the browser.
