A Test Set is a collection of tests. It often contains detailed instructions or goals and also, information on the configuration to be used during testing.
Actions
Create
To create a new Test Set issue:
Step 1: Click the Create Issue at the top of the screen to open the Create Issue dialog / page.
Step 2: Select the Project and on Issue Type select Test Set.
Step 3: Type a Summary for the Test Set and complete any appropriate fields — at least required ones which are marked by an asterisk.
Step 4: When you are satisfied with the content of your Test Set, click the Create button.
If you selected the Create another check box (below), a new Create Issue dialog appears. This issue is automatically pre-populated with your previous Test Set details, while leaving the Summary field blank.
Edit
To edit an existing Test Set issue:
Step 1: Locate the Test Set you want to edit.
Step 2: Click the Edit button (at the top-left of the 'view issue' page) to open the Edit Issue dialog box.
Alternatively, hover your mouse over a field and click the pencil icon to edit it inline.
Step 3: Modify your Test Set's details in the appropriate fields of the Edit Issue view.
Step 4: Click the Update button to save your changes.
Clone
When cloning a Test Set issue, all the Test issue associations will also be cloned. Also:
- If the test set contains links to other issue(s), you can select whether or not to include the links in the new clone test set.
- If the test set contains sub-tasks, you can select whether or not to create the sub-tasks in the new clone test set.
- If the test set contains attachments, you can select whether or not to include the attachments in the new clone test set.
To clone an existing Test Set issue:
Step 1: Open the Test Set you wish to clone.
Step 2: Select More > Clone. The Clone Issue screen will appear.
Step 3: Edit the clone Test Set's Summary if you wish.
Step 4: Click Create.
Configure Test Columns
Xray provides the ability to configure columns for the Tests table. This configuration is specific of each user and can be restored to the default configuration defined in the Global Preferences page in Xray add-on administration.
The first column (Test Rank) is fixed and can not be removed from the table.
To configure columns for the Tests table, the following steps must be performed:
Step 1: Open the Test Set issue.
Step 2: Click on the Columns select dropdown that appears in the Tests section, above the table in the top right corner. A list of the current configure columns and all available columns appears.
Step 3: Add or Remove columns by clicking the checkboxes next to each field.
Step 4: Click the Done button when finished or Cancel to abort this operation. The table refreshes with the configured columns.
Restoring Columns to Default Configuration
To restore columns in the Tests table to the default configuration, the following steps must be performed:
Step 1: Open the Test Set issue.
Step 2: Click on the Columns select dropdown that appears in the Tests section, above the table in the top right corner. A list of the current configure columns and all available columns appears.
Step 3: Click the Restore Columns link above the columns list. The table refreshes with the default configured columns.
Change Columns Order
To reorder columns in the Tests table, the following steps must be performed:
Step 1: Open the Test Set issue.
Step 2: Hover over the desired column header.
Step 3: Click in the column header and drag it to the desired position.
Associate Tests
Tests can be associated with Test Set issues:
From the Test Set issue view screen
To associate Tests with a Test Set from the Test Set issue view screen:
Step 1: Open the Test Set you wish to associate a Test with.
Step 2: Click the Add Tests button (under the Tests tab on the view page) to open the Add Tests dialog box.
Step 3: Select or search the Test issues to be associated with the Test Set:
Select Test Issues - In order to select the Tests to be associated you can, under the Select tab:
- Input the desired Test Issue Key on the Tests field;
- Click on the Down Arrow on the Tests field and select the Test from its History Search list;
- Click on the + button wich will prompt an Issue Selector Pop-Up;
- Click on the Search tab to use the Find JIRA issues browser - More here;
Search Test Issues - In order to search for Tests to be associated you can, under the Search tab:
- Browse for the desired Test Project, Type or terms it Contains;
- Click on the More button to add more browse fields such as Label, Test Set, Test Set Fix Version, Requirement and Requirement Fix Version;
- Click on the Magnifier button after filling the browse fields, to get a list of matching entries;
- Click on the Advanced button to perform a JQL search - More here;
Step 4: Click Add.
From the Test issue view screen
To associate Tests with a Test Set from the Test issue view screen:
Step 1: Open the Test you wish to associate a Test Set with.
Step 2: Click the Associate Test Sets button (under the Test Sets tab on the view page) to open the Associate Test Sets dialog box.
Step 3: Select or search the Test Set issues to be associated with the Test Set:
Select Test Set Issues - In order to select the Tests Sets to be associated you can:
- Input the desired Test Set Issue Key on the Tests Sets field;
- Click on the Down Arrow on the Tests Sets field and select the Test Set from its History Search list;
- Click on the + button wich will prompt an Issue Selector Pop-Up;
- Click on the Search tab to use the Find JIRA issues browser;
Search Test Issues - In order to search for Test Sets to be associated you can, under the Search tab:
- Browse for the desired Test Set Project or terms it Contains;
- Click on the More button to add more browse fields such as Label and Fix Version;
- Click on the Magnifier button after filling the browse fields, to get a list of matching entries;
- Click on the Advanced button to perform a JQL search;
Step 4: Click Add.
From the Create Test screen
To associate Test Sets with a Test from the Create/Edit issue screen:
Step 1: On a Test Issue Type of Create Issue dialog / page, click on the Test Sets tab
Step 2: In order to select the Tests Sets to be associated you can:
- Input the desired Test Set Issue Key on the Tests Sets field;
- Click on the Down Arrow on the Tests Sets field and select the Test Set from its History Search list;
- Click on the + button which will prompt an Issue Selector Pop-Up;
Step 3: Click Add.
Remove Tests
Tests can be removed from Test Set issues:
From the Test Set issue view screen
To remove Tests from a Test Set from the Test Set issue view screen:
Step 1: Open the Test Set you wish to remove a Test.
Step 2: On the Tests table hover the desired Test row and click on the Trash button that appears in the end of the row. You will be prompted with a confirmation dialog.
From the Test issue view screen
To remove a Test Set association from the Test issue view screen:
Step 1: Open the Test you wish to remove the association with a Test Set.
Step 2: On the Tests Sets table hover the desired Test Set row and click on the Trash button that appears in the end of the row. You will be prompted with a confirmation dialog.
Reorder Tests
Tests within a Test Set issue can be reordered. There are two ways of changing the order of a Test:
Drag-n-drop
To reorder Tests the following steps must be taken:
Step 1: Open the Test Set issue.
Step 2: Hover over the desired Test row (under the Tests section on the view page) and the drag handle column.
Step 3: Click the drag handle and move the Test up or down in the current page.
Change Rank Action
This action allows users to change the Rank of a Test between pages.
To change the rank of a Test through the action:
Step 1: Open the Test Set issue.
Step 2: Hover over the desired Test (under the Tests section on the view page)
Step 3: Click the gear that appears in the last column. The actions menu should popup with the available actions.
Step 4: Click the Move To action. The change rank dialog appears.
Step 5: Enter the desired index number (1-based) and press OK.
Bulk Operations
Xray provides the following bulk operations on the Tests table.
- Remove - Deletes all the selected Tests associations with a Test Set.
To execute these bulk actions:
Step 1: Open the Test Set issue.
Step 2: Click on the Bulk button to activate the bulk edit mode (under the Tests section on the view page). A checkbox appears on each Test row and also the bulk actions button in the actions column header.
Step 3: Selected the desired Test issues.
Step 4: Click the bulk actions gear located on the actions column header and choose one of the available actions.
Export to Cucumber
Cucumber Test Sets in JIRA can be exported to feature files ready to be executed in Cucumber. The generated feature files follow the rules defined in Export Cucumber Features and take into account the context of the JIRA Test Set issue.
A single Cucumber feature file should be generated and prompt to be downloaded for the Automated[Cucumber] Test contained on the Test Set, unless the target Test Set contains multiple Automated[Cucumber] Tests or the Automated[Cucumber] Test is associated with multiple Requirements, which, in this case, a FeatureBundle zip file will be generated containing a single Cucumber feature file for every Requirement associated with the target Automated[Cucumber] Test contained on the Test Set.
To export a Test Set issue containing Cucumber Tests to feature files, the following steps must be taken:
Step 1: Open the Test Set issue view page.
Step 2: Select More > Export to Cucumber. The file will be downloaded from the browser.
