The purpose of a Test Plan is to enable you to have a better visibility and management over your Tests.

It provides a table that shows all the Tests added to the Test Plan and their respective Test Executions that are also associated with the Test Plan.

If tracking a particular version, the Test Plan will present the latest status for each Test, independent of the number of testing iterations (i.e.,Test Executions) you make with them.

You can group a bunch of Test Executions and easily give feedback on the current/latest status of the Tests involved in those Test Executions.

From the Test Plan, it's possible to create one or more Test Executions, for all or just a subset of the Tests contained within the Test Plan (e.g., only those Tests that are still failling).

You are also able to assign one or more Test Plans to a given release and track progress of those tests within each Test Plan.

The Requirements Coverage Analysis can also be done taking into account just the tests from a given Test Plan and its related Test Executions. 

Create Test Plan

To create a new Test Plan Issue, 

Step 1: Click the Create Issue at the top of the screen to open the Create Issue dialog box / page.

Step 2: Select the Project and on Issue Type select Test Plan.

Step 3: Under the General tab, type a Summary for the test execution and fill all appropriate fields — mandatory fields are marked with an asterisk. If you're working with versions, then you should also fill out the Fix Version to indicate that you're tracking the results of the Tests for that version. This will be used to automatically fill out the Fix Version of the planned Test Executions (i.e., the ones linked to/created from this Test Plan).

Step 4: Under the Test Plan Details tab, you can populate the Test Plan custom fields provided by Xray, namely the Begin/End date. In this tab, you can also add tests to the Test Plan.

Optional: To create a series of similar Test Plans – within the same Project – select the Create another checkbox at the bottom of the dialog.

Step 5: When you are satisfied with the content of your Test Plan, click the Create button.

Step 5a: If you selected the Create another checkbox, a new Create Issue dialog appears. This issue is automatically pre-populated with your previous Test Plan details, while leaving the Summary field blank.


Add Tests to a Test Plan 

Aside from adding Tests to the Test Plan using the issue create screen, you can also do it in the Test issue page.

Step 1: Click Add.

Step 2: Choose to add either Tests or Test Sets. Note that if you choose Test Sets, you are not actually adding Test Set(s); instead, you are adding the Tests that belong to that Test Set(s).

Step 3: Choose the Tests you want, by using the Select or Search tabs and then selecting some or all of them.

Step 4: Click Add selected or Add all.

 

Reorder Tests

Ranking of Tests within the Test Plan can be done in two ways: directly in the Test Plan issue screen (if Hierarchical Test Oganization is disabled) or in the Test Plan Board (if Hierarchical Test Organization is enabled). This means you can rank Tests, whether you use hierarchies or not.


Learn more

If you are using Hierarchical Test Organization, you can and have to the ranking within the Test Plan Board. More info here.


The following procedure details how you can change the order of the Tests, directly in the Test Plan issue screen. 


There are two ways of changing the order of Tests within a Test Plan:

Drag-and-Drop

To reorder Tests,

Step 1: Open the Test Plan issue.

Step 2: Hover over the desired Test row (under the Tests section on the view page) and the drag handle column.

Step 3: Click the drag handle and move the Test up or down in the current page.

Change Rank Action

This action allows users to change the Rank of a Test between pages.

To change the rank of a Test,

Step 1: Open the Test Plan issue.

Step 2: Hover over the desired Test (under the Tests section on the view page)

Step 3: Click the gear that appears in the last column. The actions menu should pop up with the available actions.

Step 4: Click the Move To action. The change rank dialog appears.

Step 5: Enter the desired index number (1-based) and click OK.











Associate Test Executions to the Test Plan

Since the table only shows Test Runs for tests that are in the Test Plan and for Test Executions that are associated with the Test Plan, it's necessary to associate Test Executions with the Test Plan.

You can also add existing Test Execution issues directly to a Test Plan. 

The selected Test Executions will be added, including the Tests associated with those Test Executions.

Test Executions can also be associated with a Test Plan by editing the custom field Test Plan in the Test Execution issue view page or directly in the create issue screen in the Test Execution Details tab. Note that with this method, only the Test Execution shall be associated with the Test Plan; the Tests will not be associated.


Test Plan table

The Test Plan Test view section in the issue page provides you with a table where you can see all the Tests that were added to the Test Plan and their Test Executions (if they are associated to the Test Plan). 


  1. Create planned Test Execution (see next Section), so its results be reflected on the current Test Plan
  2. Add Tests and Test Sets
  3. Test Plan Progress Bar
  4. Table Filters
  5. Use a Test Environment to calculate the status for test issues for that environment.


Each row represents a Test with configurable columns, with the exception of the Latest Status. Each row also contains an inner table with information about the Test Execution. Click on the blue arrow to see the inner table for a particular test.

This inner table is similar to the Test Run table as it allows for inline execution ( 1 )  and for operations like assignee and remove ( 2 ). This inner columns are not configurable.

Create Test Executions from the Test Plan

There are 2 ways to create Test Executions directly in the Test Plan issue page:

The Create Test Execution button will open a dropdown that has 2 options. 

All tests... lets you create a Test Execution with all the tests that are associated with the Test Plan.

Note: If the revision field is not configured in the create issue screen of the Test Execution for the selected Project, the field will not appear in the dialog.

 With status... will open a dialog that will allow the user to filter the tests that will be associated to the Test Execution by Test Run Status.


  • Bulk action create; – I assume this is the second way but no description?
  • No labels