Page History

...

• Manage Test Executions under Test Plans: enabled
• Synchronize Tests between Test Execution and related Test Plan(s): enabled
• Manage Tests under Test Plans: disabled

Actions

Xray provides specific actions that will interact and integrate with changes made on Structure. These actions must be invoked explicitly.

Test Set

With the Extender added, you can now do the following actions:

...

Pre-Condition

With the Extender added, you can now do the following actions:

• Manage Tests of the Pre-Condition:
  
  • Drag a Pre-Condition to a structure and have its associated Tests dynamically appear;
    Image Added
  • Drag a Test to a Pre-Condition and have it automatically associated to the Pre-Condition. When you drag a Test to a Pre-Condition, a message will appear as displayed in the image below. You should always choose the Xray "Add" action since it's the option that will use the Xray Extender;
    Image Added  Image Added

• • Drag a Test Set to a Pre-Condition and have all the Tests in the Test Set automatically associated to the Pre-Condition. You will get the same message as above;
  • Remove a Test from a Pre-Condition and have the association automatically removed from the Pre-Condition. When you click on the X and you have a Test selected, the Test will be removed from the Pre-Condition;

Test Set

With the Extender added, you can now do the following actions:

• Drag a Test Set to a structure and have its Tests dynamically appear.
  Image Added
  
  
• Drag a Test to a Test Set and have it automatically associated to the Test Set.
  When you drag a Test to a Test Set, a message will appear. You should always choose the "Add" Xray action since it's the option that will use the Xray Extender.
  Image Added
  
  
• Drag a Test Set to a Test Set and have all the Tests in the Test Set automatically associated to the other Test Set. 
  When you drag a Test Set to another Test Set, a message will appear. You should always choose the "Add" Xray action since it's the option that will use the Xray Extender..
  
  Image Added
• Remove a Test from a Test Set and have the association automatically removed from the Test Set.
  When you click on the X and you have a Test selected, the Test will be removed from the Test Set. If you remove multiple Tests, an additional message may be shown that you should accept.
  
  Image AddedImage Added

Test Execution

...

Image Removed

Test Execution

With the Extender added, you can now do the following actions:

• Manage Tests of the Test Execution
  • Drag a Test Execution to a structure and have its Tests dynamically appear.
  • Drag a Test to a Test Execution and have it automatically associated to the Test Execution.
    When you drag a Test to a Test Execution, a message will appear. You should always choose the "Add Tests to Test Execution" since it's the option that will use the Test Execution Extender.
  • Drag a Test Set to a Test Execution and have all the Tests in the Test Set automatically associated to the other Test Execution. You will get the same message as above.
  • Remove a Test from a Test Execution and have the association automatically removed from the Test Execution. When you click on the X and you have a Test selected, the Test will be removed from the Test Execution.
• Indirectly manage the Tests of the related Test Plans (you must enable a a specific option in the Extender of this)
  

  • Drag a Test/Test Set to a Test Execution and have the Test, or related Tests, automatically associated to all Test Plans linked to that Test Execution

  • Remove a Test from a Test Execution and have the association automatically removed also from the Test Plan, if that Test is not part of any other Test Execution linked to the same Test Plan

Sub-Test Execution

With the Extender added, you can now do the following actions:

• Manage Tests of the Sub-Test Execution
  
  • Drag a Sub-Test Execution to a structure and have its Tests dynamically appear.
  • Drag a Test to a Sub-Test Execution and have it automatically associated to the Sub-Test Execution. When you drag a Test to a Sub-Test Execution, a message will appear. You should always choose the "Add Tests" since it's the option that will use the Test Execution Extender.

Image Removed

• • Drag a Test Set to a Sub-Test Execution and have all the Tests in the Test Set automatically associated to the Sub-Test Execution. You will get the same message as above
  • Remove a Test from a Sub-Test Execution and have the association automatically removed from the Sub-Test Execution. When you click on the X and you have a Test selected, the Test will be removed from the Sub-Test Execution.
• Indirectly manage the Tests of the related Test Plans (you must enable a a specific option in the Extender of this)
  

  • Drag a Test/Test Set to a Test Execution and have the Test, or related Tests, automatically associated to all Test Plans linked to that Test Execution

  • Remove a Test from a Test Execution and have the association automatically removed also from the Test Plan, if that Test is not part of any other Test Execution linked to the same Test Plan

...

With the Extender added, you can now do the following actions:

• Manage Tests of the Test

...

• Execution:
  • Drag a Test

...

• • Execution to a structure and have its Tests dynamically appear. You may also choose to make the related Test Executions appear; these behaviours depend on the options chosen in the Extender;
    Image Added
  • Drag a Test to a Test

...

• • Execution and have it automatically associated to the Test

...

• • Execution.
    When you drag a Test to a Test

...

• • Execution, a message will appear. You should always

...

• • choose the Xray "Add

...

• • " action since it's the option that will use the

...

• • Xray Extender;
    Image Added Image Added
  • Drag a Test Set to a Test

...

• • Execution and have all the Tests in the Test Set automatically associated to the other Test

...

• • Execution. You will get the same message as above

...

• • ;
  • Remove a Test from a Test

...

• • Execution and have the association automatically removed from the Test

...

• • Execution. When you click on the X and you have a Test selected, the Test will be removed from the

...

• • Test Execution.

...

• Indirectly manage the Tests of the related Test Plans (you must enable a a specific option in the Extender

...

• of this):
  

  • Drag a Test/Test

...

• • Set to a Test

...

• • Execution and have the Test, or related Tests, automatically associated to all Test Plans linked to that Test Execution;

  • Remove a Test

...

• • from a Test

...

• • Execution and have the association automatically removed also from the Test Plan, if that Test is not part of any other Test Execution linked to the same Test Plan.

Sub-Test Execution

You may perform similar actions to the Test Execution. Please see above.

Test Plan

Pre-Condition

With the Extender added, you can now do the following actions:

• Manage Tests of the Pre-ConditionTest Plan:
  • Drag a Pre-Condition to Test Plan to a structure and have its associated Tests dynamically appear.;
    Image Added
  • Drag a Test to a Pre-Condition and Test Plan and have it automatically associated to the Pre-ConditionTest Plan. When you drag a Test to a Pre-ConditionTest Plan, a message will appear as displayed in the image below. You should always choose the the Xray "Add Tests" to the Pre-Condition since " action since it's the option that will use the Pre-Condition Extender.

Image Removed

• • Xray Extender;
    Image Added  Image Added
  • Drag a Test Set to a
Pre-Condition and
• • Test Plan and have all the Tests in the Test Set automatically associated to the
Pre-Condition
• • other Test Plan. You will get the same message as above
.
• • ;
  • Remove a Test from a
Pre-Condition and
• • Test Plan and have the association automatically removed from the
Pre-Condition
• • Test Plan. When you click on the X and you have a Test selected, the Test will be removed from
the Pre-Condition.

Info

title	Note

• • the Test Plan.
• Manage the Test Executions under the Test Plan (you need to enable a specific option in the Extender for this):
  
  • Drag a Test Execution to a Test Plan and have it automatically associated to the Test Plan;
  • Remove a Test Execution from a Test Plan and have the association automatically removed from the Test Plan

When moving a Test to different issue types, the Test will not be removed from source issue.

Example: When moving Test A from Test Set B into Test Execution C, the Test will be added to Test Execution C, but not removed from Test Set B

• • .

Other features

Association between Tests and requirements

Since the association between Tests and requirements is done using the "Tests" link, you can take advantage of the built-in Structure extender for dealing with linked issues and therefore, manage this association.

For this, you must have "Automation" enabled. Choose "Extend with..." and then "Linked issues...".

Then, choose the "Tests" link type.

As soon as you do this, you're able to see the association between Tests and requirements, as shown below. You can see the story being validated by the manual Test.

You can also link your Test with other requirements just by dragging them under the Test and choose the action that will create the proper issue link between the Test and the requirement.

Info
title Note
If you want, you can also manage the association from the opposite end, by looking from the requirement's perspective. This will allow you to see and manage the Tests that validate a given requirement. For this, you just need to create an extender for the "Tested by" link type.

Association between Sub-Test Executions and requirements

Sub-Test Executions are created as sub-tasks for requirement issues. You can take advantage of the built-in Structure extender for dealing with sub-tasks and therefore, see this association.

For this, you must have "Automation" enabled. Choose "Extend with..." and then "Sub-tasks...", and then the Sub-Test Execution issue type.

Afterwards, you're able to see all the Sub-Test Executions created in the context of a requirement issue that is part of the structure.

Show requirement and test statuses

You can include information about the status of your "requirements" and its current state, along with the latest status for the corresponding Tests, in the issues being shown in the structure.

For this, you need to add the "Requirement Status" and the "TestRunStatus" columns, which correspond to the "Requirement Status" custom field of requirements and the "TestRunStatus" custom field that is available for Test issues, respectively.

Please make sure that those custom fields are configured in Xray (under "Custom Field Preferences" admin settings) to show the respective information in the same way (i.e., for the same version). Refer to this configuration page, the FAQ or Using custom fields if you have questions about these fields.

Show progress information of Test Executions and Test Plans

You can include information about the progress (i.e. the "overall execution status") of (Sub) Test Executions or Test Plans. For this, you need to include the proper custom fields: "Test Execution Satus" and "Test Plan Status", respectively. More information on these fields can be found here.

Note: you need to have the latest version of Structure installed.

Show status overview of Tests contained within Test Sets

You can include information about the status of the Tests belonging to a Test Set, by including the "Test Set Status" custom field as a column. Although Test Sets are not related with execution aspects, sometimes it may be quite useful to have an idea how certain groups of Tests (i.e. the ones that you have in some Test Set) are.

Please make sure this custom field is configured properly in Xray (under "Custom Field Preferences" admin settings), to show the status of Tests for the version you want to.

More information on this field can be found here.

Note: you need to have the latest version of Structure installed.