Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...


Image RemovedImage Added

Navigation and Actions bar

...

If you are executing an automated Test, you can export its definition right from the execution screen.

Export to Cucumber

If you're executing a Cucumber Test, an option to export the Test as a feature file will appear.

...

If you already have the test results, just use this action to import the report files into Xray and update a specific Test Run.

Dataset

If you want to edit a test run dataset, you can do it by clicking on the Dataset button. To learn more about it click on Parameterized Tests.

Execution Status

The Execution Status describes the current Test progress. The possible (native) status for a Test Run are TODOEXECUTINGFAILABORTED, and PASS. You can also create custom statuses in the Xray Execute Tests administration page.

...

Info

This section is only visible if the "Separation of Concerns" option is disabled in Coverage Settings settings page.


Image RemovedImage Added

All affected requirement statuses will be updated whenever a step (or example in the case of Cucumber automated Tests) status is changed. The status for any affected requirement can always be changed by clicking on the status and choosing the desired option.

...

The Execution Defects field lists the Global and Step defects related to the current execution. It is possible to create a new Defect issue, create a new Sub-task or Add existing Defects by clicking on the respective option.

...

The options menu on the right top corner is presented appears for Manual Tests only, it changes the presentation of the defects list.

By enabling the Show Step Defects option, besides the Global Defects, the Test Step Defects will be presented shown in this list along with the index of the Step it belongs to.

Image RemovedImage Added

Execution Evidence

The Execution Evidences field lists the overall attachments related to the current execution and by clicking on the Add EvidencesEvidence Icon, opens the Attach Files dialog box.

Image Removed

Issue Details

This section includes some fields present on the Test issue. It often contains useful information for testers to execute the Test.

Test Description

Image Added

Global and Test Step Evidence

The options menu on the right top corner appears for Manual Tests only, it changes the presentation of the evidence list.

By enabling the Show Step Evidence option, besides the Global Evidence, the Test Step Evidence will be shown in this list along with the index of the Step it belongs to.


Issue Details

This section includes some fields present on the Test issue. It This section includes the current Test issue description. The Test issue description often contains useful information for testers to execute the Test.

The field supports the Jira markup wiki language.

Image Removed

Test Description

This section includes the current Test issue description. The Test issue description often contains useful information for testers to execute the Test.

The field supports the Jira markup wiki language.

Image Added

This section shows all links associated with the Test. 

...

Unstructured Tests only contain the generic definition field on the Test Details section. This field can specify a test script, an ID to an external (automated) test case, or an Exploratory Test charter. Similar to Gherkin Tests, most unstructured test results will be imported or set by another tool. However, it is also possible to set the status of unstructured tests manually.

Iterations

When this is a test run of a data-driven test, this field shows all the iterations corresponding to the rows of the dataset closest to the test run. For each iteration, the preconditions and steps appear with the expected parameter values for it. To learn more about it click on Parameterized Tests.

All operations for test steps are also available within an iteration, namely adding defects, evidence, and the actual result.

This section also features a progress bar displaying the status of all iterations.

Filtering iterations

It is also possible to filter the iterations by status. A filter button is provided next to the iterations progress bar. Clicking on this button will open a panel with all the available statuses. Choose one or more statuses and press Apply.

Status calculation

When a step status is changed, the iteration status will be updated automatically, according to the step statuses and, in turn, the overall test status will also be updated based on all iterations statuses.

image2021-4-29_14-27-33.pngImage Added

Automated Results

...