Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

UI Expand
titleGlobal Level Settings
Image RemovedAdd Custom URLBackup & Restore
Miscellaneous Settings

Image Removed

warning cloud Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.

Image Removed

(error) cloud

Image Removed

warning cloud Available under Global Settings → Cucumber" but unable to create a prefix for a Test Plan.

Image Removed

warning cloud Setting moved to a dedicated option in the menu tab: Global Settings → Cucumber

Image Removed

warning cloud Available under Global Settings Miscellaneous & Feature

Feature Toggling

Xray Global Settings

GroupSetting

Xray Server/ DC

(Standard & Enterprise)

Xray Cloud

(Standard & Enterprise)

Miscellaneous Settings

The Global Configurations for Xray.


Display the Pre-Conditions section before the Test Details

cross mark
Display Manual Test Results table in short view

plus sign cloud Available under Global by default and per Project after enabling it.

Project admins can configure Test Step Custom Fields

warning cloud  Available by default on the project level through Test Step Fields, no longer a Global Setting

Project admins can configure Test Run Custom Fields

warning cloud  Available by default on the project level through Test Run Custom Fields, no longer a Global Setting

Test Run OptionsSet final Test Run status

cross mark

Inline Execute Tests

Restrict test execution to the assignee

cross mark

Fail All Steps/Examples                                                

warning cloud Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.

Restrict automated Test status

cross mark

(error) cloud - By default, the automated Test status can be set manually.

Can Edit TestRun Dates

warning cloud The setting is available under Project Settings → Miscellaneous

Track Time

Set the value of the Time Tracker

Enable Test Run Status history log in Test Executions

cross mark
Defect LinksLink Defects with Test

Link Defects with Test Execution

Link Defects with Requirement

warning cloud The menu is "Linked Defects with Covered Issues"

User Groups allowed to add Xray Issue Types

warning cloud This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)

NotificationsUser Groups allowed to add/remove Xray Notifications

cross mark

(error) cloud - Xray Notifications are not available in the Cloud.

Final Test Run statuses that may trigger notifications

Hierarchical Test OrganizationEnable Hierarchical Test organization

cross mark

(error) cloud - By default is set with Hierarchical Organization

Project Roles allowed the edit Test Repository information

cross mark

(error) cloud - Anyone with access to the project can edit Test Repo info.

Workflow StatusDisallow executions of Tests with workflow statuses

Disallow executions with workflow statuses

In progress test Execution workflow status

cross mark
Resolved Test Execution workflow status

cross mark
Resolution for Resolved Test Execution

cross mark
Clone IssuesAssociate a cloned Test with all original Test Sets

cross mark
Associate a cloned Test with all original Test Plans

cross mark
Defect Default ValuesEnvironment

(error) cloud - Although the option does not exist, It behaves with the default linked to "Test"

Steps to Reproduce

cross mark

Version                              

cross mark

(error) cloud - By default, it behaves as the Affect Version field of the defects created in the context of a test run will be populated by , which the FixVersion value of Test Execution will populate.

Label



Component

Automated Steps LibraryEnable Automated Steps Library                                    

cross mark


Validate Cucumber Scenarios

cross mark
Cucumber Export PrefixesTest

warning cloud - Available under Global Settings → Cucumber". Unable to create a prefix for a Test Plan.

Pre-Condition

Test Set

Test Plan

Requirement

Cucumber LanguageLanguage

Cucumber ExportReplace dash [ - ] with underscore [ _ ] when exporting issue keys as tags

Generate features by requirements

Cucumber export feature name

Document GeneratorEnable Document Generator

warning cloud Available under Global Settings Miscellaneous & Feature

Max number of issues that can be exported

cross mark

Requirements ReportsMax number of requirements per report or gadget

cross mark
Requirements TestsMaximum number of Links added to a Requirement

cross mark
GadgetsTest Evolution Tests Limit

cross mark
Test Evolution Test Executions Limit

cross mark
Test Runs list limit

cross mark
Tests per Test PlanTests per Test Plan Maximum allowed

cross mark
Xray REST APIXray REST API - Max results per request

cross mark
Associating a Test Execution to a Test Plan and importing Test results

cross mark
Bulk operationsMax Test Runs for bulk operations

cross mark
DatasetsMaximum size for parameter values

cross mark
Xray Exploratory AppEnable Xray Exploratory App execution links

cross mark
Usage MetricsEnable Xray Analytics

cross mark
Thread Pool SizeThread Pool Size

cross mark
Chat SupportEnable In-app Chat Support

NotificationsEnable Xray notifications

Show Xray notifications button

Custom FieldsCustom FieldsTest Run Status Custom Field Version

cross mark

Test Set Status Custom Field Version

cross mark
Requirement Status Custom Field Versions

cross mark

 MaintenanceRecalculate Requirement Status

cross mark

Test TypesManage Test TypesManage Test Type

warning cloud - Available under "Global Settings – Test Types" and "Project Settings – Test Types". 

In Xray Cloud it's not possible to set different Test Types to Test & Precondition, meaning that it applies to both issue types. Learn more <link>more 

Changing the Type of a Test
Manager Pre-Condition Type

Xray EnterpriseXray Enterprise SettingsXray Test Case Designer

warning cloud - Available under "Global Settings – Test Case Designer

Issue Type Mapping
Issue Type MappingAvailable Issue Types

warning cloud  - Available under Project Configuration → Test Coverage & Defects Mapping, meaning that you can change your setting per project.

Requirement Issue Types

Defect Issue Types

Sub-RequirementsSub-Tasks/Links

Epic - Story relation as a Requirement

Issue Link Type

Requirement Coverage
Requirement Coverage Strategy

cross mark

Ignore Requirements with Status

cross mark

Ignore Requirements with Label

cross mark

Ignore Tests with Status

cross mark

 

cross mark
 Separation of concerns

cross mark
 Include Previous Version Requirements

cross mark
 Show Flatten Requirements

cross mark
Document GeneratorDocument Generator Templates

cross mark
Requirement Projects

cross mark
Test Statuses

Test Statuses

Manage custom Test Run statuses for Xray

Image Added

Preferences

Image Added

warning cloud  - Available in each report filter and selected by default

Test Step StatusesTest Step Statuses

Manage custom Test Step statuses for Xray

Image Added

Default Column LayoutsTest Execution TestRun Columns

cross mark


cross mark

Image Added

Image Modified

warning cloud  - Available under Project Configuration → Default Column Layouts

Image Added

warning cloud  - Available under Project Configuration → Default Column Layouts

Image Added

warning cloud  - Available under Project Configuration → Default Column Layouts

Image Added

warning cloud  - Available under Project Configuration → Default Column Layouts

Image Added

Image Modified

warning cloud  - Available under Project Configuration → Default Column Layouts

Image Modified

warning cloud  - Available under Project Configuration → Default Column Layouts

Image Added

cross mark

Image Added

cross mark

cross mark

cross mark

cross mark
Parameter value lists

Image Added

Integrity CheckerIntegrity Checker

cross mark
 Calculated Custom Field Values

cross mark
 Automated Steps Library

cross mark
 Integrity of Hierarchical Test Organization

cross mark
License ManagementLicense Information

Image Added

warning cloud  - Available under Global Settings → Manage Apps

Cloud MigrationCloud Migration Pre-Flight Checker

cross mark

(info) - Features

cross mark

Image Modified

(info) - Test Environments

Image Added

warning There is no centralized setting, but it can be edited from an issue screen.


Image Added


(info) - BDD Step Libraries

cross mark

Image Modified

(info) - Cucumber








Cucumber Export PrefixesTestwarning Available in Global Setting → Miscellaneous

Image Modified

Image Added

Image Added

Requirement

Image Added

Cucumber LanguageLanguage

Image Added

Cucumber Export

Image Added

Image Added

Image Added

(info) - Test Run Archiving

Image Modified

warning After Xray 4.9.3 it's already possible to define an auto-archive feature linked to a Test Execution which will also affect the Test Run

Image Added

(info) - Test Case Designer

Add Custom URL

Image Added

warning Available in Global Setting → Xray Enterprise

(info) - Test Case Designer

(info) - API Keys

Create API Keycross mark

(info) - StorageRefresh Storage Usagecross mark

Filterscross mark

Image Added

(info) - Backup

With Attachments

Image Modified

Create Backup(info) - Health CheckReinstall Xray

Image Removed

Workflow & Notifications

Image Removed

Image Removed

Migration & Copy

Image Removed

(error) cloud
Backup

Image Removed

Image Removed

Restore

(error) cloud

Archiving Xray Issues

Image Removed

Image Removed

plus sign cloud Adds new feature:  Auto-Archiving

Storage

Not Applicable

Storage is managed on-premise

Image Removed

plus sign cloud Adds new feature Storage Management

Display the Pre-Conditions section before the Test Details

Image Removed

(error) cloudDisplay Manual Test Results table in short view

Image Removed

Image Removed

plus sign cloud Available under Global by default and per Project after enabling it.

Project admins can configure Test Step Custom Fields

Image Removed

Image Removed

warning cloud  Available by default on project level through Test Step Fields, no longer a Global Setting

Project admins can configure Test Run Custom Fields

Image Removed

Image Removed

warning cloud  Available by default on project level through Test Run Custom Fields, no longer a Global Setting

Set final Test Run status

Image Removed

(error) cloud

Inline Execute Tests

Image Removed

Image Removed

Restrict tests execution to the assignee

Image Removed

(error) cloud

Fail All Steps/Examples                                                

Image Removed

warning Available as a Jira function not only to backup but also to restore/import.

Image Added

Create Backup

Image Added

(info) - Health CheckReinstall Xray
Restrict automated Test status

Image Removed

(error) 

By default, the automated Test status can be set manually.

Can Edit TestRun Dates

Image Removed

Image Removed

warning cloud The setting is available under Project Settings → Miscellaneous

Track Time

Image Removed

Image Removed

Set the value of the Time Tracker

Image Removed

Image Removed

 Enable Test Run Status history log in Test Executions

Image Removed

(error) cloud
Link Defects with Test

Image Removed

Image Removed

Link Defects with Test Execution

Image Removed

Image Removed

Link Defects with Requirement

Image Removed

Image Removed

warning cloud The menu is "Linked Defects with Covered Issues"

User Groups allowed to add Xray Issue Types                              

Image Removed

Image Removed

warning cloud This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)

User Groups allowed to add/remove Xray Notifications

Image Removed

(error) 

Xray Notifications are not available in Cloud.

Final Test Run statuses that may trigger notifications

Image Removed

(error) 

Xray Notifications are not available in Cloud.

 Enable Hierarchical Test organization

Image Removed

(error) cloud

By default is set with Hierarchical Organization

Project Roles allowed the edit Test Repository information

Image Removed

(error) cloud

Anyone with access to the project can edit Test Repo info.

Disallow executions of Tests with workflow statuses

Image Removed

Image Removed

Disallow executions with workflow statuses

Image Removed

Image Removed

In progress test Execution workflow status

Image Removed

(error) cloudResolved Test Execution workflow status

Image Removed

(error) cloudResolution for Resolved Test Execution

Image Removed

(error) cloud
 Associate a cloned Test with all original Test Sets

Image Removed

(error) cloud
 Associate a cloned Test with all original Test Plans

Image Removed

(error) cloud
 Environment

Image Removed

(error) cloud

Although the option does not exist, It behaves with the default linked to "Test"

 Steps to Reproduce

Image Removed

(error) cloud

Version                              

Image Removed

(error) cloud

By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution.

Label

Image Removed

Component

Image Removed

Image Removed

 Enable Automated Steps Library                                    

Image Removed

Validate Cucumber Scenarios

Image Removed

(error) cloudCucumber Export Prefixes                             

Image Removed

Cucumber Language

Image Removed

Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags

Image Removed

Generate features by requirements

Image Removed

Cucumber export feature name

Image Removed

 Enable Document Generator

Image Removed

Max number of issues that can be exported

Image Removed

(error) cloudMax number of requirements per report or gadget

Image Removed

(error) cloudMaximum number of Links added to a Requirement

Image Removed

(error) cloudTest Evolution Tests Limit

Image Removed

(error) cloudTest Evolution Test Executions Limit

Image Removed

(error) cloudTest Runs list limit

Image Removed

(error) cloudTests per Test Plan Maximum allowed

Image Removed

(error) cloud
 Xray REST API - Max results per request

Image Removed

(error) cloud
Associating a Test Execution to a Test Plan and importing Test results

Image Removed

(error) cloudMax Test Runs for bulk operations

Image Removed

(error) cloudMaximum size for parameter values

Image Removed

(error) cloud
 Enable Xray Exploratory App execution links

Image Removed

(error) cloud
 Enable Xray Analytics

Image Removed

(error) cloud
Thread Pool Size

Image Removed

(error) cloudEnable In-app Chat Support

Image Removed

Image Removed

Enable Xray notifications

Image Removed

Image Removed

 Show Xray notifications button

Image Removed

Image Removed

Test Environmentscross mark

Image Removed

plus sign cloud Possible to manage at a Global level & project level.

Automated / BDD Step Libraries

warning

Not available as a Global setting, only as a project setting under the name "Automated Step Library"

Image Removed

plus sign cloud Possible to manage at a Global level.

Parameter value lists

Image Removed

Image Removed

Cucumber

Image Removed

plus sign cloud
Test Run ArchivingAuto Archiving

warning

Ability to manually archive Test Runs

Image Removed

plus sign cloud

Adds Auto Archive Feature

API Keys

Not Applicable

Access levels are managed on-premise

Image Removed

Storage

Not Applicable

storage is managed on-premise

Image Removed

Health Checkcross mark

Image Removed

Features
cross mark

Image Modified


Document Generator Templates
Add
UI Expand
titleProject Level Settings
Setting

ServerCloud
Test Step Custom Fields

Create

Image Modified

Image Modified

Test Run Custom Fields

Create

Image Modified

Image Modified

Parameter values lists

Add Global List

Image Modified

Image Modified

Create List

Image Modified

Image Modified

Remote Jobs
Trigger
Trigger

Image Added

Image Added

Document GeneratorDocument Generator Templates

Add

Image Added

Image Added

Store

Image Modified

Image Modified

Disable Xray Requirement Coverage

Image Added

cross mark

Import Automated Steps
Document Generator

Image Modified

Image Modified

Store

warning cloud  - Available under Global Settings → BDD Steps Library

Disable Xray Notifications

Image Modified

Image Removed

cross mark

(info) - Summary

 

Add Xray Issue Types in Project

Image Added

warning Available through the action button located on the top right corner after accessing Project Settings.

Image Modified

(info) - Miscellaneous


Image Modified


Image Modified


Image Modified


Image Modified


Image Modified


Image Modified


Image Modified



Image Modified


Image Modified


Image Modified

Choose the workflow statuses in which the Tests are not allowed to be executed.


Image Modified

Choose the workflow statuses in which the Test Execution issues will not allow executing Tests.


Image Modified

Defect Default Values


Image Modified


Image Modified

(info) - Test Coverage
Test Coverage
Available Issue Types


Image Modified

Coverable Issue Types


Image Modified



Image Modified


Image Modified


Image Modified

Issue Link Type Direction


Image Modified

(info) - Defect Mapping
Available Issue Types


Image Modified

Defect Issue Types


Image Modified

(info) - Test Types

Add New Test Type Option


Image Modified

(info) - Test Environments


Project Test EnvironmentsAdd Environment


Image Modified

Create Environment


Image Modified

SettingsCreate Inline Test Environments


Image Modified

(info) - BDD Step Library

Quoted strings e.g. "red", "blue"


Image Modified

Numbers e.g. 355, 2.3


Image Modified

Enums e.g. LEFT, RIGHT, CENTER


Image Modified

Permissions


Image Modified

(info) - Default Column Layouts
Test

Image Modified


Image Modified


Image Modified


Image Modified

Test Execution


Image Modified

Pre Condition


Image Modified

Test Set


Image Modified

Test Plan


Image Modified


Image Modified


Image Modified

(info) - Re-IndexingRe-Index


Image Modified


Understand the icons: 

warning cloud - Available in Xray Cloud but with some differences or minor UI adjustments

...