Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

UI Expand
titleGlobal Level Settings

Xray Global Settings

Group
Section
Setting

Xray Server/ DC

(Standard & Enterprise)

Xray Cloud

(Standard & Enterprise)

Miscellaneous Settings

The Global Configurations for Xray.


Display the Pre-Conditions section before the Test Details

Image Added

(error) cloud
Display Manual Test Results table in short view

Image Added

Image Added

plus sign cloud Available under Global by default and per Project after enabling it.

Project admins can configure Test Step Custom Fields

Image Added

Image Added

warning cloud  Available by default on project level through Test Step Fields, no longer a Global Setting

Custom Fields Configuration
 
Project admins can configure Test Run Custom Fields

Image Added

Image Added

warning cloud  Available by default on project level through Test Run Custom Fields, no longer a Global Setting

Test Run OptionsSet final Test Run status

Image Added

(error) cloud

Inline Execute Tests

Image Added

Image Added

Restrict test execution to the assignee

Image Added

(error) cloud

Fail All Steps/Examples                                                

Image Added

Image Added


warning cloud Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.

Restrict automated Test status

Image Added

(error) 

By default, the automated Test status can be set manually.

Can Edit TestRun Dates

Image Added

Image Added

warning cloud The setting is available under Project Settings → Miscellaneous

Track Time

Image Added

Image Added

Set the value of the Time Tracker

Image Added

Image Added

Enable Test Run Status history log in Test Executions

Image Added

(error) cloud
Defect LinksLink Defects with Test

Image Added

Image Added

Link Defects with Test Execution

Image Added

Image Added

Link Defects with Requirement

Image Added

Image Added

warning cloud The menu is "Linked Defects with Covered Issues"

User Groups allowed to add Xray Issue Types

Image Added

Image Added

warning cloud This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)

NotificationsUser Groups allowed to add/remove Xray Notifications

Image Added

(error) 

Xray Notifications are not available in Cloud.

Final Test Run statuses that may trigger notifications

Image Added

(error) 

Xray Notifications are not available in Cloud.

Hierarchical Test OrganizationEnable Hierarchical Test organization

Image Added

(error) cloud

By default is set with Hierarchical Organization

Project Roles allowed the edit Test Repository information

Image Added

(error) cloud

Anyone with access to the project can edit Test Repo info.

Workflow StatusDisallow executions of Tests with workflow statuses

Image Added

Image Added

Disallow executions with workflow statuses

Image Added

Image Added

In progress test Execution workflow status

Image Added

(error) cloud
Resolved Test Execution workflow status

Image Added

(error) cloud
Resolution for Resolved Test Execution

Image Added

(error) cloud
Clone IssuesAssociate a cloned Test with all original Test Sets

Image Added

(error) cloud
Associate a cloned Test with all original Test Plans

Image Added

(error) cloud
Defect Default ValuesEnvironment

Image Added

(error) cloud

Although the option does not exist, It behaves with the default linked to "Test"

Steps to Reproduce

Image Added

(error) cloud

Version                              

Image Added

(error) cloud

By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution.

Label

Image Added


Image Added


Component

Image Added

Image Added

Automated Steps LibraryEnable Automated Steps Library                                    

Image Added

(error) cloud


Validate Cucumber Scenarios

Image Added

(error) cloud
Cucumber Export PrefixesTest

Image Added

Image Added


warning cloud Available under Global Settings → Cucumber" but unable to create a prefix for a Test Plan.

Pre-Condition



Test Set



Test Plan



Requirement



Cucumber LanguageLanguage

Image Added

Image Added


warning cloud Setting moved to a dedicated option in the menu tab: Global Settings → Cucumber

Cucumber ExportReplace dash [ - ] with underscore [ _ ] when exporting issue keys as tags

Image Added

Generate features by requirements

Image Added

Cucumber export feature name

Image Added

Document GeneratorEnable Document Generator

Image Added

Image Added


warning cloud Available under Global Settings Miscellaneous & Feature

Max number of issues that can be exported

Image Added

(error) cloud
Requirements ReportsMax number of requirements per report or gadget

Image Added

(error) cloud
Requirements TestsMaximum number of Links added to a Requirement

Image Added

(error) cloud
GadgetsTest Evolution Tests Limit

Image Added

(error) cloud
Test Evolution Test Executions Limit

Image Added

(error) cloud
Test Runs list limit

Image Added

(error) cloud
Tests per Test PlanTests per Test Plan Maximum allowed

Image Added

(error) cloud
Xray REST APIXray REST API - Max results per request

Image Added

(error) cloud
Associating a Test Execution to a Test Plan and importing Test results

Image Added

(error) cloud
Bulk operationsMax Test Runs for bulk operations

Image Added

(error) cloud
DatasetsMaximum size for parameter values

Image Added

(error) cloud
Xray Exploratory AppEnable Xray Exploratory App execution links

Image Added

(error) cloud
Usage MetricsEnable Xray Analytics

Image Added

(error) cloud
Thread Pool SizeThread Pool Size

Image Added

(error) cloud
Chat SupportEnable In-app Chat Support

Image Added

Image Added

NotificationsEnable Xray notifications

Image Added

Image Added

Show Xray notifications button

Image Added

Image Added

Custom FieldsCustom FieldsTest Run Status Custom Field Version

Image Modified

(error) 

Configuration not available on Cloud, so it behaves like "No Version" is selected

Test Set Status Custom Field Version

Image Modified

(error) cloud
Requirement Status Custom Field Versions

Image Modified

(error) cloud

(note: behaves like "No Version" is selected)

Maintenance -
 MaintenanceRecalculate Requirement Status

Image Modified

?

Test TypesManage Test TypesManage Test Type

Image Added

warning cloud

Available under "Global Settings – Test Types" and "Project Settings – Test Types". 

In Xray Cloud it's not possible to set different Test Types to Test & Precondition, meaning that it applies to both issue types. Learn more <link>

Manager Pre-Condition Type

Image Added

Xray EnterpriseXray Enterprise SettingsXray Test Case Designer

Image Added


Issue Type Mapping
Issue Type MappingAvailable Issue Types



Requirement Issue Types



Defect Issue Types



Sub-RequirementsSub-Tasks/Links



Epic - Story relation as a Requirement



Issue Link Type





Requirement Coverage
Requirement Coverage Strategy



Ignore Requirements with Status



Ignore Requirements with Label



Ignore Tests with Status



 

 Separation of concerns

 Include Previous Version Requirements

 Show Flatten Requirements

Document GeneratorDocument Generator Templates

Requirement Projects

Test Statuses

Test Statuses

Manage custom Test Run statuses for Xray

Preferences

Test Step Statuses

Manage custom Test Step statuses for Xray



Default Column LayoutsTest Execution TestRun Columns

























Parameter value lists

Integrity CheckerIntegrity Checker

 Calculated Custom Field Values

 Automated Steps Library

 Integrity of Hierarchical Test Organization

License ManagementLicense Information

Cloud MigrationCloud Migration Pre-Flight Checker















































































































Xray Linking Restrictions

Image Modified

(error) cloud
Manage Test Types
Manage Test Type

Image Modified

warning cloud

Available under "Global Settings – Test Types" and "Project Settings – Test Types". 

In Xray Cloud it's not possible to set different Test Types to Test & Precondition, meaning that it applies to both issue types. Learn more <link>


Manager Pre-Condition Type

Image Modified

Coverage & Defects Configuration

Image Modified

 Image Modified

warning cloud Available under Project Configuration → Test Coverage & Defects Mapping, meaning that you can change your setting per project. 

Sub-Requirements

Image Modified

?

Workflow & Notifications

Image Modified

Image Modified

Migration & Copy

Image Modified

(error) cloud
Backup & Restore


Backup

Image Modified

Image Modified


Restore

(error) cloud

Xray in-App Notifications

Image Modified

Image Modified

Archiving Xray Issues

Image Modified

Image Modified

plus sign cloud Adds new feature:  Auto-Archiving

Storage

Not Applicable

Storage is managed on-premise

Image Modified

plus sign cloud Adds new feature Storage Management

Miscellaneous Settings


Display the Pre-Conditions section before the Test Details

Image Modified

(error) cloud

Display Manual Test Results table in short view

Image Modified

Image Modified

plus sign cloud Available under Global by default and per Project after enabling it.


Project admins can configure Test Step Custom Fields

Image Modified

Image Modified

warning cloud  Available by default on project level through Test Step Fields, no longer a Global Setting


Project admins can configure Test Run Custom Fields

Image Modified

Image Modified

warning cloud  Available by default on project level through Test Run Custom Fields, no longer a Global Setting


Set final Test Run status

Image Modified

(error) cloud


Inline Execute Tests

Image Modified

Image Modified


Restrict tests execution to the assignee

Image Modified

(error) cloud


Fail All Steps/Examples                                                

Image Modified

Image Modified


warning cloud Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.


Restrict automated Test status

Image Modified

(error) 

By default, the automated Test status can be set manually.


Can Edit TestRun Dates

Image Modified

Image Modified

warning cloud The setting is available under Project Settings → Miscellaneous


Track Time

Image Modified

Image Modified


Set the value of the Time Tracker

Image Modified

Image Modified

 Enable Test Run Status history log in Test Executions

Image Modified

(error) cloud

Link Defects with Test

Image Modified

Image Modified


Link Defects with Test Execution

Image Modified

Image Modified


Link Defects with Requirement

Image Modified

Image Modified

warning cloud The menu is "Linked Defects with Covered Issues"


User Groups allowed to add Xray Issue Types                              

Image Modified

Image Modified

warning cloud This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)


User Groups allowed to add/remove Xray Notifications

Image Modified

(error) 

Xray Notifications are not available in Cloud.


Final Test Run statuses that may trigger notifications

Image Modified

(error) 

Xray Notifications are not available in Cloud.

 Enable Hierarchical Test organization

Image Modified

(error) cloud

By default is set with Hierarchical Organization


Project Roles allowed the edit Test Repository information

Image Modified

(error) cloud

Anyone with access to the project can edit Test Repo info.


Disallow executions of Tests with workflow statuses

Image Modified

Image Modified


Disallow executions with workflow statuses

Image Modified

Image Modified


In progress test Execution workflow status

Image Modified

(error) cloud

Resolved Test Execution workflow status

Image Modified

(error) cloud

Resolution for Resolved Test Execution

Image Modified

(error) cloud
 Associate a cloned Test with all original Test Sets

Image Modified

(error) cloud
 Associate a cloned Test with all original Test Plans

Image Modified

(error) cloud
 Environment

Image Modified

(error) cloud

Although the option does not exist, It behaves with the default linked to "Test"

 Steps to Reproduce

Image Modified

(error) cloud


Version                              

Image Modified

(error) cloud

By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution.


Label

Image Modified


Image Modified



Component

Image Modified

Image Modified

 Enable Automated Steps Library                                    

Image Modified

(error) cloud



Validate Cucumber Scenarios

Image Modified

(error) cloud

Cucumber Export Prefixes                             

Image Modified

Image Modified


warning cloud Available under Global Settings → Cucumber" but unable to create a prefix for a Test Plan.


Cucumber Language

Image Modified

Image Modified


warning cloud Setting moved to a dedicated option in the menu tab: Global Settings → Cucumber


Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags

Image Modified


Generate features by requirements

Image Modified


Cucumber export feature name

Image Modified

 Enable Document Generator

Image Modified

Image Modified


warning cloud Available under Global Settings Miscellaneous & Feature


Max number of issues that can be exported

Image Modified

(error) cloud

Max number of requirements per report or gadget

Image Modified

(error) cloud

Maximum number of Links added to a Requirement

Image Modified

(error) cloud

Test Evolution Tests Limit

Image Modified

(error) cloud

Test Evolution Test Executions Limit

Image Modified

(error) cloud

Test Runs list limit

Image Modified

(error) cloud

Tests per Test Plan Maximum allowed

Image Modified

(error) cloud
 Xray REST API - Max results per request

Image Modified

(error) cloud

Associating a Test Execution to a Test Plan and importing Test results

Image Modified

(error) cloud

Max Test Runs for bulk operations

Image Modified

(error) cloud

Maximum size for parameter values

Image Modified

(error) cloud
 Enable Xray Exploratory App execution links

Image Modified

(error) cloud
 Enable Xray Analytics

Image Modified

(error) cloud

Thread Pool Size

Image Modified

(error) cloud

Enable In-app Chat Support

Image Modified

Image Modified


Enable Xray notifications

Image Modified

Image Modified

 Show Xray notifications button

Image Modified

Image Modified

Test Environmentscross mark

Image Modified

plus sign cloud Possible to manage at a Global level & project level.

Automated / BDD Step Libraries

warning

Not available as a Global setting, only as a project setting under the name "Automated Step Library"

Image Modified

plus sign cloud Possible to manage at a Global level.

Parameter value lists

Image Removed

Image Removed

Test Statuses

Image Removed

Image Removed

Test Step Statuses

Image Modified

Image Modified

Cucumber

Image Modified

plus sign cloud
Test Run Archiving
Auto Archiving

warning

Ability to manually archive Test Runs

Image Modified

plus sign cloud

Adds Auto Archive Feature

API Keys

Not Applicable

Access levels are managed on-premise

Image Modified

Storage

Not Applicable

storage is managed on-premise

Image Modified

Health Checkcross mark

Image Modified

Features
Feature Togglingcross mark

Image Modified


UI Expand
titleProject Level Settings
Setting
ServerCloud
Project Organization

Configuring Xray Test Project

warning cloud

cloudAvailable under "Project Configuration → Summary"

Requirements per ProjectRequirement Coverage Strategy

warning cloud

Available under "Project Configuration → Test Coverage & Defects Mapping"

Ignore Requirements with Status


Ignore Requirements with Label


Ignore Tests with Status


Requirement Historical Chart Days


Include Previous Version Requirements


Show Flatten Requirements


Separation of concerns

(error) cloud
Configure Xray with an existent Project

warningcloud

Available under "Project Configuration → Summary"

Using Xray Template

(error) cloud
Agile Boards

warning cloud

Available with limitations. We are only able to use 3 Xray Custom Fields, we are unable to showcase the "Requirement Status" field (one of the most used in DC/Server)

Permissions

(error) cloud

(Permissions are Jira wise)

SummaryNot Applicable

Issue Types MappingNot ApplicableOnly Available for Team Managed Projects
Test Coverage

warning

Available under the name Issue Type Mapping

Defect Mapping

Test Types

Test Environmentscross mark


plus sign cloud Ability to manage Test Environment at a project level.

BDD Step LibraryAvailable under the name "Automated Steps Library"

Test Step Fields

warningcloud Available under Project Settings → Test Step Custom Fields

Test Run Custom Fields

warningcloud Available under Project Settings → Test Run Custom Fields

Parameter value lists

Default Column LayoutsTest Execution TestRun Columns

Test TestRun Columns

Test PreCondition Columns

Test Test Set Columns

Test Test Plan Columns

Test Set Test Columns

Test Plan Test Columns

Test Plan Test Execution Columns

Test Coverage Columns

(error) cloud
Project Test Columns

(error) cloud
Project Test Set Columns

Project Test Execution Columns

Project Test Plan Columns

Precondition Tests Columns

Re-Indexing

...