Display the Pre-Conditions section before the Test Details
Image Added
Display Manual Test Results table in short view
Image Added
Image Added
Available under Global by default and per Project after enabling it.
Project admins can configure Test Step Custom Fields
Image Added
Image Added
Available by default on project level through Test Step Fields, no longer a Global Setting
Custom Fields Configuration
Project admins can configure Test Run Custom Fields
Image Added
Image Added
Available by default on project level through Test Run Custom Fields, no longer a Global Setting
Test Run Options
Set final Test Run status
Image Added
Inline Execute Tests
Image Added
Image Added
Restrict test execution to the assignee
Image Added
Fail All Steps/Examples
Image Added
Image Added
Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.
Restrict automated Test status
Image Added
By default, the automated Test status can be set manually.
Can Edit TestRun Dates
Image Added
Image Added
The setting is available under Project Settings → Miscellaneous
Track Time
Image Added
Image Added
Set the value of the Time Tracker
Image Added
Image Added
Enable Test Run Status history log in Test Executions
Image Added
Defect Links
Link Defects with Test
Image Added
Image Added
Link Defects with Test Execution
Image Added
Image Added
Link Defects with Requirement
Image Added
Image Added
The menu is "Linked Defects with Covered Issues"
User Groups allowed to add Xray Issue Types
Image Added
Image Added
This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)
Notifications
User Groups allowed to add/remove Xray Notifications
Image Added
Xray Notifications are not available in Cloud.
Final Test Run statuses that may trigger notifications
Image Added
Xray Notifications are not available in Cloud.
Hierarchical Test Organization
Enable Hierarchical Test organization
Image Added
By default is set with Hierarchical Organization
Project Roles allowed the edit Test Repository information
Image Added
Anyone with access to the project can edit Test Repo info.
Workflow Status
Disallow executions of Tests with workflow statuses
Image Added
Image Added
Disallow executions with workflow statuses
Image Added
Image Added
In progress test Execution workflow status
Image Added
Resolved Test Execution workflow status
Image Added
Resolution for Resolved Test Execution
Image Added
Clone Issues
Associate a cloned Test with all original Test Sets
Image Added
Associate a cloned Test with all original Test Plans
Image Added
Defect Default Values
Environment
Image Added
Although the option does not exist, It behaves with the default linked to "Test"
Steps to Reproduce
Image Added
Version
Image Added
By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution.
Label
Image Added
Image Added
Component
Image Added
Image Added
Automated Steps Library
Enable Automated Steps Library
Image Added
Validate Cucumber Scenarios
Image Added
Cucumber Export Prefixes
Test
Image Added
Image Added
Available under Global Settings → Cucumber" but unable to create a prefix for a Test Plan.
Pre-Condition
Test Set
Test Plan
Requirement
Cucumber Language
Language
Image Added
Image Added
Setting moved to a dedicated option in the menu tab: Global Settings → Cucumber
Cucumber Export
Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags
Image Added
Generate features by requirements
Image Added
Cucumber export feature name
Image Added
Document Generator
Enable Document Generator
Image Added
Image Added
Available under Global Settings Miscellaneous & Feature
Max number of issues that can be exported
Image Added
Requirements Reports
Max number of requirements per report or gadget
Image Added
Requirements Tests
Maximum number of Links added to a Requirement
Image Added
Gadgets
Test Evolution Tests Limit
Image Added
Test Evolution Test Executions Limit
Image Added
Test Runs list limit
Image Added
Tests per Test Plan
Tests per Test Plan Maximum allowed
Image Added
Xray REST API
Xray REST API - Max results per request
Image Added
Associating a Test Execution to a Test Plan and importing Test results
Image Added
Bulk operations
Max Test Runs for bulk operations
Image Added
Datasets
Maximum size for parameter values
Image Added
Xray Exploratory App
Enable Xray Exploratory App execution links
Image Added
Usage Metrics
Enable Xray Analytics
Image Added
Thread Pool Size
Thread Pool Size
Image Added
Chat Support
Enable In-app Chat Support
Image Added
Image Added
Notifications
Enable Xray notifications
Image Added
Image Added
Show Xray notifications button
Image Added
Image Added
Custom Fields
Custom Fields
Test Run Status Custom Field Version
Image Modified
Configuration not available on Cloud, so it behaves like "No Version" is selected
Test Set Status Custom Field Version
Image Modified
Requirement Status Custom Field Versions
Image Modified
(note: behaves like "No Version" is selected)
Maintenance -
Maintenance
Recalculate Requirement Status
Image Modified
?
Test Types
Manage Test Types
Manage Test Type
Image Added
Available under "Global Settings – Test Types" and "Project Settings – Test Types".
In Xray Cloud it's not possible to set different Test Types to Test & Precondition, meaning that it applies to both issue types. Learn more <link>
Manager Pre-Condition Type
Image Added
Xray Enterprise
Xray Enterprise Settings
Xray Test Case Designer
Image Added
Issue Type Mapping
Issue Type Mapping
Available Issue Types
Requirement Issue Types
Defect Issue Types
Sub-Requirements
Sub-Tasks/Links
Epic - Story relation as a Requirement
Issue Link Type
Requirement Coverage
Requirement Coverage Strategy
Ignore Requirements with Status
Ignore Requirements with Label
Ignore Tests with Status
Separation of concerns
Include Previous Version Requirements
Show Flatten Requirements
Document Generator
Document Generator Templates
Requirement Projects
Test Statuses
Test Statuses
Manage custom Test Run statuses for Xray
Preferences
Test Step Statuses
Manage custom Test Step statuses for Xray
Default Column Layouts
Test Execution TestRun Columns
Parameter value lists
Integrity Checker
Integrity Checker
Calculated Custom Field Values
Automated Steps Library
Integrity of Hierarchical Test Organization
License Management
License Information
Cloud Migration
Cloud Migration Pre-Flight Checker
Xray Linking Restrictions
Image Modified
Manage Test Types
Manage Test Type
Image Modified
Available under "Global Settings – Test Types" and "Project Settings – Test Types".
In Xray Cloud it's not possible to set different Test Types to Test & Precondition, meaning that it applies to both issue types. Learn more <link>
Manager Pre-Condition Type
Image Modified
Coverage & Defects Configuration
Image Modified
Image Modified
Available under Project Configuration → Test Coverage & Defects Mapping, meaning that you can change your setting per project.
Sub-Requirements
Image Modified
?
Workflow & Notifications
Image Modified
Image Modified
Migration & Copy
Image Modified
Backup & Restore
Backup
Image Modified
Image Modified
Restore
Xray in-App Notifications
Image Modified
Image Modified
Archiving Xray Issues
Image Modified
Image Modified
Adds new feature: Auto-Archiving
Storage
Not Applicable
Storage is managed on-premise
Image Modified
Adds new feature Storage Management
Miscellaneous Settings
Display the Pre-Conditions section before the Test Details
Image Modified
Display Manual Test Results table in short view
Image Modified
Image Modified
Available under Global by default and per Project after enabling it.
Project admins can configure Test Step Custom Fields
Image Modified
Image Modified
Available by default on project level through Test Step Fields, no longer a Global Setting
Project admins can configure Test Run Custom Fields
Image Modified
Image Modified
Available by default on project level through Test Run Custom Fields, no longer a Global Setting
Set final Test Run status
Image Modified
Inline Execute Tests
Image Modified
Image Modified
Restrict tests execution to the assignee
Image Modified
Fail All Steps/Examples
Image Modified
Image Modified
Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.
Restrict automated Test status
Image Modified
By default, the automated Test status can be set manually.
Can Edit TestRun Dates
Image Modified
Image Modified
The setting is available under Project Settings → Miscellaneous
Track Time
Image Modified
Image Modified
Set the value of the Time Tracker
Image Modified
Image Modified
Enable Test Run Status history log in Test Executions
Image Modified
Link Defects with Test
Image Modified
Image Modified
Link Defects with Test Execution
Image Modified
Image Modified
Link Defects with Requirement
Image Modified
Image Modified
The menu is "Linked Defects with Covered Issues"
User Groups allowed to add Xray Issue Types
Image Modified
Image Modified
This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)
User Groups allowed to add/remove Xray Notifications
Image Modified
Xray Notifications are not available in Cloud.
Final Test Run statuses that may trigger notifications
Image Modified
Xray Notifications are not available in Cloud.
Enable Hierarchical Test organization
Image Modified
By default is set with Hierarchical Organization
Project Roles allowed the edit Test Repository information
Image Modified
Anyone with access to the project can edit Test Repo info.
Disallow executions of Tests with workflow statuses
Image Modified
Image Modified
Disallow executions with workflow statuses
Image Modified
Image Modified
In progress test Execution workflow status
Image Modified
Resolved Test Execution workflow status
Image Modified
Resolution for Resolved Test Execution
Image Modified
Associate a cloned Test with all original Test Sets
Image Modified
Associate a cloned Test with all original Test Plans
Image Modified
Environment
Image Modified
Although the option does not exist, It behaves with the default linked to "Test"
Steps to Reproduce
Image Modified
Version
Image Modified
By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution.
Label
Image Modified
Image Modified
Component
Image Modified
Image Modified
Enable Automated Steps Library
Image Modified
Validate Cucumber Scenarios
Image Modified
Cucumber Export Prefixes
Image Modified
Image Modified
Available under Global Settings → Cucumber" but unable to create a prefix for a Test Plan.
Cucumber Language
Image Modified
Image Modified
Setting moved to a dedicated option in the menu tab: Global Settings → Cucumber
Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags
Image Modified
Generate features by requirements
Image Modified
Cucumber export feature name
Image Modified
Enable Document Generator
Image Modified
Image Modified
Available under Global Settings Miscellaneous & Feature
Max number of issues that can be exported
Image Modified
Max number of requirements per report or gadget
Image Modified
Maximum number of Links added to a Requirement
Image Modified
Test Evolution Tests Limit
Image Modified
Test Evolution Test Executions Limit
Image Modified
Test Runs list limit
Image Modified
Tests per Test Plan Maximum allowed
Image Modified
Xray REST API - Max results per request
Image Modified
Associating a Test Execution to a Test Plan and importing Test results
Image Modified
Max Test Runs for bulk operations
Image Modified
Maximum size for parameter values
Image Modified
Enable Xray Exploratory App execution links
Image Modified
Enable Xray Analytics
Image Modified
Thread Pool Size
Image Modified
Enable In-app Chat Support
Image Modified
Image Modified
Enable Xray notifications
Image Modified
Image Modified
Show Xray notifications button
Image Modified
Image Modified
Test Environments
Image Modified
Possible to manage at a Global level & project level.
Automated / BDD Step Libraries
Not available as a Global setting, only as a project setting under the name "Automated Step Library"
Image Modified
Possible to manage at a Global level.
Parameter value lists
Image Removed
Image Removed
Test Statuses
Image Removed
Image Removed
Test Step Statuses
Image Modified
Image Modified
Cucumber
Image Modified
Test Run Archiving
Auto Archiving
Ability to manually archive Test Runs
Image Modified
Adds Auto Archive Feature
API Keys
Not Applicable
Access levels are managed on-premise
Image Modified
Storage
Not Applicable
storage is managed on-premise
Image Modified
Health Check
Image Modified
Features
Feature Toggling
Image Modified
UI Expand
title
Project Level Settings
Setting
Server
Cloud
Project Organization
Configuring Xray Test Project
Available under "Project Configuration → Summary"
Requirements per Project
Requirement Coverage Strategy
Available under "Project Configuration → Test Coverage & Defects Mapping"
Ignore Requirements with Status
Ignore Requirements with Label
Ignore Tests with Status
Requirement Historical Chart Days
Include Previous Version Requirements
Show Flatten Requirements
Separation of concerns
Configure Xray with an existent Project
Available under "Project Configuration → Summary"
Using Xray Template
Agile Boards
Available with limitations. We are only able to use 3 Xray Custom Fields, we are unable to showcase the "Requirement Status" field (one of the most used in DC/Server)
Permissions
(Permissions are Jira wise)
Summary
Not Applicable
Issue Types Mapping
Not Applicable
Only Available for Team Managed Projects
Test Coverage
Available under the name Issue Type Mapping
Defect Mapping
Test Types
Test Environments
Ability to manage Test Environment at a project level.
BDD Step Library
Available under the name "Automated Steps Library"
Test Step Fields
Available under Project Settings → Test Step Custom Fields
Test Run Custom Fields
Available under Project Settings → Test Run Custom Fields