Page History

Versions Compared

Old Version 33

changes.mady.by.user Francisco Fonseca

Saved on Oct 24, 2024

compared with

New Version Current

changes.mady.by.user Francisco Fonseca

Saved on May 08, 2025

Key

This line was added.
This line was removed.
Formatting was changed.

...

This article explains in deep detail the differences between Xray Server/DC & Xray Cloud Administration & Configuration .

...

Global Settings - Xray settings that apply to all projects that use Xray. Global settings could be access by Jira Administration > Apps.

Tip
At Xray, you can override global settings and enable them as Project Settings.

Project Settings - Xray settings that are aplicable to one specific project. In case of you need to replicate the setting per several projects, you need to apply the configuration to all projects that need the same setting. Xray Projects Settings are accessible at Project > Project Settings.

...

Find a comparison view of the settings and features in Server / DC vs Cloud about Administration & Configuration on the above table.

...

UI Expand

title	Global Level Settings

Unable & Defects Mapping, meaning that you Set ColumnsBackup & Restore
Miscellaneous Settings

Image Removed

Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.

Image Removed

Available under Global Settings → Cucumber" but unable to create a prefix for a Test Plan.

Image Removed

Setting moved to a dedicated option in the menu tab: Global Settings → Cucumber

Image Removed

Available under Global Settings Miscellaneous & Feature

Xray Global Settings	Group	Setting	Xray Server/ DC (Standard & Enterprise)	Xray Cloud (Standard & Enterprise)
Miscellaneous Settings	The Global Configurations for Xray.	Display the Pre-Conditions section before the Test Details
		Display Manual Test Results table in short view		Available under Global by default and per Project after enabling it.
		Project admins can configure Test Step Custom Fields		Available by default on the project level through Test Step Fields, no longer a Global Setting
		Project admins can configure Test Run Custom Fields		Available by default on the project level through Test Run Custom Fields, no longer a Global Setting
	Test Run Options	Set final Test Run status
		Inline Execute Tests
		Restrict test execution Test Execution to the assignee
		Fail All Steps/Examples		Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.
		Restrict automated Test status		- By default, the automated Test status can be set manually.
		Can Edit TestRun Dates		The setting is available under Project Settings → Miscellaneous
		Track Time
		Set the value of the Time Tracker
		Enable Test Run Status history log in Test Executions
	Defect Links	Link Defects with Test
		Link Defects with Test Execution
		Link Defects with Requirement		The menu is "Linked Defects with Covered Issues"
	User Groups allowed to add Xray Issue Types			This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)
	Notifications	User Groups allowed to add/remove Xray Notifications		- Xray Notifications (Xray Events) are not available in the Cloud.
	Notifications	Final Test Run statuses that may trigger notifications
	Hierarchical Test Organization	Enable Hierarchical Test organization		- By By default is set with Hierarchical Organization, meaning that Test Repository & Test Plan Board is available from the sidebar. You are not able to disable it.
	Hierarchical Test Organization	Project Roles allowed the edit Test Repository information		- Anyone with access to the project can edit Test Repo info.
	Workflow Status	Disallow executions of Tests with workflow statuses
		Disallow executions with workflow statuses
		In progress test Execution workflow status
		Resolved Test Execution workflow status
		Resolution for Resolved Test Execution
	Clone Issues	Associate a cloned Test with all original Test Sets
	Clone Issues	Associate a cloned Test with all original Test Plans
	Defect Default Values	Environment		- Although the option does not exist, It behaves with the default linked to "Test"By default, when creating a defect, it inherits the environment set before the Test Run.
		Steps to Reproduce		- By default the steps are included in the Defect. Your are not able to disable this behaviour.
		Version		- By default it behaves as , the defect’s Affect Version field of the defects created in the context of a test run will be populated by the FixVersion value of is populated with the value of the FixVersion field of the Test Execution.
		Label
		Component
	Automated Steps Library	Enable Automated Steps Library		- Automated Steps Library is enabled by default. You are not able to disable it.
	Automated Steps Library	Validate Cucumber Scenarios
	Cucumber Export Prefixes	Test		Image Modified - Available under Global Settings → Cucumber".	- Unable to create a prefix for a Test Plan.
		Pre-Condition
		Test Set
		Test Plan
		Requirement
	Cucumber Language	Language	Image Added	Image Modified - Available under Global Settings → Cucumber".
	Cucumber Export	Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags	Image Added	Image Modified - Available under Global Settings → Cucumber".
		Generate features by requirements		Image Added - Available under Global Settings → Cucumber".
		Cucumber Cucumber export feature name		- Only available the possibility to "Generate feature file name using summary", under Global Settings → Cucumber".
	Document Generator	Enable Document Generator		Available under Global Settings Miscellaneous & Feature→ Features
	Document Generator	Max number of issues that can be exported
	Requirements Reports	Max number of requirements per report or gadget
	Requirements Tests	Maximum number of Links added to a Requirement
	Gadgets	Test Evolution Tests Limit
		Test Evolution Test Executions Limit
		Test Runs list limit
	Tests per Test Plan	Tests per Test Plan Maximum allowed
	Xray REST API	Xray REST API - Max results per request
	Xray REST API	Associating a Test Execution to a Test Plan and importing Test results
	Bulk operations	Max Test Runs for bulk operations
	Datasets	Maximum size for parameter values
	Xray Exploratory App	Enable Xray Exploratory App execution links		- By default within the context of a Test Run, you have available a button which allows you to "Execute with Exploratory App"
	Usage Metrics	Enable Xray	Usage Metrics	Enable Xray Analytics		- By default, Xray Analytics is enabled. You are not able to disable it.
	Thread Pool Size	Thread Pool Size
	Chat Support	Enable In-app Chat Support
	Notifications	Enable Xray notifications		Available under Global Settings → Features
	Notifications	Show Xray notifications button	Image Removed
Custom Fields	Custom Fields	Test Run Status Custom Field Version		- By default, it will behave as if "No Version" is selected.
		Test Set Status Custom Field Version		- By default, it will behave as if "No Version" is selected.
		Requirement Status Custom Field Versions
	Maintenance	Recalculate Requirement Status	Image Removed
- By default, it will behave as if "No Version" is selected.
Maintenance	Recalculate Requirement Status	Image Added	Test Types	Manage Test Types	Manage Test Type	Image Modified	Available "Re-indexing" at Project Settings, this will recalculate the requirement status for a specific project.
Permissions		Xray Test Repository Permissions	Test Types	Manage Test Types	Image Added (under Issues > Permission Schemes)
Test Types	Manage Test Types	Manage Test Type	Image Added	Image Added - Available under "Global Settings – Test Types" and "Project Settings – Test Types". - In Xray Cloud it under "Global Settings – Test Types" and "Project Settings – Test Types". In Xray Cloud it 's not possible to set different Test Types to Test & Precondition, meaning that it applies to both issue types. Learn more <link> more Changing the Type of a Test
Test Types	Manage Test Types	Manager Pre-Condition Type
Xray Enterprise	Xray Enterprise Settings	Xray Test Case Designer	Image Added	Image Modified - Available under "Global Settings – Test Case Designer
Issue Type Mapping	Issue Type Mapping	Available Requirement Issue Types		Image Modified - Available under Project Configuration → Test Coverage	. Requirement Issue Issues are named Coverable Issue Issues in Xray Cloud. - You can change your setting per project. Requirement Issue Types	Image Removed
	Issue Type Mapping	Defect Issue Types		Image Added - Available under Project Configuration → Defects Mapping. - You can change your setting per project.
	Sub-Requirements	Sub-Tasks/Links
		Epic - Story relation as a Requirement	Image Added	Image Modified
		Issue Link Type	Direction	Image Modified - Available as "Issue Links Relation".
		Direction	Requirement Coverage		Requirement Coverage Strategy		Image Added - Available as "Issue Link Type Direction"
Requirement Coverage		Requirement Coverage Strategy			Image Added
		Ignore Requirements with Status			Image Added
		Ignore Requirements with Status			Image Removed	Ignore Requirements with Label
		Ignore Tests with Status
		Requirement Historical Chart Days
		Separation Separation of concerns
		Include Include Previous Version Requirements
		Show Show Flatten Requirements
Document Generator		Document Generator Templates		Image Added
Requirement Projects				It's not possible to list all Xray Project with Requirement Coverage enabled.
Test Statuses	Test	Test Statuses	Test Statuses	Manage custom Test Run statuses for Xray	Image Added
Test Statuses	Preferences	Test Statuses	Final statuses have precedence over non-final statuses	Image Added	Image Modified - Available in each report filter and selected by default
Test Step Statuses		Manage custom Test Step statuses for Xray		Image Added
Default Column Layouts		Test Execution TestRun Columns
		Test TestRun Columns	Test PreCondition Columns	Image Modified - Available under "Test Test	Runs Columns" at Project Configuration → Default Column Layouts
		Test PreCondition	Image Removed	Test Test Plan Columns		Image Added - Available under "Precondition Tests Columns" at Project Configuration → Default Column Layouts
		Test Test Set	Test Set Test Columns	Image Removed	Test Plan Test Columns	Image Removed	Test Plan Test Execution Columns		Test Coverage Columns	Image Modified - Available under Project Configuration → Default Column Layouts
		Test Test Plan Columns		Image Added - Available under Project Configuration → Default Column Layouts
		Test Set Test Columns	Image Added	Image Modified - Available under Project Configuration → Default Column Layouts
		Test Plan Test Columns	Image Added Test Execution Columns	Image Modified - Available under Project Configuration → Default Column Layouts
		Test Plan Test Execution Columns		Parameter value lists			Image Removed	Integrity Checker		Integrity Checker	Image Removed	Calculated Custom Field Values	Image Removed	Automated Steps Library	Image Removed	Integrity of Hierarchical Test Organization	Image Removed	License Management	License Information		Image Removed	Cloud Migration	Cloud Migration Pre-Flight Checker		Image Removed	Features	** Setting exclusive to Xray Cloud.	Image Removed	BDD Step Libraries	** Setting exclusive to Xray Cloud.	Image Removed	Cucumber	** Setting exclusive to Xray Cloud.	Image Removed	Test Run Archiving	** Setting exclusive to Xray Cloud.	Image Removed	Test Case Designer	** Setting exclusive to Xray Cloud.	Image Removed	API Keys	** Setting exclusive to Xray Cloud.	Image Removed	Storage	** Setting exclusive to Xray Cloud.	Image Removed	Backup	** Setting exclusive to Xray Cloud.	Image Removed	Health Check	** Setting exclusive to Xray Cloud.	Image Removed
		Coverage & Defects Configuration			Image Removed	Image Removed Available under Project Configuration → Test Coverage & Defects Mapping, meaning that you can change your setting per project.
		Sub-Requirements			Image Removed	?
		Workflow & Notifications			Image Removed	Image Removed
		Migration & Copy			Image Removed
		Backup	Image Removed	Image Removed	Restore
		Xray in-App Notifications			Image Removed	Image Removed
Archiving Xray Issues			Image Removed	Image Removed	Image Removed Adds new feature: Auto-Archiving
Storage			Not Applicable Storage is managed on-premise	Image Removed Adds new feature Storage Management
Display the Pre-Conditions section before the Test Details	Image Removed		Display Manual Test Results table in short view	Image Removed	Image Removed Available under Global by default and per Project after enabling it.	Project admins can configure Test Step Custom Fields	Image Removed	Image Removed Available by default on project level through Test Step Fields, no longer a Global Setting	Project admins can configure Test Run Custom Fields	Image Removed	Image Removed Available by default on project level through Test Run Custom Fields, no longer a Global Setting	Set final Test Run status	Image Removed		Inline Execute Tests	Image Removed	Image Removed	Restrict tests execution to the assignee	Image Removed		Fail All Steps/Examples	Image Removed	Restrict automated Test status	Image Removed	By default, the automated Test status can be set manually.	Can Edit TestRun Dates	Image Removed	Image Removed The setting is available under Project Settings → Miscellaneous	Track Time	Image Removed	Image Removed	Set the value of the Time Tracker	Image Removed	Image Removed
	Enable Test Run Status history log in Test Executions	Image Removed
Link Defects with Test	Image Removed	Image Removed	Link Defects with Test Execution	Image Removed	Image Removed	Link Defects with Requirement	Image Removed	Image Removed The menu is "Linked Defects with Covered Issues"	User Groups allowed to add Xray Issue Types	Image Removed	Image Removed This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)	User Groups allowed to add/remove Xray Notifications	Image Removed	Xray Notifications are not available in Cloud.	Final Test Run statuses that may trigger notifications	Image Removed	Xray Notifications are not available in Cloud.
	Enable Hierarchical Test organization	Image Removed	By default is set with Hierarchical Organization
Project Roles allowed the edit Test Repository information	Image Removed	Anyone with access to the project can edit Test Repo info.	Disallow executions of Tests with workflow statuses	Image Removed	Image Removed	Disallow executions with workflow statuses	Image Removed	Image Removed	In progress test Execution workflow status	Image Removed		Resolved Test Execution workflow status	Image Removed		Resolution for Resolved Test Execution	Image Removed
	Associate a cloned Test with all original Test Sets	Image Removed
	Associate a cloned Test with all original Test Plans	Image Removed
	Environment	Image Removed	Although the option does not exist, It behaves with the default linked to "Test"
	Steps to Reproduce	Image Removed
Version	Image Removed	By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution.	Label	Image Removed	Component	Image Removed	Image Removed		Enable Automated Steps Library	Image Removed	Validate Cucumber Scenarios	Image Removed		Cucumber Export Prefixes	Image Removed	Cucumber Language	Image Removed	Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags	Image Removed	Generate features by requirements	Image Removed	Cucumber export feature name	Image Removed		Enable Document Generator	Image Removed	Max number of issues that can be exported	Image Removed		Max number of requirements per report or gadget	Image Removed		Maximum number of Links added to a Requirement	Image Removed		Test Evolution Tests Limit	Image Removed		Test Evolution Test Executions Limit	Image Removed		Test Runs list limit	Image Removed		Tests per Test Plan Maximum allowed	Image Removed
	Xray REST API - Max results per request	Image Removed
Associating a Test Execution to a Test Plan and importing Test results	Image Removed		Max Test Runs for bulk operations	Image Removed		Maximum size for parameter values	Image Removed
	Enable Xray Exploratory App execution links	Image Removed
	Enable Xray Analytics	Image Removed
Thread Pool Size	Image Removed		Enable In-app Chat Support	Image Removed	Image Removed	Enable Xray notifications	Image Removed	Image Removed
	Show Xray notifications button	Image Removed	Image Removed
Test Environments				Image Removed Possible to manage at a Global level & project level.
Automated / BDD Step Libraries			Not available as a Global setting, only as a project setting under the name "Automated Step Library"	Image Removed Possible to manage at a Global level.
Parameter value lists			Image Removed	Image Removed
Cucumber			Image Removed
Test Run Archiving	Auto Archiving	Ability to manually archive Test Runs	Image Removed Adds Auto Archive Feature
API Keys			Not Applicable Access levels are managed on-premise	Image Removed
Storage			Not Applicable storage is managed on-premise	Image Removed
Health Check				Image Removed
Features	Feature Toggling		Image Removed
Image Added - Available under Project Configuration → Default Column Layouts
Test Plan Test Runs Executions Columns		Image Added - Available under Project Configuration → Default Column Layouts
Test Coverage Columns	Image Added
Project Test Columns	Image Added
Project Test Set Columns	Image Added
Project Test Execution Columns	Image Added
Project Test Plan Columns	Image Added
Parameter value lists			Image Added	Image Added
Integrity Checker		Integrity Checker	Image Added	- Similar validation is achieve at "Project Settings > Re-indexing"
		Calculated Custom Field Values	Image Added
		Automated Steps Library	Image Added
		Integrity of Hierarchical Test Organization	Image Added
License Management	License Information		Image Added	Image Added - Available under Global Settings → Manage Apps
Cloud Migration	Cloud Migration Pre-Flight Checker		Image Added	N/A
- Features				Image Added
- Test Environments			Image Added There is no centralised setting, but it can be edited from an issue screen.	Image Added
- BDD Step Libraries			Only available at the project level.	Image Added Ability to manage the BDD Steps Library globally and share it across projects.
- Cucumber	Cucumber Export Prefixes	Test	Image Added Available in Global Setting → Miscellaneous	Image Added
		Pre Condition		Image Added
		Test Set		Image Added
		Requirement		Image Added
	Cucumber Language	Language		Image Added
	Cucumber Export	Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags		Image Added
		Generate features by requirements		Image Added
		Generate features file name using summary		Image Added
- Test Run Archiving			Image Added After Xray 4.9.3 it's already possible to define an auto-archive feature linked to a Test Execution which will also affect the Test Run	Image Added
- Test Case Designer		Add Custom URL	Image Added Available in Global Setting → Xray Enterprise	Image Added
- API Keys		Create API Key	N/A	Image Added
- Storage		Refresh Storage Usage	N/A	Image Added
- Storage		Filters	N/A	Image Added
- Backup		With Attachments	Image Added Available as a Jira function not only to backup but also to restore/import.	Image Added
- Backup		Create Backup		Image Added
- Health Check		Reinstall Xray		Image Added

UI Expand

title	Project Level Settings

Setting			Server	Cloud
Test Step Custom Fields		Create	Image Added	Image Added
Test Run Custom Fields		Create	Image Added	Image Added
Parameter values lists		Add Global List	Image Added	Image Added
Parameter values lists		Create List	Image Added	Image Added
Remote Jobs Trigger			Image Added	Image Added
Document Generator	Document Generator Templates	Add	Image Added	Image Added
Document Generator	Document Generator Templates	Store	Image Added	Image Added
Disable Xray Requirement Coverage			Image Added	- To disable Requirement Coverage you just need to remove issue types from the Test Coverage menu.
Import Automated Steps			Image Added	Image Added - Available under Global Settings → BDD Steps Library
Disable Xray Notifications			Image Added
- Summary		Add Xray Issue Types in Project	Image Added Available through the action button located on the top right corner after accessing Project Settings.	Image Added
- Miscellaneous	Enable Project Settings		Image Added	Image Added
	Test Run Options	Display Manual Test Results table in short view	Image Added	Image Added
		Can Edit Test Run Date	Image Added	Image Added
		Fail All Steps	Image Added	Image Added
		Inline Execute Tests	Image Added	Image Added
		Send email notifications to Test Run assignee	Image Added	Image Added
		Track Time	Image Added	Image Added
		Set the value of the Time Tracker	Image Added	Image Added
	Defect Links	Link Defects with Test	Image Added	Image Added
		Link Defects with Test Execution	Image Added	Image Added
		Link Defects with Covered Issues	Image Added	Image Added
	Disallow executions of Tests with workflow statuses	Choose the workflow statuses in which the Tests are not allowed to be executed.	Image Added	Image Added
	Disallow executions with workflow statuses	Choose the workflow statuses in which the Test Execution issues will not allow executing Tests.	Image Added	Image Added
	Defect Default Values	Label	Image Added	Image Added
	Defect Default Values	Component	Image Added	Image Added
- Test Coverage	Test Coverage	Available Issue Types	Image Added	Image Added
	Test Coverage	Coverable Issue Types		Image Added
	Test Coverage Hierarchy	Epic - Issues(Stories) relation		Image Added
		Issue - Sub-tasks relation		Image Added
		Issue Links relation		Image Added
		Issue Link Type Direction		Image Added
- Defect Mapping		Available Issue Types		Image Added
- Defect Mapping		Defect Issue Types		Image Added
- Test Types		Add New Test Type Option	Image Added Not possible to set as Project Setting. Available as a Global Setting under Issue Test Types	Image Added
- Test Environments	Project Test Environments	Add Environment	Image Added Not possible to set as Project Setting. There is no centralized setting, but it can be edited from an issue screen.	Image Added
	Project Test Environments	Create Environment		Image Added
	Settings	Create Inline Test Environments	It's not possible to disable the creation of Test Environments.	Image Added
- BDD Step Library	Step index heuristics	Quoted strings e.g. "red", "blue"		Image Added
		Numbers e.g. 355, 2.3		Image Added
		Enums e.g. LEFT, RIGHT, CENTER		Image Added
	Permissions			Image Added
- Default Column Layouts	Test	Test Preconditions Columns	Image Added	Image Added
		Test Test Sets Columns	Image Added	Image Added
		Test Test Plans Columns	Image Added	Image Added
		Test Test Runs Columns	Image Added	Image Added
	Test Execution	Test Execution Tests Columns	Image Added	Image Added
	Pre Condition	Precondition Tests Columns	Image Added	Image Added
	Test Set	Test Set Tests Columns	Image Added	Image Added
	Test Plan	Test Plan Tests Columns	Image Added	Image Added
		Test Plan Test Executions Columns	Image Added	Image Added
		Test Plan Test Runs Executions Columns		Image Added
- Re-Indexing		Re-Index	Image Added Available as a Jira feature ("Re-index project")

UI Expand

title	Project Level Settings

Image Removed

Ability to manage Test Environment at a project level.

Image Removed

Setting	Server	Cloud
Project Organization		Image Removed	Image Removed
Configuring Xray Test Project		Image Removed	Available under "Project Configuration → Summary"
Requirements per Project	Requirement Coverage Strategy	Image Removed	Available under "Project Configuration → Test Coverage & Defects Mapping"
	Ignore Requirements with Status	Image Removed	Ignore Requirements with Label	Image Removed	Ignore Tests with Status	Image Removed	Requirement Historical Chart Days	Image Removed	Include Previous Version Requirements	Image Removed	Show Flatten Requirements	Image Removed
	Separation of concerns	Image Removed
	Configure Xray with an existent Project		Image Removed	Available under "Project Configuration → Summary"
	Using Xray Template		Image Removed
	Agile Boards		Image Removed	Available with limitations. We are only able to use 3 Xray Custom Fields, we are unable to showcase the "Requirement Status" field (one of the most used in DC/Server)
	Permissions		Image Removed	(Permissions are Jira wise)
	Summary		Not Applicable	Image Removed
Issue Types Mapping		Not Applicable	Only Available for Team Managed Projects
Test Coverage		Available under the name Issue Type Mapping	Image Removed
Defect Mapping		Available under the name Issue Type Mapping	Image Removed
Test Types		Image Removed	Image Removed
Test Environments
BDD Step Library		Available under the name "Automated Steps Library"	Image Removed
Test Step Fields		Image Removed Available under Project Settings → Test Step Custom Fields	Image Removed
Test Run Custom Fields		Image Removed Available under Project Settings → Test Run Custom Fields	Image Removed
Parameter value lists		Image Removed	Image Removed
Default Column Layouts	Test Execution TestRun Columns	Image Removed	Image Removed
	Test TestRun Columns	Image Removed	Image Removed
	Test PreCondition Columns	Image Removed	Image Removed
	Test Test Set Columns	Image Removed	Image Removed
	Test Test Plan Columns	Image Removed	Image Removed
	Test Set Test Columns	Image Removed	Image Removed
	Test Plan Test Columns	Image Removed	Image Removed
	Test Plan Test Execution Columns	Image Removed	Image Removed
	Test Coverage Columns	Image Removed
	Project Test Columns	Image Removed
	Project Test Set Columns	Image Removed	Image Removed
	Project Test Execution Columns	Image Removed	Image Removed
	Project Test Plan Columns	Image Removed	Image Removed
	Precondition Tests Columns	Image Removed	Image Removed
Re-Indexing
	Image Modified

Understand the icons:

- Available in Xray Cloud but with some differences or minor UI adjustments

...

- Extra option or functionality in Xray Cloud

- Menus that are exclusive to Xray Cloud

Content

Space Tools

Versions Compared

Old Version 33

New Version Current

Key