Page History

Versions Compared

Old Version 29

changes.mady.by.user Sofia Canario

Saved on Oct 07, 2024

compared with

New Version Current

changes.mady.by.user Francisco Fonseca

Saved on May 08, 2025

Key

This line was added.
This line was removed.
Formatting was changed.

...

This article explains in deep detail the differences between Xray Server/DC & Xray Cloud Administration & Configuration .

...

Global Settings - Xray settings that apply to all projects that use Xray. Global settings could be access by Jira Administration > Apps.

Tip
At Xray, you can override global settings and enable them as Project Settings.

Project Settings - Xray settings that are aplicable to one specific project. In case of you need to replicate the setting per several projects, you need to apply the configuration to all projects that need the same setting. Xray Projects Settings are accessible at Project > Project Settings.

...

Find a comparison view of the settings and features in Server / DC vs Cloud about Administration & Configuration on the above table.

...

UI Expand

title	Global Level Settings

Backup & Restore
Miscellaneous Settings

tests execution

Types

Anyone

Although the option does not exist, It behaves with the default linked to "Test"

it behaves as of the defects created in the context of a test run will be populated by FixVersion value of

Prefixes but unable Setting moved to a dedicated option in the menu tab: Miscellaneous & Feature

Image Removed

Xray Global Settings	GroupSection	Setting	Xray Server/ DC (Standard & Enterprise)	Xray Cloud (Standard & Enterprise)
Custom Fields Configuration	Test Run Status Custom Field Version	Image Removed	Configuration not available on Cloud, so it behaves like "No Version" is selected
	Test Set Status Custom Field Version	Image Removed
	Requirement Status Custom Field Versions	Image Removed	(note: behaves like "No Version" is selected)
	Maintenance - Recalculate Requirement Status	Image Removed	?
Xray Linking Restrictions		Image Removed
Manage Test Types	Manage Test Type	Image Removed	Available under "Global Settings – Test Types" and "Project Settings – Test Types". In Xray Cloud it's not possible to set different Test Types to Test & Precondition, meaning that it applies to both issue types. Learn more <link>
Manage Test Types	Manager Pre-Condition Type	Image Removed
Coverage & Defects Configuration		Image Removed	Image Removed Available under Project Configuration → Test Coverage & Defects Mapping, meaning that you can change your setting per project.
Sub-Requirements		Image Removed	?
Workflow & Notifications		Image Removed	Image Removed
Migration & Copy		Image Removed
Backup	Image Removed	Image Removed
Restore	Image Removed
Xray in-App Notifications		Image Removed	Image Removed
Archiving Xray Issues		Image Removed	Image Removed Adds new feature: Auto-Archiving
Storage		Not Applicable Storage is managed on-premise	Image Removed Adds new feature Storage Management
Miscellaneous Settings	The Global Configurations for Xray.
		Display the Pre-Conditions section before the Test Details	Image Modified

		Display Manual Test Results table in short view	Image Modified	Image Modified Available under Global by default and per Project after enabling it.
	Project admins can configure Test Step Custom Fields	Image Modified	Image Modified Available by default on the project level through Test Step Fields, no longer a Global Setting
	Project admins can configure Test Run Custom Fields	Image Modified	Image Modified Available by default on the project level through Test Run Custom Fields, no longer a Global Setting
	Test Run Options	Set final Test Run status	Image Modified

		Inline Execute Tests	Image Modified	Image Modified
		Restrict
		Test Execution to the assignee	Image Modified

		Fail All Steps/Examples	Image Modified	Image Modified Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.
		Restrict automated Test status	Image Modified
		- By default, the automated Test status can be set manually.
	Can Edit TestRun Dates	Image Modified	Image Modified The setting is available under Project Settings → Miscellaneous
	Track Time	Image Modified	Image Modified
	Set the value of the Time Tracker	Image Modified	Image Modified
	Enable Test Run Status history log in Test Executions	Image Modified

	Defect Links
			Link Defects with Test	Image Modified	Image Modified
			Link Defects with Test Execution	Image Modified	Image Modified
	Link Defects with Requirement		Image Modified	Image Modified The menu is "Linked Defects with Covered Issues"
	User Groups allowed to add Xray Issue
	Types		Image Modified	Image Modified This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)
	Notifications	User Groups allowed to add/remove Xray Notifications	Image Modified
	Notifications	- Xray Notifications (Xray Events) are not available in the Cloud.
	Final Test Run statuses that may trigger notifications		Image Modified
	Xray Notifications are not available in Cloud.
	Hierarchical Test Organization	Enable Hierarchical Test organization	Image Modified
	Hierarchical Test Organization
	- By default is set with Hierarchical Organization, meaning that Test Repository & Test Plan Board is available from the sidebar. You are not able to disable it.
	Project Roles allowed the edit Test Repository information	Image Modified
	- Anyone with access to the project can edit Test Repo info.
	Workflow Status	Disallow executions of Tests with workflow statuses	Image Modified	Image Modified
		Disallow executions with workflow statuses	Image Modified	Image Modified
		In progress test Execution workflow status	Image Modified

		Resolved Test Execution workflow status	Image Modified

	Resolution for Resolved Test Execution	Image Modified

	Clone Issues	Associate a cloned Test with all original Test Sets	Image Modified
	Clone Issues
	Associate a cloned Test with all original Test Plans	Image Modified

	Defect Default Values	Environment	Image Modified
		- By default, when creating a defect, it inherits the environment set before the Test Run.
		Steps to Reproduce	Image Modified
		- By default the steps are included in the Defect. Your are not able to disable this behaviour.
		Version	Image Modified

	- By default
	, the defect’s Affect Version field
	is populated with the value of the FixVersion field of the Test Execution.
	Label	Image Modified	Image Modified
	Component	Image Modified	Image Modified
	Automated Steps Library	Enable Automated Steps Library	Image Modified
	Automated Steps Library	- Automated Steps Library is enabled by default. You are not able to disable it.
	Validate Cucumber Scenarios	Image Modified

Cucumber Export
	Prefixes	Test	Image Modified	Image Modified - Available under Global Settings → Cucumber"
		. - Unable to create a prefix for a Test Plan.
			Pre-Condition		Image Added
			Test Set		Image Added
Test Plan			Image Added
Requirement	Image Added
Cucumber Language	Language	Image Modified	Image Modified
- Available under Global Settings → Cucumber".
Cucumber Export	Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags	Image Modified	Image Added - Available under Global Settings → Cucumber".
	Generate features by requirements	Image Modified	Image Added - Available under Global Settings → Cucumber".
	Cucumber export feature name	Image Modified	- Only available the possibility to "Generate feature file name using summary", under Global Settings → Cucumber".
Document Generator	Enable Document Generator	Image Modified	Image Modified Available under Global Settings
Document Generator	→ Features
Max number of issues that can be exported	Image Modified

Requirements Reports
	Max number of requirements per report or gadget	Image Modified

Requirements Tests	Maximum number of Links added to a Requirement	Image Modified
Gadgets	Test Evolution Tests Limit	Image Modified

	Test Evolution Test Executions Limit	Image Modified

Test Runs list limit	Image Modified

Tests per Test Plan	Tests per Test Plan Maximum allowed	Image Modified

Xray REST API
Xray REST API		Xray REST API - Max results per request	Image Modified

Associating a Test Execution to a Test Plan and importing Test results	Image Modified

Bulk operations	Max Test Runs for bulk operations	Image Modified
Datasets	Maximum size for parameter values	Image Modified

Xray Exploratory App
	Enable Xray Exploratory App execution links	Image Modified	- By default within the context of a Test Run, you have available a button which allows you to "Execute with Exploratory App"
Usage Metrics	Enable Xray Analytics	Image Modified	- By default, Xray Analytics is enabled. You are not able to disable it.
Thread Pool Size	Thread Pool Size	Image Modified

Chat Support	Enable In-app Chat Support	Image Modified	Image Modified
Notifications	Enable Xray notifications	Image Modified	Image Modified Available under Global Settings → Features
Notifications	Show Xray notifications button	Image Modified
Image Removed
Test Environments			Image Removed Possible to manage at a Global level & project level.
Automated / BDD Step Libraries		Not available as a Global setting, only as a project setting under the name "Automated Step Library"	Image Removed Possible to manage at a Global level.
Parameter value lists		Image Removed	Image Removed
Test Statuses		Image Removed
Test Step Statuses		Image Removed	Image Removed
Cucumber		Image Removed
Test Run Archiving	Auto Archiving	Ability to manually archive Test Runs	Image Removed Adds Auto Archive Feature
API Keys		Not Applicable Access levels are managed on-premise	Image Removed
Storage		Not Applicable storage is managed on-premise	Image Removed
Health Check			Image Removed
Features	Feature Toggling		Image Removed

UI Expand

title	Project Level Settings

Available under "Project Configuration → Test Coverage & Defects Mapping"

		Setting	Server	Cloud

Custom Fields	Custom Fields	Test Run Status Custom Field Version	Image Added	- By default, it will behave as if "No Version" is selected.
		Test Set Status Custom Field Version	Image Added	- By default, it will behave as if "No Version" is selected.
		Requirement Status Custom Field Versions	Image Added	- By default, it will behave as if "No Version" is selected.
	Maintenance	Recalculate Requirement Status	Image Added	Image Added Available "Re-indexing" at Project Settings, this will recalculate the requirement status for a specific project.
Permissions		Xray Test Repository Permissions	Image Added (under Issues > Permission Schemes)
Test Types	Manage Test Types	Manage Test Type	Image Added	Image Added - Available under "Global Settings – Test Types" and "Project Settings – Test Types". - In Xray Cloud it's not possible to set different Test Types to Test & Precondition, meaning that it applies to both issue types. Learn more Changing the Type of a Test
Test Types	Manage Test Types	Manager Pre-Condition Type	Image Added
Xray Enterprise	Xray Enterprise Settings	Xray Test Case Designer	Image Added	Image Added - Available under "Global Settings – Test Case Designer
Issue Type Mapping	Issue Type Mapping	Requirement Issue Types	Image Added	Image Added - Available under Project Configuration → Test Coverage. Requirement Issue Issues are named Coverable Issue Issues in Xray Cloud. - You can change your setting per project.
	Issue Type Mapping	Defect Issue Types	Image Added	Image Added - Available under Project Configuration → Defects Mapping. - You can change your setting per project.
	Sub-Requirements	Sub-Tasks/Links	Image Added
		Epic - Story relation as a Requirement	Image Added	Image Added
		Issue Link Type	Image Added	Image Added - Available as "Issue Links Relation".
		Direction	Image Added	Image Added - Available as "Issue Link Type Direction"
Requirement Coverage		Requirement Coverage Strategy	Image Added
		Project Organization		Image Removed	Image Removed
		Configuring Xray Test Project		Image Removed	Available under "Project Configuration → Summary"
		Requirements per Project	Requirement Coverage Strategy	Image Removed

			Ignore Requirements with Status	Image Modified
			Ignore Requirements with Label	Image Modified
Ignore Tests with Status	Image Modified
Requirement Historical Chart Days
Separation of concerns	Image Added
Include Previous Version Requirements
Show Flatten Requirements	Image Modified

Document Generator		Document Generator Templates	Image Added	Image Added
Requirement Projects			Image Added	It's not possible to list all Xray Project with Requirement Coverage enabled.
Test Statuses	Test Statuses	Manage custom Test Run statuses for Xray	Image Added	Image Added
Test Statuses	Preferences	Final statuses have precedence over non-final statuses	Image Added	Image Added - Available in each report filter and selected by default
Test Step Statuses		Manage custom Test Step statuses for Xray	Image Added	Image Added
Default Column Layouts		Test Execution TestRun Columns	Image Added
		Test TestRun Columns	Image Added	Image Added - Available under "Test Test Runs Columns" at Project Configuration → Default Column Layouts
		Test PreCondition Columns	Image Added	Image Added - Available under "Precondition Tests Columns" at Project Configuration → Default Column Layouts
		Test Test Set Columns	Image Added	Image Added - Available under Project Configuration → Default Column Layouts
		Test Test Plan Columns	Image Added	Image Added - Available under Project Configuration → Default Column Layouts
		Test Set Test Columns	Image Added	Image Added - Available under Project Configuration → Default Column Layouts
		Test Plan Test Columns	Image Added	Image Added - Available under Project Configuration → Default Column Layouts
		Test Plan Test Execution Columns	Image Added	Image Added - Available under Project Configuration → Default Column Layouts
		Test Plan Test Runs Executions Columns		Image Added - Available under Project Configuration → Default Column Layouts
		Test Coverage Columns	Image Added
		Project Test Columns	Image Added
		Project Test Set Columns	Image Added
		Project Test Execution Columns	Image Added
		Project Test Plan Columns	Image Added
Parameter value lists			Image Added	Image Added
Integrity Checker		Integrity Checker	Image Added	- Similar validation is achieve at "Project Settings > Re-indexing"
		Calculated Custom Field Values	Image Added
		Automated Steps Library	Image Added
		Integrity of Hierarchical Test Organization	Image Added
License Management	License Information		Image Added	Image Added - Available under Global Settings → Manage Apps
Cloud Migration	Cloud Migration Pre-Flight Checker		Image Added	N/A
- Features				Image Added
- Test Environments			Image Added There is no centralised setting, but it can be edited from an issue screen.	Image Added
- BDD Step Libraries			Only available at the project level.	Image Added Ability to manage the BDD Steps Library globally and share it across projects.
- Cucumber	Cucumber Export Prefixes	Test	Image Added Available in Global Setting → Miscellaneous	Image Added
		Pre Condition		Image Added
		Test Set		Image Added
		Requirement		Image Added
	Cucumber Language	Language		Image Added
	Cucumber Export	Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags		Image Added
		Generate features by requirements		Image Added
		Generate features file name using summary		Image Added
- Test Run Archiving			Image Added After Xray 4.9.3 it's already possible to define an auto-archive feature linked to a Test Execution which will also affect the Test Run	Image Added
- Test Case Designer		Add Custom URL	Image Added Available in Global Setting → Xray Enterprise	Image Added
- API Keys		Create API Key	N/A	Image Added
- Storage		Refresh Storage Usage	N/A	Image Added
- Storage		Filters	N/A	Image Added
- Backup		With Attachments	Image Added Available as a Jira function not only to backup but also to restore/import.	Image Added
- Backup		Create Backup		Image Added
- Health Check		Reinstall Xray		Image Added

UI Expand

title	Project Level Settings

Image Removed

Ability to manage Test Environment at a project level.

Image Removed

Setting			Server	Cloud
Test Step Custom Fields		Create	Image Added	Image Added
Test Run Custom Fields		Create	Image Added	Image Added
Parameter values lists		Add Global List	Image Added	Image Added
Parameter values lists		Create List	Image Added	Image Added
Remote Jobs Trigger			Image Added	Image Added
Document Generator	Document Generator Templates	Add	Image Added	Image Added
Document Generator	Document Generator Templates	Store	Image Added	Image Added
Disable Xray Requirement Coverage			Image Added	- To disable Requirement Coverage you just need to remove issue types from the Test Coverage menu.
Import Automated Steps			Image Added	Image Added - Available under Global Settings → BDD Steps Library
Disable Xray Notifications			Image Added
- Summary		Add Xray Issue Types in Project	Image Added Available through the action button located on the top right corner after accessing Project Settings.	Image Added
- Miscellaneous	Enable Project Settings		Image Added	Image Added
	Test Run Options	Display Manual Test Results table in short view	Image Added	Image Added
		Can Edit Test Run Date	Image Added	Image Added
		Fail All Steps	Image Added	Image Added
		Inline Execute Tests	Image Added	Image Added
		Send email notifications to Test Run assignee	Image Added	Image Added
		Track Time	Image Added	Image Added
		Set the value of the Time Tracker	Image Added	Image Added
	Defect Links	Link Defects with Test	Image Added	Image Added
		Link Defects with Test Execution	Image Added	Image Added
		Link Defects with Covered Issues	Image Added	Image Added
	Disallow executions of Tests with workflow statuses	Choose the workflow statuses in which the Tests are not allowed to be executed.	Image Added	Image Added
	Disallow executions with workflow statuses	Choose the workflow statuses in which the Test Execution issues will not allow executing Tests.	Image Added	Image Added
	Defect Default Values	Label	Image Added	Image Added
	Defect Default Values	Component	Image Added	Image Added
- Test Coverage	Test Coverage	Available Issue Types	Image Added	Image Added
	Test Coverage	Coverable Issue Types		Image Added
	Test Coverage Hierarchy	Epic - Issues(Stories) relation		Image Added
		Issue - Sub-tasks relation		Image Added
		Issue Links relation		Image Added
		Issue Link Type Direction		Image Added
- Defect Mapping		Available Issue Types		Image Added
- Defect Mapping		Defect Issue Types		Image Added
- Test Types		Add New Test Type Option	Image Added Not possible to set as Project Setting. Available as a Global Setting under Issue Test Types	Image Added
- Test Environments	Project Test Environments	Add Environment	Image Added Not possible to set as Project Setting. There is no centralized setting, but it can be edited from an issue screen.	Image Added
	Project Test Environments	Create Environment		Image Added
	Settings	Create Inline Test Environments	It's not possible to disable the creation of Test Environments.	Image Added
- BDD Step Library	Step index heuristics	Quoted strings e.g. "red", "blue"		Image Added
		Numbers e.g. 355, 2.3		Image Added
		Enums e.g. LEFT, RIGHT, CENTER		Image Added
	Permissions			Image Added
- Default Column Layouts	Test	Test Preconditions Columns	Image Added	Image Added
		Test Test Sets Columns	Image Added	Image Added
		Test Test Plans Columns	Image Added	Image Added
		Test Test Runs Columns	Image Added	Image Added
	Test Execution	Test Execution Tests Columns	Image Added	Image Added
	Pre Condition	Precondition Tests Columns	Image Added	Image Added
	Test Set	Test Set Tests Columns	Image Added	Image Added
	Test Plan	Test Plan Tests Columns	Image Added	Image Added
		Test Plan Test Executions Columns	Image Added	Image Added
		Test Plan Test Runs Executions Columns		Image Added
- Re-Indexing		Re-Index	Image Added Available as a Jira feature ("Re-index project")
Separation of concerns	Image Removed
Configure Xray with an existent Project		Image Removed	Available under "Project Configuration → Summary"
Using Xray Template		Image Removed
Agile Boards		Image Removed	Available with limitations. We are only able to use 3 Xray Custom Fields, we are unable to showcase the "Requirement Status" field (one of the most used in DC/Server)
Permissions		Image Removed	(Permissions are Jira wise)
Summary		Not Applicable	Image Removed
Issue Types Mapping		Not Applicable	Only Available for Team Managed Projects
Test Coverage		Available under the name Issue Type Mapping	Image Removed
Defect Mapping		Available under the name Issue Type Mapping	Image Removed
Test Types		Image Removed	Image Removed
Test Environments
BDD Step Library		Available under the name "Automated Steps Library"	Image Removed
Test Step Fields		Image Removed Available under Project Settings → Test Step Custom Fields	Image Removed
Test Run Custom Fields		Image Removed Available under Project Settings → Test Run Custom Fields	Image Removed
Parameter value lists		Image Removed	Image Removed
Default Column Layouts	Test Execution TestRun Columns	Image Removed	Image Removed
	Test TestRun Columns	Image Removed	Image Removed
	Test PreCondition Columns	Image Removed	Image Removed
	Test Test Set Columns	Image Removed	Image Removed
	Test Test Plan Columns	Image Removed	Image Removed
	Test Set Test Columns	Image Removed	Image Removed
	Test Plan Test Columns	Image Removed	Image Removed
	Test Plan Test Execution Columns	Image Removed	Image Removed
	Test Coverage Columns	Image Removed
	Project Test Columns	Image Removed
	Project Test Set Columns	Image Removed	Image Removed
	Project Test Execution Columns	Image Removed	Image Removed
	Project Test Plan Columns	Image Removed	Image Removed
	Precondition Tests Columns	Image Removed	Image Removed
Re-Indexing
	Image Modified

Understand the icons:

- Available in Xray Cloud but with some differences or minor UI adjustments

...

- Extra option or functionality in Xray Cloud

- Menus that are exclusive to Xray Cloud

Content

Space Tools

Versions Compared

Old Version 29

New Version Current

Key