Page History

Versions Compared

Old Version 3

changes.mady.by.user Francisco Fonseca

Saved on Sep 24, 2024

compared with

New Version Current

changes.mady.by.user Francisco Fonseca

Saved on May 08, 2025

Key

This line was added.
This line was removed.
Formatting was changed.

This article explains in deep detail the differences between Xray Server/DC & Xray Cloud Administration & Configuration .

First, to understand the differences between Xray Cloud Administration & Xray Data Center, let's clarify some concepts:

Global Settings - Xray settings that apply to all projects that use Xray. Global settings could be access by Jira Administration > Apps.

Tip
At Xray, you can override global settings and enable them as Project Settings.

Project Settings - Xray settings that are aplicable to one specific project. In case of you need to replicate the setting per several projects, you need to apply the configuration to all projects that need the same setting. Xray Projects Settings are accessible at Project > Project Settings.

Find a comparison view of the settings and features in Server / DC vs Cloud about Administration & Configuration on the above table.

Note
This a comparison on settings that you can control on Xray Administration ( Global & project level). To understand if a specific feature comparison please use the Xray Server/Data Center and Xray Cloud.

UI Expand

title	Global Level Settings

To reduce clutter in the previous view, we've created a simple table listing all it's available within Administration & Configuration when looking at Server/DC vs Cloud.

Understand the icons:

- Available in Xray Cloud but with some differences or minor UI adjustments

- Not available in Xray Cloud

- Extra option or functionality in Xray Cloud

Backup & Restore
Miscellaneous Settings
In Xray Cloud, Miscellaneous Settings are present not only as a Global setting but also as a Project setting, and both with limitations:
Global Settings: Miscellaneous
- Test Run Options,
- Defect Links,
- Disallow executions of Tests with workflow statuses,
- Disallow executions with workflow statuses
- Defect Default Values → Label
- Defect Default Values → Component
- Enable Document Generator
- Enable Chat Support
Project Settings: Miscellaneous
- Test Run Options,
- Defect Links,
- Disallow executions of Tests with workflow statuses,
- Disallow executions with workflow statuses
- Defect Default Values → Label
- Defect Default Values → Component

UI Expand

title	Global Level Settings

Setting

Server

Cloud

Custom Fields Configuration

Test Run Status Custom Field Version

Test Run Status Custom Field Version → behaves like "No Version" is selected.

Custom Fields Configuration

Test Set Status Custom Field Version

Test Set Status Custom Field Version → No behavior in sight.

Custom Fields Configuration

Requirement Status Custom Field Versions

Requirement Status Custom Field Versions → behaves like "No Version" is selected.

Xray Linking Restrictions

Available

Unavailable

Manage Test Types

Manage Test Type

Available under "Global Settings – Test Types" and "Project Settings – Test Types" after enabling it → Test Type define works for both Test and Precondition.

Manage Test Types

Manager Pre-Condition Type

Available under "Global Settings – Test Types" and "Project Settings – Test Types" after enabling it → Test Type define works for both Test and Precondition.

Coverage & Defects Configuration

Available

Available under "Project Configuration → Test Coverage & Defects Mapping"

Workflow & Notifications

Available

Available under "Global Settings"

Migration & Copy

Available

Unavailable

Available

Available under "Global Settings → Backup"

Restore (Not documented in our Documentation that we can't)

Xray in-App Notifications

Available

Archiving Xray Issues

Available

Available including (Auto-Archiving)

Storage

Not Applicable

Available

Xray Global Settings	Group	Setting	Xray Server/ DC (Standard & Enterprise)	Xray Cloud (Standard & Enterprise)
Miscellaneous Settings	The Global Configurations for Xray.

Xray Global Settings

Group

Setting

Xray Server/ DC

(Standard & Enterprise)

Xray Cloud

(Standard & Enterprise)

Miscellaneous Settings

The Global Configurations for Xray.

Display the Pre-Conditions section before the Test Details

Image Added
Display Manual Test Results table in short view

Display Manual Test Results table in short view →

Image Added

Available under Global by default and per Project after enabling it.

Test Step FieldsProject

Project admins can configure Test Step Custom Fields

Project admins can configure Test Step Custom Fields →

	Image Added	Image Added Available by default on the project level through Test Step Fields, no longer a Global Setting
Project admins can configure Test Run Custom

Fields

Image Added

Project admins can configure Test Run Custom Fields →

Available by default on the project level through Test Run Custom Fields, no longer a Global Setting

Set final

Test Run

status

Options

Set

Set final Test Run status

→ To review with Sofia. (Information missing in our Documentation for Cloud)

	Image Added
Inline Execute Tests	Image Added

Inline Execute Tests

Image Added

Restrict

tests execution

Test Execution to the assignee

Restrict tests execution to assignee

Image Added
Fail All Steps/Examples

Fail All Steps/Examples →

Image Added	Image Added Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.
Restrict automated Test

status Restrict automated Test status → However by default you can edit, but by manually editing the imported run, the Imported Result Section Get's removed from Testing Board but it's still acessible through. (Omisso)

status

Image Added

- By default, the automated Test status can be set manually.

Can Edit TestRun Dates

Can Edit TestRun Dates → However by default you can edit (Omisso)

	Image Added	Image Added The setting is available under Project Settings → Miscellaneous
Track Time	Image Added

Track Time

Image Added

Set the value of the Time Tracker

	Image Added	Image Added
Enable Test Run Status history log in Test Executions

Enable Test Run Status history log in Test Executions

Image Added
Defect Links	Link Defects with Test

Link Defects with Test

	Image Added	Image Added
Link Defects with Test Execution

Image Added

Link Defects with Test Execution

Link Defects with Requirement

Link

Image Added

The menu is "Linked Defects with Covered

Issue

Issues"
User Groups allowed to add Xray Issue

Types User Groups allowed to add Xray Issue Types → You cannot restrict someone from adding Xray Issue Types: Suggestion here → https://jira.getxray.app/browse/XRAYCLOUD-6784

Types		Image Added	Image Added This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)
Notifications	User Groups allowed to add/remove Xray Notifications

Image Added

- Xray Notifications (Xray Events) are not available in the Cloud.

User Groups allowed to add/remove Xray Notifications


	Final Test Run statuses that may trigger notifications

Final Test Run statuses that may trigger notifications

Image Added
Hierarchical Test Organization	Enable Hierarchical Test organization

Enable Hierarchical Test organization →

Image Added

- By default is set with Hierarchical Organization

and access vary:Software Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the left panelBusiness Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the horizontal project menu Apps → Testing Board

, meaning that Test Repository & Test Plan Board is available from the sidebar. You are not able to disable it.

Project Roles allowed

the edit Test Repository

information

Image Added

- Anyone

Project Roles allowed to edit Test Repository information → Anyone

with access to the project can edit Test Repo info.
Workflow Status	Disallow executions of Tests with workflow statuses	Image Added	Image Added
	Disallow executions

of Tests

with workflow statuses

Disallow executions with workflow statusesDisallow executions with workflow statusesIn Progress Test

Image Added	Image Added
In progress test Execution workflow status

In Progress Test Execution workflow status

Image Added

Resolved Test Execution workflow status

Resolution for Resolved Test Execution

	Image Added
Resolution for Resolved Test Execution

Associate a cloned Test with all original Test Sets

	Image Added
Clone Issues	Associate a cloned Test with all original Test Sets

→ XRAYCLOUD-2939

Image Added

Associate a cloned Test with all original Test Plans

→ XRAYCLOUD-2939 EnvironmentEnvironment → Although the option does not exist, It behaves with the default linked to "Test" Steps to ReproduceSteps to Reproduce → Normal comment section for documentation. Version

	Image Added
Defect Default Values	Environment	Image Added	- By default, when creating a defect, it inherits the environment set before the Test Run.
	Steps to Reproduce	Image Added	- By default the steps are included in the Defect. Your are not able to disable this behaviour.
	Version

Version → By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution.

	Image Added	- By default, the defect’s Affect Version field is populated with the value of the FixVersion field of the Test Execution.
Label	Image Added	Image Added
Component	Image Added	Image Added
Automated Steps Library	Enable Automated Steps Library

LabelLabel ComponentComponent Enable Automated Steps LibraryEnable Automated Steps Library → By default you can access: Enable Automated Steps LibrarySoftware Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the left panel Enable Automated Steps LibraryBusiness Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the horizontal project menu Apps → Testing Board. Validate Cucumber ScenariosValidate Cucumber Scenarios Cucumber Export Prefixes

Image Added

- Automated Steps Library is enabled by default. You are not able to disable it.

Validate Cucumber Scenarios

Image Added

Cucumber Export Prefixes

Test

Image Added

Cucumber Export Prefixes → "

Available under Global Settings → Cucumber"

but unable

- Unable to create a prefix for a Test Plan.


	Pre-Condition	Image Added
	Test Set	Image Added
	Test Plan	Image Added
	Requirement	Image Added
Cucumber Language	Language	Image Added	Image Added -

Cucumber LanguageCucumber Language → "

Available under Global Settings → Cucumber"

Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags

.
Cucumber Export	Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags

→ "

Image Added

- Available under Global Settings → Cucumber".

Generate

Generate features by requirements

Generate features by requirements → "

Image Added

- Available under Global Settings → Cucumber".

Cucumber

Cucumber export feature name

Generate features

Image Added

- Only available the possibility to "Generate feature file name using summary

→

Available

, under Global Settings → Cucumber".

Enable

Document Generator

Enable Document Generator

→

Image Added

Available under Global Settings

Miscelaneaous & Feature

→ Features

Max

number of issues that can be exported

Max number of issues that can be exported

Image Added
Requirements Reports

Max number of requirements per report or gadget

	Image Added
Requirements Tests

Maximum number of Links added to a Requirement

Test Evolution Tests Limit

Image Added
Gadgets	Test Evolution Tests Limit

Test Evolution Test Executions Limit

	Image Added
Test Evolution Test Executions Limit

Image Added

Test Runs list limit


Test Runs list limit	Image Added

Tests

Tests per Test

Plan Maximum allowed

Plan	Tests per Test Plan Maximum allowed

Xray

	Image Added
Xray REST API	Xray REST API -

Max

Max results per request

Xray REST API

Image Added

Associating a Test Execution to a Test Plan and importing Test results

Max Test Runs for bulk

Image Added
Bulk operations

Max

Max Test Runs for bulk operations

Maximum

	Image Added
Datasets	Maximum size for parameter values

Maximum size for parameter values Enable

Image Added

Xray Exploratory App

execution links

Enable

Enable Xray Exploratory App execution links

Enable Xray Analytics Enable Xray Analytics Thread Pool Size Thread Pool Size Enable In-app Chat Support

Image Added	- By default within the context of a Test Run, you have available a button which allows you to "Execute with Exploratory App"
Usage Metrics	Enable Xray Analytics	Image Added	- By default, Xray Analytics is enabled. You are not able to disable it.
Thread Pool Size	Thread Pool Size	Image Added
Chat Support	Enable

Enable

In-app Chat Support

	Image Added	Image Added
Notifications	Enable

Enable

Xray notifications

Enable Xray notifications

Image Added	Image Added Available under Global Settings → Features
Show Xray notifications button

Show Xray notifications buttonTest EnvironmentsUnavailable AvailableAutomated / BDD Step LibrariesNot available as a Global setting, only as a project setting under the name "Automated Step Library" AvailableGlobal Settings → Parameter value listsAvailable AvailableTest StatusesAvailable AvailableTest Step StatusesAvailable AvailableCucumberAvailable under Miscellaneous Available as a dedicated optionTest Run ArchivingAuto Archiving is unavailable as a setting however, the Test Run Archive is available to be done manually. AvailableAPI KeysNot Applicable, access levels are managed on-premise AvailableStorageNot Applicable, storage is managed on-premise AvailableHealth Check Unavailable or Not Applicable AvailableFeatures Unavailable or Not Applicable Available

UI Expand

title	Project Level Settings

SettingServerCloudProject Organization Available (with the same use cases)Available (with the same use cases)Configuring Xray Test Project AvailableAvailable under "Project Configuration → Summary"Requirements per Project Requirement Coverage StrategyAvailable under "Project Configuration → Test Coverage & Defects Mapping" Ignore Requirements with StatusAvailable under "Project Configuration → Test Coverage & Defects Mapping" Ignore Requirements with LabelAvailable under "Project Configuration → Test Coverage & Defects Mapping" Ignore Tests with StatusAvailable under "Project Configuration → Test Coverage & Defects Mapping" Requirement Historical Chart DaysAvailable under "Project Configuration → Test Coverage & Defects Mapping"Separation of concernsUnavailableInclude Previous Version RequirementsAvailable under "Project Configuration → Test Coverage & Defects Mapping"Show Flatten RequirementsAvailable under "Project Configuration → Test Coverage & Defects Mapping"Configure Xray with an existent ProjectAvailableAvailable under "Project Configuration → Summary"Using Xray TemplateAvailableUnavailableAgile BoardsAvailableAvailable with limitations. e.g. --> unable to use custom fields.PermissionsAvailableUnavailable (Permissions are Jira wise)SummaryUnavailable or Not ApplicableAvailableUnavailable or Not ApplicableDemo ProjectIssue Types MappingUnavailable or Not Applicable Only Available for Team Managed ProjectsTest CoverageAvailable under Issue Type Maping Ability to set up which issue types are considered Requirements.Defect MappingAvailable under Issue Type Maping Ability to set up which issue types are considered Defects.Test TypesAvailable AvailableTest EnvironmentsUnavailable or Not Applicable Ability to manage Test Environment at a project level.BDD Step LibraryAvailable under Project Settings AvailableTest Step FieldsAvailable under Project Settings > Test Steps Custome AvailableTest Run Custom FieldsAvailable under Project Settings AvailableParameter value listsAvailable AvailableDefault Column LayoutsTest Execution TestRun Columns Test Execution TestRun ColumnsTest TestRun Columns Test TestRun ColumnsTest PreCondition Columns Test PreCondition ColumnsTest Test Set Columns Test Test Set ColumnsTest Test Plan Columns Test Test Plan ColumnsTest Set Test Columns Test Set Test ColumnsTest Plan Test Columns Test Plan Test ColumnsTest Plan Test Execution Columns Test Plan Test Execution ColumnsTest Coverage Columns Test Coverage ColumnsProject Test Columns Project Test ColumnsProject Test Set Columns Project Test Set ColumnsProject Test Execution Columns Project Test Execution ColumnsProject Test Plan Columns Project Test Plan ColumnsPrecondition Tests Columns Precondition Tests ColumnsRe-IndexingAvailableAvailable

	Image Added
Custom Fields	Custom Fields	Test Run Status Custom Field Version	Image Added	- By default, it will behave as if "No Version" is selected.
		Test Set Status Custom Field Version	Image Added	- By default, it will behave as if "No Version" is selected.
		Requirement Status Custom Field Versions	Image Added	- By default, it will behave as if "No Version" is selected.
	Maintenance	Recalculate Requirement Status	Image Added	Image Added Available "Re-indexing" at Project Settings, this will recalculate the requirement status for a specific project.
Permissions		Xray Test Repository Permissions	Image Added (under Issues > Permission Schemes)
Test Types	Manage Test Types	Manage Test Type	Image Added	Image Added - Available under "Global Settings – Test Types" and "Project Settings – Test Types". - In Xray Cloud it's not possible to set different Test Types to Test & Precondition, meaning that it applies to both issue types. Learn more Changing the Type of a Test
Test Types	Manage Test Types	Manager Pre-Condition Type	Image Added
Xray Enterprise	Xray Enterprise Settings	Xray Test Case Designer	Image Added	Image Added - Available under "Global Settings – Test Case Designer
Issue Type Mapping	Issue Type Mapping	Requirement Issue Types	Image Added	Image Added - Available under Project Configuration → Test Coverage. Requirement Issue Issues are named Coverable Issue Issues in Xray Cloud. - You can change your setting per project.
	Issue Type Mapping	Defect Issue Types	Image Added	Image Added - Available under Project Configuration → Defects Mapping. - You can change your setting per project.
	Sub-Requirements	Sub-Tasks/Links	Image Added
		Epic - Story relation as a Requirement	Image Added	Image Added
		Issue Link Type	Image Added	Image Added - Available as "Issue Links Relation".
		Direction	Image Added	Image Added - Available as "Issue Link Type Direction"
Requirement Coverage		Requirement Coverage Strategy	Image Added
		Ignore Requirements with Status	Image Added
		Ignore Requirements with Label	Image Added
		Ignore Tests with Status	Image Added
		Requirement Historical Chart Days	Image Added
		Separation of concerns	Image Added
		Include Previous Version Requirements	Image Added
		Show Flatten Requirements	Image Added
Document Generator		Document Generator Templates	Image Added	Image Added
Requirement Projects			Image Added	It's not possible to list all Xray Project with Requirement Coverage enabled.
Test Statuses	Test Statuses	Manage custom Test Run statuses for Xray	Image Added	Image Added
Test Statuses	Preferences	Final statuses have precedence over non-final statuses	Image Added	Image Added - Available in each report filter and selected by default
Test Step Statuses		Manage custom Test Step statuses for Xray	Image Added	Image Added
Default Column Layouts		Test Execution TestRun Columns	Image Added
		Test TestRun Columns	Image Added	Image Added - Available under "Test Test Runs Columns" at Project Configuration → Default Column Layouts
		Test PreCondition Columns	Image Added	Image Added - Available under "Precondition Tests Columns" at Project Configuration → Default Column Layouts
		Test Test Set Columns	Image Added	Image Added - Available under Project Configuration → Default Column Layouts
		Test Test Plan Columns	Image Added	Image Added - Available under Project Configuration → Default Column Layouts
		Test Set Test Columns	Image Added	Image Added - Available under Project Configuration → Default Column Layouts
		Test Plan Test Columns	Image Added	Image Added - Available under Project Configuration → Default Column Layouts
		Test Plan Test Execution Columns	Image Added	Image Added - Available under Project Configuration → Default Column Layouts
		Test Plan Test Runs Executions Columns		Image Added - Available under Project Configuration → Default Column Layouts
		Test Coverage Columns	Image Added
		Project Test Columns	Image Added
		Project Test Set Columns	Image Added
		Project Test Execution Columns	Image Added
		Project Test Plan Columns	Image Added
Parameter value lists			Image Added	Image Added
Integrity Checker		Integrity Checker	Image Added	- Similar validation is achieve at "Project Settings > Re-indexing"
		Calculated Custom Field Values	Image Added
		Automated Steps Library	Image Added
		Integrity of Hierarchical Test Organization	Image Added
License Management	License Information		Image Added	Image Added - Available under Global Settings → Manage Apps
Cloud Migration	Cloud Migration Pre-Flight Checker		Image Added	N/A
- Features				Image Added
- Test Environments			Image Added There is no centralised setting, but it can be edited from an issue screen.	Image Added
- BDD Step Libraries			Only available at the project level.	Image Added Ability to manage the BDD Steps Library globally and share it across projects.
- Cucumber	Cucumber Export Prefixes	Test	Image Added Available in Global Setting → Miscellaneous	Image Added
		Pre Condition		Image Added
		Test Set		Image Added
		Requirement		Image Added
	Cucumber Language	Language		Image Added
	Cucumber Export	Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags		Image Added
		Generate features by requirements		Image Added
		Generate features file name using summary		Image Added
- Test Run Archiving			Image Added After Xray 4.9.3 it's already possible to define an auto-archive feature linked to a Test Execution which will also affect the Test Run	Image Added
- Test Case Designer		Add Custom URL	Image Added Available in Global Setting → Xray Enterprise	Image Added
- API Keys		Create API Key	N/A	Image Added
- Storage		Refresh Storage Usage	N/A	Image Added
- Storage		Filters	N/A	Image Added
- Backup		With Attachments	Image Added Available as a Jira function not only to backup but also to restore/import.	Image Added
- Backup		Create Backup		Image Added
- Health Check		Reinstall Xray		Image Added

UI Expand

title	Project Level Settings

Setting			Server	Cloud
Test Step Custom Fields		Create	Image Added	Image Added
Test Run Custom Fields		Create	Image Added	Image Added
Parameter values lists		Add Global List	Image Added	Image Added
Parameter values lists		Create List	Image Added	Image Added
Remote Jobs Trigger			Image Added	Image Added
Document Generator	Document Generator Templates	Add	Image Added	Image Added
Document Generator	Document Generator Templates	Store	Image Added	Image Added
Disable Xray Requirement Coverage			Image Added	- To disable Requirement Coverage you just need to remove issue types from the Test Coverage menu.
Import Automated Steps			Image Added	Image Added - Available under Global Settings → BDD Steps Library
Disable Xray Notifications			Image Added
- Summary		Add Xray Issue Types in Project	Image Added Available through the action button located on the top right corner after accessing Project Settings.	Image Added
- Miscellaneous	Enable Project Settings		Image Added	Image Added
	Test Run Options	Display Manual Test Results table in short view	Image Added	Image Added
		Can Edit Test Run Date	Image Added	Image Added
		Fail All Steps	Image Added	Image Added
		Inline Execute Tests	Image Added	Image Added
		Send email notifications to Test Run assignee	Image Added	Image Added
		Track Time	Image Added	Image Added
		Set the value of the Time Tracker	Image Added	Image Added
	Defect Links	Link Defects with Test	Image Added	Image Added
		Link Defects with Test Execution	Image Added	Image Added
		Link Defects with Covered Issues	Image Added	Image Added
	Disallow executions of Tests with workflow statuses	Choose the workflow statuses in which the Tests are not allowed to be executed.	Image Added	Image Added
	Disallow executions with workflow statuses	Choose the workflow statuses in which the Test Execution issues will not allow executing Tests.	Image Added	Image Added
	Defect Default Values	Label	Image Added	Image Added
	Defect Default Values	Component	Image Added	Image Added
- Test Coverage	Test Coverage	Available Issue Types	Image Added	Image Added
	Test Coverage	Coverable Issue Types		Image Added
	Test Coverage Hierarchy	Epic - Issues(Stories) relation		Image Added
		Issue - Sub-tasks relation		Image Added
		Issue Links relation		Image Added
		Issue Link Type Direction		Image Added
- Defect Mapping		Available Issue Types		Image Added
- Defect Mapping		Defect Issue Types		Image Added
- Test Types		Add New Test Type Option	Image Added Not possible to set as Project Setting. Available as a Global Setting under Issue Test Types	Image Added
- Test Environments	Project Test Environments	Add Environment	Image Added Not possible to set as Project Setting. There is no centralized setting, but it can be edited from an issue screen.	Image Added
	Project Test Environments	Create Environment		Image Added
	Settings	Create Inline Test Environments	It's not possible to disable the creation of Test Environments.	Image Added
- BDD Step Library	Step index heuristics	Quoted strings e.g. "red", "blue"		Image Added
		Numbers e.g. 355, 2.3		Image Added
		Enums e.g. LEFT, RIGHT, CENTER		Image Added
	Permissions			Image Added
- Default Column Layouts	Test	Test Preconditions Columns	Image Added	Image Added
		Test Test Sets Columns	Image Added	Image Added
		Test Test Plans Columns	Image Added	Image Added
		Test Test Runs Columns	Image Added	Image Added
	Test Execution	Test Execution Tests Columns	Image Added	Image Added
	Pre Condition	Precondition Tests Columns	Image Added	Image Added
	Test Set	Test Set Tests Columns	Image Added	Image Added
	Test Plan	Test Plan Tests Columns	Image Added	Image Added
		Test Plan Test Executions Columns	Image Added	Image Added
		Test Plan Test Runs Executions Columns		Image Added
- Re-Indexing		Re-Index	Image Added Available as a Jira feature ("Re-index project")	Image Added

Understand the icons:

- Available in Xray Cloud but with some differences or minor UI adjustments

- Not available in Xray Cloud

- Extra option or functionality in Xray Cloud

- Menus that are exclusive to Xray Cloud

Content

Space Tools

Versions Compared

Old Version 3

New Version Current

Key