This article explains in deep detail the differences between Xray Server/DC & Xray Cloud Administration & Configuration . 

First, to understand the differences between Xray Cloud Administration & Xray Data Center,  let's clarify some concepts: 


  • Global Settings - Xray settings that apply to all projects that use Xray. Global settings could be access by Jira Administration > Apps. 


At Xray, you can override global settings and enable them as Project Settings.


  • Project Settings - Xray settings that are aplicable to one specific project. In case of you need to replicate the setting per several projects, you need to apply the configuration to all projects that need the same setting. Xray Projects Settings are accessible at Project > Project Settings.


Find a comparison view of the settings and features in Server / DC vs Cloud about Administration & Configuration on the above table.


This a comparison on settings that you can control on Xray Administration ( Global & project level). To understand if a specific feature comparison please use the Xray Server/Data Center and Xray Cloud.


Xray Global Settings

GroupSetting

Xray Server/ DC

(Standard & Enterprise)

Xray Cloud

(Standard & Enterprise)

Miscellaneous Settings

The Global Configurations for Xray.


Display the Pre-Conditions section before the Test Details

cross mark
Display Manual Test Results table in short view

plus sign cloud Available under Global by default and per Project after enabling it.

Project admins can configure Test Step Custom Fields

warning cloud  Available by default on the project level through Test Step Fields, no longer a Global Setting

Project admins can configure Test Run Custom Fields

warning cloud  Available by default on the project level through Test Run Custom Fields, no longer a Global Setting

Test Run OptionsSet final Test Run status

cross mark

Inline Execute Tests

Restrict Test Execution to the assignee

cross mark

Fail All Steps/Examples                                                

warning cloud Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.

Restrict automated Test status

cross mark

(error) cloud - By default, the automated Test status can be set manually.

Can Edit TestRun Dates

warning cloud The setting is available under Project Settings → Miscellaneous

Track Time

Set the value of the Time Tracker

Enable Test Run Status history log in Test Executions

cross mark
Defect LinksLink Defects with Test

Link Defects with Test Execution

Link Defects with Requirement

warning cloud The menu is "Linked Defects with Covered Issues"

User Groups allowed to add Xray Issue Types

warning cloud This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)

NotificationsUser Groups allowed to add/remove Xray Notifications

cross mark

(error) cloud - Xray Notifications (Xray Events) are not available in the Cloud.

Final Test Run statuses that may trigger notifications

Hierarchical Test OrganizationEnable Hierarchical Test organization

cross mark

 warning cloud - By default is set with Hierarchical Organization, meaning that Test Repository & Test Plan Board is available from the sidebar. You are not able to disable it.

Project Roles allowed the edit Test Repository information

cross mark

(error) cloud - Anyone with access to the project can edit Test Repo info.

Workflow StatusDisallow executions of Tests with workflow statuses

Disallow executions with workflow statuses

In progress test Execution workflow status

cross mark
Resolved Test Execution workflow status

cross mark
Resolution for Resolved Test Execution

cross mark
Clone IssuesAssociate a cloned Test with all original Test Sets

cross mark
Associate a cloned Test with all original Test Plans

cross mark
Defect Default ValuesEnvironment

cross mark

(error) cloud - By default, when creating a defect, it inherits the environment set before the Test Run.

Steps to Reproduce

cross mark

 warning cloud - By default the steps are included in the Defect. Your are not able to disable this behaviour.

Version                              

cross mark

 warning cloud - By default, the defect’s Affect Version field is populated with the value of the FixVersion field of the Test Execution.

Label


Component

Automated Steps LibraryEnable Automated Steps Library                                    

cross mark

 warning cloud - Automated Steps Library is enabled by default. You are not able to disable it.

Validate Cucumber Scenarios

cross mark
Cucumber Export PrefixesTest

warning cloud - Available under Global Settings → Cucumber".

(error) cloud - Unable to create a prefix for a Test Plan.





Pre-Condition

Test Set

Test Plan

Requirement

Cucumber LanguageLanguage

warning cloud - Available under Global Settings → Cucumber".

Cucumber ExportReplace dash [ - ] with underscore [ _ ] when exporting issue keys as tags

warning cloud - Available under Global Settings → Cucumber".

Generate features by requirements

warning cloud - Available under Global Settings → Cucumber".

Cucumber export feature name

cross mark

warning cloud -  Only available the possibility to "Generate feature file name using summary", under Global Settings → Cucumber".

Document GeneratorEnable Document Generator

warning cloud Available under Global Settings →  Features

Max number of issues that can be exported

cross mark

Requirements ReportsMax number of requirements per report or gadget

cross mark
Requirements TestsMaximum number of Links added to a Requirement

cross mark
GadgetsTest Evolution Tests Limit

cross mark
Test Evolution Test Executions Limit

cross mark
Test Runs list limit

cross mark
Tests per Test PlanTests per Test Plan Maximum allowed

cross mark
Xray REST APIXray REST API - Max results per request

cross mark
Associating a Test Execution to a Test Plan and importing Test results

cross mark
Bulk operationsMax Test Runs for bulk operations

cross mark
DatasetsMaximum size for parameter values

cross mark
Xray Exploratory AppEnable Xray Exploratory App execution links

cross mark

(error) cloud - By default within the context of a Test Run, you have available a button which allows you to "Execute with Exploratory App"

Usage MetricsEnable Xray Analytics

cross mark

(error) cloud - By default, Xray Analytics is enabled. You are not able to disable it.

Thread Pool SizeThread Pool Size

cross mark
Chat SupportEnable In-app Chat Support

NotificationsEnable Xray notifications

warning cloud Available under Global Settings →  Features

Show Xray notifications button

cross mark

Custom FieldsCustom FieldsTest Run Status Custom Field Version

cross mark

(error)  cloud- By default, it will behave as if "No Version" is selected.

Test Set Status Custom Field Version

cross mark

(error)  cloud- By default, it will behave as if "No Version" is selected.

Requirement Status Custom Field Versions

cross mark

(error)  cloud- By default, it will behave as if "No Version" is selected.

 MaintenanceRecalculate Requirement Status

warning cloud Available "Re-indexing" at Project Settings, this will recalculate the requirement status for a specific project.

Permissions

Xray Test Repository Permissions

(under Issues > Permission Schemes)

cross mark

Test TypesManage Test TypesManage Test Type

warning cloud - Available under "Global Settings – Test Types" and "Project Settings – Test Types". 

(error)  cloud- In Xray Cloud it's not possible to set different Test Types to Test & Precondition, meaning that it applies to both issue types. Learn more 

Changing the Type of a Test
Manager Pre-Condition Type

Xray EnterpriseXray Enterprise SettingsXray Test Case Designer

warning cloud - Available under "Global Settings – Test Case Designer

Issue Type Mapping
Issue Type MappingRequirement Issue Types

warning cloud  - Available under Project Configuration → Test Coverage. Requirement Issue Issues are named Coverable Issue Issues in Xray Cloud.

plus sign cloud - You can change your setting per project. 

 

Defect Issue Types

warning cloud  - Available under Project Configuration → Defects Mapping.

plus sign cloud - You can change your setting per project. 

Sub-RequirementsSub-Tasks/Links

cross mark

Epic - Story relation as a Requirement

Issue Link Type

warning cloud  - Available as "Issue Links Relation".

warning cloud  - Available as "Issue Link Type Direction"

Requirement Coverage
Requirement Coverage Strategy

cross mark

Ignore Requirements with Status

cross mark

Ignore Requirements with Label

cross mark

Ignore Tests with Status

cross mark

cross mark
Separation of concerns

cross mark
Include Previous Version Requirements

cross mark
Show Flatten Requirements

cross mark
Document GeneratorDocument Generator Templates

Requirement Projects

cross mark

It's not possible to list all Xray Project with Requirement Coverage enabled.

Test Statuses

Test Statuses

Manage custom Test Run statuses for Xray

Preferences

warning cloud  - Available in each report filter and selected by default

Test Step Statuses

Manage custom Test Step statuses for Xray

Default Column LayoutsTest Execution TestRun Columns

cross mark

warning cloud  - Available under "Test Test Runs Columns" at  Project Configuration → Default Column Layouts 

warning cloud  - Available under "Precondition Tests Columns" at Project Configuration → Default Column Layouts

warning cloud  - Available under Project Configuration → Default Column Layouts

warning cloud  - Available under Project Configuration → Default Column Layouts

warning cloud  - Available under Project Configuration → Default Column Layouts

warning cloud  - Available under Project Configuration → Default Column Layouts

warning cloud  - Available under Project Configuration → Default Column Layouts

(info) cloud Test Plan Test Runs Executions Columns 


cross mark

warning cloud  - Available under Project Configuration → Default Column Layouts

cross mark

cross mark

cross mark

cross mark

cross mark
Parameter value lists

Integrity CheckerIntegrity Checker

cross mark

warning cloud  - Similar validation is achieve at "Project Settings > Re-indexing"

 Calculated Custom Field Values

cross mark
 Automated Steps Library

cross mark
 Integrity of Hierarchical Test Organization

cross mark
License ManagementLicense Information

warning cloud  - Available under Global Settings → Manage Apps

Cloud MigrationCloud Migration Pre-Flight Checker

N/A

(info) cloud - Features

cross mark

(info) cloud - Test Environments

warning There is no centralised setting, but it can be edited from an issue screen.



(info) cloud - BDD Step Libraries

cross mark

Only available at the project level.

plus sign cloud  Ability to manage the BDD Steps Library globally and share it across projects.

(info) cloud - Cucumber








Cucumber Export PrefixesTest

warning Available in Global Setting → Miscellaneous

Requirement

Cucumber LanguageLanguage

Cucumber Export

(info) cloud - Test Run Archiving

warning After Xray 4.9.3 it's already possible to define an auto-archive feature linked to a Test Execution which will also affect the Test Run

(info) cloud - Test Case Designer

Add Custom URL

warning Available in Global Setting → Xray Enterprise

(info) cloud - API Keys

Create API KeyN/A

(info) cloud - StorageRefresh Storage UsageN/A

FiltersN/A

(info) cloud - Backup

With Attachments

warning Available as a Jira function not only to backup but also to restore/import.

Create Backup

(info) cloud - Health CheckReinstall Xraycross mark


Setting

ServerCloud
Test Step Custom Fields

Create

Test Run Custom Fields

Create

Parameter values lists

Add Global List

Create List

Remote Jobs Trigger

Document GeneratorDocument Generator Templates

Add

Store

Disable Xray Requirement Coverage

cross mark

warning cloud  - To disable Requirement Coverage you just need to remove issue types from the Test Coverage menu.

Import Automated Steps

warning cloud  - Available under Global Settings → BDD Steps Library

Disable Xray Notifications

cross mark

(info) cloud - Summary

 

Add Xray Issue Types in Project

warning Available through the action button located on the top right corner after accessing Project Settings.


(info) cloud - Miscellaneous
Enable Project Settings
















Choose the workflow statuses in which the Tests are not allowed to be executed.


Choose the workflow statuses in which the Test Execution issues will not allow executing Tests.


Defect Default Values

(info) cloud - Test Coverage
Test Coverage
Available Issue Types


Coverable Issue Types


Issue Link Type Direction

(info) cloud - Defect Mapping
Available Issue Types

Defect Issue Types

(info) cloud - Test Types

Add New Test Type Option

(error) Not possible to set as Project Setting.

warning Available as a Global Setting under Issue Test Types

(info) cloud - Test Environments


Project Test EnvironmentsAdd Environment

(error) Not possible to set as Project Setting.

warning There is no centralized setting, but it can be edited from an issue screen.

Create Environment

SettingsCreate Inline Test Environments

cross mark

warning It's not possible to disable the creation of Test Environments.

(info) cloud - BDD Step Library

Quoted strings e.g. "red", "blue"

cross mark

Numbers e.g. 355, 2.3

cross mark

Enums e.g. LEFT, RIGHT, CENTER

cross mark

Permissions

cross mark

(info) cloud - Default Column Layouts
Test

Test Execution

Pre Condition

Test Set

Test Plan

cross mark

(info) cloud - Re-IndexingRe-Index

warning Available as a Jira feature ("Re-index project")


Understand the icons: 

warning cloud - Available in Xray Cloud but with some differences or minor UI adjustments

(error) cloud - Not available in Xray Cloud

plus sign cloud - Extra option or functionality in Xray Cloud

(info) cloud - Menus that are exclusive to Xray Cloud