View Source

This article explains in deep detail the differences between Xray Server/DC & Xray Cloud Administration & Configuration .

First, to understand the differences between Xray Cloud Administration & Xray Data Center, let's clarify some concepts:

Global Settings - Xray settings that apply to all projects that use Xray. Global settings could be access by Jira Administration > Apps.

At Xray, you can override global settings and enable them as Project Settings.

Project Settings - Xray settings that are aplicable to one specific project. In case of you need to replicate the setting per several projects, you need to apply the configuration to all projects that need the same setting. Xray Projects Settings are accessible at Project > Project Settings.

Find a comparison view of the settings and features in Server / DC vs Cloud about Administration & Configuration on the above table.

This a comparison on settings that you can control on Xray Administration ( Global & project level). To understand if a specific feature comparison please use the Xray Server/Data Center and Xray Cloud.

Xray Global Settings	Group	Setting	Xray Server/ DC (Standard & Enterprise)	Xray Cloud (Standard & Enterprise)
Miscellaneous Settings	The Global Configurations for Xray.	Display the Pre-Conditions section before the Test Details
		Display Manual Test Results table in short view		Available under Global by default and per Project after enabling it.
		Project admins can configure Test Step Custom Fields		Available by default on the project level through Test Step Fields, no longer a Global Setting
		Project admins can configure Test Run Custom Fields		Available by default on the project level through Test Run Custom Fields, no longer a Global Setting
	Test Run Options	Set final Test Run status
		Inline Execute Tests
		Restrict Test Execution to the assignee
		Fail All Steps/Examples		Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.
		Restrict automated Test status		- By default, the automated Test status can be set manually.
		Can Edit TestRun Dates		The setting is available under Project Settings → Miscellaneous
		Track Time
		Set the value of the Time Tracker
		Enable Test Run Status history log in Test Executions
	Defect Links	Link Defects with Test
		Link Defects with Test Execution
		Link Defects with Requirement		The menu is "Linked Defects with Covered Issues"
	User Groups allowed to add Xray Issue Types			This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)
	Notifications	User Groups allowed to add/remove Xray Notifications		- Xray Notifications (Xray Events) are not available in the Cloud.
	Notifications	Final Test Run statuses that may trigger notifications
	Hierarchical Test Organization	Enable Hierarchical Test organization		- By default is set with Hierarchical Organization, meaning that Test Repository & Test Plan Board is available from the sidebar. You are not able to disable it.
	Hierarchical Test Organization	Project Roles allowed the edit Test Repository information		- Anyone with access to the project can edit Test Repo info.
	Workflow Status	Disallow executions of Tests with workflow statuses
		Disallow executions with workflow statuses
		In progress test Execution workflow status
		Resolved Test Execution workflow status
		Resolution for Resolved Test Execution
	Clone Issues	Associate a cloned Test with all original Test Sets
	Clone Issues	Associate a cloned Test with all original Test Plans
	Defect Default Values	Environment		- By default, when creating a defect, it inherits the environment set before the Test Run.
		Steps to Reproduce		- By default the steps are included in the Defect. Your are not able to disable this behaviour.
		Version		- By default, the defect’s Affect Version field is populated with the value of the FixVersion field of the Test Execution.
		Label
		Component
	Automated Steps Library	Enable Automated Steps Library		- Automated Steps Library is enabled by default. You are not able to disable it.
	Automated Steps Library	Validate Cucumber Scenarios
	Cucumber Export Prefixes	Test		- Available under Global Settings → Cucumber". - Unable to create a prefix for a Test Plan.
		Pre-Condition
		Test Set
		Test Plan
		Requirement
	Cucumber Language	Language		- Available under Global Settings → Cucumber".
	Cucumber Export	Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags		- Available under Global Settings → Cucumber".
		Generate features by requirements		- Available under Global Settings → Cucumber".
		Cucumber export feature name		- Only available the possibility to "Generate feature file name using summary", under Global Settings → Cucumber".
	Document Generator	Enable Document Generator		Available under Global Settings → Features
	Document Generator	Max number of issues that can be exported
	Requirements Reports	Max number of requirements per report or gadget
	Requirements Tests	Maximum number of Links added to a Requirement
	Gadgets	Test Evolution Tests Limit
		Test Evolution Test Executions Limit
		Test Runs list limit
	Tests per Test Plan	Tests per Test Plan Maximum allowed
	Xray REST API	Xray REST API - Max results per request
	Xray REST API	Associating a Test Execution to a Test Plan and importing Test results
	Bulk operations	Max Test Runs for bulk operations
	Datasets	Maximum size for parameter values
	Xray Exploratory App	Enable Xray Exploratory App execution links		- By default within the context of a Test Run, you have available a button which allows you to "Execute with Exploratory App"
	Usage Metrics	Enable Xray Analytics		- By default, Xray Analytics is enabled. You are not able to disable it.
	Thread Pool Size	Thread Pool Size
	Chat Support	Enable In-app Chat Support
	Notifications	Enable Xray notifications		Available under Global Settings → Features
	Notifications	Show Xray notifications button
Custom Fields	Custom Fields	Test Run Status Custom Field Version		- By default, it will behave as if "No Version" is selected.
		Test Set Status Custom Field Version		- By default, it will behave as if "No Version" is selected.
		Requirement Status Custom Field Versions		- By default, it will behave as if "No Version" is selected.
	Maintenance	Recalculate Requirement Status		Available "Re-indexing" at Project Settings, this will recalculate the requirement status for a specific project.
Permissions		Xray Test Repository Permissions	(under Issues > Permission Schemes)
Test Types	Manage Test Types	Manage Test Type		- Available under "Global Settings – Test Types" and "Project Settings – Test Types". - In Xray Cloud it's not possible to set different Test Types to Test & Precondition, meaning that it applies to both issue types. Learn more Changing the Type of a Test
Test Types	Manage Test Types	Manager Pre-Condition Type
Xray Enterprise	Xray Enterprise Settings	Xray Test Case Designer		- Available under "Global Settings – Test Case Designer
Issue Type Mapping	Issue Type Mapping	Requirement Issue Types		- Available under Project Configuration → Test Coverage. Requirement Issue Issues are named Coverable Issue Issues in Xray Cloud. - You can change your setting per project.
	Issue Type Mapping	Defect Issue Types		- Available under Project Configuration → Defects Mapping. - You can change your setting per project.
	Sub-Requirements	Sub-Tasks/Links
		Epic - Story relation as a Requirement
		Issue Link Type		- Available as "Issue Links Relation".
		Direction		- Available as "Issue Link Type Direction"
Requirement Coverage		Requirement Coverage Strategy
		Ignore Requirements with Status
		Ignore Requirements with Label
		Ignore Tests with Status
		Requirement Historical Chart Days
		Separation of concerns
		Include Previous Version Requirements
		Show Flatten Requirements
Document Generator		Document Generator Templates
Requirement Projects				It's not possible to list all Xray Project with Requirement Coverage enabled.
Test Statuses	Test Statuses	Manage custom Test Run statuses for Xray
Test Statuses	Preferences	Final statuses have precedence over non-final statuses		- Available in each report filter and selected by default
Test Step Statuses		Manage custom Test Step statuses for Xray
Default Column Layouts		Test Execution TestRun Columns
		Test TestRun Columns		- Available under "Test Test Runs Columns" at Project Configuration → Default Column Layouts
		Test PreCondition Columns		- Available under "Precondition Tests Columns" at Project Configuration → Default Column Layouts
		Test Test Set Columns		- Available under Project Configuration → Default Column Layouts
		Test Test Plan Columns		- Available under Project Configuration → Default Column Layouts
		Test Set Test Columns		- Available under Project Configuration → Default Column Layouts
		Test Plan Test Columns		- Available under Project Configuration → Default Column Layouts
		Test Plan Test Execution Columns		- Available under Project Configuration → Default Column Layouts
		Test Plan Test Runs Executions Columns		- Available under Project Configuration → Default Column Layouts
		Test Coverage Columns
		Project Test Columns
		Project Test Set Columns
		Project Test Execution Columns
		Project Test Plan Columns
Parameter value lists
Integrity Checker		Integrity Checker		- Similar validation is achieve at "Project Settings > Re-indexing"
		Calculated Custom Field Values
		Automated Steps Library
		Integrity of Hierarchical Test Organization
License Management	License Information			- Available under Global Settings → Manage Apps
Cloud Migration	Cloud Migration Pre-Flight Checker			N/A
- Features
- Test Environments			There is no centralised setting, but it can be edited from an issue screen.
- BDD Step Libraries			Only available at the project level.	Ability to manage the BDD Steps Library globally and share it across projects.
- Cucumber	Cucumber Export Prefixes	Test	Available in Global Setting → Miscellaneous
		Pre Condition
		Test Set
		Requirement
	Cucumber Language	Language
	Cucumber Export	Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags
		Generate features by requirements
		Generate features file name using summary
- Test Run Archiving			After Xray 4.9.3 it's already possible to define an auto-archive feature linked to a Test Execution which will also affect the Test Run
- Test Case Designer		Add Custom URL	Available in Global Setting → Xray Enterprise
- API Keys		Create API Key	N/A
- Storage		Refresh Storage Usage	N/A
- Storage		Filters	N/A
- Backup		With Attachments	Available as a Jira function not only to backup but also to restore/import.
- Backup		Create Backup
- Health Check		Reinstall Xray

Setting			Server	Cloud
Test Step Custom Fields		Create
Test Run Custom Fields		Create
Parameter values lists		Add Global List
Parameter values lists		Create List
Remote Jobs Trigger
Document Generator	Document Generator Templates	Add
Document Generator	Document Generator Templates	Store
Disable Xray Requirement Coverage				- To disable Requirement Coverage you just need to remove issue types from the Test Coverage menu.
Import Automated Steps				- Available under Global Settings → BDD Steps Library
Disable Xray Notifications
- Summary		Add Xray Issue Types in Project	Available through the action button located on the top right corner after accessing Project Settings.
- Miscellaneous	Enable Project Settings
	Test Run Options	Display Manual Test Results table in short view
		Can Edit Test Run Date
		Fail All Steps
		Inline Execute Tests
		Send email notifications to Test Run assignee
		Track Time
		Set the value of the Time Tracker
	Defect Links	Link Defects with Test
		Link Defects with Test Execution
		Link Defects with Covered Issues
	Disallow executions of Tests with workflow statuses	Choose the workflow statuses in which the Tests are not allowed to be executed.
	Disallow executions with workflow statuses	Choose the workflow statuses in which the Test Execution issues will not allow executing Tests.
	Defect Default Values	Label
	Defect Default Values	Component
- Test Coverage	Test Coverage	Available Issue Types
	Test Coverage	Coverable Issue Types
	Test Coverage Hierarchy	Epic - Issues(Stories) relation
		Issue - Sub-tasks relation
		Issue Links relation
		Issue Link Type Direction
- Defect Mapping		Available Issue Types
- Defect Mapping		Defect Issue Types
- Test Types		Add New Test Type Option	Not possible to set as Project Setting. Available as a Global Setting under Issue Test Types
- Test Environments	Project Test Environments	Add Environment	Not possible to set as Project Setting. There is no centralized setting, but it can be edited from an issue screen.
	Project Test Environments	Create Environment
	Settings	Create Inline Test Environments	It's not possible to disable the creation of Test Environments.
- BDD Step Library	Step index heuristics	Quoted strings e.g. "red", "blue"
		Numbers e.g. 355, 2.3
		Enums e.g. LEFT, RIGHT, CENTER
	Permissions
- Default Column Layouts	Test	Test Preconditions Columns
		Test Test Sets Columns
		Test Test Plans Columns
		Test Test Runs Columns
	Test Execution	Test Execution Tests Columns
	Pre Condition	Precondition Tests Columns
	Test Set	Test Set Tests Columns
	Test Plan	Test Plan Tests Columns
		Test Plan Test Executions Columns
		Test Plan Test Runs Executions Columns
- Re-Indexing		Re-Index	Available as a Jira feature ("Re-index project")

Understand the icons:

- Available in Xray Cloud but with some differences or minor UI adjustments

- Not available in Xray Cloud

- Extra option or functionality in Xray Cloud

- Menus that are exclusive to Xray Cloud