Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.


This article explains in deep detail the differences between Xray Server/DC & Xray Cloud Administration & Configuration . 

First, to understand the differences between Xray Cloud Administration & Xray Data Center,  let's clarify some concepts: 


  • Global Settings - Xray settings that apply to all projects that use Xray. Global settings could be access by Jira Administration > Apps. 


Tip

At Xray, you can override global settings and enable them as Project Settings.


  • Project Settings - Xray settings that are aplicable to one specific project. In case of you need to replicate the setting per several projects, you need to apply the configuration to all projects that need the same setting. Xray Projects Settings are accessible at Project > Project Settings.


Find a comparison view of the settings and features in Server / DC vs Cloud about Administration & Configuration on the above table.


Note

This a comparison on settings that you can control on Xray Administration ( Global & project level). To understand if a specific feature comparison please use the Xray Server/Data Center and Xray Cloud.


UI Expand
titleGlobal Level Settings

Xray Global Settings

GroupSetting

Xray Server/ DC

(Standard & Enterprise)

Xray Cloud

(Standard & Enterprise)

Miscellaneous Settings

The Global Configurations for Xray.


Display the Pre-Conditions section before the Test Details

Image Added

cross mark
Display Manual Test Results table in short view

Image Added

Image Added

plus sign cloud Available under Global by default and per Project after enabling it.

Project admins can configure Test Step Custom Fields

Image Added

Image Added

warning cloud  Available by default on the project level through Test Step Fields, no longer a Global Setting

Project admins can configure Test Run Custom Fields

Image Added

Image Added

warning cloud  Available by default on the project level through Test Run Custom Fields, no longer a Global Setting

Test Run OptionsSet final Test Run status

Image Added

cross mark

Inline Execute Tests

Image Added

Image Added

Restrict Test Execution to the assignee

Image Added

cross mark

Fail All Steps/Examples                                                

Image Added

Image Added

warning cloud

To reduce clutter in the previous view, we've created a simple table listing all it's available within Administration & Configuration when looking at Server/DC vs Cloud.

Understand the icons: 

warning cloud - Available in Xray Cloud but with some differences or minor UI adjustments

(error) cloud - Not available in Xray Cloud

plus sign cloud - Extra option or functionality in Xray Cloud

...

Feature / Setting

...

Server

...

Cloud

...

Archiving Xray Issues

...

Image Removed

...

plus sign cloud - Auto Archiving

...

Backup & Restore

...

Image Removed

...

warning cloud  Available under "Global Settings → Backup"

(error) cloud  Restore

...

Coverage & Defects Configuration

...

Image Removed

...

warning  Available under "Project Configuration → Test Coverage & Defects Mapping"

...

Custom Fields Configuration

...

Image Removed 

...

(error) cloud - Test Run Status Custom Field Version → behaves like "No Version" was selected.

(error) cloud - Test Set Status Custom Field Version → No behavior in sight

(error) cloud - Requirement Status Custom Field Versions → it behaves as if "No Version" was selected.

...

Demo Project

...

cross mark

...

plus sign cloud - Ability to set up a Demo Project

...

Global Settings → API Keys

...

cross mark

...

plus sign cloud - Ability to set up API Keys and manage who makes use of REST API

...

Global Settings → Backup

...

warning  Available under "Backup and Restore"

...

(tick)  Available

...

Global Settings → Features

...

cross mark

...

(tick)  Available

...

Global Settings → Health Check

...

cross mark

...

(tick)  Available

...

Global Settings → Miscellaneous

...

(tick)  Available in Miscellaneous

...

(tick)  Available

  • Test Run Options,
  • Defect Links,
  • Disallow executions of Tests with workflow statuses,
  • Disallow executions with workflow statuses
  • Defect Default Values → Label
  • Defect Default Values → Component
  • Enable Document Generator
  • Enable Chat Support

...

Global Settings → Storage

...

cross mark

...

(tick)  Available

...

Global Settings → Test Environments

...

cross mark

...

(tick)  Available

...

Global Settings → Test Run Archiving

...

warning Unavailable Auto Archiving, Manual Test Run Archive Available.

...

(tick)  Available

...

Global Settings → Test Types

...

Manage Test Types

...

(tick)  Available

...

Manage Test Types

...

Image Removed

...

warning cloud - Available under "Global Settings – Test Types" and "Project Settings – Test Types" after enabling it → Test Type define works for both Test and Precondition.

...

Migration & Copy

...

Image Removed

...

(error) cloud - Not available in Xray Cloud

...

Miscellaneous Settings

...

Image Removed

(error) cloudDisplay Pre-Conditions section before Test Details

warning Set final Test Run status → To review with Sofia. (Omisso)

(error) cloud - Restrict test execution to an assignee

...

Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.

Restrict automated Test status

Image Added

cross mark

(error) cloud -

...

By default, the automated Test status

...

(error) cloud - Can Edit TestRun Dates → However by default you can edit (Omisso)

can be set manually.

Can Edit TestRun Dates

Image Added

Image Added

warning cloud The setting is available under Project Settings → Miscellaneous

Track Time

Image Added

Image Added

Set the value of the Time Tracker

Image Added

Image Added

Enable Test Run Status history log in Test Executions

Image Added

cross mark
Defect LinksLink Defects with Test

Image Added

Image Added

Link Defects with Test Execution

Image Added

Image Added

Link Defects with Requirement

Image Added

Image Added

warning cloud

...

The menu is "Linked Defects with Covered Issues"

User Groups allowed to add Xray Issue Types

...

Image Added

Image Added

warning cloud This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)

Notifications
User Groups allowed to add/remove Xray Notifications

Image Added

cross mark

(error) cloud - Xray Notifications (Xray Events) are not available in the Cloud.

Final Test Run statuses that may trigger notifications

...

Image Added

Hierarchical Test OrganizationEnable Hierarchical Test organization

...

Image Added

cross mark

 warning cloud - By default is set with Hierarchical Organization

...

, meaning that Test Repository & Test Plan Board is available from the sidebar. You are not able to disable it.

Project Roles allowed the edit Test Repository information

Image Added

cross mark

(error) cloud - Anyone

...

Software Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the left panel

Business Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the horizontal project menu Apps → Testing Board.

...

with access to the project can edit Test Repo info.

...

Workflow StatusDisallow executions of Tests with workflow statuses

Image Added

Image Added

Disallow executions with workflow statuses

Image Added

Image Added

In progress test

...

Execution workflow status

...

Image Added

cross mark
Resolved Test Execution workflow status

Image Added

...

cross mark
Resolution for Resolved Test Execution

...

Image Added

cross mark
Clone IssuesAssociate a cloned Test with all original Test Sets

...

Image Added

cross mark
Associate a cloned Test with all original Test Plans

...

(error) Environment → Although the option does not exists, It behaves with the default linked to "Test"

(error) Steps to Reproduce → Normal comment section for documentation.

(error) Version → By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution.

(error) Enable Automated Steps Library → By default you can access:

Software Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the left panel

Business Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the horizontal project menu Apps → Testing Board.

(error) Validate Cucumber Scenarios

Image Added

cross mark
Defect Default ValuesEnvironment

Image Added

cross mark

(error) cloud - By default, when creating a defect, it inherits the environment set before the Test Run.

Steps to Reproduce

Image Added

cross mark

 warning cloud - By default the steps are included in the Defect. Your are not able to disable this behaviour.

Version                              

Image Added

cross mark

 warning cloud - By default, the defect’s Affect Version field is populated with the value of the FixVersion field of the Test Execution.

Label

Image Added

Image Added


Component

Image Added

Image Added

Automated Steps LibraryEnable Automated Steps Library                                    

Image Added

cross mark

 warning cloud - Automated Steps Library is enabled by default. You are not able to disable it.

Validate Cucumber Scenarios

Image Added

cross mark
Cucumber Export PrefixesTest

Image Added

Image Added

warning cloud -

...

Available under Global Settings → Cucumber"

...

.

(error) cloud - Unable to create a prefix for a Test Plan.





Pre-Condition

Image Added

Test Set

Image Added

Test Plan

Image Added

Requirement

Image Added

Cucumber LanguageLanguage

Image Added

Image Added

warning cloud - Available under Global Settings → Cucumber".

Cucumber ExportReplace dash [ - ] with underscore [ _ ] when exporting issue keys as tags

Image Added

Image Added

warning cloud - Available under Global Settings → Cucumber".

Generate features by requirements

Image Added

Image Added

warning cloud - Available under Global Settings → Cucumber".

Cucumber export feature name

Image Added

cross mark

warning cloud -  Only available the possibility to "Generate feature file name using summary

...

"

...

, under Global Settings → Cucumber"

...

.

Document GeneratorEnable Document Generator

Image Added

Image Added

warning cloud Available under Global Settings →  Features

...

Max number of issues that can be exported

...

Image Added

cross mark

Requirements Reports

...

Max number of requirements per report or gadget

...

Image Added

cross mark
Requirements Tests

...

Maximum number of Links added to a Requirement

...

Image Added

cross mark
Gadgets
Test Evolution Tests Limit

Image Added

cross mark

...

Test Evolution Test Executions Limit

Image Added

cross mark

...

Test Runs list limit

...

Image Added

cross mark
Tests per Test PlanTests per Test Plan

...

Maximum allowed

...

Image Added

cross mark
Xray REST APIXray REST API

...

- Max results per request

Image Added

cross mark
Associating a Test Execution to a Test Plan and importing Test results

...

Image Added

cross mark
Bulk operations

...

Max Test Runs for bulk operations

...

Image Added

cross mark
Datasets

...

Maximum size for parameter values

...

Image Added

cross mark
Xray Exploratory App
Enable Xray Exploratory App execution links

Image Added

cross mark

(error) cloud - By default within the context of a Test Run, you have available a button which allows you to "Execute with Exploratory App"

Usage MetricsEnable Xray Analytics

Image Added

cross mark

(error) cloud - By default, Xray Analytics is enabled. You are not able to disable it.

Thread Pool Size

...

Project Configuration → Agile Boards

...

(tick)  Available

...

warning  Available with limitations. e.g. --> unable to use custom fields.

...

Project Configuration → Configure Xray with an existent Project

...

(tick)  Available

...

warning  Available under "Project Configuration → Summary"

...

Project Configuration → Configuring Xray Test Project

...

(tick)  Available

...

warning  Available under "Project Configuration → Summary"

...

Project Configuration → Requirements per Project

...

(tick)  Requirement Coverage Strategy

(tick)  Ignore Requirements with Status

(tick)  Ignore Requirements with Label

(tick)  Ignore Tests with Status

(tick)  Requirement Historical Chart Days

(tick)  Include Previous Version Requirements

(tick)  Show Flatten Requirements

...

warning  Available under "Project Configuration → Test Coverage & Defects Mapping"

...

Project Configuration → Using Xray Template

...

(tick)  Available

...

(error) cloud - Not available in Xray Cloud

...

Project Configurations → Permissions

...

(tick)  Available

...

(error) cloud - Not available in Xray Cloud

...

Project Settings → BDD Step Library

...

(tick)  Available under Project Settings

...

(tick)  Available

...

Project Settings → Default Column Layouts

...

(tick) Test Execution TestRun Columns

(tick) Test TestRun Columns

(tick) Test PreCondition Columns

(tick) Test Test Set Columns

(tick) Test Test Plan Columns

(tick) Test Set Test Columns

(tick) Test Plan Test Columns

(tick) Test Plan Test Execution Columns

(tick) Test Coverage Columns

(tick) Project Test Columns

(tick) Project Test Set Columns

(tick) Project Test Execution Columns

(tick) Project Test Plan Columns

...

(tick) Test Execution TestRun Columns

(tick) Test TestRun Columns

(tick) Test PreCondition Columns

(tick) Test Test Set Columns

(tick) Test Test Plan Columns

(tick) Test Set Test Columns

(tick) Test Plan Test Columns

(tick) Test Plan Test Execution Columns

(error) cloud - Test Coverage Columns

(error) cloud - Project Test Columns

(tick) Project Test Set Columns

(tick) Project Test Execution Columns

(tick) Project Test Plan Columns

...

Project Settings → Defect Mapping

...

warning Available under Issue Type Mapping

...

(tick)  Ability to set up which issue types are considered Defects.

...

Project Settings → Miscellaneous

...

warning  Available under "Miscelaneous Settings"

...

(tick)  Available

  • Test Run Options,
  • Defect Links,
  • Disallow executions of Tests with workflow statuses,
  • Disallow executions with workflow statuses
  • Defect Default Values → Label
  • Defect Default Values → Component

...

Project Settings → Summary

...

cross mark

...

(tick)  Available

...

Project Settings → Test Coverage

...

warning Available under Issue Type Mapping

...

(tick)  Ability to set up which issue types are considered Requirements.

...

Project Settings → Test Environments

...

cross mark

...

(tick)  Ability to manage Test Environment at a project level.

...

Project Settings → Test Run Custom Fields

...

(tick)  Available under Project Settings

...

(tick)  Available

...

Project Settings → Test Step Fields

...

(tick)  Available under Project Settings

...

(tick)  Available

...

Project Settings →  Issue Types Mapping

...

cross mark

...

warning  Only Available for Team Managed Projects

...

Storage

...

cross mark

...

(tick)  Available

...

Workflow & Notifications

...

(tick)  Available

...

warning  Available under "Global Settings"

Thread Pool Size

Image Added

cross mark
Chat SupportEnable In-app Chat Support

Image Added

Image Added

NotificationsEnable Xray notifications

Image Added

Image Added

warning cloud Available under Global Settings →  Features

Show Xray notifications button

Image Added

cross mark

Custom FieldsCustom FieldsTest Run Status Custom Field Version

Image Added

cross mark

(error)  cloud- By default, it will behave as if "No Version" is selected.

Test Set Status Custom Field Version

Image Added

cross mark

(error)  cloud- By default, it will behave as if "No Version" is selected.

Requirement Status Custom Field Versions

Image Added

cross mark

(error)  cloud- By default, it will behave as if "No Version" is selected.

 MaintenanceRecalculate Requirement Status

Image Added

Image Added

warning cloud Available "Re-indexing" at Project Settings, this will recalculate the requirement status for a specific project.

Permissions

Xray Test Repository Permissions

Image Added

(under Issues > Permission Schemes)

cross mark

Test TypesManage Test TypesManage Test Type

Image Added

Image Added

warning cloud - Available under "Global Settings – Test Types" and "Project Settings – Test Types". 

(error)  cloud- In Xray Cloud it's not possible to set different Test Types to Test & Precondition, meaning that it applies to both issue types. Learn more 

Changing the Type of a Test
Manager Pre-Condition Type

Image Added

Xray EnterpriseXray Enterprise SettingsXray Test Case Designer

Image Added

Image Added

warning cloud - Available under "Global Settings – Test Case Designer

Issue Type Mapping
Issue Type MappingRequirement Issue Types

Image Added

Image Added

warning cloud  - Available under Project Configuration → Test Coverage. Requirement Issue Issues are named Coverable Issue Issues in Xray Cloud.

plus sign cloud - You can change your setting per project. 

 

Defect Issue Types

Image Added

Image Added

warning cloud  - Available under Project Configuration → Defects Mapping.

plus sign cloud - You can change your setting per project. 

Sub-RequirementsSub-Tasks/Links

Image Added

cross mark

Epic - Story relation as a Requirement

Image Added

Image Added

Issue Link Type

Image Added

Image Added

warning cloud  - Available as "Issue Links Relation".

Image Added

Image Added

warning cloud  - Available as "Issue Link Type Direction"

Requirement Coverage
Requirement Coverage Strategy

Image Added

cross mark

Ignore Requirements with Status

Image Added

cross mark

Ignore Requirements with Label

Image Added

cross mark

Ignore Tests with Status

Image Added

cross mark

Image Added

cross mark
Separation of concerns

Image Added

cross mark
Include Previous Version Requirements

Image Added

cross mark
Show Flatten Requirements

Image Added

cross mark
Document GeneratorDocument Generator Templates

Image Added

Image Added

Requirement Projects

Image Added

cross mark

It's not possible to list all Xray Project with Requirement Coverage enabled.

Test Statuses

Test Statuses

Manage custom Test Run statuses for Xray

Image Added

Image Added

Preferences

Image Added

Image Added

warning cloud  - Available in each report filter and selected by default

Test Step Statuses

Manage custom Test Step statuses for Xray

Image Added

Image Added

Default Column LayoutsTest Execution TestRun Columns

Image Added

cross mark

Image Added

Image Added

warning cloud  - Available under "Test Test Runs Columns" at  Project Configuration → Default Column Layouts 

Image Added

Image Added

warning cloud  - Available under "Precondition Tests Columns" at Project Configuration → Default Column Layouts

Image Added

Image Added

warning cloud  - Available under Project Configuration → Default Column Layouts

Image Added

Image Added

warning cloud  - Available under Project Configuration → Default Column Layouts

Image Added

Image Added

warning cloud  - Available under Project Configuration → Default Column Layouts

Image Added

Image Added

warning cloud  - Available under Project Configuration → Default Column Layouts

Image Added

Image Added

warning cloud  - Available under Project Configuration → Default Column Layouts

(info) cloud Test Plan Test Runs Executions Columns 


cross mark

Image Added

warning cloud  - Available under Project Configuration → Default Column Layouts

Image Added

cross mark

Image Added

cross mark

Image Added

cross mark

Image Added

cross mark

Image Added

cross mark
Parameter value lists

Image Added

Image Added

Integrity CheckerIntegrity Checker

Image Added

cross mark

warning cloud  - Similar validation is achieve at "Project Settings > Re-indexing"

 Calculated Custom Field Values

Image Added

cross mark
 Automated Steps Library

Image Added

cross mark
 Integrity of Hierarchical Test Organization

Image Added

cross mark
License ManagementLicense Information

Image Added

Image Added

warning cloud  - Available under Global Settings → Manage Apps

Cloud MigrationCloud Migration Pre-Flight Checker

Image Added

N/A

(info) cloud - Features

cross mark

Image Added

(info) cloud - Test Environments

Image Added

warning There is no centralised setting, but it can be edited from an issue screen.


Image Added


(info) cloud - BDD Step Libraries

cross mark

Only available at the project level.

Image Added

plus sign cloud  Ability to manage the BDD Steps Library globally and share it across projects.

(info) cloud - Cucumber








Cucumber Export PrefixesTest

Image Added

warning Available in Global Setting → Miscellaneous

Image Added

Image Added

Image Added

Requirement

Image Added

Cucumber LanguageLanguage

Image Added

Cucumber Export

Image Added

Image Added

Image Added

(info) cloud - Test Run Archiving

Image Added

warning After Xray 4.9.3 it's already possible to define an auto-archive feature linked to a Test Execution which will also affect the Test Run

Image Added

(info) cloud - Test Case Designer

Add Custom URL

Image Added

warning Available in Global Setting → Xray Enterprise

Image Added

(info) cloud - API Keys

Create API KeyN/A

Image Added

(info) cloud - StorageRefresh Storage UsageN/A

Image Added

FiltersN/A

Image Added

(info) cloud - Backup

With Attachments

Image Added

warning Available as a Jira function not only to backup but also to restore/import.

Image Added

Create Backup

Image Added

(info) cloud - Health CheckReinstall Xraycross mark

Image Added


UI Expand
titleProject Level Settings
Setting

ServerCloud
Test Step Custom Fields

Create

Image Added

Image Added

Test Run Custom Fields

Create

Image Added

Image Added

Parameter values lists

Add Global List

Image Added

Image Added

Create List

Image Added

Image Added

Remote Jobs Trigger

Image Added

Image Added

Document GeneratorDocument Generator Templates

Add

Image Added

Image Added

Store

Image Added

Image Added

Disable Xray Requirement Coverage

Image Added

cross mark

warning cloud  - To disable Requirement Coverage you just need to remove issue types from the Test Coverage menu.

Import Automated Steps

Image Added

Image Added

warning cloud  - Available under Global Settings → BDD Steps Library

Disable Xray Notifications

Image Added

cross mark

(info) cloud - Summary

 

Add Xray Issue Types in Project

Image Added

warning Available through the action button located on the top right corner after accessing Project Settings.

Image Added


(info) cloud - Miscellaneous
Enable Project Settings


Image Added

Image Added



Image Added



Image Added

Image Added


Image Added

Image Added


Image Added

Image Added


Image Added

Image Added


Image Added

Image Added


Image Added

Image Added


Image Added


Image Added


Image Added

Image Added


Image Added

Image Added


Image Added

Choose the workflow statuses in which the Tests are not allowed to be executed.

Image Added


Image Added

Choose the workflow statuses in which the Test Execution issues will not allow executing Tests.

Image Added


Image Added

Defect Default Values

Image Added

Image Added

Image Added

Image Added

(info) cloud - Test Coverage
Test Coverage
Available Issue Types

Image Added


Image Added

Coverable Issue Types

Image Added


Image Added

Image Added

Image Added

Issue Link Type Direction

Image Added

(info) cloud - Defect Mapping
Available Issue Types

Image Added

Defect Issue Types

Image Added

(info) cloud - Test Types

Add New Test Type Option

Image Added

(error) Not possible to set as Project Setting.

warning Available as a Global Setting under Issue Test Types

Image Added

(info) cloud - Test Environments


Project Test EnvironmentsAdd Environment

Image Added

(error) Not possible to set as Project Setting.

warning There is no centralized setting, but it can be edited from an issue screen.

Image Added

Create Environment

Image Added

SettingsCreate Inline Test Environments

cross mark

warning It's not possible to disable the creation of Test Environments.

Image Added

(info) cloud - BDD Step Library

Quoted strings e.g. "red", "blue"

cross mark

Image Added

Numbers e.g. 355, 2.3

cross mark

Image Added

Enums e.g. LEFT, RIGHT, CENTER

cross mark

Image Added

Permissions

cross mark

Image Added

(info) cloud - Default Column Layouts
Test

Image Added

Image Added

Image Added

Image Added

Image Added

Image Added

Image Added

Image Added

Test Execution

Image Added

Image Added

Pre Condition

Image Added

Image Added

Test Set

Image Added

Image Added

Test Plan

Image Added

Image Added

Image Added

Image Added

cross mark

Image Added

(info) cloud - Re-IndexingRe-Index

Image Added

warning Available as a Jira feature ("Re-index project")

Image Added


Understand the icons: 

warning cloud - Available in Xray Cloud but with some differences or minor UI adjustments

(error) cloud - Not available in Xray Cloud

plus sign cloud - Extra option or functionality in Xray Cloud

(info) cloud - Menus that are exclusive to

...

Xray Linking Restrictions

...

(tick)  Available

...

Xray Cloud