You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 31 Next »


This article explains in deep detail the differences between Xray Cloud Administration & Configuration. 

First, to understand the differences between Xray Cloud Administration & Xray Data Center,  let's clarify some concepts: 

  • Global Settings - Xray settings that apply to all projects that use Xray. Global settings could be access by Jira Administration > Apps.
  • Project Settings - Xray settings that are aplicable to one specific project. In case of you need to replicate the setting per several projects, you need to apply the configuration to all projects that need the same setting. Xray Projects Settings are accessible at Project > Project Settings.


The main difference between Xray Cloud Administration & Xray Data Center is that in Cloud you have a much better control of the settings at a project level.

Find a comparison view of the settings and features in Server / DC vs Cloud about Administration & Configuration on the above table.


This a comparison on settings that you can control on Xray Administration ( Global & project level). To understand if a specific feature comparison please use the Xray Server/Data Center and Xray Cloud.


Xray Global Settings

GroupSetting

Xray Server/ DC

(Standard & Enterprise)

Xray Cloud

(Standard & Enterprise)

Miscellaneous Settings

The Global Configurations for Xray.


Display the Pre-Conditions section before the Test Details

cross mark
Display Manual Test Results table in short view

plus sign cloud Available under Global by default and per Project after enabling it.

Project admins can configure Test Step Custom Fields

warning cloud  Available by default on the project level through Test Step Fields, no longer a Global Setting

Project admins can configure Test Run Custom Fields

warning cloud  Available by default on the project level through Test Run Custom Fields, no longer a Global Setting

Test Run OptionsSet final Test Run status

cross mark

Inline Execute Tests

Restrict test execution to the assignee

cross mark

Fail All Steps/Examples                                                

warning cloud Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.

Restrict automated Test status

(error) cloud - By default, the automated Test status can be set manually.

Can Edit TestRun Dates

warning cloud The setting is available under Project Settings → Miscellaneous

Track Time

Set the value of the Time Tracker

Enable Test Run Status history log in Test Executions

cross mark
Defect LinksLink Defects with Test

Link Defects with Test Execution

Link Defects with Requirement

warning cloud The menu is "Linked Defects with Covered Issues"

User Groups allowed to add Xray Issue Types

warning cloud This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)

NotificationsUser Groups allowed to add/remove Xray Notifications

(error) cloud - Xray Notifications are not available in Cloud.

Final Test Run statuses that may trigger notifications

Hierarchical Test OrganizationEnable Hierarchical Test organization

(error) cloud - By default is set with Hierarchical Organization

Project Roles allowed the edit Test Repository information

(error) cloud - Anyone with access to the project can edit Test Repo info.

Workflow StatusDisallow executions of Tests with workflow statuses

Disallow executions with workflow statuses

In progress test Execution workflow status

cross mark
Resolved Test Execution workflow status

cross mark
Resolution for Resolved Test Execution

cross mark
Clone IssuesAssociate a cloned Test with all original Test Sets

cross mark
Associate a cloned Test with all original Test Plans

cross mark
Defect Default ValuesEnvironment

(error) cloud - Although the option does not exist, It behaves with the default linked to "Test"

Steps to Reproduce

cross mark

Version                              

(error) cloud - By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by the FixVersion value of Test Execution.

Label



Component

Automated Steps LibraryEnable Automated Steps Library                                    

cross mark


Validate Cucumber Scenarios

cross mark
Cucumber Export PrefixesTest

warning cloud - Available under Global Settings → Cucumber". Unable to create a prefix for a Test Plan.

Pre-Condition

Test Set

Test Plan

Requirement

Cucumber LanguageLanguage

Cucumber ExportReplace dash [ - ] with underscore [ _ ] when exporting issue keys as tags

Generate features by requirements

Cucumber export feature name

Document GeneratorEnable Document Generator


warning cloud Available under Global Settings Miscellaneous & Feature

Max number of issues that can be exported

cross mark

Requirements ReportsMax number of requirements per report or gadget

cross mark
Requirements TestsMaximum number of Links added to a Requirement

cross mark
GadgetsTest Evolution Tests Limit

cross mark
Test Evolution Test Executions Limit

cross mark
Test Runs list limit

cross mark
Tests per Test PlanTests per Test Plan Maximum allowed

cross mark
Xray REST APIXray REST API - Max results per request

cross mark
Associating a Test Execution to a Test Plan and importing Test results

cross mark
Bulk operationsMax Test Runs for bulk operations

cross mark
DatasetsMaximum size for parameter values

cross mark
Xray Exploratory AppEnable Xray Exploratory App execution links

cross mark
Usage MetricsEnable Xray Analytics

cross mark
Thread Pool SizeThread Pool Size

cross mark
Chat SupportEnable In-app Chat Support

NotificationsEnable Xray notifications

Show Xray notifications button

Custom FieldsCustom FieldsTest Run Status Custom Field Version

cross mark

Test Set Status Custom Field Version

cross mark
Requirement Status Custom Field Versions

cross mark

 MaintenanceRecalculate Requirement Status

cross mark

Test TypesManage Test TypesManage Test Type

warning cloud

Available under "Global Settings – Test Types" and "Project Settings – Test Types". 

In Xray Cloud it's not possible to set different Test Types to Test & Precondition, meaning that it applies to both issue types. Learn more <link>

Manager Pre-Condition Type

Xray EnterpriseXray Enterprise SettingsXray Test Case Designer


Issue Type Mapping
Issue Type MappingAvailable Issue Types


Requirement Issue Types


Defect Issue Types


Sub-RequirementsSub-Tasks/Links


Epic - Story relation as a Requirement


Issue Link Type



Requirement Coverage
Requirement Coverage Strategy


Ignore Requirements with Status


Ignore Requirements with Label


Ignore Tests with Status


 


 Separation of concerns


 Include Previous Version Requirements


 Show Flatten Requirements


Document GeneratorDocument Generator Templates


Requirement Projects


Test Statuses

Test Statuses

Manage custom Test Run statuses for Xray


Preferences


Test Step Statuses

Manage custom Test Step statuses for Xray


Default Column LayoutsTest Execution TestRun Columns














Parameter value lists


Integrity CheckerIntegrity Checker


 Calculated Custom Field Values


 Automated Steps Library


 Integrity of Hierarchical Test Organization


License ManagementLicense Information


Cloud MigrationCloud Migration Pre-Flight Checker
















































































































Xray Linking Restrictions

(error) cloud
Manage Test Types
Manage Test Type

warning cloud

Available under "Global Settings – Test Types" and "Project Settings – Test Types". 

In Xray Cloud it's not possible to set different Test Types to Test & Precondition, meaning that it applies to both issue types. Learn more <link>


Manager Pre-Condition Type

Coverage & Defects Configuration

 

warning cloud Available under Project Configuration → Test Coverage & Defects Mapping, meaning that you can change your setting per project. 

Sub-Requirements

?

Workflow & Notifications

Migration & Copy

(error) cloud
Backup & Restore


Backup


Restore

(error) cloud

Xray in-App Notifications

Archiving Xray Issues

plus sign cloud Adds new feature:  Auto-Archiving

Storage

Not Applicable

Storage is managed on-premise

plus sign cloud Adds new feature Storage Management

Miscellaneous Settings


Display the Pre-Conditions section before the Test Details

(error) cloud

Display Manual Test Results table in short view

plus sign cloud Available under Global by default and per Project after enabling it.


Project admins can configure Test Step Custom Fields

warning cloud  Available by default on project level through Test Step Fields, no longer a Global Setting


Project admins can configure Test Run Custom Fields

warning cloud  Available by default on project level through Test Run Custom Fields, no longer a Global Setting


Set final Test Run status

(error) cloud


Inline Execute Tests


Restrict tests execution to the assignee

(error) cloud


Fail All Steps/Examples                                                


warning cloud Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.


Restrict automated Test status

(error) 

By default, the automated Test status can be set manually.


Can Edit TestRun Dates


warning cloud The setting is available under Project Settings → Miscellaneous


Track Time


Set the value of the Time Tracker

 Enable Test Run Status history log in Test Executions

(error) cloud

Link Defects with Test


Link Defects with Test Execution


Link Defects with Requirement

warning cloud The menu is "Linked Defects with Covered Issues"


User Groups allowed to add Xray Issue Types                              

warning cloud This permission is controlled by Jira permissions (only project administrators can add Xray issue Types to a project)


User Groups allowed to add/remove Xray Notifications

(error) 

Xray Notifications are not available in Cloud.


Final Test Run statuses that may trigger notifications

(error) 

Xray Notifications are not available in Cloud.

 Enable Hierarchical Test organization

(error) cloud

By default is set with Hierarchical Organization


Project Roles allowed the edit Test Repository information

(error) cloud

Anyone with access to the project can edit Test Repo info.


Disallow executions of Tests with workflow statuses


Disallow executions with workflow statuses


In progress test Execution workflow status

(error) cloud

Resolved Test Execution workflow status

(error) cloud

Resolution for Resolved Test Execution

(error) cloud
 Associate a cloned Test with all original Test Sets

(error) cloud
 Associate a cloned Test with all original Test Plans

(error) cloud
 Environment

(error) cloud

Although the option does not exist, It behaves with the default linked to "Test"

 Steps to Reproduce

(error) cloud


Version                              

(error) cloud

By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution.


Label




Component

 Enable Automated Steps Library                                    

(error) cloud



Validate Cucumber Scenarios

(error) cloud

Cucumber Export Prefixes                             


warning cloud Available under Global Settings → Cucumber" but unable to create a prefix for a Test Plan.


Cucumber Language


warning cloud Setting moved to a dedicated option in the menu tab: Global Settings → Cucumber


Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags


Generate features by requirements


Cucumber export feature name

 Enable Document Generator


warning cloud Available under Global Settings Miscellaneous & Feature


Max number of issues that can be exported

(error) cloud

Max number of requirements per report or gadget

(error) cloud

Maximum number of Links added to a Requirement

(error) cloud

Test Evolution Tests Limit

(error) cloud

Test Evolution Test Executions Limit

(error) cloud

Test Runs list limit

(error) cloud

Tests per Test Plan Maximum allowed

(error) cloud
 Xray REST API - Max results per request

(error) cloud

Associating a Test Execution to a Test Plan and importing Test results

(error) cloud

Max Test Runs for bulk operations

(error) cloud

Maximum size for parameter values

(error) cloud
 Enable Xray Exploratory App execution links

(error) cloud
 Enable Xray Analytics

(error) cloud

Thread Pool Size

(error) cloud

Enable In-app Chat Support


Enable Xray notifications

 Show Xray notifications button

Test Environmentscross mark

plus sign cloud Possible to manage at a Global level & project level.

Automated / BDD Step Libraries

warning

Not available as a Global setting, only as a project setting under the name "Automated Step Library"

plus sign cloud Possible to manage at a Global level.

Parameter value lists

Cucumber

plus sign cloud
Test Run Archiving
Auto Archiving

warning

Ability to manually archive Test Runs

plus sign cloud

Adds Auto Archive Feature

API Keys

Not Applicable

Access levels are managed on-premise

Storage

Not Applicable

storage is managed on-premise

Health Checkcross mark

Features
Feature Togglingcross mark


Setting
ServerCloud
Project Organization

Configuring Xray Test Project

warning cloud

cloudAvailable under "Project Configuration → Summary"

Requirements per ProjectRequirement Coverage Strategy

warning cloud

Available under "Project Configuration → Test Coverage & Defects Mapping"

Ignore Requirements with Status


Ignore Requirements with Label


Ignore Tests with Status


Requirement Historical Chart Days


Include Previous Version Requirements


Show Flatten Requirements


Separation of concerns

(error) cloud
Configure Xray with an existent Project

warningcloud

Available under "Project Configuration → Summary"

Using Xray Template

(error) cloud
Agile Boards

warning cloud

Available with limitations. We are only able to use 3 Xray Custom Fields, we are unable to showcase the "Requirement Status" field (one of the most used in DC/Server)

Permissions

(error) cloud

(Permissions are Jira wise)

SummaryNot Applicable

Issue Types MappingNot ApplicableOnly Available for Team Managed Projects
Test Coverage

warning

Available under the name Issue Type Mapping

Defect Mapping

Test Types

Test Environmentscross mark


plus sign cloud Ability to manage Test Environment at a project level.

BDD Step LibraryAvailable under the name "Automated Steps Library"

Test Step Fields

warningcloud Available under Project Settings → Test Step Custom Fields

Test Run Custom Fields

warningcloud Available under Project Settings → Test Run Custom Fields

Parameter value lists

Default Column LayoutsTest Execution TestRun Columns

Test TestRun Columns

Test PreCondition Columns

Test Test Set Columns

Test Test Plan Columns

Test Set Test Columns

Test Plan Test Columns

Test Plan Test Execution Columns

Test Coverage Columns

(error) cloud
Project Test Columns

(error) cloud
Project Test Set Columns

Project Test Execution Columns

Project Test Plan Columns

Precondition Tests Columns

Re-Indexing


Understand the icons: 

warning cloud - Available in Xray Cloud but with some differences or minor UI adjustments

(error) cloud - Not available in Xray Cloud

plus sign cloud - Extra option or functionality in Xray Cloud


  • No labels