Xray for Jira Server/Data Center has been available in the Atlassian Marketplace since 2014.

Xray for Jira Cloud is an offshoot of the highly successful Xray for Jira Server. While there are many similarities between the two, there are some subtle differences due to the unique nature of Jira Cloud.

These are, in fact, two distinct products with separate roadmaps and release cycles. However, our goal is to make Xray for Jira Cloud as similar to Xray for Jira Server/Data Center as possible, while improving it where we can.

Migrating from Xray Server/DC and Xray Cloud

If you are looking to migrate your Jira Server/DC instance to Jira Cloud, please take a look at our Jira Cloud Migration Guide.

Feature Comparison

Below are the core differences between Xray for Jira Server/Data Center and Xray for Jira Cloud.


Xray StandardXray Enterprise *
Feature

Xray for JIRA Server/Data Center

(7.2.x)

Xray for Jira Cloud

Xray Enterprise Data Center Xray Enterprise for Jira Cloud
Test & Test Type
(Manual, Cucumber, Generic)




warning cloud Xray Custom fields and Test Steps can only be added after Issue creation (edit view).
(error) cloud Unable to filter by labels on predefined steps.

Parameterized Tests

Modular Tests

Test Case Versioncross markcross mark

Precondition

Test Case Designercross markcross mark

Test Set

warning cloud Export to Cucumber available in a different menu "..."

plus sign  cloud Ability to create ad-hoc Tests

Test Execution

warning cloud Export to Cucumber available in a different menu "..."

plus sign  cloud Ability to create ad-hoc Tests

Sub-Test Execution

warning cloud Export to Cucumber available in a different menu "..."

plus sign  cloud Ability to create ad-hoc Tests

Test Run

warning  Test Run archive is done by archiving the Test Execution.

warning cloud Archive options available under the Test Run Table.

warning  Test Run archive is done by archiving the Test Execution.

warning cloud Archive options available under the Test Run Table

Test Plan

warning cloud Interface & UI differences.

plus sign  cloud Ability to create ad-hoc Tests

Dynamic Test Planscross markcross mark

Cucumber Tests/ Preconditions

Test Environments

  warning  Test Environment Management not available as an Xray feature (controlled by dedicated label custom field where you can apply a label gadget for more control)

(tick) cloud Ability to manage Test Environments by project and globally

warning  Test Environment Management not available as an Xray feature (controlled by dedicated label custom field where you can apply a label gadget for more control)

(tick) cloud Ability to manage Test Environments by project and globally

Test Case Importer

Test Repository

plus sign  cloud Ability to filter Preconditions and to set views by Test Set

warning cloud There are navigation & UI differences with no impact on features

(error) cloud Unable to create or add Test Set / Execution / Plan from selected Tests

Test Plan Board

warning cloud Navigation & UI differences with no impact on features

Testing Board

cross mark 


cross mark 


Test Step Custom FIelds

Test Run Custom Fields

Automated Step Library / BDD Step Library

Remote Jobs Triggercross mark cross mark

Reports

(tick) Traceability

(tick) Overall Requirement Coverage 

(tick) Historical Requirement Coverage 

(tick) Tests Plans Report

(tick) Test Executions Report

(tick) Test Runs Report

(tick) Test List

(tick) Test Sets List

(tick) Test Executions List

(tick) Test Plan List


(error) Cross-project reports not available on Xray Standard.

(tick) Traceability

(tick) Overall Test Coverage

(error)  Historical Requirement Coverage 

(tick) Tests Plans Metrics

(error) Test Executions Report

(tick) Test Runs List

(tick) Test List

(tick) Test Sets List

(tick) Test Executions List

(tick) Test Plan List


(tick) Cross-project reports available 

warning cloud Visualization changes in some reports. ie.: Hierarchical and Flat view in Test Coverage Report.

(tick) Traceability

(tick) Overall Requirement Coverage 

(tick) Historical Requirement Coverage 

(tick) Tests Plans Report

(tick) Test Executions Report

(tick) Test Runs Report

(tick) Test List

(tick) Test Sets List

(tick) Test Executions List

(tick) Test Plan List


(tick) Cross-project reports available 

(tick) Traceability

(tick) Overall Test Coverage

(error)  Historical Requirement Coverage 

(tick) Tests Plans Metrics

(error) Test Executions Report

(tick) Test Runs List

(tick) Test List

(tick) Test Sets List

(tick) Test Executions List

(tick) Test Plan List


(tick) Cross-project reports available 

warning cloud Visualization changes in some reports. ie.: Hierarchical and Flat view in Test Coverage Report.

Gadgets

(tick) Overall Requirements Coverage 

(tick) Historical Daily Requirements Coverage 

(tick) Test Runs Summary 

(tick) Tests List

(tick) Test Runs List

(tick) Tests Evolution Gadget

(tick) Overall Test Results

(tick) Requirement List

warning Test Set List - obtain the same view with Jira native gadget (filter results)

warning Test Execution List - obtain the same view with Jira native gadget (filter results)

warning Test Plan List - obtain the same view with Jira native gadget (filter results)

warning Tests by Test - obtain the same view with Jira native gadget (pie chart)

(tick) Overall Test Coverage 

(error) Historical Daily Requirements Coverage 

(tick) Test Runs Summary

(tick) Tests List

(tick) Test Runs List

(error)  Tests Evolution Gadget

(tick) Overall Test Results

(tick) Requirement List

(tick) Test Set List 

(tick) Test Execution List 

(tick) Test Plan List 

(tick) Test by Test 

warning cloud Differences in designation for some gadgets. Also more gadgets available out-of-the-box in Xray Cloud.


(tick) Overall Requirements Coverage 

(tick) Historical Daily Requirements Coverage 

(tick) Test Runs Summary 

(tick) Tests List

(tick) Test Runs List

(tick) Tests Evolution Gadget

(tick) Overall Test Results

(tick) Requirement List

warning Test Set List - obtain the same view with Jira native gadget (filter results)

warning Test Execution List - obtain the same view with Jira native gadget (filter results)

warning Test Plan List - obtain the same view with Jira native gadget (filter results)

warning Tests by Test - obtain the same view with Jira native gadget (pie chart)

(tick) Overall Test Coverage 

(error) Historical Daily Requirements Coverage 

(tick) Test Runs Summary

(tick) Tests List

(tick) Test Runs List

(error)  Tests Evolution Gadet

(tick) Overall Test Results

(tick) Requirement List

(tick) Test Set List 

(tick) Test Execution List 

(tick) Test Plan List 

(tick) Test by Test 

warning cloud Differences in designation for some gadgets. Also more gadgets available out-of-the-box in Xray cloud.

Fields available for Agile Boards

(tick) Requirement Status

(tick) Test Execution Status

(tick) Test Plan Status

(error) Requirement Status

(error) Test Execution Status

(error) Test Plan Status

(In Xray Cloud, it's not possible to add calculated Xray fields to Agile Boards, due to Jira Cloud limitation; please check the available fields here)

(tick) Requirement Status

(tick) Test Execution Status

(tick) Test Plan Status

(error) Requirement Status

(error) Test Execution Status

(error) Test Plan Status

(In Xray Cloud, it's not possible to add calculated Xray fields to Agile Boards, due to Jira Cloud limitation; please check the available fields here)

JQL FunctionsJQL Functions are available for Server/DC  hereMost of the JQL Functions are not available in Xray Cloud. Check here which ones are available.JQL Functions are available for Server/DC hereMost of the JQL Functions are not available in Xray Cloud. Check here which ones are available
Xray Notification (Xray Events)

Details here

cross mark

Details here

cross mark
Storage (Attachments)N/A100 GBN/AUnlimited
IntegrationsXporter, eazyBI, Structure, Confluence, Bamboo, Jenkins, TeamCity

Xporter, Jenkins, TeamCity, GitHub, Git Lab, Bitbucket Pipelines, Azure DevOps, Travis CI, Circle CI, Maven, Gradle, Scriptrunner

Xporter, eazyBI, Structure, Confluence, Bamboo, Jenkins, TeamCityXporter, Jenkins, TeamCity, GitHub, Git Lab, Bitbucket Pipelines, Azure DevOps, Travis CI, Circle CI, Maven, Gradle, Scriptrunner
REST API

Extends Jira's REST API.

Able to import multiple reports and manage all entities.

REST API: able to import multiple reports.

GraphQL API: manage all entities.

API Rate Limit: 300/per 5 minutes.

Extends Jira's REST API. Able to import multiple reports and manage all entities.

REST API: able to import multiple reports.

GraphQL API: manage all entities.

API rate Limit: 1000/per 5 minutes.

Automation frameworks/formats supportedCucumber, Xray, JUnit, NUnit, TestNG, xUnit, Robot framework, Robot framework v4.0, BehaveCucumber, Xray, JUnit, NUnit, TestNG, xUnit, Robot Framework, BehaveCucumber, Xray, JUnit, NUnit, TestNG, xUnit, Robot framework, Robot framework v4.0, BehaveCucumber, Xray, JUnit, NUnit, TestNG, xUnit, Robot Framework, Behave
Administration & Configuration

Please refer to documentation to understand differences between Xray Server/DC & Cloud Administration and configuration.



Xray Enterprise requires an active Xray Standard License.


Understand the icons: 

warning cloud - Available in Xray Cloud but with some differences or minor UI adjustments

(error) cloud - Not available in Xray Cloud

plus sign cloud - Extra option or functionality in Xray Cloud

  • No labels