Find a comparison view of the settings and features in Server / DC vs Cloud about Administration & Configuration. One of the first
| Section | Feature | Server | Cloud |
|---|---|---|---|
| Custom Fields Configuration | Test Run Status Custom Field Version |
|
(note: behaves like "No Version" is selected) |
| Test Set Status Custom Field Version |
|  | |
| Requirement Status Custom Field Versions |
|
(note: behaves like "No Version" is selected) | |
| Xray Linking Restrictions |
| | |
| Manage Test Types | Manage Test Type |
|
(note: Available under "Global Settings – Test Types" and "Project Settings – Test Types" after enabling it → Test Type define works for both Test and Precondition) |
| Manager Pre-Condition Type |
| ||
| Coverage & Defects Configuration |
|
(note: Available under Project Configuration → Test Coverage & Defects Mapping | |
| Workflow & Notifications |
|
| |
| Migration & Copy |
| | |
| Backup & Restore | Backup |
|
|
| Restore |
(Information missing in our Documentation for Cloud) | ||
| Xray in-App Notifications |
|
| |
| Archiving Xray Issues |
|
(note: Adds new feature Auto-Archiving) | |
| Storage | Not Applicable, storage is managed on-premise |
(note: Adds new feature Storage Management) | |
| Miscellaneous Settings | Display the Pre-Conditions section before the Test Details |
| |
| Display Manual Test Results table in short view |
|
Available under Global by default and per Project after enabling it. | |
| Test Step FieldsProject admins can configure Test Step Custom Fields |
|
Available by default on project level through Test Step Fields, no longer a Global Setting | |
| Project admins can configure Test Run Custom Fields |
|
Available by default on project level through Test Run Custom Fields, no longer a Global Setting | |
| Set final Test Run status |
|
(Information missing in our Documentation for Cloud) | |
| Inline Execute Tests |
|
| |
| Restrict tests execution to the assignee |
|
| |
| Fail All Steps/Examples |
|
Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO. | |
| Restrict automated Test status |
|
However by default, you can edit, but by manually editing the imported run, the Imported Result Section gets removed from the Testing Board but it's still accessible through. (Information missing in our Documentation for Cloud) | |
| Can Edit TestRun Dates |
|
However by default you can edit (Information missing in our Documentation for Cloud) | |
| Track Time |
|
| |
| Set the value of the Time Tracker |
|
| |
| Enable Test Run Status history log in Test Executions |
| | |
| Link Defects with Test |
|
| |
| Link Defects with Test Execution |
|
| |
| Link Defects with Requirement |
|
| |
| User Groups allowed to add Xray Issue Types |
|
You cannot restrict someone from adding Xray Issue Types | |
| User Groups allowed to add/remove Xray Notifications |
| | |
| Final Test Run statuses that may trigger notifications |
| | |
| Enable Hierarchical Test organization |
|
By default is set with Hierarchical Organization | |
| Project Roles allowed the edit Test Repository information |
|
Anyone with access to the project can edit Test Repo info. | |
| Disallow executions of Tests with workflow statuses |
|
| |
| Disallow executions with workflow statuses |
|
| |
| In progress test Execution workflow status |
| | |
| Resolved Test Execution workflow status |
| | |
| Resolution for Resolved Test Execution |
| | |
| Associate a cloned Test with all original Test Sets |
| | |
| Associate a cloned Test with all original Test Plans |
| | |
| Environment |
|
Although the option does not exist, It behaves with the default linked to "Test" | |
| Steps to Reproduce |
|
| |
| Version |
|
By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution. | |
| Label |
|
| |
| Component |
|
| |
| Enable Automated Steps Library |
|
| |
| Validate Cucumber Scenarios |
| | |
| Cucumber Export Prefixes |
|
Available under Global Settings → Cucumber" but unable to create a prefix for a Test Plan. | |
| Cucumber Language |
|
note: setting moved to a dedicated option in the menu tab: Global Settings → Cucumber | |
| Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags |
| ||
| Generate features by requirements |
| ||
| Cucumber export feature name |
| ||
| Enable Document Generator |
|
Available under Global Settings Miscelaneaous & Feature | |
| Max number of issues that can be exported |
| | |
| Max number of requirements per report or gadget |
| | |
| Maximum number of Links added to a Requirement |
| | |
| Test Evolution Tests Limit |
| | |
| Test Evolution Test Executions Limit |
| | |
| Test Runs list limit |
| | |
| Tests per Test Plan Maximum allowed |
| | |
| Xray REST API - Max results per request |
| | |
| Associating a Test Execution to a Test Plan and importing Test results |
| | |
| Max Test Runs for bulk operations |
| | |
| Maximum size for parameter values |
| | |
| Enable Xray Exploratory App execution links |
| | |
| Enable Xray Analytics |
| | |
| Thread Pool Size |
| | |
| Enable In-app Chat Support |
|
| |
| Enable Xray notifications |
|
| |
| Show Xray notifications button |
|
| |
| Test Environments |
| ||
| Automated / BDD Step Libraries | Not available as a Global setting, only as a project setting under the name "Automated Step Library" |
| |
| Parameter value lists |
|
| |
| Test Statuses |
|
| |
| Test Step Statuses |
|
| |
| Cucumber |
| ||
| Test Run Archiving | Auto Archiving | Ability to manually archive Test Runs |
Adds Auto Archive Feature |
| API Keys | Not Applicable, access levels are managed on-premise |
| |
| Storage | Not Applicable, storage is managed on-premise |
| |
| Health Check |
| ||
| Features | Feature Toggling |
| |
| Setting | Server | Cloud | |
|---|---|---|---|
| Project Organization |
|
| |
| Configuring Xray Test Project |
|
| |
| Requirements per Project | Requirement Coverage Strategy |
|
Available under "Project Configuration → Test Coverage & Defects Mapping" |
| Ignore Requirements with Status |
| ||
| Ignore Requirements with Label |
| ||
| Ignore Tests with Status |
| ||
| Requirement Historical Chart Days |
| ||
| Include Previous Version Requirements |
| ||
| Show Flatten Requirements |
| ||
| Separation of concerns |
| | |
| Configure Xray with an existent Project |
|
Available under "Project Configuration → Summary" | |
| Using Xray Template |
| | |
| Agile Boards |
|
Available with limitations. We are only able to use 3 Xray Custom Fields, we are unable to showcase the "Requirement Status" field (one of the most used in DC/Server) | |
| Permissions |
|
(Permissions are Jira wise) | |
| Summary | Not Applicable |
| |
| Issue Types Mapping | Not Applicable | Only Available for Team Managed Projects | |
| Test Coverage | Available under the name Issue Type Mapping |
| |
| Defect Mapping |
| ||
| Test Types |
|
| |
| Test Environments |
Ability to manage Test Environment at a project level. | ||
| BDD Step Library | Available under the name "Automated Steps Library" |
| |
| Test Step Fields | Available under Project Settings → Test Step Fields |
| |
| Test Run Custom Fields | Available under Project Settings → Test Run Custom Fields |
| |
| Parameter value lists |
|
| |
| Default Column Layouts | Test Execution TestRun Columns |
|
|
| Test TestRun Columns |
|
| |
| Test PreCondition Columns |
|
| |
| Test Test Set Columns |
|
| |
| Test Test Plan Columns |
|
| |
| Test Set Test Columns |
|
| |
| Test Plan Test Columns |
|
| |
| Test Plan Test Execution Columns |
|
| |
| Test Coverage Columns |
| | |
| Project Test Columns |
| | |
| Project Test Set Columns |
|
| |
| Project Test Execution Columns |
|
| |
| Project Test Plan Columns |
|
| |
| Precondition Tests Columns |
|
| |
| Re-Indexing |
|
| |
Understand the icons:
- Available in Xray Cloud but with some differences or minor UI adjustments
- Not available in Xray Cloud
- Extra option or functionality in Xray Cloud