To reduce clutter in the previous view, we've created a simple table listing all it's available within Administration & Configuration when looking at Server/DC vs Cloud.
Understand the icons:
- Available in Xray Cloud but with some differences or minor UI adjustments
- Not available in Xray Cloud
- Extra option or functionality in Xray Cloud
| Setting | Server | Cloud |
|---|---|---|
| Demo Project | Unavailable | Ability to create a demo project to showcase and test Xray Functionalities. |
| Custom Fields Configuration | Test Run Status Custom Field Version | Test Run Status Custom Field Version → behaves like "No Version" is selected. |
| Custom Fields Configuration | Test Set Status Custom Field Version | Test Set Status Custom Field Version → No behavior in sight. |
| Custom Fields Configuration | Requirement Status Custom Field Versions | Requirement Status Custom Field Versions → behaves like "No Version" is selected. |
| Xray Linking Restrictions | Available | Unavailable |
| Manage Test Types | Manage Test Type | Available under "Global Settings – Test Types" and "Project Settings – Test Types" after enabling it → Test Type define works for both Test and Precondition. |
| Manage Test Types | Manager Pre-Condition Type | Available under "Global Settings – Test Types" and "Project Settings – Test Types" after enabling it → Test Type define works for both Test and Precondition. |
| Coverage & Defects Configuration | Available | Available under "Project Configuration → Test Coverage & Defects Mapping" |
| Workflow & Notifications | Available | Available under "Global Settings" |
| Migration & Copy | Available | Unavailable |
| Backup & Restore | Available | Available under "Global Settings → Backup" |
| Backup & Restore | Available | Restore (Not documented in our Documentation that we can't) |
| Xray in-App Notifications | Available | Available |
| Archiving Xray Issues | Available | Available including (Auto-Archiving) |
| Storage | Not Applicable | Available |
| Miscellaneous Settings | Available | In Xray Cloud, Miscelaneous Settings are present not only as a Global setting but also as a Project setting and both with limitations: Global Settings: Miscelaneous - Test Run Options, - Defect Links, - Disallow executions of Tests with workflow statuses, - Disallow executions with workflow statuses - Defect Default Values → Label - Defect Default Values → Component - Enable Document Generator - Enable Chat Support Project Settings: Miscelaneous - Test Run Options, - Defect Links, - Disallow executions of Tests with workflow statuses, - Disallow executions with workflow statuses - Defect Default Values → Label - Defect Default Values → Component |
| Display Pre-Conditions section before Test Details | Display Pre-Conditions section before Test Details | |
| Display Manual Test Results table in short view | Display Manual Test Results table in short view → Available under Global by default and per Project after enabling it. | |
| Test Step FieldsProject admins can configure Test Step Custom Fields | Project admins can configure Test Step Custom Fields → Available by default on project level through Test Step Fields, no longer a Global Setting | |
| Project admins can configure Test Run Custom Fields | Project admins can configure Test Run Custom Fields → Available by default on project level through Test Run Custom Fields, no longer a Global Setting | |
| Set final Test Run status | Set final Test Run status → To review with Sofia. (Information missing in our Documentation for Cloud) | |
| Inline Execute Tests | Inline Execute Tests | |
| Restrict tests execution to assignee | Restrict tests execution to assignee | |
| Fail All Steps/Examples | Fail All Steps/Examples → Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO. | |
| Restrict automated Test status | Restrict automated Test status → However by default you can edit, but by manually editing the imported run, the Imported Result Section Get's removed from Testing Board but it's still acessible through. (Omisso) | |
| Can Edit TestRun Dates | Can Edit TestRun Dates → However by default you can edit (Omisso) | |
| Track Time | Track Time | |
| Set the value of the Time Tracker | Set the value of the Time Tracker | |
| Enable Test Run Status history log in Test Executions | Enable Test Run Status history log in Test Executions | |
| Link Defects with Test | Link Defects with Test | |
| Link Defects with Test Execution | Link Defects with Test Execution | |
| Link Defects with Requirement | Link Defects with Covered Issue | |
| User Groups allowed to add Xray Issue Types | User Groups allowed to add Xray Issue Types → You cannot restrict someone from adding Xray Issue Types: Suggestion here → https://jira.getxray.app/browse/XRAYCLOUD-6784 | |
| User Groups allowed to add/remove Xray Notifications | User Groups allowed to add/remove Xray Notifications | |
| Final Test Run statuses that may trigger notifications | Final Test Run statuses that may trigger notifications | |
| Enable Hierarchical Test organization | Enable Hierarchical Test organization → By default is set with Hierarchical Organization and access vary: | |
| Software Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the left panel | ||
| Business Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the horizontal project menu Apps → Testing Board. | ||
| Project Roles allowed to edit Test Repository information | Project Roles allowed to edit Test Repository information → Anyone with access to the project can edit Test Repo info. | |
| Disallow executions of Tests with workflow statuses | Disallow executions of Tests with workflow statuses | |
| Disallow executions with workflow statuses | Disallow executions with workflow statuses | |
| In progress Test Execution workflow status | In progress Test Execution workflow status | |
| Resolved Test Execution workflow status | Resolved Test Execution workflow status | |
| Resolution for Resolved Test Execution | Resolution for Resolved Test Execution | |
| Associate a cloned Test with all original Test Sets | Associate a cloned Test with all original Test Sets → XRAYCLOUD-2939 | |
| Associate a cloned Test with all original Test Plans | Associate a cloned Test with all original Test Plans → XRAYCLOUD-2939 | |
| Environment | Environment → Although the option does not exists, It behaves with the default linked to "Test" | |
| Steps to Reproduce | Steps to Reproduce → Normal comment section for documentation. | |
| Version | Version → By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution. | |
| Label | Label | |
| Component | Component | |
| Enable Automated Steps Library | Enable Automated Steps Library → By default you can access: | |
| Enable Automated Steps Library | Software Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the left panel | |
| Enable Automated Steps Library | Business Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the horizontal project menu Apps → Testing Board. | |
| Validate Cucumber Scenarios | Validate Cucumber Scenarios | |
| Cucumber Export Prefixes | Cucumber Export Prefixes → "Available under Global Settings → Cucumber" but unable to create a prefix for a Test Plan. | |
| Cucumber Language | Cucumber Language → "Available under Global Settings → Cucumber" | |
| Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags | Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags → "Available under Global Settings → Cucumber" | |
| Generate features by requirements | Generate features by requirements → "Available under Global Settings → Cucumber" | |
| Cucumber export feature name | Generate features file name using summary → "Available under Global Settings → Cucumber" | |
| Enable Document Generator | Enable Document Generator → Available under Global Settings Miscelaneaous & Feature | |
| Max number of issues that can be exported | Max number of issues that can be exported | |
| Max number of requirements per report or gadget | Max number of requirements per report or gadget | |
| Maximum number of Links added to a Requirement | Maximum number of Links added to a Requirement | |
| Test Evolution Tests Limit | Test Evolution Tests Limit | |
| Test Evolution Test Executions Limit | Test Evolution Test Executions Limit | |
| Test Runs list limit | Test Runs list limit | |
| Tests per Test Plan Maximum allowed | Maximum allowed | |
| Xray REST API - Max results per request | Xray REST API | |
| Associating a Test Execution to a Test Plan and importing Test results | Associating a Test Execution to a Test Plan and importing Test results | |
| Max Test Runs for bulk operations | Max Test Runs for bulk operations | |
| Maximum size for parameter values | Maximum size for parameter values | |
| Enable Xray Exploratory App execution links | Enable Xray Exploratory App execution links | |
| Enable Xray Analytics | Enable Xray Analytics | |
| Thread Pool Size | Thread Pool Size | |
| Enable In-app Chat Support | Enable In-app Chat Support | |
| Enable Xray notifications | Enable Xray notifications | |
| Show Xray notifications button | Show Xray notifications button | |
| Test Environments | Unavailable | Available |
| Automated / BDD Step Libraries | Not available as a Global setting, only as a project setting under the name "Automated Step Library" | Available |
| Global Settings → Parameter value lists | Available | Available |
| Test Statuses | Available | Available |
| Test Step Statuses | Available | Available |
| Cucumber | Available under Miscellaneous | Available as a dedicated option |
| Test Run Archiving | Auto Archiving is unavailable as a setting however,Test Run Archive available to be done manually. | Available |
| API Keys | Not Applicable, access levels is managed on premise | Available |
| Storage | Not Applicable, storage is managed on premise | Available |
| Health Check | Unavailable or Not Applicable | Available |
| Features | Unavailable or Not Applicable | Available |
| Setting | Server | Cloud |
|---|---|---|
| Project Organization | Available (with the same use cases) | Available (with the same use cases) |
| Configuring Xray Test Project | Available | Available under "Project Configuration → Summary" |
| Requirements per Project | Requirement Coverage Strategy | Available under "Project Configuration → Test Coverage & Defects Mapping" |
| Requirements per Project | Ignore Requirements with Status | Available under "Project Configuration → Test Coverage & Defects Mapping" |
| Requirements per Project | Ignore Requirements with Label | Available under "Project Configuration → Test Coverage & Defects Mapping" |
| Requirements per Project | Ignore Tests with Status | Available under "Project Configuration → Test Coverage & Defects Mapping" |
| Requirements per Project | Requirement Historical Chart Days | Available under "Project Configuration → Test Coverage & Defects Mapping" |
| Requirements per Project | Separation of concerns | Unavailable |
| Requirements per Project | Include Previous Version Requirements | Available under "Project Configuration → Test Coverage & Defects Mapping" |
| Requirements per Project | Show Flatten Requirements | Available under "Project Configuration → Test Coverage & Defects Mapping" |
| Configure Xray with an existent Project | Available | Available under "Project Configuration → Summary" |
| Using Xray Template | Available | Unavailable |
| Agile Boards | Available | Available with limitations. e.g. --> unable to use custom fields. |
| Permissions | Available | Unavailable (Permissions are Jira wise) |
| Summary | Unavailable or Not Applicable | Available |
| Issue Types Mapping | Unavailable or Not Applicable | Only Available for Team Managed Projects |
| Test Coverage | Available under Issue Type Maping | Ability to set up which issue types are considered Requirements. |
| Defect Mapping | Available under Issue Type Maping | Ability to set up which issue types are considered Defects. |
| Test Types | Available | Available |
| Test Environments | Unavailable or Not Applicable | Ability to manage Test Environment at a project level. |
| BDD Step Library | Available under Project Settings | Available |
| Test Step Fields | Available under Project Settings > Test Steps Custome | Available |
| Test Run Custom Fields | Available under Project Settings | Available |
| Parameter value lists | Available | Available |
| Default Column Layouts | Test Execution TestRun Columns | Test Execution TestRun Columns |
| Default Column Layouts | Test TestRun Columns | Test TestRun Columns |
| Default Column Layouts | Test PreCondition Columns | Test PreCondition Columns |
| Default Column Layouts | Test Test Set Columns | Test Test Set Columns |
| Default Column Layouts | Test Test Plan Columns | Test Test Plan Columns |
| Default Column Layouts | Test Set Test Columns | Test Set Test Columns |
| Default Column Layouts | Test Plan Test Columns | Test Plan Test Columns |
| Default Column Layouts | Test Plan Test Execution Columns | Test Plan Test Execution Columns |
| Default Column Layouts | Test Coverage Columns | Test Coverage Columns |
| Default Column Layouts | Project Test Columns | Project Test Columns |
| Default Column Layouts | Project Test Set Columns | Project Test Set Columns |
| Default Column Layouts | Project Test Execution Columns | Project Test Execution Columns |
| Default Column Layouts | Project Test Plan Columns | Project Test Plan Columns |
| Default Column Layouts | Precondition Tests Columns | Precondition Tests Columns |
| Re-Indexing | Available | Available |