| Setting | Server | Cloud |
|---|
| Demo Project | Unavailable | Ability to create a demo project to showcase and test Xray Functionalities. |
| Custom Fields Configuration | Test Run Status Custom Field Version | Test Run Status Custom Field Version → behaves like "No Version" is selected. |
| Custom Fields Configuration | Test Set Status Custom Field Version | Test Set Status Custom Field Version → No behavior in sight. |
| Custom Fields Configuration | Requirement Status Custom Field Versions | Requirement Status Custom Field Versions → behaves like "No Version" is selected. |
| Xray Linking Restrictions | Available | Unavailable |
| Manage Test Types | Manage Test Type | Available under "Global Settings – Test Types" and "Project Settings – Test Types" after enabling it → Test Type define works for both Test and Precondition. |
| Manage Test Types | Manager Pre-Condition Type | Available under "Global Settings – Test Types" and "Project Settings – Test Types" after enabling it → Test Type define works for both Test and Precondition. |
| Coverage & Defects Configuration | Available | Available under "Project Configuration → Test Coverage & Defects Mapping" |
| Workflow & Notifications | Available | Available under "Global Settings" |
| Migration & Copy | Available | Unavailable |
| Backup & Restore | Available | Available under "Global Settings → Backup" |
| Backup & Restore | Available | Restore (Not documented in our Documentation that we can't) |
| Xray in-App Notifications | Available | Available |
| Archiving Xray Issues | Available | Available including (Auto-Archiving) |
| Storage | Not Applicable | Available |
Miscellaneous Settings
| Available | In Xray Cloud, Miscelaneous Settings are present not only as a Global setting but also as a Project setting and both with limitations:
Global Settings: Miscelaneous
- Test Run Options,
- Defect Links,
- Disallow executions of Tests with workflow statuses,
- Disallow executions with workflow statuses
- Defect Default Values → Label
- Defect Default Values → Component
- Enable Document Generator
- Enable Chat Support
Project Settings: Miscelaneous
- Test Run Options,
- Defect Links,
- Disallow executions of Tests with workflow statuses,
- Disallow executions with workflow statuses
- Defect Default Values → Label
- Defect Default Values → Component |
| Display Pre-Conditions section before Test Details | Display Pre-Conditions section before Test Details |
| Display Manual Test Results table in short view | Display Manual Test Results table in short view → Available under Global by default and per Project after enabling it. |
| Test Step FieldsProject admins can configure Test Step Custom Fields | Project admins can configure Test Step Custom Fields → Available by default on project level through Test Step Fields, no longer a Global Setting |
| Project admins can configure Test Run Custom Fields | Project admins can configure Test Run Custom Fields → Available by default on project level through Test Run Custom Fields, no longer a Global Setting |
| Set final Test Run status | Set final Test Run status → To review with Sofia. (Information missing in our Documentation for Cloud) |
| Inline Execute Tests | Inline Execute Tests |
| Restrict tests execution to assignee | Restrict tests execution to assignee |
| Fail All Steps/Examples | Fail All Steps/Examples → Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO. |
| Restrict automated Test status | Restrict automated Test status → However by default you can edit, but by manually editing the imported run, the Imported Result Section Get's removed from Testing Board but it's still acessible through. (Omisso) |
| Can Edit TestRun Dates | Can Edit TestRun Dates → However by default you can edit (Omisso) |
| Track Time | Track Time |
| Set the value of the Time Tracker | Set the value of the Time Tracker |
| Enable Test Run Status history log in Test Executions | Enable Test Run Status history log in Test Executions |
| Link Defects with Test | Link Defects with Test |
| Link Defects with Test Execution | Link Defects with Test Execution |
| Link Defects with Requirement | Link Defects with Covered Issue |
| User Groups allowed to add Xray Issue Types | User Groups allowed to add Xray Issue Types → You cannot restrict someone from adding Xray Issue Types: Suggestion here → https://jira.getxray.app/browse/XRAYCLOUD-6784 |
| User Groups allowed to add/remove Xray Notifications | User Groups allowed to add/remove Xray Notifications |
| Final Test Run statuses that may trigger notifications | Final Test Run statuses that may trigger notifications |
| Enable Hierarchical Test organization | Enable Hierarchical Test organization → By default is set with Hierarchical Organization and access vary: |
| Software Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the left panel |
| Business Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the horizontal project menu Apps → Testing Board. |
| Project Roles allowed to edit Test Repository information | Project Roles allowed to edit Test Repository information → Anyone with access to the project can edit Test Repo info. |
| Disallow executions of Tests with workflow statuses | Disallow executions of Tests with workflow statuses |
| Disallow executions with workflow statuses | Disallow executions with workflow statuses |
| In progress Test Execution workflow status | In progress Test Execution workflow status |
| Resolved Test Execution workflow status | Resolved Test Execution workflow status |
| Resolution for Resolved Test Execution | Resolution for Resolved Test Execution |
| Associate a cloned Test with all original Test Sets | Associate a cloned Test with all original Test Sets → XRAYCLOUD-2939 |
| Associate a cloned Test with all original Test Plans | Associate a cloned Test with all original Test Plans → XRAYCLOUD-2939 |
| Environment | Environment → Although the option does not exists, It behaves with the default linked to "Test" |
| Steps to Reproduce | Steps to Reproduce → Normal comment section for documentation. |
| Version | Version → By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution. |
| Label | Label |
| Component | Component |
| Enable Automated Steps Library | Enable Automated Steps Library → By default you can access: |
| Enable Automated Steps Library | Software Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the left panel |
| Enable Automated Steps Library | Business Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the horizontal project menu Apps → Testing Board. |
| Validate Cucumber Scenarios | Validate Cucumber Scenarios |
| Cucumber Export Prefixes | Cucumber Export Prefixes → "Available under Global Settings → Cucumber" but unable to create a prefix for a Test Plan. |
| Cucumber Language | Cucumber Language → "Available under Global Settings → Cucumber" |
| Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags | Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags → "Available under Global Settings → Cucumber" |
| Generate features by requirements | Generate features by requirements → "Available under Global Settings → Cucumber" |
| Cucumber export feature name | Generate features file name using summary → "Available under Global Settings → Cucumber" |
| Enable Document Generator | Enable Document Generator → Available under Global Settings Miscelaneaous & Feature |
| Max number of issues that can be exported | Max number of issues that can be exported |
| Max number of requirements per report or gadget | Max number of requirements per report or gadget |
| Maximum number of Links added to a Requirement | Maximum number of Links added to a Requirement |
| Test Evolution Tests Limit | Test Evolution Tests Limit |
| Test Evolution Test Executions Limit | Test Evolution Test Executions Limit |
| Test Runs list limit | Test Runs list limit |
| Tests per Test Plan Maximum allowed | Maximum allowed |
| Xray REST API - Max results per request | Xray REST API |
| Associating a Test Execution to a Test Plan and importing Test results | Associating a Test Execution to a Test Plan and importing Test results |
| Max Test Runs for bulk operations | Max Test Runs for bulk operations |
| Maximum size for parameter values | Maximum size for parameter values |
| Enable Xray Exploratory App execution links | Enable Xray Exploratory App execution links |
| Enable Xray Analytics | Enable Xray Analytics |
| Thread Pool Size | Thread Pool Size |
| Enable In-app Chat Support | Enable In-app Chat Support |
| Enable Xray notifications | Enable Xray notifications |
| Show Xray notifications button | Show Xray notifications button |
| Test Environments | Unavailable | Available |
| Automated / BDD Step Libraries | Not available as a Global setting, only as a project setting under the name "Automated Step Library" | Available |
| Global Settings → Parameter value lists | Available | Available |
| Test Statuses | Available | Available |
| Test Step Statuses | Available | Available |
| Cucumber | Available under Miscellaneous | Available as a dedicated option |
| Test Run Archiving | Auto Archiving is unavailable as a setting however,Test Run Archive available to be done manually. | Available |
| API Keys | Not Applicable, access levels is managed on premise | Available |
| Storage | Not Applicable, storage is managed on premise | Available |
| Health Check | Unavailable or Not Applicable | Available |
| Features | Unavailable or Not Applicable | Available |
