Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Find a comparison view of the settings and features in Server / DC vs Cloud about Administration & Configuration. One of the first


Understand the icons: 

warning cloud - Available in Xray Cloud but with some differences or minor UI adjustments

(error) cloud - Not available in Xray Cloud

plus sign cloud - Extra option or functionality in Xray Cloud


UI Expand
titleGlobal Level Settings
  Available
SettingServerCloud
Custom Fields Configuration(tick) - Test Run Status Custom Field VersionTest (error) cloud - Test Run Status Custom Field Version → behaves like "No Version" is selected.
(tick) - Test Set Status Custom Field Version(error) cloud - Test Set Status Custom Field Version → No behavior in sight.
(tick) - Requirement Status Custom Field VersionsRequirement (error) cloud - Requirement Status Custom Field Versions → behaves like "No Version" is selected.
Xray Linking Restrictions(tick) - AvailableUnavailable(error) cloud - Unavailable
Manage Test Types(tick) - Manage Test Typewarning cloud - Available under "Global Settings – Test Types" and "Project Settings – Test Types" after enabling it → Test Type define works for both Test and Precondition.
(tick) - Manager Pre-Condition Typewarning cloud - Available under "Global Settings – Test Types" and "Project Settings – Test Types" after enabling it → Test Type define works for both Test and Precondition.
Coverage & Defects Configuration(tick) - Availablewarning cloud - Available under "Project Configuration → Test Coverage & Defects Mapping"
Workflow & Notifications(tick) - Available(tick) - Available under "Global Settings"
Migration & Copy(tick) - AvailableUnavailable(error) cloud - Unavailable
Backup & Restore

(tick) - Available(tick) - Available under "Global Settings → Backup"
(error) cloud - Restore (Not documented Information missing in our Documentation that we can'tfor Cloud)
Xray in-App Notifications(tick) - Available(tick) - Available
Archiving Xray Issues(tick) - AvailableAvailable plus sign cloud - Available including (Auto-Archiving)
StorageNot ApplicableAvailableplus sign cloud - Ability to manage Storage
Miscellaneous Settings

(tick) - Availablewarning cloudIn Xray Cloud, Miscellaneous Settings are present not only as a Global setting but also as a Project setting, and both with limitations:
Global Settings: Miscellaneous
 - Test Run Options,
 - Defect Links,
 - Disallow executions of Tests with workflow statuses,
 - Disallow executions with workflow statuses
 - Defect Default Values → Label
 - Defect Default Values → Component
 - Enable Document Generator
 - Enable Chat Support

Project Settings: Miscellaneous
 - Test Run Options,
 - Defect Links,
 - Disallow executions of Tests with workflow statuses,
 - Disallow executions with workflow statuses
 - Defect Default Values → Label
 - Defect Default Values → Component
(tick) - Display the Pre-Conditions section before the Test Details (error) cloud - Display the Pre-Conditions section before the Test Details
(tick) - Display Manual Test Results table in short view Display (tick) - Display Manual Test Results table in short view → Available under Global by default and per Project after enabling it.
(tick) - Test Step FieldsProject admins can configure Test Step Custom Fields Project (tick) - Project admins can configure Test Step Custom Fields → Available by default on project level through Test Step Fields, no longer a Global Setting
(tick) - Project admins can configure Test Run Custom Fields                                                            Project (tick) - Project admins can configure Test Run Custom Fields → Available by default on project level through Test Run Custom Fields, no longer a Global Setting
(tick) - Set final Test Run status Set warning cloud - Set final Test Run status → To review with Sofia. (Information missing in our Documentation for Cloud)
(tick) - Inline Execute Tests Inline (tick) - Inline Execute Tests
(tick) - Restrict tests execution to assignee(error) cloud - Restrict tests execution to assignee
(tick) - Fail All Steps/Examples                                                                                                         Fail warning cloudFail All Steps/Examples → Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.
(tick) - Restrict automated Test status                                                                                             Restrict (error) cloud - Restrict automated Test status → However by default, you can edit, but by manually editing the imported run, the Imported Result Section gets removed from the Testing Board but it's still accessible through. (OmissoInformation missing in our Documentation for Cloud)
(tick) - Can Edit TestRun Dates Can (error) cloud - Can Edit TestRun Dates → However by default you can edit (OmissoInformation missing in our Documentation for Cloud)
(tick) - Track Time Track (tick)Track Time
(tick) - Set the value of the Time Tracker Set (tick)Set the value of the Time Tracker
(tick) - Enable Test Run Status history log in Test Executions Enable (error) cloud - Enable Test Run Status history log in Test Executions
(tick) - Link Defects with Test Link (tick)Link Defects with Test
(tick) - Link Defects with Test Execution Link (tick)Link Defects with Test Execution
(tick) - Link Defects with Requirement Link (tick)Link Defects with Covered Issues
(tick) - User Groups allowed to add Xray Issue Types                                                                    User warning cloudUser Groups allowed to add Xray Issue Types → You cannot restrict someone from adding Xray Issue Types: Suggestion here → https://jira.getxray.app/browse/XRAYCLOUD-6784
(tick) - User Groups allowed to add/remove Xray Notifications User (error) cloud - User Groups allowed to add/remove Xray Notifications
(tick) - Final Test Run statuses that may trigger notifications Final (error) cloud - Final Test Run statuses that may trigger notifications
(tick) - Enable Hierarchical Test organizationEnable (error) cloud - Enable Hierarchical Test organization → By default is set with Hierarchical Organization and access vary:
Software Projects Test Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the left panel
Business Projects Test Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the horizontal project menu Apps → Testing Board.
(tick) - Project Roles allowed the edit Test Repository information                                               Project (error) cloud - Project Roles allowed to edit Test Repository information → Anyone with access to the project can edit Test Repo info.
(tick) - Disallow executions of Tests with workflow statuses(tick) - Disallow executions of Tests with workflow statuses
(tick) - Disallow executions with workflow statuses(tick) - Disallow executions with workflow statuses
(tick) - In progress test Execution workflow status(error) cloud - In Progress Test Execution workflow status
(tick) - Resolved Test Execution workflow statusResolved (error) cloud - Resolved Test Execution workflow status
(tick) - Resolution for Resolved Test ExecutionResolution (error) cloud - Resolution for Resolved Test Execution
(tick) - Associate a cloned Test with all original Test SetsAssociate (error) cloud - Associate a cloned Test with all original Test Sets →  XRAYCLOUD-2939
(tick) - Associate a cloned Test with all original Test PlansAssociate (error) cloud - Associate a cloned Test with all original Test Plans →  XRAYCLOUD-2939
(tick) - Environment(error) cloud - Environment Environment → Although the option does not exist, It behaves with the default linked to "Test"
 Steps (tick) - Steps to ReproduceSteps (error) cloud - Steps to Reproduce → Normal comment section for documentation.
 Version  (tick) - Version                                                                                                                               Version (error) cloud - Version → By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution.
 Label(tick) - Label(tick) - Label
 Component(tick) - Component(tick) - Component Enable
(tick) - Enable Automated Steps LibraryEnable Automated (error) cloud - Enable Automated Steps Library → By default you can access:
 Enable Automated Steps LibrarySoftware Projects Test → Software Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the left panel
 Enable Automated Steps LibraryBusiness Projects Test → Business Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the horizontal project menu Apps → Testing Board.
 Validate (tick) - Validate Cucumber ScenariosValidate (error) cloud - Validate Cucumber Scenarios
 Cucumber (tick) - Cucumber Export Prefixes                                                                                                  warning cloud - Cucumber Export Prefixes → "Available under Global Settings → Cucumber" but unable to create a prefix for a Test Plan.
(tick) - Cucumber Language(tick) -  Cucumber LanguageCucumber Language → "Available under Global Settings → Cucumber"
 Replace (tick) - Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags                            (tick) - Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags → "Available under Global Settings → Cucumber"
 Generate (tick) - Generate features by requirementswarning cloud - Generate features by requirements → "Available under Global Settings → Cucumber"
 Cucumber (tick) - Cucumber export feature name(tick) - Generate features file name using summary → "Available under Global Settings → Cucumber"
 Enable (tick) - Enable Document Generator(tick) - Enable Document Generator → Available under Global Settings Miscelaneaous & Feature
 Max (tick) - Max number of issues that can be exportedMax (error) cloud - Max number of issues that can be exported
 Max (tick) - Max number of requirements per report or gadgetMax (error) cloud - Max number of requirements per report or gadget
 Maximum (tick) - Maximum number of Links added to a RequirementMaximum (error) cloud - Maximum number of Links added to a Requirement
 Test (tick) - Test Evolution Tests LimitTest (error) cloud - Test Evolution Tests Limit
 Test (tick) - Test Evolution Test Executions LimitTest (error) cloud - Test Evolution Test Executions Limit
 Test (tick) - Test Runs list limitTest (error) cloud - Test Runs list limit
 Tests (tick) - Tests per Test Plan Maximum Plan Maximum allowedMaximum (error) cloud - Maximum allowed
 Xray (tick) - Xray REST API -  Max Max results per requestXray (error) cloud - Xray REST API
 Associating (tick) - Associating a Test Execution to a Test Plan and importing Test resultsAssociating (error) cloud - Associating a Test Execution to a Test Plan and importing Test results
 Max (tick) - Max Test Runs for bulk operations Max (error) cloud - Max Test Runs for bulk operations
 Maximum (tick) - Maximum size for parameter values Maximum (error) cloud - Maximum size for parameter values
 Enable (tick) - Enable Xray Exploratory App execution links Enable (error) cloud - Enable Xray Exploratory App execution links
 Enable (tick) - Enable Xray Analytics(error) cloud - Enable Xray Analytics
 Thread (tick) - Thread Pool Size(error) cloud - Thread Pool Size
 Enable (tick) - Enable In-app Chat Support Enable (tick) - Enable In-app Chat Support
 Enable (tick) - Enable Xray notifications Enable (tick) - Enable Xray notifications
(tick) - Show Xray notifications button Show (tick) - Show Xray notifications button
Test EnvironmentsUnavailable(error)- Unavailable(tick)Available  Available
Automated / BDD Step Librarieswarning - Not available as a Global setting, only as a project setting under the name "Automated Step Library"  Available(tick) - Available
Global Settings → Parameter value lists(tick) - Available  Available(tick)Available
Test Statuses(tick) - Available  Available(tick)Available
Test Step Statuses(tick) - Available  Available(tick)Available
Cucumber(tick) - Available under Miscellaneous  Available plus sign cloud - Available as a dedicated option
Test Run Archivingwarning - Auto Archiving is unavailable as a setting however, the Test Run Archive is available to be done manually.  Available(tick)Available
API KeysNot Applicable, access levels are managed on-premise  Available(tick)Available
StorageNot Applicable, storage is managed on-premise  Available(tick)Available
Health Check Unavailable (error)-  Unavailable or Not Applicable  Available(tick)Available
Features Unavailable or Not Applicable(error)-  Feature Toggling Unavailable for Server / DC (tick)Available


Understand the icons: 

warning cloud - Available in Xray Cloud but with some differences or minor UI adjustments

(error) cloud - Not available in Xray Cloud

plus sign cloud - Extra option or functionality in Xray Cloud


UI Expand
titleProject Level Settings
SettingServerCloud
Project Organization
  Available
(tick) - Available (with the same use cases)(tick) - Available (with the same use cases)
Configuring Xray Test Project
  Available
(tick) - Availablewarning cloud - Available under "Project Configuration → Summary"
Requirements per Project
  Requirement
(tick) - Requirement Coverage Strategywarning cloud - Available under "Project Configuration → Test Coverage & Defects Mapping"
  Ignore   Ignore
(tick) - Ignore Requirements with Status
Available under "Project Configuration → Test Coverage & Defects Mapping"

  Ignore
(tick) - Ignore Requirements with Label
Available under "Project Configuration → Test Coverage & Defects Mapping"

  Requirement
(tick) - Ignore Tests with Status
Available under "Project Configuration → Test Coverage & Defects Mapping"

Separation of concernsUnavailable
(tick) - Requirement Historical Chart Days
Available under "Project Configuration → Test Coverage & Defects Mapping"

(tick) - Include Previous Version Requirements
Available under "Project Configuration → Test Coverage & Defects Mapping"

(tick) - Show Flatten Requirements

(tick) - Separation of concerns(error) cloud - Unavailable
Available under "Project Configuration → Test Coverage & Defects Mapping"
Configure Xray with an existent Project(tick) - Availablewarning cloud - Available under "Project Configuration → Summary"
Using Xray Template(tick) - Available(error) cloud - Unavailable
Agile Boards(tick) - Availablewarning cloud - Available with limitations.
e.g. --> unable to use custom fields.
We are only able to use 3 Xray Custom Fields, we are unable to showcase the "Requirement Status" field (one of the most used in DC/Server)
Permissions(tick) - Available(error) cloud -
PermissionsAvailable
Unavailable (Permissions are Jira wise)
SummaryUnavailable or Not Applicable(tick)-Available
Unavailable or Not ApplicableDemo Project
Issue Types MappingUnavailable or Not Applicable
 
Only Available for Team Managed Projects
Test Coverage(tick) - Available under Issue Type
Maping
Mapping
  Ability
Ability to set up which issue types are considered Requirements.
Defect Mapping(tick) - Available under Issue Type
Maping
Mapping
  Ability
Ability to set up which issue types are considered Defects.
Test Types(tick) - Available
  Available
(tick)- Available
Test EnvironmentsUnavailable or Not Applicable
  Ability
plus sign cloud - Ability to manage Test Environment at a project level.
BDD Step Library(tick) - Available under
Project Settings  Available
the name "Automated Steps Library"(tick)- Available
Test Step FieldsAvailable under Project Settings
>
Test
Steps Custome
Step Fields(tick)- Available
  Available
Test Run Custom FieldsAvailable under Project Settings
  Available
→ Test Run Custom Fields(tick)- Available
Parameter value lists(tick) - Available
  Available
(tick) - Available
Default Column Layouts(tick) - Test Execution TestRun Columns
 Test
(tick)- Test Execution TestRun Columns
(tick)-Test TestRun Columns
 Test
(tick)- Test TestRun Columns
(tick)-Test PreCondition Columns
 Test
(tick)- Test PreCondition Columns
(tick)-Test Test Set Columns
 Test
(tick)- Test Test Set Columns
(tick)-Test Test Plan Columns
 Test
(tick)- Test Test Plan Columns
(tick)-Test Set Test Columns
 Test
(tick)- Test Set Test Columns
(tick)-Test Plan Test Columns
 Test
(tick)- Test Plan Test Columns
(tick)-Test Plan Test Execution Columns
 Test
(tick)- Test Plan Test Execution Columns
(tick)-Test Coverage Columns
 Test
(error) cloud - Test Coverage Columns
(tick)-Project Test Columns
 Project
(error) cloud - Project Test Columns
(tick)-Project Test Set Columns
 Project
(tick)- Project Test Set Columns
(tick)-Project Test Execution Columns
 Project
(tick)- Project Test Execution Columns
(tick)-Project Test Plan Columns
 Project
(tick)- Project Test Plan Columns
(tick)-Precondition Tests Columns
 Precondition
(tick)- Precondition Tests Columns
Re-Indexing(tick)- Available(tick)- Available

Understand the icons: 

warning cloud - Available in Xray Cloud but with some differences or minor UI adjustments

...