Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

UI Expand
titleGlobal Level Settings
SectionFeature
Setting
ServerCloud
Custom Fields Configuration
(tick) -
Test Run Status Custom Field Version

Image Added

(error) cloud

- Test Run Status Custom Field Version →

(note: behaves like "No Version" is selected

.

)

(tick) -
Test Set Status Custom Field Version

Image Added

(error) cloud
- Test Set Status Custom Field Version
(tick) -
Requirement Status Custom Field Versions

Image Added

(error) cloud

- Requirement Status Custom Field Versions →

(note: behaves like "No Version" is selected

.

)

Xray Linking Restrictions
(tick) - Available

Image Added

(error) cloud
- Unavailable
Manage Test Types
(tick) -
Manage Test Type

Image Added

warning

 

cloud

-

(note: Available under "Global Settings – Test Types" and "Project Settings – Test Types" after enabling it → Test Type define works for both Test and Precondition

.

)

(tick) -
Manager Pre-Condition Type

Image Added

warning cloud - Available under "Global Settings – Test Types" and "Project Settings – Test Types" after enabling it → Test Type define works for both Test and Precondition.
Coverage & Defects Configuration
(tick) - Available

Image Added

warning cloud - Available under "Project Configuration → Test Coverage & Defects Mapping"
Workflow & Notifications
(tick) - Available

Image Added

Image Added

(tick) - Available under "Global Settings"

Migration & Copy
(tick) - Available

Image Added

(error) cloud
- Unavailable
Backup & Restore

(tick) - Available


Backup

Image Added

Image Added

Restore
(tick) - Available under "Global Settings → Backup"

(error) cloud

- Restore

(Information missing in our Documentation for Cloud)

Xray in-App Notifications
(tick) - Available

Image Added

Image Added

(tick) - Available

Archiving Xray Issues
(tick) - Available

Image Added

plus sign cloud

 - Available including ((tick) -

(note: Adds new feature Auto-Archiving)

StorageNot Applicable, storage is managed on-premise

plus sign cloud

- Ability to manage StorageMiscellaneous Settings
(tick) - Availablewarning cloudIn Xray Cloud, Miscellaneous Settings are present not only as a Global setting but also as a Project setting, and both with limitations:
Global Settings: Miscellaneous
 - Test Run Options,
 - Defect Links,
 - Disallow executions of Tests with workflow statuses,
 - Disallow executions with workflow statuses
 - Defect Default Values → Label
 - Defect Default Values → Component
 - Enable Document Generator
 - Enable Chat Support
Project Settings: Miscellaneous
 - Test Run Options,
 - Defect Links,
 - Disallow executions of Tests with workflow statuses,
 - Disallow executions with workflow statuses
 - Defect Default Values → Label
 - Defect Default Values → Component

(note: Adds new feature Storage Management)

Miscellaneous Settings

Display the Pre-Conditions section before the Test Details

Image Added

 
(error) cloud
 - Display the Pre-Conditions section before the Test Details
(tick) -
Display Manual Test Results table in short view
(tick) - Display Manual Test Results table in short view →

Image Added

Image Added

Available under Global by default and per Project after enabling it.

(tick) -
Test Step FieldsProject admins can configure Test Step Custom Fields
(tick) - Project admins can configure Test Step Custom Fields →

Image Added

Image Added

Available by default on project level through Test Step Fields, no longer a Global Setting

(tick) - (tick) - Project admins can configure Test Run Custom Fields →
Project admins can configure Test Run Custom
Fields                                                           
Fields

Image Added

Image Added

Available by default on project level through Test Run Custom Fields, no longer a Global Setting

(tick) -
Set final Test Run status

Image Added

warning cloud

 - Set final Test Run status

(Information missing in our Documentation for Cloud)

(tick) - (tick) -
Inline Execute Tests
(tick) - Inline Execute Tests

Image Added

Image Added

Restrict tests execution to the assignee

Image Added

(error) cloud

 - Restrict tests execution to assignee

(tick) -
Fail All Steps/Examples 
                                                       
                                              

Image Added

warning cloud

- Fail All Steps/Examples →

Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.

(tick) -
Restrict automated Test
status                                                                                            
status

Image Added

(error) cloud

 - Restrict automated Test status →

However by default, you can edit, but by manually editing the imported run, the Imported Result Section gets removed from the Testing Board but it's still accessible through.

(Information missing in our Documentation for Cloud)

(tick) -
Can Edit TestRun Dates

Image Added

(error) cloud

 - Can Edit TestRun Dates →

However by default you can

edit

edit 

(Information missing in our Documentation for Cloud)

(tick) - (tick) -
Track Time
(tick)Track Time

Image Added

Image Added

Set the value of the Time Tracker
(tick)Set the value of the Time Tracker(tick) -

Image Added

Image Added

Enable Test Run Status history log in Test Executions

Image Added

(error) cloud
 - Enable Test Run Status history log in Test Executions
(tick) - (tick) -
Link Defects with Test
(tick)Link Defects with Test

Image Added

Image Added

Link Defects with Test Execution
(tick)Link Defects with Test Execution(tick) -

Image Added

Image Added

Link Defects with Requirement
(tick)Link Defects with Covered Issues(tick) -

Image Added

Image Added

User Groups allowed to add Xray Issue Types                           
                                       
  

Image Added

warning cloudUser Groups allowed to add Xray Issue Types → You cannot restrict someone from adding Xray Issue Types: Suggestion here → https://jira.getxray.app/browse/XRAYCLOUD-6784
(tick) -
User Groups allowed to add/remove Xray Notifications

Image Added

(error) cloud
 - User Groups allowed to add/remove Xray Notifications
(tick) -
Final Test Run statuses that may trigger notifications

Image Added

(error) cloud
 - Final Test Run statuses that may trigger notifications
(tick) -
Enable Hierarchical Test organization

Image Added

(error) cloud

 - Enable Hierarchical Test organization →

By default is set with Hierarchical Organization and access vary:
→ Software Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the left panel
→ Business Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the horizontal project menu Apps → Testing Board.

(tick) -
Project Roles allowed the edit Test Repository
information                                               
information

Image Added

(error) cloud

 - Project Roles allowed to edit Test Repository information →

Anyone with access to the project can edit Test Repo info.

(tick) -
Disallow executions of Tests with workflow statuses
(tick) -

Image Added

Image Added

Disallow executions
of Tests
with workflow statuses
(tick) - Disallow executions with workflow statuses(tick) - Disallow executions with workflow statuses(tick) -

Image Added

Image Added

In progress test Execution workflow status

Image Added

(error) cloud
 - In Progress Test Execution workflow status
(tick) -
Resolved Test Execution workflow status

Image Added

(error) cloud
 - Resolved Test Execution workflow status
(tick) -
Resolution for Resolved Test Execution

Image Added

(error) cloud
 - Resolution for Resolved Test Execution
(tick) -
Associate a cloned Test with all original Test Sets

Image Added

(error) cloud
 - Associate a cloned Test with all original Test Sets →  XRAYCLOUD-2939
(tick) -
Associate a cloned Test with all original Test Plans

Image Added

(error) cloud
 - Associate a cloned Test with all original Test Plans →  XRAYCLOUD-2939
(tick) -
Environment

Image Added

(error) cloud

 - Environment →

Although the option does not exist, It behaves with the default linked to "Test"

(tick) -
Steps to Reproduce

Image Added

(error) cloud

 - Steps to Reproduce →

Normal comment section for documentation.

(tick) -
Version                           
                                                                                                   
  

Image Added

(error) cloud

 - Version →

By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution.

(tick) -
Label

Image Added

(tick) - Label


Image Added

(tick) -


Component

Image Added

(tick) - Component

Image Added

(tick) -
Enable Automated Steps
Library(error)
Library   
cloud
 
- Enable Automated Steps Library → By default you can access:→ Software Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the left panel→ Business Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the horizontal project menu Apps → Testing Board.(tick) - Validate Cucumber Scenarios(error)
 
cloud
 
- Validate Cucumber Scenarios(tick) - Cucumber Export Prefixes 
                          

Image Added

(error) cloud


Validate Cucumber Scenarios

Image Added

(error) cloud
Cucumber Export Prefixes                             
                                        

Image Added

warning cloud

 - Cucumber Export Prefixes → "Available

 Available under Global Settings → Cucumber" but unable to create a prefix for a Test Plan.

(tick) -
Cucumber Language
(tick) - Cucumber Language → "Available under

Image Added

warning cloud

note: setting moved to a dedicated option in the menu tab: Global Settings → Cucumber

"

(tick) - (tick) -
Replace dash [ - ] with underscore [ _ ] when exporting issue keys as
tags                            (tick) - Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags → "Available under Global Settings → Cucumber"
tags

Image Added

(tick) -
Generate features by requirements
warning cloud - Generate features by requirements → "Available under Global Settings → Cucumber"

Image Added

(tick) -
Cucumber export feature name
(tick) - Generate features file name using summary → "Available under Global Settings → Cucumber"

Image Added

Enable Document Generator
(tick) - Enable Document Generator →

Image Added

warning cloud

Available under Global Settings Miscelaneaous & Feature

(tick) -
Max number of issues that can be exported

Image Added

(error) cloud
 - Max number of issues that can be exported
(tick) -
Max number of requirements per report or gadget

Image Added

(error) cloud
 - Max number of requirements per report or gadget
(tick) -
Maximum number of Links added to a Requirement

Image Added

(error) cloud
 - Maximum number of Links added to a Requirement
(tick) -
Test Evolution Tests Limit

Image Added

(error) cloud
 - Test Evolution Tests Limit
(tick) -
Test Evolution Test Executions Limit

Image Added

(error) cloud
 - Test Evolution Test Executions Limit
(tick) -
Test Runs list limit

Image Added

(error) cloud
 - Test Runs list limit
(tick) -
Tests per Test Plan Maximum allowed

Image Added

(error) cloud
 - Maximum allowed
(tick) -
Xray REST API - Max results per request

Image Added

(error) cloud
 - Xray REST API
(tick) -
Associating a Test Execution to a Test Plan and importing Test results

Image Added

(error) cloud
 - Associating a Test Execution to a Test Plan and importing Test results
(tick) -
Max Test Runs for bulk operations

Image Added

(error) cloud
 - Max Test Runs for bulk operations
(tick) -
Maximum size for parameter values

Image Added

(error) cloud
 - Maximum size for parameter values
(tick) -
Enable Xray Exploratory App execution links

Image Added

(error) cloud
 - Enable Xray Exploratory App execution links
(tick) -
Enable Xray Analytics

Image Added

(error) cloud
 - Enable Xray Analytics
(tick) -
Thread Pool Size

Image Added

(error) cloud
 - Thread Pool Size
(tick) - (tick) -
Enable In-app Chat Support
(tick) - Enable In-app Chat Support

Image Added

Image Added

(tick) -
Enable Xray notifications
(tick) - Enable Xray notifications

Image Added

Image Added

Show Xray notifications button
(tick) - Show Xray notifications button

Image Added

Image Added

Test Environments
(error)- Unavailable
cross mark

Image Added

(tick)Available

Automated / BDD Step Libraries

warning

 - Global Settings →

Not available as a Global setting, only as a project setting under the name "Automated Step Library"

(tick) - Available

Image Added

Parameter value lists
(tick) - Available

Image Added

Image Added

(tick)Available

Test Statuses
(tick) - Available

Image Added

Image Added

(tick)Available

Test Step Statuses
(tick) - Available

Image Added

Image Added

(tick)Available

Cucumber
(tick) - Available under Miscellaneous

Image Added

plus sign cloud
 - Available as a dedicated option
Test Run ArchivingAuto Archiving

warning

 - 

Auto Archiving is unavailable as a setting however, the Test Run Archive is available to be done manually.

(tick)Available

Image Added

API KeysNot Applicable, access levels are managed on-premise
(tick)Available

Image Added

StorageNot Applicable, storage is managed on-premise
(tick)Available

Image Added

Health Check
(error)-  Unavailable or Not Applicable
cross mark

Image Added

(tick)Available

Features
(error)
Feature Toggling
Unavailable for Server / DC 
cross mark

Image Added

(tick)Available


UI Expand
titleProject Level Settings
SettingServerCloud
Project Organization(tick) - Available (with the same use cases)(tick) - Available (with the same use cases)
Configuring Xray Test Project(tick) - Availablewarning cloud - Available under "Project Configuration → Summary"
Requirements per Project(tick) - Requirement Coverage Strategywarning cloud - Available under "Project Configuration → Test Coverage & Defects Mapping"
(tick) - Ignore Requirements with Status
(tick) - Ignore Requirements with Label
(tick) - Ignore Tests with Status
(tick) - Requirement Historical Chart Days
(tick) - Include Previous Version Requirements
(tick) - Show Flatten Requirements
(tick) - Separation of concerns(error) cloud - Unavailable
Configure Xray with an existent Project(tick) - Availablewarning cloud - Available under "Project Configuration → Summary"
Using Xray Template(tick) - Available(error) cloud - Unavailable
Agile Boards(tick) - Availablewarning cloud - Available with limitations. We are only able to use 3 Xray Custom Fields, we are unable to showcase the "Requirement Status" field (one of the most used in DC/Server)
Permissions(tick) - Available(error) cloud - Unavailable (Permissions are Jira wise)
SummaryUnavailable or Not Applicable(tick)-Available
Issue Types MappingUnavailable or Not ApplicableOnly Available for Team Managed Projects
Test Coverage(tick) - Available under Issue Type MappingAbility to set up which issue types are considered Requirements.
Defect Mapping(tick) - Available under Issue Type MappingAbility to set up which issue types are considered Defects.
Test Types(tick) - Available(tick)- Available
Test EnvironmentsUnavailable or Not Applicableplus sign cloud - Ability to manage Test Environment at a project level.
BDD Step Library(tick) - Available under the name "Automated Steps Library"(tick)- Available
Test Step FieldsAvailable under Project Settings → Test Step Fields(tick)- Available
Test Run Custom FieldsAvailable under Project Settings → Test Run Custom Fields(tick)- Available
Parameter value lists(tick) - Available(tick) - Available
Default Column Layouts(tick) - Test Execution TestRun Columns(tick)- Test Execution TestRun Columns
(tick)-Test TestRun Columns(tick)- Test TestRun Columns
(tick)-Test PreCondition Columns(tick)- Test PreCondition Columns
(tick)-Test Test Set Columns(tick)- Test Test Set Columns
(tick)-Test Test Plan Columns(tick)- Test Test Plan Columns
(tick)-Test Set Test Columns(tick)- Test Set Test Columns
(tick)-Test Plan Test Columns(tick)- Test Plan Test Columns
(tick)-Test Plan Test Execution Columns(tick)- Test Plan Test Execution Columns
(tick)-Test Coverage Columns(error) cloud - Test Coverage Columns
(tick)-Project Test Columns(error) cloud - Project Test Columns
(tick)-Project Test Set Columns(tick)- Project Test Set Columns
(tick)-Project Test Execution Columns(tick)- Project Test Execution Columns
(tick)-Project Test Plan Columns(tick)- Project Test Plan Columns
(tick)-Precondition Tests Columns(tick)- Precondition Tests Columns
Re-Indexing(tick)- Available(tick)- Available

...