Versions Compared

Old Version 2

changes.mady.by.user Francisco Fonseca

Saved on

compared with

New Version 3

changes.mady.by.user Francisco Fonseca

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

UI Expand
titleGlobal Level Settings
SettingServerCloud
Demo ProjectUnavailableAbility to create a demo project to showcase and test Xray Functionalities.
Custom Fields ConfigurationTest Run Status Custom Field VersionTest Run Status Custom Field Version → behaves like "No Version" is selected.
Custom Fields ConfigurationTest Set Status Custom Field VersionTest Set Status Custom Field Version → No behavior in sight.
Custom Fields ConfigurationRequirement Status Custom Field VersionsRequirement Status Custom Field Versions → behaves like "No Version" is selected.
Xray Linking RestrictionsAvailableUnavailable
Manage Test TypesManage Test TypeAvailable under "Global Settings – Test Types" and "Project Settings – Test Types" after enabling it → Test Type define works for both Test and Precondition.
Manage Test TypesManager Pre-Condition TypeAvailable under "Global Settings – Test Types" and "Project Settings – Test Types" after enabling it → Test Type define works for both Test and Precondition.
Coverage & Defects ConfigurationAvailableAvailable under "Project Configuration → Test Coverage & Defects Mapping"
Workflow & NotificationsAvailableAvailable under "Global Settings"
Migration & CopyAvailableUnavailable
Backup & Restore

AvailableAvailable under "Global Settings → Backup"
Backup & RestoreAvailable
Restore (Not documented in our Documentation that we can't)
Xray in-App NotificationsAvailableAvailable
Archiving Xray IssuesAvailableAvailable including (Auto-Archiving)
StorageNot ApplicableAvailable
Miscellaneous Settings

AvailableIn Xray Cloud,
Miscelaneous
Miscellaneous Settings are present not only as a Global setting but also as a Project setting, and both with limitations:
Global Settings:
Miscelaneous
Miscellaneous
 - Test Run Options,
 - Defect Links,
 - Disallow executions of Tests with workflow statuses,
 - Disallow executions with workflow statuses
 - Defect Default Values → Label
 - Defect Default Values → Component
 - Enable Document Generator
 - Enable Chat Support

Project Settings:
Miscelaneous
Miscellaneous
 - Test Run Options,
 - Defect Links,
 - Disallow executions of Tests with workflow statuses,
 - Disallow executions with workflow statuses
 - Defect Default Values → Label
 - Defect Default Values → Component
Display the Pre-Conditions section before the Test Details Display the Pre-Conditions section before the Test Details
Display Manual Test Results table in short view Display Manual Test Results table in short view → Available under Global by default and per Project after enabling it.
Test Step FieldsProject admins can configure Test Step Custom Fields Project admins can configure Test Step Custom Fields → Available by default on project level through Test Step Fields, no longer a Global Setting
Project admins can configure Test Run Custom Fields                                                            Project admins can configure Test Run Custom Fields → Available by default on project level through Test Run Custom Fields, no longer a Global Setting
Set final Test Run status Set final Test Run status → To review with Sofia. (Information missing in our Documentation for Cloud)
Inline Execute Tests Inline Execute Tests
Restrict tests execution to assignee Restrict tests execution to assignee
Fail All Steps/Examples                                                                                                         Fail All Steps/Examples → Available however changing the Run to Fail will change all Test Steps to fail and not just the ones in TODO.
Restrict automated Test status                                                                                             Restrict automated Test status → However by default you can edit, but by manually editing the imported run, the Imported Result Section Get's removed from Testing Board but it's still acessible through. (Omisso)
Can Edit TestRun Dates Can Edit TestRun Dates → However by default you can edit (Omisso)
Track Time Track Time
Set the value of the Time Tracker Set the value of the Time Tracker
Enable Test Run Status history log in Test Executions Enable Test Run Status history log in Test Executions
Link Defects with Test Link Defects with Test
Link Defects with Test Execution Link Defects with Test Execution
Link Defects with Requirement Link Defects with Covered Issue
User Groups allowed to add Xray Issue Types                                                                    User Groups allowed to add Xray Issue Types → You cannot restrict someone from adding Xray Issue Types: Suggestion here → https://jira.getxray.app/browse/XRAYCLOUD-6784
User Groups allowed to add/remove Xray Notifications User Groups allowed to add/remove Xray Notifications
Final Test Run statuses that may trigger notifications Final Test Run statuses that may trigger notifications
Enable Hierarchical Test organization Enable Hierarchical Test organization → By default is set with Hierarchical Organization and access vary:
Software Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the left panel
Business Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the horizontal project menu Apps → Testing Board.
Project Roles allowed to edit Test Repository information                                               Project Roles allowed to edit Test Repository information → Anyone with access to the project can edit Test Repo info.
Disallow executions of Tests with workflow statusesDisallow executions of Tests with workflow statuses
Disallow executions with workflow statusesDisallow executions with workflow statuses
In
progress
Progress Test Execution workflow statusIn
progress
Progress Test Execution workflow status
 Resolved Test Execution workflow statusResolved Test Execution workflow status
 Resolution for Resolved Test ExecutionResolution for Resolved Test Execution
 Associate a cloned Test with all original Test SetsAssociate a cloned Test with all original Test Sets →  XRAYCLOUD-2939
 Associate a cloned Test with all original Test PlansAssociate a cloned Test with all original Test Plans →  XRAYCLOUD-2939
 EnvironmentEnvironment → Although the option does not
exists
exist, It behaves with the default linked to "Test"
 Steps to ReproduceSteps to Reproduce → Normal comment section for documentation.
 Version                                                                                                                               Version → By default it behaves as the Affect Version field of the defects created in the context of a test run will be populated by FixVersion value of Test Execution.
 LabelLabel
 ComponentComponent
 Enable Automated Steps LibraryEnable Automated Steps Library → By default you can access:
 Enable Automated Steps LibrarySoftware Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the left panel
 Enable Automated Steps LibraryBusiness Projects Test Repo and Test Plan are accessible after navigating to Testing Board from the horizontal project menu Apps → Testing Board.
 Validate Cucumber ScenariosValidate Cucumber Scenarios
 Cucumber Export Prefixes                                                                                                  Cucumber Export Prefixes → "Available under Global Settings → Cucumber" but unable to create a prefix for a Test Plan.
 Cucumber LanguageCucumber Language → "Available under Global Settings → Cucumber"
 Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags                            Replace dash [ - ] with underscore [ _ ] when exporting issue keys as tags → "Available under Global Settings → Cucumber"
 Generate features by requirementsGenerate features by requirements → "Available under Global Settings → Cucumber"
 Cucumber export feature nameGenerate features file name using summary → "Available under Global Settings → Cucumber"
 Enable Document GeneratorEnable Document Generator → Available under Global Settings Miscelaneaous & Feature
 Max number of issues that can be exportedMax number of issues that can be exported
 Max number of requirements per report or gadgetMax number of requirements per report or gadget
 Maximum number of Links added to a RequirementMaximum number of Links added to a Requirement
 Test Evolution Tests LimitTest Evolution Tests Limit
 Test Evolution Test Executions LimitTest Evolution Test Executions Limit
 Test Runs list limitTest Runs list limit
 Tests per Test Plan Maximum allowedMaximum allowed
 Xray REST API - Max results per requestXray REST API
 Associating a Test Execution to a Test Plan and importing Test resultsAssociating a Test Execution to a Test Plan and importing Test results
 Max Test Runs for bulk operations Max Test Runs for bulk operations
 Maximum size for parameter values Maximum size for parameter values
 Enable Xray Exploratory App execution links Enable Xray Exploratory App execution links
 Enable Xray Analytics Enable Xray Analytics
 Thread Pool Size Thread Pool Size
 Enable In-app Chat Support Enable In-app Chat Support
 Enable Xray notifications Enable Xray notifications
Show Xray notifications button Show Xray notifications button
Test EnvironmentsUnavailable  Available
Automated / BDD Step LibrariesNot available as a Global setting, only as a project setting under the name "Automated Step Library"  Available
Global Settings → Parameter value listsAvailable  Available
Test StatusesAvailable  Available
Test Step StatusesAvailable  Available
CucumberAvailable under Miscellaneous  Available as a dedicated option
Test Run ArchivingAuto Archiving is unavailable as a setting however, the Test Run Archive is available to be done manually.  Available
API KeysNot Applicable, access levels
is
are managed on-premise  Available
StorageNot Applicable, storage is managed on-premise  Available
Health Check Unavailable or Not Applicable  Available
Features Unavailable or Not Applicable  Available
UI Expand
titleProject Level Settings
SettingServerCloud
Project Organization  Available (with the same use cases)
  Available
Available (with the same use cases)
Configuring Xray Test Project  Available
 
Available under "Project Configuration → Summary"
Requirements per Project  Requirement Coverage Strategy
 
Available under "Project Configuration → Test Coverage & Defects Mapping"
Requirements per Project
  Ignore Requirements with Status
 
Available under "Project Configuration → Test Coverage & Defects Mapping"
Requirements per Project
  Ignore Requirements with Label
 
Available under "Project Configuration → Test Coverage & Defects Mapping"
Requirements per Project
  Ignore Tests with Status
 
Available under "Project Configuration → Test Coverage & Defects Mapping"
Requirements per Project
  Requirement Historical Chart Days
 
Available under "Project Configuration → Test Coverage & Defects Mapping"
Requirements per Project
Separation of concernsUnavailable
Requirements per Project
Include Previous Version Requirements
 
Available under "Project Configuration → Test Coverage & Defects Mapping"
Requirements per Project
Show Flatten Requirements
 
Available under "Project Configuration → Test Coverage & Defects Mapping"
Configure Xray with an existent ProjectAvailable
 
Available under "Project Configuration → Summary"
Using Xray TemplateAvailable
 
Unavailable
Agile BoardsAvailable
 
Available with limitations. e.g. --> unable to use custom fields.
PermissionsAvailable
 
Unavailable (Permissions are Jira wise)
SummaryUnavailable or Not ApplicableAvailable
Unavailable or Not Applicable
  Available
Demo Project
Issue Types MappingUnavailable or Not Applicable  Only Available for Team Managed Projects
Test CoverageAvailable under Issue Type Maping  Ability to set up which issue types are considered Requirements.
Defect MappingAvailable under Issue Type Maping  Ability to set up which issue types are considered Defects.
Test TypesAvailable  Available
Test EnvironmentsUnavailable or Not Applicable  Ability to manage Test Environment at a project level.
BDD Step LibraryAvailable under Project Settings  Available
Test Step FieldsAvailable under Project Settings > Test Steps Custome  Available
Test Run Custom FieldsAvailable under Project Settings  Available
Parameter value listsAvailable  Available
Default Column LayoutsTest Execution TestRun Columns Test Execution TestRun Columns
Default Column Layouts
Test TestRun Columns Test TestRun Columns
Default Column Layouts
Test PreCondition Columns Test PreCondition Columns
Default Column Layouts
Test Test Set Columns Test Test Set Columns
Default Column Layouts
Test Test Plan Columns Test Test Plan Columns
Default Column Layouts
Test Set Test Columns Test Set Test Columns
Default Column Layouts
Test Plan Test Columns Test Plan Test Columns
Default Column Layouts
Test Plan Test Execution Columns Test Plan Test Execution Columns
Default Column Layouts
Test Coverage Columns Test Coverage Columns
Default Column Layouts
Project Test Columns Project Test Columns
Default Column Layouts
Project Test Set Columns Project Test Set Columns
Default Column Layouts
Project Test Execution Columns Project Test Execution Columns
Default Column Layouts
Project Test Plan Columns Project Test Plan Columns
Default Column Layouts
Precondition Tests Columns Precondition Tests Columns
Re-IndexingAvailableAvailable