Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Section
Column
width33

Eliminate wasteful redundancy

Stop hand-selecting redundant tests.

The most common type of wasteful repetition is that certain system paths and certain combinations of test inputs get tested again and again in test after test.
Based on our experience analyzing thousands of hand-selected test sets, even when those sets achieve “requirements coverage,” they consistently fail to thoroughly test critical system interactions.

Column
width40px


Column
width33

Eliminate Gaps


Image Modified

Xray Test Case Designer uses sophisticated test generation algorithms powered by Intelligent Augmentation to systematically eliminate these coverage gaps. Whether a system under test has 50 critical interactions or 50,000 critical interactions, Xray Test Case Designer will keep track of 100% of them and ensure your tests cover all of them (and do so in the fewest possible scenarios).

Column
width40px


Column
width33

Maximize variation and thoroughness


The majority of software defects are triggered by simple interactions within a system.

Every test you generate with Xray Test Case Designer is optimized to achieve maximum coverage, allowing teams to achieve greater coverage in fewer overall tests.

Xray Test Case Designer will guarantee that 100% of those system interactions are covered in as few tests as possible.

Features



Supported?
Create, view, edit, copy Test Models


Image Modified
Test Model revisions

Image Modified

Import Test Models from Excel 

Image Modified

Import Test Models from mind maps (OPML) 

Image Modified

Share Test Models 

Image Modified

Export Test Models
Parameters
Create, view, edit Parameters

Image Modified

Order Parameters

Image Modified

Add Value Expansions

Image Modified

Bulk update 

Image Modified

Rules
Constraints definition

Image Modified

Invalid constraints

Image Modified

Bound constraints

Image Modified

Forced Interactions definition

Image Modified

Import Forced Interactions

Image Modified

Scenarios
Standard and optimized scenarios generation

Image Modified

Multi way interactions

Image Modified

Mixed-strength interactions

Image Modified

Scenario Freeze option

Image Modified

Export Scenarios

Image Modified

Scripts
Manual Tests

Image Modified

Native support for BDD (Gherkin/Cucumber)

Image Modified

Analysis
Coverage Matrix

Image Added

Coverage Graph
ReviewSupported?

Create, view, edit, clone tests

Specify

Image Modified

Attachments on Test Steps

Image Removed
Link to Defects and Requirements
Review
Notes

Image Modified

Imbued Generic Automated Tests
Mind Map View

Image Modified

Native support for BDD (Gherkin/Cucumber)
Scorecard

Image Modified

Preconditions for test cases

Image Removed

Reuse preconditions between test cases

Image Removed

Multiple preconditions for test cases

Image Removed

Organize

Organize tests by project, version, component and label

Image Removed

Organize tests in Test Sets

Image Removed
Organize tests hierarchical, in folders, per project

Image Removed

Plan

Test plans

Image Removed
Organize tests hierarchical, in folders, per each Test Plan

Image Removed

Execute

Create, edit, clone and schedule test executions

Image Removed

Ad hoc style (execute unplanned tests)

Image Removed

Personalize and create Test Run and step statuses

Image Removed

Measure

Track with progress bars on Test Execution/Cycles and Test Plans

Image Removed

Track requirement coverage/status directly on issues, as an attribute

Image Removed
Advanced Reporting

Image Removed

(Traceability, Test Plans and Test Executions metrics, Overall and Historic Requirement Coverage)

Number of built-in reusable gadgets

6

Explore and evolve

Image Removed 

Advanced query language

Image Removed 

(extensive list of JQL functions)

REST API built-in

Image Removed

Characteristics

Consistency (Test changing non-retroactivity on past executions)

Image Removed

Using of Jira issues benefits

Test, Pre-Condition, Test Set, Test Execution, Test Plan

Configuration

Extensive configuration, including behavior  

Image Removed

Per-project configuration

Image Removed

Support for project separation between requirements and tests

Image Removed

Agile integration

Seamless integration with Jira's native Agile boards
(see Test Plans and Test Executions associated with requirements)

Image Removed

CI Integrations (Jenkins, Bamboo, TeamCity, GitLab, Maven)

Image Removed

Importing results

Cucumber, SpecFlow, Behave, Serenity BDD, Gwen, Xray JSON,  TestNG, JUnit, NUnit, xUnit, Robot, RSpec, Selenium

Importing tests

Cucumber .feature(s), Excel/CSV, Zephyr for Jira, HP QC/ALM and tests from many different automated test frameworks

Exporting testing data to fully customized DOC/PDF/Excel with Xporter

Image Removed

Integration with other Jira related tools (e.g. Confluence)

Image Removed

Integration with other top-notch apps

(Xporter, eazyBI, Structure, Apwide Golive, Bulk Clone)

Image Removed

UI-Supported languages 

English, German, French, Spanish

Mobile app

(see features & setup info)

Image Removed

(iOS, Android)

Access Test Case Designer

< Include requirements ( Xray Enterprise License> and screenshots on how to access Test Case Designer)

Terms & Concepts

< Explain all the main concepts and then link to pages where the user can learn how to use them> 

Test Model

Parameters

Rules

Scenarios

Scripts

Quick Getting Started


Access Test Case Designer

Note

Xray Test Case Designer is a feature included in Xray Enterprise offer, to access this feature you need to make sure that:

  • Xray Enterprise Requires an active Xray license 
  • Xray Enterprise active license
  • Minimum Xray version 6.3.0


When a valid Xray Enterprise license is detected, a new Xray Enterprise configuration option will be made available to setup your Test Case Designer instance

Initial Setup

UI Steps
sizesmall
UI Step

Access the new "Xray Enterprise" global option
Image Added

UI Step

Provide the specific URL that Xray provided you (If you don't have this URL please contact support)
Image Added

UI Step

The Test Case Designer menu option is now available on your Xray enabled projects

Image Added


Terms & Concepts

Test Model

A Test Model is an abstraction of a focused use case that we aim to test.  This model is made around a specific scope (e.g., "book a flight") that can be exercised in different ways, depending on a combination of input parameters (e.g., "origin, destination, number of seats, date"). To find bugs related with the input parameters and increase the related coverage, an optimized set test cases (manual or automated) can be derived from it. More info on Test Models here.

Parameters

The parameters are used to define the variables, and the related possible values, that are applicable to the Test Model. Usually these refer to the input variables.

Parameters, together with the restrictions specified using Rules, will be used to derive the combination of parameter/values.

More  info on Parameters here.


Info
Test parameterization is a powerful practice that allows the same test to be executed multiple times with different parameters. Parameters are similar to input values (variables) that can change with each execution.



Rules

While Parameters are used to enumerate, in general, the variables in our Test Model and the values they can have, Rules allow us to apply some restrictions as we may not be interested in having all the combinations of these variables.

Rules can be used to define what parameter values can never be tested together, as they either don't make sense in reality (e.g., Windows + Safari) or because they may not be representative/relevant.

In the other hand, Rules can also be used to enforce scenarios where parameter values can only be tested together.

More info on Rules here.

Scenarios

Scenarios are the generated combination of input parameter values, where each row represents a combination of parameters (and their values) to be used in a test.

We can think of Scenarios as an optimized dataset that will be used to iterate our Test Model multiple times, and thus test it under slightly different circumstances.

Not all combinations of parameter/values are created. Test Case Designer uses coverage optimization algorithms (pairwise, n-wise) to achieve a high level of coverage with in few tests. This can be adjusted to achieve a greater coverage if needed. More info on Scenarios here.

Scripts

While Scenarios focus on data that will be used for our tests, Scripts provide the actual context so that testers know how/where to apply it.

Scripts have the detailed steps with actions and expectations for our test scenarios.

Scripts can be either manual test scripts or automated test scripts.

For manual test scripts, detailed steps and expected results can be specified, where parameters may be mentioned. These will be replaced by the respective values whenever generating the tests later on.

For automated test scripts, Gherkin (e.g., Cucumber) Scenario or Scenario Outline can be specified or even Robot Framework test cases. Similarly to manual test scripts, parameters can be mentioned in the specification, so they can be replaced later on by proper values. More info on Scripts here.< Explain briefly how to use Test Designer  - First you create parameters, then rules, etc etc>