Overview
Xray Test Case Designer is a revolutionary test design optimization tool that will increase the effectiveness of your testing
It is used by teams in the early stages of the testing processes (and by teams when they’re creating scenario-based requirements). Benefitting from Intelligent Augmentation algorithms, Xray Test Case Designer test sets have been repeatedly proven to find more defects (and find them more efficiently) than hand-selected test sets.
To do so, it carefully constructs combinations of test conditions to achieve as much coverage as possible in as few tests as possible using applied statistics-based optimization methods that have been refined over more than 40 years.
This is the core feature of Xray Test Case Designer, and to achieve that it focuses on these areas:
- Systematically avoiding wasteful repetition.
- Systematically covering not only all user-specified requirements, but also 100% of all of the application’s critical interactions.
- doing so in the lowest mathematically possible number of tests.
With Xray Test Case Designer, you’ll test much faster. You’ll also achieve objectively much better testing. Let’s begin by discussing three key ways Xray Test Case Designer will save you and your colleagues time before we explain how scenarios you’ll generate using the tool are far more thorough than the ones selected by hand.
Design Faster
Generate test models in seconds at the push of a button
Generating tests models in Xray Test Case Designer is a fundamentally different process than selecting and documenting individual tests by hand, one by one. Generating optimized scenarios using Xray Test Case Designer requires that a thoughtful designer starts by identifying inputs and variation ideas and entering those into the tool.
Once identified, you’ll be able to generate entire sets of extremely thorough and extremely efficient scenarios in seconds and adjust them as necessary.
Approve Faster
Clearly communicate testing coverage for faster approvals
Each time you generate a set of scenarios, Xray Test Case Designer automatically creates insightful interaction coverage reports that make it clear exactly what (and what is not) covered after any scenario you choose. These visualizations facilitate clear and efficient communication between stakeholders. With Xray Test Case Designer’s coverage graphs in hand, you will immediately have clear, actionable, and fact-based answers to the questions posed above and the related questions of “How many tests are enough?”
Automate Faster
Quickly transform optimized scenarios into automated tests
If a large percentage of your automated tests today are individually written using hard-coded variables, the SDET’s, Developers, and/or automation engineers responsible for scripting and maintaining those would love our tool.
Xray Test Case Designer enables accelerated, optimized in-sprint automation because you can:
- Rapidly create clear, consistent steps that leverage Behavior Driven Development principles – the largest benefit is the one-to-many relationship between Xray Test Case Designer scripts and the data scenarios.
- Export one Scenario block into multiple skeletal scripts based on the language of your choosing.
- Maintain and reuse the script components much faster thanks to the model-based approach.
Eliminate wasteful redundancy
Stop hand-selecting redundant tests.
The most common type of wasteful repetition is that certain system paths and certain combinations of test inputs get tested again and again in test after test.Based on our experience analyzing thousands of hand-selected test sets, even when those sets achieve “requirements coverage,” they consistently fail to thoroughly test critical system interactions.
Eliminate Gaps
Xray Test Case Designer uses sophisticated test generation algorithms powered by Intelligent Augmentation to systematically eliminate these coverage gaps. Whether a system under test has 50 critical interactions or 50,000 critical interactions, Xray Test Case Designer will keep track of 100% of them and ensure your tests cover all of them (and do so in the fewest possible scenarios).
Maximize variation and thoroughness
The majority of software defects are triggered by simple interactions within a system.
Every test you generate with Xray Test Case Designer is optimized to achieve maximum coverage, allowing teams to achieve greater coverage in fewer overall tests.
Xray Test Case Designer will guarantee that 100% of those system interactions are covered in as few tests as possible.
Features
| Supported? | |
|---|---|
| Create, view, edit, copy Test Models |  |
| Test Model revisions |
|
| Import Test Models from Excel |
|
| Import Test Models from mind maps (OPML) |
|
| Share Test Models |
|
| Export Test Models | |
| Parameters | |
| Create, view, edit Parameters |
|
| Order Parameters |
|
| Add Value Expansions |
|
| Bulk update |
|
| Rules | |
| Constraints definition |
|
| Invalid constraints |
|
| Bound constraints |
|
| Forced Interactions definition |
|
| Import Forced Interactions |
|
| Scenarios | |
| Standard and optimized scenarios generation |
|
| Multi way interactions |
|
| Mixed-strength interactions |
|
| Scenario Freeze option |
|
| Export Scenarios |
|
| Scripts | |
| Manual Tests |
|
| Native support for BDD (Gherkin/Cucumber) |
|
| Analysis | |
| Coverage Matrix |
|
| Coverage Graph |
|
| Review | |
| Notes |
|
| Mind Map View |
|
| Scorecard |
|
Access Test Case Designer
Xray Test Case Designer is a feature included in Xray Enterprise offer, to access this feature you need to make sure that:
- Xray Enterprise Requires an active Xray license
- Xray Enterprise active license
- Minimum Xray version 6.3.0
When a valid Xray Enterprise license is detected, a new Xray Enterprise configuration option will be made available to setup your Test Case Designer instance
Initial Setup
Access the new "Xray Enterprise" global option
Provide the specific URL that Xray provided you (If you don't have this URL please contact support)
The Test Case Designer menu option is now available on your Xray enabled projects
Terms & Concepts
Test Model
A Test Model is your test bench where you define all the parameters, values and rules so that the system can generate all the scenarios and test scripts automatically. In this section we will go through the basic steps to create/copy your test models.
Parameters
Test parameterization is a powerful practice that allows the same test to be executed multiple times with different parameters. Parameters are similar to input values (variables) that can change with each execution.
Rules
In specific scenarios, system allows user to define what parameter values can never be tested together or in the other hand, scenarios where parameter values can only be tested together.
These are called rules and you can find more information here
Scenarios
The core process where user can define using powerful coverage optimization algorithms and multiple combinatorial strengths to achieve greater coverage in fewer overall tests.
Scripts
Scripts are user-assisted tests, listing an assortment of guidelines the user must follow, and the results that such behavior is expected to accomplish.
Quick Getting Started
< Explain briefly how to use Test Designer - First you create parameters, then rules, etc etc>