Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Image Modified

Table of Contents
maxLevel4

UI Expand
titleTable of Contents

Table of Contents

Introduction

...

Xray Test Case Designer is a revolutionary test Designer is an Xray Enterprise Test case design optimization tool that will increase enhances the effectiveness of your testing while saving time.

Teams use it during It is used by teams in the early stages of the testing processes (and by teams when they’re creating process, including when they create scenario-based requirements)Requirements. Benefitting from Intelligent Augmentation algorithms, Xray Test Case Designer test sets have been Benefiting from the model-based approach and the intelligent augmentation algorithm, Xray Test Case Designer's Test suites have repeatedly proven to find more defects (- and find them do so more efficiently ) - than hand-selected test setsTest suites. 

Xray Test Case Designer To do so, it carefully constructs combinations of test Test conditions to achieve as much coverage as possible in as few tests as possible using applied maximum coverage with the fewest possible Tests, using statistics-based optimization methods that have been refined over more than 40 years.

This is the core feature of of Xray Test Case Designer , and to achieve that it focuses on these the following areas:

  • Systematically avoiding wasteful wasteful repetition.
  • Systematically covering not only all user-specified requirements , but also and 100% of all of the application’s critical the application's critical interactions.
  • doing Doing so in the lowest mathematically possible number of testsTests.

...

Benefits

With Xray Test Case Designer, you’ll test much faster. You’ll also achieve objectively much better testing. Let’s begin by discussing three key ways Xray Test Case Designer will save you and your colleagues time before we explain how scenarios you’ll generate using the tool are far more thorough than the ones selected by hand.

...

width33

Design Faster

Generate test models in seconds at the push of a button
Image Removed

the goal is to enhance both the speed and the quality - teams create more thorough Tests faster, find defects earlier in the process, and do so in fewer Tests to run and maintain over time, which leads to cost savings.

Designing Faster

Creating Test Models

...

in Xray Test Case Designer is

...

fundamentally different

...

from manually selecting and documenting individual

...

Tests. Instead, the designer thoughtfully identifies inputs and variations and enters them into the tool.

...

Once identified,

...

you can generate entire

...

suites of

...

thorough and

...

efficient scenarios in seconds and adjust them as

...

needed.

...

width40px

...

width33

Approve Faster

Clearly communicate testing coverage for faster approvals

...

Approving Faster

Each time you generate a set of

...

Scenarios, the Xray Test Case Designer automatically creates insightful interaction coverage reports

...

, clearly showing what is and isn't covered by any chosen scenario. These visualizations facilitate clear and efficient communication

...

among stakeholders.

With Xray Test Case

...

Designer's coverage graphs

...

, you

...

'll have clear, actionable, and fact-based answers to

...

questions like "How many Tests are enough?

...

width40px

...

width33

Automate Faster

Quickly transform optimized scenarios into automated tests

Image Removed

...

".

Automating Faster

If many of your automated Tests are currently written using hard-coded variables,

...

your SDETs,

...

developers, and

...

automation engineers

...

will benefit from Xray Test Case Designer. It enables accelerated

...

and optimized in-sprint automation

...

:

  • Rapidly create clear, consistent

...

  • Test Steps that leverage Behavior Driven Development principles

...

  • . The primary benefit is the one-to-many relationship between Xray Test Case

...

...

  • Scenarios.
  • Export one

...

  • scenario block into multiple skeletal

...

  • Scripts based on

...

  • your chosen language (using the Automated Test Framework option).
  • Maintain and reuse

...

  • Script components

...

  • faster, thanks to the model-based approach.

...

Eliminating Wasteful Redundancy

...

width33

...

Stop hand-selecting redundant tests.
Image Removed

The most common type of wasteful repetition

...

occurs when certain system paths and

...

Test input combinations are tested repeatedly across multiple Tests (instead of branching out). Based on our analysis of thousands of hand-selected

...

Test suites, even

...

those achieving "Requirements coverage" often fail to thoroughly

...

Test critical system interactions.

...

width40px

...

width33

Eliminate Gaps

...

Eliminating Gaps, Maximizing Variation and Thoroughness

Most software defects are triggered by simple interactions within a system. Xray Test Case Designer uses

...

combinatorial Test generation algorithms powered by

...

intelligent augmentation to systematically eliminate coverage gaps. Whether a system under

...

Test has 50 critical interactions or

...

5000,

...

Xray Test Case Designer

...

keeps track of 100% of them

...

, ensuring your

...

Tests cover them all

...

in the fewest possible scenarios

...

width40px

...

width33

Maximize variation and thoroughness

...

Image Removed

...

.

Xray Test Case Designer will guarantee that 100% of those system interactions are covered in as few tests as possible.

Features

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Image Removed

...

Note

Xray Test Case Designer is a feature included in Xray Enterprise offer, to access this feature you need to make sure that:

  • Xray Enterprise Requires an active Xray license 
  • Xray Enterprise active license
  • Minimum Xray version 6.3.0

When a valid Xray Enterprise license is detected, a new Xray Enterprise configuration option will be made available to setup your Test Case Designer instance

...

UI Steps
sizesmall
UI Step

Access the new "Xray Enterprise" global option
Image Removed

UI Step

Provide the specific URL that Xray provided you (If you don't have this URL please contact support)
Image Removed

UI Step

The Test Case Designer menu option is now available on your Xray enabled projects

Image Removed

...

Concepts

Test Model

A Test Model is an abstraction of a focused use case that we you aim to testTest.   This model is made built around a specific scope (e.g., "book a flight") that can be exercised in different ways, depending on a combination of input parameters parameters (e.g., "origin, destination, number of seats, date"). To find bugs related with to the input parameters and increase the related coverage, an optimized set test of Test cases (manual or automated) can be derived from it. More info on Test Models here.

Parameters

The parameters are used to Parameters define the variables , and the related their possible values , that are applicable to within the Test Model. Usually Typically, these refer to the input variables.Parameters Parameters, together along with the restrictions specified using Rules, will be are used to derive the combination of parameterParameters/valuesValues.More  

Info

...

Info

Test parameterization is a powerful practice that allows the same test to

be

be executed multiple times with different parameters. Parameters are similar to input values (variables) that can change with each execution.

Rules

While Parameters are used to enumerate , in general, the variables in our your Test Model and the their possible values they can have, Rules allow us you to apply some restrictions as we may not be interested in having all the combinations of these variables. Rules can be used to define what define which parameter values can should never be tested together , as because they either don't make sense in reality (e.g., Windows + Safari) or because they may not be aren't representative/relevant.In the other

handConversely, Rules can also be used to enforce scenarios Scenarios where parameter values can only be tested together.

More info on Rules here.

certain lengthy parameter value combinations must be incorporated into the Test suite as a priority.

Scenarios

Scenarios are the generated combination combinations of input parameter values, where each row represents a combination of parameters Parameters (and their valuesValues) to be used in a testTest.

We can think Think of Scenarios as an optimized dataset that will be used to iterate our your Test Model multiple times, and thus test testing it under slightly different circumstances.

Not all combinations of parameter/values Parameter/Value combinations are created. Xray Test Case Designer uses  coverage coverage optimization algorithms (e.g., pairwise, n-wise) to achieve a high level of coverage with in few testsTests. This can be adjusted to achieve a for greater coverage if needed. More info on Scenarios here.

Scripts

While Scenarios focus on the data that will be used for our testsyour Tests, Scripts provide the actual context so that testers know how /and where to apply it.

Scripts have the detailed steps with  contain detailed Steps with actions and expectations for our your test scenarios. Scripts can be either manual test scripts or automated test scripts.

For manual test scriptsTest Scripts, detailed steps Steps and expected results can be specified, where with parameters may be mentioned. These parameters will be replaced by the respective values whenever generating when exporting the tests Tests later on.

For automated test scripts, Test Scripts, you can specify Gherkin (e.g., Cucumber) Scenario Scenarios or Scenario Outline can be specified Outlines, or even Robot Framework test Test cases. Similarly Similar to manual test scriptsTest Scripts, parameters can be mentioned in the specification , so they can be replaced later on and replaced by proper values . More info on Scripts herelater.

Features

FeaturesSupported?
Create, view, edit, and copy Test Models


Image Added
Test Model revision history

Image Added

Import Test Models from Excel 

Image Added

Import Test Models from mind maps (OPML) 

Image Added

Share Test Models 

Image Added

Export Test Models

Image Added

Parameters
Create, view, and edit Parameters

Image Added

Order Parameters

Image Added

Add Value Expansions (equivalence classes)

Image Added

Bulk update 

Image Added

Boundary/ranged values

Image Added

Rules
Constraints definition

Image Added

Invalid, Bound, Skip constraints

Image Added

Complex multi-parameter rules

Image Added

Forced Interactions definition

Image Added

Import Forced Interactions

Image Added

Scenarios
Standard and optimized Scenarios generation

Image Added

Pairwise and N-way interactions

Image Added

Mixed-strength interactions

Image Added

Scenario Freeze option

Image Added

Export Scenarios

Image Added

Scripts
Manual Tests

Image Added

Native support for BDD (Gherkin/Cucumber)

Image Added

Analysis
Coverage Matrix

Image Added

Coverage Graph

Image Added

Review
Notes

Image Added

Mind Map View

Image Added

Scorecard

Image Added


Info

TTT: Test Case Designer

Expand
titleSupport/Troubleshooting

If you have questions or technical issues, please contact the Support team via the Customer Portal (Jira service management) or send us a message using the in-app chat.