Page History
...
As detailed in the Xray Terms and Concepts, Xray uses different entities as abstractions of the different testing phases; each entity addresses a different purpose. Thus, you use Tests to write the specification of your test cases. Organization, on the other hand, is handled either by Test Sets or by the Test Repository. The planning of the testing, in some version or context of a sprint, for example, is handled by the Test Plan.
Summary of Xray entities
...
Section | |||||
---|---|---|---|---|---|
|
...
|
...
|
...
|
|
...
|
...
|
...
|
...
|
...
|
...
|
...
|
...
Test Set vs. Test Plan
While Test Sets address organization, Test Plans address planning. Thus, they have different purposes.
...
A Test Set does not provide any direct information related with test results.
A Test Plan, on the other hand, tracks the results of some Tests in some version/sprint of the SUT. Thus, its purpose is to identify the Tests you want to run, to schedule executions for them and then group the respective results.
Thus, a Test Plan can be seen as a higher-level entity above Test Executions. It groups multiple Test Executions and presents a consolidated overview (i.e., the latest status) for the Tests tracked within it.
For a given version, or a given sprint, you may create one or more Test Plans to track the test results related to different tests (e.g., you may create a Test Plan for regression testing and another one for non-regression testing).
In summary...
...
Each Xray entity (e.g., Test, Precondition, Test Set, Test Execution, Test Plan) has a purpose. Typically, these entities are related to different testing phases.
We clarified the distinction between a Test Set and a Test Plan. While both contain lists of Tests, the Test Plan has planning/execution semantics while the Test Set is a simple list of grouped test cases.
Xray gives you the ability to use all or just a subset of these entities so you can better meet your team’s needs. You may decide to start simple and then enhance your process along the way by using additional entities. Either way, Xray is as flexible as you want it to be.