Page History
| Info |
|---|
"Test Environment" is a concept introduced in Xray v2. Here is a short video that explains Test Environments and how you can use them. |
| Table of Contents |
|---|
What is a
...
Test Environment
Generically speaking, a test environment is an environment that contains all necessary elements, including the SUT, so you can perform testing on it.
...
- a testing stage (e.g. "development", "staging", "preproduction", "production")
- a device model or device operating system (e.g. "Android", "iOS")
- an operating system (e.g. "Windows", "macOS", "Linux")
- browser (e.g. "Edge", "Chrome", "Firefox")
Thus, semantics of what a "Test Environment" represents depends on your specific context.
Some tests may be tailored for or only run in some environments.
Whenever performing testing on different environments, results
...
| Info | ||
|---|---|---|
| ||
In Xray, Test Environments are focused on the execution aspect, providing the means to schedule tests and analyze their results in different environments. Thus, they're explicitly associated with Test Execution issues. |
Benefits of using Test Environments
- avoid duplication of Tests, whenever you have to run the same test on different environments
- ability to track the latest status of tests on different environments
- ability to track coverage on each environment
- ability to track overall coverage, considering the coverage/results on each environment
- ability to perform reporting, including traceability, per each environment or globally (i.e. considering all results on all different environments)
Overview
The status of a Test (i.e., TestRunStatus) is generally calculated by looking at the Test's last execution (more detail here). However, this does not work well if you execute the same Test in two different test environments (e.g., devices) and you want the two results to be consolidated.
...