Page History
...
| Info | ||
|---|---|---|
| ||
Please read Understanding coverage and the calculation of coverage status and the status of TestsTest and requirement statuses for a more in-depth explanation of the calculation of these statuses. |
...
Tests and coverable issues (e.g. requirements) can be analyzed from different perspectives/scopes.
...
In fact, Tests and coverable issues can be analyzed from these scopes (or dimensions):
- LatestNone (latest execution)
- Version
- Test Plan
Besides these scopes, they can also be analyzed based with some additional criteria that will affect the calculated values:
- Test Environment
- Final statuses precedence over non-final ones
...
None (latest execution)
If you don't care about versions, or are not using versions at all, and just want to see the calculated statuses based on the latest runs, analysis by Version "LatestNone (latest execution)" can be used for that purpose.
...
Within the issue screen, the coverage status can be evaluated for the specified scope within the Test Coverage section. The calculated coverage status is shown on the right side.
Reports
...
Overall Requirement Coverage
Coverable issues can be analyzed for some given scope using the Test Overall Requirement Coverage report. More info about this report in Test Overall Requirement Coverage Report.
Tests
The status of Tests can be evaluated directly in the Test issue view screen and also on some reports, including the Tests List report and, indirectly, the Test Sets List report.
Tests can also be evaluated in the coverable issue screen, within the "Test Coverage" section.
Issue screen
Within the Test issue screen, the Test status can be evaluated for the specified scope. The calculated status is cached for performance reasons; since data can be unsynced between Jira and Xray, it's possible to enforce a recalculation and show an up-to-date value.
Reports
Tests List
The Tests can be analyzed for some given scope using the Tests List project tab report (more info in Tests Overview).
Test Sets
The status of Test Sets (i.e. of the Tests contained within a Test Set) can be analyzed using the using the Test Sets List project tab report (more info in Test Sets Overview).
Reports
Tests Sets List
The Test Sets, and implicitly the Tests within them, can be analyzed for some given scope using the Test Sets List report.
Troubleshooting
"I have an Xray Project to Test my Requirements project. I've created a Test and I have already executed the Test, but I always get requirements status Covered but Not Run."
| Warning |
|---|
You might be using environments on Test Executions that are affecting the aggregated status for the Tests. If you have a couple of Test Executions, one with a specific environment (e.g., Android) and another without any environment, then Xray will also consider the empty environment when calculating the aggregated status (this is, of course, if all Test Executions are within the same Version or Test Plan). |
...
