This article aims to explain some Xray Anti-patterns that can lead to future constrains or even data integrity issues. Please use this information carefully and taking in consideration your own setup and team processes.
Anti-Pattern Description:
Tests without Execution are Test Cases that are created but never executed and this can result in misleading Test Coverage and lesser quality of the product.
Solution:
An effective solution for this relies on improved reporting, end-user education and possibly embracing automation in case the current solution does not have one.
Reporting
You should look for a clear view for managing this anti-pattern, the options are through Xray’s Requirement Traceability Matrix (Document Generator Template Report) or the Traceability Report. For a more tailored approach such as for a Project Lead, we recommend the usage of saved filters in a dashboard. Such as using the JQL below with Jira's Filter Results Gadget.
In case you use Xray Data Center, the JQL option is:
issue in testsWithoutTestExecution() and createdDate < -7d
Should you use Xray Cloud, it is on the verge of receiving a sort of insights tool which will give you notice of this anti-pattern and others in a Xray page.
Audit and Review
Assure that within your meetings or governance, there's a process for Test Execution Assignment as that helps increase accountability for any test to be executed as planned.
Learn More
Revisit our Documentation on Test Runs and take advantage of all Xray Features.
DC: https://docs.getxray.app/display/XRAY/Test+Runs
Cloud: https://docs.getxray.app/display/XRAYCLOUD/Test+Runs
Our Academy offers Xray Essentials for Cloud & Data Center Course to help you get familiarized on how to Execute a test and all deriveratives.
In fact we encourage your team to go through all the courses → Xray Academy