Anti-Pattern Description

Tests without Execution are Test Cases that are created but never executed and this can result in misleading Test Coverage and lesser quality of the product.

Solution

An effective solution for this relies on improved reporting, end-user education and possibly embracing automation in case the current solution does not have one.

Reporting

You should look for a clear view for managing this anti-pattern, the options are through Xray’s Requirement Traceability Matrix  (Document Generator Template Report) or the Traceability Report. For a more tailored approach such as for a Project Lead, we recommend the usage of saved filters in a dashboard. Such as using the JQL below with Jira's Filter Results Gadget.

In case you use Xray Data Center, the JQL option is: 

issue in testsWithoutTestExecution() and createdDate < -7d

Should you use Xray Cloud, it is on the verge of receiving a sort of insights tool which will give you notice of this anti-pattern and others in a Xray page.

Nonetheless, for the moment, it is possible to get this information using Document Generator. 

Snippet code:

&{for issues}
#{if (%{'${IssueTypeName}'.equals('Test')})}
#{if (%{'${TestExecutionsCount}'.equals('0')})}
Test without Test Executions Key - ${Key}
#{end}
#{end}
&{end}

Audit and Review

Assure that within your meetings or governance, there's a process for Test Execution Assignment as that helps increase accountability for any test to be executed as planned.

Learn More

Revisit our Documentation on Test Runs and take advantage of all Xray Features.

• Test Runs on Xray DC
• Test Runs on Xray Cloud

Our Academy offers Xray Essentials for Cloud & Data Center Course to help you get familiarized on how to Execute a test and all deriveratives.

In fact we encourage your team to go through all the courses → Xray Academy.