Anti-Pattern Description

Tests without executions (i.e., Test Runs) are Test cases that are created but never executed and this can result in misleading Test Coverage and lesser quality of the product.

Solution

An effective solution for this relies on improved reporting, end-user education and possibly embracing automation in case the current solution does not have one.

Reporting

You should look for a clear view for managing this anti-pattern, the options are through Xray’s Requirement Traceability Matrix  (Document Generator Template Report) or the Traceability Report. For a more tailored approach such as for a Project Lead, we recommend the usage of saved filters in a dashboard. Such as using the JQL below with Jira's Filter Results Gadget.

In case you use Xray Data Center, the JQL option is: 

issue in testsWithoutTestExecution() and createdDate < -7d

Xray Cloud users can currently obtain information about this anti-patternusing the Document Generator.

Snippet code:

&{for issues}
#{if (%{'${IssueTypeName}'.equals('Test')})}
#{if (%{'${TestExecutionsCount}'.equals('0')})}
Test without Test Executions Key - ${Key}
#{end}
#{end}
&{end}

Audit and Review

Assure that within your meetings or governance, there's a process for test execution assignment as that helps increase accountability for any test to be executed as planned.

Learn More

Revisit our Documentation on Test Runs and take advantage of all Xray Features.

• Test Runs on Xray DC
• Test Runs on Xray Cloud

Our Academy offers Xray Essentials for Cloud & Xray Essentials for Data Center Course to help you get familiarized on how to schedule and execute a test.

In fact we encourage your team to go through all the courses → Xray Academy.