Anti-Pattern Description:
Manual tests should have clearly defined steps. If a user is not creating steps, it may indicate that they are using the wrong test type and will lead to other testers misinterpretation of what needs to be done. Allowing this anti-pattern to spread will lead to significant issues such as
- Inconsistent Test Executions,
- Difficulty in reproducing Defects, and ultimately
- Reduced Test Coverage, since critical actions might have been missed or executed incorrectly.
Root Causes:
- Inadequate training or understanding of best practices for writing manual test cases.
- Time constraints leading to rushed and incomplete test documentation.
- Misunderstanding the importance of detailed steps in ensuring test accuracy and consistency.
- Legacy tools for documenting Test Cases, when the importing was done there was no cleaning activities to improve consistency
Solution:
The solution for this anti-pattern goes with user education, clearly defined parameters & standards for test case documentation, recurrent audit, and also automating repetitive tasks where detailed steps are critical. However it may also be the case we are using a wrong Test type, in that case we suggest revisintg the following articles for Generic Test Type.
DC: https://docs.getxray.app/pages/viewpage.action?pageId=62268044
Cloud: https://docs.getxray.app/display/XRAYCLOUD/Unstructured
Audit and Review
We suggest a recurrent audit; you can define its cadence, especially in Team Meetings or Dailies to assist and provide feedback on the spot.
Should you be using Xray Data Center, feel free to use the below JQL as a Saved filter with a Filter Result kind of gadget in a dashboard:
issue in manualTestsWithoutSteps()
or
issue in manualTestsWithoutSteps("saved_filter")
Should look like this:
Filter Results Gadget using the following Saved Filter: "issue in manualTestsWithoutSteps() AND Project = "Your Project Name""
Should you use Xray Cloud, it is on the verge of receiving a sort of insights tool which will give you notice of this anti-pattern and others in a Xray page.
Training
One key feature you can make use of is Modular Tests in which previously defined manual tests with respective steps can assist you to easily compose a Test Scenario.
DC: https://docs.getxray.app/display/XRAY/Modular+Tests
Cloud: https://docs.getxray.app/display/XRAYCLOUD/Modular+Tests
Our Academy offers Xray Essentials for Cloud & Data Center Course to help you get familiarized with how to fill in Test Steps and how to use the Modular Test Functionality.
In fact we encourage your team to go through all the courses → Xray Academy