This page provides a quick overview of exploratory testing and guides you on how to use Xray tools.
Xray Exploratory App
Xray Exploratory App is a side companion application that helps testers focus on exploratory testing and not on other side activities. It is available for both Windows and Mac-based systems, and it can integrate with Xray and Jira seamlessly. You can test web, desktop, or even mobile-based applications.
Xray Exploratory App eases documenting problems, bugs, ideas, doubts, and evidence related to testing. This way, testers can focus on performing testing and use their knowledge and skills to explore the target test object.
Xray Exploratory App does not perform exploratory testing for you; however, it can surely help you stay focused while testing and ease documentation/note-taking, so that you can review all you did and discuss it later on with your team.
Scripted and Exploratory Testing
In the testing community, many refer to something considered tested, as something that has been simultaneously checked and explored.
tested = checked + explored
Scripted tests, sometimes incorrectly called "manual tests," are composed of a set of well-defined actions and corresponding expected results. These tests are essential in regulated markets or for detecting regressions as they exercise the same conditions every time. They can be executed manually or automated using some automation libraries (e.g. Selenium/Webdriver) and frameworks.
Please note
In Xray, scripted-based tests are, for legacy reasons, still called "Manual".
In Xray Cloud, you can define a custom test type, of the "structured" kind (i.e. composed of steps), and name it whatever you like. No matter what you call the test type, these tests can be executed manually or with automation.
With exploratory testing (ET), testers are in control of testing; they're no longer blindly executing what someone has predefined for them.
On the other hand, with ET, the tester starts with a purpose and a mission. This means, they are no longer in a route previously defined, which may no longer be valid.
Using knowledge and human-based trained skills, testers dynamically explore the test object, test ideas, and look at possible impacts. In (exploratory) testing, actions are conditioned by how the system behaves, by the tester's expertise, and by all things going on in the tester's brain. The tester iteratively explores and learns more about the system. Previous results influence how testing is performed on the upcoming iteration.
This is why James Bach describes exploratory testing as "Exploratory testing is simultaneous learning, test design, and test execution"
While scripted-based testing provides information about the expected, exploratory testing provides information about the unknowns.
Xray and Exploratory Testing
Xray provides the basic foundations for exploratory testing. Unstructured (e.g. "generic") Test issues can be used to abstract an exploratory test charter.
Results and artifacts produced during testing (e.g. notes, screenshots, etc) can be reported against a test run of that type of test.
Please note
In Xray for Jira Cloud, an unstructured test is one whose kind is "unstructured." The default available "Generic" test type is unstructured; however, users can create additional unstructured test types.
In Xray Server and Data Center, an unstructured test is one of the test types "Generic" or any other custom value (which internally will be handled as a "Generic" test).
Thus, you can create a "Generic" Test, for example, and "execute it" to open the execution screen where you can attach evidence and leave notes.
However, Xray by itself does not provide much more than that; users still have to take screenshots, record videos, and annotate them manually. That's when the Xray Exploratory App enters the game.
Before continuing, it is important to understand two basic concepts for this app, sessions and charters.