Generic Tests may be used as exploratory or non-organized manual tests; they can also be used to have visibility of your automated tests in Jira.
A "Generic" Test can be used as an abstraction of an automated Test, so that it can be managed in Jira, linked to requirements, and report on its related results.
Basically, you manage Generic Tests the same way you would do for other Test Types.
It is uniquely identified by the issue key, but you can also use the Generic Test Definition field to somehow identify the Test (e.g., by setting it with class and method that implements the test code, or the automated script file name).
Xray does not enforce any constraint on the Generic Test Definition field, so it is optional and you may use it as an additional field for quickly identifying what this test is all about.
Generic Tests may be used as an abstraction of automated tests, regardless of the testing framework and the technologies/platforms used.
In this scenario, common if you're using JUnit, TestNG, NUnit, Robot framework, developers/testers write the automated tests as code accordingly with the automation framework being used.
After that, they just need to submit the results to Xray and it will automaticaly create Test entities for each of them (or update existing ones if they already exist), so you have visibility of the automation results in Xray.
As soon as those Tests are linked to requirements, then you can evaluate the requirement coverage based also on the results of these automated tests.
After Tests are created in Jira, they can be managed in Jira. Thus, users can add additional information to them, associate them with other entities (e.g. requirements, Test Sets, etc)..
You can see many examples in the page Integrating with Testing Frameworks, including: |
You can create Generic Tests as an abstraction of some test, so you can track its results in Jira. They are useful if you don't need to have a structured Test composed of steps (otherwise, you would have to use Manual Tests as abstractions).
These Tests can be implemented as code in our own custom framework and you may report results back to them by using the REST API and Xray's JSON format.
In general, you would follow this workflow:
If you have a project already being validated by automated tests which are not in Jira, you may create the Generic Tests in bulk either by building a CSV and import it or by using Jira's REST API (see example here).
Check out Using Xray JSON format to import execution results for more information on Xray's JSON format and Import Execution Results - REST to learn how to import those test results using the REST API. |