Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Overview

Generic Tests may be used as exploratory or non-organized manual tests; they can also be used to have visibility of your automated tests in Jira.

...

How to use Generic Tests

Automatic provisioning

...

Generic Tests may be used as an abstraction of automated tests, regardless of the testing framework and the technologies/platforms used.

In this scenario, common if you're using JUnit, TestNG, NUnit, Robot framework, developers/testers write the automated tests as code accordingly with the automation framework being used.

After that, they just need to submit the results to Xray and it will automaticaly create Test entities for each of them (or update existing ones if they already exist), so you have visibility of the automation results in Xray. 

As soon as those Tests are linked to requirements, then you can evaluate the requirement coverage based also on the results of these automated tests. 


Gliffy Diagram
namegeneric_tests_automatic_provisioning_workflow Copy Copy
pagePin1


  1. Implement the automated test code, store it in the source control system, and put the reference to the Test in Jira (i.e., the issue key).
    1. This depends on the testing framework: it can be as a "tag" or as the test name, if the framework supports that.
  2. Execute tests in the CI environment.
  3. Report execution results using the format specific to the automation framewoek (either using the REST API directly or through Bamboo/Jenkins add-ons).
  4. Create our update existing Tests in Xray
    1. In the first iteration, Tests will be automaticaly created in Xray and the Generic Test Definition field will act as the test identifier (e.g. classname plus classmethod corresponding to automated test). Xray is able to identify uniquely from the report file
    2. In second and onward iterations, existing Tests will be updated; Xray will use the Generic Test Definition field as the test identifier in order to find the existing Test in JIRA
    3. Depending on the test automation framework being used, links can also be automaticaly created between the Tests and the requirements


After Tests are created in Jira, they can be managed in Jira. Thus, users can add additional information to them, associate them with other entities (e.g. requirements, Test Sets, etc)..


Info
titleLearn more

You can see many examples in the page Integrating with Testing Frameworks, including:


Manual provisioning

You can create Generic Tests as an abstraction of some test, so you can track its results in Jira. They are useful if you don't need to have a structured Test composed of steps (otherwise, you would have to use Manual Tests as abstractions).

...