Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Managing

...

Automated Tests

Whether your tests are manual or automated, in the end you You will need to have visibility of the results of all your tests, independently regardless of how they are executed.

...

As a team member, you will need to evaluate your requirement coverage at any moment. For this, you will need to link your Tests with your requirements, and report your automated test results from your CI environment.

Xray for JIRA is the ideal tool for managing automated Tests, this because you manage manual and automated tests essentialy in essentially the same way.

 

The standard way for managing Tests would start by creating them in JIRA and proceed from there. This logic can be applied also to automated Tests.This is the standard workflow:

Gliffy Diagram
namestandard_test_workflow
pagePin
 
1


However, with automated tests and Agile teams, normally tests are normally written continuously during development and in a continuous way. Keen developers will add as many tests as possible or, or at least. the most relevant ones.

Thus, the most common workflow when dealing with automated tests would be to write the automated tests, and their specific code, execute them and then import the results and the test themselves to Xray.

Note that in the final step, Tests are only created as entities in JIRA Jira only if they are "new" Tests. This means that the Tests must be uniquely identified. 


Gliffy Diagram
nameautomated_tests_workflow
pagePin1

Type of Tests used for automation

Xray provides two different type of tests that may be used to represent automated tests:

  • Cucumber: a test specified in natural language (i.e., in Gherkin)
  • Generic: all other automated tests (or any automated test in general)

...


Info
titleLearn more

See Testing with Cucumber and Using Generic Tests for Automation to learn how to use the two different type types of automated tests.

...


Understanding

...

functionalities

It's important to understand how the different tools fit together and what are the main responsibilities functions of each one. 


Jira
JIRA
Xray
for JIRA

SCVS

(e.g., GIT, SVN, Mercurial)

CI tool

(e.g., Bamboo, Jenkins, Team City)

  • manages requirements
  • manages releases
  • etc.
  • manages Test-related entities
  • mapping between Tests and requirements
  • execution of Manual Tests
  • stores test results
  • provides info on requirement coverage and test progress
  • stores
produt
  • product code and automated tests code
  • executes builds (periodic or triggered by code commits)
  • executes automated tests (periodic or triggered by code commits)
  • stores detailed execution logs
  • stores build artifacts

 

 

...