Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
UI Steps
UI Step

The Test Execution List

UI Step

Purpose

The Test Executions List Report shows a list of Test Execution issues and their corresponding execution status. A Test Execution status is shown as a progress bar with the latest Test Run status from each Test issue that is associated with that Test Execution.

Possible usage scenarios:

  • analyze both the progress of each Test Execution and the success rate
  • analyze the number of defects opened in each Test Execution
  • analyze the testing results for some revisions of the SUT
  • see the planned Test Executions for some version, for some Test Environment and get an overview of the progress of each one of them



UI Step

How to Use

This report is accessible either from the Xray icon on the project left sidebar or from the standard Reports icon, which includes other kinds of reports besides Xray. 

Source Test Execution issues can be directly provided using a advanced filter or by specifying some Test Execution-related fields:

  • Advanced: a JQL query to filter the coverable issues
  • Basic:
    • Project: project
    • Assignee: the issue's assignee
    • Component: the component assigned to the issue
    • Fix Versions: versions assigned to the issue
    • Resolution: the workflow resolution
    • Status: the workflow status
    • Contains: the full issue key or part of the summary



Defining Scope

Source Test Execution issues can be directly provided (within section A) using a saved filter or by specifying some Test Execution-related fields:

Saved filter: a saved filter containing Test Execution issues
  • Fix Version: the version assigned to the Test Plan
  • Assignee: the Test Execution issue assignee
  • Status: the Test Execution issue Status
  • Resolution: the Test Execution issue Resolution
  • Test Plan: the assigned Test Plan
  • Environment: the assigned Test Environment
  • Image Removed

    UI Step
    UI Step

    Columns


    Aside from the available custom fields for Test Execution issues, there are some special columns that can be included:


    Metric

    Notes

    RevisionThe revision of the SUT targeted by this Test Execution (i.e., typically the code revision or the build number)
    Begin DatePlanned begin date for the Test Execution
    End DatePlanned end date for the Test Execution
    Test Environment(s)Test Environment(s) linked to the Test Execution (i.e., the environment assigned to the Test Execution where tests were executed on or are scheduled to be executed on)

    Defects

    Number of linked defects (i.e., the ones created/linked during the execution of tests)
    StatusThe progress (i.e., the overall execution status of the Test Execution)



    UI Step

    Example

    The report may be a bit wide for some screen resolutions so you will need to scroll horizontally to see the rest of the information.

    Some values provide a link, so you can be redirected to the respective entities.

    UI Step

    Export and Share

    The report can be exported to a CSV file, which will export up to 1000 issues and not just the visible ones.

    Click on Export and select To csv.