Introduction

The Xray Usage Monitor is a reporting tool developed for Xray Enterprise users to help administrators manage their Jira projects. It allows administrators to quickly analyze data on app usage and identify areas for improvement. By consulting the generated Usage Monitor report, they can apply best practices to optimize their projects.

Access

Xray Usage Monitor is only available for Administrators using Xray Enterprise.

This tool shows only the top 5 results due to performance considerations.

On your Jira Cloud instance, click the gear icon (Figure 1 - 1) and then select Apps (Figure 1 - 2).

An Xray menu will open on the left side of the screen. There, click Usage Monitor (Figure 1 - 3).

Figure 1 - Apps

The Usage Monitor screen will open (Figure 2).


Figure 2 - Screen

Operations

Generating a Usage Monitor Report

Go to the Usage Monitor screen (Figure 2).

Click the Check Now button (Figure 2 - 1).

The system will initiate a generation of a Usage Monitor report and a progress bar will appear (Figure 3 - 1).

Figure 3 - Progress

When finished, click the Acknowledge button and the report will be displayed.

A new Usage Monitor report can only be generated after 24 hours.

Cancelling the Report Generation

You can cancel the creation of a new report while it's being generated.

Go to the report being generated and click Cancel (Figure 3 - 2).

A modal will open (Figure 4). Click Confirm (Figure 4 - 3).

Figure 4 - Cancel

In this case, the data from the previous report continues to be displayed (if it exists).

Usage Monitor Screen

The Usage Monitor screen is presented in two tabs:

Overview Tab

This view (Figure 5 - 1) provides a high-level summary of performance across the instance.

Figure 5 - Overview


Overview Sections

Metrics Available in each Section

EntitiesDescription
Custom Test StatusesNumber of the existing Custom Test Statuses in Xray Global settings

Custom Test Step Statuses

Number of the existing Custom Test Step Statuses in Xray Global settings
Test EnvironmentsNumber of the existing Test Environments
Test TypesNumber of the existing Test Types.
Projects with remote jobsNumber of Projects with remote jobs (configuration active)
Step Custom FieldsNumber of the existing Custom Test Step Fields
Test Run Custom FieldsNumber of the existing Test Run Custom Fields
Parameter Value Lists

Number of the Parameters value lists (used in data sets)

Projects with Requirement Coverage enabledNumber of the Projects with Requirement Coverage Enabled in Project settings
Reported DefectsNumber of the Defects linked to Test Runs
Manual TestsNumber of the existing Manual Tests
Cucumber TestsNumber of the existing Cucumber Tests
Generic TestsNumber of the existing Generic Tests
Tests With Versions

Number of the existing Tests with multiple versions

Xray Issue Type-Based Entities

Description
TestsNumber of the existing Tests
Pre-ConditionsNumber of the existing Preconditions
Test SetsNumber of the existing Test Sets
Test RunsNumber of the existing Test Runs
Test ExecutionsNumber of the existing Test Executions
Sub-Test ExecutionsNumber of the existing Sub-Test Executions
Test PlansNumber of the existing Test Plans
Dynamic Test PlansNumber of the Test Plans where the Tests were added by using the filter
ProjectsDescription
Projects with more Requirements without TestsList of the top 5 Projects with more requirements without Tests
Projects with more RequirementsList of the top 5 Projects with more Requirements
Projects with more TestsList of the top 5 Projects with more Tests
Projects with more Manual TestsList of the top 5 Projects with more Manual Tests
Projects with more Cucumber TestsList of the top 5 Projects with more Cucumber Tests
Projects with more Generic TestsList of the top 5 Projects with more Generic Tests
Projects with more Automated TestsList of the top 5 Projects with more Automated Tests
Projects with more Tests Without Test RunsList of the top 5 Projects with more Tests without Test Runs
Projects with more DatasetsList of the top 5 Projects with more Datasets (used at either Test, Test Plan, or Test Run level)
Projects with more Dataset iterationsList of the top 5 Projects with more Dataset Iterations
Projects with more Test SetsList of the top 5 Projects with more Test Sets
Projects with more Test RunsList of the top 5 Projects with more Test Runs
Projects with more Manual Test RunsList of the top 5 Projects with more Manual Test Runs
Projects with more Cucumber Test RunsList of the top 5 Projects with more Cucumber Test Runs
Projects with more Generic Test RunsList of the top 5 Projects with more Generic Test Runs
Projects with more Test ExecutionsList of the top 5 Projects with more Test Executions
Projects with more Sub Test ExecutionsList of the top 5 Projects with more Sub Test Executions
Projects with more Test PlansList of the top 5 Projects with more Test Plans
Projects with more Test Repository foldersList of the top 5 Projects with more Test Repository folders
TestsDescription
Test Case Designer TestsNumber of Tests created using the Test Case Designer

Manual Tests with more Test Steps

List of the top 5 Tests with more Test Steps

Tests in Most Test Sets

List of the top 5 Tests in most Test Sets

Tests in Most Test Plans

List of the top 5 Tests in most Test Plans

Tests in Most Test Executions

List of the top 5 Tests in Test Executions

Tests with most versions

List of the top 5 Tests with the most Versions created (default version is considered)
PreconditionsDescription
Total orphan preconditionsNumber of Preconditions not associated/linked to any Issue
Preconditions for more TestsList of the top 5 Preconditions more used in the Tests
Test SetsDescription
Test Sets Without TestsNumber of Test Sets without Tests

Test Sets With Most Tests

List of the top 5 Test Sets with Tests
Test ExecutionsDescription

Test Executions with more Tests

List of the top 5 Test Executions with more Tests
Test PlansDescription
Test Plans without TestsNumber of Test Plans without Tests
Test Plans without Test ExecutionsNumber of Test Plans without Tests Executions

Test Plans with more Tests

List of the top 5 Test Plans with more Tests

Test Plans with more Test Executions

List of the top 5 Test Plans with more Tests Executions

Test Plans With Most Test Runs

List of the top 5 Test Plans with more Test Runs

Total Test Plan folders

List of the top 5 Test Plans with more folders on the Board
RequirementsDescription
Total RequirementsNumber of the existent Requirements
Requirements with more TestsList of the top 5 Requirements with more Tests
Requirements with more Test RunsList of the top 5 Requirements with more Test Runs
Anti-Pattern MetricsDescription
Resolved Requirements Without TestsList of the top 5 Requirements in "Resolved" status without Tests
Manual Tests Without StepsList of the top 5 Manual Tests without Steps
Manual Tests With Too Many StepsList of the top 5 Manual Tests with too many Steps
Tests Without ExecutionsList of the top 5 Tests without Steps without Executions
Test Executions Without Test RunsList of the top 5 Test Executions without Test Runs
Sub-Test Executions as Sub-TasksList of Sub-tasks of type "Sub Test Execution" linked to Test Execution issues.


Some anti-pattern metrics are calculated based on the creation date of the issues. All metrics, except for "Resolved Requirements Without Tests" and "Sub-Test Executions as Sub-Tasks," are only calculated for issues created at least seven days prior to the report generation date.

Projects Tab

This view (Figure 6) dives deeper and provides detailed information about the performance of each of the selected projects.

Figure 6 - Projects


This screen (Figure 7) allows you to select a maximum of five Projects to check the metrics. 

Figure 7 - Projects


Projects Sections

Metrics Available in Each Section

EntitiesDescription

Reported Defects

Number of Defects linked to Test Runs in the Project

Manual Tests

Number of Manual Tests in the Project

Cucumber Tests

Number of Cucumber Tests in the Project

Generic Tests

Number of Generic Tests in the Project

Tests With versions

Number of Tests with Versions in the Project

Test Repository folders

Number of folders in the Test Repository (considers the Test Repository root folder)

Test Runs by Test Type

List of Test Runs by Test Type in the Project

Xray Issue Type-Based Entities

Description

Tests

Number of the existent Tests in the Project

Preconditions

Number of the existent Preconditions in the Project

Test Sets

Number of the existent Test Sets in the Project

Test Runs

Number of the existent Test Runs in the Project.

Test Executions

Number of the existent Test Executions in the Project

Sub-Test Executions

Number of the existent Sub-Test Executions in the Project

Test Plans

Number of the existent Test Plans in the Project

Dynamic Test Plans

Number of the existent Dynamic Test Plans in the Project
RequirementsNote

Total Requirements

Nº of the Requirements in the Project
Total Requirements Without Direct TestsNº of the Requirements without Direct Tests in the Project

Requirements With Most Tests

List of the top 5 Requirements with most Tests in the Project

Requirements With Most Test Runs

List of the top 5 Requirements with most Test Runs in the Project

Functionalities

Index

On the right side of the screen, there is a collapsible/expandable index, called On this page (Figure 8 - 1), visible in the Overview and Projects tabs. This index allows users to navigate quickly throughout the screen by using the hyperlinks listed there. When an element is clicked (Figure 8 - 2), you can scroll until the selected element and focus the respective area (Figure 8 - 3).

Figure 8 - Index

Figure 8 - Index


View Settings

When the Projects tab is selected, a View Settings button appears (Figure 9 - 1). Two options are displayed:

Figure 9 - Settings


Exporting a Report

After generating a Usage Monitor report it's possible export the data in a report, a CSV file.

Click the Export button (Figure 9 - 1). A modal will open (Figure 10).

Change the delimiter (Figure 10 - 1), if necessary, and then click the Export button (Figure 10 - 2). 



Figure 10 - Export

You will get the file instantaneously on your machine (Figure 11).

Figure 11 - File


If you have questions or technical issues, please contact the Support team via the Customer Portal (Jira service management) or send us a message using the in-app chat.