In the Xray Test Case Designer, click My Test Models (Figure 1 - 1) and then click a Test model (Figure 1 - 2).

Figure 1 - Test model

A menu will open on the left. There, click Analysis (Figure 2 - 1) and select Coverage Matrix (Figure 2 - 2).

Figure 2 - Analysis

Understanding the Matrix (Figure 3)

Each square in the matrix chart represents a value pair. You can hover over the elements of the matrix to see more details (such as parameter names, status, etc.). Here's how to read the chart:

1. Read the values listed across the top.
2. Read the values listed on the left side.
3. Find the intersection of two values (one from the top and one from the side):
   • Green: the pair is already covered.
   • Red: the pair is not yet covered, based on the scenario selected via the slider.
   • Black: the pair is marked as invalid.

Figure 3 - Matrix

Sliding Your Way to Precise Coverage

The slider (Figure 2 - 4) allows you to visualize which pairs are covered in each Test.

When you arrive at the Matrix chart screen, the chart will automatically cycle through Test Case 0 to Test Case N (the final test in your set). The slider works as follows: less coverage to the left more coverage to the right.

Communicating your Testing Coverage Precisely

The Matrix chart allows you to communicate your interaction coverage more easily and precisely.

Imagine a situation where you've created some tests, and your manager says, “Development is running behind, so we’ll only have time to execute two-thirds of your Tests before going live. What will be missed?” You can easily respond with a slide like the one in Figure 4.

Figure 4 - Coverage scenarios

With this information, you can weigh your testing options. Do you need to test for a 2-way interaction that remains untested by Test 10? Is it worth generating six more test cases? Or would it be better to add a forced interaction to prioritize that pair? The coverage matrix can be invaluable in the decision-making process.

• Can I See 3-way and Higher Interactions?
  

  Currently, the Matrix chart only supports showing the pairs covered in each test.

  
  
• Note for Color-blind Users
  Pressing “C” on your keyboard changes the color scheme of the Matrix chart. The following three options are available: Red/Green/Black, Orange/Blue/Black, Purple/Orange/Black.
  
  
• Dealing with a Large Number of Values
  Having 50+ total values can appear to be overwhelming in the Matrix Chart. Xray Test Case Designer can help make such use cases more manageable with Zoom and click-drag features:
  • Each matrix cell has a pop-up window with the details in larger font (compared to value names).
  • Scrolling the mouse wheel while your cursor hovers over the matrix will increase or decrease the zoom of the section in the view.
  • In the zoomed-in state, you can left-click the matrix, hold & drag to bring a different segment into visibility. 

You can export the coverage data into a JSON or XML file by selecting the respective option from the dropdown menu (Figure 2 - 3). The file will be immediately saved to your machine, and you can easily share it with others.

In the Xray Test Case Designer, click My Test Models (Figure 6 - 1) and then click a Test model (Figure 6 - 2).

Figure 6 - Test models

A menu will open on the left. There, click Analysis (Figure 7 - 4) and select Coverage Graph (Figure 7 - 5).

Figure 7 - Analysis

The Coverage Graph screen will open (Figure 7).

Here, you can apply the Graph to any generated strength (Figure 7 - 1), but it will only display the cumulative coverage percentage, not the specific interactions.

The shape of the curve (Figure 7 - 3) is important to note: the Xray Test Case Designer algorithm frontloads as much variation as possible. Therefore, diminishing returns on incremental coverage improvement are reached fairly quickly, and the scenarios in the later part of the test suite contribute significantly less compared to the first few. The order is based on the Index column from the Scenarios screen. Sorting the data table differently does not affect the Graph or Matrix, as they always display the recommended execution priority. If you want to analyze the modified Scenarios table, you must either freeze it or manually re-import it as Forced Interactions.

You can hover over any point on the curve to see the corresponding percentage of interactions tested (Figure 7 - 3).