Challenge Summary

A common question from Test Case Designer clients in early adoption stages is:

...

The purpose of this article is to demonstrate a defect analysis approach when using TCD tests. We’ll use a simplistic customer preferences application with 5 “Checked”/ ”Not Checked” indicators, looking like this:

Challenge Summary

Manually selected tests would likely focus on isolated scenarios:

...

Now, if scenario #4 fails, it’s not just Indicator 3 that is checked, but also Indicator 1.

So, how do we pinpoint the reason for the failure?

...

TCD Analysis Approach

The key to our analysis is to look at the whole test suite and identify the dependency pattern between the consistent elements and the execution outcome.

...

So it’s important to use a combinatorial testing methodology to improve the testing coverage and then adjust the defect analysis process accordingly.

Achieving both isolated and combinatorial testing

There may be situations where targeted testing is absolutely necessary. Test Case Designer allows you to do this by forcing specific parameter values to be used. For example, we can force only 1 indicator at a time to be checked in each of the first 5 scenarios:

...