Page History
...
Taking a simple flight booking site as an example, we can easily have thousands of combinations for Flying From, Flying to, Class, (number of) Adults, (number of) Children input parameters.
This leads to a potential high-number of scenarios to be tested. For the previous example, and considering a model where parameters have just a limited number of possible values, that would still lead to 3*3*3*2*3=162 scenarios.
...
In this tutorial we'll learn about the testing challenges of these systems and how to overcome them efficiently.
Initial testing options
Test
...
using some examples of combination of parameter values
The first strategy that we may come with would be adopting data-driven testing.
...
The exact combination of parameter values to be used is beyond of the scope of data-driven testing. However, usually testers include parameter combinations that represent examples coming as a direct consequence of acceptance criteria or from well-known "happy paths".
Info | ||
---|---|---|
| ||
Xray has built-in support for datasets where testers can explicitly enumerate parameters and the combination of values to be tested. Please see Parameterized Tests for more info. |
Test every parameter/value combination
Testing every possible combination of parameters is only viable if we have very few parameters with very few possible values for each one of them.
...
Bugs related to the interaction of more parameters decrease with the number of parameters; in other words, find finding these rare bugs will require much more tests to be performed, leading to more time/costs.
...