Warning: Content Compatibility Notice

Please note that the articles in this documentation feature media from app version 2.0.5. Interface elements may differ in newer versions. Refer to the latest app version for the most accurate information.

What is a charter, and why is it relevant?

In an Exploratory Testing approach, we don't follow predefined steps or check for well-known expectations. We also don't test in a random way.

While performing Exploratory Testing, we use our experience and knowledge to uncover new information. Exploring can be done at any moment, at any time, even without a specific, explicit reason whatsoever.

Usually, however, exploratory testing starts due to a reason and around some feature or area.

To focus our exploration activities, we use a charter. By having a charter, we can focus our attention on a certain question or concern we want to address. This way, we can explore in more depth and find information that otherwise would be hard to depict.


Before coming up with a charter, reflect a bit about the following:

  • What is my main goal for this testing session?
  • Do I want to deepen knowledge about a specific "thing" (e.g., feature, flow, behavior), or do I have to want a more high-level overview?
  • Will I be using specific resources, tools, or heuristics?
  • Will I be focused on certain quality criteria attributes? (e.g., correctness, performance, accessibility)
  • Do I want to focus my attention more on positive test scenarios or negative test scenarios?


In sum, Why am I going to do this session? What "exactly" will I be looking at and using what?

The structure of a charter

There is a common format that works for most teams.


Charter template

Explore <area, feature, risk>

with/using <resources, restrictions, heuristics, dependencies, tools>

to discover <information>

Adapted from Maaret Pyhäjärvi, Elisabeth Hendrickson


However, the charter doesn't have a strict structure, and we can tailor it to our needs.

Examples

Next, there are some examples of possible charters.

In this case, we have a high-level charter, to have an overview of the system.

Charter

Explore the system

With typical usage scenarios

To discover how it works.


We can also focus on a specific feature, or page, and around a specific concern/quality criteria (e.g., usability).

Charter

Explore the login page

Using Chrome and different screen sizes

To discover problems with usability


We can still be focused on a specific feature or page, but aim to test how it works for different contexts/environments (e.g., browsers).

Charter

Explore the login page

Using Chrome, Firefox, Edge, and Opera

To discover problems with CSS styling and JavaScript


Eventually, we may even have a more focused charter, for example, to depict problems around some specific processing. 

Charter

Explore the REST API endpoint for importing test results in JUnit format

With different test reports

To discover problems in their processing and mapping to internal entities.


Our exploration can be focused on a certain feature/area (e.g., REST API endpoint), and we can explicitly enumerate a subset of items we wish to validate (e.g., operations).

Charter

Explore the REST API endpoint for managing bookings and the CRUD operations

  • POST
  • GET
  • PUT
  • DELETE

Using the "curl" command line tool and the REST API specification

To discover problems with the syntax 


Our exploration can be made around specific personas relevant to the context of our product.

Charter

Explore the bookstore site

With a mid-age, non-technical teacher persona perspective

To discover problems around the easiness of the whole process of buying books


Sometimes we're concerned about product consistency (e.g., in terms of layout, terminology, options, and operations); we can have a charter for that.

Charter

Explore the Traffic Report

Using Chrome and different data sizes

To discover consistency problems with other reports


Charters can target specific testing types, such as security testing. We may want to focus our attention and concerns on specific features and ways of "attacking" them.

Charter

Explore the shopping cart

Using Chrome and RestMan extension to perform API calls

To discover if the shopping cart and its related properties can tamper someway

Charter

Explore the product website

Using Chrome to craft and make API calls

To discover problems related to authorization


Tips

Start broad and then go to specifics

Start with more generic charters and common usage scenarios to have a more general idea about the system under test.

Use and stay focused on the charter

While testing, we should stick with the charter; if we depict something a bit unrelated, we can take notes and then decide afterward if we want to create a charter around that.

Enumerate items you know in advance that you want to cover

You may add a list of bullet points to your charter if you want to enumerate certain aspects you aim to test or subsets for your charter (e.g., operations, and user profiles).

Don't detail too much

Avoid having long charters as, eventually, they will tend to become closer to test scripts and limit your exploration.

Include quality attributes you aim to test

Usually, it is a good idea to know in advance the quality attributes/aspects you will be focused on, so you can target your exploration around those.

Discuss the charters with the team

Provide visibility of what you aim to test. The team can give you feedback about areas or aspects they may consider relevant, among others.

Reuse the charter

Charters can be reused; the findings of sessions with the same charter can and will be mostly different each time a person uses them during a testing session. A charter can be reused by another colleague, a tester, or even a developer.

References


  • No labels