Page History
...
One of the frameworks used in BDD context is Cucumber, which Xray has prime support for. In this context, you may want to have a look at a at a tutorial for Java.
Similarly to what happens with other frameworks, with Cucumber "specification" and "implementation" are two distinct things, even though related: the test specification is done in natural language using Gherkin, while the implementation of each specification's phrase (i.e., step) is done in code (e.g., Java, Ruby or some other language).
...
- creation/edition of Scenario, Scenario Outline and Background entities
- validation with Cucumber (in different languages), Behave and SpecFlow
- centralized place to manage and do refactoring on Gherkin steps using the Automated Steps Library
- automatic provisioning of Gherkin based steps on the Automated Steps Library
- bulk import/update based on .feature files using the REST API and/or one of the available CI plugins
- export of .feature files containing Scenario, Scenario Outline and Background based on the respective Tests and Pre-Conditions through the UI, REST API and/or one of the available CI plugins
...
"""
(Doc Strings) - partial support (supported on creation/edition but not yet as reusable steps on the Automated Steps Library)|
(Data Tables) - partial support (supported on creation/edition but not yet as reusable steps on the Automated Steps Library)@
(Tags), during the .feature export process based on the labels assigned to Test issues (e.g. Scenarios/Scenario Outlines) or during the import process#
(Comments)
...
Gliffy Diagram | ||||
---|---|---|---|---|
|
- Specify Cucumber tests using natural language, in Jira.
- Export Cucumber features from Jira to the CI environment, using the REST API.
- Implement tests in code and commit them to the source code versioning system.
- Execute tests in the CI environment.
- Report results to Xray, using the REST API.
...
Gliffy Diagram | ||||
---|---|---|---|---|
|
- Create Cucumber tests (e.g. Scenario/Scenario Outlines) and their respective step code in some other tool.
- add an unique tag to each Scenario/Scenario outline, in the form of "@id:xxx", in which xxx is a number (e.g. 1, 2, 3, ...)
- Import existing Cucumber tests using the REST API (e.g., from an existing code base which may have tests, and their corresponding step implementation)
- Export Cucumber features from Jira to the CI environment, using the REST API or the Jenkins/Bamboo plugins. It is crucial to use these exported features instead of the ones from the VCS, since the features exported from JIRA will contain additional tags that will allow several things, including the ability to correctly report the results to back to the correct entities in Jira, afterwards.
- Execute tests in the CI environment.
- Report results to Xray, using the REST API or the Jenkins/Bamboo plugins.
- Repeat from step 1 onward.
...
Gliffy Diagram | ||||
---|---|---|---|---|
|
- Create Cucumber tests (e.g., Scenario/Scenario Outlines) and their respective step code in some other tool.
- Import existing Cucumber tests using the REST API (e.g., from an existing code base which may have tests, and their corresponding step implementation)
- Optionally, and in parallel,
- Specify additional or edit existing Cucumber tests in natural language, in Jira.
- Implement remaining tests in code and commit them to the source code versioning system.
- Export Cucumber features from Jira to the CI environment, using the REST API or the Jenkins/Bamboo plugins.
- Execute tests in the CI environment.
- Report results to Xray, using the REST API or the Jenkins/Bamboo plugins.
- Repeat from step 3 onwards.
...