Switching test management tools can be cumbersome, with the overhead of moving your assets and relearning the processes. But do not fret, with some help, you can take the steps necessary to streamline the experience significantly.
In this tutorial, we will provide guidance for users migrating from ALM Octane (SaaS versions 23.4-24.1) to Xray in Jira Cloud, focusing on the testing workflow and best practices.
Disclaimer: concepts and UI elements may be slightly different in other ALM Octane versions, but the high-level process should be consistent.
To ensure your data is not lost in transition, you first need to identify all the migration steps. The preferred sequence is:
Even though you are migrating from one test management platform to another, some concepts will still be similar (maybe with different labels) as both tools facilitate Agile and DevOps practices with consistent approaches.
We will focus our tutorial on the major differences. At the project level, for both Jira and Xray:
ALM Octane | Jira/Xray | Comments |
Workspace | Project | |
Teams | Groups | For permission management |
Release | Version | Epics, stories, and other entities in Jira/Xray can have more than 1 version value. |
Requirements Backlog | Backlog | There are no separate modules per se for the entities in Jira/Xray. However, you can have requirements in one project and testing entities in another, with cross-project traceability and reporting. |
Application module | Jira Component Xray Test Repository folder Xray Test Set | For requirements, Jira components are a common way to organize your assets. For tests, you have multiple, not mutually exclusive options - e.g. you can have a component assigned together with a test repository folder. |
Epic Feature | Epic | Both tools have 4 levels, so there can be flexibility in terms of mapping. |
Story | Story Task | |
Task | Task Sub-Task | |
Defect | Bug | |
Backlog coverage (parent-child relations, “linked”, “covering”, etc.) | Links of different types | Xray adds the “Tests”/”Is Tested By” link type, you can also configure custom ones. The linked entity has to already exist in Jira for the link to be established during the import, otherwise it has to be done afterwards. |
Test | Test | See more details in the section below |
Test Suite | Test Plan Test Execution | In Xray, Test Plan is not mandatory for running the tests, only Test Execution is. But Test Plan is recommended for easier asset organization, especially with the dynamic option. |
Suite Run Manual Runner for multiple tests | Test Execution Sub Test Execution | |
Name field | Summary field | |
Phase field | Workflow Status field | The list values are quite different between the systems, especially with the custom workflow possibilities, so you will need to identify the closest matches and create the missing ones, if necessary. |
User tags field | Labels field | |
Octane Entity Settings Business Rules and Workflow | Jira workflows (with validators, etc.) and Jira automation | Also keep in mind the Xray settings for defects inheriting test details. |
Insights (Dashboard, Document Reports, Requirements Graphs, etc.) | Jira dashboards Reports section of the Xray Testing Board | Xray provides a comprehensive list of scopes (e.g. requirements traceability, test plan metrics, test runs summary) in both standalone and dashboard gadget formats. Also, you can leverage Xporter or Document Generator for additional insights. |
Note: the mapping above is recommended for better clarity but, in many cases, is not mandatory. E.g. you could map features to stories, defects to tasks, custom field A to custom field B.
At the test case level for Xray:
ALM Octane | Xray | Comments |
Manual Test | Manual Test Pre-condition | Xray Test issue layout overall the same as any other Jira issue. From the migration perspective, Supported:
Not supported:
For linked Defects and Requirements, if you have already migrated those entities to Jira, you can substitute the values in the Octane export with Jira issue keys, so that the test issue will be linked upon import. Once the test entities are migrated, you will need to recreate any applicable attachments/comments, datasets, and modular (“call”) tests in Xray. |
Gherkin Test | Cucumber Test | |
Test Type field | Label Custom field Xray Test Repository folder Xray Test Set Xray Test Plan | As with the Application Modules, you have different options in Jira/Xray to group tests by their nature (smoke, e2e, regression, etc.) |
Manual Run for one test | Test Run of the Test Execution | |
Data table | Dataset | |
Automation Status field | Custom field Label | Creating a custom field would allow a cleaner mapping since it won’t interact with any other labels. |
To summarize, for the migration, you will need to pay particular attention to:
To compare the visual issue layout for test cases (same color = same function):
ALM Octane
Xray
If you've used ALM Octane before, adopting Xray is straightforward. Your high-level workflow with ALM Octane (focusing on the testing aspects) was likely this:
In Jira and Xray, your actions would be similar:
You can watch our Xray Cloud product demo for a more comprehensive process walkthrough.
For a consolidated collection of useful tips please refer to this Process section, as well as the “Tutorial, Tips, and Tricks” category overall. Here, we highlight just a few best practices:
Xray and its Enterprise version are very comprehensive solutions for test management, so there's much to explore. We recommend checking out the academy courses, product guide, and tutorials.