Enterprise teams generate a massive volume of Test artifacts: automated results, screenshots, logs, and evidence. Without a clear storage strategy, even the most powerful Xray instances can become harder to manage over time. But Storage Management isn't just a technical concern; it reflects your process maturity, tooling alignment, and governance culture. This guide goes beyond limits. It offers real-world storage strategies tailored to Enterprise Testing realities.
|
While Xray Enterprise offers unlimited storage, maintaining performance in Jira environments still benefits from healthy attachment practices and routine housekeeping. Here’s what you can do:
Use the Global Storage Settings to detect them within Xray or by exporting data.
Shift verbose data to CI/CD tools: keep detailed build logs in your CI/CD system and link the build to the Test Execution Issue in Jira using a custom field for full traceability.
Figure 1 - Storage
Scenario | Approach |
|---|---|
Operate in a high-speed, autonomous environment | Allow teams to manage their own evidence formats, while guiding them with optional best practices |
Run frequent automated tests with large result volumes | Define which evidence types are required for long-term traceability (e.g., for regulatory validation), and apply lighter standards to low-risk, routine runs to avoid unnecessary storage growth |
|
CI/CD platforms (like Jenkins, GitHub Actions, Azure DevOps, or CircleCI) are great for generating and storing Test artifacts, but not for long-term retention or audit-level traceability. Linking to these artifacts instead of uploading them into Xray reduces clutter but introduces trade-offs.
CI platforms often purge artifacts automatically (e.g., after 30, 60, or 90 days). Teams unaware of this may unintentionally lose critical test evidence.
If longer retention is needed (for compliance or regression traceability), configure your automation tools accordingly.
Xray allows you to archive work items (e.g., Test Plans or Executions) while retaining evidence access, without cluttering active views.
Your CI system is built for speed. Xray is built for permanence. CI tools are designed for fast feedback and throughput, discarding intermediate data quickly. Xray is designed for structured traceability, auditability, and long-term visibility into test history and evidence. Some teams use shared drives (e.g., Google Drive, OneDrive) for storing evidence, but this introduces risks like broken links, inconsistent access control, and audit gaps. |
Automation platforms often lack the granular, role-based permissions found in Xray, making it harder to secure critical Test artifacts.
Define a policy requiring certain types of evidence to be stored in Xray - regardless of CI integration - especially for audits or regulated releases.
Review access to each evidence repository (CI or cloud storage) at least quarterly.
Real-World Scenarios Where Storage Matters Example: Medical Devices The key takeaway:
|
For teams relying on CI tools but still needing governance, here’s how to balance flexibility with control:
Scenario | Approach |
|---|---|
Short-lived artifacts (e,g., debug logs) | Link them in comments to keep execution records lightweight |
Critical Test output or evidence needed for audits | Best stored in Xray’s Test Run Evidence panel for long-term availability and traceability |
Large reports (e.g., Test coverage in HTML format) | Summarize in Xray and link to the full report hosted externally |
Regulated environments | Align CI retention and access policies with compliance needs; use Xray as the source of truth where needed |
|
A standardized process doesn’t need to feel heavy. Xray’s built-in features can help teams maintain consistency while moving faster.
How Xray can help enable a lightweight, effective evidence management:
Use custom fields in Test Executions or Test Runs to capture metadata like Test environment and revision.
Add field validations or required fields to ensure essential information is captured.
Store all evidence in Xray to ensure a single source of truth.
Use traceability reports to assess evidence completeness and quality across cycles.
Xray enables:
Scenario | Approach |
|---|---|
Working under strict QA/compliance policies (e.g., ISO, FDA, DO-178C) | Use Xray-specific workflow settings that block transitions unless all executions have been performed, with validators in your Jira workflow that block transitions unless mandatory fields or evidence are present |
Rotating or external QA resources | Provide pre-filled Test Execution templates and onboarding kits with clear ✔️/❌ examples |
Structure doesn’t mean rigidity. When done right, it builds clarity, trust, and speed. See this interactive tutorial to help you walk through smart storage decisions in Xray (based on the type, purpose, and compliance needs of your Test evidence). |
Figure 2 - Storage
You don’t need a one-size-fits-all policy: just a storage strategy that fits each team’s reality.