• Created by Unknown User (rmsp), last modified on Sep 20, 2021

Problem

When importing execution results from automated test frameworks (Xray, Cucumber, Behave, JUnit, TestNG, NUnit, xUnit, Robot), the upload does not work and may return some errors like the ones below:

NUnit errors

java.lang.NullPointerException
at com.xpandit.raven.service.executionresult.converter.framework.impl.NUnitExecutionResultBeanConverterImpl.b(Unknown Source)
...
at com.xpandit.raven.service.executionresult.converter.impl.ExecutionResultBeanConverterServiceImpl.b(Unknown Source)
at com.xpandit.raven.service.executionresult.j.a(Unknown Source)
at com.xpandit.raven.service.executionresult.impl.ImportExecutionResultsServiceImpl.a(Unknown Source)
...
at com.xpandit.raven.rest.api.v1.a.a.a(Unknown Source)
at com.xpandit.raven.rest.api.v1.a.b.e.a(Unknown Source)


Troubleshoot

One of the main causes and the first thing to test is the execution report and ensure it is correctly generated.

And a quick way to ensure the execution report is correct, its to validate it against the respective schema.

Below there a link to that format validator and to XML schemas.


XML Formats

Validator: https://www.freeformatter.com/xml-validator-xsd.html


NUnit

Schema: https://nunit.org/files/testresult_schema_25.txt

(source: https://docs.nunit.org/articles/nunit/technical-notes/usage/XML-Formats.html)


JSON Formats

Validator: https://www.jsonschemavalidator.net/


Xray format

Schema: Import Execution Results#XrayJSONSchema

Cucumber

Schema: https://github.com/cucumber/cucumber-json-schema/blob/main/schema.json

(source: https://github.com/cucumber/cucumber-json-schema)

Use the correct schema

Always ensure to use the correct schema for the format being tested. Otherwise, it may return incorrect results!