Document Generator allows you to get following data from the Xray Test Execution:
If a Test Execution contains a lot of information, it can decrease Jira performance
Overall Execution Status
Export the Overall Execution Status with name and percentage for each Test Execution Status
${Overall Execution Status}
You can print the status of the Test Execution by using the following notation:
% per Status | Number of Tests per Status |
---|---|
${Overall Execution Status.NameOfStatus} | ${Overall Execution Status.NameOfStatus.Count} |
See the real example:
You can also use the translated name of Overall Execution Status to get the same information.
Language | Translated Name |
---|---|
ES | Estado de ejecución general |
DE | Allgemeiner Ausführungsstatus |
FR | État d'Exécution Global |
See the example:
Iterating Test Runs associated with a Test Execution
Document Generator allows rendering of all the Test Tuns associated with a Test Execution.
Definition:
$ {TestRuns[n].Field} |
n is the index of the Test Run, starting from 0. The field TestRunsCount or TestrunsCount was created in order to give the total number of Test Runs.
Since a Test Run isn't a Jira Issue, you can render only the following mappings.
Example:
Exporting Test Runs custom fields
To export Test Runs Custom Fields you just have to defined the placeholder with the name of you custom field.
Example: Image that you have a custom field called "Run CF". To get the value printed on you document you just have to use the following placeholder:
#{for testruns} The Run CF value is: ${TestRuns[n].Run CF} #{end}
If your custom field type is a Number, Data or Date Time you can use formatting functions.
Iterating Pre-Conditions associated with a Test Run
Document Generator allows rendering of the Pre-Conditions associated with a Test from a Test Run.
Definition:
${TestRuns[n].PreCondition.Field} - DEPRECATED |
${TestRuns[n].PreConditions[p].Field} |
n is the index of Test Runs, starting from 0. The fields available for Pre-Conditions are:
- Key
- Summary
- Conditions
- Pre-Condition Type
Iterating Attachments associated with a Test Run
Document Generator allows rendering of all the Attachments associated with a Test Run.
Definition:
$ {TestRuns[n].AttachmentsCount[sa]} |
sa is the index of the Attachments, starting from 0. The field AttachmentsCount was created in order to give the total number of Attachments of a Test Run.
Since a Test Run isn't a Jira Issue, you can render only the following mappings.
Example:
If a Test Execution contains a lot of information, it can decrease Jira performance
Iterating Evidences associated with a Test Run
Document Generator allows rendering of all the Evidences associated with a Test Run.
Definition:
$ {TestRuns[n].ExecutionEvidences[d]} |
d is the index of the Evidences, starting from 0. The field ExecutionEvidencesCount was created in order to give the total number of Evidences of a Test Run.
Since a Test Run isn't a Jira Issue, you can render only the following mappings.
Example:
Iterating Defects associated with a Test Run
Document Generator allows rendering of all the defects associated with a Test Run.
Definition:
$ {TestRuns[n].ExecutionDefects[e]} |
e is the index of the defects, starting from 0. The field ExecutionDefectsCount was created in order to give the total number of Defects of a Test Run.
Since a Test Run isn't a Jira Issue, you can render only the following mappings.
Example:
Iterating Automated Test details associated with a Test Run
Document Generator allows rendering of the Details from Automated Tests associated with a Test Run.
Definition:
Cucumber Scenario: $ {TestRuns[n].Cucumber Scenario} Test Definition: $ {TestRuns[n].Generic Test Definition} |
n is the index of the Test Runs, starting from 0. The fields Cucumber Scenario/Generic Test Definition were created in order to give the step details of Automated Tests of a Test Run.
Since a Test Run isn't a Jira Issue, you can render only the following mappings.
Example:
If a Test Execution contains a lot of information, it can decrease Jira performance
Iterating Manual Test Step details associated with a Test Run
Document Generator allows rendering of the Details from Manual Tests associated with a Test Run.
Definition:
$ {TestRuns[n].TestSteps[r]} |
r is the index of the Test Steps, starting from 0. The field TestStepsCount or TeststepsCount was created in order to give the step details of Manual Tests of a Test Run.
Since a Test Run isn't a Jira Issue, you can render only the following mappings.
Example:
Iterating Manual Test Step Attachments associated with a Test Run
Document Generator allows rendering of the Attachments from Manual Tests Steps associated with a Test Run.
Definition:
$ {TestRuns[n].TestSteps[r].Attachments[sa]} |
sa is the index of the Test Step Attachments, starting from 0. The field AttachmentsCount was created in order to give the step attachments of Manual Tests of a Test Run.
Since a Test Run isn't a Jira Issue, you can render only the following mappings.
Example:
If a Test Execution contains a lot of information, it can decrease Jira performance
Iterating Manual Test Step Defects associated with a Test Run
Document Generator allows rendering of the Defects from Manual Tests Steps associated with a Test Run.
Definition:
$ {TestRuns[n].TestSteps[r].Defects[dc]} |
dc is the index of the Test Step Defects, starting from 0. The field DefectsCount was created in order to give the step defects of Manual Tests of a Test Run.
Since a Test Run isn't a Jira Issue, you can render only the following mappings.
Example:
Iterating Manual Test Step Evidences associated with a Test Run
Document Generator allows rendering of the Evidences from Manual Tests Steps associated with a Test Run.
Definition:
$ {TestRuns[n].TestSteps[r].Evidences[e]} |
e is the index of the Test Step Evidences, starting from 0. The field EvidencesCount was created in order to give the step evidences of Manual Tests of a Test Run.
Since a Test Run isn't a Jira Issue, you can render only the following mappings.
Example:
If you want to export the images, for example ${TestRuns[n].ExecutionEvidences[d].FileURL} you can check here for instructions on how to do it.
Manual Test Step Custom Fields associated with a Test Run
To export Test Steps Custom Fields within a Test Run you just have to define the placeholder with the name of your custom field.
Example: Image that you have a custom field called "Run CF". To get the value printed on your document you just have to use the following placeholder:
#Iterating over Test Runs #{for testruns} #Iterating over Manual Test Steps from Test Run #{for r=TestRuns[n].TestStepsCount} #Add Custom Field name, for example Run CF Run CF: ${TestRuns[n].TestSteps[r].Run CF} #{end} #{end}
If your custom field type is a Number, Data, or Date Time you can use formatting functions.
Exporting Test Run Activity
Document Generator allows export all the activity of a Test Run.
Definition:
$ {TestRuns[n].ActivityEntries[ac]} |
ac is the index of the Activity entry, starting from 0. The field ActivityEntriesCount was created in order to give the Activity entry of a Test Run.
Example:
Exporting Parameterized Tests from a Test Run
To export all this data, we first need to execute the test run. If we change any data, we need to return to the Execution Page and merge it with the new data.
Fields | Description |
---|---|
IsDataDriven | Returns "true" if the current test run is data-driven; otherwise, it returns "false" |
Iterations Overall Execution Status.STATUS.Percentage | The percentage of STATUS in the test run iterations |
IterationsOverallExecutionStatus | List of all the statuses in the current test run iteration and their percentages |
IterationsOverallExecutionStatus.STATUS.Count | The number of STATUS in the test run iterations |
Parameters | List of the parameters from each test run iteration |
ParametersCount | Total of Parameters declared in Dataset |
Data-driven
The field IsDataDriven is going to return TRUE only if the test run has more than one iteration.
Exporting Test Runs Parameters from a Test Execution
For each Test Run Parameter you can export the following fields:
- Key
- Value
Below you can find an example of how to iterate over the list of Test Run Parameters associated with a Test Execution.
// Iterating each test run #{for testruns} // Iterating over parameters for each test run Parameters Total: ${TestRuns[n].ParametersCount} #{for m=TestRuns[n].ParametersCount} Key: ${TestRuns[n].Parameters[m].Key} Value: ${TestRuns[n].Parameters[m].Value} #{end} #{end}
Exporting Test Runs Iterations from a Test Execution
For each Test Run Iteration you can export the following fields:
- Overall Execution Status
- Data from Test Run Iterations
- Parameters from Test Run Iterations
- PreConditions from Test Run Iterations
- Test steps from Test Run Iterations
Below you can find an example of how to iterate over the list of Test Run Iterations associated with a Test Execution.
// Iterating each test run #{for testruns} IsDataDriven: ${TestRuns[n].IsDataDriven} // Iterations Overall Execution Status (percentage + total of testes per status) List of Statuses: ${TestRuns[n].Iterations Overall Execution Status} TO DO: ${TestRuns[n].Iterations Overall Execution Status.TO DO}% - ${TestRuns[n].Iterations Overall Execution Status.TO DO.Count} EXECUTING: ${TestRuns[n].Iterations Overall Execution Status.EXECUTING}% - ${TestRuns[n].Iterations Overall Execution Status.EXECUTING.Count} PASSED: ${TestRuns[n].Iterations Overall Execution Status.PASSED}% - ${TestRuns[n].Iterations Overall Execution Status.PASSED.Count} FAILED: ${TestRuns[n].Iterations Overall Execution Status.FAILED}% - ${TestRuns[n].Iterations Overall Execution Status.FAILED.Count} ABORTED: ${TestRuns[n].Iterations Overall Execution Status.ABORTED}% - ${TestRuns[n].Iterations Overall Execution Status.ABORTED.Count} // Iterating over test runs iterations Total of Iterations from a Test Run: ${TestRuns[n].IterationsCount} #{for m=TestRuns[n].IterationsCount} Name: ${TestRuns[n].Iterations[m].Name} Status: ${TestRuns[n].Iterations[m].Status} Parameters: ${TestRuns[n].Iterations[m].Parameters} // Iterating over parameters for each test run iteration Parameters Total: ${TestRuns[n].Iterations[m].ParametersCount} #{for l=TestRuns[n].Iterations[m].ParametersCount} Key: ${TestRuns[n].Iterations[m].Parameters[l].Key} Value: ${TestRuns[n].Iterations[m].Parameters[l].Value} #{end} // Iterating over preconditions for each test run iteration Preconditions Total: ${TestRuns[n].Iterations[m].PreConditionsCount} #{for l=TestRuns[n].Iterations[m].PreConditionsCount} Key: ${TestRuns[n].Iterations[m].PreConditions[l].Key} Summary: ${TestRuns[n].Iterations[m].PreConditions[l].Summary} Definition: ${TestRuns[n].Iterations[m].PreConditions[l].Conditions} Type: ${TestRuns[n].Iterations[m].PreConditions[l].Pre-Condition Type} #{end} //Iterating over test steps for each test run iteration #{for i=TestRuns[n].Iterations[m].TestStepsCount} Step Number: ${TestRuns[n].Iterations[m].TestSteps[i].StepNumber} Action: ${TestRuns[n].Iterations[m].TestSteps[i].Action} Data: ${TestRuns[n].Iterations[m].TestSteps[i].Data} Expected Result: ${TestRuns[n].Iterations[m].TestSteps[i].ExpectedResult} Status: ${TestRuns[n].Iterations[m].TestSteps[i].Status} Comment: ${TestRuns[n].Iterations[m].TestSteps[i].Comment} Actual Result: ${TestRuns[n].Iterations[m].TestSteps[i].Actual Result} // Replace the placeholder text to export any custom field associated with the test step. Step Custom Field:${TestRuns[n].Iterations[m].TestSteps[i].<Step Custom Field>} // Iteration Test Step Attachments #{for l=TestRuns[n].Iterations[m].TestSteps[i].AttachmentsCount} Id: ${TestRuns[n].Iterations[m].TestSteps[i].Attachments[l].Id} Name: ${TestRuns[n].Iterations[m].TestSteps[i].Attachments[l].Name} Image: ${TestRuns[n].Iterations[m].TestSteps[i].Attachments[l].Attachment} FileURL: ${TestRuns[n].Iterations[m].TestSteps[i].Attachments[l].FileURL} #{end} // Iteration Test Step Evidences #{for l=TestRuns[n].Iterations[m].TestSteps[i].EvidencesCount} Id: ${TestRuns[n].Iterations[m].TestSteps[i].Evidences[l].Id} Name: ${TestRuns[n].Iterations[m].TestSteps[i].Evidences[l].Name} Evidence: ${TestRuns[n].Iterations[m].TestSteps[i].Evidences[l].Evidence} #{end} // Iteration Test Step Defects #{for l=TestRuns[n].Iterations[m].TestSteps[i].DefectsCount} Description: ${TestRuns[n].Iterations[m].TestSteps[i].Defects[l].Description} Id: ${TestRuns[n].Iterations[m].TestSteps[i].Defects[l].Id} Key: ${TestRuns[n].Iterations[m].TestSteps[i].Defects[l].Key} Summary: ${TestRuns[n].Iterations[m].TestSteps[i].Defects[l].Summary} #{end} #{end} #{end} #{end}