Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Gliffy Diagram
namexray_integration_with_testing_frameworks
pagePin3

Summary of features per framework

...


Robot framework

Junit 4

Nunit 2.6/3.x

CucumberXray JSON

Abstract automated test as a Test

(map an automated test to a Test issue in JIRA)

Yes

(as a Generic Test)

Yes

(as a Generic Test)

Yes

(as a Generic Test)

Yes

(as a Cucumber Test)

No.

Tests must exist beforehand.

Make Test specification in JIRA

(specify the Test itself in JIRA)


NoNoNoYesYes

Create Tests from results

(create Tests whenever importing results)

Yes

Yes

Yes

No*

(however, tehre is and endpoint for importing Cucumber features, which will create Tests for the respective Scenarios/Scenario Outlines)

No

Uniquely identify Tests

(identify existing Tests whenever importing results, avoiding duplication of Test issues)

Yes

Yes

Yes

Yes

Yes*

(based on the provided Test issue keys)

Import results

(importing results by REST API or UI)

Yes

Yes

Yes

YesYes

Import “labels”

(create labels in the Test issues)

Yes

(labels may be specified in the test's source code)

No

Yes

(labels may be specified in the test's source code)

Yes*

(this is only available whenever using the endpoint for importing Cucumber features; it's not possible whenever importing results)

No

Automatic linking to requirements

(create links to requirements)

Yes

(requirement's issue key may be specified in the test's source code)

No

Yes

(requirement's issue key may be specified in the test's source code)

Yes*

(this is only available whenever using the endpoint for importing Cucumber features; it's not possible whenever importing results)

No

Semantic on the results

(present detailed execution details in the execution screen)

Yes

(keywords “steps”)

-

Yes

(Test Suites & parameterized Tests)

Yes

(steps for scenario/scenario outline and background)

Yes*

(semantic is implicit, because the Test must be created beforehand)

Integration by platform

  

Image result for java logo

Image result for php logo transparent

 



Content by Label
showLabelsfalse
showSpacefalse
sorttitle
cqllabel = "java" and space = currentSpace()
labelsjava

Content by Label
showLabelsfalse
showSpacefalse
sorttitle
cqllabel = "csharp" and space = currentSpace()
labelscsharp

Content by Label
showLabelsfalse
showSpacefalse
sorttitle
cqllabel in ("c++","c") and space = currentSpace()
labelsc++,c

Content by Label
showLabelsfalse
showSpacefalse
sorttitle
cqllabel = "javascript" and space = currentSpace()
labelsjavascript

Content by Label
showLabelsfalse
showSpacefalse
sorttitle
cqllabel = "ruby" and space = currentSpace()
labelsruby

Content by Label
showLabelsfalse
showSpacefalse
sorttitle
cqllabel = "php" and space = currentSpace()
labelsphp

Content by Label
showLabelsfalse
showSpacefalse
sorttitle
cqllabel = "python" and space = currentSpace()
labelspython

Content by Label
showLabelsfalse
showSpacefalse
sorttitle
cqllabel = "perl" and space = currentSpace()
labelsperl

 

 




Integration by testing framework report

JUnit

NUnit

Cucumber

Content by Label
showLabelsfalse
showSpacefalse
sorttitle
cqllabel = "junit" and space = currentSpace()
labelsjunit

Content by Label
showLabelsfalse
showSpacefalse
sorttitle
cqllabel = "nunit" and space = currentSpace()
labelsnunit

Content by Label
showLabelsfalse
showSpacefalse
sorttitle
cqllabel = "cucumber" and space = currentSpace()
labelscucumber

 

...



Testing by target environment

Browser testingMobile TestingTesting in the Cloud

Content by Label
showLabelsfalse
showSpacefalse
sorttitle
cqllabel in ("phantomjs","selenium","phantomcss") and space = currentSpace()
labelsselenium phantomcss phantomjs

Content by Label
showLabelsfalse
showSpacefalse
sorttitle
cqllabel = "mobile" and space = currentSpace()
labelsmobile

Content by Label
showLabelsfalse
showSpacefalse
sorttitle
cqllabel = "cloud" and space = currentSpace()
labelscloud

 

 

 

 

 

 

 

 

...