I've reviewed Xray docs available here: https://docs.getxray.app/display/XRAYCLOUD/Version+2 but there are no endpoints for triggering generation of Test Coverage and Traceability Matrix based on specific criterias.
Is there an API available for automatic generation of Test Coverage/Traceability Matrix generation? Or do I need to do it manually via web browser?
Thanks a lot in advance for any suggestion!
Unfortunately and currently it is not possible to generate coverage or traceability reports from the API. I would suggest that you reach out Xray team and ask for an improvement request.
Related
Thanks in advance for sharing your ideas and inputs.
We know there are many REST guidelines for API published these days. I use the below for internal code review.
https://github.com/Microsoft/api-guidelines/blob/master/Guidelines.md
Is there any way I can automate the code review against the guidelines? Is there any specific tool for the same?
If no, can any of the available tool be configured with custom rules to check against the guidelines?
Any inputs are highly appreciated.
Thanks, Neel
I am using SwaggerHub which has built in standardisation checking but am playing with spectral to automatically review / lint against our standards.
API handyman/Arnaud Lauret
has an excellent series on how to do this and how spectral can be used to be an "Augmented API reviewer"
Currently, we've automated all of our web services using the Karate framework and it is super cool.Is there any way we can do the load testing with this tool?
Example: Given when I enroll a member 1000 times
Then the average response time should be 2.7 milliseconds
I'm the developer of Karate and it is great to hear this feedback, thanks !
Karate was not designed for load-testing - but we would like to support it in the future. But it is not a priority now, and there are things like mocking we want to get to sooner which we feel is a more critical need for many teams.
If you or the community would be willing to investigate and contribute, that would be great. One experiment I can think of is using the Java API try to create multiple threads and run a *.feature file.
EDIT: Karate now has Gatling integration: https://github.com/ptrthomas/karate-gatling-demo
Yesterday as part of my POC work w.r.t API demonstrated Karate in my office people were very much impressed. thanks for Karate team.
I have been going through many tool, but not able to conclude.
I have been using HP UFT for sometime and it's quite OK for my project but for some reason we need to find alternative to HPUFT with some advantage.
I have been exploring tool like selenium, IBM tools.soap ui
Could anyone suggest me test automation tool with advantages , so that I can explore.
My scenario,
More REST API based validation.
Need to make REST call and parse the response for validation.
From my experience, it all depends on if you are comfortable coding then you can use REST ASSURED if you are not too comfortable with coding then there are tools like POSTMAN and Ready API (SOAPUI) Which you can automate with very well which comes with loads of assertions.
Since you are testing REST API and validating result, I would not any testing related to UI here. So Selenium ruled out if there is no web UI involved.
For rest API I would recommend you can use Java with Junit/TestNG. Where you write keywords in Java and use the same ones to write Junit/TestNG tests.
Another alternative could be RobotFramework, for which u can have keywords in python.
The Velocity documentation mentions test coverage as a primary feature of the framework, but I'm having a hard time finding specific instructions for getting started.
Is there support for test coverage reporting in Meteor / Velocity (either directly or via a third-party package)?
You can't currently do this, but it is on the road map.
This used to work: https://github.com/xolvio/meteor-coverage but it can't with the new mirror approach. I'll update this answer when we get it working again.
Could someone explain what an automation test is and why I would use it. I read from the wiki page that a tester would create a automation script? What kind of scripting language can be used to do this?
Automation tests are carried out to check the behavior of an application against expected behavior. Normally used in regression testing where you validate that a newer version of the application doesn't hinder any of the previous version's features. These might also be carried along with manual testing.
Coming to the scripting language part, this might help you:- https://softwareengineering.stackexchange.com/questions/19292/best-language-or-tool-for-automating-tedious-manual-tasks
In simple words, If you are doing regression test or testing same piece of code over and over you can automate that manual process. That's called automation testing.
You can use several different scripting languages to achieve this and it's depends on which tool you are using. Some popular automation tools are Selenium, QTP, Loadrunner, Jmeter, SOAP UI etc.
You want to check your login with more than 1000 of users how much time you will spend to run this test case ?
In the same way you want to test you mobile API's before it used by developer how will you test?
There are lots of thing for that you have to go for automation In small application, sites you can work as an tester after that when those app's sites will grow will large data than those product owner will move for automated test cases