I am using Serenity with Cucumber-JVM. Can I configure my tests to run in parallel to reduce execution time?
Cucumber-jvm is not thread-safe. That being said, you can look here and here for a solution that assigns a test runner to each feature file.
Related
Is it possible to run cucumber scenarios in parallel with CucumberJS and WEbdriverIO while executing test scenarios on mobile devices?
We are executing feature files in Parallel as of now.
Running scenarios in parallel may not be possible as webdriverio and cucumber integration is using webdriverio runner.
Cheers!
I am new to the Cucumber. Can anyone please help me on how to run Cucumber with parallel execution and at the same time have thread safe reports?
I am able to run Cucumber with JVM parallel plugin with surefire, but the problem is I'm not getting thread safe reports (meaning: I was having extent reports and ExtendedCucumberOptions Report but it does not generate after I run the execution with Parallel plugin).
All my requirement are if someone can guide (GitHub link) with me which is best method to achieve the following:
- BDD with Cucumber
- Headless Mode(Chrome Headless)
- Parallel Execution
- Thread safe Reports with screenshots (Success/Failure).
Just want to know if it is possible.
Presently we built a Automation framework which uses Selenium Webdriver+ specflow + Nunit, and we suing bamboo as our CI to run our Job against our every build.
we written a build.xml to handle our targets (like clean, init, install latest build, run Selenium scripts, uninstall build. etc)
ant command will read the tag name from the build.xml and runs the respective feature/scenarios based on Tags (like #smoke, #Regression)with Nunit in CI machine.
Now our requirement is to use Selenium Grid to divide scripts into different machine and execute with above set-up. Grid has to divide the scripts based on feature file or based on Tags.How to achieve this.
Is there any thing need to done under [BeforeFeature] and [BeforeScenario] ?
If you provide in details steps or any link which explains detail steps that would be a great help.
Please any one can help in this regards.
Thanks,
Ashok
You have misunderstood the role Grid plays in distributed parallel testing. It does not "divide the scripts", but simply provides a single hub resource through which multiple tests can open concurrent sessions.
It is the role of the test runner (in your case Specflow) to divide tests and start multiple threads.
I believe that you require SpecFlow+ (http://www.specflow.org/plus/), but this does have a license cost.
It should be possible to create your own multithread test runner for Specflow but will require programming and technical knowledge.
If you want a free open source approach to parallel test execution in DotNet, then there is MbUnit (http://code.google.com/p/mb-unit) but this would require you to rewrite your tests
How does parallelism work in the JUnit test framework?
How can I run multiple tests in parallel in JUnit?
Or you can simply start two Runners/JUnitcores in different Threads.
You can use Maven and configure it to run your test suite in parallel. You can configure it to run your tests in parallel by method or by classes. See Running JUnit tests in parallel with Maven for more information.
I have setup Bamboo to run JBehave tests on a remote agent (with JBehave-web plugin launching test using webdriver), and everything runs fine. Only problem is after the execution is finished Bamboo shows no test executed. I can see the option in Bamboo to select the output of the test results, but it has to be a JUnit xml, and Jbehave reports are only generated in plain text or html.
Any idea how to solve this?
Thanks
I ran in the same situation about a year ago. JBehave "doesn't" integrate with Bamboo out of the box. Although, they have a plugin for Hudson CI.
In my case, such as yours, I resorted in running the tests through the Surefire plugin; the outputs are considered as JUnit tests results and Bamboo can recognize them.
Hope it helps.
There is a really simple way to do this. And I'm currently doing this for our build system.
Write a simple parse script that transforms your plain of html report into JUnit compatible results. And add that script as a task in your Bamboo task, then use Junit parser to parse the results. Boo! You're done! Plus, you've got the capability to quarantine!
This is way much faster than writing a plugin for Bamboo, which involves considerable more time to learn/write.
Setup JBehave with Maven.In Bamboo build plan use Maven task to run it. For getting results in Bamboo use JBehave Task for Bamboo. It will convert JBehave scenarios in tests in Bamboo. If scenario names contains JIRA issue ids, it will link them to JIRA issues.
https://marketplace.atlassian.com/plugins/com.mdb.plugins.jebehaveforbamboo/server/overview
Sample JBehave as Maven Project
https://bitbucket.org/vikasborse/jbehavesampleproject/overview
Download or clone this repository on your local machine.
To run navigate to this project in command line and use command:
"mvn integration-test"