Parallel Tests using the CLI

[klausbayrhammer]

In order to execute our tests in parallel using the CLI we have created a new ParallelMain which supports

• Running multiple .feature-files in parallel
• A mechanism to configure formatters as before (e.g. -f pretty:out -f fully.qual.name:out) - each executer caches the calls to formatter/reporter and replays them after a feature is executed. So although multiple features are execute in parallel, only one formatter/reporter per type is written.
• configurable number of executing-threads
• configurable timout

We could provide a PR if you are interested.

[sukesh15]

How do i use ParallelMain? Would you be able to share an example for the same. We wanted to run cucumber tests in parallel using the CLI in our project.

[klausbayrhammer]

As of yet we haven't extracted the code because we didn't know whether this feature should be a part of cucumber-jvm. If you are interested I could provide a PR.

[youngrafi]

This would be very useful. Current solutions I've found using JUnit require a subsequent merger of the reports, and besides, I've been using the CLI up until now, and would rather avoid switching to running through JUnit.

[baztian]

@klausbayrhammer I am definitely interested in parallel execution of cucumber-jvm features. So please provide a pull request.

[klausbayrhammer]

0854dd4 is a first draft to executing tests in parallel via the CLI. Currently I'm not quite sure how to handle the different formats of feature-paths which can be used in the standard CLI. I've tried to use absolute paths in CucumberFeature.path to identify the features and use that paths in cucumber.api.cli.ParallelCucumberMain:77 but that changed the URI's in e.g. the json-formatter. However I appreciate all kind of feedback!

[danielwegener]

The recorder is a quite nice workaround to thread safety in the Runtime/Backend. This however puts expensive operations like classpath scanning and gluecode matching up to every scenario execution. I think these issues could better be solved in the cucumber core abstractions (see #630).

[klausbayrhammer]

Parallel exeuction of scenarios will be tracked in #630

[lock]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.