Surefire 3.0.0-M4 passing even if a build step throws an exception

[ppalaga]

Quarkus is currently using maven-surefire-plugin 2.22.1 with which this issue does not occur. The issue is occurring in Camel Quarkus where we use maven-surefire-plugin 3.0.0-M4. But wit ha few changes, the issue is reproducible also in Quarkus.

Steps to reproduce:

1. Add throw new RuntimeException("This is failing"); at the end of io.quarkus.hibernate.validator.deployment.HibernateValidatorProcessor.registerAdditionalBeans()

2. rebuild the validator extension

cd extensions/hibernate-validator
mvn clean install -DskipTests

3. run the validator itest

cd integration-tests/hibernate-validator
mvn clean test

This fails as expected because we are still on maven-surefire-plugin 2.22.1

4. Upgrade to maven-surefire-plugin 3.0.0-M4 in the top pom.xml

5. Run the validator test again

cd integration-tests/hibernate-validator
mvn clean test

Expected: the test and the whole maven build fails
Actual:

[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running io.quarkus.it.hibernate.validator.HibernateValidatorFunctionalityTest
[INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.649 s - in io.quarkus.it.hibernate.validator.HibernateValidatorFunctionalityTest
[INFO] 
[INFO] Results:
[INFO] 
[INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0
[INFO] 
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS

cc @aloubyansky