-
Notifications
You must be signed in to change notification settings - Fork 19
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Additional mutant statuses (TIMED_OUT, BUILD_FAILED) #40
Comments
k3rn31
changed the title
Additional mutant statuses
Additional mutant statuses (TIMED_OUT, BUILD_FAILED)
Jul 22, 2022
k3rn31
added a commit
that referenced
this issue
Jul 23, 2022
NOT VIABLE is a better name than BUILD FAILED, since it remains more generic and can be used for other use cases in the future. |
k3rn31
added a commit
that referenced
this issue
Jul 24, 2022
k3rn31
added a commit
that referenced
this issue
Jul 24, 2022
k3rn31
added a commit
that referenced
this issue
Jul 24, 2022
k3rn31
added a commit
that referenced
this issue
Jul 24, 2022
k3rn31
added a commit
that referenced
this issue
Jul 24, 2022
k3rn31
added a commit
that referenced
this issue
Jul 24, 2022
k3rn31
added a commit
that referenced
this issue
Jul 24, 2022
k3rn31
added a commit
that referenced
this issue
Jul 24, 2022
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Currently, Gremlins supports KILLED, LIVED, NOT_COVERED and RUNNABLE status.
It should also report if the test fails for a timeout or for a build error, so two new statuses should be introduced:
BUILD_FAILED
Should be easy enough to implement: tests failed for a build error have exit code 2 (while test failures have 1). We can simply set the mutation status based on the exit code of the tests.
TIMED_OUT
This is trickier because timed out tests have exit code 1 (same as normal test failures). How can detect if the test has timed out?
I can think of two options:
-timeout XXs
flag in the test and manage test timeouts outside of the command, using a context with timeout andexec.CommandContext
,Ideas are welcome.
The text was updated successfully, but these errors were encountered: