Fail test even after it has passed #1330
Labels
blocked
waiting on something else to be resolved first
enhancement
new functionality
help wanted
scope:assertions
scope:reporters
scope:test-interface
09b23e0 made it an error if an assertion is added after a test has finished. This can occur if the test finished earlier than the user intended. Once a test has passed though we cannot update its state in the reporters.
The feedback in 09b23e0 could only be provided to users if the test was waiting for a pending assertion. That behavior itself is confusing, which means that when #1327 is fixed we won't be able to provide any feedback at all.
If a test has passed, but then later an assertion is added before other tests have finished, we should change the test state to a failure and update the reporters. The mini reporter should work well, since it hides previously passing tests. The verbose reporter would have a duplicate entry for the test but perhaps that's OK. I'm not sure whether it's acceptable to add a duplicate entry in the TAP reporter. The alternative is buffering the output for each test file which is not ideal.
The text was updated successfully, but these errors were encountered: