Try pytest-xdist and pytest-rerunfailures #229
Closed
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Closes #228
Locally, test run fine and rarely require retries.
On CIs, some tests are flakky. Let's mark those with
pytest-rerunfailures
.But to do so, those test need to be run by workers through
xdist
to recover from e.g.segfaults
.But all tests can not be run through
xdist
, e.g. stream resolution.Plan:
pytest.mark.no_xdist
for serial executionno_xdist
with the arguments-n logical --dist worksteal
no_xdist
Deprecation in
pytest-cov
due to pytest-dev/pytest-cov#623