You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As discussed in #1554, merging all of these phases into one set of statistics makes them quite difficult to interpret if a test is or recently has been failing. The count of invalid examples tends to be higher, and it would be nice to distinguish generated, replayed, and shrunk test cases.
This will involve changes to the recording in hypothesis.internal.conjecture.engine, and to the reporting in hypothesis.statistics. Only phases with more than zero examples should be reported, to avoid e.g. pointless lines of statistics for passing tests.
The text was updated successfully, but these errors were encountered:
The reporting side of this should be relatively easy to build on top of #1577, and after that's merged I can have a go at the collection side too... but if anyone else wants to try go for it, and I'll post again before I start.
As discussed in #1554, merging all of these phases into one set of statistics makes them quite difficult to interpret if a test is or recently has been failing. The count of invalid examples tends to be higher, and it would be nice to distinguish generated, replayed, and shrunk test cases.
This will involve changes to the recording in
hypothesis.internal.conjecture.engine
, and to the reporting inhypothesis.statistics
. Only phases with more than zero examples should be reported, to avoid e.g. pointless lines of statistics for passing tests.The text was updated successfully, but these errors were encountered: