Fix flaky test_worker_reconnects_mid_compute
#5227
Merged
test_worker_reconnects_mid_compute
#5227