Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make the executor close LeaseJobRuns stream #3876

Merged
merged 10 commits into from
Sep 5, 2024

Conversation

JamesMurkin
Copy link
Contributor

@JamesMurkin JamesMurkin commented Aug 12, 2024

This makes it so that we properly wait for the EOF on the stream, which indicates the stream has closed successfully

In addition I've made the stream handling simpler:

  • We no longer try to handle partial success, such as us timing out in the middle of receiving leased jobs
  • No longer special case handle timeout and instead just call recv which will return a timeout error if the context expires

@JamesMurkin JamesMurkin added the do-not-merge Do not merge this PR label Aug 12, 2024
@JamesMurkin JamesMurkin marked this pull request as ready for review September 4, 2024 08:30
@JamesMurkin JamesMurkin removed the do-not-merge Do not merge this PR label Sep 5, 2024
}
}

err = closeStream(stream)
if err != nil {
return nil, err
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

couldn't we just log a warning here? We've got all the information we need so do we need to propagate the error?

@JamesMurkin JamesMurkin enabled auto-merge (squash) September 5, 2024 09:43
@JamesMurkin JamesMurkin merged commit 996b203 into master Sep 5, 2024
24 checks passed
@JamesMurkin JamesMurkin deleted the executor_close_stream_better branch September 5, 2024 09:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants