Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

udp errors should result in protocol.error_received, inconsistent with vanilla asyncio #601

Merged
merged 2 commits into from
Aug 26, 2024

Conversation

jensbjorgensen
Copy link
Contributor

I observed a condition in production where a temporary network outage caused a UDP sendto to fail. In stock asyncio this would result in a call to error_received on the protocol object, but in uvloop this results in a fatal error that closes the transport. This is a rather nasty thing to happen since with vanilla asyncio when the transient network condition was resolved the transport could again be used, but with uvloop you would have to close the transport and repoen it.. See cpython source here:

https://github.com/python/cpython/blob/main/Lib/asyncio/selector_events.py#L1240

Sorry I don't have a script/fragment to reproduce the error, to do this you'd have to manipulate the networking stack such that the interface was not available after the transport was created. It's possible of course but I don't know of an easy way to do this.

Comment on lines 257 to 260
if isinstance(exc, OSError):
self._protocol.error_received(exc)
else:
self._fatal_error(exc, True)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this can be replaced by calling _on_sent() with the converted exception.

@@ -244,14 +244,20 @@ cdef class UDPTransport(UVBaseTransport):
ctx.close()

exc = convert_error(err)
self._fatal_error(exc, True)
if isinstance(exc, OSError):
self._protocol.error_received(exc)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This needs to be wrapped with run_in_context...(), see also the _on_sent() below.

@jensbjorgensen jensbjorgensen force-pushed the udp_protocol_error_not_fatal branch from e55cebd to dd53a3e Compare August 26, 2024 17:51
Copy link
Member

@fantix fantix left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@fantix fantix merged commit 3c3bbef into MagicStack:master Aug 26, 2024
11 checks passed
@jensbjorgensen jensbjorgensen deleted the udp_protocol_error_not_fatal branch September 2, 2024 17:17
fantix added a commit that referenced this pull request Oct 14, 2024
Changes
=======

* Add cleanup_socket param on create_unix_server() (#623)
  (by @fantix in d6114d2)

Fixes
=====

* Use cythonized SO_REUSEPORT rather than the unwrapped native one. (#609)
  (by @ptribble in 4083a94 for #550)

* UDP errors should result in protocol.error_received (#601)
  (by @jensbjorgensen in 3c3bbef)

* Updates for Cython3 (#587)
  (by @alan-brooks in 3fba9fa for #587)

* Test with Python 3.13 (#610)
  (by @edgarrmondragon in fb5a139)
@fantix fantix mentioned this pull request Oct 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants