-
Notifications
You must be signed in to change notification settings - Fork 12
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Who doesn't like multiprocessing? #84
Labels
Comments
sfork is fairly experimental (and I never released a version of supervise that uses it - all the released versions use os.fork). rsyscall is the more robust form of it. |
@catern thanks for the clarification 👍 and my bad for the misread. |
Thanks to @ryanhiebert for finding
approach! |
This was referenced Nov 22, 2019
goodboy
added a commit
that referenced
this issue
Apr 29, 2021
It's clear now that special attention is needed to handle the case where a spawned `multiprocessing` proc is started but then the parent is cancelled before the child can connect back; in this case we need to be sure to kill the near-zombie child asap. This may end up being the solution to other resiliency issues seen around mp with nested process trees too. More testing is needed to be sure. Relates to #84 #89 #134 #146
Merged
goodboy
added a commit
that referenced
this issue
May 6, 2021
It's clear now that special attention is needed to handle the case where a spawned `multiprocessing` proc is started but then the parent is cancelled before the child can connect back; in this case we need to be sure to kill the near-zombie child asap. This may end up being the solution to other resiliency issues seen around mp with nested process trees too. More testing is needed to be sure. Relates to #84 #89 #134 #146
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
I've been hearing grumblings about distaste for
multiprocessing
. I can't discount these opinions because my inability to get a reliable system withmultiprocessing
is one of the main reasons I started building this project.I do think it would be interesting to start some work on alternatives for process spawning/forking.
A couple ideas I have offhand:
trio
's new built-in process spawning as an alternative spawn methodsupervise
packagedistex
andpulsar
do it (I guess by looking insideasyncio.create_subprocess_exec()
.Very open to opinions and ideas here!
The text was updated successfully, but these errors were encountered: