-
Notifications
You must be signed in to change notification settings - Fork 28.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
SPARK-4300 [CORE] Race condition during SparkWorker shutdown #4787
Conversation
…d exception on reading closed input stream
Test build #27999 has started for PR 4787 at commit
|
Test build #27999 has finished for PR 4787 at commit
|
Test FAILed. |
Jenkins, retest this please |
Test build #28001 has started for PR 4787 at commit
|
Test build #28001 has finished for PR 4787 at commit
|
Test PASSed. |
LGTM. This is similar to #4788. I'm merging this into master and 1.2, and marking it to be back ported into 1.3 later. |
Close appender saving stdout/stderr before destroying process to avoid exception on reading closed input stream. (This also removes a redundant `waitFor()` although it was harmless) CC tdas since I think you wrote this method. Author: Sean Owen <[email protected]> Closes #4787 from srowen/SPARK-4300 and squashes the following commits: e0cdabf [Sean Owen] Close appender saving stdout/stderr before destroying process to avoid exception on reading closed input stream (cherry picked from commit 3fb53c0) Signed-off-by: Andrew Or <[email protected]>
Close appender saving stdout/stderr before destroying process to avoid exception on reading closed input stream. (This also removes a redundant `waitFor()` although it was harmless) CC tdas since I think you wrote this method. Author: Sean Owen <[email protected]> Closes #4787 from srowen/SPARK-4300 and squashes the following commits: e0cdabf [Sean Owen] Close appender saving stdout/stderr before destroying process to avoid exception on reading closed input stream
Close appender saving stdout/stderr before destroying process to avoid exception on reading closed input stream.
(This also removes a redundant
waitFor()
although it was harmless)CC @tdas since I think you wrote this method.