Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SPARK-4300 [CORE] Race condition during SparkWorker shutdown #4787

Closed
wants to merge 1 commit into from

Conversation

srowen
Copy link
Member

@srowen srowen commented Feb 26, 2015

Close appender saving stdout/stderr before destroying process to avoid exception on reading closed input stream.
(This also removes a redundant waitFor() although it was harmless)

CC @tdas since I think you wrote this method.

@SparkQA
Copy link

SparkQA commented Feb 26, 2015

Test build #27999 has started for PR 4787 at commit e0cdabf.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Feb 26, 2015

Test build #27999 has finished for PR 4787 at commit e0cdabf.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/27999/
Test FAILed.

@srowen
Copy link
Member Author

srowen commented Feb 26, 2015

Jenkins, retest this please

@SparkQA
Copy link

SparkQA commented Feb 26, 2015

Test build #28001 has started for PR 4787 at commit e0cdabf.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Feb 26, 2015

Test build #28001 has finished for PR 4787 at commit e0cdabf.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/28001/
Test PASSed.

@andrewor14
Copy link
Contributor

LGTM. This is similar to #4788. I'm merging this into master and 1.2, and marking it to be back ported into 1.3 later.

asfgit pushed a commit that referenced this pull request Feb 26, 2015
Close appender saving stdout/stderr before destroying process to avoid exception on reading closed input stream.
(This also removes a redundant `waitFor()` although it was harmless)

CC tdas since I think you wrote this method.

Author: Sean Owen <[email protected]>

Closes #4787 from srowen/SPARK-4300 and squashes the following commits:

e0cdabf [Sean Owen] Close appender saving stdout/stderr before destroying process to avoid exception on reading closed input stream

(cherry picked from commit 3fb53c0)
Signed-off-by: Andrew Or <[email protected]>
@asfgit asfgit closed this in 3fb53c0 Feb 26, 2015
@srowen srowen deleted the SPARK-4300 branch February 26, 2015 22:37
asfgit pushed a commit that referenced this pull request Mar 13, 2015
Close appender saving stdout/stderr before destroying process to avoid exception on reading closed input stream.
(This also removes a redundant `waitFor()` although it was harmless)

CC tdas since I think you wrote this method.

Author: Sean Owen <[email protected]>

Closes #4787 from srowen/SPARK-4300 and squashes the following commits:

e0cdabf [Sean Owen] Close appender saving stdout/stderr before destroying process to avoid exception on reading closed input stream
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants