Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[YUNIKORN-2919] Document spark-operator: Account spark.memory.offHeap.size #508

Merged
merged 2 commits into from
Dec 24, 2024

Conversation

ryankert01
Copy link
Contributor

What is this PR for?

once spark-operator#2209(kubeflow/spark-operator#2209) merged and released, it would be memory + memoryOverhead + spark.executor.pyspark.memory + spark.memory.offHeap.size

What type of PR is it?

  • - Bug Fix
  • - Improvement
  • - Feature
  • - Documentation
  • - Hot Fix
  • - Refactoring

Todos

  • - Task

What is the Jira issue?

https://issues.apache.org/jira/browse/YUNIKORN-2919

How should this be tested?

Screenshots (if appropriate)

Questions:

  • - The licenses files need update.
  • - There is breaking changes for older versions.
  • - It needs documentation.

Copy link
Contributor

@wilfred-s wilfred-s left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM +1
checked against the spark 3.5.1 documentation

@yuchaoran2011 yuchaoran2011 merged commit c496925 into apache:master Dec 24, 2024
1 check passed
github-actions bot pushed a commit that referenced this pull request Dec 24, 2024
@ryankert01 ryankert01 deleted the YUNIKORN-2919 branch January 12, 2025 12:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants