Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP: Standalone Spark on k8s #31

Draft
wants to merge 4 commits into
base: dev
Choose a base branch
from
Draft

WIP: Standalone Spark on k8s #31

wants to merge 4 commits into from

Conversation

wjxiz1992
Copy link
Collaborator

@wjxiz1992 wjxiz1992 commented Jan 13, 2023 •
edited
Loading

Add Standalone Spark cluster to k8s.

Helm chart including:

  • Spark Standalone Master & Worker

Not sure if they should be bundled together with Spark Standalone:

  • Livy
  • Alluxio

@wjxiz1992 wjxiz1992 self-assigned this Jan 13, 2023
@wjxiz1992
fix typo
80938e0 
Signed-off-by: Allen Xu <[email protected]>
res-life pushed a commit to res-life/spark-rapids-container that referenced this pull request Mar 28, 2023
@wjxiz1992
Merge branch 'save-query-output' into 'main'
acab6e4 
Rename columns before saving query output

Closes NVIDIA#30 and NVIDIA#31

See merge request nvspark/nds!25
res-life pushed a commit to res-life/spark-rapids-container that referenced this pull request Mar 28, 2023
@wjxiz1992
only set schema for text data source (NVIDIA#31)
c88ba32 
Signed-off-by: Allen Xu <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@wjxiz1992 wjxiz1992

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@wjxiz1992