Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Beyond the jvm updates #123

Merged
merged 37 commits into from
Apr 1, 2024

Conversation

holdenk
Copy link
Member

@holdenk holdenk commented Mar 18, 2024

Update accelerator examples and related for "Beyond the JVM" chapter
Includes #121

holdenk added 5 commits March 16, 2024 19:37
Try and fix dependecny setup issue.

Ok if we can't install libgoogle-glog lets see if we can still build.

Try explicitilyy install libunwind-dev as suggested by https://github.com/kadalu-tech/pkgs/pull/2/files#r1001042597

Ok try and make velox optional.

Get the build to include our GLuten UDF if and only if gluten is present

Refactor gluten UDF build to produce a seperate object file so we can conditonally do things based on that.

Start work to selectively integrate gluten into the examples.

Add script to setup gluten

Make some progress to integrating gluten into our examples.

simplify build options.

Start adding a Gluten 34 ex but it only works in old ubuntu anyways.

Give up on Gluten on modern systems because I don't have time for that. But maybe we can get it to work with Clickhouse

Style fixes.

Work on trying to get something with gluten to run.

bloop
…gfault)

re-enable gluten-sql-ex

Add cache accel cache.

Lets go for 3.5.1

Update shell for style

Fix gluten jar dl

Add full path for SPARK_PATH

Only use pre-built for 20.04

Build deps with sudo

Ignore incubator gluten

More work getting gluten and comet
@holdenk holdenk force-pushed the beyond-the-jvm-updates branch from 416c8be to 8c90b72 Compare March 20, 2024 17:59
@holdenk holdenk merged commit 834a8e4 into high-performance-spark:main Apr 1, 2024
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant