Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add CLBLAST native library to native libraries build #468

Merged
merged 7 commits into from
Jan 31, 2024

Conversation

jasoncouture
Copy link
Contributor

@jasoncouture jasoncouture commented Jan 30, 2024

Build llama against CLBLAST (windows only for now)

Passing build: https://github.com/jasoncouture/LLamaSharp/actions/runs/7714965548/job/21028424704

Step 1 of #464
Step 2 will be to update the binaries, and add a new NuGet package spec.

using bash expansion expression, combined with mkdir -p (--parents), allows us to create all of the directories at once.

`deps/{avx,avx2,avx512,osx-arm64,osx-x64,cu11.7.1,cu12.1.0,clblast}`
expands to: deps/avx deps/avx2 deps/avx512 deps/osx-arm64 deps/osx-x64 deps/cu11.7.1 deps/cu12.1.0 deps/clblast
@martindevans
Copy link
Member

Is this good to merge now? I can see you've got the Linux stuff in there but commented out, do you want to include that in this PR, or merge as is and leave it for the future?

@jasoncouture
Copy link
Contributor Author

@martindevans it should be good to go.

Sorry for the close and reopen, fat fingers on my phone.

@jasoncouture
Copy link
Contributor Author

jasoncouture commented Jan 31, 2024

Llamacpp doesn't build clblast on Linux, I'll figure that out eventually, but for now windows only.

@martindevans martindevans merged commit 3b08874 into SciSharp:master Jan 31, 2024
8 checks passed
@martindevans
Copy link
Member

Thanks again!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants