Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

March Binary Update #565

Merged
merged 4 commits into from
Mar 6, 2024
Merged

Conversation

martindevans
Copy link
Member

@martindevans martindevans commented Mar 3, 2024

Updated binaries to llama.cpp 3ab8b3a92ede46df88bc5a2dfca3777de4a2b2b6. Build: https://github.com/SciSharp/LLamaSharp/actions/runs/8118890586).

Does not yet include Vulkan binaries.

Testing required:

  • Windows, CPU
  • Windows, GPU
  • Linux
  • MacOS

@SignalRT
Copy link
Collaborator

SignalRT commented Mar 3, 2024

@martindevans It's working OK on MacOS.

@martindevans
Copy link
Member Author

Resolve #531

@AsakusaRinne
Copy link
Collaborator

Shall we add a new release when merging this PR? Some new features are included in this llama.cpp version.

@martindevans
Copy link
Member Author

I don't want to do a release with this PR, since there's hopefully going to be some LLava bits merged in after this. Definitely shortly after though.

@martindevans martindevans mentioned this pull request Mar 5, 2024
4 tasks
@m0nsky
Copy link
Contributor

m0nsky commented Mar 6, 2024

Used this branch to run my local projects on both the desktop (Windows, CUDA 12) and laptop (Windows, AVX2) and found no issues.

@martindevans
Copy link
Member Author

Thanks for testing that @m0nsky

@martindevans martindevans merged commit a8ba9f0 into SciSharp:master Mar 6, 2024
3 checks passed
@martindevans martindevans deleted the march_binaries branch March 6, 2024 15:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants