Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upgrade llamafile to 0.6 for AMD GPU support in Windows #1

Closed
amakropoulos opened this issue Jan 9, 2024 · 2 comments · Fixed by #27
Closed

Upgrade llamafile to 0.6 for AMD GPU support in Windows #1

amakropoulos opened this issue Jan 9, 2024 · 2 comments · Fixed by #27
Labels
enhancement New feature or request
Milestone
v1.0.2

Comments

@amakropoulos
Copy link
Collaborator

amakropoulos commented Jan 9, 2024 •
edited
Loading

llamafile version 0.6 allows AMD GPUs in Windows along with some other goodies.

However, it seems to be breaking the GPU support for Linux (issue).
If the issue is fixed, the version will be tested and incorporated in the repo.
Edit: Requires CUDA 11.8+ but will mark it as resolved
@amakropoulos amakropoulos added the enhancement New feature or request label Jan 9, 2024
@amakropoulos amakropoulos changed the title Upgrade llamafile to 0.5 Upgrade llamafile to 0.5 for AMD GPU support in Windows Jan 9, 2024
@amakropoulos amakropoulos added this to the v1.1.0 milestone Jan 11, 2024
@amakropoulos amakropoulos moved this from Blocked to Todo in LLM for Unity Roadmap Jan 11, 2024
@amakropoulos amakropoulos modified the milestones: v1.1.0, v1.0.2 Jan 11, 2024
@ArEnSc
Copy link

ArEnSc commented Jan 16, 2024

why notjust jump to 0.6 ?

@amakropoulos amakropoulos changed the title Upgrade llamafile to 0.5 for AMD GPU support in Windows Upgrade llamafile to 0.6 for AMD GPU support in Windows Jan 16, 2024
@amakropoulos
Copy link
Collaborator Author

yes now it's 0.6, at the time of writing it was not yet out 😄.
I have changed the title accordingly.

This was referenced Jan 17, 2024
Merged
Merged
@github-project-automation github-project-automation bot moved this from Todo to Done in LLM for Unity Roadmap Jan 18, 2024
@3inary 3inary mentioned this issue Aug 9, 2024
Closed
@CGAleksey CGAleksey mentioned this issue Nov 22, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
LLM for Unity Roadmap
Status: Done
Milestone
v1.0.2
Development

Successfully merging a pull request may close this issue.

Release v1.0.2 undreamai/LLMUnity
2 participants
@ArEnSc @amakropoulos