Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ggml : allow setting the backend name with env variable #1059

Merged
merged 1 commit into from
Jan 5, 2025

Conversation

rgerganov
Copy link
Collaborator

ref: #1058

@slaren
Copy link
Collaborator

slaren commented Jan 3, 2025

I am not sure that this is the best way to implement this, because ggml_backend_load_best only looks in a list of pre-defined paths that may not be entirely obvious to the user, and this behavior may change in the future. It may make more sense to use ggml_backend_load with the full file path in the environment variable.

@rgerganov rgerganov merged commit c8bd0fe into ggerganov:master Jan 5, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants