Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration of Groq LPU Inference generation (#140) #278

Merged
merged 5 commits into from
Oct 21, 2024

Conversation

symdec
Copy link
Contributor

@symdec symdec commented Sep 8, 2024

Following this issue : #140

  • Add GroqGenerator class, taking inspiration from CohereGenerator and others (from the 2.0 release)
  • Update managers.py to include this new generator
  • Update README to precise the availability of this Groq Generation feature + section to recommend using the environment variable before launching Verba (to have updated models list)

The generation has been successfully tested locally with various Groq models :

  • using the GROQ_API_KEY variable set in the .env file before the launch
  • using no .env file and providing the API key in the graphical config interface

@weaviate-git-bot
Copy link

To avoid any confusion in the future about your contribution to Weaviate, we work with a Contributor License Agreement. If you agree, you can simply add a comment to this PR that you agree with the CLA so that we can merge.

beep boop - the Weaviate bot 👋🤖

PS:
Are you already a member of the Weaviate Slack channel?

@symdec
Copy link
Contributor Author

symdec commented Sep 9, 2024

I agree with the CLA.

@thomashacker
Copy link
Collaborator

Thanks a lot for the PR, I'll have a look 🚀

@thomashacker thomashacker changed the base branch from main to dev October 21, 2024 09:23
@thomashacker thomashacker merged commit 2dfb6f6 into weaviate:dev Oct 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants