Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Multi-GPU support #58

Open
ghost opened this issue Apr 18, 2023 · 2 comments
Open

Multi-GPU support #58

ghost opened this issue Apr 18, 2023 · 2 comments

Comments

@ghost
Copy link

ghost commented Apr 18, 2023

Is it possible to use Weaviate with multi-GPUs? For example, we can see only one of the GPUs being used in our machine.
@trengrj trengrj transferred this issue from weaviate/weaviate Apr 28, 2023
@trengrj
Copy link
Member

trengrj commented Apr 28, 2023

The modules just use a single GPU but you can run multi modules and load balance between them. @antas-marcin has an example of this.

@ghost
Copy link
Author

ghost commented Apr 29, 2023

Dear @antas-marcin ,
Is there any chance you could share the example @trengrj mentions, please? It would be amazing to learn how to run multi modules? Or any other methods to reduce the search and question answering time, with multi GPUs or without extra GPUs. Many Thanks in advance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@trengrj