Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Usage]: has vllm supported encoder-only model such as bge-m3? #5737

Closed
chenchunhui97 opened this issue Jun 21, 2024 · 4 comments
Closed

[Usage]: has vllm supported encoder-only model such as bge-m3? #5737

chenchunhui97 opened this issue Jun 21, 2024 · 4 comments
Labels
stale usage How to use vllm

Comments

@chenchunhui97
Copy link

chenchunhui97 commented Jun 21, 2024

Your current environment

The output of `python collect_env.py`

How would you like to use vllm

I saw an issue here: https://github.com/vllm-project/vllm/pull/3187/files
image

I want to know has vllm supported embedding model in RAG? such as BAAI/bge-m3. and how to use it?

@chenchunhui97 chenchunhui97 added the usage How to use vllm label Jun 21, 2024
@Ludoko91
Copy link

@Huyueeer
Copy link

I also want to know whether vllm supports

Copy link

This issue has been automatically marked as stale because it has not had any activity within 90 days. It will be automatically closed if no further activity occurs within 30 days. Leave a comment if you feel this issue should remain open. Thank you!

@github-actions github-actions bot added the stale label Nov 12, 2024
Copy link

This issue has been automatically closed due to inactivity. Please feel free to reopen if you feel it is still relevant. Thank you!

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Dec 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
stale usage How to use vllm
Projects
None yet
Development

No branches or pull requests

3 participants