-
Notifications
You must be signed in to change notification settings - Fork 731
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature] add support for llama 3.2 #1523
Comments
vLLM as already added support for Llama 3.2. SGLang, should do that too fast. |
Yes, vLLM currently only supports a single image. @hnyls2002 is working on support Llama 3.2 3b functionality. |
I just need to reinstall sglang and update some packages to reason about llama 3b |
Will be ready soon #1551 |
any ETA? And would this support all family and multiple images? |
Yes, it will support all family and multi image. |
supported by #1551 |
Checklist
Describe the bug
data did not match any variant of untagged enum ModelWrapper at line 1251003 column 3
Reproduction
try to run llama 3.2 3b
Environment
docker
The text was updated successfully, but these errors were encountered: