Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does VLMEvalKit support Paged Attention evaluation? #641

Open
weiaicunzai opened this issue Dec 2, 2024 · 1 comment
Open

Does VLMEvalKit support Paged Attention evaluation? #641

weiaicunzai opened this issue Dec 2, 2024 · 1 comment
Assignees

Comments

@weiaicunzai
Copy link

Thanks for your great work.
I would love to know if VLMEvalKit supports the Paged Attention inference? If it does, how can I use the Paged Attention for inference? Thanks.

@PhoenixZ810
Copy link
Collaborator

Hi,
Thank you for reaching out regarding the use of Paged Attention with VLMEvalkit.

Currently, VLMEvalkit does not provide specific support for Paged Attention inference. If you intend to utilize Paged Attention, please verify whether your model supports this feature before proceeding.

We appreciate your understanding and are happy to assist with any further questions or clarifications you may need.

@PhoenixZ810 PhoenixZ810 self-assigned this Dec 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants