You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks for your great work.
I would love to know if VLMEvalKit supports the Paged Attention inference? If it does, how can I use the Paged Attention for inference? Thanks.
The text was updated successfully, but these errors were encountered:
Hi,
Thank you for reaching out regarding the use of Paged Attention with VLMEvalkit.
Currently, VLMEvalkit does not provide specific support for Paged Attention inference. If you intend to utilize Paged Attention, please verify whether your model supports this feature before proceeding.
We appreciate your understanding and are happy to assist with any further questions or clarifications you may need.
Thanks for your great work.
I would love to know if VLMEvalKit supports the Paged Attention inference? If it does, how can I use the Paged Attention for inference? Thanks.
The text was updated successfully, but these errors were encountered: