Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Owl2中使用的Vit-H-16是从哪个版本初始化的？ #218

Open
OpenJarvisAI opened this issue Apr 15, 2024 · 2 comments
Open

Owl2中使用的Vit-H-16是从哪个版本初始化的？ #218

OpenJarvisAI opened this issue Apr 15, 2024 · 2 comments

Comments

@OpenJarvisAI
Copy link

Owl2中使用的Vit-H-16是从哪个版本初始化的？
可以分享一下这个vit的初始版本权重吗
@vateye
Copy link

vateye commented Apr 15, 2024

Owl2 是用OpenAI CLIP-L/224初始化的
Owl2.1 的ViT-H-16是用OpenCLIP的权重初始化的

@OpenJarvisAI
Copy link
Author

可以发一下原始的vit-h-16的连接吗，想看看是哪个版本。

顺便问一下，初始化之后，分别在哪个阶段微调了这个vit，以及输入尺寸是如何增大的呢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@vateye @OpenJarvisAI