Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

siglip's [cls token] #145

Open
guoyanan1g opened this issue Jan 3, 2025 · 1 comment
Open

siglip's [cls token] #145

guoyanan1g opened this issue Jan 3, 2025 · 1 comment

Comments

@guoyanan1g
Copy link

Hello,I want to get the token of siglip like the "cls token in CLIP",
Did siglip have such token which can be used to represent the main feature of the image?

@mitscha
Copy link
Collaborator

mitscha commented Jan 23, 2025

Hi SigLIP has a MAP head (attention pooling head) instead of a CLS token. You can try using the MAP head output (pre_logits) instead of the CLS token representation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants