Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add SAM2 models and AI Batch Mode #1493

Open
wants to merge 12 commits into
base: main
Choose a base branch
from
Open

Add SAM2 models and AI Batch Mode #1493

wants to merge 12 commits into from

Conversation

jakep72
Copy link

@jakep72 jakep72 commented Sep 11, 2024

  • Support for Segment Anything 2 tiny and large models. Models are currently located in the fork release (see below):

SAM2 Large Models
https://github.com/jakep72/labelme/releases/download/SAM2/sam2_large.encoder.onnx
https://github.com/jakep72/labelme/releases/download/SAM2/sam2_large.decoder.onnx

SAM2 Tiny Models
https://github.com/jakep72/labelme/releases/download/SAM2/sam2_hiera_tiny.encoder.onnx
https://github.com/jakep72/labelme/releases/download/SAM2/sam2_hiera_tiny.decoder.onnx

  • Implement "AI Batch" mode -- adds the ability to label multiple similar polygons without clicking on each object. Accept or reject each polygon using the label dialog pop up widget.

@ryouchinsa
Copy link

sam-cpp-macos is the Segment Anything Model 2 CPP Wrapper for macOS and Ubuntu CPU/GPU.
This code is to run a SAM2 ONNX model in c++ code and implemented on the macOS app RectLabel.
This code is currently support only image prediction, not video prediction.
We hope this code would be helpful for some users.

On macOS CPU use-case.

  • SAM2 Tiny takes 1s for preprocessing.
  • SAM2 Small takes 2s for preprocessing.
  • SAM2 BasePlus takes 4s for preprocessing.
  • SAM2 Large takes 10s for preprocessing.

sam2_polygon.mp4

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants