Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Display embeddings with interactive map widget #459

Open
stepan-anokhin opened this issue Feb 7, 2022 · 0 comments
Open

Display embeddings with interactive map widget #459

stepan-anokhin opened this issue Feb 7, 2022 · 0 comments
Labels
enhancement New feature or request

Comments

@stepan-anokhin
Copy link
Collaborator

stepan-anokhin commented Feb 7, 2022

Context

It is hard to display embeddings of a large collection of videos using a single static image. A much better way is to generate a tiles for an interactive map to display embeddings at different zoom level. JS libraries for building maps such as https://leafletjs.com/ also support a lot of useful interactions (like navigating, handling mouse events, drawing polygones, etc.) out of the box, which makes this approach very fertile for adding new features.

Task

  1. Implement a job to generate tiles for an interactive map widget.
  2. Display embeddings using the interactive map widget on the dashboard page if the corresponding embeddings exist.
  3. Show video preview in a popup when user clicks on a video
  4. Add a control to the video-details page to show video's vicinity on the embeddings map.

basic

Further Improvements

Here are some possible developments on top of this task (but out of the scope of this task):

  1. Select an area (e.g. by drawing a polygon) and then application will show you a list of videos from that area
    polygon

  2. Hover a magnifying glass tool over the embeddings and the application will dynamically show thumbnails and a word-cloud (after semantic text-search will be implemented) of the nearby videos.

  3. Select an area and add all videos from that area to a new collection of videos (after Match graph communities as first-class objects #455 is implemented).

@stepan-anokhin stepan-anokhin added the enhancement New feature or request label Feb 7, 2022
johnhbenetech added a commit that referenced this issue Apr 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant