Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add send_columns examples for images, fix rust send_columns handling of listarrays #7172

Merged
merged 12 commits into from
Aug 14, 2024

Conversation

Wumpf
Copy link
Member

@Wumpf Wumpf commented Aug 14, 2024

What

  • New send_columns snippets for image, demonstrating to send several images at once efficiently
  • C++ convenience methods for image format component
  • Rust slicing of blobs
  • Rust send_columns no longer assumes that an encountered ListArray is already the list array for the column
    • this broke any send_columns call for any component batch that's internally a list array

Unfortunately, the snippet isn't fully deterministic and can't be compared cross language since the due to the batcher on log calls, log may arrive before or after send_columns

Screen.Recording.2024-08-14.at.11.03.12.mov

Checklist

  • I have read and agree to Contributor Guide and the Code of Conduct
  • I've included a screenshot or gif (if applicable)
  • I have tested the web demo (if applicable):
  • The PR title and labels are set such as to maximize their usefulness for the next release's CHANGELOG
  • If applicable, add a new check to the release checklist!
  • If have noted any breaking changes to the log API in CHANGELOG.md and the migration guide

To run all checks from main, comment on the PR with @rerun-bot full-check.

Copy link

github-actions bot commented Aug 14, 2024

Deployed docs

Commit Link
d7060dd https://landing-nbj5cuqn7-rerun.vercel.app/docs

@Wumpf Wumpf added 🦀 Rust API Rust logging API examples Issues relating to the Rerun examples 🌊 C++ API C/C++ API specific include in changelog and removed 🦀 Rust API Rust logging API 🌊 C++ API C/C++ API specific labels Aug 14, 2024
@Wumpf Wumpf force-pushed the andreas/more-send_columns-snippets branch from 46c8a1f to 1508207 Compare August 14, 2024 09:00
@Wumpf Wumpf marked this pull request as ready for review August 14, 2024 09:03
@emilk emilk self-requested a review August 14, 2024 09:07
Copy link
Member

@emilk emilk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice

docs/snippets/all/archetypes/image_send_columns.cpp Outdated Show resolved Hide resolved
docs/snippets/all/archetypes/image_send_columns.rs Outdated Show resolved Hide resolved
@@ -172,6 +172,11 @@ quick_start = [ # These examples don't have exactly the same implementation.
"py",
"rust",
]
"archetypes/image_send_columns" = [ # This mixes `log` and `send_columns`. Since `log` is suspect to delays by the batcher, this test gets flaky.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder if this could be fixed by tuning the batcher parameters… but probably it's not possible since it is running on a separate thread.

@Wumpf Wumpf merged commit d770e43 into main Aug 14, 2024
7 of 12 checks passed
@Wumpf Wumpf deleted the andreas/more-send_columns-snippets branch August 14, 2024 10:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
examples Issues relating to the Rerun examples include in changelog
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants