Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New Chunk-based time-series views #6995

Merged
merged 2 commits into from
Jul 29, 2024

Conversation

teh-cmc
Copy link
Member

@teh-cmc teh-cmc commented Jul 25, 2024

The new Chunk-based time-series views.

They can chomp through your scalars real fast, here's 2.25M of them!

24-07-25_18.45.34.patched.mp4

Checklist

  • I have read and agree to Contributor Guide and the Code of Conduct
  • I've included a screenshot or gif (if applicable)
  • I have tested the web demo (if applicable):
  • The PR title and labels are set such as to maximize their usefulness for the next release's CHANGELOG
  • If applicable, add a new check to the release checklist!
  • If have noted any breaking changes to the log API in CHANGELOG.md and the migration guide

To run all checks from main, comment on the PR with @rerun-bot full-check.

@teh-cmc teh-cmc changed the title TODO 5: todo New Chunk-based time-series views Jul 25, 2024
@teh-cmc teh-cmc added 📺 re_viewer affects re_viewer itself 🔍 re_query affects re_query itself 🚀 performance Optimization, memory use, etc do-not-merge Do not merge this PR include in changelog labels Jul 25, 2024
@teh-cmc teh-cmc marked this pull request as ready for review July 26, 2024 14:09
@Wumpf Wumpf requested review from Wumpf and removed request for Wumpf July 29, 2024 11:12
@teh-cmc teh-cmc force-pushed the cmc/chunkified_queries_4_entitydb_integration branch from 8352397 to d1331a4 Compare July 29, 2024 12:33
Base automatically changed from cmc/chunkified_queries_4_entitydb_integration to main July 29, 2024 12:34
@teh-cmc teh-cmc force-pushed the cmc/chunkified_queries_5_new_time_series branch from 301c344 to 76c5d4a Compare July 29, 2024 12:35
@jleibs jleibs self-requested a review July 29, 2024 14:29
Copy link
Member

@jleibs jleibs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! All reads quite logically. Still feels a bit on the verbose side, but looks like some good opportunities still for improved helpers in the future.

.flat_map(|chunk| {
chunk.iter_component_indices(&query.timeline(), &Scalar::name())
})
.map(|index| (index, ()))
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks odd. I assume this is related to the requirements for using range_zip_1x1 below, but maybe hints at the need for some helpers with slightly different shape if it shows up in more places.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This only shows up in the time series views which are written in an awkward, rustc-pleasing kind of way.

It's still worthy of a comment in any case, you're right.

@teh-cmc teh-cmc removed the do-not-merge Do not merge this PR label Jul 29, 2024
@teh-cmc teh-cmc merged commit ae86854 into main Jul 29, 2024
27 of 29 checks passed
@teh-cmc teh-cmc deleted the cmc/chunkified_queries_5_new_time_series branch July 29, 2024 16:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
include in changelog 🚀 performance Optimization, memory use, etc 🔍 re_query affects re_query itself 📺 re_viewer affects re_viewer itself
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants