-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Minor: distinguish parquet row group pruning type in unit test #8921
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Makes sense to me -- thank you @Ted-Jiang
test_row_group_prune( | ||
Scenario::Timestamps, | ||
"SELECT * FROM t where nanos < to_timestamp('2020-01-02 01:01:11Z')", | ||
Some(0), | ||
Some(1), | ||
Some(0), | ||
10, | ||
) | ||
.await; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There are so many parameters here it is getting hard to read the tests I think (as you have three different constants that need to be remembered)
Maybe we can (as a follow on PR) make a more self documenting, something like
test_row_group_prune( | |
Scenario::Timestamps, | |
"SELECT * FROM t where nanos < to_timestamp('2020-01-02 01:01:11Z')", | |
Some(0), | |
Some(1), | |
Some(0), | |
10, | |
) | |
.await; | |
RowGroupPruningTest::new() | |
.with_scenario(Scenario::Timestamps) | |
.with_query("SELECT * FROM t where nanos < to_timestamp('2020-01-02 01:01:11Z')"), | |
.with_expected_errors(Some(0)), | |
.with_pruned_by_stats(Some(1)), | |
.with_pruned_by_bloom_filter(Some(0)), | |
.with_expected_rows(10) | |
) | |
.await; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Which issue does this PR close?
Related #8880. when i implements 8880 cause lot ut fail, because not distinguish between parquet row group pruning by statistics or bloom filter
Rationale for this change
What changes are included in this PR?
Are these changes tested?
Are there any user-facing changes?