Improve performance of boolean aggregates: implement convert_to_state
#11818
Labels
enhancement
New feature or request
convert_to_state
#11818
Is your feature request related to a problem or challenge?
@korowa added "skip partial aggregation mode" in #11627 which helps with high cardinality aggregates by doing minimal work for the first phase of the aggregation. This mode is triggered dynamically based on how effective the first aggregation phase is working.
In order to use this new mode, the corresponding
GroupsAccumulator
needs to implement theconvert_to_state
methoddatafusion/datafusion/expr/src/groups_accumulator.rs
Lines 166 to 213 in c340b6a
Describe the solution you'd like
Implement
covert_to_state
fordatafusion/datafusion/physical-expr-common/src/aggregate/groups_accumulator/bool_op.rs
Line 64 in 2eb38bd
Add tests in
datafusion/datafusion/sqllogictest/test_files/aggregate_skip_partial.slt
Lines 18 to 19 in c340b6a
Describe alternatives you've considered
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: