You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
We could both improve the performance and save the memory of GroupedHashAggregate by employing row format.
By using Vec<u8> backed rows, we are able to:
compare compound grouping keys by comparing raw bytes directly.
create all accumulator states by just creating a Vec<u8> for each key, and update the contents in place
reduce the memory footprint for each group state, by changing from Vec<ScalarValue> based state to Vec<u8> based state with less datatype information.
Describe the solution you'd like
A new Accumulator trait to manipulate state's updating/merging based on Vec<u8>
branching AggregateExec::execute to employ row-based aggregate when applicable.
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
We could both improve the performance and save the memory of GroupedHashAggregate by employing row format.
By using
Vec<u8>
backed rows, we are able to:Vec<u8>
for each key, and update the contents in placeVec<ScalarValue>
based state toVec<u8>
based state with less datatype information.Describe the solution you'd like
Vec<u8>
AggregateExec::execute
to employ row-based aggregate when applicable.Describe alternatives you've considered
Additional context
#1708 and #2188
The text was updated successfully, but these errors were encountered: