You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As a result, filters containing these types will be rejected when used as pushdown (e.g. through DuckDb) or provided directly from Substrait.
This is primarily a tracking issue. Once Datafusion supports these types we shouldn't need to do any additional work but it would be good to add some regression tests.
The text was updated successfully, but these errors were encountered:
This is particularly useful for operations like "delete by id"
I ran into a fair bit of difficulty with this PR and punted a few things
to follow-ups (#2971#2972).
The arrow type system is wider than Substrait's default types (e.g. unsigned integers, large strings, etc.). There is a spec for expressing these types as Substrait user defined types (https://github.com/apache/arrow/blob/main/format/substrait/extension_types.yaml) however, Datafusion doesn't yet support the extension.
As a result, filters containing these types will be rejected when used as pushdown (e.g. through DuckDb) or provided directly from Substrait.
This is primarily a tracking issue. Once Datafusion supports these types we shouldn't need to do any additional work but it would be good to add some regression tests.
The text was updated successfully, but these errors were encountered: