You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In order to support the CalledVia option for athena, we need to introduce new flags that allow a native behavior to create/insert data into tables.
In order to do so we need to have additional flags:
native_drop: table is dropped via "drop" DML in athena, in case of iceberg we use the native s3 path dropping, as iceber tables are managed - use_information_schema: allow to fetch glue tables details via information schema, pretty much means merging what was done in feat: use glue api instead of information_schema to retrieve table info #174 with 2 behaviours
Regarding the usage of information schema, after discussing with @brabste we agreed that we use of information schema is not necessary, as we can use glue apis - and we avoid still direct access to S3 data.
The text was updated successfully, but these errors were encountered:
In order to support the CalledVia option for athena, we need to introduce new flags that allow a native behavior to create/insert data into tables.
In order to do so we need to have additional flags:
- use_information_schema: allow to fetch glue tables details via information schema, pretty much means merging what was done in feat: use glue api instead of information_schema to retrieve table info #174 with 2 behavioursRegarding the usage of information schema, after discussing with @brabste we agreed that we use of information schema is not necessary, as we can use glue apis - and we avoid still direct access to S3 data.
The text was updated successfully, but these errors were encountered: