Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

time partitioning #39

Closed
giwa opened this issue Mar 30, 2020 · 2 comments
Closed

time partitioning #39

giwa opened this issue Mar 30, 2020 · 2 comments

Comments

@giwa
Copy link
Contributor

giwa commented Mar 30, 2020

Should time_partioning option come from template_table?

I consider time_partition is a part of the table. Therefore, time_partiioning should be inherited from template table.

template_table PR
embulk/embulk-output-bigquery#25

time_partitioning issue
embulk/embulk-output-bigquery#100

@giwa
Copy link
Contributor Author

giwa commented Mar 31, 2020

It seems no option to get time partitioning info. A workaround could get field name and flag through INFORMATION_SCHEMA.TABLE_OPTIONS It's unclear to get expiration ms.

partition_expiration_days provides days for expiration

https://cloud.google.com/bigquery/docs/information-schema-tables#table_options_view

https://cloud.google.com/bigquery/docs/information-schema-tables#columns_view

https://googleapis.dev/java/google-cloud-clients/latest/com/google/cloud/bigquery/TimePartitioning.Builder.html

The expiration time cannot be configured through GUI, which requires CLI or API call.

For the first step, I will implement same API of jruby version.

@giwa
Copy link
Contributor Author

giwa commented Mar 31, 2020

time_partitioning supported in 0.0.12

@giwa giwa closed this as completed Mar 31, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant