Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: expand arrow to iceberg schema to handle nanosecond timestamp #710

Merged

Conversation

jdockerty
Copy link
Contributor

@jdockerty jdockerty commented Nov 22, 2024

Closes #709

The changes here stopped the resulting panic that was shown in the linked issue.

Nanosecond precision can be written by parquet-rs and iceberg-rust has some support for this recently too.

Copy link
Contributor

@liurenjie1024 liurenjie1024 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @jdockerty for adding this!

@liurenjie1024 liurenjie1024 merged commit 564f5a3 into apache:main Nov 28, 2024
16 checks passed
shaeqahmed pushed a commit to matanolabs/iceberg-rust that referenced this pull request Dec 9, 2024
…pache#710)

* fix: expand schema conversion data types for nanoseconds

* fix: use ns timestamp variants
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Arrow schema to iceberg conversion fails with nanosecond timestamps
3 participants