Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cannot read Parquet files with missing dictionary page offsets #5764

Closed
abaranec opened this issue Jul 12, 2024 · 0 comments · Fixed by #5765
Closed

Cannot read Parquet files with missing dictionary page offsets #5764

abaranec opened this issue Jul 12, 2024 · 0 comments · Fixed by #5765
Assignees
@abaranec
Labels
bug Something isn't working core Core development tasks parquet Related to the Parquet integration
Milestone
0.36.0

Comments

@abaranec
Copy link
Contributor

abaranec commented Jul 12, 2024 •
edited
Loading

Description
An older parquet file that is missing the dictionary_page_offset.

Steps to reproduce
Attempt to load the attached file

Expected results
You get a table and no errors

Actual results

Errors

Additional details and attachments

data.tar.gz

Versions

  • Deephaven: 0.33.4
@abaranec abaranec added bug Something isn't working triage labels Jul 12, 2024
@abaranec abaranec added this to the 0.36.0 milestone Jul 12, 2024
@abaranec abaranec self-assigned this Jul 12, 2024
@abaranec abaranec changed the title Cannot read Parquet files with missing dictionary page offsets or null INT96 values Cannot read Parquet files with missing dictionary page offsets Jul 12, 2024
@abaranec abaranec mentioned this issue Jul 12, 2024
Merged
@rcaudy rcaudy added core Core development tasks parquet Related to the Parquet integration and removed triage labels Jul 12, 2024
abaranec added a commit to abaranec/deephaven-core that referenced this issue Jul 18, 2024
@abaranec
fix: Fix readback of parquet files with missing dictionary page offse…
2ffc4da 
…ts (deephaven#5765)

This fixes deephaven#5764

(cherry picked from commit ae966a8)
@abaranec abaranec mentioned this issue Jul 18, 2024
Merged
devinrsmith pushed a commit that referenced this issue Jul 19, 2024
@abaranec
fix: Fix readback of parquet files with missing dictionary page offse… (
d2eab7d 
#5810)

…ts (#5765)

This fixes #5764

(cherry picked from commit ae966a8)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@abaranec abaranec

Labels
bug Something isn't working core Core development tasks parquet Related to the Parquet integration
Projects
None yet
Milestone
0.36.0
Development

Successfully merging a pull request may close this issue.

fix: Fix readback of parquet files with missing dictionary page offsets abaranec/deephaven-core
2 participants
@abaranec @rcaudy