Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(rust, python): Add support for reading zstd compressed files (no-options) in read_csv #12214

Merged
merged 2 commits into from
Nov 3, 2023

Conversation

hirohira9119
Copy link
Contributor

Partially addresses #9283

This PR allows read_csv to read zstd-compressed files only without options (dictionary, window size, etc.).
Despite the limitation of only no-option, the functionality is equivalent to pyarrow and I still believe it is useful.

…-options) in read_csv

Partially addresses 9283

This PR allows read_csv to read zstd-compressed files only without options (dictionary, window size, etc.).
@github-actions github-actions bot added enhancement New feature or an improvement of an existing feature python Related to Python Polars rust Related to Rust Polars labels Nov 3, 2023
Copy link
Member

@ritchie46 ritchie46 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good and I think it is a low effort feature to have. Thank you.

@ritchie46 ritchie46 merged commit d3860ba into pola-rs:main Nov 3, 2023
@hirohira9119 hirohira9119 deleted the add_support_read_csv_zst branch November 3, 2023 11:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or an improvement of an existing feature python Related to Python Polars rust Related to Rust Polars
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants