Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Panic when importing parquet file #17175

Closed
2 tasks done
Chuck321123 opened this issue Jun 25, 2024 · 4 comments
Closed
2 tasks done

Panic when importing parquet file #17175

Chuck321123 opened this issue Jun 25, 2024 · 4 comments
Labels
A-io-parquet Area: reading/writing Parquet files A-panic Area: code that results in panic exceptions bug Something isn't working needs triage Awaiting prioritization by a maintainer python Related to Python Polars

Comments

@Chuck321123
Copy link

Checks

  • I have checked that this issue has not already been reported.
  • I have confirmed this bug exists on the latest version of Polars.

Reproducible example

Polars bug

Log output

No response

Issue description

So I got this panic error, but I dont know how to replicate it. Would be nice if someone could find a fix to this.

Expected behavior

That it doesnt panic

Installed versions

--------Version info---------
Polars:               1.0.0-beta.1
Index type:           UInt32
Platform:             Linux-6.8.0-1005-raspi-aarch64-with-glibc2.39
Python:               3.12.3 | packaged by conda-forge | (main, Apr 15 2024, 18:17:49) [GCC 12.3.0]

----Optional dependencies----
adbc_driver_manager:  <not installed>
cloudpickle:          3.0.0
connectorx:           <not installed>
deltalake:            <not installed>
fastexcel:            <not installed>
fsspec:               <not installed>
gevent:               <not installed>
great_tables:         <not installed>
hvplot:               <not installed>
matplotlib:           3.9.0
nest_asyncio:         1.6.0
numpy:                1.26.4
openpyxl:             3.1.4
pandas:               2.2.2
pyarrow:              16.1.0
pydantic:             <not installed>
pyiceberg:            <not installed>
sqlalchemy:           <not installed>
torch:                <not installed>
xlsx2csv:             <not installed>
xlsxwriter:           <not installed>
@Chuck321123 Chuck321123 added bug Something isn't working needs triage Awaiting prioritization by a maintainer python Related to Python Polars labels Jun 25, 2024
@ritchie46
Copy link
Member

Can you show the full backtrace with RUST_BACKTRACE=1 and share the parquet file?

@Chuck321123
Copy link
Author

Chuck321123 commented Jun 25, 2024

@ritchie46 I turned on rust backtrace from now on, but the file has updated while i was asleep and is now working. It consists of 1 row with a datetime column and several float32 columns in its working state. About 306 columns. I'll let you know if I'm able to replicate the error.

@Chuck321123
Copy link
Author

@ritchie46 Put my read parquet function in a try-except loop before it failed. Here are some previous error messages:
Polars bug

@stinodego stinodego added A-io-parquet Area: reading/writing Parquet files A-panic Area: code that results in panic exceptions labels Jun 25, 2024
@Chuck321123
Copy link
Author

After updating to v1.0.0-rc.2 I haven't encountered this error again. I'll reopen the case if it happens again.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-io-parquet Area: reading/writing Parquet files A-panic Area: code that results in panic exceptions bug Something isn't working needs triage Awaiting prioritization by a maintainer python Related to Python Polars
Projects
None yet
Development

No branches or pull requests

3 participants