Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Segfaults even with duckdb v0.7+ installed #717

Closed
jrabary opened this issue Mar 21, 2023 · 4 comments
Closed

Segfaults even with duckdb v0.7+ installed #717

jrabary opened this issue Mar 21, 2023 · 4 comments
Labels
bug Something isn't working

Comments

@jrabary
Copy link

jrabary commented Mar 21, 2023

Hi,
I'm giving lance a try and get segfaults even with duckedb v0.7.1. I'm using Mac OS with m1 chips.
Any ideas ?

@changhiskhan
Copy link
Contributor

Can you help us repro it? What's the data / query look like?

@eddyxu eddyxu added the bug Something isn't working label Mar 21, 2023
@jrabary
Copy link
Author

jrabary commented Mar 21, 2023

I've just find out why I get this. I have a large parquet file with binary image inside. Generated from coco dataset. When I run a query with duckdb.query("SELECT * ...") I get a segfault. But if I specify a column like "SELECT image ..." it works.

@changhiskhan
Copy link
Contributor

Would you be able to share the data?

  1. If you do "SELECT * EXCLUDE(image) ...", do you still get a segfault? If so, can you share the parquet dataset without the image column (hopefully making it much smaller) ?
  2. OR if like the first 10 rows still reproduces the error, just share the first 10 rows?

Another possibility is that we're working on #664 which adds support for list-of-dict or list-of-struct-with-dict fields. If you've converted data from parquet, it's possible this is the problem too.

If you can, please share the data so we can verify it from our end before the next release

@jrabary
Copy link
Author

jrabary commented May 31, 2023

Not sure whether this is an issue anymore. Maybe our parquet file was not correctly generated

@jrabary jrabary closed this as completed May 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants