Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support "dill" for serialization and deserialization #424

Closed
schlichtanders opened this issue Nov 21, 2023 · 4 comments
Closed

support "dill" for serialization and deserialization #424

schlichtanders opened this issue Nov 21, 2023 · 4 comments
Labels
enhancement New feature or request
Milestone

Comments

@schlichtanders
Copy link
Contributor

I am using PythonCall to define a Python interface from julia. It happens that I want to precompile Python code using Python's compile function and then send it to a remote process (Distributed).

Unfortunately the default serialize_py and deserialize_py use pickle which cannot handle code objects.

Describe the solution you'd like
It would be perfect if PythonCall had an option to use dill instead of pickle

Describe alternatives you've considered
I am currently overwriting serialize_py and deserialize_py myself to use "dill", and also add "dill" to the CondaPkg.toml.

@schlichtanders schlichtanders added the enhancement New feature or request label Nov 21, 2023
@cjdoris
Copy link
Collaborator

cjdoris commented Nov 22, 2023

Agreed this would be a nice feature.

@cjdoris cjdoris added this to the features milestone Nov 22, 2023
@ma-sadeghi
Copy link

@schlichtanders Did you figure this out? If so, would appreciate it if you could share the solution. Thanks!

@ma-sadeghi
Copy link

I think #454 is related, and will be automatically fixed if dill was an option.

@cjdoris
Copy link
Collaborator

cjdoris commented May 12, 2024

This feature is merged to main - you can set JULIA_PYTHONCALL_PICKLE=dill.

@cjdoris cjdoris closed this as completed May 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants