-
Notifications
You must be signed in to change notification settings - Fork 310
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Set CUDA_STATIC_MATH_LIBRARIES in Python builds #4612
Set CUDA_STATIC_MATH_LIBRARIES in Python builds #4612
Conversation
In rapidsai#4526, we introduced the CUDA_STATIC_MATH_LIBRARIES option and set it to OFF by default. We did not set it to ON in the Python builds, and as a result ended up bundling dynamic CUDA libraries. Set the option to ON in the Python build.
Thanks Kyle, before I approve this, let's wait until a wheel build completes and we can inspect the resulting outputs. If the sizes go back down then we'll know things worked as expected. |
Comparing https://downloads.rapids.ai/ci/cugraph/branch/branch-24.10/a538745/ (before this change) to https://downloads.rapids.ai/ci/cugraph/pull-request/4612/aa83fbf/ (after this change), it looks like there was a slight reduction in wheel size, but not massive. |
Interestingly, both look much smaller than what Robert was observing in his document. I would download and untar, it might be compression. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm recommending that we merge this fix (since it's definitely needed) and then we reassess package sizes afterwards to see if there's some other additional cause for increased wheel sizes in 24.08.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actually sorry hold on, I'm seeing some odd things that make me want to investigate a bit more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
OK, so strictly speaking this isn't related to #4526, but rather rapidsai/raft#2376. #4526 changed the build options for cugraph_etl, which doesn't get built into the wheel anyway right, but the changes in raft needed to be propagated up since we rebuild/statically link raft in our wheels.
However, that still doesn't account for the full binary size increase. Most of that is coming from the fact that libcugraph itself seems to have nearly doubled in size from 24.06 to 24.08. We need to look into that, but we can do that independently since it's not a wheels issue (the size difference is evident even in our libcguraph conda packages).
/merge |
In #4526, we introduced the CUDA_STATIC_MATH_LIBRARIES option and set it to OFF by default. We did not set it to ON in the Python builds, and as a result ended up bundling dynamic CUDA libraries. Set the option to ON in the Python build.