Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Installation requirements and error text for dask/dask-awkward in extras.py #680

Closed
wants to merge 3 commits into from

Conversation

jpivarski
Copy link
Member

This is addressing #652 (comment) (@masonproffitt).

@kkothari2001, please make sure that uproot.extras.dask_awkward is only called if library != "np" (i.e. uproot.dask with library="np" requires Dask, but uproot.dask with library="ak" requires Dask-Awkward). If Dask-Awkward strictly depends on dask[complete] (I haven't checked: please check it!), then the imports in the dask_awkward() function can be reduced to just import dask_awkward. We want to minimize the number of error messages that say, "Stop what you're doing and go install some other library," but not require people to install things that they don't need. (Consider the example of lz4 and xxhash, which are always needed together, so the error message for both says to install both.)

I'm not sure what will be required for the library="pd" case; quite possibly Awkward-Pandas. (If we no longer explode ragged data into a MultiIndex but wrap them using Awkward-Pandas, as described in #668, then every function with library="pd" may need Awkward-Pandas.)

@jpivarski jpivarski marked this pull request as draft August 18, 2022 14:39
@jpivarski
Copy link
Member Author

Actually, dask-awkward is not on conda-forge yet, so it needs to be pip-installed even if one's main installed is conda (and if Dask is installed via conda).

kkothari2001 added a commit that referenced this pull request Aug 24, 2022
jpivarski added a commit that referenced this pull request Aug 24, 2022
This also addresses #652 (comment), but is more up-to-date.

It _replaces_ #680, which should be closed.
@jpivarski
Copy link
Member Author

Replaced by #690.

@jpivarski jpivarski closed this Aug 24, 2022
jpivarski added a commit that referenced this pull request Aug 24, 2022
This also addresses #652 (comment), but is more up-to-date.

It _replaces_ #680, which should be closed.
jpivarski pushed a commit that referenced this pull request Sep 1, 2022
* Token change to get PR number

* Revert "Token change to get PR number"

This reverts commit ce59fe1.

* from_map optimization: Tests pass

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"

This reverts commit 6bc1c39.

* Solve issues with merge and add 2 noqa's

* Changes as suggested in #680

* Use right label for dask arrays

* Import dask.blockwise in extras

* Corrected issue with error message during merge

* Remove specia keyword used in tests for assert_eq

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
@jpivarski jpivarski deleted the jpivarski/dask-awkward-in-extras.py branch September 23, 2022 00:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant