-
Notifications
You must be signed in to change notification settings - Fork 611
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Dask PCA support #2563
Dask PCA support #2563
Conversation
Codecov Report
Additional details and impacted files@@ Coverage Diff @@
## master #2563 +/- ##
==========================================
+ Coverage 72.27% 72.32% +0.04%
==========================================
Files 105 105
Lines 11753 11785 +32
==========================================
+ Hits 8495 8524 +29
- Misses 3258 3261 +3
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
looks straightforward enough!
- please make sure the docs look right and you are using links. You probably have to add a line to
intersphinx_mapping
indocs/conf.py
to be able to link to the dask-ml docs. - the logic seems straightforward, but the user should know when which
svd_solver
argument works, as that part is getting complicated. - you have a lot of duplicated lines that can just be moved to after their
if
/else
block to deduplicate them
Co-authored-by: Philipp A. <[email protected]>
Co-authored-by: Philipp A. <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
scanpy/scanpy/preprocessing/_pca.py
Lines 191 to 192 in 3c76af9
if not zero_center or random_state or svd_solver != 'arpack': | |
logg.debug('Ignoring zero_center, random_state, svd_solver') |
at this point, svd_solver
is None
, right? Please make this line work with both None
and the explicit value
@flying-sheep , haven't considered all combinations yet but wanted to check if this way is good for testing warnings. |
Looks great! You can get rid of |
You also need to fix the links. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
great! once the docs build (and you’re happy with it), that’s ready
Co-authored-by: Philipp A. <[email protected]> Co-authored-by: Philipp A <[email protected]>
Hi,
Just wanted to start the PR. Passes the tests except one. Also need to deal with solver names since they don't correspond to anything dask uses.
Also refactored where the DaskArray mock class is.
Pinging @ivirshup