Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cp feature refactor #35

Merged
merged 15 commits into from
Jul 6, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -6,3 +6,5 @@ __pycache__/
.vscode
# autosklearn
3.ML_model/autosklearn.ipynb
# Mac files
.DS_Store
11 changes: 3 additions & 8 deletions 0.download_data/README.md
Original file line number Diff line number Diff line change
@@ -1,22 +1,17 @@
# Download Data

In this module, we present our method for downloading and combining nucleus morphology data.
In this module, a labeled dataset is downloaded from `mitocheck_data`.

### Download/Preprocess Data

Complete instructions for data download and preprocessing can be found at: https://github.com/WayScience/mitocheck_data

### Usage

In this repository, all training data is downloaded from a version controlled [mitocheck_data](https://github.com/WayScience/mitocheck_data).

An earlier (2006) and later (2015) dataset are both downloaded from `mitocheck_data` and combined by checking if any of the plate/well/frame/coordinates of the cells from the 2006 and 2015 datasets match.
If all of this information matches, this must be the same cell and is only added once to the final combined dataset.
This combination method avoids repeating cells in the combined dataset which could lead to biases in the final model.
In this repository, all labeled data is downloaded from a version controlled [mitocheck_data](https://github.com/WayScience/mitocheck_data).

The version of mitocheck_data used is specified by the hash corresponding to a current commit.
The current hashes being used are `19bfa5b0959d6b7536f83e7bb85745ba3edf7ff9` for the 2006 dataset and `3ebd0ca7c288f608e9b23987a8ddbabd5476bd8f` for the 2015 dataset.
These correspond to [mitocheck_data/19bfa5b](https://github.com/WayScience/mitocheck_data/tree/19bfa5b0959d6b7536f83e7bb85745ba3edf7ff9) and [mitocheck_data/3ebd0ca](https://github.com/WayScience/mitocheck_data/tree/3ebd0ca7c288f608e9b23987a8ddbabd5476bd8f) respectively.
The current hash being used is `e1f86cd007657f8247310b78df92891b22e51621` which corresponds to [mitocheck_data/e1f86cd](https://github.com/WayScience/mitocheck_data/tree/e1f86cd007657f8247310b78df92891b22e51621).
The `hash` variable can be set in [download_data.ipynb](download_data.ipynb) to change which version of mitocheck_data is being accessed.

## Step 1: Download Data
Expand Down
Binary file not shown.
Loading