Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: remove hacky INDEX #1222

Closed
wants to merge 6 commits into from

Conversation

maxulysse
Copy link
Member

PR checklist

Closes #XXX

  • This comment contains a description of changes (with reason).
  • If you've fixed a bug or added code that should be tested, add tests!
  • If you've added a new tool - have you followed the module conventions in the contribution docs
  • If necessary, include test data in your PR.
  • Remove all TODO statements.
  • Emit the versions.yml file.
  • Follow the naming conventions.
  • Follow the parameters requirements.
  • Follow the input/output options guidelines.
  • Add a resource label
  • Use BioConda and BioContainers if possible to fulfil software requirements.
  • Ensure that the test works with either Docker / Singularity. Conda CI tests can be quite flaky:
    • PROFILE=docker pytest --tag <MODULE> --symlink --keep-workflow-wd
    • PROFILE=singularity pytest --tag <MODULE> --symlink --keep-workflow-wd
    • PROFILE=conda pytest --tag <MODULE> --symlink --keep-workflow-wd

@maxulysse
Copy link
Member Author

ok, so first version f524d06 is what I would have preferred to do, and pass the path around.
second version 6316357 is I think a good compromise and require very little changes from the .tar.gz extractions process

Copy link
Contributor

@edmundmiller edmundmiller left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I love it! The only thing is how does this look in the work directory? Are all the index files in the root? Just wondering.

@maxulysse
Copy link
Member Author

I love it! The only thing is how does this look in the work directory? Are all the index files in the root? Just wondering.

yes all files in the root folder, it how I use to do it in sarek before

@FriederikeHanssen
Copy link
Contributor

How does it work with multiple bwa indices, so like for bwa and bwamem2?

I love it! The only thing is how does this look in the work directory? Are all the index files in the root? Just wondering.

@maxulysse
Copy link
Member Author

How does it work with multiple bwa indices, so like for bwa and bwamem2?

I love it! The only thing is how does this look in the work directory? Are all the index files in the root? Just wondering.

Not sure I understood your question there

@drpatelh
Copy link
Member

Hi Guys. Let's maybe discuss and vote for this on #modules before merging because this will have implications for other modules requiring a typical alignment index and will also mean we need to update the igenomes.config for all pipelines that use it.

Be great if you can summarise the advantages and disadvantages compared to the current method in #modules please @maxulysse ?

@FriederikeHanssen
Copy link
Contributor

How does it work with multiple bwa indices, so like for bwa and bwamem2?

I love it! The only thing is how does this look in the work directory? Are all the index files in the root? Just wondering.

Not sure I understood your question there

Nevermind me, I half-way remembered this thread but didn't open it. Now I see that there is a long dicussion there. Will read through it there and comment

@maxulysse
Copy link
Member Author

@mahesh-panchal any idea why the nf-core linting is failing?

@mahesh-panchal
Copy link
Member

Looks like a parsing issue. I'll have a look.

@mahesh-panchal
Copy link
Member

These lines need an update it seems:
https://github.com/nf-core/tools/blob/e563811adb292b07ec933a52611e937ce9ef5481/nf_core/modules/lint/main_nf.py#L55-L68
to account for the when. The linter thinks it's still in the output block.

@mahesh-panchal
Copy link
Member

Updated linter in nf-core/tools#1397, but not sure what to do here.

edmundmiller added a commit to nf-core/nascent that referenced this pull request Apr 1, 2022
@maxulysse maxulysse closed this Jun 13, 2022
@maxulysse maxulysse deleted the master_better_index branch June 13, 2022 14:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants