Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NeusFacto #1654

Merged
merged 5 commits into from
Apr 13, 2023
Merged

NeusFacto #1654

merged 5 commits into from
Apr 13, 2023

Conversation

pablovela5620
Copy link
Contributor

@pablovela5620 pablovela5620 commented Mar 24, 2023

Added NeusFacto method, about 3x faster on per train iter basis (getting 50ms v.s. 150ms on baseline neus), with set defaults took around 15 minutes to train DTU scan 65. Tangentially also fixed refine_pixsfm missing from video on ns-process-data

To download relevant data

ns-download-data sdfstudio --dataset-name sdfstudio-demo-data

to train on DTU scan 65 without monocular priors

ns-train neus-facto --pipeline.model.sdf-field.inside-outside=False sdfstudio-data --data=data/sdfstudio-demo-data/dtu-scan65

Copy link
Collaborator

@ethanweber ethanweber left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Replied to my own comments. I'll push some changes.

scripts/process_data.py Show resolved Hide resolved
scripts/process_data.py Outdated Show resolved Hide resolved
Copy link
Collaborator

@ethanweber ethanweber left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey @pablovela5620, I made some changes, and feel free to merge if you agree with everything. LGTM!

@pablovela5620 pablovela5620 merged commit 8126d47 into main Apr 13, 2023
@pablovela5620 pablovela5620 deleted the pablo/sdf_neus_facto branch April 13, 2023 00:08
@MvWouden
Copy link
Contributor

Is there any documentation on how custom data can be pre-processed for use with the (now merged) NeusFacto?

From what I could see it required different data pre-processing than e.g., nerfacto, could you confirm this?
I also tried the model on data using the sdfstudio format, but I encountered some issues.

I created an issue #1732 so others may find it as well.

chris838 pushed a commit to chris838/nerfstudio that referenced this pull request Apr 22, 2023
* add neus_facto method

* fix missing pixsfm from video process

* fix dev errors and small typos

---------

Co-authored-by: Ethan Weber <[email protected]>
lucasthahn pushed a commit to tne-ai/nerfstudio that referenced this pull request Apr 23, 2023
* add neus_facto method

* fix missing pixsfm from video process

* fix dev errors and small typos

---------

Co-authored-by: Ethan Weber <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants