Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Experiments on the 3DGS #62

Closed
JuntingLee opened this issue Sep 12, 2024 · 2 comments
Closed

Experiments on the 3DGS #62

JuntingLee opened this issue Sep 12, 2024 · 2 comments

Comments

@JuntingLee
Copy link

Hi,
Congratualtion for your work!

I am trying to test the result of 3DGS under different input views. As the shared code has input of 16 views, do you think 3DGS will also benefit from more inputs when compared with GPS-GS.

When I tested some val samples in 3dgs, I found some ones such 0000 can not get valid result during the matching process of the colmap. I think it may be due to almost textureless clothes in these samples.
In addition, for some samples that can succsesfully get camera parameter from colmap, I found the intrinsic parameter is a little bit diferent from the orginal image size 1024*1024.

I think you can directly use the camera parameter from your rendering code to train 3DGS per scene, so that you will not meet the two issue mentioned above. It would be appreciated if you could share the dataloader for 3DGS.

Looking forward to your reply~

@ShunyuanZheng
Copy link
Collaborator

ShunyuanZheng commented Sep 12, 2024

Hi, thanks for your interest.

I think 16 camera views are still too sparse for original 3DGS.

On our synthetic data, you can use real camera parameters rather than those estimated from COLMAP. Maybe 16 cameras is also challenging for COLMAP, especially on textureless clothes.

You can try our modified 3D-GS code static_3dgs_batch.zip. However, I think the data should be reorganized as the example data example_data.zip. I have not used this code for a long time, so there may be some bugs on the reading file path. You can build a 3DGS model for each static human or each frame by running run_bash.sh.

@JuntingLee
Copy link
Author

Hi, thanks for your interest.

I think 16 camera views are still too sparse for original 3DGS.

On our synthetic data, you can use real camera parameters rather than those estimated from COLMAP. Maybe 16 cameras is also challenging for COLMAP, especially on textureless clothes.

You can try our modified 3D-GS code static_3dgs_batch.zip. However, I think the data should be reorganized as the example data example_data.zip. I have not used this code for a long time, so there may be some bugs on the reading file path. You can build a 3DGS model for each static human or each frame by running run_bash.sh.

Hi, Shunyuan!

Thanks for reply so quickly!
We appreciate for your opinions and code about 3DGS! It helps a lot.

Best Regards,
Junting

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants