Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

about per-pixel gaussian allocation #54

Open
bbakpil opened this issue Jul 22, 2024 · 1 comment
Open

about per-pixel gaussian allocation #54

bbakpil opened this issue Jul 22, 2024 · 1 comment

Comments

@bbakpil
Copy link

bbakpil commented Jul 22, 2024

Hello, firstly, thanks for your awesome work.

I've got some question about the gaussian map regressing algorithm.

(1) Is it possible to allocate more than one pixel on each pixel?
(ex. high frequency region)

(2) For the high resolution (2048x2048) novel view synthesis, how is it rendered based on the original resolution (1024x1024)?
I've checked that gaussians maps are still in size of 1024x1024

@ShunyuanZheng
Copy link
Collaborator

Hi, thanks for your interest!

(1) It is a good idea to allocate more than one pixel on each pixel in high-frequency regions or merge some Gaussians in low-frequency regions. The only concern is whether the depth of such non-pixel-aligned Gaussians can be precisely adjusted according to the image frequency or the distribution of Gaussian points. I think it is worth further research. If you need any help or further discussion, please feel free to contact me.

(2) Yes, you are right. GPS-Gaussian uses two 1K-resolution Gaussian maps from both views to render 2K-resolution novel views. The learned scale map enables a higher-resolution rendering based on the binocular input with redundant information in overlapping regions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants