Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CUDA error/SVD not converging #8

Open
zgojcic opened this issue Jun 1, 2020 · 3 comments
Open

CUDA error/SVD not converging #8

zgojcic opened this issue Jun 1, 2020 · 3 comments

Comments

@zgojcic
Copy link

zgojcic commented Jun 1, 2020

Dear authors,

thank you for making the code public. I have tried to run your method on our own data (partial point clouds of the ShapeNet cars) and have stumbled on a CUDA error as already mentioned in a previous issue.

We have tried following things to mitigate the error:

  1. As mentioned in one of the issues we have tried replacing top-k with sort().
  2. We have tried to improve the conditioning of the ill-contioned covariance-matrices by adding small constant values to the diagonal.
  3. Running the SVD on the GPU instead of the CPU.
  4. Using a newer version of pytorch (1.5). In this case there was no CUDA error did not occur but the SVD did not converge "SBDSC did not converged error"

We are wondering if you maybe have some other suggestions or know what could be done to alleviate this problem. Do you know hot other people managed to solve this issues?

Thanks for your help

Zan

@SebastianGrans
Copy link

I've also struggled with these issues. I don't remember exactly how I solved it, but the current state of my fork runs without these issues. Link

@Dengzhi-USTC
Copy link

May be your data will generate nan?

@alejandroHdzV
Copy link

I am currently facing this error, does any one know how to fix it? Thanks in advance.

Error: 'torch._C._LinAlgError: linalg.svd: The algorithm failed to converge because the input matrix is ill-conditioned or has too many repeated singular values (error code: 2).'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants