Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NAN appears when training #54

Open
JesseZZZZZ opened this issue May 24, 2024 · 3 comments
Open

NAN appears when training #54

JesseZZZZZ opened this issue May 24, 2024 · 3 comments

Comments

@JesseZZZZZ
Copy link

Hi @lahavlipson , have you tried training DPVO on other datasets beside TartanAir? I tried to train it on TUM (using _build_dataset from raw RGB and depth maps), but all values became NAN, do you know the issue? (t1[0] and t2[0] are all NANs). Thank you so much!
Uploading image.png…

@JesseZZZZZ
Copy link
Author

Hi, dear authors, it turns out that the nomalization step will cause NANs in poses
image
After I delete the two lines of codes like I did in the picture, the issue disappeared. Do you think that simply deleting the codes is available? Or are there any other ways to solve this issue? THANKS!

@markinruc
Copy link

markinruc commented Oct 3, 2024

@JesseZZZZZ Hello! I met the same problem. Have you solved it?

@JesseZZZZZ
Copy link
Author

@markinruc Well, for the NAN in the image it was because some values in my depth maps are 0, and the inverse depth calculation results in NAN (1/0). Another NAN in inference is that my model was so bad....After I trained it for some epochs the NAN disappeared

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants