Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

training error #15

Open
deokisys opened this issue Jan 11, 2018 · 1 comment
Open

training error #15

deokisys opened this issue Jan 11, 2018 · 1 comment

Comments

@deokisys
Copy link

deokisys commented Jan 11, 2018

I train ./experiments/scripts/faster_rcnn_end2end.sh 0 VGG16 pascal_voc.
if just run, error message is
default
so, I fixed faster_rcnn_end2end.sh ITERS=2000000 ->500 then it worked.
big ITERS occur error
small ITERS not occur error, but it is not good learning.
error message is

Floating point exception

1 ITERS is almost spend 3s. is it good? or this error is common error?

@lsj910128
Copy link

Hi, you can decrease the base_lr in the solver.prototxt. Change the base_lr: 0.001 to 0.0001, repeating this until you find a base_lr value that work.

And the time of 1 iters is ok. Mine is 2.45/iter.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants