Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Validation and testing results are not good #18

Open
chienyiwang opened this issue Feb 8, 2022 · 7 comments
Open

Validation and testing results are not good #18

chienyiwang opened this issue Feb 8, 2022 · 7 comments

Comments

@chienyiwang
Copy link

chienyiwang commented Feb 8, 2022

Hi,
Thanks for the great work and kind release of the implementation. I followed the modification in Issue#16 and could train the model with your default .yml file. However, the validation and testing results are not good visually (using ckpt at epoch 500k/600k/...). Most of them are blurry and some of them even only contains background. The training losses are decreasing, but the coarse loss of validation set is not. Could you please provide some suggestions about how to tune the parameters or fix the model training? Thanks a lot!

The validation results and loss curves from tensorboard snapshots are attached below:
test_result
train_loss

@chienyiwang
Copy link
Author

I accidentally set "no_ndc" to "False" in the previous experiments... After setting back "no_ndc" to "True", the results are getting much better now.
result
loss

@chienyiwang
Copy link
Author

If possible, could you elaborate more on the choice of "no_ndc"? Is it heavily dependent on the input format or just empirical? Thanks a lot!

@cjerry1243
Copy link

I am not able to get the results with the same quality as the paper either.

@Alpe6825
Copy link

Alpe6825 commented Oct 5, 2022

I accidentally set "no_ndc" to "False" in the previous experiments... After setting back "no_ndc" to "True", the results are getting much better now. result loss

I get similar results even if no_ndc is true.

@jianweif
Copy link

jianweif commented Dec 1, 2022

Same here. Trained with person_1's data and config. Training psnr gradually reaches 32 while validation psnr plateaus at 20. Would really appreciate if author can help here!

@Volleria
Copy link

Volleria commented Apr 8, 2023

Hi, Thanks for the great work and kind release of the implementation. I followed the modification in Issue#16 and could train the model with your default .yml file. However, the validation and testing results are not good visually (using ckpt at epoch 500k/600k/...). Most of them are blurry and some of them even only contains background. The training losses are decreasing, but the coarse loss of validation set is not. Could you please provide some suggestions about how to tune the parameters or fix the model training? Thanks a lot!

The validation results and loss curves from tensorboard snapshots are attached below: test_result train_loss

Hi!How did you get these charts?

@wuzuyin
Copy link

wuzuyin commented Nov 14, 2023

Same here. Trained with person_1's data and config. Training psnr gradually reaches 32 while validation psnr plateaus at 20. Would really appreciate if author can help here!

Hello, I have also encountered the same problem. Have you resolved it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants