Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Loss of WGAN does not converge #5

Open
Curry-whs opened this issue Oct 9, 2021 · 2 comments
Open

Loss of WGAN does not converge #5

Curry-whs opened this issue Oct 9, 2021 · 2 comments

Comments

@Curry-whs
Copy link

The loss curve of my WGAN does not converge all the time, and I do not know why. Could anyone help me?I have changed the whole model many times, and the best result is that it starts to converge and collapse at 250peochs,the loss curve just like this :
c13d00bce75dd2d7390953e332db4bb
adfbee48d8597e10b59ba6399f40889

my code looks like this:
image
image
image
image
image
image
image
image

So how to solve this problem?

@tf2gan
Copy link

tf2gan commented May 21, 2022

Have you solved the problem? My WGAN loss is also not convergent

@senu-et
Copy link

senu-et commented Sep 17, 2022

Gradient clipping instead of weight clipping

for WGAN model all the gradients should clip to (-0.01,0.01)

    for idx,grad in enumerate(gradients_of_d) :
        gradients_of_d[idx]=tf.clip_by_value(grad,-0.01,0.01)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants