Checkerboard pattern in decoder output for 256x256 input

[zimonitrome]

Hello!
I am currently using the discriminator only in a custom GAN but I am often noticing that the decoder output produces checkerboard patterns. Even when useful information is seen, the checkerboard appears on top.

[zimonitrome]

Note: This is however without CutMix regularization.

[lucidrains]

@zimonitrome are you using your own custom generator?

[zimonitrome]

@lucidrains Yes, I am using a U-Net generator as a cGAN. I tried adding both CutMix and gradient penalty (instead of previously using spectral normalization) but some networks just seem to collapse very quickly. I get that this is not really your concern since I am using a lot of custom setup 😛 but I was interested if you had noticed something similar with larger resolutions.