Spectral Normalization for Generative Adversarial Networks
About
One of the challenges in the study of generative adversarial networks is the instability of its training. In this paper, we propose a novel weight normalization technique called spectral normalization to stabilize the training of the discriminator. Our new normalization technique is computationally light and easy to incorporate into existing implementations. We tested the efficacy of spectral normalization on CIFAR10, STL-10, and ILSVRC2012 dataset, and we experimentally confirmed that spectrally normalized GANs (SN-GANs) is capable of generating images of better or equal quality relative to the previous training stabilization techniques.
Takeru Miyato, Toshiki Kataoka, Masanori Koyama, Yuichi Yoshida• 2018
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Generation | CIFAR-10 (test) | FID11.8 | 471 | |
| Unconditional Image Generation | CIFAR-10 (test) | FID17.19 | 216 | |
| Image Generation | CIFAR-10 | Inception Score8.38 | 178 | |
| Unconditional Image Generation | CIFAR-10 unconditional | FID21.7 | 159 | |
| Image Generation | CIFAR10 32x32 (test) | FID19.73 | 154 | |
| Image Generation | CelebA | FID7.62 | 110 | |
| Unconditional Generation | CIFAR-10 (test) | FID21.7 | 102 | |
| Image Generation | CIFAR-10 (train/test) | FID21.7 | 78 | |
| Image Generation | ImageNet | FID26.79 | 68 | |
| Image Generation | STL-10 | FID40.15 | 66 |
Showing 10 of 61 rows