Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Alias-Free Generative Adversarial Networks

About

We observe that despite their hierarchical convolutional nature, the synthesis process of typical generative adversarial networks depends on absolute pixel coordinates in an unhealthy manner. This manifests itself as, e.g., detail appearing to be glued to image coordinates instead of the surfaces of depicted objects. We trace the root cause to careless signal processing that causes aliasing in the generator network. Interpreting all signals in the network as continuous, we derive generally applicable, small architectural changes that guarantee that unwanted information cannot leak into the hierarchical synthesis process. The resulting networks match the FID of StyleGAN2 but differ dramatically in their internal representations, and they are fully equivariant to translation and rotation even at subpixel scales. Our results pave the way for generative models better suited for video and animation.

Tero Karras, Miika Aittala, Samuli Laine, Erik H\"ark\"onen, Janne Hellsten, Jaakko Lehtinen, Timo Aila• 2021

Related benchmarks

TaskDatasetResultRank
Image GenerationFFHQ
FID2.79
91
Image GenerationCIFAR-10 (train/test)
FID10.83
78
Image GenerationFFHQ
FID3.8
70
Image GenerationFFHQ 256x256 (test)
FID3.92
30
Spatiotemporal Field ReconstructionNavier-Stokes (Full)
CRPS2.176
30
Spatiotemporal Field ReconstructionNavier-Stokes 10% Subset
CRPS2.6354
30
Spatiotemporal forecastingAirDelhi AD-B
CRPS33.135
10
Image SynthesisFFHQ 1024x1024 (train test)
FID2.79
9
Medical Image GenerationSLIVER 07--
8
Image GenerationFFHQ 1024x1024 50k (test)
FID2.7
7
Showing 10 of 11 rows

Other info

Follow for update