Boundless: Generative Adversarial Networks for Image Extension
About
Image extension models have broad applications in image editing, computational photography and computer graphics. While image inpainting has been extensively studied in the literature, it is challenging to directly apply the state-of-the-art inpainting methods to image extension as they tend to generate blurry or repetitive pixels with inconsistent semantics. We introduce semantic conditioning to the discriminator of a generative adversarial network (GAN), and achieve strong results on image extension with coherent semantics and visually pleasing colors and textures. We also show promising results in extreme extensions, such as panorama generation.
Piotr Teterwak, Aaron Sarna, Dilip Krishnan, Aaron Maschinot, David Belanger, Ce Liu, William T. Freeman• 2019
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Outpainting (Right 50%) | Places2 | FID7.8 | 5 | |
| Image Extension | Places365 25% extension (held-out set of 500 images) | FID0.79 | 4 | |
| Image Extension | Places365 held-out set of 500 images (50% extension) | FID3.46 | 4 | |
| Image Extension | Places365 75% extension (held-out set of 500 images) | FID8.79 | 4 | |
| Image Inpainting | Places365 Inpainting (held-out set of 500 images) | FID2.53 | 4 | |
| Image Uncropping | Places2 scenery categories 10k (val) | FID12.7 | 3 | |
| Uncropping | Places2 top-50 categories | FID28.3 | 3 | |
| Uncropping | ImageNet (val) | FID18.7 | 3 | |
| Uncropping | Places2 (val) | FID11.8 | 3 |
Showing 9 of 9 rows