Few-shot Image Generation via Cross-domain Correspondence
About
Training generative models, such as GANs, on a target domain containing limited examples (e.g., 10) can easily result in overfitting. In this work, we seek to utilize a large source domain for pretraining and transfer the diversity information from source to target. We propose to preserve the relative similarities and differences between instances in the source via a novel cross-domain distance consistency loss. To further reduce overfitting, we present an anchor-based strategy to encourage different levels of realism over different regions in the latent space. With extensive results in both photorealistic and non-photorealistic domains, we demonstrate qualitatively and quantitatively that our few-shot model automatically discovers correspondences between source and target domains and generates more diverse and realistic images than previous methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Anomaly Generation | MVTec 1 (test) | Image Similarity (IS)2.1 | 112 | |
| Few-shot Image Generation | Sunglasses 10-shot | FID41.45 | 36 | |
| Few-shot Image Generation | Babies 10-shot | FID69.13 | 35 | |
| Few-shot Image Generation | MetFaces 10-shot | FID65.45 | 34 | |
| Few-shot Image Generation | AFHQ-Dog 10-shot | FID170.9 | 34 | |
| Few-shot Image Generation | AFHQ-Cat 10-shot | FID176.2 | 34 | |
| Few-shot Image Generation | AFHQ-Wild 10-shot | FID135.1 | 34 | |
| Few-shot Image Generation | Sketches 10-shot | FID47.62 | 18 | |
| Image Generation | AFHQ Cat | FID174.5 | 18 | |
| Few-shot Image Generation | AFHQ Cat | KID196.6 | 12 |