Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Few-shot Image Generation via Cross-domain Correspondence

About

Training generative models, such as GANs, on a target domain containing limited examples (e.g., 10) can easily result in overfitting. In this work, we seek to utilize a large source domain for pretraining and transfer the diversity information from source to target. We propose to preserve the relative similarities and differences between instances in the source via a novel cross-domain distance consistency loss. To further reduce overfitting, we present an anchor-based strategy to encourage different levels of realism over different regions in the latent space. With extensive results in both photorealistic and non-photorealistic domains, we demonstrate qualitatively and quantitatively that our few-shot model automatically discovers correspondences between source and target domains and generates more diverse and realistic images than previous methods.

Utkarsh Ojha, Yijun Li, Jingwan Lu, Alexei A. Efros, Yong Jae Lee, Eli Shechtman, Richard Zhang• 2021

Related benchmarks

TaskDatasetResultRank
Anomaly GenerationMVTec 1 (test)
Image Similarity (IS)2.1
112
Few-shot Image GenerationSunglasses 10-shot
FID41.45
36
Few-shot Image GenerationBabies 10-shot
FID69.13
35
Few-shot Image GenerationMetFaces 10-shot
FID65.45
34
Few-shot Image GenerationAFHQ-Dog 10-shot
FID170.9
34
Few-shot Image GenerationAFHQ-Cat 10-shot
FID176.2
34
Few-shot Image GenerationAFHQ-Wild 10-shot
FID135.1
34
Few-shot Image GenerationSketches 10-shot
FID47.62
18
Image GenerationAFHQ Cat
FID174.5
18
Few-shot Image GenerationAFHQ Cat
KID196.6
12
Showing 10 of 36 rows

Other info

Follow for update