Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

WeditGAN: Few-Shot Image Generation via Latent Space Relocation

About

In few-shot image generation, directly training GAN models on just a handful of images faces the risk of overfitting. A popular solution is to transfer the models pretrained on large source domains to small target ones. In this work, we introduce WeditGAN, which realizes model transfer by editing the intermediate latent codes $w$ in StyleGANs with learned constant offsets ($\Delta w$), discovering and constructing target latent spaces via simply relocating the distribution of source latent spaces. The established one-to-one mapping between latent spaces can naturally prevents mode collapse and overfitting. Besides, we also propose variants of WeditGAN to further enhance the relocation process by regularizing the direction or finetuning the intensity of $\Delta w$. Experiments on a collection of widely used source/target datasets manifest the capability of WeditGAN in generating realistic and diverse images, which is simple yet highly effective in the research area of few-shot image generation. Codes are available at https://github.com/Ldhlwh/WeditGAN.

Yuxuan Duan, Li Niu, Yan Hong, Liqing Zhang• 2023

Related benchmarks

TaskDatasetResultRank
Few-shot Image GenerationSunglasses 10-shot
FID28.03
36
Few-shot Image GenerationBabies 10-shot
FID48.83
35
Few-shot Image GenerationAFHQ-Cat 10-shot
FID58.07
34
Few-shot Image GenerationAFHQ-Wild 10-shot
FID36.87
34
Few-shot Image GenerationMetFaces 10-shot
FID51.34
34
Few-shot Image GenerationAFHQ-Dog 10-shot
FID100.9
34
Few-shot Image GenerationSketches 10-shot
FID35.41
18
Showing 7 of 7 rows

Other info

Follow for update