Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Image-to-Image Translation with Disentangled Latent Vectors for Face Editing

About

We propose an image-to-image translation framework for facial attribute editing with disentangled interpretable latent directions. Facial attribute editing task faces the challenges of targeted attribute editing with controllable strength and disentanglement in the representations of attributes to preserve the other attributes during edits. For this goal, inspired by the latent space factorization works of fixed pretrained GANs, we design the attribute editing by latent space factorization, and for each attribute, we learn a linear direction that is orthogonal to the others. We train these directions with orthogonality constraints and disentanglement losses. To project images to semantically organized latent spaces, we set an encoder-decoder architecture with attention-based skip connections. We extensively compare with previous image translation algorithms and editing with pretrained GAN works. Our extensive experiments show that our method significantly improves over the state-of-the-arts.

Yusuf Dalva, Hamza Pehlivan, Cansu Moran, \"Oyk\"u Irmak Hatipo\u{g}lu, Ay\c{s}eg\"ul D\"undar• 2023

Related benchmarks

TaskDatasetResultRank
Face Attribute EditingCelebA-HQ (test)
FID19.91
56
Face Image EditingCelebA-HQ
Editing Time (s)0.284
10
Attribute EditingCelebA-HQ Setting #2 (test)
Smile FID (+)19.31
8
Style ManipulationCelebA-HQ (test)
Bangs FID (+)16.37
6
Latent-guided Style ManipulationCelebA-HQ
Bangs FID16.69
5
Reference-guided Face Attribute EditingCelebA-HQ (test)
FID (+Smile)20.6
4
Showing 6 of 6 rows

Other info

Follow for update