Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Double InfoGAN for Contrastive Analysis

About

Contrastive Analysis (CA) deals with the discovery of what is common and what is distinctive of a target domain compared to a background one. This is of great interest in many applications, such as medical imaging. Current state-of-the-art (SOTA) methods are latent variable models based on VAE (CA-VAEs). However, they all either ignore important constraints or they don't enforce fundamental assumptions. This may lead to sub-optimal solutions where distinctive factors are mistaken for common ones (or viceversa). Furthermore, the generated images have a rather poor quality, typical of VAEs, decreasing their interpretability and usefulness. Here, we propose Double InfoGAN, the first GAN based method for CA that leverages the high-quality synthesis of GAN and the separation power of InfoGAN. Experimental results on four visual datasets, from simple synthetic examples to complex medical images, show that the proposed method outperforms SOTA CA-VAEs in terms of latent separation and image quality. Datasets and code are available online.

Florence Carton, Robin Louiset, Pietro Gori• 2024

Related benchmarks

TaskDatasetResultRank
Attribute SwappingFFHQ Swap X to Y high-quality (test)
ID Similarity0.158
7
Attribute SwappingFFHQ Swap Y to X high-quality (test)
ID-Sim0.153
7
Image ReconstructionFFHQ X dataset high-quality (test)
LPIPS0.369
7
Image ReconstructionFFHQ Y dataset high-quality (test)
LPIPS0.361
7
Latent Factor SeparationFFHQ No Glasses vs. Glasses
C Score0.65
4
Latent Factor SeparationFFHQ Head Pose: Frontal vs. Right/Left
C Metric0.71
4
Latent Factor SeparationFFHQ Male vs. Female
C Score0.6
4
Latent Factor SeparationFFHQ Smile vs. Non-Smiling
C Score0.64
4
Common and Salient SeparationBraTS
Delta (Δ)0.42
3
Common and Salient SeparationCelebA-HQ Gender
Delta Separation Score0.4
3
Showing 10 of 24 rows

Other info

Follow for update