Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation

About

Recent studies have shown remarkable success in image-to-image translation for two domains. However, existing approaches have limited scalability and robustness in handling more than two domains, since different models should be built independently for every pair of image domains. To address this limitation, we propose StarGAN, a novel and scalable approach that can perform image-to-image translations for multiple domains using only a single model. Such a unified model architecture of StarGAN allows simultaneous training of multiple datasets with different domains within a single network. This leads to StarGAN's superior quality of translated images compared to existing models as well as the novel capability of flexibly translating an input image to any desired target domain. We empirically demonstrate the effectiveness of our approach on a facial attribute transfer and a facial expression synthesis tasks.

Yunjey Choi, Minje Choi, Munyoung Kim, Jung-Woo Ha, Sunghun Kim, Jaegul Choo• 2017

Related benchmarks

TaskDatasetResultRank
Facial Attribute ClassificationCelebA--
163
Cross-contrast MR image translationIXI (test)
MAE0.0174
17
PET Tracer SynthesisMulti-tracer Brain PET 18F-FDG to 11C-UCB-J
SSIM0.701
8
PET Tracer SynthesisMulti-tracer Brain PET 18F-FDG to 11C-PiB
SSIM0.609
8
Subject-driven generationDreamBooth random 7 subjects
Subject Fidelity42
6
Cross-contrast MR image translationBraTS 2019 (test)
MAE0.0083
6
Facial Expression SynthesisRaFD (test)
Classification Error2.12
5
Liver SegmentationCHAOS CT 2019 (test)
DICE96.65
5
Liver SegmentationCHAOS T1w 2019 (test)
DICE0.9271
5
Liver SegmentationCHAOS T2w 2019 (test)
DICE86.38
5
Showing 10 of 20 rows

Other info

Follow for update