Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Unsupervised Attention-guided Image to Image Translation

About

Current unsupervised image-to-image translation techniques struggle to focus their attention on individual objects without altering the background or the way multiple objects interact within a scene. Motivated by the important role of attention in human perception, we tackle this limitation by introducing unsupervised attention mechanisms that are jointly adversarialy trained with the generators and discriminators. We demonstrate qualitatively and quantitatively that our approach is able to attend to relevant regions in the image without requiring supervision, and that by doing so it achieves more realistic mappings compared to recent approaches.

Youssef A. Mejjati, Christian Richardt, James Tompkin, Darren Cosker, Kwang In Kim• 2018

Related benchmarks

TaskDatasetResultRank
Image-to-Image Translationselfie2anime
KID14.63
11
Image-to-Image Translationanime2selfie
KID12.72
10
Image-to-Image Translationportrait2photo
KID2.19
10
Unpaired Image-to-Image Translation (Apple to Orange)Apple2Orange (test)
KID0.0644
8
Unpaired Image-to-Image Translation (Horse to Zebra)Horse2Zebra (test)
KID (x100)6.93
8
Unpaired Image-to-Image Translation (Orange to Apple)Apple2Orange (test)
KID0.0532
8
Unpaired Image-to-Image Translation (Zebra to Horse)Horse2Zebra (test)
KID (x100)8.87
8
Image-to-Image Translationhorse2zebra
KID7.58
6
Image-to-Image Translationdog2cat
KID9.45
6
Image-to-Image Translationzebra2horse
KID8.8
6
Showing 10 of 14 rows

Other info

Follow for update