One-Sided Unsupervised Domain Mapping
About
In unsupervised domain mapping, the learner is given two unmatched datasets $A$ and $B$. The goal is to learn a mapping $G_{AB}$ that translates a sample in $A$ to the analog sample in $B$. Recent approaches have shown that when learning simultaneously both $G_{AB}$ and the inverse mapping $G_{BA}$, convincing mappings are obtained. In this work, we present a method of learning $G_{AB}$ without learning $G_{BA}$. This is done by learning a mapping that maintains the distance between a pair of samples. Moreover, good mappings are obtained, even by maintaining the distance between different parts of the same sample before and after mapping. We present experimental results that the new method not only allows for one sided mapping learning, but also leads to preferable numerical results over the existing circularity-based constraint. Our entire code is made publicly available at https://github.com/sagiebenaim/DistanceGAN .
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Semantic Image Synthesis | ADE20K | FID80 | 66 | |
| Semantic Image Synthesis | Cityscapes | FID78 | 54 | |
| Semantic Image Synthesis | COCO Stuff | FID92.4 | 40 | |
| Image-to-Image Translation | edges -> handbags (test) | FID26.5 | 15 | |
| Image-to-Image Translation | Cityscapes | FID78.8 | 14 | |
| Unpaired Image-to-Image Translation | Cat → Dog v1 (test) | FID144.4 | 14 | |
| Unpaired Image-to-Image Translation | Horse-to-Zebra | FID67.2 | 8 | |
| Unpaired Image-to-Image Translation | Cityscapes | Pixel Accuracy47.2 | 8 |