Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CyCADA: Cycle-Consistent Adversarial Domain Adaptation

About

Domain adaptation is critical for success in new, unseen environments. Adversarial adaptation models applied in feature spaces discover domain invariant representations, but are difficult to visualize and sometimes fail to capture pixel-level and low-level domain shifts. Recent work has shown that generative adversarial networks combined with cycle-consistency constraints are surprisingly effective at mapping images between domains, even without the use of aligned image pairs. We propose a novel discriminatively-trained Cycle-Consistent Adversarial Domain Adaptation model. CyCADA adapts representations at both the pixel-level and feature-level, enforces cycle-consistency while leveraging a task loss, and does not require aligned pairs. Our model can be applied in a variety of visual recognition and prediction settings. We show new state-of-the-art results across multiple adaptation tasks, including digit classification and semantic segmentation of road scenes demonstrating transfer from synthetic to real world domains.

Judy Hoffman, Eric Tzeng, Taesung Park, Jun-Yan Zhu, Phillip Isola, Kate Saenko, Alexei A. Efros, Trevor Darrell• 2017

Related benchmarks

TaskDatasetResultRank
Semantic segmentationCityscapes (test)
mIoU39.5
1254
Semantic segmentationCityscapes
mIoU39.3
674
Semantic segmentationGTA5 → Cityscapes (val)
mIoU42.7
586
Semantic segmentationCityscapes (val)
mIoU35.4
572
Semantic segmentationCityscapes GTA5 to Cityscapes adaptation (val)
mIoU (Overall)42.7
375
Image ClassificationOffice-Home
Average Accuracy46.1
167
Semantic segmentationGTA5 to Cityscapes (test)
mIoU42.7
151
Semantic segmentationCityscapes 1.0 (val)
mIoU38.7
110
Semantic segmentationBDD100K
mIoU37.2
105
Semantic segmentationGTA5 to Cityscapes 1.0 (val)
Road IoU86.7
98
Showing 10 of 76 rows
...

Other info

Follow for update