Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Bidirectional Learning for Domain Adaptation of Semantic Segmentation

About

Domain adaptation for semantic image segmentation is very necessary since manually labeling large datasets with pixel-level labels is expensive and time consuming. Existing domain adaptation techniques either work on limited datasets, or yield not so good performance compared with supervised learning. In this paper, we propose a novel bidirectional learning framework for domain adaptation of segmentation. Using the bidirectional learning, the image translation model and the segmentation adaptation model can be learned alternatively and promote to each other. Furthermore, we propose a self-supervised learning algorithm to learn a better segmentation adaptation model and in return improve the image translation model. Experiments show that our method is superior to the state-of-the-art methods in domain adaptation of segmentation with a big margin. The source code is available at https://github.com/liyunsheng13/BDL.

Yunsheng Li, Lu Yuan, Nuno Vasconcelos• 2019

Related benchmarks

TaskDatasetResultRank
Semantic segmentationCityscapes (val)
mIoU48.5
572
Semantic segmentationGTA5 → Cityscapes (val)
mIoU48.5
533
Semantic segmentationSYNTHIA to Cityscapes (val)
Rider IoU73.7
435
Semantic segmentationCityscapes GTA5 to Cityscapes adaptation (val)
mIoU (Overall)48.5
352
Facial Landmark Detection300-W (Common)
NME2.99
180
Facial Landmark Detection300W (Challenging)
NME5.32
159
Semantic segmentationGTA5 to Cityscapes (test)
mIoU48.5
151
Semantic segmentationSYNTHIA to Cityscapes
Road IoU86
150
Semantic segmentationSynthia to Cityscapes (test)
Road IoU86
138
Semantic segmentationCityscapes (val)
mIoU48.5
133
Showing 10 of 50 rows

Other info

Code

Follow for update