Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DACS: Domain Adaptation via Cross-domain Mixed Sampling

About

Semantic segmentation models based on convolutional neural networks have recently displayed remarkable performance for a multitude of applications. However, these models typically do not generalize well when applied on new domains, especially when going from synthetic to real data. In this paper we address the problem of unsupervised domain adaptation (UDA), which attempts to train on labelled data from one domain (source domain), and simultaneously learn from unlabelled data in the domain of interest (target domain). Existing methods have seen success by training on pseudo-labels for these unlabelled images. Multiple techniques have been proposed to mitigate low-quality pseudo-labels arising from the domain shift, with varying degrees of success. We propose DACS: Domain Adaptation via Cross-domain mixed Sampling, which mixes images from the two domains along with the corresponding labels and pseudo-labels. These mixed samples are then trained on, in addition to the labelled data itself. We demonstrate the effectiveness of our solution by achieving state-of-the-art results for GTA5 to Cityscapes, a common synthetic-to-real semantic segmentation benchmark for UDA.

Wilhelm Tranheden, Viktor Olsson, Juliano Pinto, Lennart Svensson• 2020

Related benchmarks

TaskDatasetResultRank
Semantic segmentationGTA5 → Cityscapes (val)
mIoU53.8
533
Semantic segmentationSYNTHIA to Cityscapes (val)
Rider IoU82.9
435
Semantic segmentationGTA5 to Cityscapes (test)
mIoU52.1
151
Semantic segmentationSYNTHIA to Cityscapes
Road IoU80.6
150
Semantic segmentationSynthia to Cityscapes (test)
Road IoU82.1
138
Semantic segmentationCityscapes (val)
mIoU52.14
133
Semantic segmentationGTA5 to Cityscapes 1.0 (val)
Road IoU89.9
98
Semantic segmentationSYNTHIA-to-Cityscapes 16 categories (val)
mIoU (Overall)74.4
74
Semantic segmentationGTA to Cityscapes
Road IoU89.9
72
Semantic segmentationCityscapes trained on SYNTHIA (val)
Road IoU80.6
60
Showing 10 of 46 rows

Other info

Code

Follow for update