Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Source-Free Domain Adaptation for Semantic Segmentation

About

Unsupervised Domain Adaptation (UDA) can tackle the challenge that convolutional neural network(CNN)-based approaches for semantic segmentation heavily rely on the pixel-level annotated data, which is labor-intensive. However, existing UDA approaches in this regard inevitably require the full access to source datasets to reduce the gap between the source and target domains during model adaptation, which are impractical in the real scenarios where the source datasets are private, and thus cannot be released along with the well-trained source models. To cope with this issue, we propose a source-free domain adaptation framework for semantic segmentation, namely SFDA, in which only a well-trained source model and an unlabeled target domain dataset are available for adaptation. SFDA not only enables to recover and preserve the source domain knowledge from the source model via knowledge transfer during model adaptation, but also distills valuable information from the target domain for self-supervised learning. The pixel- and patch-level optimization objectives tailored for semantic segmentation are seamlessly integrated in the framework. The extensive experimental results on numerous benchmark datasets highlight the effectiveness of our framework against the existing UDA approaches relying on source data.

Yuang Liu, Wei Zhang, Jun Wang• 2021

Related benchmarks

TaskDatasetResultRank
Semantic segmentationGTA5 → Cityscapes (val)
mIoU45.8
533
Semantic segmentationSYNTHIA to Cityscapes (val)
Rider IoU27.3
435
Semantic segmentationGTA5 to Cityscapes (test)
mIoU45.8
151
Semantic segmentationGTA5 to Cityscapes 1.0 (val)
Road IoU84.2
98
Semantic segmentationSYNTHIA-to-Cityscapes 16 categories (val)
mIoU (Overall)42.4
74
Semantic segmentationStanford2D3D
mIoU54.76
32
Surgical Instrument SegmentationEndovis17 to Endovis18 1.0 (target)
Scissor IoU66.05
14
Semantic segmentationSynPASS-to-DensePASS (S-to-D) target 1.0 (test)
mIoU38.21
11
Panoramic Semantic SegmentationCityscapes-to-DensePASS (test)
mIoU42.7
10
Showing 9 of 9 rows

Other info

Follow for update