Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Source-Free Domain Adaptation for Semantic Segmentation

About

Unsupervised Domain Adaptation (UDA) can tackle the challenge that convolutional neural network(CNN)-based approaches for semantic segmentation heavily rely on the pixel-level annotated data, which is labor-intensive. However, existing UDA approaches in this regard inevitably require the full access to source datasets to reduce the gap between the source and target domains during model adaptation, which are impractical in the real scenarios where the source datasets are private, and thus cannot be released along with the well-trained source models. To cope with this issue, we propose a source-free domain adaptation framework for semantic segmentation, namely SFDA, in which only a well-trained source model and an unlabeled target domain dataset are available for adaptation. SFDA not only enables to recover and preserve the source domain knowledge from the source model via knowledge transfer during model adaptation, but also distills valuable information from the target domain for self-supervised learning. The pixel- and patch-level optimization objectives tailored for semantic segmentation are seamlessly integrated in the framework. The extensive experimental results on numerous benchmark datasets highlight the effectiveness of our framework against the existing UDA approaches relying on source data.

Yuang Liu, Wei Zhang, Jun Wang• 2021

Related benchmarks

TaskDatasetResultRank
Semantic segmentationGTA5 → Cityscapes (val)
mIoU45.8
586
Semantic segmentationSYNTHIA to Cityscapes (val)
Rider IoU27.3
480
Semantic segmentationGTA5 to Cityscapes (test)
mIoU45.8
151
Semantic segmentationGTA5 to Cityscapes 1.0 (val)
Road IoU84.2
98
Semantic segmentationSYNTHIA-to-Cityscapes 16 categories (val)
mIoU (Overall)42.4
74
Load forecastingGEFCom
MAPE7.498
67
Semantic segmentationStanford2D3D
mIoU54.76
32
Semantic segmentationDensePASS C-to-D (val)
mIoU42.7
15
Surgical Instrument SegmentationEndovis17 to Endovis18 1.0 (target)
Scissor IoU66.05
14
Photovoltaic power predictionSolarPV
MAE1.214
13
Showing 10 of 14 rows

Other info

Follow for update