Semi-supervised Domain Adaptation via Minimax Entropy
About
Contemporary domain adaptation methods are very effective at aligning feature distributions of source and target domains without any target supervision. However, we show that these techniques perform poorly when even a few labeled examples are available in the target. To address this semi-supervised domain adaptation (SSDA) setting, we propose a novel Minimax Entropy (MME) approach that adversarially optimizes an adaptive few-shot model. Our base model consists of a feature encoding network, followed by a classification layer that computes the features' similarity to estimated prototypes (representatives of each class). Adaptation is achieved by alternately maximizing the conditional entropy of unlabeled target data with respect to the classifier and minimizing it with respect to the feature encoder. We empirically demonstrate the superiority of our method over many baselines, including conventional feature alignment and few-shot methods, setting a new state of the art for SSDA.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Semantic segmentation | GTA5 → Cityscapes (val) | mIoU64.2 | 533 | |
| Semantic segmentation | Cityscapes (val) | mIoU67.9 | 332 | |
| Unsupervised Domain Adaptation | Office-Home | Average Accuracy49.2 | 238 | |
| Image Classification | Office-Home (test) | Mean Accuracy62.7 | 199 | |
| Object Detection | Cityscapes to Foggy Cityscapes (test) | mAP48.86 | 196 | |
| Domain Adaptation | Office-Home | Average Accuracy67.3 | 111 | |
| Object Detection | Sim10K → Cityscapes (test) | -- | 104 | |
| Object Detection | Pascal VOC -> Clipart (test) | mAP43.93 | 78 | |
| Domain Adaptation | Office31 (test) | Mean Accuracy76.95 | 74 | |
| Image Classification | DomainNet | Average Accuracy66.4 | 58 |