Unsupervised Domain Adaptation via Structured Prediction Based Selective Pseudo-Labeling
About
Unsupervised domain adaptation aims to address the problem of classifying unlabeled samples from the target domain whilst labeled samples are only available from the source domain and the data distributions are different in these two domains. As a result, classifiers trained from labeled samples in the source domain suffer from significant performance drop when directly applied to the samples from the target domain. To address this issue, different approaches have been proposed to learn domain-invariant features or domain-specific classifiers. In either case, the lack of labeled samples in the target domain can be an issue which is usually overcome by pseudo-labeling. Inaccurate pseudo-labeling, however, could result in catastrophic error accumulation during learning. In this paper, we propose a novel selective pseudo-labeling strategy based on structured prediction. The idea of structured prediction is inspired by the fact that samples in the target domain are well clustered within the deep feature space so that unsupervised clustering analysis can be used to facilitate accurate pseudo-labeling. Experimental results on four datasets (i.e. Office-Caltech, Office31, ImageCLEF-DA and Office-Home) validate our approach outperforms contemporary state-of-the-art methods.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Unsupervised Domain Adaptation | Office-Home (test) | Average Accuracy71 | 332 | |
| Image Classification | Office-31 | Average Accuracy89.6 | 261 | |
| Image Classification | Office-Home | Average Accuracy71 | 142 | |
| Domain Adaptation | Office-Home | Average Accuracy65.7 | 111 | |
| Partial Domain Adaptation | Office-Home | Average Accuracy65.7 | 97 | |
| Image Classification | Office-10 + Caltech-10 | Average Accuracy93 | 77 | |
| Domain Adaptation | Image-CLEF DA (test) | Average Accuracy90.3 | 76 | |
| Domain Adaptation | Office 3-shots 31 | Accuracy (D->A)74.2 | 25 | |
| Unsupervised Domain Adaptation | Office-Home 101 (test) | Accuracy (Ar→Cl)54.5 | 17 | |
| Domain Adaptation | Office-31 1-shot | A->D Accuracy12 | 16 |