MLNet: Mutual Learning Network with Neighborhood Invariance for Universal Domain Adaptation
About
Universal domain adaptation (UniDA) is a practical but challenging problem, in which information about the relation between the source and the target domains is not given for knowledge transfer. Existing UniDA methods may suffer from the problems of overlooking intra-domain variations in the target domain and difficulty in separating between the similar known and unknown class. To address these issues, we propose a novel Mutual Learning Network (MLNet) with neighborhood invariance for UniDA. In our method, confidence-guided invariant feature learning with self-adaptive neighbor selection is designed to reduce the intra-domain variations for more generalizable feature representation. By using the cross-domain mixup scheme for better unknown-class identification, the proposed method compensates for the misidentified known-class errors by mutual learning between the closed-set and open-set classifiers. Extensive experiments on three publicly available benchmarks demonstrate that our method achieves the best results compared to the state-of-the-arts in most cases and significantly outperforms the baseline across all the four settings in UniDA. Code is available at https://github.com/YanzuoLu/MLNet.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Domain Adaptation | Office-31 | Accuracy (A -> W)91 | 156 | |
| Open-Partial-Set Domain Adaptation | Office-31 OPDA | Accuracy (A->D)90.4 | 38 | |
| Domain Adaptation | Office-10 (test) | Acc (A->W)84.6 | 21 | |
| Partial Domain Adaptation | Office-Home PDA protocol (first 25 categories) | Accuracy A:C65 | 15 | |
| Open Partial Domain Adaptation | OfficeHome 10/5/50 v1.0 | A2C Acc68.2 | 11 | |
| Open Partial Domain Adaptation | VisDA 6 shared, 3 source-private, 3 unknown classes 2017 | H-score69.9 | 11 | |
| Domain Adaptation | VisDA PDA (6 shared, 6 source-private, 0 target-private) | Accuracy80.4 | 10 | |
| Open Set Domain Adaptation | Office (10/0/11) | Accuracy (A->D)93 | 9 | |
| Open Set Domain Adaptation | OfficeHome 25/0/40 | A2C Accuracy61.3 | 9 | |
| Open Set Domain Adaptation | VisDA 6/0/6 | H-score63.9 | 9 |