Exploring Dualistic Meta-Learning to Enhance Domain Generalization in Open Set Scenarios
About
Domain generalization learns from multiple source domains to generalize to unseen target domains. However, it often neglects the realistic case of label mismatch between source and target. Open set domain generalization is then proposed to recognize unseen classes in unseen domains. A simple approach trains one-vs-all classifiers to separate each class and detect outliers as unknown. Yet, the imbalance between few positive samples and many negative samples skews the decision boundary towards the positive ones, leading the model to over-reject out-of-distribution data, even from known classes in unseen domains. In this paper, we propose a novel meta-learning stategy called dualistic MEta-learning with joint DomaIn-Class matching (MEDIC), which considers implicit gradient matching towards inter-domain and inter-class task splits simultaneously to find optimal boundaries balanced for both domains and classes. Experimental results show that MEDIC not only outperforms prior methods in open set scenarios, but also maintains competitive close set generalization ability.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Single-source Domain Generalization | PACS (test) | Average Domain Transfer Accuracy72.2 | 30 | |
| Domain Generalization | DomainNet | Clipart Accuracy73.38 | 26 | |
| Domain Generalization | DomainBed | CMST Accuracy52.4 | 14 | |
| Open Set Domain Generalization | PACS ResNet50 (test) | Photo Accuracy97.58 | 12 | |
| Open Set Domain Generalization | PACS (test) | Photo Accuracy98.06 | 10 | |
| Open Set Domain Generalization | Digits-DG MNIST (test) | Accuracy98.44 | 10 | |
| Open Set Domain Generalization | Digits-DG SYN (test) | Accuracy88.11 | 10 | |
| Open Set Domain Generalization | Digits-DG SVHN (test) | Accuracy77.31 | 10 | |
| Open Set Domain Generalization | Digits-DG MNIST-M (test) | Accuracy73.14 | 10 | |
| Partial Class Domain Generalization | PACS | Accuracy (Photo)96.3 | 5 |