Towards Shape Biased Unsupervised Representation Learning for Domain Generalization
About
It is known that, without awareness of the process, our brain appears to focus on the general shape of objects rather than superficial statistics of context. On the other hand, learning autonomously allows discovering invariant regularities which help generalization. In this work, we propose a learning framework to improve the shape bias property of self-supervised methods. Our method learns semantic and shape biased representations by integrating domain diversification and jigsaw puzzles. The first module enables the model to create a dynamic environment across arbitrary domains and provides a domain exploration vs. exploitation trade-off, while the second module allows the model to explore this environment autonomously. This universal framework does not require prior knowledge of the domain of interest. Extensive experiments are conducted on several domain generalization datasets, namely, PACS, Office-Home, VLCS, and Digits. We show that our framework outperforms state-of-the-art domain generalization methods by a large margin.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Domain Generalization | VLCS | Accuracy75.79 | 238 | |
| Domain Generalization | PACS (test) | Average Accuracy84.46 | 225 | |
| Image Classification | PACS v1 (test) | Average Accuracy84.46 | 92 | |
| Image Classification | PACS (out-of-domain) | Overall Accuracy84.46 | 63 | |
| Domain Adaptation | SVHN to MNIST (test) | Accuracy71.7 | 53 | |
| Domain Generalization | Office-Home | Overall Average Accuracy68.8 | 34 | |
| Single-source Domain Generalization | SVHN Target from MNIST Source (test) | Accuracy53.7 | 8 |