Drop to Adapt: Learning Discriminative Features for Unsupervised Domain Adaptation
About
Recent works on domain adaptation exploit adversarial training to obtain domain-invariant feature representations from the joint learning of feature extractor and domain discriminator networks. However, domain adversarial methods render suboptimal performances since they attempt to match the distributions among the domains without considering the task at hand. We propose Drop to Adapt (DTA), which leverages adversarial dropout to learn strongly discriminative features by enforcing the cluster assumption. Accordingly, we design objective functions to support robust domain adaptation. We demonstrate efficacy of the proposed method on various experiments and achieve consistent improvements in both image classification and semantic segmentation tasks. Our source code is available at https://github.com/postBG/DTA.pytorch.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Semantic segmentation | Cityscapes GTA5 to Cityscapes adaptation (val) | mIoU (Overall)35.8 | 352 | |
| Object Classification | VisDA synthetic-to-real 2017 | Mean Accuracy81.5 | 91 | |
| Image Classification | VisDA 2017 (test) | Class Accuracy (Plane)93.7 | 83 | |
| Image Classification | VisDA-C (test) | Mean Accuracy81.5 | 76 | |
| Image Classification | SVHN to MNIST (test) | Accuracy99.4 | 66 | |
| Image Classification | MNIST -> USPS (test) | Accuracy99.5 | 64 | |
| Image Classification | USPS -> MNIST (test) | Accuracy99.1 | 63 | |
| Classification | VisDA 2017 (val) | Mean Accuracy81.5 | 45 | |
| Image Classification | STL to CIFAR standard (test) | Accuracy72.8 | 39 | |
| Image Classification | CIFAR to STL standard (test) | Accuracy82.6 | 35 |