Implicit Class-Conditioned Domain Alignment for Unsupervised Domain Adaptation
About
We present an approach for unsupervised domain adaptation---with a strong focus on practical considerations of within-domain class imbalance and between-domain class distribution shift---from a class-conditioned domain alignment perspective. Current methods for class-conditioned domain alignment aim to explicitly minimize a loss function based on pseudo-label estimations of the target domain. However, these methods suffer from pseudo-label bias in the form of error accumulation. We propose a method that removes the need for explicit optimization of model parameters from pseudo-labels directly. Instead, we present a sampling-based implicit alignment approach, where the sample selection procedure is implicitly guided by the pseudo-labels. Theoretical analysis reveals the existence of a domain-discriminator shortcut in misaligned classes, which is addressed by the proposed implicit alignment approach to facilitate domain-adversarial learning. Empirical results and ablation studies confirm the effectiveness of the proposed approach, especially in the presence of within-domain class imbalance and between-domain class distribution shift.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Unsupervised Domain Adaptation | Office-Home (test) | Average Accuracy69.5 | 332 | |
| Unsupervised Domain Adaptation | Office-Home | Average Accuracy69.5 | 238 | |
| Domain Adaptation | Office-31 unsupervised adaptation standard | Accuracy (A to W)90.3 | 162 | |
| Domain Adaptation | Office-Home | Average Accuracy69.5 | 111 | |
| Domain Adaptation | VisDA 2017 (test) | Mean Class Accuracy75.8 | 98 | |
| Unsupervised Domain Adaptation | VisDA unsupervised domain adaptation 2017 | Mean Accuracy75.8 | 87 | |
| Domain Adaptation | Office 3-shots 31 | Accuracy (D->A)67.9 | 25 | |
| Domain Adaptation | DomainNet target | R->C Accuracy41.4 | 22 | |
| Unsupervised Domain Adaptation | Office-Home (train test) | Ar -> Cl Accuracy56 | 22 | |
| Image Classification | Blended-Office-Home-LMT ResNet-50 (test) | Accuracy (Clipart)61.9 | 18 |