Vector-Decomposed Disentanglement for Domain-Invariant Object Detection
About
To improve the generalization of detectors, for domain adaptive object detection (DAOD), recent advances mainly explore aligning feature-level distributions between the source and single-target domain, which may neglect the impact of domain-specific information existing in the aligned features. Towards DAOD, it is important to extract domain-invariant object representations. To this end, in this paper, we try to disentangle domain-invariant representations from domain-specific representations. And we propose a novel disentangled method based on vector decomposition. Firstly, an extractor is devised to separate domain-invariant representations from the input, which are used for extracting object proposals. Secondly, domain-specific representations are introduced as the differences between the input and domain-invariant representations. Through the difference operation, the gap between the domain-specific and domain-invariant representations is enlarged, which promotes domain-invariant representations to contain more domain-irrelevant information. In the experiment, we separately evaluate our method on the single- and compound-target case. For the single-target case, experimental results of four domain-shift scenes show our method obtains a significant performance gain over baseline methods. Moreover, for the compound-target case (i.e., the target is a compound of two different domains without domain labels), our method outperforms baseline methods by around 4%, which demonstrates the effectiveness of our method.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Object Detection | Cityscapes to Foggy Cityscapes (test) | mAP40 | 196 | |
| Object Detection | Foggy Cityscapes (test) | AP (Person)33.4 | 161 | |
| Object Detection | Cityscapes -> Foggy Cityscapes | mAP40 | 73 | |
| Object Detection | PASCAL VOC to Water Color (test) | mAP56.6 | 64 | |
| Object Detection | VOC to Watercolor (target) | mAP56.6 | 31 | |
| Object Detection | Watercolor (test) | Bike Prediction Error90 | 28 | |
| Object Detection | Daytime Clear to Night Clear | AP (Bus)35.4 | 8 |