Implicit Non-Causal Factors are Out via Dataset Splitting for Domain Generalization Object Detection
About
Open world object detection faces a significant challenge in domain-invariant representation, i.e., implicit non-causal factors. Most domain generalization (DG) methods based on domain adversarial learning (DAL) pay much attention to learn domain-invariant information, but often overlook the potential non-causal factors. We unveil two critical causes: 1) The domain discriminator-based DAL method is subject to the extremely sparse domain label, i.e., assigning only one domain label to each dataset, thus can only associate explicit non-causal factor, which is incredibly limited. 2) The non-causal factors, induced by unidentified data bias, are excessively implicit and cannot be solely discerned by conventional DAL paradigm. Based on these key findings, inspired by the Granular-Ball perspective, we propose an improved DAL method, i.e., GB-DAL. The proposed GB-DAL utilizes Prototype-based Granular Ball Splitting (PGBS) module to generate more dense domains from limited datasets, akin to more fine-grained granular balls, indicating more potential non-causal factors. Inspired by adversarial perturbations akin to non-causal factors, we propose a Simulated Non-causal Factors (SNF) module as a means of data augmentation to reduce the implicitness of non-causal factors, and facilitate the training of GB-DAL. Comparative experiments on numerous benchmarks demonstrate that our method achieves better generalization performance in novel circumstances.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Object Detection | Cityscapes to Foggy Cityscapes (test) | mAP48.5 | 196 | |
| Object Detection | BDD100K (test) | -- | 48 | |
| Object Detection | Foggy Cityscapes F (test) | AP (bike)39.5 | 36 | |
| Object Detection | Cityscapes → BDD100k (test) | mAP (Overall)45.3 | 32 | |
| Object Detection | Cityscapes-C (test) | mAP (Clean)45.2 | 27 | |
| Image Classification | PACS 54 (test) | Accuracy (P Domain)97.3 | 11 | |
| Object Detection | Cityscapes (C) to Rainy Cityscapes (R) (test) | mAP53.9 | 6 | |
| Object Detection | Cityscapes (C) to Sim10K (S) (test) | mAP43.9 | 6 | |
| Object Detection | Cityscapes (C) to PASCAL VOC (P) (test) | mAP65.5 | 6 |