Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SRCD: Semantic Reasoning with Compound Domains for Single-Domain Generalized Object Detection

About

This paper provides a novel framework for single-domain generalized object detection (i.e., Single-DGOD), where we are interested in learning and maintaining the semantic structures of self-augmented compound cross-domain samples to enhance the model's generalization ability. Different from DGOD trained on multiple source domains, Single-DGOD is far more challenging to generalize well to multiple target domains with only one single source domain. Existing methods mostly adopt a similar treatment from DGOD to learn domain-invariant features by decoupling or compressing the semantic space. However, there may have two potential limitations: 1) pseudo attribute-label correlation, due to extremely scarce single-domain data; and 2) the semantic structural information is usually ignored, i.e., we found the affinities of instance-level semantic relations in samples are crucial to model generalization. In this paper, we introduce Semantic Reasoning with Compound Domains (SRCD) for Single-DGOD. Specifically, our SRCD contains two main components, namely, the texture-based self-augmentation (TBSA) module, and the local-global semantic reasoning (LGSR) module. TBSA aims to eliminate the effects of irrelevant attributes associated with labels, such as light, shadow, color, etc., at the image level by a light-yet-efficient self-augmentation. Moreover, LGSR is used to further model the semantic relationships on instance features to uncover and maintain the intrinsic semantic structures. Extensive experiments on multiple benchmarks demonstrate the effectiveness of the proposed SRCD.

Zhijie Rao, Jingcai Guo, Luyao Tang, Yue Huang, Xinghao Ding, Song Guo• 2023

Related benchmarks

TaskDatasetResultRank
Object DetectionSim10K → Cityscapes (test)
AP (Car)43
104
Object DetectionBDD100K (val)
mAP31.6
60
Object DetectionKITTI (test)--
35
Object DetectionCityscapes → BDD100k (test)
mAP (Overall)25.9
32
Object DetectionCityscapes (val)
mAP5043
31
Object DetectionDiverse Weather Datasets
DF35.9
27
Object DetectionDiverse Weather Dataset (DWD) (test)
mAP (Night-sunny)36.7
24
Object DetectionBDD100K
mAP25.9
19
Object DetectionCityscapes Synthetic-to-Real v1.0 (test)
AP5043
15
Object DetectionBDD100K Synthetic-to-Real v1.0 (test)
AP@5031.6
9
Showing 10 of 14 rows

Other info

Follow for update