Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Prototype-Anchored Generalized Manifold Regression for Unknown-Domain Object Detection

About

In this paper, we study Single-Domain Generalized Object Detection (Single-DGOD), which aims to transfer a detector trained on a single source domain to multiple unseen domains. Existing methods mainly rely on simulation-driven strategies, such as data augmentation or textual prompts, to enlarge the training distribution. However, finite simulations can hardly cover the dynamic variations of real-world scenarios, often causing overfitting to synthetic styles and limited robustness to complex structural degradations. Inspired by the manifold hypothesis, we argue that semantic features, despite diverse visual changes, should lie on a compact and stable low-dimensional manifold. Therefore, robust generalization requires rectifying deviant samples back to this semantic manifold, rather than exhaustively simulating external perturbations. To this end, we propose Manifold Regression with Visual-Text Dual Chain-of-Thought (MR-DCoT), which formulates unknown-domain generalization as a manifold regression problem. MR-DCoT first uses a Visual-Text Dual Chain-of-Thought module to combine VLM-guided semantic evolution with diffusion-based structural perturbation, generating structured off-manifold hard examples. It then introduces Class-Specific Prototype Anchoring to learn a rectification operator that projects deviant features toward the source semantic manifold. By integrating outlier generation and semantic correction into a closed loop, MR-DCoT effectively narrows the distribution gap and improves robustness under unseen shifts. Extensive experiments on three complementary benchmarks, including adverse-weather detection, real-to-art generalization, and zero-shot semantic segmentation, demonstrate the effectiveness and versatility of our method.

Zihao Zhang, Aming Wu, Yang Li, Yahong Han• 2026

Related benchmarks

TaskDatasetResultRank
Semantic segmentationGTA5 to Cityscapes
mIoU43.96
70
Object DetectionDiverse Weather Dataset (DWD) (test)
mAP (Night-sunny)62.4
53
Semantic segmentationACDC Snow
mIoU47.3
48
Object DetectionPascal VOC
mAP (AP50:95)88.7
34
Object DetectionComic
mAP40.4
24
Object DetectionWatercolor
mAP63.2
24
Semantic segmentationCityscapes to ACDC Night
mIoU27.2
10
Semantic segmentationCityscapes to ACDC Rain
mIoU45.36
10
Semantic segmentationCityscapes to GTA5
mIoU44.32
10
Object DetectionClipart
mAP45.6
8
Showing 10 of 11 rows

Other info

Follow for update