Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Open-Text Aerial Detection: A Unified Framework For Aerial Visual Grounding And Detection

About

Open-Vocabulary Aerial Detection (OVAD) and Remote Sensing Visual Grounding (RSVG) have emerged as two key paradigms for aerial scene understanding. However, each paradigm suffers from inherent limitations when operating in isolation: OVAD is restricted to coarse category-level semantics, while RSVG is structurally limited to single-target localization. These limitations prevent existing methods from simultaneously supporting rich semantic understanding and multi-target detection. To address this, we propose OTA-Det, the first unified framework that bridges both paradigms into a cohesive architecture. Specifically, we introduce a task reformulation strategy that unifies task objectives and supervision mechanisms, enabling joint training across datasets from both paradigms with dense supervision signals. Furthermore, we propose a dense semantic alignment strategy that establishes explicit correspondence at multiple granularities, from holistic expressions to individual attributes, enabling fine-grained semantic understanding. To ensure real-time efficiency, OTA-Det builds upon the RT-DETR architecture, extending it from closed-set detection to open-text detection by introducing several high efficient modules, achieving state-of-the-art performance on six benchmarks spanning both OVAD and RSVG tasks while maintaining real-time inference at 34 FPS.

Guoting Wei, Xia Yuan, Yang Zhou, Haizhao Jing, Yu Liu, Xianbiao Qi, Chunxia Zhao, Haokui Zhang, Rong Xiao• 2026

Related benchmarks

TaskDatasetResultRank
Visual GroundingDIOR-RSVG
Accuracy@0.585.1
25
Open-vocabulary Aerial DetectionDIOR
AP5093.1
8
Open-vocabulary Aerial DetectionDOTA
mAP52
8
Open-vocabulary Aerial DetectionLAE-80C
mAP31
8
Remote Sensing Visual GroundingOPT-RSVG
Acc@0.586.5
8
Remote Sensing Visual GroundingAerialVG
Acc@0.553.9
7
Referring Expression GroundingAerialVG
Acc@0.554.9
5
Showing 7 of 7 rows

Other info

Follow for update