Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding

About

Vision-language models (VLMs) commonly formulate visual grounding and detection as a coordinate-token generation problem, serializing each 2D box into multiple 1D tokens that are learned and decoded largely independently. This token-by-token decoding mismatches the coupled structure of box geometry and creates a practical inference bottleneck due to strictly sequential generation. We introduce LocateAnything, a unified generative grounding and detection framework based on Parallel Box Decoding (PBD). By decoding geometric elements such as bounding boxes and points as atomic units in a single step, LocateAnything preserves intra-box geometric coherence and unlocks substantial parallelism. We show that PBD improves both decoding throughput and localization accuracy. We further develop a scalable data engine and curate LocateAnything-Data, a large-scale dataset with more than 138 million training samples, substantially increasing data diversity for high-precision localization. Extensive evaluations show that LocateAnything advances the speed-accuracy frontier, achieving significantly higher decoding throughput while improving high-IoU localization quality across diverse benchmarks. The results highlight the complementary benefits of Parallel Box Decoding and large-scale training data in enabling efficient and precise unified visual grounding and detection.

Shihao Wang, Shilong Liu, Yuanguo Kuang, Xinyu Wei, Yangzhou Liu, Zhiqi Li, Yunze Man, Guo Chen, Andrew Tao, Guilin Liu, Jan Kautz, Lei Zhang, Zhiding Yu• 2026

Related benchmarks

TaskDatasetResultRank
Object DetectionLVIS v1.0 (val)--
542
GUI GroundingScreenSpot Pro
Average Score60.3
458
Referring Expression ComprehensionRefCOCOg (test)--
300
Dense Object DetectionDense200
F1 Score @ IoU 0.574
25
Object PointingRefCOCOg (val)
F1 Score0.913
13
Object PointingRefCOCOg (test)
F1 Score91
13
Dense Object DetectionVisDrone
F1@IoU 0.563
11
Referring Expression ComprehensionHumanRef--
11
Object PointingCOCO
F1@Point83.9
9
Object PointingLVIS
F1@Point76.6
9
Showing 10 of 16 rows

Other info

Follow for update