LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding
About
Vision-language models (VLMs) commonly formulate visual grounding and detection as a coordinate-token generation problem, serializing each 2D box into multiple 1D tokens that are learned and decoded largely independently. This token-by-token decoding mismatches the coupled structure of box geometry and creates a practical inference bottleneck due to strictly sequential generation. We introduce LocateAnything, a unified generative grounding and detection framework based on Parallel Box Decoding (PBD). By decoding geometric elements such as bounding boxes and points as atomic units in a single step, LocateAnything preserves intra-box geometric coherence and unlocks substantial parallelism. We show that PBD improves both decoding throughput and localization accuracy. We further develop a scalable data engine and curate LocateAnything-Data, a large-scale dataset with more than 138 million training samples, substantially increasing data diversity for high-precision localization. Extensive evaluations show that LocateAnything advances the speed-accuracy frontier, achieving significantly higher decoding throughput while improving high-IoU localization quality across diverse benchmarks. The results highlight the complementary benefits of Parallel Box Decoding and large-scale training data in enabling efficient and precise unified visual grounding and detection.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Object Detection | LVIS v1.0 (val) | -- | 542 | |
| GUI Grounding | ScreenSpot Pro | Average Score60.3 | 458 | |
| Referring Expression Comprehension | RefCOCOg (test) | -- | 300 | |
| Dense Object Detection | Dense200 | F1 Score @ IoU 0.574 | 25 | |
| Object Pointing | RefCOCOg (val) | F1 Score0.913 | 13 | |
| Object Pointing | RefCOCOg (test) | F1 Score91 | 13 | |
| Dense Object Detection | VisDrone | F1@IoU 0.563 | 11 | |
| Referring Expression Comprehension | HumanRef | -- | 11 | |
| Object Pointing | COCO | F1@Point83.9 | 9 | |
| Object Pointing | LVIS | F1@Point76.6 | 9 |