Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Thinking with Geometry: Active Geometry Integration for Spatial Reasoning

About

Recent progress in spatial reasoning with Multimodal Large Language Models (MLLMs) increasingly leverages geometric priors from 3D encoders. However, most existing integration strategies remain passive: geometry is exposed as a global stream and fused in an indiscriminate manner, which often induces semantic-geometry misalignment and redundant signals. We propose GeoThinker, a framework that shifts the paradigm from passive fusion to active perception. Instead of feature mixing, GeoThinker enables the model to selectively retrieve geometric evidence conditioned on its internal reasoning demands. GeoThinker achieves this through Spatial-Grounded Fusion applied at carefully selected VLM layers, where semantic visual priors selectively query and integrate task-relevant geometry via frame-strict cross-attention, further calibrated by Importance Gating that biases per-frame attention toward task-relevant structures. Comprehensive evaluation results show that GeoThinker sets a new state-of-the-art in spatial intelligence, achieving a peak score of 72.6 on the VSI-Bench. Furthermore, GeoThinker demonstrates robust generalization and significantly improved spatial perception across complex downstream scenarios, including embodied referring and autonomous driving. Our results indicate that the ability to actively integrate spatial structures is essential for next-generation spatial intelligence. Code can be found at https://github.com/Li-Hao-yuan/GeoThinker.

Haoyuan Li, Qihang Cao, Tao Tang, Kun Xiang, Zihan Guo, Jianhua Han, JiaWang Bian, Hang Xu, Xiaodan Liang• 2026

Related benchmarks

TaskDatasetResultRank
Spatial ReasoningVSI-Bench
Avg Score72.6
255
Spatial ReasoningViewspatial
Accuracy45.9
125
Spatial ReasoningEmbSpatial
Overall Accuracy78.8
103
Spatial ReasoningMindCube
Accuracy83.6
87
Spatial ReasoningCV-Bench
Accuracy85.1
79
Autonomous Driving PlanningNAVSIM (navtest)
NC97
68
Spatial ReasoningMindCube (tiny)
Accuracy83
65
Spatial ReasoningMMSI-Bench
Accuracy31.7
65
Spatial Reasoning3DSRBench
Overall Accuracy51.9
60
Spatial ReasoningSPAR-Bench--
45
Showing 10 of 21 rows

Other info

Follow for update