ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Models
About
Recent advances in Multi-modal Large Language Models (MLLMs) target 3D spatial intelligence, yet the progress has been largely driven by post-training on curated benchmarks, leaving the inference-time approach relatively underexplored. In this paper, we take a training-free perspective and introduce ViSRA, a human-aligned Video-based Spatial Reasoning Agent, as a framework to probe the spatial reasoning mechanism of MLLMs. ViSRA elicits spatial reasoning in a modular and extensible manner by leveraging explicit spatial information from expert models, enabling a plug-and-play flexible paradigm. ViSRA offers two key advantages: (1) human-aligned and transferable 3D understanding rather than task-specific overfitting; and (2) no post-training computational cost along with heavy manual curation of spatial reasoning datasets. Experimental results demonstrate consistent improvement across a set of MLLMs on both existing benchmarks and unseen 3D spatial reasoning tasks, with ViSRA outperforming baselines by up to a 15.6% and 28.9% absolute margin respectively.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 3D Question Answering | VSI-Bench | Room Size Accuracy52.7 | 56 | |
| Spatial Reasoning | VSI-Bench Extra | RDB (Back)72 | 9 | |
| Cross-viewpoint spatial reasoning | ViewSpatial-Bench | Camera-Relative Direction Accuracy46.3 | 6 | |
| Online spatio-temporal understanding | OST-Bench | Directional Temporal Score80.8 | 6 | |
| Video-based spatial intelligence | MMSI-Video-Bench | Instance-Scene Score29.9 | 6 |