Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ViSRA: A Video-based Spatial Reasoning Agent for Multi-modal Large Language Models

About

Recent advances in Multi-modal Large Language Models (MLLMs) target 3D spatial intelligence, yet the progress has been largely driven by post-training on curated benchmarks, leaving the inference-time approach relatively underexplored. In this paper, we take a training-free perspective and introduce ViSRA, a human-aligned Video-based Spatial Reasoning Agent, as a framework to probe the spatial reasoning mechanism of MLLMs. ViSRA elicits spatial reasoning in a modular and extensible manner by leveraging explicit spatial information from expert models, enabling a plug-and-play flexible paradigm. ViSRA offers two key advantages: (1) human-aligned and transferable 3D understanding rather than task-specific overfitting; and (2) no post-training computational cost along with heavy manual curation of spatial reasoning datasets. Experimental results demonstrate consistent improvement across a set of MLLMs on both existing benchmarks and unseen 3D spatial reasoning tasks, with ViSRA outperforming baselines by up to a 15.6% and 28.9% absolute margin respectively.

Tingshu Mou, Jiabo He, Renying Wang, Ce Liu, Hao Yang, Tiehua Zhang, Jingjing Chen, Xingjun Ma• 2026

Related benchmarks

TaskDatasetResultRank
3D Question AnsweringVSI-Bench
Room Size Accuracy52.7
56
Spatial ReasoningVSI-Bench Extra
RDB (Back)72
9
Cross-viewpoint spatial reasoningViewSpatial-Bench
Camera-Relative Direction Accuracy46.3
6
Online spatio-temporal understandingOST-Bench
Directional Temporal Score80.8
6
Video-based spatial intelligenceMMSI-Video-Bench
Instance-Scene Score29.9
6
Showing 5 of 5 rows

Other info

Follow for update