Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models

About

Spatial reasoning remains a fundamental challenge for Vision-Language Models (VLMs), with current approaches struggling to achieve robust performance despite recent advances. We identify that this limitation stems from a critical gap: existing methods attempt to learn spatial reasoning directly without establishing the hierarchical foundations of perception and understanding. To address this challenge, we present a comprehensive methodology for building spatial intelligence progressively. We introduce SpatialLadder-26k, a multimodal dataset containing 26,610 samples spanning object localization, single image, multi-view, and video spatial reasoning tasks, constructed through a standardized pipeline that ensures systematic coverage across modalities. Building on this dataset, we design a three-stage progressive training framework that (1) establishes spatial perception through object localization, (2) develops spatial understanding through multi-dimensional spatial tasks, and (3) strengthens complex reasoning via reinforcement learning with verifiable rewards. This approach yields SpatialLadder, a 3B-parameter model that achieves state-of-the-art performance on spatial reasoning benchmarks, with 23.4% average improvement over the base model, surpassing GPT-4o by 20.8% and Gemini-2.0-Flash by 10.1%. Notably, SpatialLadder maintains strong generalization with 7.2% improvement on out-of-domain benchmarks, demonstrating that progressive training from perception to reasoning is essential for robust spatial intelligence.

Hongxing Li, Dingming Li, Zixuan Wang, Yuchen Yan, Hang Wu, Wenqi Zhang, Yongliang Shen, Weiming Lu, Jun Xiao, Yueting Zhuang• 2025

Related benchmarks

TaskDatasetResultRank
Spatial ReasoningVSI-Bench
Avg Score44.8
192
Multimodal ReasoningWeMath
Accuracy34.4
129
Spatial ReasoningViewspatial
Accuracy44.2
92
Multimodal UnderstandingPOPE
POPE Score0.855
90
Spatial ReasoningVSI-Bench 1.0 (test)
Relative Distance Error45.6
80
Multimodal ReasoningMMBench
Overall Score72.3
78
Spatial ReasoningMindCube
Accuracy43.4
69
Spatial ReasoningEmbSpatial--
63
Spatial ReasoningCV-Bench
Accuracy73.7
61
Image UnderstandingMMStar
Score45.8
54
Showing 10 of 57 rows

Other info

Follow for update