Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models

About

Spatial reasoning remains a fundamental challenge for Vision-Language Models (VLMs), with current approaches struggling to achieve robust performance despite recent advances. We identify that this limitation stems from a critical gap: existing methods attempt to learn spatial reasoning directly without establishing the hierarchical foundations of perception and understanding. To address this challenge, we present a comprehensive methodology for building spatial intelligence progressively. We introduce SpatialLadder-26k, a multimodal dataset containing 26,610 samples spanning object localization, single image, multi-view, and video spatial reasoning tasks, constructed through a standardized pipeline that ensures systematic coverage across modalities. Building on this dataset, we design a three-stage progressive training framework that (1) establishes spatial perception through object localization, (2) develops spatial understanding through multi-dimensional spatial tasks, and (3) strengthens complex reasoning via reinforcement learning with verifiable rewards. This approach yields SpatialLadder, a 3B-parameter model that achieves state-of-the-art performance on spatial reasoning benchmarks, with 23.4% average improvement over the base model, surpassing GPT-4o by 20.8% and Gemini-2.0-Flash by 10.1%. Notably, SpatialLadder maintains strong generalization with 7.2% improvement on out-of-domain benchmarks, demonstrating that progressive training from perception to reasoning is essential for robust spatial intelligence.

Hongxing Li, Dingming Li, Zixuan Wang, Yuchen Yan, Hang Wu, Wenqi Zhang, Yongliang Shen, Weiming Lu, Jun Xiao, Yueting Zhuang• 2025

Related benchmarks

TaskDatasetResultRank
Object Hallucination EvaluationPOPE
Accuracy84.7
2019
Spatial ReasoningVSI-Bench
Avg Score45.7
255
Visual PerceptionBLINK
Accuracy58.6
241
Multimodal ReasoningWeMath
Accuracy34.4
171
Multimodal ReasoningMMBench--
127
Spatial ReasoningViewspatial
Accuracy44.2
125
Visual PerceptionMMVP
Accuracy48.1
118
Multimodal UnderstandingPOPE
POPE Score0.855
112
Spatial ReasoningEmbSpatial
Overall Accuracy58.2
103
Spatial ReasoningVSI-Bench 1.0 (test)
Average Score44.9
101
Showing 10 of 93 rows
...

Other info

Follow for update