Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CaMo: Camera Motion Grounded Evaluation and Training for Vision-Language Models

About

Vision-Language Models (VLMs) achieve strong performance on spatial question answering benchmarks, yet it remains unclear whether such gains reflect genuine spatial intelligence. We show that existing spatial VLMs lack basic camera motion understanding, a key component of spatial cognition. We propose the Spatial Narrative Score (SNS), an evaluation framework that requires VLMs to generate explicit spatial narratives capturing both scene semantics and camera motion, followed by reasoning with a frozen proxy LLM. Under SNS, state-of-the-art spatial VLMs exhibit significant performance degradation despite high direct question answering accuracy. To address this gap, we introduce CaMo, a camera motion grounded VLM that achieves consistent performance across SNS evaluation and direct spatial question answering accuracy. Our results highlight the importance of explicit spatial narrative externalization for evaluating VLMs with transferable 3D spatial understanding. Our code, data, and model is available at https://github.com/hsiangwei0903/CaMo

Hsiang-Wei Huang, Junbin Lu, Kuang-Ming Chen, Jianxu Shangguan, Cheng-Yen Yang, Jenq-Neng Hwang• 2026

Related benchmarks

TaskDatasetResultRank
Spatial ReasoningVSI-Bench
Avg Score44
255
Spatial ReasoningSPBench SI
Accuracy77.5
42
Spatial ReasoningVSI-Bench tiny
Avg Score51
39
Spatial ReasoningViewSpatial-Bench
Overall Score41
35
Spatial Relationship ReasoningSPAR-Bench
Accuracy (Avg)27.6
26
Spatial ReasoningCV-Bench
Average Spatial Score76.3
22
Camera Motion CaptioningCameraBench
SPICE41
20
Spatial ReasoningSPBench MV
NQ Score61.2
14
Spatial Narrative ScoringVSI-Bench MCQ (full)
Relative Direction Score33.7
3
Showing 9 of 9 rows

Other info

Follow for update