CaMo: Camera Motion Grounded Evaluation and Training for Vision-Language Models
About
Vision-Language Models (VLMs) achieve strong performance on spatial question answering benchmarks, yet it remains unclear whether such gains reflect genuine spatial intelligence. We show that existing spatial VLMs lack basic camera motion understanding, a key component of spatial cognition. We propose the Spatial Narrative Score (SNS), an evaluation framework that requires VLMs to generate explicit spatial narratives capturing both scene semantics and camera motion, followed by reasoning with a frozen proxy LLM. Under SNS, state-of-the-art spatial VLMs exhibit significant performance degradation despite high direct question answering accuracy. To address this gap, we introduce CaMo, a camera motion grounded VLM that achieves consistent performance across SNS evaluation and direct spatial question answering accuracy. Our results highlight the importance of explicit spatial narrative externalization for evaluating VLMs with transferable 3D spatial understanding. Our code, data, and model is available at https://github.com/hsiangwei0903/CaMo
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Spatial Reasoning | VSI-Bench | Avg Score44 | 255 | |
| Spatial Reasoning | SPBench SI | Accuracy77.5 | 42 | |
| Spatial Reasoning | VSI-Bench tiny | Avg Score51 | 39 | |
| Spatial Reasoning | ViewSpatial-Bench | Overall Score41 | 35 | |
| Spatial Relationship Reasoning | SPAR-Bench | Accuracy (Avg)27.6 | 26 | |
| Spatial Reasoning | CV-Bench | Average Spatial Score76.3 | 22 | |
| Camera Motion Captioning | CameraBench | SPICE41 | 20 | |
| Spatial Reasoning | SPBench MV | NQ Score61.2 | 14 | |
| Spatial Narrative Scoring | VSI-Bench MCQ (full) | Relative Direction Score33.7 | 3 |