RoboPIN: Grounded Embodied Reasoning via Pinned Chain-of-Thought
About
Embodied reasoning requires models to perceive task-relevant objects and spaces in physical environments and maintain consistent visual grounding throughout multi-step reasoning. However, current vision-language models rely on text-only or coordinate-augmented chain-of-thought, where entity references remain implicit and ambiguous. This may cause the reasoning process to decouple from visual evidence, entity references to drift across steps, and a causal disconnection between the reasoning trajectory and the final answer, with these problems further amplified in multi-view scenarios due to cross-view appearance changes. To address these issues, we propose Pinned Chain-of-Thought (PinCoT), a structured reasoning paradigm that pins every reasoning step to visual evidence. PinCoT introduces the concept of reasoning anchor, which binds each task-relevant entity to a structured visual anchor with entity name, unique identity, view index, and spatial grounding, enabling consistent entity tracking across reasoning steps and views. We build a fully automated data generation pipeline to construct PIN-170K, a high-quality PinCoT-formatted reasoning dataset. We then train RoboPIN through three-stage post-training that progressively injects embodied knowledge, structured reasoning ability, and process-supervised alignment, with rewards that directly constrain both anchor localization and identity consistency during reasoning. On 14 benchmarks covering embodied spatial reasoning, multi-view reasoning, and pointing, RoboPIN with only 4B parameters consistently outperforms 7B level open-source embodied models, achieving a 12% average improvement over the strongest 7B baseline, Mimo-Embodied. Further analysis shows that PinCoT improves grounding accuracy and cross-step identity consistency, validating the effectiveness of process supervision.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Spatial Reasoning | EmbSpatial | Overall Accuracy83.1 | 131 | |
| Spatial Reasoning | CV-Bench | Accuracy85.5 | 89 | |
| Spatial Reasoning | BLINK | Spa. Score87.4 | 57 | |
| Spatial Reasoning | ROBOSPATIAL | Accuracy66.6 | 48 | |
| Spatial Reasoning | SAT | Overall Acc78 | 21 | |
| Spatial Reasoning | ERQA | Accuracy44 | 17 | |
| Multi-view spatial reasoning | CrossPoint | Accuracy72.2 | 10 | |
| Visual Grounding | Ref-Spatial | Pointing Performance50.5 | 10 | |
| Visual Grounding | Robo-Refit | Pointing Performance89 | 10 | |
| Visual Grounding | Robo Afford | Pointing Performance72.8 | 10 |