NavSpace: How Navigation Agents Follow Spatial Intelligence Instructions
About
Instruction-following navigation is a key step toward embodied intelligence. Prior benchmarks mainly focus on semantic understanding but overlook systematically evaluating navigation agents' spatial perception and reasoning capabilities. In this work, we introduce the NavSpace benchmark, which contains six task categories and 1,228 trajectory-instruction pairs designed to probe the spatial intelligence of navigation agents. On this benchmark, we comprehensively evaluate 22 navigation agents, including state-of-the-art navigation models and multimodal large language models. The evaluation results lift the veil on spatial intelligence in embodied navigation. Furthermore, we propose SNav, a new spatially intelligent navigation model. SNav outperforms existing navigation agents on NavSpace and real robot tests, establishing a strong baseline for future work.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Vertical Perception | NavSpace | Navigation Error (NE)5.03 | 30 | |
| Precise Movement | NavSpace | Navigation Error (NE)4.5 | 27 | |
| Instruction navigation | Real-world navigation (test) | Precise Movement3 | 3 | |
| Spatial Intelligence Navigation | NavSpace | Navigation Error (NE)4.47 | 3 | |
| Spatial Relationship | NavSpace | NE4.47 | 3 | |
| Space Structure | NavSpace | Navigation Error (NE)4.17 | 3 | |
| Environment State | NavSpace | Navigation Error (NE)3.17 | 2 |