Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

NavSpace: How Navigation Agents Follow Spatial Intelligence Instructions

About

Instruction-following navigation is a key step toward embodied intelligence. Prior benchmarks mainly focus on semantic understanding but overlook systematically evaluating navigation agents' spatial perception and reasoning capabilities. In this work, we introduce the NavSpace benchmark, which contains six task categories and 1,228 trajectory-instruction pairs designed to probe the spatial intelligence of navigation agents. On this benchmark, we comprehensively evaluate 22 navigation agents, including state-of-the-art navigation models and multimodal large language models. The evaluation results lift the veil on spatial intelligence in embodied navigation. Furthermore, we propose SNav, a new spatially intelligent navigation model. SNav outperforms existing navigation agents on NavSpace and real robot tests, establishing a strong baseline for future work.

Haolin Yang, Yuxing Long, Zhuoyuan Yu, Zihan Yang, Minghan Wang, Jiapeng Xu, Yihan Wang, Ziyan Yu, Wenzhe Cai, Lei Kang, Hao Dong• 2025

Related benchmarks

TaskDatasetResultRank
Vertical PerceptionNavSpace
Navigation Error (NE)5.03
30
Precise MovementNavSpace
Navigation Error (NE)4.5
27
Instruction navigationReal-world navigation (test)
Precise Movement3
3
Spatial Intelligence NavigationNavSpace
Navigation Error (NE)4.47
3
Spatial RelationshipNavSpace
NE4.47
3
Space StructureNavSpace
Navigation Error (NE)4.17
3
Environment StateNavSpace
Navigation Error (NE)3.17
2
Showing 7 of 7 rows

Other info

Follow for update