Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Nav-$R^2$ Dual-Relation Reasoning for Generalizable Open-Vocabulary Object-Goal Navigation

About

Object-goal navigation in open-vocabulary settings requires agents to locate novel objects in unseen environments, yet existing approaches suffer from opaque decision-making processes and low success rate on locating unseen objects. To address these challenges, we propose Nav-$R^2$, a framework that explicitly models two critical types of relationships, target-environment modeling and environment-action planning, through structured Chain-of-Thought (CoT) reasoning coupled with a Similarity-Aware Memory. We construct a Nav$R^2$-CoT dataset that teaches the model to perceive the environment, focus on target-related objects in the surrounding context and finally make future action plans. Our SA-Mem preserves the most target-relevant and current observation-relevant features from both temporal and semantic perspectives by compressing video frames and fusing historical observations, while introducing no additional parameters. Compared to previous methods, Nav-R^2 achieves state-of-the-art performance in localizing unseen objects through a streamlined and efficient pipeline, avoiding overfitting to seen object categories while maintaining real-time inference at 2Hz. Resources will be made publicly available at \href{https://github.com/AMAP-EAI/Nav-R2}{github link}.

Wentao Xiang, Haokang Zhang, Tianhang Yang, Zedong Chu, Ruihang Chu, Shichao Xie, Yujian Yuan, Jian Sun, Zhining Gu, Junjie Wang, Xiaolong Wu, Mu Xu, Yujiu Yang• 2025

Related benchmarks

TaskDatasetResultRank
Object NavigationOVON unseen (val)
SR44
12
Open-Vocabulary Object NavigationOVON unseen (val)
SR44
10
Open-Vocabulary Object NavigationOVON Synonyms (val)
SR45.9
9
Open-Vocabulary Object NavigationOVON seen (val)
SR45.6
9
Open-Vocabulary Object Goal NavigationHM3D OVON (test)
SR44
7
Object NavigationHM3D (val)
SR65
4
Showing 6 of 6 rows

Other info

Follow for update