Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SoraNav: Adaptive UAV Task-Centric Navigation via Zeroshot VLM Reasoning

About

Autonomous navigation under natural language instructions represents a crucial step toward embodied intelligence, enabling complex task execution in environments ranging from industrial facilities to domestic spaces. However, language-driven 3D navigation for Unmanned Aerial Vehicles (UAVs) requires precise spatial reasoning, a capability inherently lacking in current zero-shot Vision-Language Models (VLMs) which often generate ambiguous outputs and cannot guarantee geometric feasibility. Furthermore, existing Vision-Language Navigation (VLN) methods are predominantly tailored for 2.5D ground robots, rendering them unable to generalize to the unconstrained 3D spatial reasoning required for aerial tasks in small-scale, cluttered environments. In this paper, we present SoraNav, a novel framework enabling zero-shot VLM reasoning for UAV task-centric navigation. To address the spatial-semantic gap, we introduce Multi-modal Visual Annotation (MVA), which encodes 3D geometric priors directly into the VLM's 2D visual input. To mitigate hallucinated or infeasible commands, we propose an Adaptive Decision Making (ADM) strategy that validates VLM proposals against exploration history, seamlessly switching to geometry-based exploration to avoid dead-ends and redundant revisits. Deployed on a custom PX4-based micro-UAV, SoraNav demonstrates robust real-world performance. Quantitative results show our approach significantly outperforms state-of-the-art baselines, increasing Success Rate (SR) by 25.7% and navigation efficiency (SPL) by 17.3% in 2.5D scenarios, and achieving improvements of 39.3% (SR) and 24.7% (SPL) in complex 3D scenarios.

Hongyu Song, Rishabh Dev Yadav, Cheng Guo, Wei Pan• 2025

Related benchmarks

TaskDatasetResultRank
Image Spatial Reasoning2.5D Scenes
SR83
5
Long-term NavigationKilburn 2.5D
Avg Prompt Count5.67
5
Short-term navigationWarehouse 2.5D
Average Prompts1.14
5
Short-term navigationPark 2.5D
Avg Prompts Adherence1.57
5
Image Spatial Reasoning3D Scenes (3 outdoor and 1 indoor scenes)
SR67
2
Long-term NavigationConstruction 3D
Avg Prompts6
2
Short-term navigationWarehouse 3D
Average Prompts2.29
2
Short-term navigationPark 3D
Avg Prompts2.14
2
Showing 8 of 8 rows

Other info

Follow for update