SoraNav: Adaptive UAV Task-Centric Navigation via Zeroshot VLM Reasoning
About
Autonomous navigation under natural language instructions represents a crucial step toward embodied intelligence, enabling complex task execution in environments ranging from industrial facilities to domestic spaces. However, language-driven 3D navigation for Unmanned Aerial Vehicles (UAVs) requires precise spatial reasoning, a capability inherently lacking in current zero-shot Vision-Language Models (VLMs) which often generate ambiguous outputs and cannot guarantee geometric feasibility. Furthermore, existing Vision-Language Navigation (VLN) methods are predominantly tailored for 2.5D ground robots, rendering them unable to generalize to the unconstrained 3D spatial reasoning required for aerial tasks in small-scale, cluttered environments. In this paper, we present SoraNav, a novel framework enabling zero-shot VLM reasoning for UAV task-centric navigation. To address the spatial-semantic gap, we introduce Multi-modal Visual Annotation (MVA), which encodes 3D geometric priors directly into the VLM's 2D visual input. To mitigate hallucinated or infeasible commands, we propose an Adaptive Decision Making (ADM) strategy that validates VLM proposals against exploration history, seamlessly switching to geometry-based exploration to avoid dead-ends and redundant revisits. Deployed on a custom PX4-based micro-UAV, SoraNav demonstrates robust real-world performance. Quantitative results show our approach significantly outperforms state-of-the-art baselines, increasing Success Rate (SR) by 25.7% and navigation efficiency (SPL) by 17.3% in 2.5D scenarios, and achieving improvements of 39.3% (SR) and 24.7% (SPL) in complex 3D scenarios.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Spatial Reasoning | 2.5D Scenes | SR83 | 5 | |
| Long-term Navigation | Kilburn 2.5D | Avg Prompt Count5.67 | 5 | |
| Short-term navigation | Warehouse 2.5D | Average Prompts1.14 | 5 | |
| Short-term navigation | Park 2.5D | Avg Prompts Adherence1.57 | 5 | |
| Image Spatial Reasoning | 3D Scenes (3 outdoor and 1 indoor scenes) | SR67 | 2 | |
| Long-term Navigation | Construction 3D | Avg Prompts6 | 2 | |
| Short-term navigation | Warehouse 3D | Average Prompts2.29 | 2 | |
| Short-term navigation | Park 3D | Avg Prompts2.14 | 2 |