Mitigating Error Accumulation in Continuous Navigation via Memory-Augmented Kalman Filtering
About
Continuous navigation in complex environments is critical for Unmanned Aerial Vehicle (UAV). However, the existing Vision-Language Navigation (VLN) models follow the dead-reckoning, which iteratively updates its position for the next waypoint prediction, and subsequently construct the complete trajectory. Then, such stepwise manner will inevitably lead to accumulated errors of position over time, resulting in misalignment between internal belief and objective coordinates, which is known as "state drift" and ultimately compromises the full trajectory prediction. Drawing inspiration from classical control theory, we propose to correct for errors by formulating such sequential prediction as a recursive Bayesian state estimation problem. In this paper, we design NeuroKalman, a novel framework that decouples navigation into two complementary processes: a Prior Prediction, based on motion dynamics and a Likelihood Correction, from historical observation. We first mathematically associate Kernel Density Estimation of the measurement likelihood with the attention-based retrieval mechanism, which then allows the system to rectify the latent representation using retrieved historical anchors without gradient updates. Comprehensive experiments on TravelUAV benchmark demonstrate that, with only 10% of the training data fine-tuning, our method clearly outperforms strong baselines and regulates drift accumulation.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Continuous Navigation | UAV-Need-Help Full (test-seen) | Navigation Error (NE)71.56 | 17 | |
| Continuous Navigation | UAV-Need-Help Easy (test-seen) | Navigation Error (NE)42.7 | 17 | |
| Continuous Navigation | UAV-Need-Help Hard (test-seen) | Navigation Error (NE)105.1 | 17 | |
| Continuous Navigation | UAV-Need-Help UO, Easy L1 assistant (test-unseen) | Navigation Error (NE)44.5 | 7 | |
| Continuous Navigation | UAV-Need-Help UM, Full L1 assistant (test-unseen) | Navigation Error100.3 | 7 | |
| Continuous Navigation | UAV-Need-Help UM, Easy L1 assistant (test-unseen) | Navigation Error69.5 | 7 | |
| Continuous Navigation | UAV-Need-Help UM Hard L1 assistant (test-unseen) | Navigation Efficiency (NE)140 | 7 | |
| Continuous Navigation | UAV-Need-Help UO, Full L1 assistant (test-unseen) | NE71.01 | 7 | |
| Continuous Navigation | UAV-Need-Help UO Hard L1 assistant (test-unseen) | NE84.5 | 7 |