FlowDec: Temporal Conditional Flow Decorruptor for Robust Continuous Vision-Language Navigation
About
Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires agents to follow natural-language instructions in unseen scenes. While Large Models (LMs) have advanced VLN-CE, their performance remains severely degraded by real-world visual corruptions, a critical yet underexplored domain constraint. We introduce Temporal Conditional Flow Decorruptor (FlowDec), a novel image restoration framework tailored for LM-based VLN-CE. FlowDec integrates a hybrid temporal conditioning strategy to align the generative flow path with historical context and employs action-centroid guided filtering to dynamically assess and integrate outputs. Extensive experiments demonstrate that FlowDec outperforms state-of-the-art decorruption methods in both navigation accuracy and generation latency. Our approach establishes a robust, efficient paradigm for resilient embodied navigation in unpredictable real-world conditions.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Temporal consistency evaluation | R2R-CE (test) | Warp Error (Gaussian)0.1 | 5 | |
| Temporal consistency evaluation | RxR-CE (test) | Warp Error (Gaussian)0.12 | 5 | |
| Vision-Language Navigation | RxR-CE Continuous Environments (test) | Success Rate (Gaussian Noise)32.33 | 5 | |
| Vision-Language Navigation | R2R Continuous Environments (test) | SR (Gaussian)26.54 | 5 | |
| Vision-Language Navigation | R2R-CE and RxR-CE | Inference Time (ms)370 | 4 | |
| Robot navigation | Real-world experiments Indoor | Task 1 Score35 | 2 | |
| Robot navigation | Real-world experiments Outdoor | Task 3 Score30 | 2 | |
| Vision-and-Language Navigation | R2R-CE | SR (Gaussian Noise)32.72 | 2 | |
| Vision-and-Language Navigation | RxR-CE | SR (Gaussian Noise)35.36 | 2 |