Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LiDAR Teach, Radar Repeat: Robust Cross-Modal Navigation in Degenerate and Varying Environments

About

Long-term autonomy requires robust navigation in environments subject to dynamic and static changes, as well as adverse weather conditions. Teach-and-Repeat (T\&R) navigation offers a reliable and cost-effective solution by avoiding the need for consistent global mapping; however, existing T\&R systems lack a systematic solution to tackle various environmental variations such as weather degradation, ephemeral dynamics, and structural changes. This work proposes LTR$^2$, the first cross-modal, cross-platform LiDAR-Teach-and-Radar-Repeat system that systematically addresses these challenges. LTR$^2$ leverages LiDAR during the teaching phase to capture precise structural information under normal conditions and utilizes 4D millimeter-wave radar during the repeating phase for robust operation under environmental degradations. To align sparse and noisy forward-looking 4D radar with dense and accurate omnidirectional 3D LiDAR data, we introduce a Cross-Modal Registration (CMR) network that jointly exploits Doppler-based motion priors and the physical laws governing LiDAR intensity and radar power density. Furthermore, we propose an adaptive fine-tuning strategy that incrementally updates the CMR network based on localization errors, enabling long-term adaptability to static environmental changes without ground-truth labels. We demonstrate that the proposed CMR network achieves state-of-the-art cross-modal registration performance on the open-access dataset. Then we validate LTR$^2$ across three robot platforms over a large-scale, long-term deployment (40+ km over 6 months), including challenging conditions such as nighttime smoke. Experimental results and ablation studies demonstrate centimeter-level accuracy and strong robustness against diverse environmental disturbances, significantly outperforming existing approaches.

Renxiang Xiao, Yichen Chen, Yuanfan Zhang, Qianyi Shao, Yushuai Chen, Yuxuan Han, Yunjiang Lou, Liang Hu• 2026

Related benchmarks

TaskDatasetResultRank
Cross-modal registrationVoD sequence 01
RYE0.219
14
Cross-modal registrationVoD sequence 02
RYE0.221
14
Cross-modal registrationVoD sequence 03
RYE0.217
14
Cross-modal registrationVoD sequence 04
RYE0.213
14
Cross-modal registrationVoD sequence 14
RYE0.16
14
Cross-modal registrationVoD sequence 19
RYE0.191
14
Open-loop RegistrationVoD sequence 01
RTE (m)0.092
14
Open-loop RegistrationVoD sequence 02
RTE (m)0.106
14
Open-loop RegistrationVoD sequence 03
RTE (m)0.1
14
Open-loop RegistrationVoD sequence 04
RTE (m)0.066
14
Showing 10 of 24 rows

Other info

Follow for update