BEV-Patch-PF: Particle Filtering with BEV-Aerial Feature Matching for Off-Road Geo-Localization
About
We propose BEV-Patch-PF, a GPS-free sequential geo-localization system that integrates a particle filter with learned bird's-eye-view (BEV) and aerial feature maps. From onboard RGB and depth images, we construct a BEV feature map. For each 3-DoF particle pose hypothesis, we crop the corresponding patch from an aerial feature map computed from a local aerial image queried around the approximate location. BEV-Patch-PF computes a per-particle log-likelihood by matching the BEV feature to the aerial patch feature. On two real-world off-road datasets, our method achieves 7.5x lower absolute trajectory error (ATE) on seen routes and 7.0x lower ATE on unseen routes than a retrieval-based baseline, while maintaining accuracy under dense canopy and shadow. The system runs in real time at 10 Hz on an NVIDIA Tesla T4, enabling practical robot deployment.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Cross-view geo-localization | TartanDrive Seen routes TD01–06 2.0 (seen) | Median Distance Error (TD01)1.66 | 4 | |
| Cross-view geo-localization | TartanDrive Unseen routes TD07–22 2.0 | Route TD07 Result1.79 | 4 | |
| Cross-view geo-localization | GQ (Unseen route) | Geo-localization Error (GQ03)2.62 | 3 | |
| Cross-view geo-localization | Urban Park UP (Real-time deployment) | UP01 Metric Value2.03 | 3 | |
| Cross-view geo-localization | GQ (Seen route) | GQ01 Score1.58 | 3 |