Ultra-Fusion: A Resilient Tightly-Coupled Multi-Sensor Fusion SLAM Framework under Sensor Degradation and Spatiotemporal Perturbation for Intelligent Transportation Systems
About
Reliable localization is essential for intelligent transportation systems (ITS), including autonomous vehicles, quadruped last-mile carriers, and infrastructure-inspection unmanned aerial vehicles (UAVs). Although tightly-coupled multi-sensor fusion improves accuracy in favorable conditions, deployed systems remain vulnerable to sensor degradation -- poor illumination, LiDAR degeneracy, wheel slippage, and GNSS outage -- and to spatiotemporal calibration errors. These failures are common in urban canyons, tunnels, and high-speed corridors, where localization drift can degrade route tracking, tunnel passage continuity, and local map alignment. This paper presents Ultra-Fusion, a tightly-coupled multi-sensor localization framework based on a unified sliding-window estimator. Asynchronous measurements are timestamp-ordered and converted into optional factors within one optimization window, supporting WIO, VIO, LIO, and LVIO with optional wheel and GNSS augmentation. Observability-aware initialization selects the bootstrap mode, factor-wise reliability scheduling gates degraded measurements, and online LiDAR--IMU spatiotemporal calibration refines temporal offsets and rotational extrinsics during operation. We extend the M3DGR benchmark with simulation trajectories and evaluate more than 60 open-source SLAM systems on M3DGR, M2DGR-Plus, KAIST, GrandTour, and MARS-LVIG. The results show competitive accuracy across wheeled, legged, and aerial platforms under long-duration and high-speed operation, degradation, and calibration perturbation, improving localization availability for road-level autonomy, campus and warehouse mobility, and low-altitude aerial inspection. To benefit the industrial and academic community, we will release source code and datasets upon paper acceptance.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| SLAM | M3DGR | Average Rank1.3 | 68 | |
| Trajectory Estimation | GrandTour SPX-2 urban large-scale | RTE (cm)0.41 | 18 | |
| Trajectory Estimation | GrandTour SNOW-2 snowy low-visibility | RTE (cm)0.34 | 18 | |
| Trajectory Estimation | GrandTour ARC-2 (debris unstructured) | RTE (cm)0.9 | 18 | |
| Trajectory Estimation | GrandTour EIG-1 industrial cluttered | RTE (cm)0.26 | 17 | |
| Localization | MARS-LVIG Aggregate | Average Rank1.3 | 10 | |
| Odometry | KAIST Urban23 | ATE RMSE (m)12.38 | 8 | |
| Localization | MARS-LVIG HKairport02 | ATE0.61 | 7 | |
| Localization | MARS-LVIG HKGNSS02 | Absolute Trajectory Error (ATE)0.9 | 7 | |
| Odometry | KAIST Urban25 | ATE RMSE (m)14.56 | 7 |