Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

RobustLoc: Robust Camera Pose Regression in Challenging Driving Environments

About

Camera relocalization has various applications in autonomous driving. Previous camera pose regression models consider only ideal scenarios where there is little environmental perturbation. To deal with challenging driving environments that may have changing seasons, weather, illumination, and the presence of unstable objects, we propose RobustLoc, which derives its robustness against perturbations from neural differential equations. Our model uses a convolutional neural network to extract feature maps from multi-view images, a robust neural differential equation diffusion block module to diffuse information interactively, and a branched pose decoder with multi-layer training to estimate the vehicle poses. Experiments demonstrate that RobustLoc surpasses current state-of-the-art camera pose regression models and achieves robust performance in various environments. Our code is released at: https://github.com/sijieaaa/RobustLoc

Sijie Wang, Qiyu Kang, Rui She, Wee Peng Tay, Andreas Hartmannsgruber, Diego Navarro Navarro• 2022

Related benchmarks

TaskDatasetResultRank
Camera Pose RegressionOxford RobotCar (Full)
Mean Translation Error (m)9.37
18
Camera Pose RegressionPerturbed RobotCar (Hard)
Mean Translation Error (m)10.06
16
Camera Pose RegressionOxford RobotCar (Loop)
Mean Translation Error (m)2.49
12
Camera Pose RegressionOxford RobotCar Loop cross-day
Mean Translation Error (m)4.68
9
Camera Pose Regression4Seasons Business Campus
Mean Translation Error (m)4.28
8
Camera Pose Regression4Seasons (Neighborhood)
Mean Translation Error (m)1.36
8
Camera Pose Regression4Seasons Old Town
Mean Translation Error (m)21.65
8
Camera Pose RegressionPerturbed RobotCar (Medium)
Mean Translation Error (m)8.12
8
Showing 8 of 8 rows

Other info

Code

Follow for update