Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localization

About

Visual localization aims to determine the camera pose of a query image relative to a database of posed images. In recent years, deep neural networks that directly regress camera poses have gained popularity due to their fast inference capabilities. However, existing methods struggle to either generalize well to new scenes or provide accurate camera pose estimates. To address these issues, we present Reloc3r, a simple yet effective visual localization framework. It consists of an elegantly designed relative pose regression network, and a minimalist motion averaging module for absolute pose estimation. Trained on approximately eight million posed image pairs, Reloc3r achieves surprisingly good performance and generalization ability. We conduct extensive experiments on six public datasets, consistently demonstrating the effectiveness and efficiency of the proposed method. It provides high-quality camera pose estimates in real time and generalizes to novel scenes. Code: https://github.com/ffrivera0/reloc3r.

Siyan Dong, Shuzhe Wang, Shaohui Liu, Lulu Cai, Qingnan Fan, Juho Kannala, Yanchao Yang• 2024

Related benchmarks

TaskDatasetResultRank
Relative Pose EstimationMegaDepth 1500
AUC @ 5°49.6
104
Relative Pose EstimationScanNet 1500 pairs (test)
AUC@5°34.79
48
Camera Localization7 Scenes
Average Position Error (m)0.04
46
Visual LocalizationCambridge Landmarks (test)
Avg Median Positional Error (m)0.38
35
Multi-view pose regressionCO3D v2
RRA@1595.8
31
Pose Estimation7 Scenes
Average Median Translation Error (m)0.041
23
Camera Pose RegressionCambridge Landmarks (test)
Average Translation Error (Median, 4 Scenes, m)0.38
16
Relative Camera Pose EstimationEgo-Exo4D (val)
Rotation Only AUC@537.35
13
Relative Camera Pose EstimationCO3D v2 (test)
RRA@1595.8
12
Visual LocalizationSynthetic Dataset (T1)
Translational Error (m)25.78
11
Showing 10 of 20 rows

Other info

Code

Follow for update