Relational Epipolar Graphs for Robust Relative Camera Pose Estimation
About
A key component of Visual Simultaneous Localization and Mapping (VSLAM) is estimating relative camera poses using matched keypoints. Accurate estimation is challenged by noisy correspondences. Classical methods rely on stochastic hypothesis sampling and iterative estimation, while learning-based methods often lack explicit geometric structure. In this work, we reformulate relative pose estimation as a relational inference problem over epipolar correspondence graphs, where matched keypoints are nodes and nearby ones are connected by edges. Graph operations such as pruning, message passing, and pooling estimate a quaternion rotation, translation vector, and the Essential Matrix (EM). Minimizing a loss comprising (i) $\mathcal{L}_2$ differences with ground truth (GT), (ii) Frobenius norm between estimated and GT EMs, (iii) singular value differences, (iv) heading angle differences, and (v) scale differences, yields the relative pose between image pairs. The dense detector-free method LoFTR is used for matching. Experiments on indoor and outdoor benchmarks show improved robustness to dense noise and large baseline variation compared to classical and learning-guided approaches, highlighting the effectiveness of global relational consensus.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Relative Pose Estimation | KITTI Sequence 01 | Rotation RMSE6.6282 | 20 | |
| Relative Camera Pose Estimation | KITTI Sequence 05 (test) | Absolute Trajectory Error (m)0.1123 | 9 | |
| Relative Camera Pose Estimation | KITTI Sequence 09 (test) | ATE (m)1.1242 | 9 | |
| Relative Pose Estimation | KITTI Odometry Sequence 05 | ATE (m)0.4264 | 9 | |
| Relative Pose Estimation | KITTI Odometry Sequence 09 | ATE (m)0.2554 | 9 | |
| Relative Pose Estimation | KITTI Odometry Sequence 01 (test) | ATE (m)1.3835 | 9 | |
| Relative Pose Estimation | KITTI Odometry Sequence 05 (test) | ATE (m)0.6674 | 9 | |
| Relative Pose Estimation | KITTI Odometry Sequence 09 (test) | ATE (m)0.1879 | 9 | |
| Camera pose estimation | King's College Seq 02 | ATE22.198 | 8 | |
| Camera pose estimation | King's College Seq 03 | ATE (m)35.219 | 8 |