Camera Pose Revisited
About
Estimating the position and orientation of a camera with respect to an observed scene is one of the central problems in computer vision, particularly in the context of camera calibration and multi-sensor systems. This paper addresses the planar Perspective--$n$--Point problem, with special emphasis on the initial estimation of the pose of a calibration object. As a solution, we propose the \texttt{PnP-ProCay78} algorithm, which combines the classical quadratic formulation of the reconstruction error with a Cayley parameterization of rotations and least-squares optimization. The key component of the method is a deterministic selection of starting points based on an analysis of the reconstruction error for two canonical vectors, allowing costly solution-space search procedures to be avoided. Experimental validation is performed using data acquired also from high-resolution RGB cameras and very low-resolution thermal cameras in an integrated RGB--IR setup. The results demonstrate that the proposed algorithm achieves practically the same projection accuracy as optimal \texttt{SQPnP} and slightly higher than \texttt{IPPE}, both prominent \texttt{PnP-OpenCV} procedures. However, \texttt{PnP-ProCay78} maintains a significantly simpler algorithmic structure. Moreover, the analysis of optimization trajectories in Cayley space provides an intuitive insight into the convergence process, making the method attractive also from a didactic perspective. Unlike existing PnP solvers, the proposed \texttt{PnP-ProCay78} algorithm combines projection error minimization with an analytically eliminated reconstruction-error surrogate for translation, yielding a hybrid cost formulation that is both geometrically transparent and computationally efficient.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Perspective-n-Point (PnP) | RP5-RGB Projection | RMSE0.35 | 4 | |
| Perspective-n-Point (PnP) | RP5-RGB Reprojection | RMSE0.76 | 4 | |
| Perspective-n-Point (PnP) | RP5-IR Projection | RMSE10.9 | 4 | |
| Perspective-n-Point (PnP) | RP5-IR Reprojection | RMSE1.05 | 4 | |
| Perspective-n-Point (PnP) | PC-Logitex Projection | RMSE1.18 | 4 | |
| Perspective-n-Point (PnP) | PC-Logitex Reprojection | RMSE0.66 | 4 | |
| Perspective-n-Point (PnP) | PC-Aver Projection | RMSE1.35 | 4 | |
| Perspective-n-Point (PnP) | PC-Aver Reprojection | RMSE0.81 | 4 | |
| Perspective-n-Point (PnP) | PC-USB Projection | RMSE2.7 | 4 | |
| Perspective-n-Point (PnP) | PC-USB Reprojection | RMSE1.71 | 4 |