Robust Camera Location Estimation by Convex Programming
About
$3$D structure recovery from a collection of $2$D images requires the estimation of the camera locations and orientations, i.e. the camera motion. For large, irregular collections of images, existing methods for the location estimation part, which can be formulated as the inverse problem of estimating $n$ locations $\mathbf{t}_1, \mathbf{t}_2, \ldots, \mathbf{t}_n$ in $\mathbb{R}^3$ from noisy measurements of a subset of the pairwise directions $\frac{\mathbf{t}_i - \mathbf{t}_j}{\|\mathbf{t}_i - \mathbf{t}_j\|}$, are sensitive to outliers in direction measurements. In this paper, we firstly provide a complete characterization of well-posed instances of the location estimation problem, by presenting its relation to the existing theory of parallel rigidity. For robust estimation of camera locations, we introduce a two-step approach, comprised of a pairwise direction estimation method robust to outliers in point correspondences between image pairs, and a convex program to maintain robustness to outlier directions. In the presence of partially corrupted measurements, we empirically demonstrate that our convex formulation can even recover the locations exactly. Lastly, we demonstrate the utility of our formulations through experiments on Internet photo collections.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 3D Reconstruction | Ellis Island | MRE1.54 | 18 | |
| Location Recovery | Montreal ND | Median Reconstruction Error (m)0.6 | 14 | |
| Location Recovery | Gendarmen | Median Error (m)27 | 14 | |
| Location Recovery | Union Sq. | Median Reconstruction Error (m)5 | 14 | |
| Translation Averaging | 1DSfM Montreal Notre Dame | Mean Translation Error0.84 | 14 | |
| Location Recovery | Piazza Pop. | Median Reconstruction Error (m)2 | 14 | |
| Location Recovery | Metropolis | Median Reconstruction Error (m)3.7 | 14 | |
| Location Recovery | Vienna Cath. | Median Error (m)3.2 | 14 | |
| Location Recovery | NYC Library | Median Error (m)1.9 | 14 | |
| Location Recovery | Roman For. | Median Reconstruction Error (m)6.6 | 14 |