Robust Camera Location Estimation by Convex Programming
About
$3$D structure recovery from a collection of $2$D images requires the estimation of the camera locations and orientations, i.e. the camera motion. For large, irregular collections of images, existing methods for the location estimation part, which can be formulated as the inverse problem of estimating $n$ locations $\mathbf{t}_1, \mathbf{t}_2, \ldots, \mathbf{t}_n$ in $\mathbb{R}^3$ from noisy measurements of a subset of the pairwise directions $\frac{\mathbf{t}_i - \mathbf{t}_j}{\|\mathbf{t}_i - \mathbf{t}_j\|}$, are sensitive to outliers in direction measurements. In this paper, we firstly provide a complete characterization of well-posed instances of the location estimation problem, by presenting its relation to the existing theory of parallel rigidity. For robust estimation of camera locations, we introduce a two-step approach, comprised of a pairwise direction estimation method robust to outliers in point correspondences between image pairs, and a convex program to maintain robustness to outlier directions. In the presence of partially corrupted measurements, we empirically demonstrate that our convex formulation can even recover the locations exactly. Lastly, we demonstrate the utility of our formulations through experiments on Internet photo collections.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Translation Averaging | 1DSfM Montreal Notre Dame | Mean Translation Error0.84 | 14 | |
| Translation Averaging | 1DSfM Alamo | Mean Translation Error1.69 | 7 | |
| Translation Averaging | 1DSfM Gendarmenmarkt | Mean Translation Error38.17 | 7 | |
| Translation Averaging | 1DSfM Piazza del Popolo | Mean Translation Error5.26 | 7 | |
| Translation Averaging | 1DSfM Yorkminster | Mean Translation Error (t¯)5.39 | 7 | |
| Translation Averaging | 1DSfM Average | Mean Translation Error (t̄)10.51 | 7 | |
| Translation Averaging | 1DSfM Ellis Island | Mean Translation Error (t¯)21.98 | 7 | |
| Translation Averaging | 1DSfM Roman Forum | Mean Translation Error8.32 | 7 | |
| Translation Averaging | 1DSfM Vienna Cathedral | Mean Translation Error12.8 | 7 | |
| Translation Averaging | 1DSfM Madrid Metropolis | Mean Translation Error (t¯)5.94 | 7 |