CAM3R: Camera-Agnostic Model for 3D Reconstruction
About
Recovering dense 3D geometry from unposed images remains a foundational challenge in computer vision. Current state-of-the-art models are predominantly trained on perspective datasets, which implicitly constrains them to a standard pinhole camera geometry. As a result, these models suffer from significant geometric degradation when applied to wide-angle imagery captured via non-rectilinear optics, such as fisheye or panoramic sensors. To address this, we present CAM3R, a Camera-Agnostic, feed-forward Model for 3D Reconstruction capable of processing images from wide-angle camera models without prior calibration. Our framework consists of a two-view network which is bifurcated into a Ray Module (RM) to estimate per-pixel ray directions and a Cross-view Module (CVM) to infer radial distance with confidence maps, pointmaps, and relative poses. To unify these pairwise predictions into a consistent 3D scene, we introduce a Ray-Aware Global Alignment framework for pose refinement and scale optimization while strictly preserving the predicted local geometry. Extensive experiments on various camera model datasets, including panorama, fisheye and pinhole imagery, demonstrate that CAM3R establishes a new state-of-the-art in pose estimation and reconstruction.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Multi-view relative pose estimation | 2D3DS | RRA@1597.7 | 7 | |
| Multi-view relative pose estimation | 360Loc | RRA@1596 | 7 | |
| Two-view relative pose estimation | ADT | RRA@1599 | 7 | |
| Two-view relative pose estimation | CO3D v2 | RRA@1597.5 | 7 | |
| Two-view relative pose estimation | MegaDepth | RRA@1597.2 | 7 | |
| Multi-view trajectory alignment | 2D3DS | ATE RMSE1.8 | 4 | |
| Multi-view trajectory alignment | 360Loc | ATE RMSE2.7 | 4 | |
| Multi-view relative pose estimation | CO3D v2 | RRA85 | 4 | |
| Multi-view trajectory alignment | CO3D Zero-shot v2 | ATE RMSE1.1 | 4 | |
| Multi-view trajectory alignment | ADT | ATE RMSE0.4 | 4 |