PMNI: Pose-free Multi-view Normal Integration for Reflective and Textureless Surface Reconstruction
About
Reflective and textureless surfaces remain a challenge in multi-view 3D reconstruction. Both camera pose calibration and shape reconstruction often fail due to insufficient or unreliable cross-view visual features. To address these issues, we present PMNI (Pose-free Multi-view Normal Integration), a neural surface reconstruction method that incorporates rich geometric information by leveraging surface normal maps instead of RGB images. By enforcing geometric constraints from surface normals and multi-view shape consistency within a neural signed distance function (SDF) optimization framework, PMNI simultaneously recovers accurate camera poses and high-fidelity surface geometry. Experimental results on synthetic and real-world datasets show that our method achieves state-of-the-art performance in the reconstruction of reflective surfaces, even without reliable initial camera poses.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Shape Recovery | DiLiGenT-MV (test) | BEAR CD0.189 | 6 | |
| Camera pose estimation | RT3D | RPEr (MONKEY)0.23 | 5 | |
| Surface Shape Estimation | RT3D | Relative Depth Error (MONKEY)0.011 | 5 | |
| Camera Pose Recovery | DiLiGenT-MV (test) | BEAR0.03 | 2 |