Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

PMNI: Pose-free Multi-view Normal Integration for Reflective and Textureless Surface Reconstruction

About

Reflective and textureless surfaces remain a challenge in multi-view 3D reconstruction. Both camera pose calibration and shape reconstruction often fail due to insufficient or unreliable cross-view visual features. To address these issues, we present PMNI (Pose-free Multi-view Normal Integration), a neural surface reconstruction method that incorporates rich geometric information by leveraging surface normal maps instead of RGB images. By enforcing geometric constraints from surface normals and multi-view shape consistency within a neural signed distance function (SDF) optimization framework, PMNI simultaneously recovers accurate camera poses and high-fidelity surface geometry. Experimental results on synthetic and real-world datasets show that our method achieves state-of-the-art performance in the reconstruction of reflective surfaces, even without reliable initial camera poses.

Mingzhi Pei, Xu Cao, Xiangyi Wang, Heng Guo, Zhanyu Ma• 2025

Related benchmarks

TaskDatasetResultRank
Shape RecoveryDiLiGenT-MV (test)
BEAR CD0.189
6
Camera pose estimationRT3D
RPEr (MONKEY)0.23
5
Surface Shape EstimationRT3D
Relative Depth Error (MONKEY)0.011
5
Camera Pose RecoveryDiLiGenT-MV (test)
BEAR0.03
2
Showing 4 of 4 rows

Other info

Code

Follow for update