Inverse Rendering for High-Genus 3D Surface Meshes from Multi-view Images with Persistent Homology Priors
About
Reconstructing 3D objects from images is inherently an ill-posed problem due to ambiguities in geometry, appearance, and topology. This paper introduces collaborative inverse rendering with persistent homology priors, a novel strategy that leverages topological constraints to resolve these ambiguities. By incorporating priors that capture critical features such as tunnel loops and handle loops, our approach directly addresses the difficulty of reconstructing high-genus surfaces. The collaboration between photometric consistency from multi-view images and homology-based guidance enables recovery of complex high-genus geometry while circumventing catastrophic failures such as collapsing tunnels or losing high-genus structure. Instead of neural networks, our method relies on gradient-based optimization within a mesh-based inverse rendering framework to highlight the role of topological priors. Experimental results show that incorporating persistent homology priors leads to lower Chamfer Distance (CD) and higher Volume IoU compared to state-of-the-art mesh-based methods, demonstrating improved geometric accuracy and robustness against topological failure.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| 3D Mesh Reconstruction | Kitten high-genus mesh (test) | Chamfer Distance0.002 | 2 | |
| 3D Mesh Reconstruction | Amphora high-genus mesh (test) | Chamfer Distance0.0021 | 2 | |
| 3D Mesh Reconstruction | Pretzel high-genus mesh (test) | Chamfer Distance0.0043 | 2 | |
| 3D Mesh Reconstruction | Birthday high-genus mesh (test) | Chamfer Distance8.00e-4 | 2 | |
| 3D Mesh Reconstruction | Elephant high-genus mesh (test) | Chamfer Distance0.002 | 2 | |
| 3D Mesh Reconstruction | Botijo high-genus mesh (test) | Chamfer Distance0.003 | 2 | |
| 3D Mesh Reconstruction | Sorter high-genus mesh (test) | Chamfer Dist0.0032 | 2 | |
| 3D Mesh Reconstruction | Heptoroid high-genus mesh (test) | Chamfer Distance0.0062 | 2 |