Sparse2DGS: Geometry-Prioritized Gaussian Splatting for Surface Reconstruction from Sparse Views
About
We present a Gaussian Splatting method for surface reconstruction using sparse input views. Previous methods relying on dense views struggle with extremely sparse Structure-from-Motion points for initialization. While learning-based Multi-view Stereo (MVS) provides dense 3D points, directly combining it with Gaussian Splatting leads to suboptimal results due to the ill-posed nature of sparse-view geometric optimization. We propose Sparse2DGS, an MVS-initialized Gaussian Splatting pipeline for complete and accurate reconstruction. Our key insight is to incorporate the geometric-prioritized enhancement schemes, allowing for direct and robust geometric learning under ill-posed conditions. Sparse2DGS outperforms existing methods by notable margins while being ${2}\times$ faster than the NeRF-based fine-tuning approach.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Surface Reconstruction | DTU sparse-view | CD (Scan 24)1.05 | 27 | |
| Mesh Reconstruction | Real-world articulated objects | Stapler Reconstruction Error0.14 | 12 | |
| Dynamic Surface Reconstruction | CMU Panoptic (Band1) | Accuracy12.6 | 12 | |
| Dynamic Surface Reconstruction | CMU Panoptic Haggling b2 | Accuracy8.4 | 12 | |
| Dynamic Surface Reconstruction | CMU Panoptic (Pizza1) | Accuracy11.1 | 12 | |
| Dynamic Surface Reconstruction | CMU Panoptic (Ian3) | Accuracy7.8 | 12 | |
| Dynamic Surface Reconstruction | Hi4D (Basketball13) | Accuracy4.87 | 8 | |
| Dynamic Surface Reconstruction | Hi4D Cheers37 | Accuracy2.66 | 8 | |
| Dynamic Surface Reconstruction | Hi4D (Talk22) | Accuracy3.21 | 8 | |
| Dynamic Surface Reconstruction | Hi4D (Football18) | Accuracy1.94 | 8 |