Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstruction

About

Recently, 3D Gaussian Splatting (3DGS) has attracted widespread attention due to its high-quality rendering, and ultra-fast training and rendering speed. However, due to the unstructured and irregular nature of Gaussian point clouds, it is difficult to guarantee geometric reconstruction accuracy and multi-view consistency simply by relying on image reconstruction loss. Although many studies on surface reconstruction based on 3DGS have emerged recently, the quality of their meshes is generally unsatisfactory. To address this problem, we propose a fast planar-based Gaussian splatting reconstruction representation (PGSR) to achieve high-fidelity surface reconstruction while ensuring high-quality rendering. Specifically, we first introduce an unbiased depth rendering method, which directly renders the distance from the camera origin to the Gaussian plane and the corresponding normal map based on the Gaussian distribution of the point cloud, and divides the two to obtain the unbiased depth. We then introduce single-view geometric, multi-view photometric, and geometric regularization to preserve global geometric accuracy. We also propose a camera exposure compensation model to cope with scenes with large illumination variations. Experiments on indoor and outdoor scenes show that our method achieves fast training and rendering while maintaining high-fidelity rendering and geometric reconstruction, outperforming 3DGS-based and NeRF-based methods.

Danpeng Chen, Hai Li, Weicai Ye, Yifan Wang, Weijian Xie, Shangjin Zhai, Nan Wang, Haomin Liu, Hujun Bao, Guofeng Zhang• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisMip-NeRF360
PSNR27.49
138
Novel View SynthesisMipNeRF 360 Indoor
PSNR30.36
120
Novel View SynthesisMipNeRF 360 Outdoor
PSNR24.77
117
Novel View SynthesisNeRF Synthetic
PSNR34.05
110
Novel View SynthesisTanks&Temples
PSNR14.55
95
3D surface reconstructionDTU (test)
Mean Chamfer Distance (CD)0.53
79
Surface ReconstructionTanks&Temples
Mean50
57
3D ReconstructionDTU
Chamfer Distance0.34
55
3D ReconstructionDTU
Average Error0.52
47
Surface ReconstructionDTU
CD (Scan 24)0.34
43
Showing 10 of 94 rows
...

Other info

Follow for update