Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstruction

About

Recently, 3D Gaussian Splatting (3DGS) has attracted widespread attention due to its high-quality rendering, and ultra-fast training and rendering speed. However, due to the unstructured and irregular nature of Gaussian point clouds, it is difficult to guarantee geometric reconstruction accuracy and multi-view consistency simply by relying on image reconstruction loss. Although many studies on surface reconstruction based on 3DGS have emerged recently, the quality of their meshes is generally unsatisfactory. To address this problem, we propose a fast planar-based Gaussian splatting reconstruction representation (PGSR) to achieve high-fidelity surface reconstruction while ensuring high-quality rendering. Specifically, we first introduce an unbiased depth rendering method, which directly renders the distance from the camera origin to the Gaussian plane and the corresponding normal map based on the Gaussian distribution of the point cloud, and divides the two to obtain the unbiased depth. We then introduce single-view geometric, multi-view photometric, and geometric regularization to preserve global geometric accuracy. We also propose a camera exposure compensation model to cope with scenes with large illumination variations. Experiments on indoor and outdoor scenes show that our method achieves fast training and rendering while maintaining high-fidelity rendering and geometric reconstruction, outperforming 3DGS-based and NeRF-based methods.

Danpeng Chen, Hai Li, Weicai Ye, Yifan Wang, Weijian Xie, Shangjin Zhai, Nan Wang, Haomin Liu, Hujun Bao, Guofeng Zhang• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisMipNeRF 360 Outdoor
PSNR24.76
112
Novel View SynthesisMipNeRF 360 Indoor
PSNR30.36
108
Surface ReconstructionDTU
Scan 24 Metric Value0.4
34
Object RenderingObject Rendering Dataset Individual Objects and Average
PSNR44.07
30
View SynthesisUrbanScene3D Sci-Art
PSNR19.72
22
Novel View SynthesisMip-NeRF 360 Outdoor Scene 2022
PSNR24.76
16
Novel View SynthesisMip-NeRF 360 Indoor Scene 2022
PSNR30.36
16
Novel View SynthesisMip-NeRF 360 Average on all scenes
PSNR27.45
15
3D Shape ReconstructionDTU (standard 15-scene split)
Scene 24 Error0.34
14
Surface ReconstructionDTU sparse-view
CD (Scan 24)3.36
14
Showing 10 of 37 rows

Other info

Follow for update