Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

RaDe-GS: Rasterizing Depth in Gaussian Splatting

About

Gaussian Splatting (GS) has proven to be highly effective in novel view synthesis, achieving high-quality and real-time rendering. However, its potential for reconstructing detailed 3D shapes has not been fully explored. Existing methods often suffer from limited shape accuracy due to the discrete and unstructured nature of Gaussian splats, which complicates the shape extraction. While recent techniques like 2D GS have attempted to improve shape reconstruction, they often reformulate the Gaussian primitives in ways that reduce both rendering quality and computational efficiency. To address these problems, our work introduces a rasterized approach to render the depth maps and surface normal maps of general 3D Gaussian splats. Our method not only significantly enhances shape reconstruction accuracy but also maintains the computational efficiency intrinsic to Gaussian Splatting. It achieves a Chamfer distance error comparable to NeuraLangelo on the DTU dataset and maintains similar computational efficiency as the original 3D GS methods. Our method is a significant advancement in Gaussian Splatting and can be directly integrated into existing Gaussian Splatting-based methods.

Baowen Zhang, Chuan Fang, Rakesh Shrestha, Yixun Liang, Xiaoxiao Long, Ping Tan• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisMipNeRF 360 Outdoor
PSNR25.17
112
Novel View SynthesisMipNeRF 360 Indoor
PSNR30.74
108
Novel View SynthesisMip-NeRF360
PSNR23.56
104
Novel View SynthesisDTU
PSNR25.778
100
Novel View SynthesisNeRF Synthetic
PSNR27.531
92
Novel View SynthesisMip-NeRF360 (test)
PSNR19.066
58
Novel View SynthesisSynthetic-NeRF (test)
PSNR27.531
48
Surface ReconstructionDTU 1.0 (test)
Chamfer Distance (Scene 24)0.46
35
Surface ReconstructionDTU
Scan 24 Metric Value0.46
34
3D ReconstructionDTU
Average Error0.68
32
Showing 10 of 21 rows

Other info

Follow for update