Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

2D Gaussian Splatting for Geometrically Accurate Radiance Fields

About

3D Gaussian Splatting (3DGS) has recently revolutionized radiance field reconstruction, achieving high quality novel view synthesis and fast rendering speed without baking. However, 3DGS fails to accurately represent surfaces due to the multi-view inconsistent nature of 3D Gaussians. We present 2D Gaussian Splatting (2DGS), a novel approach to model and reconstruct geometrically accurate radiance fields from multi-view images. Our key idea is to collapse the 3D volume into a set of 2D oriented planar Gaussian disks. Unlike 3D Gaussians, 2D Gaussians provide view-consistent geometry while modeling surfaces intrinsically. To accurately recover thin surfaces and achieve stable optimization, we introduce a perspective-correct 2D splatting process utilizing ray-splat intersection and rasterization. Additionally, we incorporate depth distortion and normal consistency terms to further enhance the quality of the reconstructions. We demonstrate that our differentiable renderer allows for noise-free and detailed geometry reconstruction while maintaining competitive appearance quality, fast training speed, and real-time rendering.

Binbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger, Shenghua Gao• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisTanks&Temples (test)
PSNR23.08
257
Novel View SynthesisMip-NeRF 360 (test)
PSNR27.77
184
Novel View SynthesisMip-NeRF 360
PSNR28.56
143
Novel View SynthesisRE10K
SSIM82.9
142
Novel View SynthesisMip-NeRF360
PSNR27.37
138
Novel View SynthesisMipNeRF 360 Indoor
PSNR30.41
120
Novel View SynthesisMipNeRF 360 Outdoor
PSNR26.1
117
Novel View SynthesisNeRF Synthetic
PSNR33.07
110
Novel View SynthesisTanks&Temples
PSNR23.15
95
3D surface reconstructionDTU (test)
Mean Chamfer Distance (CD)0.76
79
Showing 10 of 197 rows
...

Other info

Follow for update