Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

2D Gaussian Splatting for Geometrically Accurate Radiance Fields

About

3D Gaussian Splatting (3DGS) has recently revolutionized radiance field reconstruction, achieving high quality novel view synthesis and fast rendering speed without baking. However, 3DGS fails to accurately represent surfaces due to the multi-view inconsistent nature of 3D Gaussians. We present 2D Gaussian Splatting (2DGS), a novel approach to model and reconstruct geometrically accurate radiance fields from multi-view images. Our key idea is to collapse the 3D volume into a set of 2D oriented planar Gaussian disks. Unlike 3D Gaussians, 2D Gaussians provide view-consistent geometry while modeling surfaces intrinsically. To accurately recover thin surfaces and achieve stable optimization, we introduce a perspective-correct 2D splatting process utilizing ray-splat intersection and rasterization. Additionally, we incorporate depth distortion and normal consistency terms to further enhance the quality of the reconstructions. We demonstrate that our differentiable renderer allows for noise-free and detailed geometry reconstruction while maintaining competitive appearance quality, fast training speed, and real-time rendering.

Binbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger, Shenghua Gao• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisTanks&Temples (test)
PSNR23.08
239
Novel View SynthesisMip-NeRF 360 (test)
PSNR27.77
166
Novel View SynthesisMipNeRF 360 Outdoor
PSNR26.1
112
Novel View SynthesisMipNeRF 360 Indoor
PSNR30.41
108
Novel View SynthesisMip-NeRF360
PSNR27.04
104
Novel View SynthesisMip-NeRF 360
PSNR28.56
102
3D surface reconstructionDTU (test)
Mean Chamfer Distance (CD)0.76
69
Novel View SynthesisMip-NeRF360 (test)
PSNR26.32
58
Novel View SynthesisTanks&Temples
PSNR23.15
52
Novel View SynthesisSynthetic-NeRF (test)
PSNR27.058
48
Showing 10 of 114 rows
...

Other info

Follow for update