Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Images

About

In this paper, we present a method to optimize Gaussian splatting with a limited number of images while avoiding overfitting. Representing a 3D scene by combining numerous Gaussian splats has yielded outstanding visual quality. However, it tends to overfit the training views when only a small number of images are available. To address this issue, we introduce a dense depth map as a geometry guide to mitigate overfitting. We obtained the depth map using a pre-trained monocular depth estimation model and aligning the scale and offset using sparse COLMAP feature points. The adjusted depth aids in the color-based optimization of 3D Gaussian splatting, mitigating floating artifacts, and ensuring adherence to geometric constraints. We verify the proposed method on the NeRF-LLFF dataset with varying numbers of few images. Our approach demonstrates robust geometry compared to the original method that relies solely on images. Project page: robot0321.github.io/DepthRegGS

Jaeyoung Chung, Jeongtaek Oh, Kyoung Mu Lee• 2023

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisTanks&Temples (test)
PSNR21.46
257
Novel View SynthesisMip-NeRF 360 (test)
PSNR16.88
184
Novel View SynthesisLLFF 3-view
PSNR16.73
130
Novel View SynthesisLLFF 6-view
PSNR18.6
105
Novel View SynthesisScanNet++
PSNR24.32
67
Depth EstimationScanNet++
AbsRel0.118
40
Few-shot Novel View SynthesisLLFF static scenes 3 views
PSNR17.17
10
Novel View SynthesisTanksAndTemples Moderate Data
PSNR23.318
9
Novel View SynthesisMipNeRF 360 Moderate Data
PSNR25.668
9
Novel View SynthesisTanksAndTemples Low Data
PSNR20.173
9
Showing 10 of 13 rows

Other info

Follow for update