Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Improving Sparse-View 3DGS Generalization via Flat Minima Optimization

About

Recent advances in neural rendering have established 3D Gaussian Splatting (3DGS) as a highly efficient representation for novel view synthesis, enabling fast training and real-time rendering with strong fidelity. However, when supervision is limited to sparse input views, 3DGS tends to overfit to the observed images and generalize poorly to unseen viewpoints. We address this challenge from the perspective of flat minima (FM) optimization, which seeks solutions that remain stable under small parameter perturbations. Viewing Gaussian parameters as trainable weights, we adapt FM principles to the geometric and dynamic nature of 3DGS with a lightweight training framework. Our method regularizes optimization with controlled Gaussian perturbations that account for each Gaussian's anisotropy and the training progress, preserving fine details while improving robustness to sparse-view overfitting. To further stabilize this flat minima optimization process, we introduce periodic reinitialization, which temporarily returns non-positional parameters to their initial states for a short window. Together, these techniques integrate seamlessly into existing 3DGS pipelines without architectural changes. Experiments on LLFF and Mip-NeRF360 datasets demonstrate improved quantitative metrics and perceptual quality under sparse-view supervision, producing reconstructions that are sharper, more stable, and better generalized to novel viewpoints.

Kangmin Seo, Sangeek Hyun, MinKyu Lee, Jae-Pil Heo• 2026

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisLLFF 6-view
PSNR24.76
143
Novel View SynthesisLLFF 9-view
PSNR26.23
135
Novel View SynthesisDTU 3-view
PSNR19.84
112
Novel View SynthesisMip-NeRF 360 12-view
PSNR19.5
92
Novel View SynthesisMip-NeRF 360 24-view
PSNR24.19
68
Novel View SynthesisLLFF (3 views)
PSNR20.88
25
Novel View SynthesisBlender 8 views
PSNR22.73
25
Novel View SynthesisTanks & Temples 12-view
PSNR13.9
3
Novel View SynthesisNeO 360 12-view
PSNR22.47
3
Showing 9 of 9 rows

Other info

Follow for update