Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Ref-GS: Directional Factorization for 2D Gaussian Splatting

About

In this paper, we introduce Ref-GS, a novel approach for directional light factorization in 2D Gaussian splatting, which enables photorealistic view-dependent appearance rendering and precise geometry recovery. Ref-GS builds upon the deferred rendering of Gaussian splatting and applies directional encoding to the deferred-rendered surface, effectively reducing the ambiguity between orientation and viewing angle. Next, we introduce a spherical Mip-grid to capture varying levels of surface roughness, enabling roughness-aware Gaussian shading. Additionally, we propose a simple yet efficient geometry-lighting factorization that connects geometry and lighting via the vector outer product, significantly reducing renderer overhead when integrating volumetric attributes. Our method achieves superior photorealistic rendering for a range of open-world scenes while also accurately recovering geometry.

Youjia Zhang, Anpei Chen, Yumin Wan, Zikai Song, Junqing Yu, Yawei Luo, Wei Yang• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisNeRF-synthetic original (test)
PSNR33.2
25
Reflective Object ReconstructionGlossy Synthetic
PSNR31.27
19
Novel View SynthesisShiny Blender
PSNR33.4
13
Surface ReconstructionShinySynthetic
MAE (Ball)1.05
13
Novel View SynthesisShinySynthetic
PSNR34.8
12
Novel View SynthesisGlossySynthetic
PSNR30.37
12
Surface ReconstructionShinySynthetic
Normal MAE (ball)1.05
12
Surface ReconstructionGlossySynthetic (test)
Normal MAE (angel)1.99
10
Novel View SynthesisRef-Real
PSNR23.93
10
Modeling reflectionsRef-NeRF
PSNR35.57
9
Showing 10 of 22 rows

Other info

Follow for update