Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Ref-GS: Directional Factorization for 2D Gaussian Splatting

About

In this paper, we introduce Ref-GS, a novel approach for directional light factorization in 2D Gaussian splatting, which enables photorealistic view-dependent appearance rendering and precise geometry recovery. Ref-GS builds upon the deferred rendering of Gaussian splatting and applies directional encoding to the deferred-rendered surface, effectively reducing the ambiguity between orientation and viewing angle. Next, we introduce a spherical Mip-grid to capture varying levels of surface roughness, enabling roughness-aware Gaussian shading. Additionally, we propose a simple yet efficient geometry-lighting factorization that connects geometry and lighting via the vector outer product, significantly reducing renderer overhead when integrating volumetric attributes. Our method achieves superior photorealistic rendering for a range of open-world scenes while also accurately recovering geometry.

Youjia Zhang, Anpei Chen, Yumin Wan, Zikai Song, Junqing Yu, Yawei Luo, Wei Yang• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisNeRF-synthetic original (test)
PSNR33.2
25
Reflective Object ReconstructionGlossy Synthetic
PSNR31.27
15
Novel View SynthesisShiny Blender
PSNR33.4
13
Modeling reflectionsRef-NeRF
PSNR35.57
9
Novel View SynthesisGlossy Synthetic original (test)
PSNR30.59
8
Novel View SynthesisShiny Real
PSNR24.44
8
Modeling reflectionsRef-Real
PSNR23.81
8
Normal ReconstructionShiny Blender (ShinyB) original (test)
MAE2.21
7
Radiance-field-based reconstructionReflective Benchmarks (test)
Rendering Speed0.37
6
Novel View SynthesisSynthetic datasets (test)
Rendering Speed (x)0.37
5
Showing 10 of 10 rows

Other info

Follow for update