Ref-GS: Directional Factorization for 2D Gaussian Splatting
About
In this paper, we introduce Ref-GS, a novel approach for directional light factorization in 2D Gaussian splatting, which enables photorealistic view-dependent appearance rendering and precise geometry recovery. Ref-GS builds upon the deferred rendering of Gaussian splatting and applies directional encoding to the deferred-rendered surface, effectively reducing the ambiguity between orientation and viewing angle. Next, we introduce a spherical Mip-grid to capture varying levels of surface roughness, enabling roughness-aware Gaussian shading. Additionally, we propose a simple yet efficient geometry-lighting factorization that connects geometry and lighting via the vector outer product, significantly reducing renderer overhead when integrating volumetric attributes. Our method achieves superior photorealistic rendering for a range of open-world scenes while also accurately recovering geometry.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Novel View Synthesis | NeRF-synthetic original (test) | PSNR33.2 | 25 | |
| Reflective Object Reconstruction | Glossy Synthetic | PSNR31.27 | 15 | |
| Novel View Synthesis | Shiny Blender | PSNR33.4 | 13 | |
| Modeling reflections | Ref-NeRF | PSNR35.57 | 9 | |
| Novel View Synthesis | Glossy Synthetic original (test) | PSNR30.59 | 8 | |
| Novel View Synthesis | Shiny Real | PSNR24.44 | 8 | |
| Modeling reflections | Ref-Real | PSNR23.81 | 8 | |
| Normal Reconstruction | Shiny Blender (ShinyB) original (test) | MAE2.21 | 7 | |
| Radiance-field-based reconstruction | Reflective Benchmarks (test) | Rendering Speed0.37 | 6 | |
| Novel View Synthesis | Synthetic datasets (test) | Rendering Speed (x)0.37 | 5 |