Ref-GS: Directional Factorization for 2D Gaussian Splatting
About
In this paper, we introduce Ref-GS, a novel approach for directional light factorization in 2D Gaussian splatting, which enables photorealistic view-dependent appearance rendering and precise geometry recovery. Ref-GS builds upon the deferred rendering of Gaussian splatting and applies directional encoding to the deferred-rendered surface, effectively reducing the ambiguity between orientation and viewing angle. Next, we introduce a spherical Mip-grid to capture varying levels of surface roughness, enabling roughness-aware Gaussian shading. Additionally, we propose a simple yet efficient geometry-lighting factorization that connects geometry and lighting via the vector outer product, significantly reducing renderer overhead when integrating volumetric attributes. Our method achieves superior photorealistic rendering for a range of open-world scenes while also accurately recovering geometry.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Novel View Synthesis | NeRF-synthetic original (test) | PSNR33.2 | 25 | |
| Reflective Object Reconstruction | Glossy Synthetic | PSNR31.27 | 19 | |
| Novel View Synthesis | Shiny Blender | PSNR33.4 | 13 | |
| Surface Reconstruction | ShinySynthetic | MAE (Ball)1.05 | 13 | |
| Novel View Synthesis | ShinySynthetic | PSNR34.8 | 12 | |
| Novel View Synthesis | GlossySynthetic | PSNR30.37 | 12 | |
| Surface Reconstruction | ShinySynthetic | Normal MAE (ball)1.05 | 12 | |
| Surface Reconstruction | GlossySynthetic (test) | Normal MAE (angel)1.99 | 10 | |
| Novel View Synthesis | Ref-Real | PSNR23.93 | 10 | |
| Modeling reflections | Ref-NeRF | PSNR35.57 | 9 |