Neural Shell Texture Splatting: More Details and Fewer Primitives
About
Gaussian splatting techniques have shown promising results in novel view synthesis, achieving high fidelity and efficiency. However, their high reconstruction quality comes at the cost of requiring a large number of primitives. We identify this issue as stemming from the entanglement of geometry and appearance in Gaussian Splatting. To address this, we introduce a neural shell texture, a global representation that encodes texture information around the surface. We use Gaussian primitives as both a geometric representation and texture field samplers, efficiently splatting texture features into image space. Our evaluation demonstrates that this disentanglement enables high parameter efficiency, fine texture detail reconstruction, and easy textured mesh extraction, all while using significantly fewer primitives.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Novel View Synthesis | MipNeRF 360 Outdoor | PSNR23.74 | 112 | |
| Novel View Synthesis | MipNeRF 360 Indoor | PSNR30.35 | 108 | |
| Novel View Synthesis | Mip-NeRF360 | PSNR26.68 | 104 | |
| Novel View Synthesis | Tanks&Temples | PSNR23.02 | 52 | |
| Novel View Synthesis | Custom | PSNR25.4 | 24 | |
| Novel View Synthesis | Mip-NeRF360 | FPS23 | 5 | |
| Novel View Synthesis | Mip-NeRF360 Indoor | FPS27 | 3 | |
| Novel View Synthesis | Mip-NeRF360 Outdoor | FPS19 | 3 |