LapisGS: Layered Progressive 3D Gaussian Splatting for Adaptive Streaming
About
The rise of Extended Reality (XR) requires efficient streaming of 3D online worlds, challenging current 3DGS representations to adapt to bandwidth-constrained environments. This paper proposes LapisGS, a layered 3DGS that supports adaptive streaming and progressive rendering. Our method constructs a layered structure for cumulative representation, incorporates dynamic opacity optimization to maintain visual fidelity, and utilizes occupancy maps to efficiently manage Gaussian splats. This proposed model offers a progressive representation supporting a continuous rendering quality adapted for bandwidth-aware streaming. Extensive experiments validate the effectiveness of our approach in balancing visual fidelity with the compactness of the model, with up to 50.71% improvement in SSIM, 286.53% improvement in LPIPS with 23% of the original model size, and shows its potential for bandwidth-adapted 3D streaming and rendering applications.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Novel View Synthesis | Mip-NeRF360 | PSNR28.1 | 51 | |
| 3D Reconstruction | Mip-NeRF 360 (test) | PSNR28.73 | 44 | |
| 3D Reconstruction | Blender (test) | PSNR36.18 | 20 | |
| 3D Reconstruction | Tank&Temples 2017 (test) | PSNR24.62 | 20 | |
| Novel View Synthesis | Tanks&Temples | PSNR24 | 16 | |
| Novel View Synthesis | DeepBlending | PSNR24.22 | 16 | |
| 3D Scene Rendering | Averaged across all datasets | PSNR29.13 | 12 |