Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LapisGS: Layered Progressive 3D Gaussian Splatting for Adaptive Streaming

About

The rise of Extended Reality (XR) requires efficient streaming of 3D online worlds, challenging current 3DGS representations to adapt to bandwidth-constrained environments. This paper proposes LapisGS, a layered 3DGS that supports adaptive streaming and progressive rendering. Our method constructs a layered structure for cumulative representation, incorporates dynamic opacity optimization to maintain visual fidelity, and utilizes occupancy maps to efficiently manage Gaussian splats. This proposed model offers a progressive representation supporting a continuous rendering quality adapted for bandwidth-aware streaming. Extensive experiments validate the effectiveness of our approach in balancing visual fidelity with the compactness of the model, with up to 50.71% improvement in SSIM, 286.53% improvement in LPIPS with 23% of the original model size, and shows its potential for bandwidth-adapted 3D streaming and rendering applications.

Yuang Shi, G\'eraldine Morin, Simone Gasparini, Wei Tsang Ooi• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisMip-NeRF360
PSNR28.1
51
3D ReconstructionMip-NeRF 360 (test)
PSNR28.73
44
3D ReconstructionBlender (test)
PSNR36.18
20
3D ReconstructionTank&Temples 2017 (test)
PSNR24.62
20
Novel View SynthesisTanks&Temples
PSNR24
16
Novel View SynthesisDeepBlending
PSNR24.22
16
3D Scene RenderingAveraged across all datasets
PSNR29.13
12
Showing 7 of 7 rows

Other info

Follow for update