PCGS: Progressive Compression of 3D Gaussian Splatting
About
3D Gaussian Splatting (3DGS) achieves impressive rendering fidelity and speed for novel view synthesis. However, its substantial data size poses a significant challenge for practical applications. While many compression techniques have been proposed, they fail to efficiently utilize existing bitstreams in on-demand applications due to their lack of progressivity, leading to a waste of resource. To address this issue, we propose PCGS (Progressive Compression of 3D Gaussian Splatting), which adaptively controls both the quantity and quality of Gaussians (or anchors) to enable effective progressivity for on-demand applications. Specifically, for quantity, we introduce a progressive masking strategy that incrementally incorporates new anchors while refining existing ones to enhance fidelity. For quality, we propose a progressive quantization approach that gradually reduces quantization step sizes to achieve finer modeling of Gaussian attributes. Furthermore, to compact the incremental bitstreams, we leverage existing quantization results to refine probability prediction, improving entropy coding efficiency across progressive levels. Overall, PCGS achieves progressivity while maintaining compression performance comparable to SoTA non-progressive methods. Code available at: github.com/YihangChen-ee/PCGS.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Novel View Synthesis | Deep Blending DrJohnson scene | PSNR29.85 | 11 | |
| Novel View Synthesis | Deep Blending Playroom scene | PSNR30.91 | 11 | |
| Novel View Synthesis | MipNeRF360 Room | Model Size (MB)5 | 8 | |
| Novel View Synthesis | BungeeNeRF Amsterdam | Size (MB)15.49 | 7 | |
| Novel View Synthesis | BungeeNeRF Bilbao | Size (MB)12.18 | 7 | |
| Novel View Synthesis | BungeeNeRF Hollywood | Model Size (MB)12.35 | 7 | |
| Novel View Synthesis | BungeeNeRF Pompidou | Size (MB)13.87 | 7 | |
| Novel View Synthesis | BungeeNeRF Quebec | Size (MB)10.94 | 7 | |
| 3D Scene Reconstruction | NeRF Synthetic Chair | Size (MB)1.23 | 6 | |
| 3D Scene Reconstruction | NeRF Synthetic Drums | Size (MB)1.68 | 6 |