Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

ExGS: Extreme 3D Gaussian Compression with Diffusion Priors

About

Neural scene representations, such as 3D Gaussian Splatting (3DGS), have enabled high-quality neural rendering; however, their large storage and transmission costs hinder deployment in resource-constrained environments. Existing compression methods either rely on costly optimization, which is slow and scene-specific, or adopt training-free pruning and quantization, which degrade rendering quality under high compression ratios. In contrast, recent data-driven approaches provide a promising direction to overcome this trade-off, enabling efficient compression while preserving high rendering quality. We introduce ExGS, a novel feed-forward framework that unifies Universal Gaussian Compression (UGC) with GaussPainter for Extreme 3DGS compression. UGC performs re-optimization-free pruning to aggressively reduce Gaussian primitives while retaining only essential information, whereas GaussPainter leverages powerful diffusion priors with mask-guided refinement to restore high-quality renderings from heavily pruned Gaussian scenes. Unlike conventional inpainting, GaussPainter not only fills in missing regions but also enhances visible pixels, yielding substantial improvements in degraded renderings. To ensure practicality, it adopts a lightweight VAE and a one-step diffusion design, enabling real-time restoration. Our framework can even achieve over 100X compression (reducing a typical 354.77 MB model to about 3.31 MB) while preserving fidelity and significantly improving image quality under challenging conditions. These results highlight the central role of diffusion priors in bridging the gap between extreme compression and high-quality neural rendering. Our code repository will be released at: https://github.com/chenttt2001/ExGS

Jiaqi Chen, Xinhao Ji, Yuanyuan Gao, Hao Li, Yuning Gong, Yifei Liu, Dan Xu, Zhihang Zhong, Dingwen Zhang, Xiao Sun• 2025

Related benchmarks

TaskDatasetResultRank
3D Gaussian Splatting CompressionReplica (0.1 compression ratio)
LPIPS0.2197
8
3D Gaussian Splatting CompressionReplica (0.2 compression ratio)
LPIPS0.1652
8
3D Gaussian Splatting CompressionReplica 0.3 compression ratio
LPIPS0.1478
8
3D Gaussian Splatting CompressionScanNet++ 0.1 compression ratio (test)
LPIPS0.2321
8
3D Gaussian Splatting CompressionScanNet++ 0.2 compression ratio (test)
LPIPS0.1948
8
3D Gaussian Splatting CompressionScanNet++ 0.3 compression ratio (test)
LPIPS0.1718
8
Novel View SynthesisGenerated 3D assets
LPIPS0.3124
8
Novel View SynthesisMip-NeRF360 0.03 ratio (test)
LPIPS0.4595
8
Novel View SynthesisMip-NeRF360 0.05 ratio (test)
LPIPS0.3934
8
Novel View SynthesisMip-NeRF360 0.1 ratio (test)
LPIPS0.3303
8
Showing 10 of 10 rows

Other info

Follow for update