Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

MesonGS: Post-training Compression of 3D Gaussians via Efficient Attribute Transformation

About

3D Gaussian Splatting demonstrates excellent quality and speed in novel view synthesis. Nevertheless, the huge file size of the 3D Gaussians presents challenges for transmission and storage. Current works design compact models to replace the substantial volume and attributes of 3D Gaussians, along with intensive training to distill information. These endeavors demand considerable training time, presenting formidable hurdles for practical deployment. To this end, we propose MesonGS, a codec for post-training compression of 3D Gaussians. Initially, we introduce a measurement criterion that considers both view-dependent and view-independent factors to assess the impact of each Gaussian point on the rendering output, enabling the removal of insignificant points. Subsequently, we decrease the entropy of attributes through two transformations that complement subsequent entropy coding techniques to enhance the file compression rate. More specifically, we first replace rotation quaternions with Euler angles; then, we apply region adaptive hierarchical transform to key attributes to reduce entropy. Lastly, we adopt finer-grained quantization to avoid excessive information loss. Moreover, a well-crafted finetune scheme is devised to restore quality. Extensive experiments demonstrate that MesonGS significantly reduces the size of 3D Gaussians while preserving competitive quality.

Shuzhao Xie, Weixiang Zhang, Chen Tang, Yunpeng Bai, Rongwei Lu, Shijia Ge, Zhi Wang• 2024

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisMip-NeRF 360 (test)
PSNR27.03
166
Novel View SynthesisDeep Blending (test)
PSNR29.54
64
3D ReconstructionMip-NeRF 360
SSIM0.796
37
3D Scene ReconstructionDeepBlending
PSNR29.51
30
3D Scene ReconstructionTank & Temples
PSNR23.32
26
3D Scene ReconstructionMipNeRF360 Outdoor (test)
PSNR24.554
8
3D Scene ReconstructionTanks&Temples (test)
PSNR23.541
8
3D Scene ReconstructionMipNeRF360 Indoor (test)
PSNR30.173
8
3D Scene ReconstructionDeep Blending (test)
PSNR29.638
8
Importance score computationMip-NeRF360 Indoor
Computation Time (s)14.84
7
Showing 10 of 17 rows

Other info

Follow for update