Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GuardSplat: Efficient and Robust Watermarking for 3D Gaussian Splatting

About

3D Gaussian Splatting (3DGS) has recently created impressive 3D assets for various applications. However, considering security, capacity, invisibility, and training efficiency, the copyright of 3DGS assets is not well protected as existing watermarking methods are unsuited for its rendering pipeline. In this paper, we propose GuardSplat, an innovative and efficient framework for watermarking 3DGS assets. Specifically, 1) We propose a CLIP-guided pipeline for optimizing the message decoder with minimal costs. The key objective is to achieve high-accuracy extraction by leveraging CLIP's aligning capability and rich representations, demonstrating exceptional capacity and efficiency. 2) We tailor a Spherical-Harmonic-aware (SH-aware) Message Embedding module for 3DGS, seamlessly embedding messages into the SH features of each 3D Gaussian while preserving the original 3D structure. This enables watermarking 3DGS assets with minimal fidelity trade-offs and prevents malicious users from removing the watermarks from the model files, meeting the demands for invisibility and security. 3) We present an Anti-distortion Message Extraction module to improve robustness against various distortions. Experiments demonstrate that GuardSplat outperforms state-of-the-art and achieves fast optimization speed. Project page is at https://narcissusex.github.io/GuardSplat, and Code is at https://github.com/NarcissusEx/GuardSplat.

Zixuan Chen, Guangcong Wang, Jiahao Zhu, Jianhuang Lai, Xiaohua Xie• 2024

Related benchmarks

TaskDatasetResultRank
Digital WatermarkingBlender and LLFF (test)
Bit Accuracy (No Attack)99.64
39
3D Gaussian Splatting WatermarkingBlender and LLFF (test)
Bit Accuracy99.04
24
3D Scene WatermarkingBlender and LLFF 16 bits
Bit Accuracy99.64
14
3D Scene WatermarkingBlender and LLFF 32 bits
Bit Accuracy99.04
14
3D Scene WatermarkingBlender and LLFF 48 bits
Bit Acc98.29
14
3D Scene WatermarkingBlender, LLFF, and Mip-NeRF 360
Bit Accuracy95.58
12
Image Quality AssessmentBlender and LLFF views (test)
SSIM0.991
6
3D Gaussian Splatting protection (Joint Watermarking and Edit Deterrence)Mip-NeRF 360 and Instruct-NeRF2NeRF averaged scenes (novel views)
sUCPS0.7489
6
3D WatermarkingLLFF and Blender (train)
Training Time (min)22
6
3D Watermarking Robustness against Diffusion AttacksBlender and LLFF (test)
Bit Accuracy (Deterministic)0.492
6
Showing 10 of 13 rows

Other info

Code

Follow for update