Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Poison-splat: Computation Cost Attack on 3D Gaussian Splatting

About

3D Gaussian splatting (3DGS), known for its groundbreaking performance and efficiency, has become a dominant 3D representation and brought progress to many 3D vision tasks. However, in this work, we reveal a significant security vulnerability that has been largely overlooked in 3DGS: the computation cost of training 3DGS could be maliciously tampered by poisoning the input data. By developing an attack named Poison-splat, we reveal a novel attack surface where the adversary can poison the input images to drastically increase the computation memory and time needed for 3DGS training, pushing the algorithm towards its worst computation complexity. In extreme cases, the attack can even consume all allocable memory, leading to a Denial-of-Service (DoS) that disrupts servers, resulting in practical damages to real-world 3DGS service vendors. Such a computation cost attack is achieved by addressing a bi-level optimization problem through three tailored strategies: attack objective approximation, proxy model rendering, and optional constrained optimization. These strategies not only ensure the effectiveness of our attack but also make it difficult to defend with simple defensive measures. We hope the revelation of this novel attack surface can spark attention to this crucial yet overlooked vulnerability of 3DGS systems. Our code is available at https://github.com/jiahaolu97/poison-splat .

Jiahao Lu, Yifan Zhang, Qiuhong Shen, Xinchao Wang, Shuicheng Yan• 2024

Related benchmarks

TaskDatasetResultRank
3D Scene ReconstructionMip-NeRF360
Training Time (min)13.98
37
3D Scene ReconstructionTanks&Temples
Training Time (min)9.63
25
3D Scene ReconstructionNeRF Synthetic
Training Time (min)8.61
25
3D ReconstructionMip-NeRF 360 (test)
PSNR26.446
24
3D ReconstructionTanks&Temples (test)
PSNR23.284
15
Novel View SynthesisMip-NeRF360 (room)
PSNR30.167
13
3D ReconstructionNeRF-Synthetic (NS) standard (test)
PSNR30.767
11
3D Scene ReconstructionNeRF-Synthetic (NS)
Peak GPU Memory (MB)4.03e+3
5
3D Scene ReconstructionTanks-and-Temples (TT)
Peak GPU Memory (MB)4.88e+3
5
Novel View SynthesisMip-NeRF360 bonsai
PSNR30.289
3
Showing 10 of 12 rows

Other info

Follow for update