StegaNeRF: Embedding Invisible Information within Neural Radiance Fields
About
Recent advances in neural rendering imply a future of widespread visual data distributions through sharing NeRF model weights. However, while common visual data (images and videos) have standard approaches to embed ownership or copyright information explicitly or subtly, the problem remains unexplored for the emerging NeRF format. We present StegaNeRF, a method for steganographic information embedding in NeRF renderings. We design an optimization framework allowing accurate hidden information extractions from images rendered by NeRF, while preserving its original visual quality. We perform experimental evaluations of our method under several potential deployment scenarios, and we further discuss the insights discovered through our analysis. StegaNeRF signifies an initial exploration into the novel problem of instilling customizable, imperceptible, and recoverable information to NeRF renderings, with minimal impact to rendered images. Project page: https://xggnet.github.io/StegaNeRF/.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Digital Watermarking | Blender and LLFF (test) | Bit Accuracy (No Attack)93.15 | 39 | |
| 3D Gaussian Splatting Watermarking | Blender and LLFF (test) | Bit Accuracy93.15 | 24 | |
| Steganography | DTU Bricks scene | PSNR21.67 | 8 | |
| Steganography | DTU Tools scene | PSNR22.38 | 8 | |
| Steganography | DTU Birds scene | PSNR20.2 | 8 | |
| Steganography | DTU Snowman scene | PSNR20.63 | 8 | |
| 3D Steganography | Tanks & Temples Message | PSNR28.114 | 4 | |
| 3D Scene Steganography | THuman_MV 2 scenes | Cover PSNR28.72 | 4 | |
| 3D Scene Steganography | THuman_MV 3 scenes | Cover PSNR28.01 | 4 | |
| 3D Steganography | Tanks & Temples Scene | PSNR27.251 | 4 |