RecGS: Removing Water Caustic with Recurrent Gaussian Splatting
About
Water caustics are commonly observed in seafloor imaging data from shallow-water areas. Traditional methods that remove caustic patterns from images often rely on 2D filtering or pre-training on an annotated dataset, hindering the performance when generalizing to real-world seafloor data with 3D structures. In this paper, we present a novel method Recurrent Gaussian Splatting (RecGS), which takes advantage of today's photorealistic 3D reconstruction technology, 3DGS, to separate caustics from seafloor imagery. With a sequence of images taken by an underwater robot, we build 3DGS recurrently and decompose the caustic with low-pass filtering in each iteration. In the experiments, we analyze and compare with different methods, including joint optimization, 2D filtering, and deep learning approaches. The results show that our method can effectively separate the caustic from the seafloor, improving the visual appearance, and can be potentially applied on more problems with inconsistent illumination.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Underwater Image Restoration | D3 | ΔE0020.15 | 13 | |
| Novel View Synthesis | Simulated underwater scenes 1.0 (S2 Scene) | PSNR18.551 | 9 | |
| Color Correction | SeaThru D5 | ΔE0024.09 | 9 | |
| Novel View Synthesis | Simulated underwater scenes S1 1.0 | PSNR18.576 | 9 | |
| Novel View Synthesis | Simulated underwater scenes S3 1.0 | PSNR14.23 | 9 | |
| Color Correction | SeaThru-NeRF Curasao | ΔE0039.53 | 9 | |
| Novel View Synthesis | SeaThru-NeRF (test) | PSNR25.829 | 7 | |
| Novel View Synthesis | U-IW (test) | PSNR22.186 | 7 | |
| Novel View Synthesis | S-U (test) | PSNR24.62 | 7 |