OceanSplat: Object-aware Gaussian Splatting with Trinocular View Consistency for Underwater Scene Reconstruction
About
We introduce OceanSplat, a novel 3D Gaussian Splatting-based approach for high-fidelity underwater scene reconstruction. To overcome multi-view inconsistencies caused by scattering media, we design a trinocular setup for each camera pose by rendering from horizontally and vertically translated virtual viewpoints, enforcing view consistency to facilitate spatial optimization of 3D Gaussians. Furthermore, we derive synthetic epipolar depth priors from the virtual viewpoints, which serve as self-supervised depth regularizers to compensate for the limited geometric cues in degraded underwater scenes. We also propose a depth-aware alpha adjustment that modulates the opacity of 3D Gaussians during early training based on their depth along the viewing direction, deterring the formation of medium-induced primitives. Our approach promotes the disentanglement of 3D Gaussians from the scattering medium through effective geometric constraints, enabling accurate representation of scene structure and significantly reducing floating artifacts. Experiments on real-world underwater and simulated scenes demonstrate that OceanSplat substantially outperforms existing methods for both scene reconstruction and restoration in scattering media.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Novel View Synthesis | SeaThru-NeRF Panama | PSNR32.74 | 11 | |
| Novel View Synthesis | SeaThru-NeRF Curasao | PSNR34.56 | 11 | |
| Novel View Synthesis | SeaThru-NeRF (IUI3-RedSea) | PSNR30.17 | 11 | |
| Novel View Synthesis | SeaThru-NeRF (J.G.-RedSea) | PSNR25.35 | 11 | |
| Novel View Synthesis | Coral In-the-Wild | PSNR29.15 | 6 | |
| Novel View Synthesis | In-the-Wild Composite | PSNR26.39 | 6 | |
| Novel View Synthesis | Underwater Scenes | Training Time19 | 6 | |
| Novel View Synthesis | LLFF Fern simulated underwater (test) | PSNR28.8 | 4 | |
| Novel View Synthesis | LLFF Fern simulated foggy (test) | PSNR29.12 | 4 | |
| Scene Restoration | LLFF Fern simulated foggy (test) | PSNR20.17 | 4 |