Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Spatiotemporal Degradation-Aware 3D Gaussian Splatting for Realistic Underwater Scene Reconstruction

About

Reconstructing realistic underwater scenes from underwater video remains a meaningful yet challenging task in the multimedia domain. The inherent spatiotemporal degradations in underwater imaging, including caustics, flickering, attenuation, and backscattering, frequently result in inaccurate geometry and appearance in existing 3D reconstruction methods. While a few recent works have explored underwater degradation-aware reconstruction, they often address either spatial or temporal degradation alone, falling short in more real-world underwater scenarios where both types of degradation occur. We propose MarineSTD-GS, a novel 3D Gaussian Splatting-based framework that explicitly models both temporal and spatial degradations for realistic underwater scene reconstruction. Specifically, we introduce two paired Gaussian primitives: Intrinsic Gaussians represent the true scene, while Degraded Gaussians render the degraded observations. The color of each Degraded Gaussian is physically derived from its paired Intrinsic Gaussian via a Spatiotemporal Degradation Modeling (SDM) module, enabling self-supervised disentanglement of realistic appearance from degraded images. To ensure stable training and accurate geometry, we further propose a Depth-Guided Geometry Loss and a Multi-Stage Optimization strategy. We also construct a simulated benchmark with diverse spatial and temporal degradations and ground-truth appearances for comprehensive evaluation. Experiments on both simulated and real-world datasets show that MarineSTD-GS robustly handles spatiotemporal degradations and outperforms existing methods in novel view synthesis with realistic, water-free scene appearances.

Shaohua Liu, Ning Gao, Zuoya Gu, Hongkun Dou, Yue Deng, Hongjue Li• 2026

Related benchmarks

TaskDatasetResultRank
Underwater Image RestorationD3
ΔE0019.64
13
Color CorrectionSeaThru-NeRF Curasao
ΔE0019.98
9
Novel View SynthesisSimulated underwater scenes S1 1.0
PSNR27.719
9
Novel View SynthesisSimulated underwater scenes 1.0 (S2 Scene)
PSNR25.853
9
Novel View SynthesisSimulated underwater scenes S3 1.0
PSNR26.355
9
Color CorrectionSeaThru D5
ΔE0022.23
9
Showing 6 of 6 rows

Other info

Follow for update