Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Phaseformer: Phase-based Attention Mechanism for Underwater Image Restoration and Beyond

About

Quality degradation is observed in underwater images due to the effects of light refraction and absorption by water, leading to issues like color cast, haziness, and limited visibility. This degradation negatively affects the performance of autonomous underwater vehicles used in marine applications. To address these challenges, we propose a lightweight phase-based transformer network with 1.77M parameters for underwater image restoration (UIR). Our approach focuses on effectively extracting non-contaminated features using a phase-based self-attention mechanism. We also introduce an optimized phase attention block to restore structural information by propagating prominent attentive features from the input. We evaluate our method on both synthetic (UIEB, UFO-120) and real-world (UIEB, U45, UCCS, SQUID) underwater image datasets. Additionally, we demonstrate its effectiveness for low-light image enhancement using the LOL dataset. Through extensive ablation studies and comparative analysis, it is clear that the proposed approach outperforms existing state-of-the-art (SOTA) methods.

MD Raqib Khan, Anshul Negi, Ashutosh Kulkarni, Shruti S. Phutke, Santosh Kumar Vipparthi, Subrahmanyam Murala• 2024

Related benchmarks

TaskDatasetResultRank
Underwater Image EnhancementSeaThru (sample images)
GPMAE36
48
Underwater Image EnhancementEUVP (test)
PSNR8.987
35
Underwater Image EnhancementU45
UCIQE0.781
23
Underwater Image EnhancementUFO-120 (test)
PSNR13.059
21
Underwater Image EnhancementLSUI (test)
PSNR9.821
19
Underwater Image EnhancementSeathru
UCIQE0.763
10
Underwater Image EnhancementOceanDark
UCIQE105.6
10
Underwater Image EnhancementUSOD10k
UCIQE0.503
10
Underwater Image EnhancementFISHTRAC
UCIQE0.489
10
Underwater Image EnhancementHICRD
CCF22.57
6
Showing 10 of 12 rows

Other info

Follow for update