Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

CE-VAE: Capsule Enhanced Variational AutoEncoder for Underwater Image Enhancement

About

Unmanned underwater image analysis for marine monitoring faces two key challenges: (i) degraded image quality due to light attenuation and (ii) hardware storage constraints limiting high-resolution image collection. Existing methods primarily address image enhancement with approaches that hinge on storing the full-size input. In contrast, we introduce the Capsule Enhanced Variational AutoEncoder (CE-VAE), a novel architecture designed to efficiently compress and enhance degraded underwater images. Our attention-aware image encoder can project the input image onto a latent space representation while being able to run online on a remote device. The only information that needs to be stored on the device or sent to a beacon is a compressed representation. There is a dual-decoder module that performs offline, full-size enhanced image generation. One branch reconstructs spatial details from the compressed latent space, while the second branch utilizes a capsule-clustering layer to capture entity-level structures and complex spatial relationships. This parallel decoding strategy enables the model to balance fine-detail preservation with context-aware enhancements. CE-VAE achieves state-of-the-art performance in underwater image enhancement on six benchmark datasets, providing up to 3x higher compression efficiency than existing approaches. Code available at \url{https://github.com/iN1k1/ce-vae-underwater-image-enhancement}.

Rita Pucci, Niki Martinel• 2024

Related benchmarks

TaskDatasetResultRank
Underwater Image EnhancementEUVP (test)
PSNR27.75
35
Underwater Image EnhancementUFO-120 (test)
PSNR24.38
21
Underwater Image EnhancementLSUI L400 (test)
PSNR24.49
9
Underwater Image EnhancementU45 non-reference (test)
UIQM3.23
9
Underwater Image EnhancementSQUID non-reference (test)
UIQM2.44
9
Underwater Image EnhancementUCCS non-reference (test)
UIQM3.21
9
Showing 6 of 6 rows

Other info

Code

Follow for update