Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

CE-VAE: Capsule Enhanced Variational AutoEncoder for Underwater Image Enhancement

About

Unmanned underwater image analysis for marine monitoring faces two key challenges: (i) degraded image quality due to light attenuation and (ii) hardware storage constraints limiting high-resolution image collection. Existing methods primarily address image enhancement with approaches that hinge on storing the full-size input. In contrast, we introduce the Capsule Enhanced Variational AutoEncoder (CE-VAE), a novel architecture designed to efficiently compress and enhance degraded underwater images. Our attention-aware image encoder can project the input image onto a latent space representation while being able to run online on a remote device. The only information that needs to be stored on the device or sent to a beacon is a compressed representation. There is a dual-decoder module that performs offline, full-size enhanced image generation. One branch reconstructs spatial details from the compressed latent space, while the second branch utilizes a capsule-clustering layer to capture entity-level structures and complex spatial relationships. This parallel decoding strategy enables the model to balance fine-detail preservation with context-aware enhancements. CE-VAE achieves state-of-the-art performance in underwater image enhancement on six benchmark datasets, providing up to 3x higher compression efficiency than existing approaches. Code available at \url{https://github.com/iN1k1/ce-vae-underwater-image-enhancement}.

Rita Pucci, Niki Martinel• 2024

Related benchmarks

TaskDatasetResultRank
Underwater Image EnhancementLSUI (test)
PSNR22.638
55
Underwater Image EnhancementEUVP (test)
PSNR27.75
47
Underwater Image EnhancementEUVP
UIQM2.745
34
Underwater Image EnhancementUFO-120 (test)
PSNR24.38
21
Underwater Image EnhancementLSUI L400 (test)
PSNR24.49
17
Underwater Image EnhancementUIEB
MUSIQ Score46.304
13
Underwater Image EnhancementLSUI
PAQ2PIQ71.816
11
Underwater Image EnhancementReplica
PSNR16.0331
11
Underwater Image EnhancementUnderwater Image Enhancement (aggregated)
Average Rank8
11
Underwater Image EnhancementP2UIE 1473
PAQ2PIQ71.001
11
Showing 10 of 15 rows

Other info

Code

Follow for update