Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

LLCaps: Learning to Illuminate Low-Light Capsule Endoscopy with Curved Wavelet Attention and Reverse Diffusion

About

Wireless capsule endoscopy (WCE) is a painless and non-invasive diagnostic tool for gastrointestinal (GI) diseases. However, due to GI anatomical constraints and hardware manufacturing limitations, WCE vision signals may suffer from insufficient illumination, leading to a complicated screening and examination procedure. Deep learning-based low-light image enhancement (LLIE) in the medical field gradually attracts researchers. Given the exuberant development of the denoising diffusion probabilistic model (DDPM) in computer vision, we introduce a WCE LLIE framework based on the multi-scale convolutional neural network (CNN) and reverse diffusion process. The multi-scale design allows models to preserve high-resolution representation and context information from low-resolution, while the curved wavelet attention (CWA) block is proposed for high-frequency and local feature learning. Furthermore, we combine the reverse diffusion procedure to further optimize the shallow output and generate the most realistic image. The proposed method is compared with ten state-of-the-art (SOTA) LLIE methods and significantly outperforms quantitatively and qualitatively. The superior performance on GI disease segmentation further demonstrates the clinical potential of our proposed model. Our code is publicly accessible.

Long Bai, Tong Chen, Yanan Wu, An Wang, Mobarakol Islam, Hongliang Ren• 2023

Related benchmarks

TaskDatasetResultRank
Low-light Image EnhancementRLE (test)
PSNR33.18
20
Semantic segmentationEndoVis 17
Dice83.49
18
Semantic segmentationReal-world
Dice0.5734
14
Low-light Image EnhancementEndoVis18
PSNR25.18
14
Low-light Image EnhancementEndoVis 17
FPS1.87
14
Low-light Image EnhancementKvasir-Capsule (test)
PSNR35.24
12
Low-light Image EnhancementKvasir-Capsule (external val)
LPIPS0.3082
12
Red Lesion SegmentationRLE (test)
mIoU66.47
12
Medical Image RestorationCEC
PSNR27.55
11
Showing 9 of 9 rows

Other info

Code

Follow for update