Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

CARD: Correlation Aware Restoration with Diffusion

About

Denoising diffusion models have achieved state-of-the-art performance in image restoration by modeling the process as sequential denoising steps. However, most approaches assume independent and identically distributed (i.i.d.) Gaussian noise, while real-world sensors often exhibit spatially correlated noise due to readout mechanisms, limiting their practical effectiveness. We introduce Correlation Aware Restoration with Diffusion (CARD), a training-free extension of DDRM that explicitly handles correlated Gaussian noise. CARD first whitens the noisy observation, which converts the noise into an i.i.d. form. Then, the diffusion restoration steps are replaced with noise-whitened updates, which inherits DDRM's closed-form sampling efficiency while now being able to handle correlated noise. To emphasize the importance of addressing correlated noise, we contribute CIN-D, a novel correlated noise dataset captured across diverse illumination conditions to evaluate restoration methods on real rolling-shutter sensor noise. This dataset fills a critical gap in the literature for experimental evaluation with real-world correlated noise. Experiments on standard benchmarks with synthetic correlated noise and on CIN-D demonstrate that CARD consistently outperforms existing methods across denoising, deblurring, and super-resolution tasks.

Niki Nezakati, Arnab Ghosh, Amit Roy-Chowdhury, Vishwanath Saragadam• 2025

Related benchmarks

TaskDatasetResultRank
DenoisingLSUN Bed + Cat Average (val)
PSNR34.7
30
DenoisingCIN-D Indoor Scenes
PSNR39.8
30
DenoisingCIN-D Outdoor Scenes
PSNR36.4
30
Super-ResolutionLSUN Bed + Cat Average (test)
PSNR29
12
DenoisingCIN-D Low Noise Level
PSNR38.1
10
DenoisingCIN-D High Noise Level
PSNR31.5
10
DenoisingImageNet noise level sigma=0.1 (val)
PSNR34
10
DenoisingImageNet noise level sigma=0.5 (val)
PSNR29.1
10
DenoisingImageNet noise level sigma=0.9 (val)
PSNR26.7
10
Gaussian DeblurringImageNet sigma=0.2 (test)
PSNR26.6
6
Showing 10 of 13 rows

Other info

Follow for update