Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Make Explicit Calibration Implicit: Calibrate Denoiser Instead of the Noise Model

About

Explicit calibration-based methods have dominated RAW image denoising under extremely low-light environments. However, these methods are impeded by several critical limitations: a) the explicit calibration process is both labor- and time-intensive, b) challenge exists in transferring denoisers across different camera models, and c) the disparity between synthetic and real noise is exacerbated by digital gain. To address these issues, we introduce a groundbreaking pipeline named Lighting Every Darkness (LED), which is effective regardless of the digital gain or the camera sensor. LED eliminates the need for explicit noise model calibration, instead utilizing an implicit fine-tuning process that allows quick deployment and requires minimal data. Structural modifications are also included to reduce the discrepancy between synthetic and real noise without extra computational demands. Our method surpasses existing methods in various camera models, including new ones not in public datasets, with just a few pairs per digital gain and only 0.5% of the typical iterations. Furthermore, LED also allows researchers to focus more on deep learning advancements while still utilizing sensor engineering benefits. Code and related materials can be found in https://srameo.github.io/projects/led-iccv23/ .

Xin Jin, Jia-Wen Xiao, Ling-Hao Han, Chunle Guo, Xialei Liu, Chongyi Li, Ming-Ming Cheng• 2023

Related benchmarks

TaskDatasetResultRank
Image DenoisingMultiRAW Canon EOSR10
PSNR48.629
25
Image DenoisingMultiRAW Camera3
PSNR42.3091
25
Image DenoisingMultiRAW Camera4
PSNR50.1183
25
Image DenoisingMultiRAW Sony A6400
PSNR49.0211
25
Image DenoisingMultiRAW Camera5
PSNR46.9796
25
Raw Image DenoisingELD Nikon D850 (test)
PSNR50.6222
12
Raw Image DenoisingELD Canon EOS70D (test)
PSNR48.5063
12
Raw Image DenoisingELD Canon EOS700D (test)
PSNR47.7006
12
Raw Image DenoisingELD Sony A7S2 (test)
PSNR51.9547
12
Raw Image DenoisingSID Sony x100 gain (test)
PSNR41.9842
10
Showing 10 of 12 rows

Other info

Code

Follow for update