Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

PQDynamicISP: Dynamically Controlled Image Signal Processor for Any Image Sensors Pursuing Perceptual Quality

About

Full DNN-based image signal processors (ISPs) have been actively studied and have achieved superior image quality compared to conventional ISPs. In contrast to this trend, we propose a lightweight ISP that consists of simple conventional ISP functions but achieves high image quality by increasing expressiveness. Specifically, instead of tuning the parameters of the ISP, we propose to control them dynamically for each environment and even locally. As a result, state-of-the-art accuracy is achieved on various datasets, including other tasks like tone mapping and image enhancement, even though ours is lighter than DNN-based ISPs. Additionally, our method can process different image sensors with a single ISP through dynamic control, whereas conventional methods require training for each sensor.

Masakazu Yoshimura, Junji Otsuka, Takeshi Ohashi• 2024

Related benchmarks

TaskDatasetResultRank
Image EnhancementAdobe Five-K
PSNR25.53
22
Tone MappingFiveK
PSNR25.72
15
Tone MappingHDR+
PSNR26.72
8
Universal ISPFiveK
PSNR23.59
6
Image Signal ProcessingMAI 2021 (Internal)
PSNR24.63
4
Image Signal ProcessingMAI 2021 (test)--
4
Showing 6 of 6 rows

Other info

Follow for update