Deep Atrous Guided Filter for Image Restoration in Under Display Cameras
About
Under Display Cameras present a promising opportunity for phone manufacturers to achieve bezel-free displays by positioning the camera behind semi-transparent OLED screens. Unfortunately, such imaging systems suffer from severe image degradation due to light attenuation and diffraction effects. In this work, we present Deep Atrous Guided Filter (DAGF), a two-stage, end-to-end approach for image restoration in UDC systems. A Low-Resolution Network first restores image quality at low-resolution, which is subsequently used by the Guided Filter Network as a filtering input to produce a high-resolution output. Besides the initial downsampling, our low-resolution network uses multiple, parallel atrous convolutions to preserve spatial resolution and emulates multi-scale processing. Our approach's ability to directly train on megapixel images results in significant performance improvement. We additionally propose a simple simulation scheme to pre-train our model and boost performance. Our overall framework ranks 2nd and 5th in the RLQ-TOD'20 UDC Challenge for POLED and TOLED displays, respectively.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| UDC Image Restoration | Synthetic UDC dataset HDRI Haven (test) | PSNR27.12 | 13 | |
| Hardware-induced Blur Removal | T-OLED | PSNR36.49 | 9 | |
| UDC Restoration | POLED (test) | PSNR32.29 | 7 | |
| UDC Restoration | TOLED (test) | PSNR36.49 | 7 | |
| Under-display camera image restoration | POLED 49 (val) | PSNR33.79 | 6 | |
| Under-display camera image restoration | TOLED 49 (val) | PSNR37.87 | 6 |