Single Image Reflection Removal with Patch Reflectance Prior
About
Single Image Reflection Removal (SIRR) in real-world images is a challenging task due to diverse image degradations occurring on the glass surface during light transmission and reflection. Many existing methods rely on specific prior assumptions to resolve the problem. In this paper, we propose a general reflection intensity prior that captures the intensity of the reflection phenomenon and demonstrate its effectiveness. To learn the reflection intensity prior, we introduce the Reflection Prior Extraction Network (RPEN). By segmenting images into regional patches, RPEN learns non-uniform reflection prior in an image. We propose Prior-based Reflection Removal Network (PRRN) using a simple transformer U-Net architecture that adapts reflection prior fed from RPEN. Experimental results on real-world benchmarks demonstrate the effectiveness of our approach achieving state-of-the-art accuracy in SIRR.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Single Image Reflection Removal | Real20 (test) | PSNR23.78 | 77 | |
| Single Image Reflection Removal | Wild 55 images (test) | PSNR25.48 | 35 | |
| Single Image Reflection Removal | Objects 200 images (test) | PSNR25.08 | 17 | |
| Single Image Reflection Removal | CDR All | PSNR24.31 | 12 | |
| Single Image Reflection Removal | CDR SRST | PSNR23.13 | 12 | |
| Single Image Reflection Removal | CDR BRST | PSNR25.51 | 12 | |
| Single Image Reflection Removal | CDR Non-ghosting | PSNR23.71 | 12 | |
| Single Image Reflection Removal | CDR Weak R | PSNR28.04 | 12 | |
| Single Image Reflection Removal | CDR Moderate R | PSNR23.34 | 12 | |
| Single Image Reflection Removal | CDR Ghosting | PSNR26.63 | 12 |