Single Image Reflection Separation via Component Synergy
About
The reflection superposition phenomenon is complex and widely distributed in the real world, which derives various simplified linear and nonlinear formulations of the problem. In this paper, based on the investigation of the weaknesses of existing models, we propose a more general form of the superposition model by introducing a learnable residue term, which can effectively capture residual information during decomposition, guiding the separated layers to be complete. In order to fully capitalize on its advantages, we further design the network structure elaborately, including a novel dual-stream interaction mechanism and a powerful decomposition network with a semantic pyramid encoder. Extensive experiments and ablation studies are conducted to verify our superiority over state-of-the-art approaches on multiple real-world benchmark datasets. Our code is publicly available at https://github.com/mingcv/DSRNet.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Single Image Reflection Removal | Real20 (test) | PSNR24.52 | 70 | |
| Image Reflection Removal | Real20 | PSNR24.23 | 56 | |
| Image Reflection Removal | Wild | PSNR26.11 | 20 | |
| Image Reflection Removal | Postcard | PSNR24.83 | 20 | |
| Single Image Reflection Separation | SIR2 Postcard (test) | PSNR24.46 | 20 | |
| Single Image Reflection Separation | SIR2 Wild (test) | PSNR26.52 | 20 | |
| Single Image Reflection Removal | Nature (test) | PSNR25.61 | 19 | |
| Single Image Reflection Removal | Wild 55 images (test) | PSNR26.11 | 19 | |
| Single Image Reflection Removal | Average (Real20, Objects, Postcard, Wild) (test) | PSNR25.75 | 18 | |
| Image Reflection Removal | Nature | PSNR25.27 | 18 |