Language-guided Image Reflection Separation
About
This paper studies the problem of language-guided reflection separation, which aims at addressing the ill-posed reflection separation problem by introducing language descriptions to provide layer content. We propose a unified framework to solve this problem, which leverages the cross-attention mechanism with contrastive learning strategies to construct the correspondence between language descriptions and image layers. A gated network design and a randomized training strategy are employed to tackle the recognizable layer ambiguity. The effectiveness of the proposed method is validated by the significant performance advantage over existing reflection separation methods on both quantitative and qualitative comparisons.
Haofeng Zhong, Yuchen Hong, Shuchen Weng, Jinxiu Liang, Boxin Shi• 2024
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Single Image Reflection Removal | Real20 (test) | PSNR24.05 | 70 | |
| Image Reflection Removal | Real20 | PSNR24.05 | 56 | |
| Single Image Reflection Separation | SIR2 Postcard (test) | PSNR25.02 | 20 | |
| Single Image Reflection Separation | SIR2 Wild (test) | PSNR26.23 | 20 | |
| Single Image Reflection Removal | Nature (test) | PSNR23.87 | 19 | |
| Single Image Reflection Separation | SIR2 Objects (test) | PSNR26.51 | 12 | |
| Single Image Reflection Separation | Synthetic Datasets Average (540) (test) | PSNR25.72 | 12 | |
| Single Image Reflection Removal (Reflection Recovery) | SIR2 Objects 200 (test) | PSNR26.51 | 10 | |
| Reflection Separation | SIR2 199 (Postcard) | PSNR25.02 | 7 | |
| Reflection Separation | SIR2 Wild 101 | PSNR26.23 | 7 |
Showing 10 of 11 rows