Single Image Reflection Separation via Dual Prior Interaction Transformer
About
Single image reflection separation aims to separate the transmission and reflection layers from a mixed image. Existing methods typically combine general priors from pre-trained models with task-specific priors such as text prompts and reflection detection. However, the transmission prior, as the most direct task-specific prior for the target transmission layer, has not been effectively modeled or fully utilized, limiting performance in complex scenarios. To address this issue, we propose a dual-prior interaction framework based on lightweight transmission prior generation and effective prior fusion. First, we design a Local Linear Correction Network (LLCN) that finetunes pre-trained models based on the physical constraint T=SI+B, where S and B represent pixel-wise and channel-wise scaling and bias transformations. LLCN efficiently generates high-quality transmission priors with minimal parameters. Second, we construct a Dual-Prior Interaction Transformer (DPIT) that employs a dual-stream channel reorganization attention mechanism. By reorganizing features from general and transmission priors for attention computation, DPIT achieves deep fusion of both priors, fully exploiting their complementary information. Experimental results on multiple benchmark datasets demonstrate that the proposed method achieves state-of-the-art performance.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Image Reflection Removal | Real20 | PSNR25.46 | 56 | |
| Image Reflection Removal | Nature | PSNR27.15 | 18 | |
| Single Image Reflection Removal | Nature 20 | PSNR27.03 | 15 | |
| Reflection Removal | SIR2 zero-shot 454/500 | PSNR (SIR2 454, Zero-Shot)26.9 | 11 | |
| Reflection Removal | SIR2 Objects | PSNR27.38 | 9 | |
| Reflection Removal | SIR2 Postcard | PSNR26.98 | 9 | |
| Reflection Removal | SIR2 Wild | PSNR28.11 | 9 | |
| Reflection Removal | Average 494 | PSNR27.21 | 9 | |
| Single Image Reflection Removal | Five Real-world Datasets (Real20, Objects, Postcard, Wild, Nature) Average (494) (test) | PSNR27.21 | 9 |