Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Language-guided Image Reflection Separation

About

This paper studies the problem of language-guided reflection separation, which aims at addressing the ill-posed reflection separation problem by introducing language descriptions to provide layer content. We propose a unified framework to solve this problem, which leverages the cross-attention mechanism with contrastive learning strategies to construct the correspondence between language descriptions and image layers. A gated network design and a randomized training strategy are employed to tackle the recognizable layer ambiguity. The effectiveness of the proposed method is validated by the significant performance advantage over existing reflection separation methods on both quantitative and qualitative comparisons.

Haofeng Zhong, Yuchen Hong, Shuchen Weng, Jinxiu Liang, Boxin Shi• 2024

Related benchmarks

TaskDatasetResultRank
Single Image Reflection RemovalReal20 (test)
PSNR24.05
107
Single Image Reflection RemovalWild 55 images (test)
PSNR26.23
65
Image Reflection RemovalReal20
PSNR24.05
56
Single Image Reflection RemovalObjects 200 images (test)
PSNR26.51
47
Single Image Reflection RemovalPostcard 199 (test)
PSNR25.02
37
Single Image Reflection SeparationSIR2 Postcard (test)
PSNR25.02
20
Single Image Reflection SeparationSIR2 Wild (test)
PSNR26.23
20
Single Image Reflection RemovalNature (test)
PSNR23.87
19
Reflection RemovalNature (test)
PSNR23.87
19
Single Image Reflection SeparationSIR2 Objects (test)
PSNR26.51
12
Showing 10 of 15 rows

Other info

Follow for update