Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Single Image Reflection Separation with Perceptual Losses

About

We present an approach to separating reflection from a single image. The approach uses a fully convolutional network trained end-to-end with losses that exploit low-level and high-level image information. Our loss function includes two perceptual losses: a feature loss from a visual perception network, and an adversarial loss that encodes characteristics of images in the transmission layers. We also propose a novel exclusion loss that enforces pixel-level layer separation. We create a dataset of real-world images with reflection and corresponding ground-truth transmission layers for quantitative evaluation and model training. We validate our method through comprehensive quantitative experiments and show that our approach outperforms state-of-the-art reflection removal methods in PSNR, SSIM, and perceptual user study. We also extend our method to two other image enhancement tasks to demonstrate the generality of our approach.

Xuaner Zhang, Ren Ng, Qifeng Chen• 2018

Related benchmarks

TaskDatasetResultRank
Single Image Reflection RemovalReal20 (test)
PSNR22.55
70
Image Reflection RemovalReal20
PSNR22.55
56
Single Image Reflection RemovalObjects (test)
PSNR22.72
22
Single Image Reflection SeparationSIR2 Postcard (test)
PSNR22.89
20
Single Image Reflection SeparationSIR2 Wild (test)
PSNR24.82
20
Image Reflection RemovalWild
PSNR21.52
20
Image Reflection RemovalPostcard
PSNR16.81
20
Single Image Reflection RemovalNature (test)
PSNR22
19
Single Image Reflection RemovalWild 55 images (test)
PSNR21.52
19
Single Image Reflection RemovalAverage (Real20, Objects, Postcard, Wild) (test)
PSNR20.22
18
Showing 10 of 24 rows

Other info

Follow for update