Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Symmetric Parallax Attention for Stereo Image Super-Resolution

About

Although recent years have witnessed the great advances in stereo image super-resolution (SR), the beneficial information provided by binocular systems has not been fully used. Since stereo images are highly symmetric under epipolar constraint, in this paper, we improve the performance of stereo image SR by exploiting symmetry cues in stereo image pairs. Specifically, we propose a symmetric bi-directional parallax attention module (biPAM) and an inline occlusion handling scheme to effectively interact cross-view information. Then, we design a Siamese network equipped with a biPAM to super-resolve both sides of views in a highly symmetric manner. Finally, we design several illuminance-robust losses to enhance stereo consistency. Experiments on four public datasets demonstrate the superior performance of our method. Source code is available at https://github.com/YingqianWang/iPASSR.

Yingqian Wang, Xinyi Ying, Longguang Wang, Jungang Yang, Wei An, Yulan Guo• 2020

Related benchmarks

TaskDatasetResultRank
Super-ResolutionKITTI 2012 (Left)
PSNR30.97
43
Super-ResolutionKITTI 2015 (Left)
PSNR30.01
43
Super-ResolutionKITTI (Left + Right) / 2 2012
PSNR31.11
43
Super-ResolutionKITTI (Left + Right) / 2 2015
PSNR30.81
43
Super-ResolutionMiddlebury (Left + Right) / 2
PSNR34.51
43
Stereo Image Super-ResolutionKITTI 2012
PSNR31.11
42
Stereo Image Super-ResolutionMiddlebury
PSNR34.51
42
Super-ResolutionFlickr1024 ((Left + Right) / 2)
PSNR28.6
41
Stereo Image Super-ResolutionKITTI 2015
PSNR30.81
40
Stereo Image Super-ResolutionMiddlebury Left
PSNR34.41
27
Showing 10 of 14 rows

Other info

Code

Follow for update