Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

NAFSSR: Stereo Image Super-Resolution Using NAFNet

About

Stereo image super-resolution aims at enhancing the quality of super-resolution results by utilizing the complementary information provided by binocular systems. To obtain reasonable performance, most methods focus on finely designing modules, loss functions, and etc. to exploit information from another viewpoint. This has the side effect of increasing system complexity, making it difficult for researchers to evaluate new ideas and compare methods. This paper inherits a strong and simple image restoration model, NAFNet, for single-view feature extraction and extends it by adding cross attention modules to fuse features between views to adapt to binocular scenarios. The proposed baseline for stereo image super-resolution is noted as NAFSSR. Furthermore, training/testing strategies are proposed to fully exploit the performance of NAFSSR. Extensive experiments demonstrate the effectiveness of our method. In particular, NAFSSR outperforms the state-of-the-art methods on the KITTI 2012, KITTI 2015, Middlebury, and Flickr1024 datasets. With NAFSSR, we won 1st place in the NTIRE 2022 Stereo Image Super-resolution Challenge. Codes and models will be released at https://github.com/megvii-research/NAFNet.

Xiaojie Chu, Liangyu Chen, Wenqing Yu• 2022

Related benchmarks

TaskDatasetResultRank
Stereo Image Super-ResolutionKITTI 2012 (test)
PSNR31.6
58
Super-ResolutionKITTI 2012 (Left)
PSNR31.45
43
Super-ResolutionKITTI 2015 (Left)
PSNR30.46
43
Super-ResolutionKITTI (Left + Right) / 2 2012
PSNR31.6
43
Super-ResolutionKITTI (Left + Right) / 2 2015
PSNR31.25
43
Super-ResolutionMiddlebury (Left + Right) / 2
PSNR35.88
43
Stereo Image Super-ResolutionKITTI 2012
PSNR31.23
42
Super-ResolutionFlickr1024 ((Left + Right) / 2)
PSNR29.68
41
Stereo Image Super-ResolutionMiddlebury Left
PSNR35.83
27
Stereo Image Super-ResolutionFlickr1024--
22
Showing 10 of 10 rows

Other info

Code

Follow for update