Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

See More Details: Efficient Image Super-Resolution by Experts Mining

About

Reconstructing high-resolution (HR) images from low-resolution (LR) inputs poses a significant challenge in image super-resolution (SR). While recent approaches have demonstrated the efficacy of intricate operations customized for various objectives, the straightforward stacking of these disparate operations can result in a substantial computational burden, hampering their practical utility. In response, we introduce SeemoRe, an efficient SR model employing expert mining. Our approach strategically incorporates experts at different levels, adopting a collaborative methodology. At the macro scale, our experts address rank-wise and spatial-wise informative features, providing a holistic understanding. Subsequently, the model delves into the subtleties of rank choice by leveraging a mixture of low-rank experts. By tapping into experts specialized in distinct key factors crucial for accurate SR, our model excels in uncovering intricate intra-feature details. This collaborative approach is reminiscent of the concept of "see more", allowing our model to achieve an optimal performance with minimal computational costs in efficient settings. The source will be publicly made available at https://github.com/eduardzamfir/seemoredetails

Eduard Zamfir, Zongwei Wu, Nancy Mehta, Yulun Zhang, Radu Timofte• 2024

Related benchmarks

TaskDatasetResultRank
Image Super-resolutionManga109
PSNR39.49
875
Image Super-resolutionSet5
PSNR38.27
774
Super-ResolutionUrban100
PSNR32.87
670
Image Super-resolutionSet14
PSNR34.01
565
Super-ResolutionManga109
PSNR31.48
368
Image Super-resolutionUrban100 x4 (test)
PSNR26.79
309
Image Super-resolutionB100
PSNR32.35
137
Image Super-resolutionUrban100 x2 (test)
PSNR32.87
118
Image Super-resolutionUrban100 x3 (test)
PSNR28.86
96
Image Super-resolutionManga109 x2 (test)
PSNR39.49
92
Showing 10 of 30 rows

Other info

Follow for update