MPRNet: Multi-Path Residual Network for Lightweight Image Super Resolution
About
Lightweight super resolution networks have extremely importance for real-world applications. In recent years several SR deep learning approaches with outstanding achievement have been introduced by sacrificing memory and computational cost. To overcome this problem, a novel lightweight super resolution network is proposed, which improves the SOTA performance in lightweight SR and performs roughly similar to computationally expensive networks. Multi-Path Residual Network designs with a set of Residual concatenation Blocks stacked with Adaptive Residual Blocks: ($i$) to adaptively extract informative features and learn more expressive spatial context information; ($ii$) to better leverage multi-level representations before up-sampling stage; and ($iii$) to allow an efficient information and gradient flow within the network. The proposed architecture also contains a new attention mechanism, Two-Fold Attention Module, to maximize the representation ability of the model. Extensive experiments show the superiority of our model against other SOTA SR approaches.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Perceptual Image Restoration | Average across datasets (combined) | PSNR32.49 | 35 | |
| Semantic segmentation | Vaihingen CR-thin | mIoU71.3 | 20 | |
| Semantic segmentation | Vaihingen CR-thick | mIoU0.619 | 20 | |
| Classification | CLS-2 | Accuracy50 | 11 | |
| Semantic segmentation | SEG-3 | mIoU67.5 | 11 | |
| Height Estimation | HE-2 | RMSE2.905 | 11 | |
| Height Estimation | HE-3 | RMSE1.711 | 11 | |
| Semantic segmentation | SEG-2 | mIoU55.9 | 11 | |
| Building Extraction | BLD-2 | IoU53.4 | 11 | |
| Classification | CLS-1 | Accuracy49.8 | 11 |