AnyTSR: Any-Scale Thermal Super-Resolution for UAV
About
Thermal imaging can greatly enhance the application of intelligent unmanned aerial vehicles (UAV) in challenging environments. However, the inherent low resolution of thermal sensors leads to insufficient details and blurred boundaries. Super-resolution (SR) offers a promising solution to address this issue, while most existing SR methods are designed for fixed-scale SR. They are computationally expensive and inflexible in practical applications. To address above issues, this work proposes a novel any-scale thermal SR method (AnyTSR) for UAV within a single model. Specifically, a new image encoder is proposed to explicitly assign specific feature code to enable more accurate and flexible representation. Additionally, by effectively embedding coordinate offset information into the local feature ensemble, an innovative any-scale upsampler is proposed to better understand spatial relationships and reduce artifacts. Moreover, a novel dataset (UAV-TSR), covering both land and water scenes, is constructed for thermal SR tasks. Experimental results demonstrate that the proposed method consistently outperforms state-of-the-art methods across all scaling factors as well as generates more accurate and detailed high-resolution images. The code is located at https://github.com/vision4robotics/AnyTSR.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Hyperspectral Image Super-Resolution | Pavia x4 In-distribution (test) | PSNR27.1 | 6 | |
| Hyperspectral Image Super-Resolution | Pavia x6 Out-of-distribution (test) | PSNR25.48 | 6 | |
| HSI Super-Resolution | Houston x6 (test) | PSNR30.68 | 6 | |
| HSI Super-Resolution | Houston x8 (test) | PSNR29.53 | 6 | |
| Hyperspectral Image Super-Resolution | Pavia x8 Out-of-distribution (test) | PSNR24.52 | 6 | |
| HSI Super-Resolution | Houston x2 (test) | PSNR34.21 | 6 | |
| HSI Super-Resolution | Houston x4 (test) | PSNR31.71 | 6 | |
| HSI Super-Resolution | Chikusei x2 | PSNR38.06 | 6 | |
| HSI Super-Resolution | Chikusei x8 | PSNR31.47 | 6 | |
| Hyperspectral Image Super-Resolution | Pavia In-distribution x2 (test) | PSNR31.76 | 6 |