CoFusion: Multispectral and Hyperspectral Image Fusion via Spectral Coordinate Attention
About
Multispectral and Hyperspectral Image Fusion (MHIF) aims to reconstruct high-resolution images by integrating low-resolution hyperspectral images (LRHSI) and high-resolution multispectral images (HRMSI). However, existing methods face limitations in modeling cross-scale interactions and spatial-spectral collaboration, making it difficult to achieve an optimal trade-off between spatial detail enhancement and spectral fidelity. To address this challenge, we propose CoFusion: a unified spatial-spectral collaborative fusion framework that explicitly models cross-scale and cross-modal dependencies. Specifically, a Multi-Scale Generator (MSG) is designed to construct a three-level pyramidal architecture, enabling the effective integration of global semantics and local details. Within each scale, a dual-branch strategy is employed: the Spatial Coordinate-Aware Mixing module (SpaCAM) is utilized to capture multi-scale spatial contexts, while the Spectral Coordinate-Aware Mixing module (SpeCAM) enhances spectral representations through frequency decomposition and coordinate mixing. Furthermore, we introduce the Spatial-Spectral Cross-Fusion Module (SSCFM) to perform dynamic cross-modal alignment and complementary feature fusion. Extensive experiments on multiple benchmark datasets demonstrate that CoFusion consistently outperforms state-of-the-art methods, achieving superior performance in both spatial reconstruction and spectral consistency.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Hyperspectral Image Super-Resolution | PaviaU (test) | MPSNR41.3824 | 66 | |
| Hyperspectral Image Super-Resolution | CAVE (test) | SAM2.0238 | 39 | |
| Hyperspectral Image Super-Resolution | Chikusei (test) | PSNR53.0875 | 27 | |
| Hyperspectral Image Fusion | Chikusei | D_lambda0.0638 | 9 | |
| Hyperspectral Image Fusion | CAVE | D_lambda0.0715 | 9 | |
| Hyperspectral Image Fusion | PaviaU | D_lambda0.0882 | 9 |