Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Bi^2MAC: Bimodal Bi-Adaptive Mask-Aware Convolution for Remote Sensing Pansharpening

About

Pansharpening aims to fuse a high-resolution panchromatic (PAN) image with a low-resolution multispectral (LRMS) image to generate a high-resolution multispectral image (HRMS). Conventional deep learning-based methods are inherently limited in their ability to adapt to regional heterogeneity within feature representations. Although various adaptive convolution methods have been proposed to address this limitation, they often suffer from excessive computational costs and a limited ability to capture heterogeneous regions in remote sensing images effectively. To overcome these challenges, we propose Bimodal Bi-Adaptive Mask-Aware Convolution (Bi^2MAC), which effectively exploits information from different types of regions while intelligently allocating computational resources. Specifically, we design a lightweight module to generate both soft and hard masks, which are used to modulate the input features preliminarily and to guide different types of regions into separate processing branches, respectively. Redundant features are directed to a compact branch for low-cost global processing. In contrast, heterogeneous features are routed to a focused branch that invests more computational resources for fine-grained modeling. Extensive experiments on multiple benchmark datasets demonstrate that Bi^2MAC achieves state-of-the-art (SOTA) performance while requiring substantially lower training time and parameter counts, and the minimal computational cost among adaptive convolution models.

Xianghong Xiao, Zeyu Xia, Zhou Fei, Jinliang Xiao, Haorui Chen, Liangjian Deng• 2025

Related benchmarks

TaskDatasetResultRank
PansharpeningWorldView-3 full-resolution original (test)
D_lambda0.0165
81
PansharpeningQuickBird full-resolution
D_lambda (Spectral Divergence)0.0433
56
PansharpeningGaoFen-2 (GF2) full-resolution
D_lambda0.0206
39
PansharpeningQuickBird (QB) reduced-resolution (test)
SAM4.3694
17
PansharpeningWorldView-3 Reduced-resolution (test)
SAM2.8569
17
PansharpeningQuickBird (QB) Reduced-resolution (20 samples)
SAM4.3694
13
PansharpeningGaofen-2 (GF2) Reduced-Resolution (20 samples)
SAM0.6448
13
PansharpeningWorldView-3 Reduced (20 samples)
SAM2.8569
13
PansharpeningWorldView-3 Full (20 full-resolution samples)
Dλ (Spectral Divergence)0.0165
13
PansharpeningGaofen-2 (GF2) reduced-resolution (test)
SAM0.6448
5
Showing 10 of 10 rows

Other info

Follow for update