Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

GSPan: A Continuous Gaussian Primitive Representation for Arbitrary-Scale Pansharpening

About

Pansharpening aims to generate high-resolution multispectral (HRMS) images by fusing low-resolution multispectral (LRMS) and panchromatic (PAN) observations. Most existing deep learning methods treat pansharpening as fixed-grid prediction, which limits scale adaptation. To address this, we propose GSPan, a framework that introduces 2D Gaussian Splatting (GS) into pansharpening. Instead of directly predicting pixels, GSPan represents band-wise residual details as continuous and learnable 2D Gaussian primitives. We design a Dual-Stream Hierarchical Interaction (DSHI) architecture with a Spatial-Spectral Interactive Attention (SSIA) module to estimate these primitives from complementary PAN and MS observations. The predicted primitives are rendered as a residual detail field and injected into the upsampled MS image. This continuous representation allows GSPan to render fused images on arbitrary target sampling grids without scale-specific retraining. It further enables a Scale-Decoupled Asymmetric Inference (SDAI) strategy, which estimates primitives at a reduced resolution and renders the fused image at the target resolution for efficient large-scene pansharpening. Experiments on QuickBird, GaoFen-2, WorldView-3, and WorldView-3-4K datasets show that GSPan delivers state-of-the-art fusion performance. Moreover, SDAI markedly accelerates inference, achieving a favorable trade-off between computational efficiency and fusion quality. Our results demonstrate the potential of continuous Gaussian residual representations as a flexible and scale-decoupled alternative to fixed-grid prediction.

Fangyi Li, Xiaoyuan Yang, Yixiao Li, Zongyang Sui, Kangqing Shen, Gemine Vivone• 2026

Related benchmarks

TaskDatasetResultRank
PansharpeningQB (QuickBird) full-resolution (test)
Dx0.0282
63
PansharpeningGaoFen-2 (GF2) full-resolution original (test)
D_lambda0.0111
34
PansharpeningQuickBird (QB) reduced-resolution (test)
SAM4.5566
28
PansharpeningWV3 full-resolution
0.0136
27
PansharpeningPancollection GF2 Reduced-resolution (test)
SAM0.7027
11
PansharpeningPancollection WV3 Reduced-resolution (test)
SAM2.9104
11
PansharpeningPancollection WV3 Full-resolution (test)
D_lambda0.014
11
Showing 7 of 7 rows

Other info

Follow for update