Learning to Balance: Decoupled Siamese Diffusion Transformer for Reference-Based Remote Sensing Image Super-Resolution
About
Diffusion-based methods demonstrate significant potential for remote sensing image super-resolution at large scaling factors, particularly in reference-based super-resolution (RefSR), where high-resolution reference images provide critical fine-grained texture priors. However, existing methods often suffer from a trade-off between over-reliance on reference information, which leads to texture artifacts, and under-utilization of such information, which results in insufficient detail recovery. To address these issues, we propose DS-DiT, a Decoupled Siamese Diffusion Transformer that decouples the interaction between low-resolution (LR) and reference (Ref) conditions within the attention mechanism. By allowing LR structural priors and Ref texture information to independently interact with the noisy latent, the framework effectively mitigates competition between the two conditional sources. To further compensate for the limited local modeling ability of global attention, we introduce a Patch-Level Weighting (PLW) module that adaptively modulates the fusion of conditional sources. In addition, the siamese architecture enables an inference-time autoguidance strategy that exploits the prediction discrepancy between strong and weak Ref conditions to improve generation quality without additional training. Experimental results across multiple datasets and scaling factors show that DS-DiT outperforms existing methods in both quantitative metrics and visual fidelity.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Reference-based Super-Resolution | CNAM-CD | LPIPS0.2101 | 10 | |
| Reference-based Super-Resolution | SECOND full x8 (test) | LPIPS0.2174 | 7 | |
| Reference-based Super-Resolution | SECOND full x16 (test) | LPIPS0.2905 | 7 | |
| Reference-based Super-Resolution | FUSU x8 (test) | LPIPS0.1741 | 7 | |
| Reference-based Super-Resolution | FUSU x16 (test) | LPIPS0.2301 | 7 | |
| Reference-based Super-Resolution | Real-RefRSSRD | LPIPS0.3261 | 5 |