PSGAN: A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening
About
This paper addresses the problem of remote sensing image pan-sharpening from the perspective of generative adversarial learning. We propose a novel deep neural network based method named PSGAN. To the best of our knowledge, this is one of the first attempts at producing high-quality pan-sharpened images with GANs. The PSGAN consists of two components: a generative network (i.e., generator) and a discriminative network (i.e., discriminator). The generator is designed to accept panchromatic (PAN) and multispectral (MS) images as inputs and maps them to the desired high-resolution (HR) MS images and the discriminator implements the adversarial training strategy for generating higher fidelity pan-sharpened images. In this paper, we evaluate several architectures and designs, namely two-stream input, stacking input, batch normalization layer, and attention mechanism to find the optimal solution for pan-sharpening. Extensive experiments on QuickBird, GaoFen-2, and WorldView-2 satellite images demonstrate that the proposed PSGANs not only are effective in generating high-quality HR MS images and superior to state-of-the-art methods and also generalize well to full-scale images.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Pansharpening | QB (QuickBird) full-resolution (test) | Dx0.0289 | 63 | |
| Pansharpening | GaoFen-2 (GF2) full-resolution original (test) | D_lambda0.0117 | 34 | |
| Pansharpening | QuickBird (QB) reduced-resolution (test) | SAM4.9338 | 28 | |
| Pansharpening | WV3 full-resolution | Dλ0.348 | 27 | |
| Pansharpening | Pancollection GF2 Reduced-resolution (test) | SAM0.8332 | 11 | |
| Pansharpening | Pancollection WV3 Reduced-resolution (test) | SAM3.2393 | 11 | |
| Pansharpening | Pancollection WV3 Full-resolution (test) | D_lambda0.019 | 11 |