GeoDiT: Point-Conditioned Diffusion Transformer for Satellite Image Synthesis
About
We introduce GeoDiT, a diffusion transformer designed for text-to-satellite image generation with point-based control. Existing controlled satellite image generative models often require pixel-level maps that are time-consuming to acquire, yet semantically limited. To address this limitation, we introduce a novel point-based conditioning framework that controls the generation process through the spatial location of the points and the textual description associated with each point, providing semantically rich control signals. This approach enables flexible, annotation-friendly, and computationally simple inference for satellite image generation. To this end, we introduce an adaptive local attention mechanism that effectively regularizes the attention scores based on the input point queries. We systematically evaluate various domain-specific design choices for training GeoDiT, including the selection of satellite image representation for alignment and geolocation representation for conditioning. Our experiments demonstrate that GeoDiT achieves impressive generation performance, surpassing the state-of-the-art remote sensing generative models.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Satellite image generation | Git-Rand 15k | FID12.01 | 14 | |
| Satellite image generation | Git-Spatial 15k | FID19.18 | 14 | |
| AI-generated image detection | Git-Spatial-15k (test) | F1 Score (Fake Class)81.7 | 14 | |
| AI-generated image detection | Git-Rand-15k (test) | F1 Score (Fake Class)74.25 | 14 | |
| Satellite image generation | fMoW | FID32.11 | 13 | |
| Satellite image generation | RSICD | FID31.76 | 12 | |
| AI-generated image detection | fMoW (test) | F1 Score (Fake Class)92.35 | 12 | |
| AI-generated image detection | RSICD (test) | F1 Score (Fake Class)91.85 | 12 | |
| Inpainting | Git-Rand-15k (test) | FID16.81 | 4 |