Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

TerraDiT-$\Omega$: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitive

About

Generative models have achieved remarkable progress, yet applying them to satellite imagery remains challenging. Unlike natural imagery, satellite scenes are structured by spatially complex and semantically distinct geometries. Prior work addresses this complexity by adapting natural image frameworks using dense rasters or sparse prompts, trading off annotation cost and fidelity while breaking compatibility with vector primitives commonly used to represent geographic information. We introduce TerraDiT-$\Omega$, a unified spatial control framework that generates satellite imagery directly from any native geospatial primitive. By jointly leveraging precise annotations (polygons, polylines) and coarser ones (bounding boxes, points), the model supports controllable layouts across varying annotation budgets, broadening applicability to design tasks such as urban planning while remaining naturally compatible with end-to-end GeoAI workflows. To effectively leverage these primitives during generation, we propose Geometry-Aware Local Attention, a conditioning mechanism that injects explicit geometric cues into the attention space. Across all conditioning formats, our approach consistently outperforms both dense-control and sparse-control baselines. Furthermore, this flexibility enables controllable synthetic data augmentation using a single generative model, improving downstream performance on land-cover segmentation, object detection, road graph extraction, and scene classification. Code, data, and weights are available at https://github.com/mvrl/TerraDiT.

Brian Wei, Srikumar Sastry, Daniel Cher, Eric Xing, Nathan Jacobs• 2026

Related benchmarks

TaskDatasetResultRank
Satellite image generationGit-Rand 15k
FID9.25
35
Satellite image generationGit-Spatial 15k
FID17.46
35
Satellite Image SynthesisGit-Dense 3.5k
FID18.2
21
Spatially Controlled Image GenerationGit-Rand 15k
Top-1 Acc79.36
10
Showing 4 of 4 rows

Other info

GitHub

Follow for update