Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

VectorSynth: Fine-Grained Satellite Image Synthesis with Structured Semantics

About

We introduce VectorSynth, a diffusion-based framework for pixel-accurate satellite image synthesis conditioned on polygonal geographic annotations with semantic attributes. Unlike prior text- or layout-conditioned models, VectorSynth learns dense cross-modal correspondences that align imagery and semantic vector geometry, enabling fine-grained, spatially grounded edits. A vision language alignment module produces pixel-level embeddings from polygon semantics; these embeddings guide a conditional image generation framework to respect both spatial extents and semantic cues. VectorSynth supports interactive workflows that mix language prompts with geometry-aware conditioning, allowing rapid what-if simulations, spatial edits, and map-informed content generation. For training and evaluation, we assemble a collection of satellite scenes paired with pixel-registered polygon annotations spanning diverse urban scenes with both built and natural features. We observe strong improvements over prior methods in semantic fidelity and structural realism, and show that our trained vision language model demonstrates fine-grained spatial grounding. The code and data are available at https://github.com/mvrl/VectorSynth.

Daniel Cher, Brian Wei, Srikumar Sastry, Nathan Jacobs• 2025

Related benchmarks

TaskDatasetResultRank
Satellite image generationGit-Rand 15k
FID95.15
35
Satellite image generationGit-Spatial 15k
FID204.2
35
Satellite Image SynthesisGit-Dense 3.5k
FID72.26
21
Spatially Controlled Image GenerationGit-Rand 15k
Top-1 Acc61.75
10
Showing 4 of 4 rows

Other info

Follow for update