Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Language-Free Generative Editing from One Visual Example

About

Text-guided diffusion models have advanced image editing by enabling intuitive control through language. However, despite their strong capabilities, we surprisingly find that SOTA methods struggle with simple, everyday transformations such as rain or blur. We attribute this limitation to weak and inconsistent textual supervision during training, which leads to poor alignment between language and vision. Existing solutions often rely on extra finetuning or stronger text conditioning, but suffer from high data and computational requirements. We argue that diffusion-based editing capabilities aren't lost but merely hidden from text. The door to cost-efficient visual editing remains open, and the key lies in a vision-centric paradigm that perceives and reasons about visual change as humans do, beyond words. Inspired by this, we introduce Visual Diffusion Conditioning (VDC), a training-free framework that learns conditioning signals directly from visual examples for precise, language-free image editing. Given a paired example -one image with and one without the target effect- VDC derives a visual condition that captures the transformation and steers generation through a novel condition-steering mechanism. An accompanying inversion-correction step mitigates reconstruction errors during DDIM inversion, preserving fine detail and realism. Across diverse tasks, VDC outperforms both training-free and fully fine-tuned text-based editing methods. The code and models are open-sourced at https://omaralezaby.github.io/vdc/

Omar Elezabi, Eduard Zamfir, Zongwei Wu, Radu Timofte• 2026

Related benchmarks

TaskDatasetResultRank
DehazingSOTS--
154
Super-ResolutionFFHQ 1k
FID41.41
23
Image DeblurringFFHQ 1k
FID35.51
16
Image DenoisingBSD400 (test)
FID82.57
16
Image ColorizationDIV2K
FID105.3
16
Image DerainingRain100L
FID66.92
13
Super-ResolutionUser Study SR samples
Perceptual Score31.5
5
Image DerainingUser Study DeRain samples
Perceptual Score34
4
Image RestorationRealRain-1k-L (test)
FID106.9
3
Showing 9 of 9 rows

Other info

Follow for update