Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

InterCoG: Towards Spatially Precise Image Editing with Interleaved Chain-of-Grounding Reasoning

About

Emerging unified editing models have demonstrated strong capabilities in general object editing tasks. However, it remains a significant challenge to perform fine-grained editing in complex multi-entity scenes, particularly those where targets are not visually salient and require spatial reasoning. To this end, we propose InterCoG, a novel text-vision Interleaved Chain-of-Grounding reasoning framework for fine-grained image editing in complex real-world scenes. The key insight of InterCoG is to first perform object position reasoning solely within text that includes spatial relation details to explicitly deduce the location and identity of the edited target. It then conducts visual grounding via highlighting the editing targets with generated bounding boxes and masks in pixel space, and finally rewrites the editing description to specify the intended outcomes. To further facilitate this paradigm, we propose two auxiliary training modules: multimodal grounding reconstruction supervision and multimodal grounding reasoning alignment to enforce spatial localization accuracy and reasoning interpretability, respectively. We also construct GroundEdit-45K, a dataset comprising 45K grounding-oriented editing samples with detailed reasoning annotations, and GroundEdit-Bench for grounding-aware editing evaluation. Extensive experiments substantiate the superiority of our approach in highly precise edits under spatially intricate and multi-entity scenes.

Yecong Wan, Fan Li, Chunwei Wang, Hao Wu, Mingwen Shao, Wangmeng Zuo• 2026

Related benchmarks

TaskDatasetResultRank
Instruction-based Image EditingGroundEdit-Bench
Color Change (EGA)84
19
Image EditingSmartEdit Reasoning Scenarios
PSNR30.024
8
Image EditingSmartEdit Understanding Scenarios
PSNR25.774
8
Image EditingGroundEdit-Bench
Latency (s)2
3
Showing 4 of 4 rows

Other info

Follow for update