Shifting the Breaking Point of Flow Matching for Multi-Instance Editing
About
Flow matching models have recently emerged as an efficient alternative to diffusion, especially for text-guided image generation and editing, offering faster inference through continuous-time dynamics. However, existing flow-based editors predominantly support global or single-instruction edits and struggle with multi-instance scenarios, where multiple parts of a reference input must be edited independently without semantic interference. We identify this limitation as a consequence of globally conditioned velocity fields and joint attention mechanisms, which entangle concurrent edits. To address this issue, we introduce Instance-Disentangled Attention, a mechanism that partitions joint attention operations, enforcing binding between instance-specific textual instructions and spatial regions during velocity field estimation. We evaluate our approach on both natural image editing and a newly introduced benchmark of text-dense infographics with region-level editing instructions. Experimental results demonstrate that our approach promotes edit disentanglement and locality while preserving global output coherence, enabling single-pass, instance-level editing.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Infographic Editing | Crello Edit (test) | FID9.45 | 7 | |
| Infographic Editing | InfoEdit (test) | FID2.41 | 7 | |
| Multi-instance image editing | LoMOE-Bench (test) | Target Consistency25.6 | 6 | |
| Multi-instance editing | LoMOE-Bench (test) | Elo Score (Users)1.59e+3 | 3 | |
| Multi-instance editing | Infographics (test) | Elo Score (Users)1.40e+3 | 3 |