Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Edit-R2: Context-Aware Reinforcement Learning for Multi-Turn Image Editing

About

Text-guided image editing has advanced rapidly with diffusion models and unified multimodal foundation models. However, most existing methods remain confined to single-turn settings, overlooking the more realistic scenario of multi-turn in-context editing, where users iteratively refine an image through a sequence of instructions. In this setting, a model must follow each new instruction while preserving accumulated session-level constraints, challenged by two coupled failure modes: long-context dilution, where sparse textual constraints become difficult to recover from growing interleaved image-text histories, and state contamination, where earlier editing mistakes degrade subsequent generations. We introduce Edit-R2, a novel reinforcement learning post-training framework for unified multimodal models. Edit-R2 reconstructs the operative session intent, which effectively consolidates scattered historical constraints into an explicit reasoning trace before each editing turn. It further enables multi-turn RL over both reasoning and generation through a unified objective that jointly optimizes intent reconstruction generation in discrete text space and flow-matching image generation in continuous latent space, while a trajectory filtering mechanism suppresses corrupted rollouts to stabilize training under state contamination. To support systematic evaluation, we introduce MICE-Bench, a large-scale benchmark for multi-turn in-context editing with automated metrics for instruction following (IF), content consistency (CC), and global awareness (GA) over accumulated session constraints. Experiments show that Edit-R2 substantially improves multi-turn in-context editing and achieves competitive performance compared against strong baselines.

Yuxiao Ye, Haoran He, Fangyuan Kong, Xintao Wang, Pengfei Wan, Kun Gai, Ling Pan• 2026

Related benchmarks

TaskDatasetResultRank
Instruction-guided image editingGEdit-Bench EN Full set
G_SC7.55
44
Multi-turn image editingEdiVal 1.0 (test)
EdiVal-IF (T1)57.99
18
In-context image editingMICE-Bench Turn 2
IF Score60.77
10
In-context image editingMICE-Bench Turn 3
IF58.63
10
In-context image editingMICE-Bench (Turn 1)
IF54.82
10
Showing 5 of 5 rows

Other info

Follow for update