Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Uni-Synergy: Bridging Understanding and Generation for Personalized Reasoning via Co-operative Reinforcement Learning

About

Unified Multimodal Models (UMMs) excel in general tasks but struggle to bridge the gap between personalized understanding and generation. Prior works largely rely on implicit token-level alignment via supervised fine-tuning, which fails to fully capture the potential synergy between comprehension and creation. In this work, we propose Sync-R1, an end-to-end reinforcement learning framework that jointly optimizes personalized understanding and generation within a single, explicit reasoning loop. Through this unified feedback process, Sync-R1 enables personalized comprehension to guide content creation, while the resulting generation quality reciprocally refines understanding within an integrated reward landscape. To efficiently orchestrate this dual-task synergy, we introduce Sync-GRPO, a reinforcement learning method utilizing an ensemble reward system. Furthermore, we propose Dynamic Group Scaling (DGS), which adaptively filters low-potential trajectories to reduce gradient variance and accelerate convergence. To better reflect real-world complexity, we introduce UnifyBench++, featuring denser textual descriptions and richer user contexts. Experimental results demonstrate that Sync-R1 achieves state-of-the-art performance, showcasing superior cross-task reasoning and robust personalization without requiring complex cold-start procedures. The code and the UnifyBench++ dataset will be released at: https://github.com/arctanxarc/UniCTokens.

Zijun Shen, Sihan Yang, Ruichuan An, Ziyu Guo, Hao Liang, Ming Lu, Renrui Zhang, Wentao Zhang• 2026

Related benchmarks

TaskDatasetResultRank
Dense Image GenerationUnifybench++
GPT Similarity Score0.353
20
Concept RecognitionUnifybench++
Weight85.9
13
Question AnsweringUnifybench++
BLEU60.4
13
Dense Multimodal ReasoningUnifybench++
GPT Score50.3
13
Multimodal ReasoningUnifybench++
BLEU25
13
Visual Question AnsweringUnifybench++
BLEU59.2
13
Pure Image GenerationUnifybench++
CLIP-I0.765
11
Reasoning-based Image GenerationUnifybench++
CLIP-T Score0.324
10
Showing 8 of 8 rows

Other info

Follow for update