Uni-Synergy: Bridging Understanding and Generation for Personalized Reasoning via Co-operative Reinforcement Learning
About
Unified Multimodal Models (UMMs) excel in general tasks but struggle to bridge the gap between personalized understanding and generation. Prior works largely rely on implicit token-level alignment via supervised fine-tuning, which fails to fully capture the potential synergy between comprehension and creation. In this work, we propose Sync-R1, an end-to-end reinforcement learning framework that jointly optimizes personalized understanding and generation within a single, explicit reasoning loop. Through this unified feedback process, Sync-R1 enables personalized comprehension to guide content creation, while the resulting generation quality reciprocally refines understanding within an integrated reward landscape. To efficiently orchestrate this dual-task synergy, we introduce Sync-GRPO, a reinforcement learning method utilizing an ensemble reward system. Furthermore, we propose Dynamic Group Scaling (DGS), which adaptively filters low-potential trajectories to reduce gradient variance and accelerate convergence. To better reflect real-world complexity, we introduce UnifyBench++, featuring denser textual descriptions and richer user contexts. Experimental results demonstrate that Sync-R1 achieves state-of-the-art performance, showcasing superior cross-task reasoning and robust personalization without requiring complex cold-start procedures. The code and the UnifyBench++ dataset will be released at: https://github.com/arctanxarc/UniCTokens.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Dense Image Generation | Unifybench++ | GPT Similarity Score0.353 | 20 | |
| Concept Recognition | Unifybench++ | Weight85.9 | 13 | |
| Question Answering | Unifybench++ | BLEU60.4 | 13 | |
| Dense Multimodal Reasoning | Unifybench++ | GPT Score50.3 | 13 | |
| Multimodal Reasoning | Unifybench++ | BLEU25 | 13 | |
| Visual Question Answering | Unifybench++ | BLEU59.2 | 13 | |
| Pure Image Generation | Unifybench++ | CLIP-I0.765 | 11 | |
| Reasoning-based Image Generation | Unifybench++ | CLIP-T Score0.324 | 10 |