Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

UniVerse: A Unified Modulation Framework for Segmentation-Free,Disentangled Multi-Concept Personalization

About

Personalized visual understanding has advanced significantly, yet existing approaches struggle to localize and extract specific concepts when input images contain multiple objects. Many prior methods rely heavily on segmentation-based supervision or exhibit poor compositional generalization, limiting their ability to accurately disentangle and manipulate individual concepts. In this work, we propose UniVerse, a Unified Modulation Framework for segmentation-free, disentangled multi-concept personalization in diffusion transformers. Our method allows for composable and decomposable concept extraction, enabling fine-grained localization and representation of target objects without explicit segmentation masks. UniVerse learns to decompose complex scenes into concept-specific representations and then compose them in a unified manner, enabling robust personalization across diverse visual contexts. Through extensive experiments on multiple benchmarks, we demonstrate that UniVerse significantly outperforms state-of-the-art baselines in both localization accuracy and visual fidelity. Qualitative and quantitative results show that our approach can precisely extract target concepts in cluttered scenes, paving the way for more flexible, interpretable, and personalized visual generation and understanding.

Quynh Phung, Sandesh Ghimire, Minsi Hu, Chung-Chi Tsai, Jia-Bin Huang• 2026

Related benchmarks

TaskDatasetResultRank
Personalized Image GenerationUniVerseBench Single-Subject
IP-S51.49
8
Personalized Image GenerationUniVerseBench Multi-Subject
IP-S42.29
8
Personalized Image GenerationUniVerseBench
Overall Score51.05
8
Personalized Image GenerationXVerseBench
Overall Score74.16
8
Personalized Image GenerationXVerseBench Multi-Subject
DPG87.95
8
Personalized Image GenerationXVerseBench Single-Subject
DPG91.93
8
Showing 6 of 6 rows

Other info

Follow for update