Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DVI: Disentangling Semantic and Visual Identity for Training-Free Personalized Generation

About

Recent tuning-free identity customization methods achieve high facial fidelity but often overlook visual context, such as lighting, skin texture, and environmental tone. This limitation leads to ``Semantic-Visual Dissonance,'' where accurate facial geometry clashes with the input's unique atmosphere, causing an unnatural ``sticker-like'' effect. We propose **DVI (Disentangled Visual-Identity)**, a zero-shot framework that orthogonally disentangles identity into fine-grained semantic and coarse-grained visual streams. Unlike methods relying solely on semantic vectors, DVI exploits the inherent statistical properties of the VAE latent space, utilizing mean and variance as lightweight descriptors for global visual atmosphere. We introduce a **Parameter-Free Feature Modulation** mechanism that adaptively modulates semantic embeddings with these visual statistics, effectively injecting the reference's ``visual soul'' without training. Furthermore, a **Dynamic Temporal Granularity Scheduler** aligns with the diffusion process, prioritizing visual atmosphere in early denoising stages while refining semantic details later. Extensive experiments demonstrate that DVI significantly enhances visual consistency and atmospheric fidelity without parameter fine-tuning, maintaining robust identity preservation and outperforming state-of-the-art methods in IBench evaluations.

Guandong Li, Yijun Ding• 2025

Related benchmarks

TaskDatasetResultRank
Identity-Preserving Text-to-Image GenerationIBench 41 prompts 100 IDs
Aesthetic Score70
7
Identity CustomizationIBench ChineseID editable long prompts
Aesthetic Score0.7
6
Showing 2 of 2 rows

Other info

Follow for update