UniBioTransfer: A Unified Framework for Multiple Biometrics Transfer
About
Deepface generation has traditionally followed a task-driven paradigm, where distinct tasks (e.g., face transfer and hair transfer) are addressed by task-specific models. Nevertheless, this single-task setting severely limits model generalization and scalability. A unified model capable of solving multiple deepface generation tasks in a single pass represents a promising and practical direction, yet remains challenging due to data scarcity and cross-task conflicts arising from heterogeneous attribute transformations. To this end, we propose UniBioTransfer, the first unified framework capable of handling both conventional deepface tasks (e.g., face transfer and face reenactment) and shape-varying transformations (e.g., hair transfer and head transfer). Besides, UniBioTransfer naturally generalizes to unseen tasks, like lip, eye, and glasses transfer, with minimal fine-tuning. Generally, UniBioTransfer addresses data insufficiency in multi-task generation through a unified data construction strategy, including a swapping-based corruption mechanism designed for spatially dynamic attributes like hair. It further mitigates cross-task interference via an innovative BioMoE, a mixture-of-experts based model coupled with a novel two-stage training strategy that effectively disentangles task-specific knowledge. Extensive experiments demonstrate the effectiveness, generalization, and scalability of UniBioTransfer, outperforming both existing unified models and task-specific methods across a wide range of deepface generation tasks. Project page is at https://scy639.github.io/UniBioTransfer.github.io/
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Face transfer | Deepface (test) | Identity Similarity63.7 | 7 | |
| Face transfer | Deepface | ID Similarity0.637 | 4 | |
| Face transfer | Complex Scenes Exaggerated Expressions | ID Similarity0.518 | 3 | |
| Face transfer | Complex Scenes Extreme Pose | ID Similarity0.302 | 3 | |
| Face transfer | Complex Scenes Occlusions | ID Similarity0.316 | 3 | |
| Facial Part Transfer | Facial Part Swap Eye | CLIP L2 Distance0.427 | 3 | |
| Facial Part Transfer | Facial Part Swap Nose | CLIP L20.327 | 3 | |
| Facial Part Transfer | Facial Part Swap Lip | CLIP L2 Similarity0.384 | 3 | |
| Hair transfer | Deepface | CLIP Distance0.421 | 3 | |
| Head Transfer | Head Transfer Evaluation Set (test) | CLIP Distance0.46 | 3 |