Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

UniBioTransfer: A Unified Framework for Multiple Biometrics Transfer

About

Deepface generation has traditionally followed a task-driven paradigm, where distinct tasks (e.g., face transfer and hair transfer) are addressed by task-specific models. Nevertheless, this single-task setting severely limits model generalization and scalability. A unified model capable of solving multiple deepface generation tasks in a single pass represents a promising and practical direction, yet remains challenging due to data scarcity and cross-task conflicts arising from heterogeneous attribute transformations. To this end, we propose UniBioTransfer, the first unified framework capable of handling both conventional deepface tasks (e.g., face transfer and face reenactment) and shape-varying transformations (e.g., hair transfer and head transfer). Besides, UniBioTransfer naturally generalizes to unseen tasks, like lip, eye, and glasses transfer, with minimal fine-tuning. Generally, UniBioTransfer addresses data insufficiency in multi-task generation through a unified data construction strategy, including a swapping-based corruption mechanism designed for spatially dynamic attributes like hair. It further mitigates cross-task interference via an innovative BioMoE, a mixture-of-experts based model coupled with a novel two-stage training strategy that effectively disentangles task-specific knowledge. Extensive experiments demonstrate the effectiveness, generalization, and scalability of UniBioTransfer, outperforming both existing unified models and task-specific methods across a wide range of deepface generation tasks. Project page is at https://scy639.github.io/UniBioTransfer.github.io/

Caiyi Sun, Yujing Sun, Xiangyu Li, Yuhang Zheng, Yiming Ren, Jiamin Wang, Yuexin Ma, Siu-Ming Yiu• 2026

Related benchmarks

TaskDatasetResultRank
Face transferDeepface (test)
Identity Similarity63.7
7
Face transferDeepface
ID Similarity0.637
4
Face transferComplex Scenes Exaggerated Expressions
ID Similarity0.518
3
Face transferComplex Scenes Extreme Pose
ID Similarity0.302
3
Face transferComplex Scenes Occlusions
ID Similarity0.316
3
Facial Part TransferFacial Part Swap Eye
CLIP L2 Distance0.427
3
Facial Part TransferFacial Part Swap Nose
CLIP L20.327
3
Facial Part TransferFacial Part Swap Lip
CLIP L2 Similarity0.384
3
Hair transferDeepface
CLIP Distance0.421
3
Head TransferHead Transfer Evaluation Set (test)
CLIP Distance0.46
3
Showing 10 of 26 rows

Other info

Follow for update