Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Generalizable and Animatable Gaussian Head Avatar

About

In this paper, we propose Generalizable and Animatable Gaussian head Avatar (GAGAvatar) for one-shot animatable head avatar reconstruction. Existing methods rely on neural radiance fields, leading to heavy rendering consumption and low reenactment speeds. To address these limitations, we generate the parameters of 3D Gaussians from a single image in a single forward pass. The key innovation of our work is the proposed dual-lifting method, which produces high-fidelity 3D Gaussians that capture identity and facial details. Additionally, we leverage global image features and the 3D morphable model to construct 3D Gaussians for controlling expressions. After training, our model can reconstruct unseen identities without specific optimizations and perform reenactment rendering at real-time speeds. Experiments show that our method exhibits superior performance compared to previous methods in terms of reconstruction quality and expression accuracy. We believe our method can establish new benchmarks for future research and advance applications of digital avatars. Code and demos are available https://github.com/xg-chu/GAGAvatar.

Xuangeng Chu, Tatsuya Harada• 2024

Related benchmarks

TaskDatasetResultRank
3D Head Avatar ReconstructionAva 256
PSNR12.7
13
Cross-ReenactmentVOODOO-XP (test)
MEt3R0.034
10
Self-ReenactmentVOODOO-XP (test)
MEt3R0.027
10
Cross-identity reenactmentHDTF 55 (test)
CSIM0.9004
8
Self-ReenactmentHDTF 55 (test)
PSNR23.72
8
Cross-identity reenactmentVFHQ (test)
CSIM0.6681
8
Self-ReenactmentVFHQ (test)
PSNR21.6
8
3D Face ReenactmentCelebVHQ
Sc Score5.502
8
3D Portrait Animation (Self Reenactment)VFHQ 1.0 (test)
PSNR21.83
7
3D talking head generation100-frame sequence (test)
FPS58.11
7
Showing 10 of 22 rows

Other info

Follow for update