Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

GART: Gaussian Articulated Template Models

About

We introduce Gaussian Articulated Template Model GART, an explicit, efficient, and expressive representation for non-rigid articulated subject capturing and rendering from monocular videos. GART utilizes a mixture of moving 3D Gaussians to explicitly approximate a deformable subject's geometry and appearance. It takes advantage of a categorical template model prior (SMPL, SMAL, etc.) with learnable forward skinning while further generalizing to more complex non-rigid deformations with novel latent bones. GART can be reconstructed via differentiable rendering from monocular videos in seconds or minutes and rendered in novel poses faster than 150fps.

Jiahui Lei, Yufu Wang, Georgios Pavlakos, Lingjie Liu, Kostas Daniilidis• 2023

Related benchmarks

TaskDatasetResultRank
Novel View SynthesisZJU-MoCap (test)
SSIM0.977
43
3D human reconstructionZJU-MoCap (test)
PSNR31.9
31
Human Novel View SynthesisZJU-MoCap
PSNR32.22
31
Human Novel View SynthesisPeople-Snapshot
PSNR30.4
11
View SynthesisPeople-Snapshot male-3-casual
PSNR30.4
8
View SynthesisPeople-Snapshot female-4-casual
PSNR29.23
8
4D Reconstruction4D-Dress 1.0 (test)
Overall Score0.8
8
View SynthesisPeople-Snapshot male-4-casual
PSNR27.57
8
View SynthesisPeople-Snapshot female-3-casual
PSNR26.26
8
Human Avatar RenderingUPB (test)
PSNR (Full)26.2
4
Showing 10 of 13 rows

Other info

Follow for update