GART: Gaussian Articulated Template Models
About
We introduce Gaussian Articulated Template Model GART, an explicit, efficient, and expressive representation for non-rigid articulated subject capturing and rendering from monocular videos. GART utilizes a mixture of moving 3D Gaussians to explicitly approximate a deformable subject's geometry and appearance. It takes advantage of a categorical template model prior (SMPL, SMAL, etc.) with learnable forward skinning while further generalizing to more complex non-rigid deformations with novel latent bones. GART can be reconstructed via differentiable rendering from monocular videos in seconds or minutes and rendered in novel poses faster than 150fps.
Jiahui Lei, Yufu Wang, Georgios Pavlakos, Lingjie Liu, Kostas Daniilidis• 2023
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Novel View Synthesis | ZJU-MoCap (test) | SSIM0.977 | 43 | |
| 3D human reconstruction | ZJU-MoCap (test) | PSNR31.9 | 31 | |
| Human Novel View Synthesis | ZJU-MoCap | PSNR32.22 | 31 | |
| Human Novel View Synthesis | People-Snapshot | PSNR30.4 | 11 | |
| View Synthesis | People-Snapshot male-3-casual | PSNR30.4 | 8 | |
| View Synthesis | People-Snapshot female-4-casual | PSNR29.23 | 8 | |
| 4D Reconstruction | 4D-Dress 1.0 (test) | Overall Score0.8 | 8 | |
| View Synthesis | People-Snapshot male-4-casual | PSNR27.57 | 8 | |
| View Synthesis | People-Snapshot female-3-casual | PSNR26.26 | 8 | |
| Human Avatar Rendering | UPB (test) | PSNR (Full)26.2 | 4 |
Showing 10 of 13 rows