Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

DAD-3DHeads: A Large-scale Dense, Accurate and Diverse Dataset for 3D Head Alignment from a Single Image

About

We present DAD-3DHeads, a dense and diverse large-scale dataset, and a robust model for 3D Dense Head Alignment in the wild. It contains annotations of over 3.5K landmarks that accurately represent 3D head shape compared to the ground-truth scans. The data-driven model, DAD-3DNet, trained on our dataset, learns shape, expression, and pose parameters, and performs 3D reconstruction of a FLAME mesh. The model also incorporates a landmark prediction branch to take advantage of rich supervision and co-training of multiple related tasks. Experimentally, DAD-3DNet outperforms or is comparable to the state-of-the-art models in (i) 3D Head Pose Estimation on AFLW2000-3D and BIWI, (ii) 3D Face Shape Reconstruction on NoW and Feng, and (iii) 3D Dense Head Alignment and 3D Landmarks Estimation on DAD-3DHeads dataset. Finally, the diversity of DAD-3DHeads in camera angles, facial expressions, and occlusions enables a benchmark to study in-the-wild generalization and robustness to distribution shifts. The dataset webpage is https://p.farm/research/dad-3dheads.

Tetiana Martyniuk, Orest Kupyn, Yana Kurliak, Igor Krashenyi, Ji\v{r}i Matas, Viktoriia Sharmanska• 2022

Related benchmarks

TaskDatasetResultRank
Head Pose EstimationBIWI (test)
Yaw Error3.79
56
Head Pose EstimationAFLW 3D 2000 (test)
MAE (Yaw)3.08
44
6DoF head pose estimationBIWI (test)
Yaw Error3.79
31
3D Face ReconstructionNoW
Median Error (mm)1.236
17
3D facial landmark localizationDAD-3DHeads (test)
Error (High Subset)1.84
14
3D facial landmark localizationMultiface (test)
NMLC Error (Full)3.3
14
Head Pose EstimationAFLW2000 (val)
Yaw Error3.08
12
Head Pose EstimationBIWI (val)
Yaw Error3.79
12
Head Pose EstimationCMU Panoptic (test)
Yaw11.29
9
3D Face ReconstructionFeng LQ 1.0
Median Error (mm)1.624
7
Showing 10 of 19 rows

Other info

Code

Follow for update