Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Dense Face Alignment

About

Face alignment is a classic problem in the computer vision field. Previous works mostly focus on sparse alignment with a limited number of facial landmark points, i.e., facial landmark detection. In this paper, for the first time, we aim at providing a very dense 3D alignment for large-pose face images. To achieve this, we train a CNN to estimate the 3D face shape, which not only aligns limited facial landmarks but also fits face contours and SIFT feature points. Moreover, we also address the bottleneck of training CNN with multiple datasets, due to different landmark markups on different datasets, such as 5, 34, 68. Experimental results show our method not only provides high-quality, dense 3D face fitting but also outperforms the state-of-the-art facial landmark detection methods on the challenging datasets. Our model can run at real time during testing.

Yaojie Liu, Amin Jourabloo, William Ren, Xiaoming Liu• 2017

Related benchmarks

TaskDatasetResultRank
Face AlignmentAFLW 2000-3D 68 pts (test)
Mean NME4.5
82
Facial Landmark Detection300-W public Challenging inter-pupil normalization (test)
NME9.38
46
Facial Landmark Detection300-W public Full inter-pupil normalization (test)
NME6.1
29
Face AlignmentAFLW2000-3D (test)
NME (Full height)4.5
29
Facial Landmark Detection300-W Public Common subset inter-pupil normalization (test)
NME5.37
28
3D Face ReconstructionAFLW2000-3D
NME0.0564
26
3D Face AlignmentAFLW2000-3D
NME (Mean)4.5
11
3D Dense Face AlignmentAFLW2000-3D
NME (%)6.04
10
3D Face Reconstruction and Dense AlignmentGeneric Inference Profiling
Run time (ms)35.4
6
3D Face AlignmentAFLW2000-3D Dense
NME (%)6.04
5
Showing 10 of 11 rows

Other info

Code

Follow for update