Dense Face Alignment
About
Face alignment is a classic problem in the computer vision field. Previous works mostly focus on sparse alignment with a limited number of facial landmark points, i.e., facial landmark detection. In this paper, for the first time, we aim at providing a very dense 3D alignment for large-pose face images. To achieve this, we train a CNN to estimate the 3D face shape, which not only aligns limited facial landmarks but also fits face contours and SIFT feature points. Moreover, we also address the bottleneck of training CNN with multiple datasets, due to different landmark markups on different datasets, such as 5, 34, 68. Experimental results show our method not only provides high-quality, dense 3D face fitting but also outperforms the state-of-the-art facial landmark detection methods on the challenging datasets. Our model can run at real time during testing.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Face Alignment | AFLW 2000-3D 68 pts (test) | Mean NME4.5 | 82 | |
| Facial Landmark Detection | 300-W public Challenging inter-pupil normalization (test) | NME9.38 | 46 | |
| Facial Landmark Detection | 300-W public Full inter-pupil normalization (test) | NME6.1 | 29 | |
| Face Alignment | AFLW2000-3D (test) | NME (Full height)4.5 | 29 | |
| Facial Landmark Detection | 300-W Public Common subset inter-pupil normalization (test) | NME5.37 | 28 | |
| 3D Face Reconstruction | AFLW2000-3D | NME0.0564 | 26 | |
| 3D Face Alignment | AFLW2000-3D | NME (Mean)4.5 | 11 | |
| 3D Dense Face Alignment | AFLW2000-3D | NME (%)6.04 | 10 | |
| 3D Face Reconstruction and Dense Alignment | Generic Inference Profiling | Run time (ms)35.4 | 6 | |
| 3D Face Alignment | AFLW2000-3D Dense | NME (%)6.04 | 5 |