Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Aggregation via Separation: Boosting Facial Landmark Detector with Semi-Supervised Style Translation

About

Facial landmark detection, or face alignment, is a fundamental task that has been extensively studied. In this paper, we investigate a new perspective of facial landmark detection and demonstrate it leads to further notable improvement. Given that any face images can be factored into space of style that captures lighting, texture and image environment, and a style-invariant structure space, our key idea is to leverage disentangled style and shape space of each individual to augment existing structures via style translation. With these augmented synthetic samples, our semi-supervised model surprisingly outperforms the fully-supervised one by a large margin. Extensive experiments verify the effectiveness of our idea with state-of-the-art results on WFLW, 300W, COFW, and AFLW datasets. Our proposed structure is general and could be assembled into any face alignment frameworks. The code is made publicly available at https://github.com/thesouthfrog/stylealign.

Shengju Qian, Keqiang Sun, Wayne Wu, Chen Qian, Jiaya Jia• 2019

Related benchmarks

TaskDatasetResultRank
Facial Landmark Detection300-W (Common)
NME0.0321
180
Facial Landmark Detection300-W (Fullset)
Mean Error (%)3.86
174
Facial Landmark Detection300W (Challenging)
NME6.46
159
Face AlignmentWFLW (test)
NME (%) (Testset)4.39
144
Facial Landmark DetectionWFLW (test)
Mean Error (ME) - All4.39
122
Facial Landmark DetectionWFLW (Full)
NME (%)4.39
65
Facial Landmark Detection300W
NME3.86
52
Facial Landmark DetectionWFLW Pose
Mean Error (%)8.21
50
Facial Landmark Detection300-W Challenging Subset
Mean Error6.49
49
Facial Landmark DetectionWFLW Blur
Mean Error (%)4.86
49
Showing 10 of 32 rows

Other info

Code

Follow for update