Face Alignment via Regressing Local Binary Features
Shaoqing Ren, Xudong Cao, Yichen Wei et al. · IEEE Transactions on Image Processing · 2016
This paper presents a highly efficient and accurate regression approach for face alignment. Our approach has two novel components: 1) a set of local binary features and 2) a locality principle for learning those features. The locality principle guides us to learn a set of highly discriminative local binary features for each facial landmark independently. The obtained local binary features are used to jointly learn a linear regression for the final output. This approach achieves the state-of-the-art results when tested on the most challenging benchmarks to date. Furthermore, because extracting and regressing local binary features are computationally very cheap, our system is much faster than previous methods. It achieves over 3000 frames per second (FPS) on a desktop or 300 FPS on a mobile phone for locating a few dozens of landmarks. We also study a key issue that is important but has received little attention in the previous research, which is the face detector used to initialize alignment. We investigate several face detectors and perform quantitative evaluation on how they affect alignment accuracy. We find that an alignment friendly detector can further greatly boost the accuracy of our alignment method, reducing the error up to 16% relatively. To facilitate practical usage of face detection/alignment methods, we also propose a convenient metric to measure how good a detector is for alignment initialization.
Cited by 94 works. doi:10.1109/tip.2016.2518867
Authors
References
- Random Forests
- Rapid object detection using a boosted cascade of simple features
- LIBLINEAR: A Library for Large Linear Classification
- Active Shape Models-Their Training and Application
- Active appearance models
- An extended set of Haar-like features for rapid object detection
- Face detection, pose estimation, and landmark localization in the wild
- XM2VTSDB: The Extended M2VTS Database
- Active Appearance Models Revisited
- Deep Convolutional Network Cascade for Facial Point Detection