Approaching human level facial landmark localization by deep learning

Image and Vision Computing

Volumn 47, Issue , 2016, Pages 27-35

  Fan, Haoqiang ^a   Zhou, Erjin ^a  

^a Megvii Inc (Face++)   (China)

Author keywords

Convolutional neural network; Deep learning; Facial landmark localization

Indexed keywords

DEEP LEARNING; NEURAL NETWORKS;

CONVOLUTIONAL NEURAL NETWORK; FACIAL LANDMARK; HUMAN LEVELS; HUMAN PERFORMANCE; HUMAN STUDY; LOCALIZATION PERFORMANCE;

DEEP NEURAL NETWORKS;

EID: 84954286857     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2015.11.004     Document Type: Article

References (31)

1. [1] Berg, T., Belhumeur, P.N., Tom-vs-Pete classifiers and identity-preserving alignment for face verification. BMVC Citeseer, vol. 2, 2012, 7.
2. [2] Chen, D., Cao, X., Wen, F., Sun, J., Blessing of dimensionality: high-dimensional feature and its efficient compression for face verification. Computer Vision and Pattern Recognition (CVPR), 2013 IEEE conference on, IEEE, 2013, 3025–3032.
3. [3] Zhou, E., Fan, H., Cao, Z., Jiang, Y., Yin, Q., Extensive facial landmark localization with coarse-to-fine convolutional network cascade. Computer Vision Workshops (ICCVW), 2013 IEEE international conference on, IEEE, 2013, 386–391.
4. [4] Sun, Y., Wang, X., Tang, X., Deep convolutional network cascade for facial point detection. Computer Vision and Pattern Recognition (CVPR), 2013 IEEE conference on, IEEE, 2013, 3476–3483.
5. [5] E. Zhou, Z. Cao, Q. Yin, Naive-deep face recognition: touching the limit of lfw benchmark or not?, arXiv preprint arXiv:1501.04690.
6. [6] Fan, H., Yang, M., Cao, Z., Jiang, Y., Yin, Q., Learning compact face representation: packing a face into an int32. Proceedings of the ACM International Conference on Multimedia, ACM, 2014, 933–936.
7. [7] Y. Sun, X. Wang, X. Tang, Deeply learned face representations are sparse, selective, and robust, arXiv preprint arXiv:1412.1265.
8. [8] Taigman, Y., Yang, M., Ranzato, M., Wolf, L., Deepface: closing the gap to human-level performance in face verification. Computer Vision and Pattern Recognition (CVPR), 2014 IEEE conference on, IEEE, 2014, 1701–1708.
9. [9] Cootes, T.F., Edwards, G.J., Taylor, C.J., Active appearance models. Computer Vision—ECCV'98, 1998, Springer, 484–498.
10. [10] Felzenszwalb, P.F., Girshick, R.B., McAllester, D., Ramanan, D., Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell. 32:9 (2010), 1627–1645.
11. [11] Tzimiropoulos, G., Pantic, M., Gauss–Newton deformable part models for face alignment in-the-wild. Computer Vision and Pattern Recognition (CVPR), 2014 IEEE conference on, IEEE, 2014, 1851–1858.
12. [12] Felzenszwalb, P.F., Huttenlocher, D.P., Pictorial structures for object recognition. Int. J. Comput. Vis. 61:1 (2005), 55–79.
13. [13] Zhang, Z., Luo, P., Loy, C., Tang, X., Learning deep representation for face alignment with auxiliary attributes. IEEE Trans. Pattern Anal. Mach. Intell., PP(99), 2015, 1.
14. [14] Zhang, J., Shan, S., Kan, M., Chen, X., Coarse-to-fine auto-encoder networks (CFAN) for real-time face alignment. Computer Vision—ECCV 2014, 2014, Springer, 1–16.
15. [15] Cao, X., Wei, Y., Wen, F., Sun, J., Face alignment by explicit shape regression. Int. J. Comput. Vis. 107:2 (2014), 177–190.
16. [16] Krizhevsky, A., Sutskever, I., Hinton, G.E., Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, 2012, 1097–1105.
17. [17] Le, V., Brandt, J., Lin, Z., Bourdev, L., Huang, T.S., Interactive facial feature localization. Computer Vision—ECCV 2012, 2012, Springer, 679–692.
18. [18] Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., Pantic, M., A semi-automatic methodology for facial landmark annotation. Computer Vision and Pattern Recognition Workshops (CVPRW), 2013 IEEE conference on, IEEE, 2013, 896–903.
19. [19] Belhumeur, P.N., Jacobs, D.W., Kriegman, D., Kumar, N., Localizing parts of faces using a consensus of exemplars. Computer Vision and Pattern Recognition (CVPR), 2011 IEEE conference on, IEEE, 2011, 545–552.
20. [20] Zhu, X., Ramanan, D., Face detection, pose estimation, and landmark localization in the wild. Computer Vision and Pattern Recognition (CVPR), 2012 IEEE conference on, IEEE, 2012, 2879–2886.
21. [21] Yu, X., Huang, J., Zhang, S., Yan, W., Metaxas, D.N., Pose-free facial landmark fitting via optimized part mixtures and cascaded deformable shape model. Computer Vision (ICCV), 2013 IEEE international conference on, IEEE, 2013, 1944–1951.
22. [22] Asthana, A., Zafeiriou, S., Cheng, S., Pantic, M., Robust discriminative response map fitting with constrained local models. Computer Vision and Pattern Recognition (CVPR), 2013 IEEE conference on, IEEE, 2013, 3444–3451.
23. [23] Burgos-Artizzu, X.P., Perona, P., Dollár, P., Robust face landmark estimation under occlusion. Computer Vision (ICCV), 2013 IEEE international conference on, IEEE, 2013, 1513–1520.
24. [24] Xiong, X., De la Torre, F., Supervised descent method and its applications to face alignment. Computer Vision and Pattern Recognition (CVPR), 2013 IEEE conference on, IEEE, 2013, 532–539.
25. [25] Kazemi, V., Sullivan, J., One millisecond face alignment with an ensemble of regression trees. Computer Vision and Pattern Recognition (CVPR), 2014 IEEE conference on, IEEE, 2014, 1867–1874.
26. [26] Ren, S., Cao, X., Wei, Y., Sun, J., Face alignment at 3000 fps via regressing local binary features. Computer Vision and Pattern Recognition (CVPR), 2014 IEEE conference on, IEEE, 2014, 1685–1692.
27. [27] Zhu, S., Li, C., Loy, C.C., Tang, X., Face alignment by coarse-to-fine shape searching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, 4998–5006.
28. [28] Viola, P., Jones, M.J., Robust real-time face detection. Int. J. Comput. Vis. 57:2 (2004), 137–154.
29. [29] A. Chandra, Dividing a circular arc into equal number of divisions.
30. [30] Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L., Imagenet: A large-scale hierarchical image database. Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE conference on, IEEE, 2009, 248–255.
31. [31] K. He, X. Zhang, S. Ren, J. Sun, Delving deep into rectifiers: surpassing human-level performance on imagenet classification, arXiv preprint arXiv:1502.01852.