Face Alignment via Regressing Local Binary Features

IEEE Transactions on Image Processing

Volumn 25, Issue 3, 2016, Pages 1233-1245

  Ren, Shaoqing ^a   Cao, Xudong ^b   Wei, Yichen ^c   Sun, Jian ^c  

^a UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^b SENSETIME RESEARCH   (China)

^c MICROSOFT RESEARCH   (United States)

Author keywords

face alignment; local binary feature; random forest; tracking

Indexed keywords

BINS; DECISION TREES; E-LEARNING; SURFACE DISCHARGES;

ALIGNMENT ACCURACY; ALIGNMENT METHODS; BINARY FEATURES; FACE ALIGNMENT; FRAMES PER SECONDS; LOCALITY PRINCIPLE; QUANTITATIVE EVALUATION; RANDOM FORESTS;

FACE RECOGNITION;

ANATOMY AND HISTOLOGY; BIOMETRY; DECISION TREE; DIAGNOSTIC IMAGING; FACE; FACTUAL DATABASE; HUMAN; IMAGE PROCESSING; PROCEDURES; REGRESSION ANALYSIS;

BIOMETRIC IDENTIFICATION; DATABASES, FACTUAL; DECISION TREES; FACE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; REGRESSION ANALYSIS;

EID: 84962727760     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2016.2518867     Document Type: Article

References (49)

1. X. Cao, Y. Wei, F. Wen, and J. Sun, "Face alignment by explicit shape regression, " Int. J. Comput. Vis., vol. 107, no. 2, pp. 177-190, 2014.
2. M. Dantone, J. Gall, G. Fanelli, and L. Van Gool, "Real-time facial feature detection using conditional regression forests, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 2578-2585.
3. P. Dollar, P. Welinder, and P. Perona, "Cascaded pose regression, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 1078-1085.
4. M. Valstar, B. Martinez, X. Binefa, and M. Pantic, "Facial point detection using boosted regression and graph models, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 2729-2736.
5. C. Cao, Y. Weng, S. Lin, and K. Zhou, "3D shape regression for real-time facial animation, " ACM Trans. Graph., vol. 32, no. 4, 2013, Art. ID 41.
6. X. Xiong and F. De la Torre, "Supervised descent method and its applications to face alignment, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 532-539.
7. X. P. Burgos-Artizzu, P. Perona, and P. Dollár, "Robust face landmark estimation under occlusion, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2013, pp. 1513-1520.
8. Y. Sun, X. Wang, and X. Tang, "Deep convolutional network cascade for facial point detection, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2013, pp. 3476-3483.
9. V. Kazemi and J. Sullivan, "One millisecond face alignment with an ensemble of regression trees, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014, pp. 1867-1874.
10. J. Xing, Z. Niu, J. Huang, W. Hu, and S. Yan, "Towards multi-view and partially-occluded face alignment, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2014, pp. 1829-1836.
11. J. Zhang, S. Shan, M. Kan, and X. Chen, "Coarse-to-fine auto-encoder networks (CFAN) for real-time face alignment, " in Computer Vision. Springer, 2014, pp. 1-16.
12. Z. Zhang, P. Luo, C. C. Loy, and X. Tang, "Facial landmark detection by deep multi-task learning, " in Computer Vision. Springer, 2014, pp. 94-108.
13. T. Sheerman-Chase, E.-J. Ong, and R. Bowden, "Non-linear predictors for facial feature tracking across pose and expression, " in Proc. 10th IEEE Int. Conf. Workshops Autom. Face Gesture Recognit. (FG), Apr. 2013, pp. 1-8.
14. E.-J. Ong, Y. Lan, B. Theobald, R. Harvey, and R. Bowden, "Robust facial feature tracking using selected multi-resolution linear predictors, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Sep. 2009, pp. 1483-1490.
15. T. F. Cootes, M. C. Ionita, C. Lindner, and P. Sauer, "Robust and accurate shape model fitting using random forest regression voting, " in Computer Vision. Springer, 2012, pp. 278-291.
16. J. Yan, Z. Lei, D. Yi, and S. Z. Li, "Learn to combine multiple hypotheses for accurate face alignment, " in Proc. IEEE Int. Conf. Comput. Vis. Workshops (ICCVW), Dec. 2013, pp. 392-396.
17. H. Li, G. Hua, Z. Lin, J. Brandt, and J. Yang, "Probabilistic elastic part model for unsupervised face detector adaptation, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2013, pp. 793-800.
18. X. Zhu and D. Ramanan, "Face detection, pose estimation, and landmark localization in the wild, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2012, pp. 2879-2886.
19. D. Chen, S. Ren, Y. Wei, X. Cao, and J. Sun, "Joint cascade face detection and alignment, " in Computer Vision. Springer, 2014, pp. 109-122.
20. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic, "A semiautomatic methodology for facial landmark annotation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. Workshops (CVPRW), Jun. 2013, pp. 896-903.
21. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685, Jun. 2001.
22. I. Matthews and S. Baker, "Active appearance models revisited, " Int. J. Comput. Vis., vol. 60, no. 2, pp. 135-164, 2004.
23. L. Liang, R. Xiao, F. Wen, and J. Sun, "Face alignment via componentbased discriminative search, " in Computer Vision. Springer, 2008, pp. 72-85.
24. R. Gross, I. Matthews, and S. Baker, "Generic vs. person specific active appearance models, " Image Vis. Comput., vol. 23, no. 12, pp. 1080-1093, 2005.
25. R. Gross, I. Matthews, and S. Baker, "Active appearance models with occlusion, " Image Vis. Comput., vol. 24, no. 6, pp. 593-604, 2006.
26. P. Sauer, T. F. Cootes, and C. J. Taylor, "Accurate regression procedures for active appearance models, " in Proc. Brit. Mach. Vis. Conf. (BMVC), 2011, pp. 1-11.
27. P. A. Tresadern, P. Sauer, and T. F. Cootes, "Additive update predictors in active appearance models, " in Proc. Brit. Mach. Vis. Conf. (BMVC), 2010, pp. 91. 1-91. 12.
28. T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham, "Active shape models-Their training and application, " Comput. Vis. Image Understand., vol. 61, no. 1, pp. 38-59, 1995.
29. D. Cristinacce and T. F. Cootes, "Feature detection and tracking with constrained local models, " in Proc. Brit. Mach. Vis. Conf. (BMVC), 2006, pp. 95. 1-95. 10.
30. D. Cristinacce and T. F. Cootes, "Boosted regression active shape models, " in Proc. Brit. Mach. Vis. Conf. (BMVC), 2007, pp. 1-10.
31. P. N. Belhumeur, D. W. Jacobs, D. J. Kriegman, and N. Kumar, "Localizing parts of faces using a consensus of exemplars, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 545-552.
32. F. Zhou, J. Brandt, and Z. Lin, "Exemplar-based graph matching for robust facial landmark localization, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Dec. 2013, pp. 1025-1032.
33. B. M. Smith and L. Zhang, "Joint face alignment with non-parametric shape models, " in Computer Vision. Springer, 2012, pp. 43-56.
34. Y. Wang, S. Lucey, and J. F. Cohn, "Enforcing convexity for improved alignment with constrained local models, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2008, pp. 1-8.
35. J. M. Saragih, S. Lucey, and J. F. Cohn, "Deformable model fitting by regularized landmark mean-shift, " Int. J. Comput. Vis., vol. 91, no. 2, pp. 200-215, Jan. 2011.
36. F. Moosmann, B. Triggs, and F. Jurie, "Fast discriminative visual codebooks using randomized clustering forests, " in Proc. Adv. Neural Inf. Process. Syst., 2007, pp. 1-7.
37. Z. Cao, Q. Yin, X. Tang, and J. Sun, "Face recognition with learning-based descriptor, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2010, pp. 2707-2714.
38. W. Zhang, X. Wang, and X. Tang, "Coupled information-theoretic encoding for face photo-sketch recognition, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2011, pp. 513-520.
39. C. Vens and F. Costa, "Random forest based feature induction, " in Proc. 11th IEEE Int. Conf. Data Mining (ICDM), Dec. 2011, pp. 744-753.
40. M. Kobetski and J. Sullivan, "Discriminative tree-based feature mapping, " in Proc. Brit. Mach. Vis. Conf. (BMVC), 2013, pp. 71. 1-71. 11.
41. L. Breiman, "Random forests, " Mach. Learn., vol. 45, no. 1, pp. 5-32, 2001.
42. M.-T. Pham and T.-J. Cham, "Fast training and selection of haar features using statistics in boosting-based face detection, " in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Oct. 2007, pp. 1-7.
43. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin, "LIBLINEAR: A library for large linear classification, " J. Mach. Learn. Res., vol. 9, pp. 1871-1874, Jun. 2008.
44. V. Le, J. Brandt, Z. Lin, L. Bourdev, and T. S. Huang, "Interactive facial feature localization, " in Proc. 12th Eur. Conf. Comput. Vis. (ECCV), 2012, pp. 679-692.
45. K. Messer, J. Matas, J. Kittler, J. Luettin, and G. Maitre, "XM2VTSDB: The extended M2VTS database, " in Proc. 2nd Int. Conf. Audio Video-Based Biometric Person Authentication, 1999, pp. 1-6.
46. S. Milborrow and F. Nicolls, "Locating facial features with an extended active shape model, " in Computer Vision. Springer, 2008.
47. S. Zhu, C. Li, C. C. Loy, and X. Tang, "Face alignment by coarse-to-fine shape searching, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2015, pp. 4998-5006.
48. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit. (CVPR), vol. 1. Dec. 2001, pp. I-511-I-518.
49. R. Lienhart and J. Maydt, "An extended set of Haar-like features for rapid object detection, " in Proc. Int. Conf. Image Process., vol. 1. 2002, pp. I-900-I-903.