Robust face alignment under occlusion via regional predictive power estimation

IEEE Transactions on Image Processing

Volumn 24, Issue 8, 2015, Pages 2393-2403

  Yang, Heng ^a   He, Xuming ^b   Jia, Xuhui ^c   Patras, Ioannis ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^b CSIRO   (Australia)

^c UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

cascaded pose regression; Face alignment; model adaptation; occlusion; random forest

Indexed keywords

DECISION TREES; REGRESSION ANALYSIS;

CASCADED POSE REGRESSION; FACE ALIGNMENT; MODEL ADAPTATION; OCCLUSION; RANDOM FORESTS;

FACE RECOGNITION;

ALGORITHM; ANATOMY AND HISTOLOGY; BIOMETRY; DECISION TREE; FACE; FACTUAL DATABASE; HUMAN; PROCEDURES; STATISTICAL MODEL;

ALGORITHMS; BIOMETRIC IDENTIFICATION; DATABASES, FACTUAL; DECISION TREES; FACE; HUMANS; MODELS, STATISTICAL;

EID: 84929468961     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2015.2421438     Document Type: Article

References (46)

1. B. Amberg and T. Vetter, "Optimal landmark detection using shape models and branch and bound," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 455-462.
2. P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik, "Contour detection and hierarchical image segmentation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 898-916, May 2011.
3. A. Asthana, S. Zafeiriou, S. Cheng, and M. Pantic, "Robust discriminative response map fitting with constrained local models," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 3444-3451.
4. A. Asthana, S. Zafeiriou, S. Cheng, and M. Pantic, "Incremental face alignment in the wild," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 1859-1866.
5. T. Baltrušaitis, P. Robinson, and L.-P. Morency, "Continuous conditional neural fields for structured regression," in Proc. 13th Eur. Conf. Comput. Vi s. , 2014, pp. 593-608.
6. P. N. Belhumeur, D. W. Jacobs, D. Kriegman, and N. Kumar, "Localizing parts of faces using a consensus of exemplars," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 545-552.
7. X. P. Burgos-Artizzu, P. Perona, and P. Dollár, "Robust face landmark estimation under occlusion," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1513-1520.
8. X. Cao, Y. Wei, F. Wen, and J. Sun, "Face alignment by explicit shape regression," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2887-2894.
9. T. F. Cootes, G. J. Edwards, and C. J. Taylor, "Active appearance models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685, Jun. 2001.
10. T. F. Cootes, M. C. Ionita, C. Lindner, and P. Sauer, "Robust and accurate shape model fitting using random forest regression voting," in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 278-291.
11. M. Cox, J. Nuevo-Chiquero, J. Saragih, and S. Lucey, "CSIRO face analysis SDK," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. Workshop, May 2013.
12. D. Cristinacce and T. F. Cootes, "Feature detection and tracking with constrained local models," in Proc. Brit. Mach. Vis. Conf., 2006, p. 6.
13. M. Dantone, J. Gall, G. Fanelli, and L. Van Gool, "Real-time facial feature detection using conditional regression forests," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2578-2585.
14. P. Dollár, P. Welinder, and P. Perona, "Cascaded pose regression," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 1078-1085.
15. B. Efraty, C. Huang, S. K. Shah, and I. A. Kakadiaris, "Facial landmark detection in uncontrolled conditions," in Proc. Int. Joint Conf. Biometrics, Oct. 2011, pp. 1-8.
16. P. F. Felzenszwalb and D. P. Huttenlocher, "Efficient graph-based image segmentation," Int. J. Comput. Vis., vol. 59, no. 2, pp. 167-181, 2004.
17. H. K. Galoogahi, T. Sim, and S. Lucey, "Multi-channel correlation filters," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 3072-3079.
18. G. Ghiasi and C. C. Fowlkes, "Occlusion coherence: Localizing occluded faces with a hierarchical deformable part model," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 1899-1906.
19. M. Kostinger, P. Wohlhart, P. M. Roth, and H. Bischof, "Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization," in Proc. IEEE Int. Conf. Comput. Vis. Workshops, Nov. 2011, pp. 2144-2151.
20. B. Martinez, M. F. Valstar, X. Binefa, and M. Pantic, "Local evidence aggregation for regression-based facial point detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 5, pp. 1149-1163, May 2012.
21. M. Mathias, R. Benenson, M. Pedersoli, and L. Van Gool, "Face detection without bells and whistles," in Proc. 13th Eur. Conf. Comput. Vis. , 2014, pp. 720-735.
22. I. Patras and E. R. Hancock, "Coupled prediction classification for robust visual tracking," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1553-1567, Sep. 2010.
23. V. Rapp, T. Senechal, K. Bailly, and L. Prevost, "Multiple kernel learning SVM and statistical validation for facial landmark detection," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. Workshops, Mar. 2011, pp. 265-271.
24. N. Razavi, J. Gall, and L. Van Gool, "Backprojection revisited: Scalable multi-view object detection and similarity metrics for detections," in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 620-633.
25. S. Ren, X. Cao, Y. Wei, and J. Sun, "Face alignment at 3000 fps via regressing local binary features," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 1685-1692.
26. M.-C. Roh, T. Oguri, and T. Kanade, "Face alignment robust to occlusion," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. Workshops, Mar. 2011, pp. 239-244.
27. C. Sagonas, G. Tzimiropoulos, S. Zafeiriou, and M. Pantic, "300 faces in-the-wild challenge: The first facial landmark localization challenge," in Proc. IEEE Int. Conf. Comput. Vis. Workshops, Dec. 2013, pp. 397-403.
28. J. Saragih and R. Goecke, "A nonlinear discriminative approach to AAM fitting," in Proc. IEEE 11th Int. Conf. Comput. Vis., Oct. 2007, pp. 1-8.
29. B. M. Smith, J. Brandt, Z. Lin, and L. Zhang, "Nonparametric context modeling of local appearance for pose- and expression-robust facial landmark localization," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2014, pp. 1741-1748.
30. Y. Sun, X. Wang, and X. Tang, "Deep convolutional network cascade for facial point detection," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 3476-3483.
31. P. A. Tresadern, P. Sauer, and T. F. Cootes, "Additive update predictors in active appearance models," in Proc. Brit. Mach. Vis. Conf., 2010, p. 4.
32. G. Tzimiropoulos and M. Pantic, "Optimization problems for fast AAM fitting in-the-wild," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 593-600.
33. M. Valstar, B. Martinez, X. Binefa, and M. Pantic, "Facial point detection using boosted regression and graph models," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2729-2736.
34. X. Xiong and F. De la Torre, "Supervised descent method and its applications to face alignment," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 532-539.
35. F. Yang, J. Huang, and D. Metaxas, "Sparse shape registration for occluded facial feature localization," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit. Workshops, Mar. 2011, pp. 272-277.
36. H. Yang and I. Patras, "Face parts localization using structured-output regression forests," in Proc. 11th Asian Conf. Comput. Vis., 2012, pp. 667-679.
37. H. Yang and I. Patras, "Privileged information-based conditional regression forest for facial feature detection," in Proc. 10th IEEE Int. Conf. Autom. Face Gesture Recognit., Apr. 2013, pp. 1-6.
38. H. Yang and I. Patras, "Sieving regression forest votes for facial feature detection in the wild," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1936-1943.
39. H. Yang and I. Patras, "Fine-tuning regression forests votes for object alignment in the wild," IEEE Trans. Image Process., vol. 24, no. 2, pp. 619-631, Feb. 2015.
40. H. Yang, C. Zou, and I. Patras, "Face sketch landmarks localization in the wild," IEEE Signal Process. Lett., vol. 21, no. 11, pp. 1321-1325, Nov. 2014.
41. X. Yu, J. Huang, S. Zhang, W. Yan, and D. N. Metaxas, "Pose-free facial landmark fitting via optimized part mixtures and cascaded deformable shape model," in Proc. IEEE Int. Conf. Comput. Vis., Dec. 2013, pp. 1944-1951.
42. X. Yu, F. Yang, J. Huang, and D. N. Metaxas, "Explicit occlusion detection based deformable fitting for facial landmark localization," in Proc. 10th IEEE Int. Conf. Autom. Face Gesture Recognit., Apr. 2013, pp. 1-6.
43. Z. Zhang, P. Luo, C. C. Loy, and X. Tang, "Facial landmark detection by deep multi-task learning," in Proc. 13th Eur. Conf. Comput. Vis., 2014, pp. 94-108.
44. X. Zhao, S. Shan, X. Chai, and X. Chen, "Cascaded shape space pruning for robust facial landmark detection," in Proc. IEEE Int. Conf. Comput. Vis. , Dec. 2013, pp. 1033-1040.
45. F. Zhou, J. Brandt, and Z. Lin, "Exemplar-based graph matching for robust facial landmark localization," in Proc. IEEE Int. Conf. Comput. Vis. , Dec. 2013, pp. 1025-1032.
46. X. Zhu and D. Ramanan, "Face detection, pose estimation, and landmark localization in the wild," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2879-2886.