Multi-view facial landmark detector learned by the Structured Output SVM

Image and Vision Computing

Volumn 47, Issue , 2016, Pages 45-59

  Uřičář, Michal ^a   Franc, Vojtěch ^a   Thomas, Diego ^b   Sugimoto, Akihiro ^b   Hlaváč, Václav ^a  

^a CZECH TECHNICAL UNIVERSITY IN PRAGUE   (Czech Republic)

^b NATIONAL INSTITUTE OF INFORMATICS   (Japan)

Author keywords

Deformable Part Models; Facial landmarks detection; Structured output SVM

Indexed keywords

DEFORMATION; SUPPORT VECTOR MACHINES;

COARSE-TO-FINE SEARCHES; DEFORMABLE PART MODELS; FACIAL LANDMARK; GLOBALLY OPTIMAL ESTIMATES; HIGH RESOLUTION IMAGE; STATE-OF-THE-ART METHODS; STRUCTURED OUTPUT SVM; SUPPORT VECTOR MACHINES ALGORITHMS;

DYNAMIC PROGRAMMING;

EID: 84961226711     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2016.02.004     Document Type: Article

References (45)

1. [1] Martnez, A.M., Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans. Pattern Anal. Mach. Intell. 24:6 (2002), 748–763.
2. [2] Blanz, V., Vetter, T., Face recognition based on fitting a 3D morphable model. IEEE Trans. Pattern Anal. Mach. Intell. 25:9 (2003), 1063–1074.
3. [3] Fischler, M.A., Elschlager, R.A., The representation and matching of pictorial structures. IEEE Trans. Comput. C-22:1 (1973), 67–92.
4. [4] Felzenszwalb, P.F., Girshick, R.B., McAllester, D.A., Ramanan, D., Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell. 32:9 (2010), 1627–1645.
5. [5] Tsochantaridis, I., Joachims, T., Hofmann, T., Altun, Y., Large margin methods for structured and interdependent output variables. J. Mach. Learn. Res. 6 (2005), 1453–1484.
6. [6] Felzenszwalb, P.F., Huttenlocher, D.P., Distance transforms of sampled functions. Theory Comput. 8:1 (2012), 415–428.
7. [7] Williams, L., Pyramidal parametrics. Proceedings of the 10th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ‘83, 1983, ACM, New York, NY, USA, 1–11.
8. [8] Köstinger, M., Wohlhart, P., Roth, P.M., Bischof, H., Annotated facial landmarks in the wild: a large-scale, real-world database for facial landmark localization. IEEE International Conference on Computer Vision Workshops, ICCV'11 Workshops, Barcelona, Spain, 2011, 2144–2151.
9. [9] Zhu, X., Ramanan, D., Face detection, pose estimation, and landmark localization in the wild. The 25th IEEE Conference on Computer Vision and Pattern Recognition, CVPR'12, Providence, RI, USA, 2012, 2879–2886.
10. [10] Xiong, X., la Torre, F.D., Supervised descent method and its applications to face alignment. The 26th IEEE Conference on Computer Vision and Pattern Recognition, CVPR'13, Portland, OR, USA, 2013, 532–539.
11. [11] Asthana, A., Zafeiriou, S., Cheng, S., Pantic, M., Incremental face alignment in the wild. The 27th IEEE Conference on Computer Vision and Pattern Recognition, CVPR'14, Columbus, OH, USA, 2014, 1859–1866.
12. [12] Kazemi, V., Sullivan, J., One millisecond face alignment with an ensemble of regression trees. The 27th IEEE Conference on Computer Vision and Pattern Recognition, CVPR'14, Columbus, OH, USA, 2014, 1867–1874.
13. [13] Tzimiropoulos, G., Pantic, M., Gauss-Newton deformable part models for face alignment in-the-wild. The 27th IEEE Conference on Computer Vision and Pattern Recognition, CVPR'14, Columbus, OH, USA, 2014, 1851–1858.
14. [14] Vapnik, V.N., Statistical Learning Theory, Adaptive and Learning Systems. 1998, Wiley, New York, New York, USA.
15. [15] Ojala, T., Pietikäinen, M., Mäenpää, T., Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24:7 (2002), 971–987.
16. [16] Uřičář, M., Franc, V., Hlaváč, V., Detector of facial landmarks learned by the Structured Output SVM. Proceedings of the International Conference on Computer Vision Theory and Applications, VISAPP’12, vol. 1, 2012, SciTePress - Science and Technology Publications, Rome, Italy, 547–556.
17. [17] Uřičář, M., Franc, V., Thomas, D., Sugimoto, A., Hlaváč, V., Real-time multi-view facial landmark detector learned by the Structured Output SVM. Proceedings of the 11th IEEE International Conference on Automatic Face and Gesture Recognition Conference and Workshops, BWILD'15, 2015, IEEE, Ljubljana, Slovenia.
18. [18] Cootes, T.F., Edwards, G.J., Taylor, C.J., Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23:6 (2001), 681–685.
19. [19] Matthews, I., Baker, S., Active appearance models revisited. Int. J. Comput. Vis. 60:2 (2004), 135–164.
20. [20] Dollár, P., Welinder, P., Perona, P., Cascaded pose regression. The 23rd IEEE Conference on Computer Vision and Pattern Recognition, CVPR'10, San Francisco, CA, USA, 2010, 1078–1085.
21. [21] Ren, S., Cao, X., Wei, Y., Sun, J., Face alignment at 3000 FPS via regressing local binary features. The 27th IEEE Conference on Computer Vision and Pattern Recognition, CVPR'14, Columbus, OH, USA, 2014, 1685–1692.
22. [22] Saragih, J., Göcke, R., A nonlinear discriminative approach to AAM fitting. The 11th IEEE International Conference on Computer Vision, ICCV'07, Rio de Janeiro, Brazil, 2007, 1–8.
23. [23] Saragih, J., Göcke, R., Learning AAM fitting through simulation. Pattern Recogn. 42:11 (2009), 2628–2636.
24. [24] Valstar, M.F., Martnez, B., Binefa, X., Pantic, M., Facial point detection using boosted regression and graph models. The 23rd IEEE Conference on Computer Vision and Pattern Recognition, CVPR'10, San Francisco, CA, USA, 2010, 2729–2736.
25. [25] Martnez, B., Valstar, M.F., Binefa, X., Pantic, M., Local evidence aggregation for regression-based facial point detection. IEEE Trans. Pattern Anal. Mach. Intell. 35:5 (2013), 1149–1163.
26. [26] Cristinacce, D., Cootes, T.F., Feature detection and tracking with constrained local models. Proceedings of the British Machine Vision Conference 2006, BMVC'06, Edinburgh, UK, 2006, 929–938.
27. [27] Cristinacce, D., Cootes, T.F., Automatic feature localisation with constrained local models. Pattern Recogn. 41:10 (2008), 3054–3067.
28. [28] Wang, Y., Lucey, S., Cohn, J.F., Enforcing convexity for improved alignment with constrained local models. The 21st IEEE Conference on Computer Vision and Pattern Recognition, CVPR'08, Anchorage, AK, USA, 2008.
29. [29] Saragih, J.M., Lucey, S., Cohn, J.F., Deformable model fitting by regularized landmark mean-shift. Int. J. Comput. Vis. 91:2 (2011), 200–215.
30. [30] Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J., Active shape models-their training and application. Comput. Vis. Image Underst. 61:1 (1995), 38–59.
31. [31] Everingham, M., Sivic, J., Zisserman, A., “Hello! My name is Buffy” — automatic naming of characters in TV video. Proceedings of the British Machine Vision Conference 2006, BMVC'06, Edinburgh, UK, 2006, 899–908.
32. [32] Felzenszwalb, P.F., Huttenlocher, D.P., Pictorial structures for object recognition. Int. J. Comput. Vis. 61:1 (2005), 55–79.
33. [33] Dalal, N., Triggs, B., Histograms of oriented gradients for human detection. The 18th IEEE Conference on Computer Vision and Pattern Recognition, CVPR'05, San Diego, CA, USA, 2005, 886–893.
34. [34] Sonnenburg, S., Franc, V., COFFIN: a computational framework for linear SVMs. Proceedings of the 27th International Conference on Machine Learning, ICML'10, Haifa, Israel, 2010, 999–1006.
35. [35] Teo, C.H., Vishwanathan, S.V.N., Smola, A.J., Le, Q.V., Bundle methods for regularized risk minimization. J. Mach. Learn. Res. 11 (2010), 311–365.
36. [36] Bertsekas, D.P., Nonlinear Programming. 1999, Athena Scientific, Belmont, MA.
37. [37] Schlesinger, M.I., Hlaváč, V., Ten Lectures on Statistical and Structural Pattern Recognition. 2002, Kluwer Academic Publishers, Dordrecht, The Netherlands.
38. [38] Gross, R., Matthews, I., Cohn, J.F., Kanade, T., Baker, S., Multi-PIE. Image Vis. Comput. 28:5 (2010), 807–813.
39. [39] Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., Pantic, M., A semi-automatic methodology for facial landmark annotation. The 26th IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPR'13 Workshops, Portland, OR, USA, 2013, 896–903.
40. [40] Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., Pantic, M., 300 faces in-the-wild challenge: the first facial landmark localization challenge. Proceedings of IEEE International Conference on Computer Vision Workshops, ICCV'13 Workshops, Sydney, Australia, 2013.
41. [41] Šochman, J., Matas, J., WaldBoost — learning for time constrained sequential detection. The 18th IEEE Conference on Computer Vision and Pattern Recognition, CVPR'05, San Diego, CA, USA, 2005, 150–156.
42. [42] Čech, J., Franc, V., Matas, J., A 3D approach to facial landmarks: detection, refinement, and tracking. 22nd International Conference on Pattern Recognition, ICPR'14, Stockholm, Sweden, 2014, 2173–2178.
43. [43] Asthana, A., Zafeiriou, S., Cheng, S., Pantic, M., Robust discriminative response map fitting with constrained local models. The 26th IEEE Conference on Computer Vision and Pattern Recognition, CVPR'13, Portland, OR, USA, 2013, 3444–3451.
44. [44] Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E., Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Tech. Rep. 07–49, October 2007, University of Massachusetts, Amherst.
45. [45] Belhumeur, P.N., Jacobs, D.W., Kriegman, D.J., Kumar, N., Localizing parts of faces using a consensus of exemplars. The 24th IEEE Conference on Computer Vision and Pattern Recognition, CVPR'11, Colorado Springs, CO, USA, 2011, 545–552.