A statistical method for 2-D facial landmarking

IEEE Transactions on Image Processing

Volumn 21, Issue 2, 2012, Pages 844-858

  Dibeklioglu, Hamdi ^a   Salah, Albert Ali ^b   Gevers, Theo ^a,c  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

^b BOGAZICI UNIVERSITY   (Turkey)

^c UNIVERSITAT AUTÒNOMA DE BARCELONA   (Spain)

Author keywords

Facial feature localization; facial landmarking; factor analysis; Gabor wavelet features; mixture models; shape prior; structural analysis

Indexed keywords

FACIAL FEATURE LOCALIZATION; FACIAL LANDMARKING; FACTOR ANALYSIS; GABOR WAVELETS; MIXTURE MODELS; SHAPE PRIORS;

DATABASE SYSTEMS; FEATURE EXTRACTION; GESTURE RECOGNITION; STATISTICAL METHODS; STRUCTURAL ANALYSIS;

FACE RECOGNITION;

ALGORITHM; ARTICLE; BIOMETRY; FACE; FACIAL EXPRESSION; FACTUAL DATABASE; FEMALE; HISTOLOGY; HUMAN; MALE; METHODOLOGY; MULTIVARIATE ANALYSIS; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STATISTICAL MODEL; VIDEORECORDING;

ALGORITHMS; BIOMETRIC IDENTIFICATION; DATABASES, FACTUAL; FACE; FACIAL EXPRESSION; FEMALE; HUMANS; MALE; MODELS, STATISTICAL; MULTIVARIATE ANALYSIS; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; VIDEO RECORDING;

EID: 84856256887     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2011.2163162     Document Type: Article

References (43)

1. A. A. Salah, N. Alyüz, and L. Akarun, "Registration of 3D face scans with average face models," J. Electron. Imag., vol. 17, no. 011006, Mar. 2008.
2. D. Cristinacce and T. Cootes, "Feature detection and tracking with constrained local models," in Proc. BMVC, 2006, pp. 929-938.
3. S. Milborrow and F.Nicolls, "Locating facial features with anextended active shape model," in Proc. ECCV, 2008, pp. 504-513.
4. A. A. Salah, H. Cinar, L. Akarun, and B. Sankur, "Robust facial landmarking for registration," Ann. Telecommun., vol. 62, no. 1/2, pp. 1608-1633, 2007.
5. M. Valstar, B. Martinez, X. Binefa, and M. Pantic, "Facial point detection using boosted regression and graph models," in Proc. CVPR, 2010, pp. 2729-2736.
6. T. Kozakaya, T. Shibata, M. Yuasa, and O. Yamaguchi, "Facial feature localization using weighted vector concentration approach," Image Vis. Comput., vol. 28, no. 5, pp. 772-780, May 2010.
7. S. Arca, P. Campadelli, and R. Lanzarotti, "A face recognition system based on automatically determined facial fiducial points," Pattern Recognit., vol. 39, no. 3, pp. 432-443, Mar. 2006. (Pubitemid 41808624)
8. D. Vukadinovic and M. Pantic, "Fully automatic facial feature point detection using Gabor feature based boosted classifiers," in Proc. IEEE CSMC, 2005, pp. 1692-1698. (Pubitemid 41667548)
9. L. Chen, L. Zhang, H. Zhang, and M. Abdel-Mottaleb, "3D shape constraint for facial feature localization using probabilistic-like output," in Proc. AFGR, 2004, pp. 302-307.
10. R. Senaratne and S. Halgamuge, "Optimised landmark model matching for face recognition," in Proc. AFGR, 2006, pp. 120-125. (Pubitemid 44711338)
11. L. Wiskott, J. M. Fellous, N. Krüger, and C. Von der Malsburg, "Face recognition by elastic bunch graph matching," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 775-779, Jul. 1997. (Pubitemid 127762270)
12. T. F. Cootes and C. J. Taylor, Statistical models of appearance for computer vision Manchester, U.K., 2004, Tech. Rep.
13. Y. Tong, X. Liu, F. W. Wheeler, and P. Tu, "Automatic facial landmark labeling with minimal supervision," in Proc. CVPR, 2009, pp. 2097-2104.
14. T. F. Cootes, C. J. Taylor, D. H. Cooper, and J. Graham, "Active shape models-Their training and application," Comput. Vis. Image Understanding, vol. 61, no. 1, pp. 38-59, Jan. 1995.
15. L. Gu and T. Kanade, "A generative shape regularization model for robust face alignment," in Proc. ECCV, 2008, pp. 413-426.
16. S. Zhao, Y. Gao, and B. Zhang, "Gabor feature constrained statistical model for efficient landmark localization and face recognition," Pattern Recognit. Lett., vol. 30, no. 10, pp. 922-930, Jul. 2009.
17. X. Liu, "Video-based face model fitting using adaptive active appearance model," Image Vis. Comput., vol. 28, no. 7, pp. 1162-1172, Jul. 2010.
18. X. Yu, J. Tian, and J. Liu, "Active appearance models fitting with occlusion," in Energy Minimization Methods in Computer Vision and Pattern Recognition. Berlin, Germany: Springer-Verlag, 2007, pp. 137-144.
19. M. Hamouz, J. Kittler, J. K. Kamarainen, P. Paalanen, H. Kalviainen, and J. Matas, "Feature-based affine-invariant localization of faces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 9, pp. 1490-1495, Sep. 2005. (Pubitemid 41387779)
20. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. CVPR, 2001, vol. 1, pp. 511-518.
21. A. A. Salah and E. Alpaydin, "Incremental mixtures of factor analysers," in Proc. ICPR, 2004, vol. 1, pp. 276-279.
22. Z. Ghahramani and G. E. Hinton, The EM algorithm for mixtures of factor analyzers Univ. Toronto, Toronto, ON, Canada, Tech. Rep. CRG-TR-96-1, 1997, (revised).
23. M. A. T. Figueiredo and A.K. Jain, "Unsupervised learning of finite mixture models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 3, pp. 381-396, Mar. 2002. (Pubitemid 35289353)
24. C. Goodall, "Procrustes methods in the statistical analysis of shape," J. Roy. Stat. Soc. B, vol. 53, no. 2, pp. 285-339, 1991.
25. A. Martinez and R. Benavente, The AR face data base Purdue Univ., West Lafayette, IN, CVC Tech. Rep. #24, 1998.
26. FGnet Project [Online]. Available: http://www-prima.inrialpes.fr/FGnet/ html/benchmarks.html
27. BioID Database [Online]. Available: http://www.bioid.com
28. A. Savran, N. Alyüz, H. Dibeklioglu, O. Çeliktutan, B. Gökberk, B. Sankur, and L. Akarun, "Bosphorus database for 3D face analysis," in BIOID. Berlin, Germany: Springer-Verlag, 2008, pp. 47-56.
29. P. Ekman, W. V. Friesen, and J. C. Hager, Facial Action Coding System. Palo Alto, CA: Consult. Psychol. Press, 1978.
30. T.Kanade, J. F.Cohn, and Y. Tian, "Comprehensive database for facial expression analysis," in Proc. AFGR, 2000, pp. 46-53.
31. P. J. Phillips, P. J. Flynn, W. T. Scruggs, K. W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. J. Worek, "Overview of the face recognition grand challenge," in Proc. CVPR, 2005, vol. 1, pp. 947-954. (Pubitemid 43897294)
32. K. Messer, J. Matas, J. Kittler, J. Luettin, and G. Maitre, "XM2VTS: The extended M2VTS database," in Proc. AVBPA, Washington, DC, 1999.
33. M. Romero-Huertas and N. Pears, "3d facial landmark localisation by matching simple descriptors," in Proc. 2nd IEEE Int. Conf. Biometrics, Theory, Appl. Syst., 2008, pp. 1-6.
34. D. Colbry, G. Stockman, and A. Jain, "Detection of anchor points for 3d face verification," in Proc. CVPR Workshops, 2005, p. 118.
35. X. Zhao, E. Dellandrea, and L. Chen, "A 3D statistical facial feature model and its application on locating facial landmarks," in Proc. Adv. Concepts Intell. Vis. Syst., 2009, pp. 686-697.
36. J. F. Cohn, A. J. Zlochower, J. Lien, and T. Kanade, "Automated face analysis by feature point tracking has high concurrent validity with manual FACS coding," Psychophysiology, vol. 36, no. 1, pp. 35-43, 1999. (Pubitemid 29044454)
37. M. Bartlett, G. Littlewort, M. Frank, C. Lainscsek, I. Fasel, and J. Movellan, "Recognizing facial expression: Machine learning and application tospontaneous behavior," in Proc. CVPR, 2005, vol. 2, p. 568.
38. M. Pantic and L. J. M. Rothkrantz, "Automatic analysis of facial expressions: The state of the art," IEEE Trans. Pattern Anal. Mach. In-tell., vol. 22, no. 12, pp. 1424-1445, Dec. 2000. (Pubitemid 32088469)
39. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 1, pp. 39-58, Jan. 2009.
40. R. Valenti, N. Sebe, and T. Gevers, "Facial expression recognition: A fully integrated approach," in Proc. ICIAPW, 2007, pp. 125-130.
41. H. Tao and T. S. Huang, "Connected vibrations: A modal analysis approach for non-rigid motion tracking," in Proc. CVPR, 1998, pp. 735-740.
42. F. L. Bookstein, "Principal warps: Thin-plate splines and the decomposition of deformations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 6, pp. 567-585, Jun. 1989.
43. L. Yin, X. Chen, Y. Sun, T. Worm, and M. Reale, "A high-resolution 3D dynamic facial expression database," in Proc. AFGR, 2008, pp. 1-6.