A unified probabilistic framework for automatic 3D facial expression analysis based on a Bayesian belief inference and statistical feature models

Image and Vision Computing

Volumn 31, Issue 3, 2013, Pages 231-245

  Zhao, Xi ^a   Dellandréa, Emmanuel ^a   Zou, Jianhua ^b   Chen, Liming ^a  

^a UNIVERSITÉ DE LYON   (France)

^b XI'AN JIAOTONG UNIVERSITY   (China)

Author keywords

3D face; Action units recognition; Automatic landmarking; Bayesian Belief Network; Facial expression recognition; Statistical feature model

Indexed keywords

BAYESIAN NETWORKS; BOLTZMANN EQUATION; GESTURE RECOGNITION; INFERENCE ENGINES; THREE DIMENSIONAL; THREE DIMENSIONAL COMPUTER GRAPHICS;

3D FACES; ACTION UNIT; AUTOMATIC LANDMARKING; FACIAL EXPRESSION RECOGNITION; STATISTICAL FEATURES;

FACE RECOGNITION;

EID: 84875933418     PISSN: 02628856     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.imavis.2012.10.001     Document Type: Article

References (51)

1. Z. Zeng, M. Pantic, G.I. Roisman, and T.S. Huang A survey of affect recognition methods: audio, visual, and spontaneous expressions IEEE Trans. Pattern. Anal. Mach. Intell. 31 2009 39 58
2. P. Ekman, and W. Friesen Facial Action Coding System: A Technique for the Measurement of Facial Movement 1978 Consulting Psychologists Press Palo Alto
3. P. Ekman, and E. Rosenberg What the Face Reveals: Basic and Applied Studies of Spontaneous Expression Using the Facial Action Coding System second ed. edition 2005 Oxford Univ. Press
4. M. Pantic, and L. Rothkrantz Automatic analysis of facial expressions: the state of the art IEEE Trans. Pattern. Anal. Mach. Intell. 22 2000 1424 1445
5. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. Taylor Emotion recognition in human-computer interaction IEEE Signal Process. Mag. 18 2001 32 80
6. Y. Tian, T. Kanade, and J. Cohn Facial expression analysis Handbook of Face Recognition 2003
7. B. Fasel, and J. Luettin Automatic facial expression analysis: a survey Pattern Recog. 36 2003 259 275
8. M. Pantic, A. Pentland, A. Nijholt, and T. Huang Human computing and machine understanding of human behavior: a survey F. Quek, Y. Yang, ACM SIGCHI Proceedings Eighth International Conference on Multimodal Interfaces 2006 ACM New York 239 248
9. T. Fang, X. Zhao, O. Ocegueda, S.K. Shah, and I.A. Kakadiaris 3D facial expression recognition: a perspective on promises and challenges 7th International Conference on Automatic Face and Gesture Recognition 2011 603 610
10. Y. Chang, C. Hu, R. Feris, and M. Turk Manifold based analysis of facial expression Image Vision Comput. 24 2006 605 614
11. M. Pantic, and I. Patras Dynamics of facial expression: recognition of facial actions and their temporal segments form face profile image sequences IEEE Trans. Syst. Man Cybern. B 36 2006 433 449
12. M.S. Bartlett, G. Littlewort, M. Frank, C. Lainscsek, I. Fasel, and J. Movellan Recognizing Facial Expression: Machine Learning and Application to Spontaneous Behavior 2005
13. S. Koelstra, M. Pantic, and I. Patras A dynamic texture based approach to recognition of facial actions and their temporal models IEEE Trans. Pattern. Anal. Mach. Intell. 99 2010
14. K. Bowyer, K. Chang, and P. Flynn A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition J. Comput. Vis. Image Underst. 101 2006 1 15
15. L. Yin, X. Wei, Y. Sun, J. Wang, and M. Rosato A 3D facial expression database for facial behavior research IEEE International Conference on Automatic Face and Gesture Recognition 2006 211 216
16. A. Savran, N. Alyuz, H. Dibeklioglu, O. Celiktutan, B. Gokberk, B. Sankur, and L. Akarun Bosphorus database for 3D face analysis The First COST 2101 Workshop on Biometrics and Identity Management 2008
17. H. Soyel, and H. Demirel 3D facial expression recognition with geometrically localized facial features Symposium on Computer Science and Information Technology 2008 1 4
18. H. Tang, and T. Huang 3D facial expression recognition based on properties of line segments connecting facial feature points IEEE International Conference on Automatic Face and Gesture Recognition 2008 1 6
19. Y.V. Venkatesh, A.A. Kassim, and O.V.R. Murthy A novel approach to classification of facial expressions from 3D-mesh datasets using modified PCA Pattern Recogn. Lett. 30 2009 1128 1137
20. J. Wang, L. Yin, X. Wei, and Y. Sun 3D facial expression recognition based on primitive surface feature distribution International Conference on Computer Vision and Pattern Recognition 2006 1399 1406
21. S. Ramanathan, A. Kassim, Y. Venkatesh, and W.S. Wah Human facial expression recognition using a 3D morphable model IEEE International Conference on Image Processing 2006 661 664
22. H. Tang, and T.S. Huang 3D facial expression recognition based on automatically selected features, workshop International Conference on Computer Vision and Pattern Recognition 2008 1 8
23. I. Mpiperis, S. Malassiotis, and M. Strintzis Bilinear models for 3-d face and facial expression recognition IEEE Trans. Inf. Forensics Secur. 3 2008 498 511
24. M. Rosato, X. Chen, and L. Yin Automatic registration of vertex correspondences for 3D facial expression analysis International Conference on Biometrics: Theory, Applications and Systems 2008 1 7
25. X. Zhao, E. Dellandréa, and L. Chen A 3D statistical facial feature model and its application on locating facial landmarks ACIVS 2009: Advanced Concepts for Intelligent Vision Systems 2009 686 697
26. X. Zhao, E. Dellandra, L. Chen, and I.A. Kakadiaris Accurate landmarking of three-dimensional facial data in the presence of facial expressions and occlusions using a three-dimensional statistical facial feature model IEEE Trans. Syst. Man Cybern. B 2011 1 12
27. X. Zhao, D. Huang, E. Dellandra, and L. Chen Automatic 3D facial expression recognition based on a Bayesian Belief Net and a statistical facial feature model International Conference on Pattern Recognition (ICPR) 2010
28. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification 2nd Edition 2000 Wiley-Interscience
29. T.F. Cootes, G.J. Edwards, and C.J. Taylor Active appearance models IEEE Trans. Pattern. Anal. Mach. Intell. 23 2001 681 685
30. Y. Tong, W. Liao, and Q. Ji Facial action unit recognition by exploiting their dynamic and semantic relationships IEEE Trans. Pattern. Anal. Mach. Intell. 29 2007 1683 1699
31. Y. Tong, J. Chen, and Q. Ji A unified probabilistic framework for spontaneous facial action modeling and understanding IEEE Trans. Pattern. Anal. Mach. Intell. 32 2010 258 273
32. D. Datcu, and L. Rothkrantz Automatic recognition of facial expressions using Bayesian Belief Networks International Conference on Systems, Man and Cybernetics 2004
33. A. Savran, B. Sankur, and M.T. Bilge Regression-based intensity estimation of facial action units Image Vision Comput. 30 10 October 2012 774 784
34. A. Savran, B. Sankur, and M.T. Bilge Comparative evaluation of 3D versus 2D modality for automatic detection of facial action units Pattern Recog. 45 2012 767 782
35. M. Hall Correlation-based feature selection for machine learning Technique Report 1999
36. D. Huang, C. Shan, M. Ardabilian, Y. Wang, and L. Chen Local binary patterns and its applications on facial image IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 41 2011 765 781
37. C. Shan, and T. Gritti Learning discriminative lbp-histogram bins for facial expression recognition British Machine Vision Conference 2008
38. C. Chan, J. Kittler, and K. Messer Multi-scale local binary pattern histograms for face recognition Proceedings of International Conference on Advances in Biometrics 2007 809 818
39. C. Dorai, and A. Jain Cosmos - a representation scheme for 3D free-form objects IEEE Trans. Pattern. Anal. Mach. Intell. 19 1997 1115 1130
40. D. Huang, G. Zhang, M. Ardabilian, Y. Wang, and L. Chen 3D face recognition using distinctiveness enhanced facial representations and local feature hybrid matching IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems 2010 1 4
41. P. Szeptycki, M. Ardabilian, L. Chen, W. Zeng, D. Gu, and D. Samaras Partial face biometry using shape decomposition on 2D conformal maps of faces Int. Conf. Pattern Recog. (ICPR) 2010 1 4
42. J. Nelder, and R. Mead A simplex method for function minimization Comput. J. 7 1965 308 313
43. V. Blanz, and T. Vetter A morphable model for the synthesis of 3D faces SIGGRAPH '99: Proceedings of the 26th annual conference on Computer Graphics and Interactive Techniques 1999 ACM Press/Addison-Wesley Publishing Co New York, NY, USA 187 194
44. A. Savran, N. Alyuz, H. Dibeklioglu, O. Celiktutan, B. Gokberk, B. Sankur, and L. Akarun Bosphorus database for 3D face analysis The First COST 2101 Workshop on Biometrics and Identity Management 2008
45. P. Nair, and A. Cavallaro 3-D face detection, landmark localization, and registration using a point distribution model IEEE Trans. Multimedia 11 2009 611 623
46. C. Chang, and C. Lin LIBSVM: a library for support vector machines (Software available at) http://www.csie.ntu.edu.tw/cjlin/libsvm 2001
47. J. Wright, A.Y. Yang, A. Ganesh, S.S. Sastry, and Y. Ma Robust face recognition via sparse representation IEEE Trans. Pattern. Anal. Mach. Intell. 31 2009 210 227
48. B.G. kberk, H. Dutagaci, A. Ulas, and L. Akarun Representation plurality and fusion for 3-D face recognition IEEE Trans. Syst. Man Cybern. B 38 2008 155 173
49. J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas On combining classifiers IEEE Trans. Pattern Anal. Mach. Learn. 20 1998 226 239
50. A. Savran, and B. Sankur Automatic detection of facial actions from 3D data ICCV09: Workshop on Human Computer Interaction 2009
51. Y. Sun, M. Reale, and L. Yin Recognizing partial facial action units based on 3D dynamic range data for facial expression recognition Automatic Face Gesture Recognition FG '08. 8th IEEE International Conference on 2008 1 8