Automatic facial expression recognition based on spatiotemporal descriptors

Pattern Recognition Letters

Volumn 33, Issue 10, 2012, Pages 1373-1380

  Ji, Yi ^a   Idrissi, Khalid ^b  

^a SOOCHOW UNIVERSITY   (China)

^b UNIVERSITÉ DE LYON   (France)

Author keywords

Dynamic descriptor; Facial expression recognition; Moments; Spatialtemporal domain; Support vector machine; Vertical time backward

Indexed keywords

DEFORMATION; HUMAN COMPUTER INTERACTION; SUPPORT VECTOR MACHINES;

DYNAMIC DESCRIPTOR; FACIAL EXPRESSION RECOGNITION; MOMENTS; SPATIALTEMPORAL DOMAINS; VERTICAL TIME BACKWARD;

FACE RECOGNITION;

EID: 84860224487     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2012.03.006     Document Type: Article

References (39)

1. Bartlett, M.; GLittlewort, C.; Lainscsek, C.; Fasel, I.; Frank, M.; Movellan, J.; 2006. Fully automatic facial action recognition in spontaneous behavior. In: Automatic Face and Gesture Recognition, pp. 223-228.
2. J.N. Bassili Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face J. Pers. Soc. Psychol. 37 1979 2049 2058
3. J. Buenaposada, E. Munoz, and L. Baumela Recognizing facial expressions in video sequences Pattern Anal. Appl. 1 2008 101 116
4. Chang, K.; Liu, T.; Lai, S.; 2009. Learning partially-observed hidden conditional random fields for facial expression recognition. In: CVPR, Miami, FL, USA, pp. 533-540.
5. Cohen, I.; Sebe, N.; Gozman, F.; Cirelo, M.; Huang, T.; 2003. Learning bayesian network classifiers for facial expression recognition both labeled and unlabeled data. In: CVPR, Madison, Wisconsin, USA, pp. 595-601.
6. C.R. De Silva, S. Ranganath, and L.C. De Silva Cloud basis function neural network: a modified RBF network architecture for holistic facial expression recognition Pattern Recognition 41 2008 1241 1253 (Pubitemid 350218150)
7. P. Ekman, and W. Friesen Facial Action Coding System: A Technique for the Measurement of Facial Movement 1978 Consulting Psychologists Press Palo Alto
8. Ji, Y.; Idrissi, K.; 2010. Learning from essential facial parts and local features for automatic facial expression recognition. In: CBMI, 8th Internat. Workshop on Content-Based Multimedia Indexing.
9. Kanade, T.; Cohn, J.; Tian, Y.L.; 2000. Comprehensive database for facial expression analysis. In: Proc. 4th IEEE Internat. Conf. on Automatic Face and Gesture Recognition (FG'00), Grenoble, France, pp. 46-53.
10. Kienzle, W.; Bakir, G.; Franz, M.; Schlkopf, B.; 2005. Face detection - Efficient and rank deficient. In: NIPS 2004, pp. 673-680.
11. D.H. Kim, S.U. Jung, and M.J. Chung Extension of cascaded simple feature based face detection to facial expression recognition Pattern Recognition Lett. 29 2008 1621 1631
12. Koelstra, S.; Pantic, M.; 2008. Non-rigid registration using free-form deformations for recognition of facial actions and their temporal dynamics. In: Automatic Face and Gesture Recognition, pp. 1-8.
13. I. Kotsia, S. Zafeiriou, and I. Pitas Texture and shape information fusion for facial expression and facial action unit recognition Pattern Recognition 41 2008 833 851 (Pubitemid 47632661)
14. S. Kumano, K. Otsuka, J. Yamato, E. Maeda, and Y. Sato Pose-invariant facial expression recognition using variable-intensity templates Internat. J. Comput. Vision 83 2009 178 194
15. G.C. Littlewort, M.S. Bartlett, and K. Lee Automatic coding of facial expressions displayed during posed and genuine pain Image Vision Comput. 27 2009 1797 1803
16. Moore, S.; Bowden, R.; 2009. The effect of pose on facial expression recognition. In: BMVC09, pp. xx-yy.
17. T. Ojala, M. PietikSinen, and D. Harwood A comparative study of texture measures with classification based on feature distributions Pattern Recognition 29 1996 51 59
18. M. Pantic, and M.S. Bartlett Machine Analysis of Facial Expressions 2007 I-Tech Education and Publishing Vienna, Austria
19. M. Pantic, and L. Rothkrantz Automatic analysis of facial expressions: The state of the art IEEE Transactions on Pattern Analysis and Machine Intelligence 22 2000 1424 1445 (Pubitemid 32088469)
20. Pantic, M.; Valstar, M.; Rademaker, R.; Maat, L.; 2005. Web-based database for facial expression analysis. In: Proc. IEEE Internat. Conf. on Multimedia and Expo, pp. 317-321. (Pubitemid 44668868)
21. S. Park, and D. Kim Subtle facial expression recognition using motion magnification Pattern Recognition Lett. 30 2009 708 716
22. Peng, Yang, Qingshan Liu, D.N.M.; 2009. Rankboost with l1 regularization for facial expression recognition and intensity estimation. In: ICCV, Kyoto, Japan, pp. 1018-1025.
23. C. Shan, S. Gong, and P. McOwan Facial expression recognition based on local binary patterns: A comprehensive study Image Vision Comput. 27 2009 803 816
24. Shan, C.; Gong, S.; Mcowan, P.W.; 2006. Dynamic facial expression recognition using a bayesian temporal manifold model. In: Proc. British Machine Vision Conference, pp. 297-306.
25. Shang, L.; Chan, K.P.; 2009. Nonparametric discriminant HMM and application to facial expression recognition. In: CVPR, Miami, FL, USA. pp. 2090-2096.
26. Suwa, M.; Sugie, N.; Fujimora, K.; 1978. A preliminary note on pattern recognition of human emotional expression. In: The Fourth International Joint Conference on Pattern Recognition, pp. 408-410.
27. Y. Tian, T. Kanade, and J. Cohn Handbook of Face Recognition 2005 Springer New York
28. Y. Tong, J. Chen, and Q. Ji A unified probabilistic framework for spontaneous facial action modeling and understanding IEEE Trans. Pattern Anal. Machine Intell. 32 2010 258 273
29. Y. Venkatesh, A.A. Kassim, and O.R. Murthy A novel approach to classification of facial expressions from 3d-mesh datasets using modified PCA Pattern Recognition Lett. 30 2009 1128 1137
30. Vretos, N.; Nikolaidis, N.; Pitas, I.; 2009. A model-based facial expression recognition algorithm using principal components analysis. In: ICIP, pp. 3301-3304.
31. T. Xiang, M. Leung, and S. Cho Expression recognition using fuzzy spatio-temporal modeling Pattern Recognition 41 2008 204 216 (Pubitemid 47284205)
32. X. Xie, and K.M. Lam Facial expression recognition based on shape and texture Pattern Recognition 42 2009 1003 1011
33. P. Yang, Q. Liu, and D.N. Metaxas Boosting encoded dynamic features for facial expression recognition Pattern Recognition Lett. 30 2009 132 139
34. M. Yeasin, B. Bullot, and R. Sharma From facial expression to level of interest: A spatio-temporal approach CVPR 2 2004 922 927
35. Z. Zeng, M. Pantic, G.I. Roisman, and T.S. Huang A survey of affect recognition methods: Audio, visual, and spontaneous expressions IEEE Trans. Pattern Anal. Machine Intell. 31 2009 39 58
36. G. Zhao, and M. Pietikäinen Boosted multi-resolution spatiotemporal descriptors for facial expression recognition Pattern Recognition Lett. 30 2009 1117 1127
37. Zheng, W.; Tang, H.; Lin, Z.; Huang, T.S.; 2009. A novel approach to expression recognition from non-frontal face images. In: ICCV, pp. 1901-1908.
38. Zhi, R.; Flierl, M.; Ruan, Q.; Kleijn, B.; 2009. Facial expression recognition based on graph-preserving sparse non-negative matrix factorization. In: ICIP, pp. 3293-3296.
39. Y. Zhu, L.D. Silva, and C. Ko Using moment invariants and HMM in facial expression recognition Pattern Recognition Lett. 23 2002 83 91 (Pubitemid 33119503)