Facial expression recognition using tracked facial actions: Classifier performance analysis

Engineering Applications of Artificial Intelligence

Volumn 26, Issue 1, 2013, Pages 467-477

  Dornaika, Fadi ^a,b   Moujahid, Abdelmalik ^a   Raducanu, Bogdan ^c  

^a UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

^b BASQUE FOUNDATION FOR SCIENCE   (Spain)

^c Barcelona Perception Computing Lab   (Spain)

Author keywords

3D deformable models; Dynamic facial expression recognition; Facial actions; Human computer interaction; Visual face tracking

Indexed keywords

3D FACE TRACKER; 3D HEAD; APPEARANCE BASED; CLASSIFICATION PERFORMANCE; CLASSIFIER PERFORMANCE; DEFORMABLE MODELS; DIMENSION REDUCTION TECHNIQUES; DYNAMIC FACIAL EXPRESSION; DYNAMIC TIME WARPING; FACIAL ACTION; FACIAL EXPRESSION RECOGNITION; FACIAL EXPRESSIONS; FEATURE VECTORS; HEAD POSE; RECOGNITION RATES; SCHEME MODELS; TEMPORAL SIGNATURES; TRAINING DATA; UNIVERSAL FACIAL EXPRESSIONS; VIDEO SEQUENCES; VISUAL FACE TRACKING;

EXPERIMENTS; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION; LEARNING ALGORITHMS; THREE DIMENSIONAL COMPUTER GRAPHICS; VIDEO RECORDING;

FACE RECOGNITION;

EID: 84870057729     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2012.09.002     Document Type: Article

References (35)

1. J. Ahlberg An active model for facial feature tracking EURASIP J. Appl. Signal Process. 1 6 2002 566 571
2. Z. Ambadar, J. Schooler, and J. Cohn Deciphering the enigmatic face the importance of facial dynamics to interpreting subtle facial expressions Psychol. Sci. 16 5 2005 403 410
3. Bartlett, M.; Littlewort, G.; Frank, M.; Lainscsek, C.; Fasel, I.; Movellan, J.; 2006. Fully automatic facial action recognition in spontaneous behavior. In: IEEE International Conference on Automatic Face and Gesture Recognition, 2006.
4. A. Chakraborty, A. Konar, U. Chakraborty, and A. Chatterjee Emotion recognition from facial expressions and its control using fuzzy logic IEEE Trans. Syst. Man Cybern. - Part A Syst. Humans 39 4 2009 726 743
5. Y. Cheon, and D. Kim Natural facial expression recognition using differential-AAM and manifold learning Pattern Recognition 42 2009 1340 1350
6. F. Dornaika, and F. Davoine On appearance based face and facial action tracking IEEE Trans. Circuits Syst. Video Technol. 16 9 2006
7. F. Dornaika, and B. Raducanu Inferring facial expressions from videos tool and application Signal Process. Image Commun. 22 9 2007 769 784
8. Dornaika, F.; Raducanu, B.; 2010. Person-specific face shape estimation under varying head pose from single snapshots. In: IEEE International Conference on Pattern Recognition.
9. P. Ekman Facial expressions of emotions an old controversy and new findings Philos. Trans. R. Soc. London 335 1992 63 69
10. B. Fasel, and J. Luettin Automatic facial expression analysis a survey Pattern Recognition 36 1 2003 259 275
11. Huang, X.; Zhao, G.; Pietikinen, M.; Zheng, W.; 2011. Expression recognition in videos using a weighted component-based feature descriptor. In: Image Analysis, Lecture Notes on Computer Science, vol. 6688.
12. Kanade, T.; Cohn, J.; Tian, Y.L.; 2000. Comprehensive database for facial expression analysis. In: International Conference on Automatic Face and Gesture Recognition, Grenoble, France, March, pp. 46-53.
13. E. Keogh, and C.A. Ratanamahatana Exact indexing of dynamic time warping Knowl. Inf. Syst. 7 2005 358 386
14. Meng, H.; Romera-Paredes, B.; Bianchi-Berthouze, N.; 2011. Emotion recognition by two view SVM-2K classifier on dynamic facial expression features. In: IEEE International Conference on Face and Gesture Recognition - Workshop on Facial Expression Recognition and Analysis Challenge.
15. S. Moore, and R. Bowden Local binary patterns for multi-view facial expression recognition Comput. Vision Image Understanding 115 2011 541 558
16. Moore, S.; Ong, E.; Bowden, R.; 2010. Facial expression recognition using spatiotemporal boosted discriminator classifiers. In: International Conference on Image Analysis and Recognition.
17. A.R. Naghsh-Nilchi, and M. Roshanzamir An efficient algorithm for motion detection based facial expression recognition using optical flow Int. J. Eng. Appl. Sci. 2 3 2006 141 146
18. M. Pantic, and I. Patras Dynamics of facial expression recognition of facial actions and their temporal segments form face profile images IEEE Trans. Syst. Man Cybern. Part B 36 2 2006 433 449
19. T. Robin, M. Bierlairey, and J. Cruz Dynamic facial expression recognition with a discrete choice model J. Choice Modelling 2 1 2011 95 148
20. N. Sebe, M.S. Lew, Y. Sun, I. Cohen, T. Gevers, and T.S. Huang Authentic facial expression analysis Image Vision Comput. 25 December 2007 1856 1863
21. Shan, C.; Gong, S.; McOwan, P.W.; 2006. Dynamic facial expression recognition using a bayesian temporal manifold model. In: Proceedings of the British Machine Vision Conference, vol. I, Edinburgh, UK, pp. 297-306.
22. C. Shan, S. Gong, and P.W. McOwan Facial expression recognition based on local binary patterns a comprehensive study Image Vision Comput. 27 2009 803 816
23. J. Sung, and D. Kim Real-time facial expression recognition using STAAM and layered GDA classifier Image Vision Comput. 27 9 2009 1313 1325
24. Y. Tian, T. Kanade, and J.F. Cohn Recognizing action units for facial expression analysis IEEE Trans. Pattern Anal. Mach. Intell. 23 2001 97 115
25. Wu, T.; Bartlett, M.S.; Movellan, J.R.; 2010. Facial expression recognition using Gabor motion energy filters. In: Computer Vision and Pattern Recognition Workshops (CVPRW).
26. T. Xiang, M.K.H. Leung, and S.Y. Cho Expression recognition using fuzzy spatio-temporal modeling Pattern Recognition 41 1 2008 204 216
27. R. Xiao, Q. Zhao, D. Zhang, and P. Shi Facial expression recognition on multiple manifolds Pattern Recognition 44 2011 107 116
28. J. Yang, and J. Yang Why can LDA be performed in PCA transformed space? Pattern Recognition 36 2 2003 563 566
29. Yang, P.; Liu, Q.; Cui, X.; Metaxas, D.N.; 2008. Facial expression recognition using encoded dynamic features. In: Computer Vision and Pattern Recognition.
30. M. Yeasin, B. Bullot, and R. Sharma Recognition of facial expressions and measurement of levels of interest from video IEEE Trans. Multimedia 8 3 2006 500 508
31. Z. Zeng, M. Pantic, G.I. Roisman, and T.S. Huang A survey of affect recognition methods audio, visual, and spontaneous expressions IEEE Trans. Pattern Anal. Mach. Intell. 31 1 2009 39 58
32. S. Zhang, X. Zhao, and B. Lei Robust facial expression recognition via compressive sensing Sensors 12 2012 3747 3761
33. Y. Zhang, and Q. Ji Active and dynamic information fusion for facial expression understanding from image sequences IEEE Trans. Pattern Anal. Mach. Intell. 27 5 2005 699 714
34. Y. Zhang, Q. Ji, Z. Zhu, and B. Yi Dynamic facial expression analysis and synthesis with MPEG-4 facial animation parameters IEEE Trans. Circuits Syst. Video Technol. 18 10 2008 1383 1396
35. G. Zhao, and M. Pietikinen Dynamic texture recognition using local binary patterns with an application to facial expressions IEEE Trans. Pattern Anal. Mach. Intell. 29 6 2007 915 928