Real-time 2D+3D facial action and expression recognition

Pattern Recognition

Volumn 43, Issue 5, 2010, Pages 1763-1775

  Tsalakanidou, Filareti ^a   Malassiotis, Sotiris ^a  

^a INFORMATION TECHNOLOGIES INSTITUTE   (Greece)

Author keywords

3D face tracking; Facial action unit detection; Facial expression classification

Indexed keywords

3-D IMAGE; 3D FACE TRACKING; CONTROLLED CONDITIONS; EXPRESSION RECOGNITION; FACIAL ACTION; FACIAL EXPRESSION CLASSIFICATION; FACIAL EXPRESSION RECOGNITION; LOCAL FEATURE; RULE-BASED CLASSIFICATION; STRUCTURED-LIGHT SENSORS; SURFACE CURVATURES;

GENE EXPRESSION; GESTURE RECOGNITION; THREE DIMENSIONAL; TWO DIMENSIONAL;

FACE RECOGNITION;

EID: 75749135273     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2009.12.009     Document Type: Article

References (24)

1. Lewis M., Jones J., and Barrett L. Handbook of Emotions (2008), Guilford Publications, Inc
2. Ekman P., and Friesen W.V. The Facial Action Coding System: A technique for measurement of facial movement (1978), Consulting Psychologists Press, Palo Alto, CA
3. Pantic M., and Rothkrantz L. Automatic analysis of facial expressions: the state of the art. IEEE Transactions on Pattern Analysis and Machine Intelligence 22 12 (2000) 1424-1445
4. Kotsia I., and Pitas I. Facial expression recognition in image sequences using geometric deformation features and support vector machines. IEEE Transactions on Image Processing 16 1 (2007) 172-187
5. M.S. Bartlett, G. Littlewort, I. Fasel, J.R. Movellan, Real time face detection and facial expression recognition: development and application to human computer interaction, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, vol. 5, 2003, p. 53.
6. Black M., and Yacoob Y. Recognizing facial expressions in image sequences using local parameterized models of image motion. International Journal of Computer Vision 25 1 (1997) 23-48
7. Pantic M., and Rothkrantz L. Facial action recognition for facial expression analysis from static face images. IEEE Transactions on Systems, Man, and Cybernetics-Part B 34 3 (2004) 1449-1461
8. Cohen I., Sebe N., Garg A., Chen L., and Huang T. Facial expression recognition from video sequences: temporal and static modeling. Computer Vision and Image Understanding 91 (2003) 160-187
9. Pantic M., and Patras I. Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences. IEEE Transactions on Systems, Man, and Cybernetics-Part B 36 2 (2006) 433-449
10. Z. Wen, T. Huang, Capturing subtle facial motions in 3D face tracking, in: Proceedings of the IEEE International Conference on Computer Vision, vol. 2, 2003, pp. 1343-1350.
11. J. Wang, L. Yin, X. Wei, Y. Sun, 3D facial expression recognition based on primitive surface feature distribution, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, vol. 2, 2006, pp. 1399-1406.
12. H. Tang, T. Huang, 3D facial expression recognition based on automatically selected features, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition Workshops, 2008, pp. 1-8.
13. H. Soyel, H. Demirel, Facial expression recognition using 3D facial feature distances, in: Proceedings of the International Conference on Image Analysis and Recognition, Lecture Notes in Computer Science, vol. 4633, Springer, Berlin, 2007, pp. 831-838.
14. Mpiperis I., Malassiotis S., and Strintzis M.G. Bilinear models for 3-D face and facial expression recognition. IEEE Transactions on Information Forensics and Security 3 3 (2008) 498-511
15. X. Huang, S. Zhang, Y. Wang, D. Metaxas, D. Samaras, A hierarchical framework for high resolution facial expression tracking, in: Proceedings of the IEEE Workshop on Articulated and Nonrigid Motion, 2004, p. 22.
16. Y. Chang, M. Vieira, M. Turk, L. Velho, Automatic 3D facial expression analysis in videos, in: Proceedings of the 2nd International Workshop on Analysis and Modelling of Faces and Gestures, Lecture Notes in Computer Science, vol. 3723, Springer, Berlin, 2005, pp. 293-307.
17. Y. Sun, L. Yin, Facial expression recognition based on 3D dynamic range model sequences, in: Proceedings of the 10th European Conference on Computer Vision, Lecture Notes in Computer Science, vol. 5303, Springer, Berlin, 2008, pp. 58-71.
18. J. Liebelt, J. Xiao, J. Yang, Robust AAM fitting by fusion of images and disparity data, in: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, vol. 2, 2006, pp. 2483-2490.
19. D. Modrow, C. Laloni, G. Doemens, G. Rigoll, A novel sensor system for 3D face scanning based on infrared coded light, in: Proceedings of the SPIE Conference on Three-Dimensional Image Capture and Applications 2008, vol. 6805, 2008.
20. F. Tsalakanidou, S. Malassiotis, Robust facial action recognition from real-time 3D streams, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2009, pp. 4-11.
21. Lanitis A., Taylor C.J., and Cootes T.F. Automatic interpretation and coding of face images using flexible models. IEEE Transactions on Pattern Analysis and Machine Intelligence 19 7 (1997) 743-756
22. Malassiotis S., and Strintzis M.G. Robust face recognition using 2D and 3D data: pose and illumination compensation. Pattern Recognition 38 12 (2005) 2537-2548
23. Malassiotis S., and Strintzis M.G. Robust real-time 3D head pose estimation from range data. Pattern Recognition 38 8 (2005) 1153-1165
24. Horn B. Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society of America A 4 4 (1987) 629-642