Inferring facial expressions from videos: Tool and application

Signal Processing: Image Communication

Volumn 22, Issue 9, 2007, Pages 769-784

  Dornaika, Fadi ^a   Raducanu, Bogdan ^b  

^a INSTITUT GÉOGRAPHIQUE NATIONAL   (France)

^b Barcelona Perception Computing Lab   (Spain)

Author keywords

AIBO robot; Facial expression recognition; Human machine interaction; Keyframes; Temporal classifiers

Indexed keywords

FACE RECOGNITION; MAN MACHINE SYSTEMS; REAL TIME SYSTEMS; USER INTERFACES;

AIBO ROBOT; FACIAL EXPRESSION RECOGNITION; HUMAN MACHINE INTERACTION; TEMPORAL CLASSIFIERS;

VIDEO STREAMING;

EID: 35248888440     PISSN: 09235965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.image.2007.06.006     Document Type: Article

References (27)

1. J. Ahlberg, CANDIDE-3-an updated parametrized face, Technical Report LiTH-ISY-R-2326, Department of Electrical Engineering, Linköping University, Sweden, 2001.
2. M. Bartlett, G. Littlewort, C. Lainscsek, I. Fasel, J. Movellan, Machine learning methods for fully automatic recognition of facial expressions and facial actions, in: IEEE International Conference on Systems, Man and Cybernetics, vol. I, The Hague, The Netherlands, October 2004, pp. 592-597.
3. Bassili J.N. Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. J. Pers. Social Psychol. 37 (1979) 2049-2059
4. Black M.J., and Yacoob Y. Recognizing facial expressions in image sequences using local parameterized models of image motion. Int. J. Comput. Vision 25 1 (1997) 23-48
5. Blake A., and Isard M. Active Contours: The Application of Techniques from Graphics, Vision, Control Theory and Statistics to Visual Tracking of Shapes in Motion (2000), Springer, New York
6. Breazeal C., and Scassellati B. Robots that imitate humans. Trends Cognitive Sci. 6 (2002) 481-487
7. L. Cañamero, P. Gaussier, in: Emotion understanding: robots as tools and models, Emotional Development: Recent Research Advances, 2005, pp. 235-258.
8. Cohen I., Sebe N., Garg A., Chen L., and Huang T.S. Facial expression recognition from video sequences: temporal and static modeling. Comput. Vision Image Understanding 91 1-2 (2003) 160-187
9. F. Dornaika, F. Davoine, View- and texture-independent facial expression recognition in continuous videos using dynamic programming, in: IEEE International Conference on Image Processing, 2005.
10. Dornaika F., and Davoine F. On appearance based face and facial action tracking. IEEE Trans. Circuits Syst. Video Technol. 16 9 (September 2006) 1107-1124
11. F. Dornaika, F. Davoine, Recognizing facial expressions in videos using autoregressive models, in: IEEE International Conference on Pattern Recognition, Hong Kong, 2006, pp. 520-523.
12. F. Dornaika, B. Raducanu, Recognizing facial expressions in videos using a facial action analysis-synthesis scheme, in: IEEE International Conference on Advanced Video and Signal based Surveillance, Australia, 2006.
13. Ekman P. Facial expressions of emotion: an old controversy and new findings. Philos. Trans. Roy. Soc. London B 335 (1992) 63-69
14. Ekman P., and Friesen W. Pictures of Facial Affect (1976), Consulting Psychologists Press, Palo Alto, CA, USA
15. Fasel B., and Luettin J. Automatic facial expression analysis: a survey. Pattern Recognition 36 1 (2003) 259-275
16. T. Kanade, J. Cohn, Y.L. Tian, Comprehensive database for facial expression analysis, in: International Conference on Automatic Face and Gesture Recognition, Grenoble, France, March 2000, pp. 46-53.
17. Y. Kim, S. Lee, S. Kim, G. Park, A fully automatic system recognizing human facial expressions, in: Knowledge-Based Intelligent Information and Engineering Systems, Lecture Notes in Computer Science, vol. 3215, 2004, pp. 203-209.
18. Ljung L. System Identification: Theory for the User. second ed. (1987), Prentice-Hall International, UK
19. North B., Blake A., Isard M., and Rittscher J. Learning and classification of complex dynamics. IEEE Trans. Pattern Anal. Mach. Intell. 22 9 (2000) 1016-1034
20. M. Pantic, in: Encyclopedia of Multimedia Technology and Networking, Affective Computing, vol. 1, 2005, pp. 8-14.
21. Picard R.W., Vyzas E., and Healy J. Toward machine emotional intelligence: analysis of affective physiological state. IEEE Trans. Pattern Anal. Mach. Intell. 23 10 (2001) 1175-1191
22. H. Prendinger, J. Mori, M. Ishizuka, Recognizing, modeling, and responding to users' affective states, in: Proceedings of the 10th International Conference on User Modeling (UM-05), Springer Lecture Notes in Artificial Intelligence, vol. 3538, 2005, pp. 60-69.
23. Rabiner L. A tutorial on hidden markov models and selected applications in speech recognition. Proc. IEEE 77 2 (1989) 257-286
24. J. Sung, S. Lee, D. Kim, A real-time facial expression recognition using the STAAM, in: International Conference on Pattern Recognition, vol. I, Hong Kong, 2006, pp. 275-278.
25. Tian Y., Kanade T., and Cohn J.F. Recognizing action units for facial expression analysis. IEEE Trans. Pattern Anal. Mach. Intell. 23 (2001) 97-115
26. Yeasin M., Bullot B., and Sharma R. Recognition of facial expressions and measurement of levels of interest from video. IEEE Trans. Multimedia 8 3 (2006) 500-508
27. Zhang Y., and Ji Q. Active and dynamic information fusion for facial expression understanding from image sequences. IEEE Trans. Pattern Anal. Mach. Intell. 27 5 (2005) 699-714