Automatic recognition of facial actions in spontaneous expressions

Journal of Multimedia

Volumn 1, Issue 6, 2006, Pages 22-35

  Bartlett, Marian Stewart ^a   Littlewort, Gwen C ^a   Frank, Mark G ^b   Lainscsek, Claudia ^a   Fasel, Ian R ^a   Movellan, Javier R ^a  

^a UNIVERSITY OF CALIFORNIA SAN DIEGO   (United States)

^b UNIVERSITY AT BUFFALO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADAPTIVE BOOSTING; COMPUTER KEYBOARDS; LEARNING SYSTEMS; OBJECT RECOGNITION; VIDEO STREAMING;

AUTOMATIC RECOGNITION; FACIAL ACTION CODING SYSTEM; FACIAL ACTION DETECTION; FACIAL EXPRESSIONS; IMAGE REPRESENTATIONS; INTENSITY MEASUREMENTS; MACHINE LEARNING METHODS; REAL TIME RECOGNITION;

FACE RECOGNITION;

EID: 84856668658     PISSN: 17962048     EISSN: None     Source Type: Journal    
DOI: 10.4304/jmm.1.6.22-35     Document Type: Article

References (47)

1. J. R. Anderson. Spanning seven orders of magnitude: a challenge for cognitive modeling. Cognitive Science, 26:85-112, 2002.
2. M.S. Bartlett, G.L. Donato, J.R. Movellan, J.C. Hager, P. Ekman, and T.J. Sejnowski. Image representations for facial expression coding. In S.A. Solla, T.K. Leen, and K.-R. Muller, editors, Advances in Neural Information Processing Systems, volume 12. MIT Press, 2000.
3. M.S. Bartlett, G. Littlewort, I. Fasel, and J.R. Movellan. Real time face detection and expression recognition: Development and application to human-computer interaction. In CVPR Workshop on Computer Vision and Pattern Recognition for Human-Computer Interaction, 2003.
4. M.S. Bartlett, G. Littlewort, M.G. Frank, C. Lainscsek, I. Fasel, and J. Movellan. Recognizing facial expression: Machine learning and application to spontaneous behavior. In IEEE International Conference on Computer Vision and Pattern Recognition, pages 568-573, 2005.
5. F. Bernieri, J. Davis, R. Rosenthal, and C. Knee. Inter-actional synchrony and rapport: Measuring synchrony in displays devoid of sound and facial affect. Personality and Social Psychology Bulletin, 20:303-311, 1994.
6. A. Brodal. Neurological anatomy: In relation to clinical medicine. Oxford University Press, New York, 1981.
7. T.L. Chartrand and J. A. Bargh. The chameleon effect: the perception-behavior link and social interaction. Journal of Personality and Social Psychology, 76:893-911, 1999.
8. K.D. Craig, S.A. Hyde, and C.J. Patrick. Genuine, suppressed, and faked facial behavior during exacerbation of chronic low back pain. Pain, 46:161-172, 1991.
9. C. Darwin. The expression of the emotions in man and animals. Oxford University Press, New York, 1998. 3rd Edition, w/ commentaries by Paul Ekman.
10. P. Doenges, F. Lavagetto, J. Ostermann, I.S. Pandzic, and E. Petajan. Mpeg-4: Audio/video and synthetic graphics/audio for real-time, interactive media delivery. Image Communications Journal, 5(4), 1997.
11. G. Donato, M. Bartlett, J. Hager, P. Ekman, and T. Sejnowski. Classifying facial actions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(10):974-989, 1999.
12. Torres E. and Andersen R. Space-time separation during obstacle-avoidance learning in monkeys. submitted.
13. P. Ekman. The argument and evidence about universals in facial expressions of emotion. In D.C. Raskin, editor, Psychological methods in criminal investigation and evidence, pages 297-332. Springer Publishing Co, Inc., New York, 1989.
14. P. Ekman. Telling Lies: Clues to Deceit in the Marketplace, Politics, and Marriage. W.W. Norton, New York, 2nd edition, 1991.
15. P. Ekman. Facial expression of emotion. American Psychologist, 48:384-392, 1993.
16. P. Ekman, R. J. Davidson, and W. V. Friesen. The duchenne smile: Emotional expression and brain physiology ii. Journal of Personality and Social Psychology, 58:342-353, 1990.
17. P. Ekman and W. Friesen. Facial Action Coding System: A Technique for the Measurement of Facial Movement. Consulting Psychologists Press, Palo Alto, CA, 1978.
18. P. Ekman and W. V. Friesen. Felt, false, and miserable smiles. Journal of Nonverbal Behavior, 6:238-252, 1982.
19. P. Ekman, R.W. Levenson, and W.V. Friesen. Autonomic nervous system activity distinguishes between emotions. Science, 221:1208-1210, 1983.
20. P. Ekman and E.L. Rosenberg. What the Face Reveals: Basic and Applied Studies of Spontaneous Expression using the Facial Action Coding System (FACS). Oxford University Press, New York, 1997.
21. P. Ekman and E.L. Rosenberg. What the Face Reveals: Basic and Applied Studies of Spontaneous Expression using the Facial Action Coding System (FACS). 2nd Edition. Oxford University Press, New York, 2005.
22. B. Fasel and J. Luettin. Automatic facial expression analysis: A survey. Pattern Recognition, 36:259-275, 2003.
23. Ian R Fasel, Bret Fortenberry, and Javier R Movellan. A generative framework for real-time object detection and classification. Computer Vision and Image Understanding, 98, 2005.
24. M. G. Frank and P. Ekman. Not all smiles are created equal: The differences between enjoyment and other smiles. Humor: The International Journal for Research in Humor, 6:9-26, 1993.
25. M.G. Frank. International Encyclopedia of the Social and Behavioral Sciences, chapter Facial expressions. Elsevier, Oxford, 2002.
26. M.G. Frank and P. Ekman. Appearing truthful generalizes across different deception situations. Journal of personality and social psychology, 86:486-495, 2004.
27. M. Heller and V. Haynal. The faces of suicidal depression (translation). les visages de la depression de suicide. Kahiers Psychiatriques Genevois (Medecine et Hygiene Editors), 16:107-117, 1994.
28. T. Kanade, J.F. Cohn, and Y. Tian. Comprehensive database for facial expression analysis. In Proceedings of the fourth IEEE International conference on automatic face and gesture recognition (FG'00), pages 46-53, Grenoble, France, 2000.
29. Qi Y, Kapoor, A. and R.W. Picard. Fully automatic upper facial action recognition. In IEEE International Workshop on Analysis and Modeling of Faces and Gestures, 2003.
30. Y. Lin, X. Wei, Y. Sun, J. Wang, and M. Rosato. A 3d facial expression database for facial behavior research. In Proceedings, International Conference Automatic on Face and Gesture Recognition, 2006.
31. G. Littlewort, M.S. Bartlett, I. Fasel, J. Susskind, and J.R. Movellan. An automatic system for measuring facial expression in video. Image and Vision Computing, in press.
32. T. K. Marks, J. Hershey, J. Cooper Roddey, and J. R. Movellan. 3d tracking of morphable objects using conditionally gaussian nonlinear filters. In CVPR Workshop on Generative-Model Based Vision, 2004.
33. A. Meihlke. Surgery of the facial nerve. Saunders, Philadelphia, 1973.
34. O'Toole, J Harms, SL Snow, DR Hurst, MR Pappas JH Ayyad, and H Abdi. A video database of moving faces and people. IEEE Transactions on Pattern Analysis and Machine, 27(5):812-816, 2005.
35. M. Pantic and I. Patras. Dynamics of facial expression: Recognition of facial actions and their temporal segments from face profile image sequences. IEEE Transactions on Systems, Man and Cybernetics-Part B, 36(2):433-449, 2006.
36. M. Pantic and J.M. Rothkrantz. Automatic analysis of facial expressions: State of the art. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12):1424-1445, 2000.
37. M. Pantic and J.M. Rothkrantz. Facial action recognition for facial expression analysis from static face images. IEEE Transactions on Systems, Man and Cybernetics, 34(3):1449-1461, 2004.
38. M. Pantic, M.F. Valstar, R. Rademaker, and L. Maat. Web-based database for facial expression analysis. In Proc. IEEE Int'l Conf. on Multimedia and Expo (ICME'05), pages 317-321, 2005.
39. R.W. Picard. Affective Computing. MIT Press, 1997.
40. W. E. Rinn. The neuropsychology of facial expression: A review of the neurological and psychological mechanisms for producing facial expressions. Psychological Bulletin, 95(1):52-77, 1984.
41. Morecraft RJ, Louie JL, Herrick JL, and Stilwell-Morecraft KS. Cortical innervation of the facial nucleus in the non-human primate. a new interpretation of the effects of stroke and related subtotal brain trauma on the muscles of facial expression. Brain, 124:176-208, 2001.
42. E.L. Rosenberg, P. Ekman, W. Jiang, M. Babyak, et al. Linkages between facial expressions of anger and transient myocardial ischemia in men with coronary artery disease. American Psychological Assn, US. Emotion, 1(2):107-115, 2001.
43. D. D. Salvucci and J. R. Anderson. Intelligent gaze-added interfaces. in human factors in computing systems. In CHI Conference Proceedings, pages 273-280, New York, 2000. ACM Press.
44. M. A. Sayette, D. W. Smith, M.J. Breiner, and G. T Wilson. The effect of alcohol on emotional response to a social stressor. Journal of Studies on Alcohol, 53:541-545, 1992.
45. Y.L. Tian, T. Kanade, and J.F. Cohn. Recognizing action units for facial expression analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23:97-116, 2001.
46. Y. Tong, W. Liao, and Q. Ji. Inferring facial action units with causal relations. In Proceedings, Computer Vision and Pattern Recognition, 2006.
47. P. Viola and M. Jones. Robust real-time object detection. In ICCV Second International Workshop no Statistical and Conceptual Theories of Vision., 2001.