Manipulating Video Sequences to Determine the Components of Conversational Facial Expressions

ACM Transactions on Applied Perception

Volumn 2, Issue 3, 2005, Pages 251-269

  Cunningham, Douglas W ^a   Christianwallraven, Mariokleiner ^a   Bülthoff, Heinrichh ^a  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

animation; Applied perception; computer graphics; Experimentation; facial expressions; human computer interface

Indexed keywords

EID: 33749046446     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/1077399.1077404     Document Type: Article

References (37)

1. Barton, J. J. S. 2003. Disorders of face perception and recognition. Neurologic Clinics 21, 521-548.
2. Bassili, J. 1978. Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology 4, 373-379.
3. Bassili, J. 1979. Emotion recognition: The role of facial motion and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology 37, 2, 049-2, 059.
4. Bavelas, J. B., Black, A., Lemery, C. R., and Mullett, J. 1986. I show how you feel-motor mimicry as a communicative act. Journal of Personality and Social Psychology 59, 322-329.3.
5. Bavelas, J. B. and Chovil, N. 2000. Visible acts of meaning-an integrated message model of language in face-to-face dialogue. Journal of Language and Social Psychology 19, 163-194.
6. Bavelas, J. B., Coates, L., and Johnson, T. 2000. Listeners as co-narrators. Journal of Personality and Social Psychology 79, 941-952.
7. Blanz, V. and Vetter, T. 1999. A morphable model for the synthesis of 3d faces. In SIGGRAPH'99 Conference Proceedings. 187-194.
8. Bruce, V. 1988. Recognising Faces. Lawrence Erlbaum Associates, Mahwah, NJ.
9. Bull, P. 2001. State of the art: Nonverbal communication. The Psychologist 14, 644-647.
10. Bull, R. E. and Connelly, G. 1986. Body movement and emphasis in speech. Journal of Nonverbal Behaviour 9, 169-187.
11. Cassell, J., Bickmore, T., Cambell, L., Vilhjalmsson, H., and Yan, H. 2001. More than just a pretty face: conversational protocols and the affordances of embodiment. Knowledge-Based Systems 14, 22-64.
12. Cassell, J. and Thorisson, K. R. 1999. The power of a nod and a glance: Envelope vs. emotional feedback in animated conversational agents. Applied Artificial Intelligence 13, 519-538.
13. Condon, W. S. and Ogston, W. D. 1966. Sound film analysis of normal and pathological behaviour patterns. Journal of Nervous and Mental Disease 143, 338-347.
14. Cunningham, D. W., Breidt, M., Kleiner, M., Wallraven, C., and Bulthoff, H. H. 2003a. How believable are real faces?: Towards a perceptual basis for conversational animation. In Computer Animation and Social Agents 2003. 23-29.
15. Cunningham, D. W., Breidt, M., Kleiner, M., Wallraven, C., and Bulthoff, H. H. 2003b. The inaccuracy and insincerity of real faces. In Proceedings of Visualization, Imaging, and Image Processing 2003. 7-12.
16. Cunningham, D. W., Nusseck, M., Wallraven, C., and Bulthoff, H. H. 2004. The role of image size in the recognition of conversational facial expressions. Computer Animation & Virtual Worlds 15, 3-4 (July), 305-310.
17. Decarlo, D., Revilla, C., and Stone, M. 2002. Making discourse visible: Coding and animating conversational facial displays. In Proceedings of the Computer Animation 2002. 11-16.
18. Donato, G., Bartlett, M. S., Hager, J. C., Ekman, P., and Sejnowski, T. J. 1999. Classifying facial actions. IEEE Trans. Pattern Anal. Mach. Intell. 21, 10, 974-989.
19. Edwards, K. 1998. The face of time: Temporal cues in facial expressions of emotion. Psychological Science 9, 270-276.
20. Ekman, P. 1972. Universal and cultural differences in facial expressions of emotion. In Nebraska Symposium on Motivation 1971, J. R. Cole, Ed. University of Nebraska Press, Lincoln, NE, 207-283.
21. Ekman, P. and Friesen, W. 1978. Facial Action Coding System. Consulting Psychologists Press, Inc., Palo Alto, California.
22. Essa, I. and Pentland, A. 1994. A vision system for observing and extracting facial action parameters. In CVPR 94, 76-83.
23. Frank, M. G. and Stennett, J. 2001. The forced-choice paradigm and the perception of facial expressions of emotion. Journal of Personality and Social Psychology 80, 75-85.
24. Gooch, B. and Gooch, A. 2001. Non-Photorealistic Rendering. A. K. Peters. Natick, Massachusetts, USA.
25. Humphreys, G., Donnelly, N., and Riddoch, M. 1993. Expression is computed separately from facial identity, and is computed separately for moving and static faces: Neuropsychological evidence. Neuropsychologia 31, 173-181.
26. Isaacs, E. and Tang, J. 1993. What video can and can't do for collaboration: a case study. In “ACM Multimedia'93”. ACM, New York, 496-503.
27. Kamachi, M., Bruce, V., Mukaida, S., Gyoba, J., Yoshikawa, S., and Akamatsu, S. 2001. Dynamic properties influence the perception of facial expressions. Perception 30, 875-887.
28. Kleiner, M., Wallraven, C., and Bulthoff, H. H. 2004. The MPI Videolab-a system for high quality synchronous recording of video and audio from multiple viewpoints. Tech. Rep. 123, Max Planck Institute for Biological Cybernetics, Tubingen, Germany.
29. Motley, M. T. 1993. Facial affect and verbal context in conversation-facial expression as interjection. Human Communication Research 20, 3-40.
30. Pantic, M. and Rothkrantz, L. J. M. 2000. Automatic analysis of facial expressions: The state of the art. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 12, 1424-1445.
31. Pelachaud, C., Badler, N., and Viaud, M. 1994. Final report to the NSF of the standards for facial animation workshop. Tech. rep., University of Pennsylvania, School of Engineering and Applied Science, Computer and Information Science Department, Philadelphia, PA 6389-19104.
32. Poggio, I. and Pelachaud, C. 2000. Perfomative facial expressions in animated faces. In Embodied Conversational Agents, J. Cassell, J. Sullivan, S. Prevost, and E. Churchill, Eds. MIT Press, Cambridge, MA, 115-188.
33. Sayette, M. A., Cohn, J. F., Wertz, J. M., Perrott, M. A. J. D. 2001. A psychometric evaluation of the facial action coding system for assessing spontaneous expression. Journal of Nonverbal Behavior 25, 167-186.
34. Strothotte, T. and Schlechtweg, S. 2002. Non-Photorealistic Computer Graphics: Modeling, Rendering, and Animation. Morgan Kaufmann, san Francisco, CA.
35. Thorisson, K. R. 1996. Toonface: A system for creating and animating cartoon faces. Tech. Rep. 96-01, M.I.T. Media Laboratory, Learning & Common Sense Section.
36. Vertegaal, R. 1997. Conversational awareness in multiparty vmc. In “Extended Abstracts of CHI'97”. ACM, Atlanta, 496-503.
37. Yngve, V. H. 1970. On getting a word in edgewise. In Papers from the Sixth Regional Meeting of the Chicago Linguistic Society. Chicago Linguistic Society, Chicago, Illinois. 567-578.