The contribution of different facial regions to the recognition of conversational expressions

Journal of Vision

Volumn 8, Issue 8, 2008, Pages

  Nusseck, Manfred ^a,b   Cunningham, Douglas W ^c   Wallraven, Christian ^a   Bülthoff, Heinrich H ^a  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^b University of Tübingen ^*  (Germany)

^c UNIVERSITY OF TÜBINGEN   (Germany)

Author keywords

Conversational expressions; Expression recognition; Faces; Facial motions

Indexed keywords

ADULT; ARTICLE; EMOTION; FACE; FACE MUSCLE; FACIAL EXPRESSION; FEMALE; HAPPINESS; HUMAN; INTERPERSONAL COMMUNICATION; MALE; MOVEMENT (PHYSIOLOGY); PHYSIOLOGY; PSYCHOPHYSICS; RECOGNITION; THINKING; VERBAL BEHAVIOR;

ADULT; COMMUNICATION; EMOTIONS; FACE; FACIAL EXPRESSION; FACIAL MUSCLES; FEMALE; HAPPINESS; HUMANS; MALE; MOVEMENT; PSYCHOPHYSICS; RECOGNITION (PSYCHOLOGY); THINKING; VERBAL BEHAVIOR; YOUNG ADULT;

EID: 44449100126     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/8.8.1     Document Type: Article

References (54)

1. Adolphs, R. (2002). Recognizing emotion from facial expressions: Psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews, 1, 21-62.
2. Ambadar, Z., Schooler, J. W., & Cohn, J. F. (2005). Deciphering the enigmatic face: The importance of facial dynamics in interpreting subtle facial expressions. Psychological Science, 16, 403-410.
3. Argyle, M., & Cook, M. (1976). Gaze and mutual gaze. New York: Cambridge University Press.
4. Baron-Cohen, S., Wheelwright, S., & Jolliffe, T. (1997). Is there a "language of the eyes?" Evidence from normal adults and adults with autism or Asperger syndrome. Visual Cognition, 4, 311-331.
5. Bassili, J. N. (1978). Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology: Human Perception and Performance, 4, 373-379.
6. Bassili, J. N. (1979). Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology, 37, 2049-2058.
7. Bavelas, J. B., Coates, L., & Johnson, T. (2000). Listeners as co-narrators. Journal of Personality and Social Psychology, 79, 941-952.
8. Bull, P. (2001). State of the art: Nonverbal communication. Psychologist, 14, 644-647.
9. Calder, A. J., & Young, A. W. (2005). Understanding the recognition of facial identity and facial expression. Nature Reviews, Neuroscience, 6, 641-651.
10. Cassell, J., & Thorisson, K. (2001). The power of a nod and a glance: Envelope vs. emotional feedback in animated conversational agents. Applied Artificial Intelligence, 13, 519-539.
11. Cohn, J., & Kanade, T. (2006). Use of automated facial image analysis for measurement of emotion expression. In J. A. Coan & J. B. Allen (Eds.), The handbook of emotion elicitation and assessment. Oxford University Press Series in Affective Science. New York: Oxford.
12. Cohn, J., Schmidt, K., Gross, R., & Ekman, P. (2002). Individual differences in facial expression: Stability over time, relation to self-reported emotion, and ability to inform person identification. In Proceedings of the International Conference on Multimodal User Interfaces (pp. 491-496).
13. Constantini, E., Pianesi F., & Prete, M. (2005). Recognising emotions in human and synthetic faces: The role of the upper and lower part of the face. In Proceedings of Intelligent User Interfaces IUI'05. New York: ACM.
14. Cunningham, D., Breidt, M., Kleiner, M., Wallraven, C., & Bülthoff, H. (2003). How believable are real faces: Towards a perceptual basis for conversational animation. Computer Animation and Social Agents, 23-39.
15. Cunningham, D., Kleiner, M., Wallraven, C., & Bülthoff, H. (2004). The components of conversational facial expressions. In APGV 2004 Symposium on Applied Perception in Graphics and Visualization ACH Press (pp. 143-149).
16. Cunningham, D., Kleiner, M., Wallraven, C., & Bülthoff, H. (2005). Manipulating video sequences to determine the components of conversational facial expressions. ACM Transactions on Applied Perception, 2, 251-269.
17. Cunningham, D., Nusseck, M., Wallraven, C., & Bülthoff, H. (2004). The role of image size in the recognition of conversational facial expressions. Computer Animation & Virtual Worlds, 15.
18. Cunningham, D., & Wallraven, C. (2008). Temporal information for the recognition of facial expressions. Manuscript submitted for publication.
19. Darwin, C. (1872). The expression of emotion in man and animals. New York: D. Appleton and company.
20. Edwards, K. (1998). The face of time: Temporal cues in facial expressions of emotion. Psychological Science, 9, 270-276.
21. Ehrlich, S. M., Schiano, D. J., & Sheridan, K. (2000). Communicating facial affect: It's not the realism, it's the motion. In Proceedings of ACM CHI 2000 Conference on Human Factors in Computing Systems (pp. 252-253). New York: ACM.
22. Ekman, P. (1972). Universals and cultural differences in facial expressions of emotion. In J. K. Cole (Ed.), Nebraska symposium of motivation, 1971 (vol. 4, pp. 207-283). Lincoln: University of Nebraska Press.
23. Ekman, P. (1989). The argument and evidence about universals in facial expressions of emotion. In H. Wagner & A. Manstead (Eds.), Handbook of social psychophysiology (pp. 143-146). New York: John Wiley.
24. Ekman, P. (1992). Facial expressions of emotion: New findings, new questions. Psychological Science, 3, 34-38.
25. Ekman, P. (2004). Emotions revealed: Recognizing faces and feelings to improve communication and emotional life. NY: Owl Books.
26. Ekman, P., & Friesen, W. (1978). Facial action coding system. Palo Alto, California: Consulting Psychologists Press, Inc.
27. Essa, I. A., & Pentland, A. (1994). A vision system for observing and extracting facial action. In IEEE CVPR 1994 Conference (pp. 76-83).
28. Frank, M. G., & Stennett, J. (2001). The forced-choice paradigm and the perception of facial expressions of emotion. Journal of Personality and Social Psychology, 80, 75-85.
29. Gibson, J. J. (1979). The ecological approach to visual perception. Boston: Houghton Mifflin.
30. Hanawalt, N. (1944). The role of the upper and lower parts of the face as the basis for judging facial expressions: II. In posed expressions and "candid camera" pictures. Journal of General Psychology, 31, 23-36.
31. Harwood, N. K., Hall, L. J., & Shinkfield, A. J. (1999). Recognition of facial emotional expressions from moving and static displays by individuals with mental retardation. American Journal on Mental Retardation, 104, 270-278.
32. Hill, H. C., Troje, N. F., & Johnston, A. (2005). Range- and domain-specific exaggeration of facial speech. Journal of Vision, 5(10):4, 793-807, http://journalofvision.org/5/10/4/, doi:10.1167/ 5.10.4.
33. Humphreys, G. W., Donnelly, N., & Riddoch, M. J. (1993). Expression is computed separately from facial identity, and is computed separately for moving and static faces: Neuropsychological evidence. Neuropsychologia, 31, 173-181.
34. Kamachi, M., Bruce, V., Mukaida, S., Gyoba, J., Yoshikawa, S., & Akamatsu, S. (2001). Dynamic properties influence the perception of facial expressions. Perception, 30, 875-887.
35. Katsyri, J., Klucharev, V., Frydrych, M., & Sams, M. (2003). Identification of synthetic and natural emotional facial expressions. Paper Presented at the ISCA Tutorial and Research Workshop on Audio Visual Speech Processing (AVSP), St. Jorioz, France.
36. Keltner, D. (1995). Signs of appeasement: Evidence for the distinct displays of embarrassment, amusement, and shame. Journal of Personality & Social Psychology, 68, 441-454.
37. Kleiner, M., Wallraven, C., Breidt, M., Cunningham, D., & Bülthoff, H. (2004). Multi-viewpoint video capture for facial perception research. In Captech 2004 Workshop on modeling and motion capture techniques for virtual environments (pp. 55-60).
38. Kleiner, M., Wallraven, C., & Bülthoff, H. H. (2004). The MPI Videolab a system for high quality synchronous recording of video and audio from multiple viewpoints (Tech. Rep. No. 123). Tübingen, Germany: Max Planck Institute for Biological Cybernetics.
39. Kohler, C. G., Turner, T., Stolar, N., Bilker, W., Brensinger, C. M., Gur, R. E., et al. (2004). Differences in facial expressions of four universal emotions. Psychiatry Research, 128, 235-244.
40. Kshirsagar, S., Escher, M., Sannier, G., & Magnenat-Thalmann, N. (1999). Multimodal animation system based on the MPEG4 standard. Proceedings of Multimedia Modeling, 215-232.
41. LaBar, K. S., Crupain, M. J., Voyvodic, J. T., & McCarthy, G. (2003). Dynamic perception of facial affect and identity in the human brain. Cerebral Cortex, 13, 1023-1033.
42. O'Toole, A. J., Roark, D. A., & Abdi, H. (2002). Recognizing moving faces: A psychological and neural synthesis. Trends in Cognitive Sciences, 6, 261-266.
43. Pelachaud, C., Badler, N. I., & Steedman, M. (1996). Generating facial expressions for speech. Cognitive Science, 20, 1-46.
44. Pelachaud, C., & Poggi, I. (2002). Subtleties of facial expressions in embodied agents. Journal of Visualization and Computer Animation.
45. Russell, J. (1993). Forced-choice response format in the study of facial. expression. Motivation and Emotion, 17, 41-51.
46. Russell, J., & Fernandez-Dols, J. M. (1997). The psychology of facial expression. New York: Cambridge University Press.
47. Sayette, M. A., Cohn, J. F., Wertz, J. M., Perrott, M. A., & Parrott, D. J. (2001). A psychometric evaluation of the facial action coding system for assessing spontaneous expression. Journal of Nonverbal Behavior, 25, 167-185.
48. Schwaninger, A., Wallraven, C., Cunningham, D. W., & Chiller-Glaus, S. D. (2006). Processing of facial identity and expression: A psychophysical, physiological, and computational perspective. Progress in Brain Research, 156, 321-343.
49. Smith, M. L., Cottrell, G. W., Gosselin, F., & Schyns, P. G. (2005). Transmitting and decoding facial expressions. Psychological Science, 16, 184-189.
50. Wallraven, C., Breidt, M., Cunningham, D., & Bülthoff, H. (2007). Evaluating the perceptual realism of animated facial expressions. ACM Transactions on Applied Perception.
51. Wallraven, C., Fischer, J., Cunningham, D., Bartz, D., & Bülthoff, H. H. (2006). The evaluation of stylized facial expressions. In Proceedings of the 3rd Symposium on Applied Perception in Graphics and Visualization (pp. 85-92).
52. Wehrle, T., Kaiser, S., Schmidt, S., & Scherer, K. R. (2000). Studying the dynamics of emotional expression using synthesized facial muscle movements. Journal of Personality and Social Psychology, 78, 105-119.
53. Weyers, P., Mühlberger, A., Hefele, C., & Pauli, P. (2006). Electromyographic responses to static and dynamic avatar emotional facial expressions. Psychophysiology, 43, 450-453.
54. Yngve, V. H. (1970). On getting a word in edgewise. Papers from the Sixth Regional Meeting, Chicago Linguistics Society (pp. 567-578).