Virtual friend or threat? the effects of facial expression and gaze interaction on psychophysiological responses and emotional experience

Psychophysiology

Volumn 46, Issue 5, 2009, Pages 922-931

  Schrammel, Franziska ^a   Pannasch, Sebastian ^a   Graupner, Sven Thomas ^a   Mojzisch, Andreas ^b   Velichkovsky, Boris M ^a  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

^b UNIVERSITY OF GÖTTINGEN   (Germany)

Author keywords

EMG; Eye movements; Facial expression; Mutual gaze; Nonverbal communication; Pupillometry; Virtual characters

Indexed keywords

ADULT; AROUSAL; ARTICLE; ASSOCIATION; ATTENTION; ELECTROMYOGRAM; EMOTION; EXPERIENCE; EYE MOVEMENT; FACE MUSCLE; FACIAL EXPRESSION; FEMALE; GAZE; GENDER; HUMAN; HUMAN EXPERIMENT; MALE; MOTOR ACTIVITY; NORMAL HUMAN; PRIORITY JOURNAL; PSYCHOPHYSIOLOGY; PUPIL; SOCIAL ASPECT; THREAT; VIRTUAL REALITY;

ADULT; AROUSAL; ATTENTION; COMPUTER GRAPHICS; ELECTROMYOGRAPHY; EMOTIONS; FACIAL EXPRESSION; FEMALE; FIXATION, OCULAR; HUMANS; INTERPERSONAL RELATIONS; MALE; PHOTIC STIMULATION; PUPIL; SOCIAL PERCEPTION; YOUNG ADULT;

EID: 70349121336     PISSN: 00485772     EISSN: 14698986     Source Type: Journal    
DOI: 10.1111/j.1469-8986.2009.00831.x     Document Type: Article

References (66)

1. Achaibou, A., Pourtois, G., Schwartz, S. Vuilleumier, P. (2008). Simultaneous recording of EEG and facial muscle reactions during spontaneous emotional mimicry. Neuropsychologia, 46, 1104 1113.
2. Adams, R. B. Jr., Gordon, H. L., Baird, A. A., Ambady, N. Kleck, R. E. (2003). Effects of gaze on amygdala sensitivity to anger and fear faces. Science, 300, 1536.
3. Adams, R. B. Jr. Kleck, R. E. (2003). Perceived gaze direction and the processing of facial displays of emotion. Psychological Science, 14, 644 647.
4. Adams, R. B. Jr. Kleck, R. E. (2005). Effects of direct and averted gaze on the perception of facially communicated emotion. Emotion, 5, 3 11.
5. Argyle, M. Cook, M. (1976). Gaze and mutual gaze. Cambridge, UK : Cambridge University Press.
6. Baron-Cohen, S. (1995). Mindblindness: An essay on autism and theory of mind. Cambridge, MA : MIT Press.
7. Baron-Cohen, S., Wheelwright, S. Jolliffe, T. (1997). Is there a "language of the eyes"? Evidence from normal adults and adults with autism or Asperger syndrome. Visual Cognition, 4, 311 331. (Pubitemid 127700185)
8. Bailenson, J. N., Blascovich, J., Beall, A. C. Loomis, J. M. (2003). Interpersonal distance in immersive virtual environments. Personality and Social Psychology Bulletin, 29, 1 15.
9. Blairy, S., Herrera, P. Hess, U. (1999). Mimicry and the judgment of emotional facial expressions. Journal of Nonverbal Behavior, 23, 5 41.
10. Bourgeois, P. Hess, U. (2008). The impact of social context on mimicry. Biological Psychology, 77, 343 352.
11. Bradley, M. M. Lang, P. J. (1994). Measuring emotion: The Self-Assessment Manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25, 49 59.
12. Bradley, M. M., Miccoli, L., Escrig, M. A. Lang, P. J. (2008). The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology, 45, 602 607.
13. Dalton, K. M., Nacewicz, B. M., Johnstone, T., Schaefer, H. S., Gernsbacher, M. A., Goldsmith, H. H., et al 2005). Gaze fixation and the neural circuitry of face processing in autism. Nature Neuroscience, 8, 519 526.
14. Diamond, M. R., Ross, J. Morrone, M. C. (2000). Extraretinal control of saccadic suppression. Journal of Neuroscience, 20, 3449 3455.
15. Dimberg, U. (1997). Facial reactions: Rapidly evoked emotional responses. Journal of Psychophysiology, 11, 115 123.
16. Dimberg, U. Lundquist, L. O. (1990). Gender differences in facial reactions to facial expressions. Biological Psychology, 30, 151 159.
17. Dimberg, U. Thunberg, M. (1998). Rapid facial reactions to emotional facial expressions. Scandinavian Journal of Psychology, 39, 39 45.
18. Dimberg, U., Thunberg, M. Elmehed, K. (2000). Unconscious facial reactions to emotional facial expressions. Psychological Science, 11, 86 89.
19. Dimberg, U., Thunberg, M. Grunedal, S. (2002). Facial reactions to emotional stimuli: Automatically controlled emotional responses. Cognition and Emotion, 16, 449 471.
20. Driver, J., Davis, G., Ricciardelli, P., Kidd, P., Maxwell, E. Baron-Cohen, S. (1999). Gaze perception triggers reflexive visuospatial orienting. Visual Cognition, 6, 509 540.
21. Eagly, A. H. (1987). Sex differences in social behaviour: A social-role interpretation. Hillsdale, NJ : Lawrence Erlbaum.
22. Ekman, P. Friesen, W. (1978). Facial action coding system: A technique for the measurement of facial movement. Palo Alto, CA : Consulting Psychologists Press.
23. Ferrari, P. F., Gallese, V., Rizzolatti, G. Fogassi, L. (2003). Mirror neurons responding to the observation of ingestive and communicative mouth actions in the monkey ventral premotor cortex. European Journal of Neuroscience, 17, 1703 1714.
24. Fox, E. Damjanovic, L. (2006). The eyes are sufficient to produce a threat superiority effect. Emotion, 6, 534 539.
25. Fridlund, A. J. Cacioppo, J. T. (1986). Guidelines for human electromyographic research. Psychophysiology, 23, 567 589.
26. Friesen, C. K. Kingstone, A. (1998). The eyes have it! Reflexive orienting is triggered by nonpredictive gaze. Psychonomic Bulletin and Review, 5, 490 495.
27. Friesen, C. K., Moore, C. Kingstone, A. (2005). Does gaze direction really trigger a reflexive shift of spatial attention? Brain and Cognition, 57, 66 69.
28. Gale, A., Kingsley, E., Brookes, S. Smith, D. (1978). Cortical arousal and social intimacy in human female under different conditions of eye contact. Behavioural Processes, 3, 271 275.
29. Graham, R. La Bar, K. S. (2007). Garner interference reveals dependencies between emotional expression and gaze in face perception. Emotion, 7, 296 313.
30. Green, M. J., Williams, L. M. Davidson, D. (2003). In the face of danger: Specific viewing strategies for facial expressions of threat? Cognition and Emotion, 17, 779 786.
31. Hall, J. A. Halberstadt, A. G. (1986). Smiling and gazing. In J. S. Hyde M. C. Linn (Eds.), The psychology of gender (pp. 136 158). Baltimore, MD : The Johns Hopkins University Press.
32. Hamm, A. O., Cuthbert, B. N., Globisch, J. Vaitl, D. (1997). Fear and the startle reflex: Blink modulation and autonomic response patterns in animal and mutilation fearful subjects. Psychophysiology, 34, 97 107.
33. Hamm, A. O. Vaitl, D. (1993). Emotionsinduktion durch visuelle Reize: Validierung einer Stimulationsmethode auf drei Reaktionsebenen. [Emotion induction using visual stimuli: Validating an elicitation method on three response levels]. Psychologische Rundschau, 44, 143 161.
34. Hess, U., Adams, R. B. Kleck, R. E. (2005). Who may frown and who should smile? Dominance, affiliation, and the display of happiness and anger. Cognition and Emotion, 19, 515 536.
35. Hess, U., Adams, R. B. Kleck, R. E. (2007). Looking at you or looking elsewhere: The influence of head orientation on the signal value of emotional facial expressions. Motivation and Emotion, 31, 137 144.
36. Hess, U., Philippot, P. Blairy, S. (1998). Facial reactions to emotional facial expressions: Affect or cognition? Cognition and Emotion, 12, 509 532.
37. Janisse, M. P. (1977). Pupillometry. Washington, DC : Hemisphere Publishing Corporation.
38. Johnsen, B. H., Thayer, J. F. Hugdahl, K. (1995). Affective judgment of the Ekman faces - A dimensional approach. Journal of Psychophysiology, 9, 193 202.
39. Kätsyri, J., Klucharev, V., Frydrych, M. Sams, M. (2003). Identification of synthetic and natural emotional facial expressions. Proceedings of the International Conference on Audio-Visual Speech Processing, 9, 239 243.
40. Klucharev, V. Sams, M. (2004). Interaction of gaze direction and facial expressions processing: ERP study. NeuroReport, 15, 621 625.
41. Ku, J., Jang, H. J., Kim, K. U., Kim, J. H., Park, S. H., Lee, J. H., et al 2005). Experimental results of affective valence and arousal to avatar's facial expressions. Cyberpsychology and Behavior, 8, 493 503.
42. LaFrance, M. Hecht, M. (2000). Gender and smiling: A meta-analysis. In A. H. Fischer (Ed.), Gender and emotion (pp. 118 142). Cambridge, UK : University Press.
43. Lang, P. J. (1980). Behavioural treatment and bio-behavioural assessment: Computer applications. In J. B. Sidowski, J. H. Johnson T. A. Williams (Eds.), Technology in mental health care delivery systems (pp. 119 137). Norwood, NJ : Ablex.
44. Larsen, J. T., Norris, C. J. Cacioppo, J. T. (2003). Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii. Psychophysiology, 40, 776 785.
45. Likowski, K. U., Mühlberger, A., Seibt, B., Pauli, P. Weyers, P. (2008). Modulation of facial mimicry by attitudes. Journal of Experimental Social Psychology, 44, 1065 1072.
46. Lundqvist, D. Öhman, A. (2005). Emotion regulates attention: The relation between facial configurations, facial emotion, and visual attention. Visual Cognition, 12, 51 84.
47. Lundqvist, L. O. Dimberg, U. (1995). Facial expressions are contagious. Journal of Psychophysiology, 9, 203 211.
48. McIntosh, D. N. (2006). Spontaneous facial mimicry, liking and emotional contagion. Polish Psychological Bulletin, 37, 31 42.
49. Mojzisch, A., Schilbach, L., Helmert, J., Pannasch, S., Velichkovsky, B. M. Vogeley, K. (2006). The effects of self-involvement on attention, arousal, and facial expression during social interaction with virtual others: A psychophysiological study. Social Neuroscience, 1, 184 195.
50. Moody, E. J., McIntosh, D. N., Mann, L. J. Weisser, K. R. (2007). More than mere mimicry? The influence of emotion on rapid facial reactions to faces. Emotion, 7, 447 457.
51. Mühlberger, A., Kund, A., Pauli, P. Weyers, P. (2006). Modulation of facial reactions to avatar emotional faces by nonconscious competition priming. Journal of Psychophysiology, 20, 143 143.
52. Neumann, D., Spezio, M. L., Piven, J. Adolphs, R. (2006). Looking you in the mouth: Abnormal gaze in autism resulting from impaired top-down modulation of visual attention. Social Cognitive and Affective Neuroscience, 1, 194 202.
53. Nichols, K. A. Champness, B. G. (1971). Eye gaze and GSR. Journal of Experimental Social Psychology, 7, 623 626.
54. Öhman, A., Lundqvist, D. Esteves, F. (2001). The face in the crowd revisited: A threat advantage with schematic stimuli. Journal of Personality and Social Psychology, 80, 381 396.
55. Parr, L. A., Waller, B. M. Fugate, J. (2005). Emotional communication in primates: Implications for neurobiology. Current Opinion in Neurobiology, 15, 716 720.
56. Pelphrey, K. A., Sasson, N. J., Reznick, J. S., Paul, G., Goldman, B. D. Piven, J. (2002). Visual scanning of faces in autism. Journal of Autism and Developmental Disorders, 32, 249 261.
57. Sander, D., Grandjean, D., Kaiser, S., Wehrle, T. Scherer, K. (2007). Interaction effects of perceived gaze direction and dynamic facial expression: Evidence for appraisal theories of emotion. European Journal of Cognitive Psychology, 19, 470 480.
58. Sato, W., Yoshikawa, S., Kochiyama, T. Matsumura, M. (2004). The amygdala processes the emotional significance of facial expressions: An fMRI investigation using the interaction between expression and face direction. NeuroImage, 22, 1006 1013.
59. Schilbach, L., Wohlschlaeger, A. M., Kraemer, N. C., Newen, A., Shah, N. J., Fink, G. R., et al 2006). Being with virtual others: Neural correlates of social interaction. Neuropsychologia, 44, 718 730.
60. Schwartz, G. E., Fair, P. L., Salt, P., Mandel, M. R. Klerman, G. L. (1976). Facial expression and imagery in depression - Electromyographic study. Psychosomatic Medicine, 38, 337 347.
61. Spencer-Smith, J., Wild, H., Innes-Ker, A. H., Townsend, J., Duffy, C., Edwards, C., et al 2001). Making faces: Creating three-dimensional parameterized models of facial expression. Behavior Research Methods, Instruments, and Computers, 33, 115 123.
62. Tomasello, M. Carpenter, M. (2007). Shared intentionality. Developmental Science, 10, 121 125.
63. Tomasello, M., Carpenter, M., Call, J., Behne, T. Moll, H. (2005). Understanding and sharing intentions: The origins of cultural cognition. Behavioural and Brain Sciences, 28, 675 735.
64. Velichkovsky, B. M. (1995). Communicating attention: Gaze position transfer in cooperative problem solving. Pragmatics and Cognition, 3, 199 224.
65. Wehrle, T., Kaiser, S., Schmidt, S. Scherer, K. R. (2000). Studying the dynamics of emotional expression using synthesized facial muscle movements. Journal of Personality and Social Psychology, 78, 105 119.
66. Weyers, P., Mühlberger, A., Hefele, C. Pauli, P. (2006). Electromyographic responses to static and dynamic avatar emotional facial expressions. Psychophysiology, 43, 450 453.