Face the noise: Embodied responses to nonverbal vocalizations of discrete emotions

Journal of Personality and Social Psychology

Volumn 102, Issue 4, 2012, Pages 796-814

  Hawk, Skyler T ^a   Fischer, Agneta H ^a   Van Kleef, Gerben A ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Cross channel simulation; Embodied emotions; Emotion vocalization; Empathy; Facial expression; Nonverbal vocalizations

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; COMPARATIVE STUDY; CRYING; EMOTION; EMPATHY; FACE MUSCLE; FACIAL EXPRESSION; FEMALE; HEARING; HUMAN; HUMAN RELATION; INHIBITION (PSYCHOLOGY); MIDDLE AGED; NEUROPSYCHOLOGICAL TEST; NONVERBAL COMMUNICATION; PERCEPTION; PHYSIOLOGY; PSYCHOLOGICAL ASPECT;

ADOLESCENT; ADULT; AUDITORY PERCEPTION; CRYING; EMOTIONS; EMPATHY; FACIAL EXPRESSION; FACIAL MUSCLES; FEMALE; HUMANS; INHIBITION (PSYCHOLOGY); INTERPERSONAL RELATIONS; LAUGHTER; MIDDLE AGED; NEUROPSYCHOLOGICAL TESTS; NONVERBAL COMMUNICATION; SOCIAL PERCEPTION; YOUNG ADULT;

EID: 84861096084     PISSN: 00223514     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0026234     Document Type: Article

References (104)

1. Arnott, S. R., Singhal, A., & Goodale, M. A. (2009). An investigation of auditory contagious yawning. Cognitive, Affective, & Behavioral Neuroscience, 9, 335-342. doi:10.3758/CABN.9.3.335
2. Bachorowski, J.-A., & Owren, M. J. (2001). Not all laughs are alike: Voiced but not unvoiced laughter readily elicits positive affect. Psychological Science, 12, 252-257. doi:10.1111/1467-9280.00346
3. Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70, 614-636. doi:10.1037/0022-3514.70.3.614
4. Barrett, L. F., & Russell, J. A. (1999). Structure of current affect. Current Directions in Psychological Science, 8, 10-14. doi:10.1111/14678721.00003
5. Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577-609.
6. Barsalou, L. W., Niedenthal, P. M., Barbey, A. K., & Ruppert, J. A. (2003). Social embodiment. In B. H. Ross (Ed.), The psychology of learning and motivation: Vol. 43. Advances in research and theory (pp. 43-92). New York, NY: Academic Press.
7. Batson, C. D., Turk, C. L., Shaw, L. L., & Klein, T. R. (1995). Information function of empathic emotion: Learning that we value the other's welfare. Journal of Personality and Social Psychology, 68, 300-313. doi: 10.1037/0022-3514.68.2.300
8. Bavelas, J. B., Black, A., Lemery, C. R., & Mullett, J. (1986). "I show how you feel": Motor mimicry as a communicative act. Journal of Personality and Social Psychology, 50, 322-329. doi:10.1037/00223514.50.2.322
9. Blairy, S., Herrera, P., & Hess, U. (1999). Mimicry and the judgment of emotional facial expressions. Journal of Nonverbal Behavior, 23, 5-41. doi:10.1023/A:1021370825283
10. Bradley, M. M., & Lang, P. J. (2000). Affective reactions to acoustic stimuli. Psychophysiology, 37, 204-215. doi:10.1111/14698986.3720204
11. Carr, L., Iacoboni, M., Dubeau, M. C., Mazziotta, J. C., & Lenzi, G. L. (2003). Neural mechanisms of empathy in humans: A relay from neural systems for imitation to limbic areas. Proceedings of the National Academy of Sciences of the United States of America, 100, 5497-5502. doi:10.1073/pnas.0935845100
12. Chartrand, T. L., & Bargh, J. A. (1999). The chameleon effect: The perception-behavior link and social interaction. Journal of Personality and Social Psychology, 76, 893-910. doi:10.1037/0022-3514.76.6.893
13. Coyne, J. C. (1976). Depression and the response of others. Journal of Abnormal Psychology, 85, 186-193. doi:10.1037/0021-843X.85.2.186
14. Dapretto, M., Davies, M. S., Pfeifer, J. H., Scott, A. A., Sigman, M., Bookheimer, S. Y., & Iacoboni, M. (2006). Understanding emotions in others: Mirror neuron dysfunction in children with autism spectrum disorders. Nature Neuroscience, 9, 28-30.
15. Davis, J. I., Gross, J. J., & Ochsner, K. N. (2011). Psychological distance and emotional experience: What you see is what you get. Emotion, 11, 438-444. doi:10.1037/a0021783
16. Davis, J. I., Senghas, A., Brandt, & Ochsner, K. N. (2010). The effects of Botox injections on emotional experience. Emotion, 10, 433-440. doi: 10.1037/a0018690
17. Davis, J. I., Senghas, A., & Ochsner, K. N. (2009).How does facial feedback modulate emotional experience. Journal of Research in Personality, 43, 822-829. doi:10.1016/j.jrp.2009.06.005
18. De Gelder, B., Pourtois, G., & Weiskrantz, L. (2002). Fear recognition in the voice is modulated by unconsciously recognized facial expressions but not by unconsciously recognized affective pictures. Proceedings of the National Academy of Sciences of the United States of America, 99, 4121-4126. doi:10.1073/pnas.062018499
19. De Gelder, B., & Vroomen, J. (2000). Bimodal emotion perception: Integration across separate modalities, cross-modal perceptual grouping or perception of multimodal events? Cognition and Emotion, 14(3), 321-324. doi:10.1080/026999300378842
20. Dijksterhuis, A., & Bargh, J. A. (2001). The perception-behavior expressway: Automatic effects of social perception on social behavior. In M. P. Zanna (Ed.), Advances in experimental social psychology (Vol. 33, pp. 1-40). New York, NY: Academic Press.
21. Dimberg, U. (1982). Facial reactions to facial expressions. Psychophysiology, 19, 643-647. doi:10.1111/j.1469-8986.1982.tb02516.x
22. Dimberg, U. (1990). Facial electromyography reactions and automatic activity to auditory stimuli. Biological Psychology, 31, 137-147. doi: 10.1016/0301-0511(90)90013-M
23. Dimberg, U. (1996). Facial EMG and the orienting response[Abstract]. Psychophysiology, 33, S34.
24. Dimberg, U., & Karlsson, B. (1997). Facial reactions to different emotionally relevant stimuli. Scandinavian Journal of Psychology, 38, 297-303. doi:10.1111/1467-9450.00039
25. Dimberg, U., & Lundqvist, L. (1990). Gender differences in facial reactions to facial expressions. Biological Psychology,30, 151-159.
26. Dimberg, U., & öhman, A. (1996). Behold the wrath: Psychophysiological responses to facial stimuli. Motivation and Emotion, 20, 149-182. doi:10.1007/BF02253869
27. Dimberg, U., & Petterson, M. (2000). Facial reactions to happy and angry facial expressions: Evidence for right hemisphere dominance. Psychophysiology, 37, 693-696. doi:10.1111/1469-8986.3750693
28. Dimberg, U., & Thunberg, M. (1998). Rapid facial reactions to emotional facial expressions. Scandinavian Journal of Psychology, 39, 39-46. doi:10.1111/1467-9450.00054
29. Dimberg, U.,Thunberg, M., & Elmehed, K. (2000). Unconscious facial reactions to emotional facial expressions. Psychological Science, 11, 86-89. doi:10.1111/1467-9280.00221
30. Doherty, R. W., Orimoto, L., Singelis, T. M., Hatfield, E., & Hebb, J. (1995). Emotional contagion: Gender and occupational differences. Psychology of Women Quarterly, 19, 355-371. doi:10.1111/j.14716402.1995.tb00080.x
31. Dolan, R. J., Morris, J. S., & De Gelder, B. (2001). Crossmodal binding of fear in voice and face. Proceedings of the National Academy of Sciences of the United States of America, 98, 10006-10010. doi:10.1073/pnas.171288598
32. Duclos, S. E., Laird, J. D., Schneider, E., Sexter, M., Stern, L., & Van Lighten, O. (1989). Emotion-specific effects of facial expressions and postures on emotional experience. Journal of Personality and Social Psychology, 57, 100-108. doi:10.1037/0022-3514.57.1.100
33. Effron, D. A., Niedenthal, P. M., Gil, S., & Droit-Volet, S. (2006). Embodied temporal perception of emotion. Emotion, 6, 1-9. doi: 10.1037/1528-3542.6.1.1
34. Ekman, P. (2007). The directed facial action task. In J. A. Coan & J. J. B. Allen (Eds.), Handbook of emotion elicitation and assessment (pp. 47-53). New York, NY: Oxford University Press.
35. Ekman, P., & Friesen, W. V. (1978). The Facial Action Coding System: A technique for the measurement of facial movement. Palo Alto, CA: Consulting Psychologists Press.
36. Ekman, P., Friesen, W. V., & Hager, J. (2002). The Facial Action Coding System (2nded.). Salt Lake City, UT: Research Nexus ebook.
37. Esteves, E., Dimberg, D., & öhman, A. (1994). Automatically elicited fear: Conditioned skin conductance responses to masked facial expressions. Cognition & Emotion, 8, 393-413. doi:10.1080/02699939408408949
38. Fischer, A. H., & Manstead, A. S. R. (2008). Social functions of emotion. In M. Lewis, J. Haviland-Jones, & L. F. Barrett (Eds.), Handbook of emotions (3rd ed.). New York, NY: Guilford.
39. Fischer, A. H., & Roseman, I. J. (2007). Beat them or ban them: The characteristics and social functions of anger and contempt. Journal of Personality and Social Psychology, 93,103-115. doi:10.1037/00223514.93.1.103
40. Flack, W. F. (2006). Peripheral feedback effects of facial expressions, bodily postures, and vocal expressions on emotional feelings. Cognition &Emotion, 20, 177-195. doi:10.1080/02699930500359617
41. Flack, W. F., Laird, J. D., & Cavallaro, L. A. (1999). Separate and combined effects of facial expressions and bodily postures on emotional feelings. European Journal of Social Psychology, 29, 203-217. doi: 10.1002/(SICI)1099-0992(199903/05)29:2/3<203::AID-EJSP924> 3.0.CO;2-8
42. Foroni, F., & Semin, G. R. (2009). Language that puts you in touch with your bodily feelings: The multimodal responsiveness of affective expressions. Psychological Science, 20, 974-980. doi:10.1111/j.14679280.2009.02400.x
43. Foroni, F., & Semin, G. R. (2011). When does mimicry affect evaluative judgment? Emotion, 11, 687-690. doi:10.1037/a0023163
44. Fox, E., Russo, R., & Dutton, K. (2002). Attentional bias for threat: Evidence for delayed disengagement from emotional faces. Cognition & Emotion, 16, 355-379. doi:10.1080/02699930143000527
45. Guilford, T., & Dawkins, M. S. (1991). Receiver psychology and the evolution of animal signals. Animal Behaviour, 42, 1-14. doi:10.1016/S0003-3472(05)80600-1
46. Hatfield, E., Cacioppo, J. T., & Rapson, R. L. (1992). Primitive emotional contagion. In M. S. Clark (Ed.), Review of personality and social psychology:Vol. 14. Emotion and social behavior (pp. 151-177). Newbury Park, CA: Sage.
47. Hatfield, E., Cacioppo, J. T., & Rapson, R. L. (1994). Emotional contagion. Cambridge, England: Cambridge University Press.
48. Hatfield, E., Hsee, C. K., Costello, J., Weisman, M. S., & Denney, C. (1995). The impact of vocal feedback on emotional experience and expression. Journal of Social Behavior and Personality, 10, 293-312
49. Havas, D. A., Glenberg, A., Gutowski, K., Lucarelli, M., & Davidson, R. (2010). Cosmetic use of botulinum toxin-A affects processing of emo-tional language. Psychological Science, 21, 895-900. doi:10.1177/0956797610374742
50. Hawk, S. T., Van Kleef, G. A., Fischer, A. H., & Van der Schalk, J. (2009). "Worth a thousand words": Absolute and relative decoding of nonlinguistic affect vocalizations. Emotion, 9, 293-305. doi:10.1037/a0015178
51. Hess, U., & Blairy, S. (2001). Facial mimicry and emotional contagion to dynamic emotional facial expressions and their influence on decoding accuracy. International Journal of Psychophysiology, 40, 129-141. doi: 10.1016/S0167-8760(00)00161-6
52. Hess, U., Philippot, P., & Blairy, S. (1998). Facial reactions to emotional facial expressions: Affect or cognition? Cognition & Emotion, 12, 509-531. doi:10.1080/026999398379547
53. Hietanen, J. K., Leppänen, J. M., Illi, M., & Surakka, V. (2004). Evidence for the integration of audiovisual emotional information at the perceptual level of processing. European Journal of Cognitive Psychology, 16, 769-790. doi:10.1080/09541440340000330
54. Hietanen, J. K., Surakka, V., & Linnankoski, I. (1998). Facial electromyographic responses to vocal affect expressions. Psychophysiology, 35, 530-536. doi:10.1017/S0048577298970445
55. Hoffman, M. L. (1984). Interaction of affect and cognition on empathy. In C. E. Izard, J. Kagan, & R. B. Zajonc (Eds.), Emotions, cognition, and behavior (pp. 103-131). Cambridge, England: Cambridge University Press.
56. Hoffman, M. L. (2008). Empathy and prosocial behavior. In M. Lewis, J. M. Haviland-Jones, & L. F. Barrett (Eds.), Handbook of emotions (3rd ed., pp. 440-455). New York, NY: Guilford Press.
57. Keltner, D., & Haidt, J. (1999). Social functions of emotions at four levels of analysis. Cognition & Emotion, 13, 505-521. doi:10.1080/026999399379168
58. Keysers, C., & Gazzola, V. (2009). Expanding the mirror: Vicarious activity for actions, emotions and sensations. Current Opinion in Neurobiology, 19, 666-671. doi:10.1016/j.conb.2009.10.006
59. Krumhuber, E. G., & Scherer, K. R. (2011). Affect bursts: Dynamic patterns of facial expression. Emotion, 11, 825-841.
60. Lanzetta, J. T., & Englis, B. G. (1989). Expectations of cooperation and competition and their effects on observers' vicarious emotional responses. Journal of Personality and Social Psychology, 56, 543-554. doi:10.1037/0022-3514.56.4.543
61. Larsen, R. J., Kasimatis, M., & Frey, K. (1992). Facilitating the furrowed brow: An unobtrusive test of the facial feedback hypothesis applied to unpleasant affect. Cognition & Emotion, 6, 321-338. doi:10.1080/02699939208409689
62. Leslie, K. R., Johnson-Frey, S. H., & Grafton, S. T. (2004). Functional imaging of face and hand imitation: Towards a motor theory of empathy. NeuroImage, 21, 601-607. doi:10.1016/j.neuroimage.2003.09.038
63. Lundqvist, L., & Dimberg, U. (1995). Facial expressions are contagious. Journal of Psychophysiology, 9, 203-211.
64. Magnée, M. J. C. M., Stekelenburg, J. J., Kemner, C., & De Gelder, B. (2007). Similar facial electromyographic responses to faces, voices, and body expressions. NeuroReport, 18, 369-372.
65. Massaro, D. W., & Egan, P. B. (1996). Perceiving affect from the voice and the face. Psychonomic Bulletin and Review, 3, 215-221. doi:10.3758/BF03212421
66. Moody, E. J., McIntosh, D. N., Mann, L. J., & Weisser, K. R. (2007). More than mere mimicry? The influence of emotion on rapid facial reactions to faces. Emotion, 7, 447-457. doi:10.1037/1528-3542.7.2.447
67. Neumann, R., & Strack, F. (2000). Mood contagion: The automatic transfer of mood between persons. Journal of Personality and Social Psychology, 79, 211-223. doi:10.1037/0022-3514.79.2.211
68. Niedenthal, P. M. (2007, May 18). Embodying emotion. Science, 316, 1002-1005. doi:10.1126/science.1136930
69. Niedenthal, P. M., Brauer, M., Halberstadt, J. B., & Innes-Ker, Å. (2001). When did her smile drop? Facial mimicry and the influences of emo-tional state on the detection of change in emotional expression. Cognition & Emotion, 15, 853-864. doi:10.1080/02699930143000194
70. Niedenthal, P. M., Mermillod, M., Maringer, M., & Hess, U. (2010). The simulation of smiles (SIMS) model: A window to general principles in processing facial expression. Behavioral and Brain Sciences, 33, 417-433. doi:10.1017/S0140525X10000865
71. Niedenthal, P. M., Winkielman, P., Mondillon, L., & Vermeulen, N. (2009). Embodiment of emotional concepts. Journal of Personality and Social Psychology, 96, 1120-1136. doi:10.1037/a0015574
72. Oberman, L. M., Winkielman, P., & Ramachandran, V. S. (2007). Face to face: Blocking facial mimicry can selectively impair recognition of emotional expressions. Social Neuroscience, 2, 167-178. doi:10.1080/17470910701391943
73. Oosterwijk, S., Rotteveel, M., Fischer, A. H., & Hess, U. (2009). Embodied emotion concepts: How generating words about pride and disappointment influences posture. European Journal of Social Psychology, 39, 457-466. doi:10.1002/ejsp.584
74. Oosterwijk, S., Topper, M., Rotteveel, M., & Fischer, A. H. (2010). When the mind forms fear: Embodied fear knowledge potentiates bodily reactions to fearful stimuli. Social Psychological & Personality Science, 1, 65-72. doi:10.1177/1948550609355328
75. Owren, M. J., Rendall, D., & Bachorowski, J-A. (2005). Conscious and unconscious emotion in nonlinguistic vocal communication. In L. F. Barrett, P. M. Niedenthal, & P. Winkielman (Eds.), Emotion and consciousness (pp. 185-204). New York, NY: Guilford.
76. Pell, M. D. (2005). Prosody-face interactions in emotional processing as revealed by the facial affect decision task. Journal of Nonverbal Behavior, 29, 193-215. doi:10.1007/s10919-005-7720-z
77. Philippot, P., Chapelle, G., & Blairy, S. (1994). Respiratory feedback in the generation of emotion. In N. H. Frijda (Ed.), Proceedings of the 8th conference of the International Society for Research on Emotion. Storrs, CT: International Society for Research on Emotion.
78. Preston, S. D., & De Waal, F. B. M. (2002). Empathy: Its ultimate and proximate bases. Behavioral and Brain Sciences, 25, 1-72.
79. Provine, R. R. (1992). Contagious laughter: Laughter is a sufficient stimulus for laughter and smiles. Bulletin of the Psychonomic Society, 30, 1-4.
80. Provine, R. R. (1996). Laughter. American Scientist, 84, 38-45.
81. Rosenberg, E. L., & Ekman, P. (1995). Conceptual and methodological issues in the judgment of facial expressions of emotion. Motivation and Emotion, 19, 111-138. doi:10.1007/BF02250566
82. Rozin, P., Lowery, L., & Ebert, R. (1994). Varieties of disgust faces and the structure of disgust. Journal of Personality and Social Psychology, 66, 870-881. doi:10.1037/0022-3514.66.5.870
83. Russell, J. A., Bachorowski, J.-A., & Fernández-Dols, J.-M. (2003). Facial and vocal expression of emotion. Annual Review of Psychology, 54, 329-349. doi:10.1146/annurev.psych.54.101601.145102
84. Russell, J. A., & Barrett, L. F. (1999). Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant. Journal of Personality and Social Psychology, 76, 805-819. doi: 10.1037/0022-3514.76.5.805
85. Scherer, K. R. (1980). The functions of nonverbal signs in conversation. In R. N. St. Clair & H. Giles (Eds.), The social and psychological contexts of language (pp. 225-244). Hillsdale, NJ: Erlbaum.
86. Scherer, K. R. (1988). On the symbolic functions of vocal affect expression. Journal of Language and Social Psychology, 7, 79-100. doi: 10.1177/0261927X8800700201
87. Scherer, K. R. (1994). Affect bursts. In S. H. M. van Goozen, N. E. van de Poll, & J. A. Sergeant (Eds.), Emotions: Essays on emotion theory (pp. 161-193). Hillsdale, NJ: Erlbaum.
88. Schröder, M. (2003). Experimental study of affect bursts. Speech Communication, 40, 99-116. doi:10.1016/S0167-6393(02)00078-X
89. Simon-Thomas, E. R., Keltner, D., Sauter, D., Sinicropi-Yao, L., & Abramson, A. (2009). The voice conveys specific emotions: Evidence from vocal burst displays. Emotion, 9, 838-846. doi:10.1037/a0017810
90. Sonnby-Borgström, M. (2002). Automatic mimicry reactions as related to differences in emotional empathy. Scandinavian Journal of Psychology, 43, 433-443. doi:10.1111/1467-9450.00312
91. Sonnby-Borgström, M., Jönsson, P., & Svensson, O. (2003). Emotional empathy as related to mimicry reactions at different levels of information processing. Journal of Nonverbal Behavior, 27, 3-23. doi:10.1023/A:1023608506243
92. Sonnby-Borgström, M., Jönsson, P., & Svensson, O. (2008). Imitative responses and verbally reported emotional contagion from spontaneous, unconscious to emotionally regulated, conscious information-processing levels. Neuropsychoanalysis, 10, 81-98.
93. Stel, M., & Van Knippenberg, A. (2008). The role of facial mimicry in the recognition of affect. Psychological Science, 19, 984-985. doi:10.1111/j.1467-9280.2008.02188.x
94. Strack, F., Martin, L., & Stepper, S. (1988). Inhibiting and facilitating conditions of the human smile: A nonobtrusive test of the facial feedback hypothesis.Journal of Personality and Social Psychology, 54, 768-777.
95. Tajadura-Jiménez, A., Väljamäe, A., Asutay, E., & Västfjäll, D. (2010). Embodied auditory perception: The emotional impact of approaching and receding sound sources. Emotion, 10, 216-229. doi:10.1037/a0018422
96. Van der Gaag, C. Minderaa, R. B., & Keysers, C. (2007). Facial expressions: What the mirror neuron system can and cannot tell us. Social Neuroscience, 2, 179-222. doi:10.1080/17470910701376878
97. Van der Schalk, J., Hawk, S. T., Fischer, A. H., & B. Doosje, B. (2011). Moving faces, looking places: Validation of the Amsterdam Dynamic Facial Expressions Set (ADFES). Emotion, 11, 907-920.
98. Van Kleef, G. A. (2009). How emotions regulate social life: The emotions as social information (EASI) model. Current Directions in Psychological Science, 18, 184-188. doi:10.1111/j.1467-8721.2009.01633.x
99. Van Kleef, G. A., De Dreu, C. K. W., & Manstead, A. S. R. (2010). An interpersonal approach to emotion in social decision making: The emotions as social information model. Advances in Experimental Social Psychology, 42, 45-96. doi:10.1016/S0065-2601(10)42002-X
100. Van Kleef, G. A., Oveis, C., Van der Löwe, I., LuoKogan, A., Goetz, J., & Keltner, D. (2008). Power, distress, and compassion: Turning a blind eye to the suffering of others. Psychological Science, 19, 1315-1322. doi: 10.1111/j.1467-9280.2008.02241.x
101. Vermeulen, N., & Mermillod, M. (2010). Fast emotional embodiment can modulate sensory exposure in perceivers. Communicative & Integrative Biology, 3, 184-187. doi:10.4161/cib.3.2.10922
102. Verona, E., Patrick, C. J., Curtin, J. J., Bradley, M. M., & Lang, P. J. (2004). Psychopathy and physiological response to emotionally evocative sounds. Journal of Abnormal Psychology, 113, 99-108. doi: 10.1037/0021-843X.113.1.99
103. Wicker, B., Keysers, C., Plailly, J., Royet, J. P., Gallese, V., & Rizzolatti, G. (2003). Both of us disgusted in my insula: The common neural basis of seeing and feeling disgust. Neuron, 40, 655-664. doi:10.1016/S08966273(03)00679-2
104. Wild, B., Erb, M., & Bartels, M. (2001). Are emotions contagious? Evoked emotions while viewing emotionally expressive faces: Quality, quantity, time course and gender differences. Psychiatry Research, 102, 109-124. doi:10.1016/S0165-1781(01)00225-6