Emotional expressions in voice and music: Same code, same effect?

Human Brain Mapping

Volumn 34, Issue 8, 2013, Pages 1796-1810

  Escoffier, Nicolas ^a   Zhong, Jidan ^b   Schirmer, Annett ^a,c   Qiu, Anqi ^a,d  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^c DUKE NUS MEDICAL SCHOOL   (Singapore)

^d AGENCY FOR SCIENCE   (Singapore)

Author keywords

ACC; FMRI; MPFC; Prosody; Theory of mind

Indexed keywords

ANTERIOR CINGULATE; ARTICLE; BOLD SIGNAL; CUNEUS; ECHO PLANAR IMAGING; EMOTION; FRONTAL CORTEX; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; INFORMATION PROCESSING; MIDDLE TEMPORAL GYRUS; MUSIC; PITCH; PRECUNEUS; PRIMARY AUDITORY CORTEX; PRIORITY JOURNAL; SECONDARY AUDITORY CORTEX; SOCIAL COGNITION; STIMULUS; SUPERIOR TEMPORAL GYRUS; TEMPORAL CORTEX; VOCALIZATION; VOICE;

ACC; FMRI; MPFC; PROSODY; THEORY OF MIND;

ADOLESCENT; ADULT; AUDITORY PERCEPTION; BRAIN MAPPING; CEREBRAL CORTEX; EMOTIONS; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MUSIC; VOICE; YOUNG ADULT;

EID: 84880135992     PISSN: 10659471     EISSN: 10970193     Source Type: Journal    
DOI: 10.1002/hbm.22029     Document Type: Article

References (92)

1. Andrade A, Kherif F, Mangin JF, Worsley KJ, Paradis AL, Simon O, Dehaene S, Le Bihan D, Poline JB ( 2001): Detection of fMRI activation using cortical surface mapping. Hum Brain Mapp 12: 79-93.
2. Anticevic A, Dierker DL, Gillespie SK, Repovs G, Csernansky JG, Van Essen DC, Barch DM ( 2008): Comparing surface-based and volume-based analyses of functional neuroimaging data in patients with schizophrenia. Neuroimage 41: 835-848.
3. Bach DR, Grandjean D, Sander D, Herdener M, Strik WK, Seifritz E ( 2008): The effect of appraisal level on processing of emotional prosody in meaningless speech. Neuroimage 42: 919-927.
4. Banse R, Scherer K ( 1996): Acoustic profiles in vocal emotion expression. J Pers Soc Psychol 70: 614-636.
5. Belin P, Zatorre R, Lafaille P, Ahad P, Pike B ( 2000): Voice-selective areas in human auditory cortex. Nature 403: 309-312.
6. Belin P, Zatorre RJ, Ahad P ( 2002): Human temporal-lobe response to vocal sounds. Cogn Brain Res 13: 17-26.
7. Binder JR, Frost JA, Hammeke TA, Bellgowan PSF, Springer JA, Kaufman JN, Possing ET ( 2000): Human temporal lobe activation by speech and nonspeech sounds. Cereb Cortex 10: 512-528.
8. Brosch T, Sander D, Pourtois G, Scherer KR ( 2008): Beyond fear: Rapid spatial orienting toward positive emotional stimuli. Psychol Sci 19: 362-370.
9. Brosch T, Grandjean D, Sander D, Scherer KR ( 2009): Cross-modal emotional attention: Emotional voices modulate early stages of visual processing. J Cogn Neurosci 21: 1670-1679.
10. Carrington SJ, Bailey AJ ( 2009): Are there theory of mind regions in the brain? A review of the neuroimaging literature. Hum Brain Mapp 30: 2313-2335.
11. Chua SM, Schirmer A ( 2011): Perceiving verbal and vocal emotions in a second language. Cog Emotion 25: 1376-1392.
12. Chung MK, Robbins SM, Dalton KM, Davidson RJ, Alexander AL, Evans AC ( 2005): Cortical thickness analysis in autism with heat kernel smoothing. Neuroimage 25: 1256-1265.
13. Critchley H, Daly E, Phillips M, Brammer M, Bullmore E, Williams S, Van Amelsvoort T, Robertson D, David A, Murphy D ( 2000): Explicit and implicit neural mechanisms for processing of social information from facial expressions: A functional magnetic resonance imaging study. Hum Brain Mapp 9: 93-105.
14. Confavreux C, Croisile B, Garassus P, Aimard G, Trillet M ( 1992): Progressive amusia and aprosody. Arch Neurol 49: 971-976.
15. Curtis ME, Bharucha JJ ( 2010): The minor third communicates sadness in speech, mirroring its use in music. Emotion 10: 335-348.
16. Dale AM, Fischl B, Sereno MI ( 1999): Cortical surface-based analysis I. Segmentation and surface reconstruction. Neuroimage 9: 179-194.
17. Deike S, Gaschler-Markefski B, Brechmann A, Scheich H ( 2004): Auditory stream segregation relying on timbre involves left auditory cortex. Neuroreport 15: 1511-1514.
18. Desikan RS, Ségonne F, Fischl B, Quinn BT, Dickerson BC, Blacker D, Buckner RL, Dale AM, Maguire RP, Hyman BT, Albert MS, Killiany RJ ( 2006): An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. Neuroimage 31: 968-980.
19. Ellis RJ, Thayer JF ( 2010): Music and autonomic nervous system (dys)function. Music Percept 27: 317-326.
20. Ethofer T, Anders S, Wiethoff S, Erb M, Herbert C, Saur R, Grodd W, Wildgruber D ( 2006): Effects of prosodic emotional intensity on activation of associative auditory cortex. Neuroreport 17: 249-253.
21. Fecteau S, Belin P, Joanette Y, Armony JL ( 2007): Amygdala responses to nonlinguistic emotional vocalizations. Neuroimage 36: 480-487.
22. Fischl B, Salat DH, Busa E, Albert M, Dieterich M, Haselgrove C, van der Kouwe A, Killiany R, Kennedy D, Klaveness S, Montillo A, Makris N, Rosen B, Dale AM ( 2002): Whole brain segmentation automated labeling of neuroanatomical structures in the human brain. Neuron 33: 341-355.
23. Fischl B, van der Kouwe A, Destrieux C, Halgren E, Segonne F, Salat DH, Busa E, Seidman LJ, Goldstein J, Kennedy D, Caviness V, Makris N, Rosen B, Dale AM ( 2004): Automatically parcellating the human cerebral cortex. Cereb Cortex 14: 11-22.
24. Fletcher PC, Happé F, Frith U, Baker SC, Dolan RJ, Frackowiak RSJ, Frith CD ( 1995): Other minds in the brain: A functional imaging study of "theory of mind" in story comprehension. Cognition 57: 109-128.
25. Friston KJ, Holmes AP, Worsley KJ, Poline JB, Frith CD, Frackowiak RS ( 1995): Statistical parametric maps in functional imaging: A general linear approach. Hum Brain Mapp 2: 189-210.
26. Friston KJ, Fletcher P, Josephs O, Holmes A, Rugg MD, Turner R ( 1998): Event-related fMRI: Characterizing differential responses. Neuroimage 7: 30-40.
27. Fritz T, Jentschke S, Gosselin N, Sammler D, Peretz I, Turner R, Friederici AD, Koelsch S ( 2009): Universal recognition of three basic emotions in music. Curr Biol 19: 573-576.
28. Gallagher HL, Happe F, Brunswick N, Fletcher PC, Frith U, Frith CD ( 2000): Reading the mind in cartoons and stories: An fMRI study of theory of mind in verbal and nonverbal tasks. Neuropsychologia 38: 11-21.
29. Gandour J, Wong D, Dzemidzic M, Lowe M, Tong Y, Li X ( 2003): A cross-linguistic fMRI study of perception of intonation and emotion in Chinese. Hum Brain Mapp 18: 149-157.
30. Gobbini MI, Koralek AC, Bryan RE, Montgomery KJ, Haxby JV ( 2007): Two takes on the social brain: A comparison of theory of mind tasks. J Cogn Neurosci 19: 1803-1814.
31. Gosselin N, Peretz I, Noulhiane M, Hasboun D, Beckett C, Baulac M, Samson S ( 2005): Impaired recognition of scary music following unilateral temporal lobe excision. Brain 128: 628-640.
32. Gosselin N, Samson S, Adolphs R, Noulhiane M, Roy M, Hasboun D, Baulac M, Peretz I ( 2006): Emotional responses to unpleasant music correlates with damage to the parahippocampal cortex. Brain 129: 2585-2592.
33. Gosselin N, Peretz I, Johnsen E, Adolphs R ( 2007): Amygdala damage impairs emotion recognition from music. Neuropsychologia 45: 236-244.
34. Gosselin N, Peretz I, Hasboun D, Baulac M, Samson S ( 2011): Impaired recognition of musical emotions and facial expressions following anteromedial temporal lobe excision. Cortex 47: 1116-1125.
35. Grandjean D, Sander D, Pourtois G, Schwartz S, Seghier ML, Scherer KR, Vuilleumier P ( 2005): The voices of wrath: Brain responses to angry prosody in meaningless speech. Nat Neurosci 8: 145-146.
36. Green A, Baerentsen K, Stodkilde-Jorgensen H, Wallentin M, Roepstorff A, Vuust P ( 2008): Music in minor activates limbic structures: A relationship with dissonance? Neuroreport 19: 711-715.
37. Hariri AR, Bookheimer SY, Mazziotta JC ( 2000): Modulating emotional responses: Effects of a neocortical network on the limbic system. Neuroreport 11: 43-48.
38. Hariri AR, Mattay VS, Tessitore A, Fera F, Weinberger DR ( 2003): Neocortical modulation of the amygdala response to fearful stimuli. Biol Psychiat 53: 494-501.
39. Holmes AP, Friston KJ ( 1998): Generalisability, random effects and population inference. Neuroimage 7: S754.
40. Ilie G, Thompson WF ( 2006): A comparison of acoustic cues in music and speech for three dimensions of affect. Music Percept 23: 319-329.
41. Imaizumi S, Mori K, Kiritani S, Hosoi H, Tonoike M ( 1998): Task-dependent laterality for cue decoding during spoken language processing. Neuroreport 9: 899-903.
42. Janata P ( 2005): Brain networks that track musical structure. Ann NY Acad Sci 1060: 111-124.
43. Janata P ( 2009a): Music and the self. In: Haas R, Brandes V, editors. Music that Works: Contributions of Biology, Neurophysiology, Psychology, Sociology, Medicine and Musicology. New York, NY: Springer. pp 131-141.
44. Janata P ( 2009b): The neural architecture of music-evoked autobiographical memories. Cereb Cortex 19: 2579-2594.
45. Jenkinson M, Bannister P, Brady M, Smith S ( 2002): Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 17: 825-841.
46. Juslin PN ( 2000): Cue utilization in communication of emotion in music performance: Relating performance to perception. J Exp Psychol Human 26: 1797-1813.
47. Juslin PN, Laukka P ( 2003): Communication of emotions in vocal expression and music performance: Different channels, same code? Psychol Bull 129: 770-814.
48. Kawase T, Yamaguchi K, Ogawa T, Suzuki K, Suzuki M, Itoh M, Kobayashi T, Fujii T ( 2005): Recruitment of fusiform face area associated with listening to degraded speech sounds in auditory-visual speech perception: A PET study. Neurosci Lett 382: 254-258.
49. Khalfa S, Schon D, Anton JL, Liégeois-Chauvel C ( 2005): Brain regions involved in the recognition of happiness and sadness in music. Neuroreport 16: 1981-1984.
50. Leitman DI, Wolf DH, Ragland JD, Laukka P, Loughead J, Valdez JN, Javitt DC, Turetsky BI, Gur RC ( 2010): It's not what you say, but how you say it: A reciprocal temporo-frontal network for affective prosody. Front Hum Neurosci 26: 4-19.
51. Levitin DJ, Tirovolas AK ( 2009): Current advances in the cognitive neuroscience of music. Ann NY Acad Sci 1156: 211-231.
52. Livingstone S, Thompson W ( 2009): The emergence of music from theory of mind. Music Sci (Special issue 2009-2010): 83-115.
53. Loftus GR, Masson ME ( 1994): Using confidence intervals in within-participant designs. Psychon B Rev 1: 476-490.
54. Micheyl C, Carlyon R, Gutschalk A, Melcher J, Oxenham A, Rauschecker J, Tian B, Wilson CE ( 2007): The role of auditory cortex in the formation of auditory streams. Hear Res 229: 116-131.
55. Mitterschiffthaler M, Fu C, Dalton J, Andrew C, Williams S ( 2007): A functional MRI study of happy and sad affective states induced by classical music. Hum Brain Mapp 28: 1150-1162.
56. Nichols T, Brett M, Andersson J, Wager T, Poline JB ( 2005): Valid conjunction inference with the minimum statistic. Neuroimage 25: 653-660.
57. Peelen MV, Atkinson AP, Vuilleumier P ( 2010): Supramodal representations of perceived emotions in the human brain. J Neurosci 30: 10127-10134.
58. Pell MD, Skorup V ( 2008): Implicit processing of emotional prosody in a foreign versus native language. Speech Commun 50: 519-530.
59. Peretz I, Gagnon L, Bouchard B ( 1998): Music and emotion: Perceptual determinants, immediacy, and isolation after brain damage. Cognition 68: 111-141.
60. Peretz I, Zatorre RJ ( 2004): Brain organization for music processing. Annu Rev Psychol 56: 89-114.
61. Phillips ML, Young AW, Scott SK, Calder AJ, Andrew C, Giampietro V, Williams C, Bullmore ET, Brammer M, Gray JA ( 1998): Neural responses to facial and vocal expressions of fear and disgust. P Roy Soc B-Biol Sci 265: 1809-1817.
62. Pittam J ( 1994): Voice in Social Interaction: An Interdisciplinary Approach. Thousand Oaks, CA: Sage Publications, Inc.
63. Plailly J, Tillmann B, Royet J-P ( 2007): The feeling of familiarity of music and odors: The same neural signature? Cereb Cortex 17: 2650-2658.
64. Qiu A, Bitouk D, Miller MI ( 2006a): Smooth functional and structural maps on the neocortex via orthonormal bases of the Laplace-Beltrami operator. IEEE T Med Imaging 25: 1296-1306.
65. Qiu A, Rosenau BJ, Greenberg AS, Hurdal MK, Barta P, Yantis S, Miller MI ( 2006b): Estimating linear cortical magnification in human primary visual cortex via dynamic programming. Neuroimage 31: 125-138.
66. Ratnanather JT, Barta PE, Honeycutt NA, Lee N, Morris HM, Dziorny AC, Hurdal MK, Pearlson GD, Miller MI ( 2003): Dynamic programming generation of boundaries of local coordinatized submanifolds in the neocortex: Application to the planum temporale. Neuroimage 20: 359-377.
67. Rousseau JJ ( 1992): Essay on the origin of languages. In: Scott J, editor. Essay on the Origin of Languages and Writings Related to Music. Hanover: University Press of New England.
68. Sander D, Grandjean D, Pourtois G, Schwartz S, Seghier M, Scherer KR, Vuilleumier P ( 2005): Emotion and attention interactions in social cognition: Brain regions involved in processing anger prosody. Neuroimage 28: 848-858.
69. Saxe R, Brett M, Kanwisher N ( 2006): Divide and conquer: A defense of functional localizers. Neuroimage 30: 1088-1096.
70. Scherer KR ( 1986): Vocal affect expression: A review and a model for future research. Psychol Bull 99: 143-165.
71. Scherer KR ( 2003): Vocal communication of emotion: A review of research paradigms. Speech Commun 40: 227-256.
72. Schirmer A, Escoffier N ( 2010): Emotional MMN: Anxiety and heart rate correlate with the ERP signature for auditory change detection. Clin Neurophys 121: 53-59.
73. Schirmer A, Escoffier N, Zysset S, Koester D, Striano T, Friederici A ( 2008): When vocal processing gets emotional: On the role of social orientation in relevance detection by the human amygdala. Neuroimage 40: 1402-1410.
74. Schirmer A, Kotz S ( 2006): Beyond the right hemisphere: Brain mechanisms mediating vocal emotional processing. Trends Cogn Sci 10: 24-30.
75. Schirmer A, Zysset S, Kotz S, von Cramon Y ( 2004): Gender differences in the activation of inferior frontal cortex during emotional speech perception. Neuroimage 21: 1114-1123.
76. Schönwiesner M, Rübsamen R, von Cramon Y ( 2005): Hemispheric asymmetry for spectral and temporal processing in the human antero-lateral auditory belt cortex. Eur J Neurosci 22: 1521-1528.
77. Schroeder MR ( 1968): Period histogram and product spectrum: New methods for fundamental-frequency measurement. J Acoust Soc Am 43: 829-834.
78. Shtyrov Y, Pihko E, Pulvermüller F ( 2005): Determinants of dominance: Is language laterality explained by physical or linguistic features of speech? Neuroimage 27: 37-47.
79. Spencer H ( 1857): The origin and function of music. Fraser's Magazine 56: 396-408.
80. Strait DL, Kraus N, Skoe E, Ashley R ( 2009): Musical experience and neural efficiency-Effects of training on subcortical processing of vocal expressions of emotion. Eur J Neurosci 29: 661-668.
81. Tervaniemi M, Szameitat AJ, Kruck S, Schroger E, Alter K, De Baene W, Friederici AD ( 2006): From air oscillations to music and speech: Functional magnetic resonance imaging evidence for fine-tuned neural networks in audition. J Neurosci 26: 8647-8652.
82. von Kriegstein K, Patterson RD, Griffiths T ( 2008): Task-dependent modulation of medial geniculate body is behaviorally relevant for speech recognition. Curr Biol 18: 1855-1859.
83. Warren J ( 2008): How does the brain process music? Clin Med 8: 32-36.
84. Wildgruber D, Pihan H, Ackermann H, Erb M, Grodd W ( 2002): Dynamic brain activation during processing of emotional intonation: Influence of acoustic parameters, emotional valence, and sex. Neuroimage 15: 856-869.
85. Wildgruber D, Ackermann H, Kreifelts B, Ethofer T ( 2006): Cerebral processing of linguistic and emotional prosody: fMRI studies. Prog Brain Res 156: 249-268.
86. Worsley KJ, Marrett S, Neelin P, Vandal AC, Friston KJ, Evans AC ( 1996): A unified statistical approach for determining significant signals in images of cerebral activation. Hum Brain Mapp 4: 58-73.
87. Zaki J, Weber J, Bolger N, Ochsner K ( 2009): The neural bases of empathic accuracy. Proc Natl Acad Sci USA 106: 11382-11387.
88. Zatorre R, Belin P ( 2001): Spectral and temporal processing in human auditory cortex. Cereb Cortex 11: 946-953.
89. Zatorre R, Belin P, Penhune V ( 2002): Structure and function of auditory cortex: Music and speech. Trends Cogn Sci 6: 37-46.
90. Zentner M, Grandjean D, Scherer K ( 2008): Emotions evoked by the sound of music: Characterization, classification, and measurement. Emotion 8: 494-521.
91. Zhong J, Qiu A ( 2010): Multi-manifold diffeomorphic metric mapping for aligning cortical hemispheric surfaces. Neuroimage 49: 355-365.
92. Zhong J, Phua DY, Qiu A ( 2010): Quantitative evaluation of LDDMM, FreeSurfer, and CARET for cortical surface mapping. Neuroimage 52: 131-141.