" It's not what you say, but how you say it ": A reciprocal temporo-frontal network for affective prosody

Frontiers in Human Neuroscience

Volumn 4, Issue , 2010, Pages

  Leitman, David I ^a   Wolf, Daniel H ^a   Ragland, J Daniel ^b   Laukka, Petri ^c   Loughead, James ^a   Valdez, Jeffrey N ^a   Javitt, Daniel C ^d,e   Turetsky, Bruce I ^a   Gur, Ruben C ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c STOCKHOLM UNIVERSITY   (Sweden)

^d NATHAN S KLINE INSTITUTE FOR PSYCHIATRIC RESEARCH   (United States)

^e NEW YORK UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

Amygdala; Auditory cortex; Emotion; Inferior frontal gyrus; Prosody; Speech

Indexed keywords

ADOLESCENT; ADULT; AFFECT; AMYGDALOID NUCLEUS; ANGER; ARTICLE; AUDITORY LATERALIZATION; AUDITORY STIMULATION; BRAIN DEPTH STIMULATION; COMPREHENSION; CONTROLLED STUDY; EMOTIONALITY; FEAR; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HAPPINESS; HEMISPHERIC DOMINANCE; HUMAN; HUMAN EXPERIMENT; INFERIOR FRONTAL GYRUS; MALE; NERVE CELL NETWORK; NERVE CONDUCTION; NEUROIMAGING; SIGNAL NOISE RATIO; SPEECH; SPEECH DISCRIMINATION; TASK PERFORMANCE; TEMPORAL CORTEX; VOCALIZATION;

EID: 77957680260     PISSN: 16625161     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2010.00019     Document Type: Article

References (59)

1. Adams, R. B., and Janata, P. (2002). A comparison of neural circuits underlying auditory and visual object categorization. Neuroimage 16, 361-377.
2. Adolphs, R. (2002). Neural systems for recognizing emotion. Curr. Opin. Neurobiol. 12, 169-177.
3. Adolphs, R., Tranel, D., and Damasio, H. (2001). Emotion recognition from faces and prosody following temporal lobectomy. Neuropsychology 15, 396-404.
4. Bach, D. R., Grandjean, D., Sander, D., Herdener, M., Strik, W. K., and Seifritz, E. (2008a). The effect of appraisal level on processing of emotional prosody in meaningless speech. Neuroimage 42, 919-927.
5. Bach, D. R., Schachinger, H., Neuhoff, J. G., Esposito, F., Di Salle, F., Lehmann, C., Herdener, M., Scheffler, K., and Seifritz, E. (2008b). Rising sound intensity: an intrinsic warning cue activating the amygdala. Cereb. Cortex 18, 145-150.
6. Bandettini, P. A., Wong, E. C., Hinks, R. S., Tikofsky, R. S., and Hyde, J. S. (1992). Time course EPI of human brain function during task activation. Magn. Reson. Med. 25, 390-397.
7. Banse, R., and Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. J. Pers. Soc. Psychol. 70, 614-636.
8. Beckmann, C. F., Jenkinson, M., and Smith, S. M. (2003). General multilevel linear modeling for group analysis in FMRI. Neuroimage 20, 1052-1063.
9. Boersma, P. (2001). Praat, a system for doing phonetics by computer. Glot International 5, 341-345.
10. Borod, J. C., Cicero, B. A., Obler, L. K., Welkowitz, J., Erhan, H. M., Santschi, C., Grunwald, I. S., Agosti, R. M., and Whalen, J. R. (1998). Right hemisphere emotional perception: evidence across multiple channels. Neuropsychology 12, 446-458.
11. Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., and Taylor, J. G. (2001). Emotion recognition in human-computer interaction. IEEE Signal Proc. Mag. 18, 32-80.
12. Efron, B., and Tibshirani, R. (1993). An introduction to the bootstrap. New York, Chapman and Hall.
13. Ethofer, T., Anders, S., Erb, M., Herbert, C., Wiethoff, S., Kissler, J., Grodd, W., and Wildgruber, D. (2006). Cerebral pathways in processing of affective prosody: a dynamic causal modeling study. Neuroimage 30, 580-587.
14. Ethofer, T., Kreifelts, B., Wiethoff, S., Wolf, J., Grodd, W., Vuilleumier, P., and Wildgruber, D. (2009a). Differential infl uences of emotion, task, and novelty on brain regions underlying the processing of speech melody. J. Cogn. Neurosci. 21, 1255-1268.
15. Ethofer, T., Van De Ville, D., Scherer, K., and Vuilleumier, P. (2009b). Decoding of emotional information in voicesensitive cortices. Curr. Biol. 19, 1028-1033.
16. Fecteau, S., Belin, P., Joanette, Y., and Armony, J. L. (2007). Amygdala responses to nonlinguistic emotional vocalizations. Neuroimage 36, 480-487.
17. Fernald, A. (1989). Intonation and communicative intent in mothers' speech to infants: is the melody the message? Child Dev. 60, 1497-1510.
18. Friston, K. J., Buechel, C., Fink, G. R., Morris, J., Rolls, E., and Dolan, R. J. (1997). Psychophysiological and modulatory interactions in neuroimaging. Neuroimage 6, 218-229.
19. Grandjean, D., Sander, D., Pourtois, G., Schwartz, S., Seghier, M. L., Scherer, K. R., and Vuilleumier, P. (2005). The voices of wrath: brain responses to angry prosody in meaningless speech. Nat. Neurosci. 8, 145-146.
20. Gur, R. C., Schroeder, L., Turner, T., McGrath, C., Chan, R. M., Turetsky, B. I., Alsop, D., Maldjian, J., and Gur, R. E. (2002). Brain activation during facial emotion processing. Neuroimage 16, 651-662.
21. Gur, R. E., Loughead, J., Kohler, C. G., Elliott, M. A., Lesko, K., Ruparel, K., Wolf, D. H., Bilker, W. B., and Gur, R. C. (2007). Limbic activation associated with misidentifi cation of fearful faces and fl at affect in schizophrenia. Arch. Gen. Psychiatry 64, 1356-1366.
22. Habel, U., Windischberger, C., Derntl, B., Robinson, S., Kryspin-Exner, I., Gur, R. C., and Moser, E. (2007). Amygdala activation and facial expressions: explicit emotion discrimination versus implicit emotion processing. Neuropsychologia 45, 2369-2377.
23. Heilman, K. M., Bowers, D., Speedie, L., and Coslett, H. B. (1984). Comprehension of affective and nonaffective prosody. Neurology 34, 917-921.
24. Hesling, I., Dilharreguy, B., Clement, S., Bordessoules, M., and Allard, M. (2005). Cerebral mechanisms of prosodic sensory integration using low-frequency bands of connected speech. Hum. Brain Mapp. 26, 157-169.
25. Hornak, J., Rolls, E. T., and Wade, D. (1996). Face and voice expression identifi cation in patients with emotional and behavioural changes following ventral frontal lobe damage. Neuropsychologia 34, 247-261.
26. Jenkinson, M., and Smith, S. (2001). A global optimisation method for robust affine registration of brain images. Med. Image Anal. 5, 143-156.
27. Juslin, P. N., and Laukka, P. (2001). Impact of intended emotion intensity on cue utilization and decoding accuracy in vocal expression of emotion. Emotion 1, 381-412.
28. Juslin, P. N., and Laukka, P. (2003). Communication of emotions in vocal expression and music performance: different channels, same code? Psychol. Bull. 129, 770-814.
29. Ladd, D., Silverman, K., Tolkmitt, F., Bergmann, G., and Scherer, K. (1985). Evidence for the independent function of intonation, contour type, voice quality, and F0 range in signalling speaker affect. J. Acoust. Soc. Am. 78, 435-444.
30. Leitman, D., Hoptman, M., Foxe, J. J., Wylie, G. R., Nierenberg, J., Jalbkowcski, M., Lim, K., and Javitt, D. C. (2007). The neural substrates of impaired prosodic detection in schizophrenia and its sensorial antecedents. Am. J. Psychiatry 164, 1-9.
31. Leitman, D. I., Foxe, J. J., Butler, P. D., Saperstein, A., Revheim, N., and Javitt, D. C. (2005). Sensory contributions to impaired prosodic processing in schizophrenia. Biol. Psychiatry 58, 56-61.
32. Leitman, D. I., Laukka, P., Juslin, P. N., Saccente, E., Butler, P., and Javitt, D. C. (2008). Getting the cue: sensory contributions to auditory emotion recognition impairments in schizophrenia. Schizophr. Bull. [Epub ahead of print].
33. Maldjian, J. A., Laurienti, P. J., Kraft, R. A., and Burdette, J. H. (2003). An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. Neuroimage 19, 1233-1239.
34. Matsumoto, K., Samson, G. T., O'Daly, O. D., Tracy, D. K., Patel, A. D., and Shergill, S. S. (2006). Prosodic discrimination in patients with schizophrenia. Br. J. Psychiatry 189, 180-181.
35. Mitchell, R. L., and Crow, T. J. (2005). Right hemisphere language functions and schizophrenia: the forgotten hemisphere? Brain 128, 963-978.
36. Mitchell, R. L., Elliott, R., Barry, M., Cruttenden, A., and Woodruff, P. W. (2003). The neural response to emotional prosody, as revealed by functional magnetic resonance imaging. Neuropsychologia 41, 1410-1421.
37. Morris, J. S., Scott, S. K., and Dolan, R. J. (1999). Saying it with feeling: neural responses to emotional vocalizations. Neuropsychologia 37, 1155-1163.
38. Obleser, J., Eisner, F., and Kotz, S. A. (2008). Bilateral speech comprehension reflects differential sensitivity to spectral and temporal features. J. Neurosci. 28, 8116-8123.
39. Phillips, M. L., Young, A. W., Scott, S. K., Calder, A. J., Andrew, C., Giampietro, V., Williams, S. C., Bullmore, E. T., Brammer, M., and Gray, J. A. (1998). Neural responses to facial and vocal expressions of fear and disgust. Proc. Biol. Sci. 265, 1809-1817.
40. Poldrack, R. A. (2006). Can cognitive processes be inferred from neuroimaging data? Trends Cogn Sci 10, 59-63.
41. Ross, E. D. (1981). The aprosodias. Functional-anatomic organization of the affective components of language in the right hemisphere. Arch. Neurol. 38, 561-569.
42. Ross, E. D., Edmondson, J. A., Seibert, G. B., and Homan, R. W. (1988). Acoustic analysis of affective prosody during right-sided Wada Test: a within-subjects verifi cation of the right hemisphere's role in language. Brain Lang. 33, 128-145.
43. Ross, E. D., and Monnot, M. (2008). Neurology of affective prosody and its functional-anatomic organization in right hemisphere. Brain Lang. 104, 51-74.
44. Sander, D., Grandjean, D., Pourtois, G., Schwartz, S., Seghier, M. L., Scherer, K. R., and Vuilleumier, P. (2005). Emotion and attention interactions in social cognition: brain regions involved in processing anger prosody. Neuroimage 28, 848-858.
45. Schirmer, A., and Kotz, S. A. (2006). Beyond the right hemisphere: brain mechanisms mediating vocal emotional processing. Trends Cogn. Sci. (Regul. Ed.) 10, 24-30.
46. Schirmer, A., Kotz, S. A., and Friederici, A. D. (2002). Sex differentiates the role of emotional prosody during word processing. Brain Res. Cogn. Brain Res. 14, 228-233.
47. Schirmer, A., Zysset, S., Kotz, S. A., and Yves von Cramon, D. (2004). Gender differences in the activation of inferior frontal cortex during emotional speech perception. Neuroimage 21, 1114-1123.
48. Smith, S. M. (2002). Fast robust automated brain extraction. Hum. Brain Mapp. 17, 143-155.
49. Talairach, J., and Tournoux, P. (1988). Co-Planar Steriotaxic Atlas of the Human Brain, 3 Dimensional Proportional System: An Approach to Cerebral Imaging. New York, Thieme Medical Publishers.
50. Thompson-Schill, S. L., D'Esposito, M., Aguirre, G. K., and Farah, M. J. (1997). Role of left inferior prefrontal cortex in retrieval of semantic knowledge: a reevaluation. Proc. Natl. Acad. Sci. U.S.A. 94, 14792-14797.
51. Van Horn, J. D., and Poldrack, R. A. (2009). Functional MRI at the crossroads. Int. J. Psychophysiol. 73, 3-9.
52. Van Lancker, D., and Sidtis, J. J. (1993). Brain damage and prosody errors reconsidered: reply to Heilman. J. Speech Hear. Res. 36, 1191-1192.
53. Wiethoff, S., Wildgruber, D., Grodd, W., and Ethofer, T. (2009). Response and habituation of the amygdala during processing of emotional prosody. Neuroreport [Epub ahead of print].
54. Wiethoff, S., Wildgruber, D., Kreifelts, B., Becker, H., Herbert, C., Grodd, W., and Ethofer, T. (2008). Cerebral processing of emotional prosody-influence of acoustic parameters and arousal. Neuroimage 39, 885-893.
55. Wildgruber, D., Hertrich, I., Riecker, A., Erb, M., Anders, S., Grodd, W., and Ackermann, H. (2004). Distinct frontal regions subserve evaluation of linguistic and emotional aspects of speech intonation. Cereb. Cortex 14, 1384-1389.
56. Wildgruber, D., Riecker, A., Hertrich, I., Erb, M., Grodd, W., Ethofer, T., and Ackermann, H. (2005). Identifi cation of emotional intonation evaluated by fMRI. Neuroimage 24, 1233-1241.
57. Woolrich, M. W., Behrens, T. E., Beckmann, C. F., Jenkinson, M., and Smith, S. M. (2004). Multilevel linear modelling for FMRI group analysis using Bayesian inference. Neuroimage 21, 1732-1747.
58. Woolrich, M. W., Ripley, B. D., Brady, M., and Smith, S. M. (2001). Temporal autocorrelation in univariate linear modeling of FMRI data. Neuroimage 14, 1370-1386.
59. Zatorre, R. J., and Belin, P. (2001). Spectral and temporal processing in human auditory cortex. Cereb. Cortex 11, 946-953.