Cerebral representation of non-verbal emotional perception: fMRI reveals audiovisual integration area between voice- and face-sensitive regions in the superior temporal sulcus

Neuropsychologia

Volumn 47, Issue 14, 2009, Pages 3059-3066

  Kreifelts, Benjamin ^a   Ethofer, Thomas ^a,b   Shiozawa, Thomas ^c   Grodd, Wolfgang ^b   Wildgruber, Dirk ^a,b  

^a UNIVERSITY HOSPITAL TÜBINGEN   (Germany)

^b the CNS   (Germany)

^c UNIVERSITY OF TÜBINGEN   (Germany)

Author keywords

Crossmodal; Emotion; Implicit; Multisensory; Social cognition; STS

Indexed keywords

ADULT; ARTICLE; EMOTION; FACE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEARING; HUMAN; HUMAN EXPERIMENT; MALE; NERVE CELL; NEUROIMAGING; NONVERBAL COMMUNICATION; NORMAL HUMAN; PERCEPTION; SOCIAL INTERACTION; SUPERIOR TEMPORAL SULCUS; TEMPORAL LOBE; VISION; VOICE;

ACOUSTIC STIMULATION; ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; BRAIN MAPPING; EMOTIONS; FACE; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; OXYGEN; PHOTIC STIMULATION; SELF CONCEPT; SENSITIVITY AND SPECIFICITY; SEX FACTORS; TEMPORAL LOBE; VOICE; YOUNG ADULT;

EID: 70350378200     PISSN: 00283932     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuropsychologia.2009.07.001     Document Type: Article

References (39)

1. Allison T., Puce A., and McCarthy G. Social perception from visual cues: Role of the STS region. Trends in Cognitive Sciences 4 7 (2000) 267-278
2. Barraclough N.E., Xiao D., Baker C.I., Oram M.W., and Perrett D.I. Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. Journal of Cognitive Neuroscience 17 3 (2005) 377-391
3. Beauchamp M.S., Lee K.E., Argall B.D., and Martin A. Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41 5 (2004) 809-823
4. Belin P., Zatorre R.J., Lafaille P., Ahad P., and Pike B. Voice-selective areas in human auditory cortex. Nature 403 6767 (2000) 309-312
5. Brackett M.A., and Mayer J.D. Convergent, discriminant, and incremental validity of competing measures of emotional intelligence. Personality and Social psychology Bulletin 29 9 (2003) 1147-1158
6. Bradley M.M., and Lang P.J. Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry 25 1 (1994) 49-59
7. Calvert G.A., Campbell R., and Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology 10 11 (2000) 649-657
8. Chapman B.P., and Hayslip Jr. B. Incremental validity of a measure of emotional intelligence. Journal of Personality Assessment 85 2 (2005) 154-169
9. De Gelder B., and Vroomen J. The perception of emotions by ear and by eye. Cognition and Emotion 14 3 (2000) 289-311
10. Epstein R., Harris A., Stanley D., and Kanwisher N. The parahippocampal place area: Recognition, navigation, or encoding?. Neuron 23 1 (1999) 115-125
11. Ethofer T., Pourtois G., and Wildgruber D. Investigating audiovisual integration of emotional signals in the human brain. Progress in Brain Research 156 (2006) 345-361
12. Fecteau S., Armony J.L., Joanette Y., and Belin P. Is voice processing species-specific in human auditory cortex? An fMRI study. Neuroimage 23 3 (2004) 840-848
13. Geisser S., and Greenhouse S.W. An extension of Box's results on the use of the F-distribution in multivariate analysis. Annals of Mathematical Statistics 29 (1958) 885-891
14. Giraud A.L., Kell C., Thierfelder C., Sterzer P., Russ M.O., Preibisch C., et al. Contributions of sensory input, auditory search and verbal comprehension to cortical activity during speech processing. Cerebral Cortex 14 3 (2004) 247-255
15. Gobbini M.I., Koralek A.C., Bryan R.E., Montgomery K.J., and Haxby J.V. Two takes on the social brain: A comparison of theory of mind tasks. Journal of Cognitive Neuroscience 19 11 (2007) 1803-1814
16. Grèzes J., Costes N., and Decety J. Top down effect of strategy on the perception of human biological motion: A pet investigation. Cognitive Neuropsychology 15 6-8 (1998) 553-582
17. Hamann S., and Canli T. Individual differences in emotion processing. Current Opinions in Neurobiology 14 2 (2004) 233-238
18. Haxby J.V., Hoffman E.A., and Gobbini M.I. The distributed human neural system for face perception. Trends in Cognitive Sciences 4 6 (2000) 223-233
19. Ishai A., Pessoa L., Bikle P.C., and Ungerleider L.G. Repetition suppression of faces is modulated by emotion. Proceedings of the National Academy of Sciences of the United States of America 101 26 (2004) 9827-9832
20. Kanwisher N., McDermott J., and Chun M.M. The fusiform face area: A module in human extrastriate cortex specialized for face perception. Journal of Neuroscience 17 11 (1997) 4302-4311
21. Kreifelts B., Ethofer T., Grodd W., Erb M., and Wildgruber D. Audiovisual integration of emotional signals in voice and face: An event-related fMRI study. Neuroimage 37 4 (2007) 1445-1456
22. Kriegstein K.V., and Giraud A.L. Distinct functional substrates along the right superior temporal sulcus for the processing of voices. Neuroimage 22 2 (2004) 948-955
23. Lotze M., Heymans U., Birbaumer N., Veit R., Erb M., Flor H., et al. Differential cerebral activation during observation of expressive gestures and motor acts. Neuropsychologia 44 10 (2006) 1787-1795
24. Massaro D.W., and Egan P.B. Perceiving affect from the voice and the face. Psychonomic Bulletin & Review 3 2 (1996) 215-221
25. Ochiai T., Grimault S., Scavarda D., Roch G., Hori T., Riviere D., et al. Sulcal pattern and morphology of the superior temporal sulcus. Neuroimage 22 2 (2004) 706-719
26. Oldfield R.C. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 9 1 (1971) 97-113
27. Petkov C.I., Kayser C., Steudel T., Whittingstall K., Augath M., and Logothetis N.K. A voice region in the monkey brain. Nature Neuroscience 11 3 (2008) 367-374
28. Pourtois G., de Gelder B., Bol A., and Crommelinck M. Perception of facial expressions and voices and of their combination in the human brain. Cortex 41 1 (2005) 49-59
29. Pourtois G., de Gelder B., Vroomen J., Rossion B., and Crommelinck M. The time-course of intermodal binding between seeing and hearing affective information. Neuroreport 11 6 (2000) 1329-1333
30. Saklofske A., and Minski P. Factor structure and validity of a trait emotional intelligence measure. Personality and Individual Differences 34 (2003) 707-721
31. Schutte N.S., Malouff J.M., Bobik C., Coston T.D., Greeson C., Jedlicka C., et al. Emotional intelligence and interpersonal relations. Journal of Social Psychology 141 4 (2001) 523-536
32. Schutte N., Malouff J., Hall L., Haggerty D., Cooper J., Golden C., et al. Development and validation of a measure of emotional intelligence. Personality and Individual Differences 25 (1998) 167-177
33. Seltzer B., and Pandya D.N. Afferent cortical connections and architectonics of the superior temporal sulcus and surrounding cortex in the rhesus monkey. Brain Research 149 1 (1978) 1-24
34. Sorger B., Goebel R., Schiltz C., and Rossion B. Understanding the functional neuroanatomy of acquired prosopagnosia. Neuroimage 35 2 (2007) 836-852
35. Spiers H.J., and Maguire E.A. Spontaneous mentalizing during an interactive real world task: An fMRI study. Neuropsychologia 44 10 (2006) 1674-1682
36. Stein B.E., and Meredith M.A. Merging of senses (1993), MIT Press, Cambridge
37. Tsao D.Y., Freiwald W.A., Tootell R.B., and Livingstone M.S. A cortical region consisting entirely of face-selective cells. Science 311 5761 (2006) 670-674
38. van Atteveldt N., Formisano E., Goebel R., and Blomert L. Integration of letters and speech sounds in the human brain. Neuron 43 2 (2004) 271-282
39. Wright T.M., Pelphrey K.A., Allison T., McKeown M.J., and McCarthy G. Polysensory interactions along lateral temporal regions evoked by audiovisual speech. Cerebral Cortex 13 10 (2003) 1034-1043