People-selectivity, audiovisual integration and heteromodality in the superior temporal sulcus

Cortex

Volumn 50, Issue , 2014, Pages 125-136

  Watson, Rebecca ^a,b   Latinus, Marianne ^b,c   Charest, Ian ^b,d   Crabbe, Frances ^b   Belin, Pascal ^b,c,e  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

^c AIX MARSEILLE UNIVERSITY   (France)

^d MRC COGNITION AND BRAIN SCIENCES UNIT   (United Kingdom)

^e UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

Audiovisual integration; Face sensitivity; Superior temporal sulcus; Voice sensitivity

Indexed keywords

ADULT; ARTICLE; AUDITORY STIMULATION; BRAIN REGION; FACE; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUNCTIONAL NEUROIMAGING; HUMAN; HUMAN EXPERIMENT; MALE; NEUROPHYSIOLOGY; NORMAL HUMAN; PERCEPTION; STIMULUS RESPONSE; SUPERIOR TEMPORAL SULCUS; VISUAL STIMULATION; VOICE; AUDIOVISUAL INTEGRATION; BRAIN MAPPING; FACE SENSITIVITY; HEARING; IMAGE PROCESSING; NUCLEAR MAGNETIC RESONANCE IMAGING; PHOTOSTIMULATION; PHYSIOLOGY; RECOGNITION; SINGING; SPEECH; TEMPORAL LOBE; VISION; VOICE SENSITIVITY; YOUNG ADULT;

AUDIOVISUAL INTEGRATION; FACE SENSITIVITY; SUPERIOR TEMPORAL SULCUS; VOICE SENSITIVITY;

ADULT; AUDITORY PERCEPTION; BRAIN MAPPING; FACE; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; PHOTIC STIMULATION; RECOGNITION (PSYCHOLOGY); SINGING; SPEECH; TEMPORAL LOBE; VISUAL PERCEPTION; VOICE; YOUNG ADULT;

EID: 84900384970     PISSN: 00109452     EISSN: 19738102     Source Type: Journal    
DOI: 10.1016/j.cortex.2013.07.011     Document Type: Article

References (61)

1. Allison T., Puce A., McCarthy G. Social perception from visual cues: role of the STS region. Trends in Cognitive Sciences 2000, 4:267-278.
2. Andics A., McQueen J.M., Petersson K.M., Gál V., Rudas G., Vidnyánszky Z. Neural mechanisms for voice recognition. NeuroImage 2010, 52:1528-1540.
3. Andrews T.J., Davies-Thompson J., Kingstone A., Young A.W. Internal and external features of the face are represented holistically in face-selective regions of visual cortex. Journal of Neuroscience 2010, 30:3544-3552.
4. van Atteveldt N., Formisano E., Goebel R., Blomert L. Integration of letters and speech sounds in the human brain. Neuron 2004, 43:271-282.
5. Baier B., Kleinschmidt A., Müller N.G. Cross-modal processing in early visual and auditory cortices depends on expected statistical relationship of multisensory information. Journal of Neuroscience 2006, 26:12260-12265.
6. Barraclough N.E., Xiao D., Baker C.I., Oram M.W., Perrett D.I. Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. Journal of Cognitive Neuroscience 2005, 17:377-391.
7. Beauchamp M.S. Statistical criteria in FMRI studies of multisensory integration. Neuroinformatics 2005, 3:93-113.
8. Beauchamp M.S., Lee K.E., Argall B.D., Martin A. Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 2004, 41:809-823.
9. Beauchamp M., Lee K., Haxby J., Martin A. FMRI responses to video and point-light displays of moving humans and manipulable objects. Journal of Cognitive Neuroscience 2003, 15:991-1001.
10. Belin P., Bestelmeyer P.E.G., Latinus M., Watson R. Understanding voice perception. British Journal of Psychology 2011, 102:711-725.
11. Belin P., Fecteau S., Bédard C. Thinking the voice: neural correlates of voice perception. Trends in Cognitive Sciences 2004, 8:129-135.
12. Belin P., Zatorre R.J. Adaptation to speaker's voice in right anterior temporal lobe. NeuroReport 2003, 14:2105-2109.
13. Belin P., Zatorre R.J., Ahad P. Human temporal-lobe response to vocal sounds. Brain Research. Cognitive Brain Research 2002, 13:17-26.
14. Belin P., Zatorre R.J., Lafaille P., Ahad P., Pike B. Voice-selective areas in human auditory cortex. Nature 2000, 403:309-312.
15. Blank H., Anwander A., von Kriegstein K. Direct structural connections between voice- and face-recognition areas. Journal of Neuroscience 2011, 31:12906-12915.
16. Brancucci A., Lucci G., Mazzatenta A., Tommasi L. Asymmetries of the human social brain in the visual, auditory and chemical modalities. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 2009, 364:895-914.
17. Bushara K.O., Grafman J., Hallett M. Neural correlates of auditory-visual stimulus onset asynchrony detection. Journal of Neuroscience 2001, 21:300-304.
18. Calvert G.A. Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cerebral Cortex 2001, 11:1110-1123.
19. Calvert G.A., Campbell R., Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology 2000, 10:649-657.
20. Cusick C.G. The superior temporal polysensory region in monkeys. Cerebral cortex 1997, vol. 12:435-468. Plenum Press, New York.
21. De Renzi E., Perani D., Carlesimo G.A., Silveri M.C., Fazio F. Prosopagnosia can be associated with damage confined to the right hemisphere - an MRI and PET study and a review of the literature. Neuropsychologia 1994, 32:893-902.
22. Ethofer T., Anders S., Erb M., Droll C., Royen L., Saur R., et al. Impact of voice on emotional judgment of faces: an event-related fMRI study. Human Brain Mapping 2006, 27:707-714.
23. Ethofer T., Van De Ville D., Scherer K., Vuilleumier P. Decoding of emotional information in voice-sensitive cortices. Current Biology 2009, 19:1028-1033.
24. Gazzaniga M.S., Smylie C.S. Facial recognition and brain asymmetries: clues to underlying mechanisms. Annals of Neurology 1983, 13:536-540.
25. Ghazanfar A.A., Maier J.X., Hoffman K.L., Logothetis N.K. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. Journal of Neuroscience 2005, 25:5004-5012.
26. Grandjean D., Sander D., Pourtois G., Schwartz S., Seghier M.L., Scherer K.R., et al. The voices of wrath: brain responses to angry prosody in meaningless speech. Nature Neuroscience 2005, 8:145-146.
27. Hagan C.C., Woods W., Johnson S., Calder A.J., Green G.G., Young A.W. MEG demonstrates a supra-additive response to facial and vocal emotion in the right superior temporal sulcus. Proceedings of the National Academy of Sciences of the United States of America 2009, 106:20010-20015.
28. Haxby J.V., Hoffman E.A., Gobbini M.I. The distributed human neural system for face perception. Trends in Cognitive Sciences 2000, 4:223-232.
29. Haxby J.V., Hoffman E.A., Gobbini M.I. Human neural systems for face recognition and social communication. Biological Psychiatry 2002, 51:59-67.
30. Hein G., Knight R.T. Superior temporal sulcus - it's my area: or is it?. Journal of Cognitive Neuroscience 2008, 20:2125-2136.
31. Hoffman E.A., Haxby J.V. Distinct representations of eye gaze and identity in the distributed human neural system for face perception. Nature Neuroscience 2000, 3:80-84.
32. Joassin F., Pesenti M., Maurage P., Verreckt E., Bruyer R., Campanella S. Cross-modal interactions between human faces and voices involved in person recognition. Cortex 2011, 47:367-376.
33. Kanwisher N., McDermott J., Chun M.M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. Journal of Neuroscience 1997, 17:4302-4311.
34. Komura Y., Tamura R., Uwano T., Nishijo H., Ono T. Auditory thalamus integrates visual inputs into behavioral gains. Nature Neuroscience 2005, 8:1203-1209.
35. Kreifelts B., Ethofer T., Grodd W., Erb M., Wildgruber D. Audiovisual integration of emotional signals in voice and face: an event-related fMRI study. NeuroImage 2007, 37:1445-1456.
36. Kreifelts B., Ethofer T., Huberle E., Grodd W., Wildgruber D. Association of trait emotional intelligence and individual fMRI activation patterns during the perception of social signals from voice and face. Human Brain Mapping 2010, 31:979-991.
37. Kreifelts B., Ethofer T., Shiozawa T., Grodd W., Wildgruber D. Cerebral representation of non-verbal emotional perception: fMRI reveals audiovisual integration area between voice- and face-sensitive regions in the superior temporal sulcus. Neuropsychologia 2009, 47:3059-3066.
38. von Kriegstein K., Eger E., Kleinschmidt A., Giraud A.L. Modulation of neural responses to speech by directing attention to voices or verbal content. Cognitive Brain Research 2003, 17:48-55.
39. von Kriegstein K., Giraud A.L. Distinct functional substrates along the right superior temporal sulcus for the processing of voices. NeuroImage 2004, 22:948-955.
40. Latinus M., Crabbe F., Belin P. Learning-induced changes in the cerebral processing of voice identity. Cerebral Cortex 2011, 21:2820-2828.
41. Lee L.C., Andrews T.J., Johnson S.J., Woods W., Gouws A., Green G.G., et al. Neural responses to rigidly moving faces displaying shifts in social attention investigated with fMRI and MEG. Neuropsychologia 2010, 48:477-490.
42. Le Grand R., Mondloch C.J., Maurer D., Brent H.P. Expert face processing requires visual input to the right hemisphere during infancy. Nature Neuroscience 2003, 6:1108-1112.
43. Linden D.E., Thornton K., Kuswanto C.N., Johnston S.J., van de Ven V., Jackson M.C. The brain's voices: comparing nonclinical auditory hallucinations and imagery. Cerebral Cortex 2011, 21:330-337.
44. Love S.A., Pollick F.E., Latinus M. Cerebral correlates and statistical criteria of cross-modal face and voice integration. Seeing and Perceiving 2011, 24:351-367. Cerebral Cortex, 21, 330-37.
45. McCarthy G., Puce A., Gore J.C., Allison T. Face-specific processing in the human fusiform gyrus. Journal of Cognitive Neuroscience 1997, 9:605-610.
46. Meng M., Cherian T., Singal G., Sinha P. Lateralization of face processing in the human brain. Proceedings of the Royal Society Series B Biological Sciences 2012, 279:2052-2061.
47. Miller M.B., Kingstone A., Gazzaniga M.S. Hemispheric encoding asymmetry is more apparent than real. Journal of Cognitive Neuroscience 2002, 14:702-708.
48. Ochiai T., Grimault S., Scavarda D., Roch G., Hori T., Rivière D., et al. Sulcal pattern and morphology of the superior temporal sulcus. NeuroImage 2004, 22:706-719.
49. Padberg J., Seltzer B., Cusick C.G. Architectonics and cortical connections of the upper bank of the superior temporal sulcus in the rhesus monkey: an analysis in the tangential plane. Journal of Comparative Neurology 2003, 467:418-434.
50. Peuskens H., Vanrie J., Verfaillie K., Orban G.A. Specificity of regions processing biological motion. European Journal of Neuroscience 2005, 21:2864-2875.
51. Phillips M.L., Young A.W., Senior C., Calder A.J., Rowland D., Brammer M., et al. A specific neural substrate for perception of facial expressions of disgust. Nature 1997, 389:495-498.
52. Pitcher D., Dilks D.D., Saxe R.R., Triantafyllou C., Kanwisher N. Differential selectivity for dynamic versus static information in face-selective cortical regions. NeuroImage 2011, 56:2356-2363.
53. Pourtois G., de Gelder B., Bol A., Crommelinck M. Perception of facial expressions and voices and of their combination in the human brain. Cortex 2005, 41:49-59.
54. Rossion B., Caldara R., Seghier M., Schuller A.M., Lazeyras F., Mayer E. A network of occipito-temporal face-sensitive areas besides the right middle fusiform gyrus is necessary for normal face processing. Brain 2003, 126:2381-2395.
55. Savic I., Berglund H., Gulyas B., Roland P. Smelling odorous sex hormone-like compounds causes sex-differentiated hypothalamic activations in humans. Neuron 2001, 31:661-668.
56. Savic I., Berglund H., Lindstrom P. Brain response to putative pheromones in homosexual men. Proceedings of the Natural Academy of Sciences USA 2005, 102:7356-7361.
57. Sokhi D.S., Hunter M.D., Wilkinson I.D., Woodruff P.W. Male and female voices activate distinct regions in the male brain. NeuroImage 2005, 27:572-578.
58. Szycik G.R., Jansma H., Münte T.F. Audiovisual integration during speech comprehension: an fMRI study comparing ROI-based and whole brain analyses. Human Brain Mapping 2009, 30:1990-1999.
59. Vohn R., Fimm B., Weber J., Schnitker R., Thron A., Spijkers W., et al. Management of attentional resources in within-modal and cross-modal divided attention tasks: an fMRI study. Human Brain Mapping 2007, 28:1267-1275.
60. Werner S., Noppeney U. Superadditive responses in superior temporal sulcus predict audiovisual benefits in object categorization. Cerebral Cortex 2010, 20:1829-1842.
61. Wright T.M., Pelphrey K.A., Allison T., McKeown M.J., McCarthy G. Polysensory interactions along lateral temporal regions evoked by audiovisual speech. Cerebral Cortex 2003, 13:1034-1043.