Multisensory speech perception without the left superior temporal sulcus

NeuroImage

Volumn 62, Issue 3, 2012, Pages 1825-1832

  Baum, Sarah H ^a   Martin, Randi C ^b   Hamilton, A Cris ^b   Beauchamp, Michael S ^a  

^a UNIVERSITY OF TEXAS MEDICAL SCHOOL   (United States)

^b RICE UNIVERSITY   (United States)

Author keywords

Audiovisual; McGurk effect; Multisensory integration; Speech; STS

Indexed keywords

ADULT; AMPLITUDE MODULATION; APHASIA; ARTICLE; BEHAVIOR; BOLD SIGNAL; CASE REPORT; CONTROLLED STUDY; DISEASE SEVERITY; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; IMAGE ANALYSIS; LANGUAGE DISABILITY; MALE; MULTISENSORY SPEECH PERCEPTION; NUCLEAR MAGNETIC RESONANCE IMAGING; PARIETAL LOBE; PRIORITY JOURNAL; SPEECH PERCEPTION; STIMULUS RESPONSE; STROKE; SUPERIOR TEMPORAL SULCUS; TEMPORAL LOBE;

APHASIA; BRAIN MAPPING; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MIDDLE AGED; SPEECH PERCEPTION; STROKE; TEMPORAL LOBE;

EID: 84863520124     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2012.05.034     Document Type: Article

References (61)

1. Argall B.D., Saad Z.S., Beauchamp M.S. Simplified intersubject averaging on the cortical surface using SUMA. Hum. Brain Mapp. 2006, 27:14-27.
2. Beauchamp M.S. See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex. Curr. Opin. Neurobiol. 2005, 15:145-153.
3. Beauchamp M.S., Lee K.E., Argall B.D., Martin A. Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 2004, 41:809-823.
4. Beauchamp M.S., Nath A.R., Pasalar S. fMRI-guided transcranial magnetic stimulation reveals that the superior temporal sulcus is a cortical locus of the McGurk effect. J. Neurosci. 2010, 30:2414-2417.
5. Blasi V., Young A.C., Tansy A.P., Petersen S.E., Snyder A.Z., Corbetta M. Word retrieval learning modulates right frontal cortex in patients with left frontal damage. Neuron 2002, 36:159-170.
6. Blau V., van Atteveldt N., Formisano E., Goebel R., Blomert L. Task-irrelevant visual letters interact with the processing of speech sounds in heteromodal and unimodal cortex. Eur. J. Neurosci. 2008, 28:500-509.
7. Buckner R.L., Corbetta M., Schatz J., Raichle M.E., Petersen S.E. Preserved speech abilities and compensation following prefrontal damage. Proc. Natl. Acad. Sci. U.S.A. 1996, 93:1249-1253.
8. Calvert G.A., Campbell R., Brammer M.J. Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 2000, 10:649-657.
9. Campbell R., Garwood J., Franklin S., Howard D., Landis T., Regard M. Neuropsychological studies of auditory-visual fusion illusions. Four case studies and their implications. Neuropsychologia 1990, 28:787-802.
10. Cao Y., Vikingstad E.M., George K.P., Johnson A.F., Welch K.M. Cortical language activation in stroke patients recovering from aphasia with functional MRI. Stroke 1999, 30:2331-2340.
11. Carreiras M., Seghier M.L., Baquero S., Estevez A., Lozano A., Devlin J.T., Price C.J. An anatomical signature for literacy. Nature 2009, 461:983-986.
12. Champoux F., Tremblay C., Mercier C., Lassonde M., Lepore F., Gagne J.P., Theoret H. A role for the inferior colliculus in multisensory speech integration. Neuroreport 2006, 17:1607-1610.
13. Colin C., Radeau M., Deltenre P. Top-down and bottom-up modulation of audiovisual integration in speech. Eur. J. Cogn. Psychol. 2005, 17:541-560.
14. Cox R.W. AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. 1996, 29:162-173.
15. Crawford J.R., Howell D.C. Comparing an individual's test scores against norms derived from small samples. Clin. Neuropsychol. 1998, 12:482-486.
16. Czopf D. The role of the non-dominant hemisphere in speech recovery. Aphasia Apraxia Agnosia 1979, 2:27-33.
17. Dale A.M. Optimal experimental design for event-related fMRI. Hum. Brain Mapp. 1999, 8:109-114.
18. Dale A.M., Fischl B., Sereno M.I. Cortical surface-based analysis. I. Segmentation and surface reconstruction. Neuroimage 1999, 9:179-194.
19. Destrieux C., Fischl B., Dale A., Halgren E. Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature. Neuroimage 2010, 53:1-15.
20. Dronkers N.F., Wilkins D.P., Van Valin R.D., Redfern B.B., Jaeger J.J. Lesion analysis of the brain areas involved in language comprehension. Cognition 2004, 92:145-177.
21. Fischl B., Sereno M.I., Dale A.M. Cortical surface-based analysis. II: Inflation, flattening, and a surface-based coordinate system. Neuroimage 1999, 9:195-207.
22. Fischl B., van der Kouwe A., Destrieux C., Halgren E., Segonne F., Salat D.H., Busa E., Seidman L.J., Goldstein J., Kennedy D., Caviness V., Makris N., Rosen B., Dale A.M. Automatically parcellating the human cerebral cortex. Cereb. Cortex 2004, 14:11-22.
23. Frassinetti F., Bolognini N., Bottari D., Bonora A., Ladavas E. Audiovisual integration in patients with visual deficit. J. Cogn. Neurosci. 2005, 17:1442-1452.
24. Friston K.J., Rotshtein P., Geng J.J., Sterzer P., Henson R.N. A critique of functional localisers. Neuroimage 2006, 30:1077-1087.
25. Froyen D., van Atteveldt N., Blomert L. Exploring the role of low level visual processing in letter-speech sound integration: a visual MMN study. Front. Integr. Neurosci. 2010, 4:9.
26. Grant K.W., Seitz P.F. The use of visible speech cues for improving auditory detection of spoken sentences. J. Acoust. Soc. Am. 2000, 108:1197-1208.
27. Hickok G., Costanzo M., Capasso R., Miceli G. The role of Broca's area in speech perception: evidence from aphasia revisited. Brain Lang. 2011, 119:214-220.
28. Kherif F., Josse G., Seghier M.L., Price C.J. The main sources of intersubject variability in neuronal activation for reading aloud. J. Cogn. Neurosci. 2009, 21:654-668.
29. Kinsbourne M. The minor cerebral hemisphere as a source of aphasic speech. Arch. Neurol. 1971, 25:302-306.
30. Kriegeskorte N., Simmon W.K., Bellgowan P.S., Baker C.I. Circular analysis in systems neuroscience: the dangers of double dipping. Nat. Neurosci. 2009, 12:535-540.
31. Lewis J.W., Van Essen D.C. Corticocortical connections of visual, sensorimotor, and multimodal processing areas in the parietal lobe of the macaque monkey. J. Comp. Neurol. 2000, 428:112-137.
32. Massaro D. Data archive of 5*5+5+5 expanded factorial visual-auditory recognition experiments 1998, (URL: http://mambo.ucsc.edu/psl/8236/).
33. Massaro D., Cohen M.M., Gesi A., Heredia R., Tsuzaki M. Bimodal speech perception: an examination across languages. J. Phon. 1993, 21:445-478.
34. Mazziotta J., Toga A., Evans A., Fox P., Lancaster J., Zilles K., Woods R., Paus T., Simpson G., Pike B., Holmes C., Collins L., Thompson P., MacDonald D., Iacoboni M., Schormann T., Amunts K., Palomero-Gallagher N., Geyer S., Parsons L., Narr K., Kabani N., Le Goualher G., Boomsma D., Cannon T., Kawashima R., Mazoyer B. A probabilistic atlas and reference system for the human brain: International Consortium for Brain Mapping (ICBM). Philos. Trans. R. Soc. Lond. B Biol. Sci. 2001, 356:1293-1322.
35. McGettigan C., Faulkner A., Altarelli I., Obleser J., Baverstock H., Scott S.K. Speech comprehension aided by multiple modalities: behavioural and neural interactions. Neuropsychologia 2012, 50(5):762-776. (April).
36. McGurk H., MacDonald J. Hearing lips and seeing voices. Nature 1976, 264:746-748.
37. Miller L.M., D'Esposito M. Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J. Neurosci. 2005, 25:5884-5893.
38. Mumford J.A., Turner B.O., Ashby F.G., Poldrack R.A. Deconvolving BOLD activation in event-related designs for multivoxel pattern classification analyses. Neuroimage 2012, 59:2636-2643.
39. Nath A.R., Beauchamp M.S. Dynamic changes in superior temporal sulcus connectivity during perception of noisy audiovisual speech. J. Neurosci. 2011, 31:1704-1714.
40. Nath A.R., Beauchamp M.S. A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion. Neuroimage 2012, 59:781-787.
41. Nath A.R., Fava E.E., Beauchamp M.S. Neural correlates of interindividual differences in children's audiovisual speech perception. J. Neurosci. 2011, 31:13963-13971.
42. Oldfield R.C. The assessment and analysis of handedness: the edinburgh inventory. Neuropsychologia 1971, 9:97-113.
43. Raij T., Uutela K., Hari R. Audiovisual integration of letters in the human brain. Neuron 2000, 28:617-625.
44. Ross L.A., Saint-Amour D., Leavitt V.M., Javitt D.C., Foxe J.J. Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb. Cortex 2007, 17:1147-1153.
45. Saad Z.S., Glen D.R., Chen G., Beauchamp M.S., Desai R., Cox R.W. A new method for improving functional-to-structural MRI alignment using local Pearson correlation. Neuroimage 2009, 44:839-848.
46. Saxe R., Brett M., Kanwisher N. Divide and conquer: a defense of functional localizers. Neuroimage 2006, 30:1088-1096. (discussion 1097-1089).
47. Schmid G., Thielmann A., Ziegler W. The influence of visual and auditory information on the perception of speech and non-speech oral movements in patients with left hemisphere lesions. Clin. Linguist. Phon. 2009, 23:208-221.
48. Scott S.K., Johnsrude I.S. The neuroanatomical and functional organization of speech perception. Trends Neurosci. 2003, 26:100-107.
49. Seltzer B., Cola M.G., Gutierrez C., Massee M., Weldon C., Cusick C.G. Overlapping and nonoverlapping cortical projections to cortex of the superior temporal sulcus in the rhesus monkey: double anterograde tracer studies. J. Comp. Neurol. 1996, 370:173-190.
50. Skudlarski P., Constable R.T., Gore J.C. ROC analysis of statistical methods used in functional MRI: individual subjects. Neuroimage 1999, 9:311-329.
51. Stein B.E., Meredith M.A. The Merging of the Senses 1993, MIT Press.
52. Stevenson R.A., James T.W. Audiovisual integration in human superior temporal sulcus: inverse effectiveness and the neural processing of speech and object recognition. Neuroimage 2009, 44:1210-1223.
53. Stevenson R.A., VanDerKlok R.M., Pisoni D.B., James T.W. Discrete neural substrates underlie complementary audiovisual speech integration processes. Neuroimage 2011, 55:1339-1345.
54. Sumby W.H., Pollack I. Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 1954, 26:212-215.
55. Thomas C., Altenmueller E., Marckmann G., Kahrs J., Dichgans J. Language processing in aphasia: changes in lateralization patterns during recovery reflect cerebral plasticity in adults. Electroencephalogr. Clin. Neurophysiol. 1997, 102:86-97.
56. Turkeltaub P.E., Coslett H.B., Thomas A.L., Faseyitan O., Benson J., Norise C., Hamilton R.H. The right hemisphere is not unitary in its role in aphasia recovery. Cortex 2011, http://dx.doi.org/10.1016/j.cortex.2011.06.010 (epub ahead of print).
57. van Atteveldt N., Formisano E., Goebel R., Blomert L. Integration of letters and speech sounds in the human brain. Neuron 2004, 43:271-282.
58. van Atteveldt N.M., Blau V.C., Blomert L., Goebel R. fMR-adaptation indicates selectivity to audiovisual content congruency in distributed clusters in human superior temporal cortex. BMC Neurosci. 2010, 11:11.
59. Vul E., Harris C., Winkielman P., Pashler H. Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition. Perspect. Psychol. Sci. 2009, 4:274-290.
60. Winhuisen L., Thiel A., Schumacher B., Kessler J., Rudolf J., Haupt W.F., Heiss W.D. Role of the contralateral inferior frontal gyrus in recovery of language function in poststroke aphasia: a combined repetitive transcranial magnetic stimulation and positron emission tomography study. Stroke 2005, 36:1759-1763.
61. Youse K.M., Cienkowski K.M., Coelho C.A. Auditory-visual speech perception in an adult with aphasia. Brain Inj. 2004, 18:825-834.