The cortical organization of audio-visual sentence comprehension: An fMRI study at 4 Tesla

Cognitive Brain Research

Volumn 20, Issue 2, 2004, Pages 111-119

  Capek, Cheryl M ^a   Bavelier, Daphne ^b   Corina, David ^c   Newman, Aaron J ^b   Jezzard, Peter ^d   Neville, Helen J ^a  

^a UNIVERSITY OF OREGON   (United States)

^b UNIVERSITY OF ROCHESTER   (United States)

^c UNIVERSITY OF WASHINGTON   (United States)

^d JOHN RADCLIFFE HOSPITAL   (United Kingdom)

Author keywords

Audio visual; Cognition; Lateral dominance; Magnetic resonance imaging; Neural basis of behavior; Perisylvian cortex; Sentence comprehension; Sign language

Indexed keywords

ADULT; ARTICLE; AUDITORY NERVOUS SYSTEM; AUDITORY STIMULATION; BRAIN FUNCTION; COMPREHENSION; FACE; FEMALE; HEMISPHERIC DOMINANCE; HUMAN; HUMAN EXPERIMENT; LEFT HEMISPHERE; MALE; NEUROIMAGING; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; PREFRONTAL CORTEX; PRIORITY JOURNAL; VIDEORECORDING; VISUAL NERVOUS SYSTEM; VISUAL STIMULATION;

ADULT; AUDITORY CORTEX; AUDITORY PERCEPTION; BRAIN MAPPING; DOMINANCE, CEREBRAL; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; SIGN LANGUAGE; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 2942525375     PISSN: 09266410     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cogbrainres.2003.10.014     Document Type: Article

References (75)

1. Baldwin D.A., Markman E.M., Bill B., Desjardins R.N., Irwin J.M. Infants' reliance on social criterion for establishing word-object relations. Child Development. 6:1996;3135-3153
2. Bavelier D., Corina D., Jezzard P., Padmanabhan S., Clark V.P., Karni A., Prinster A., Braun A., Lalwani A., Rauschecker J.P., Turner R., Neville H.J. Sentence reading: a functional MRI study at 4 Tesla. Journal of Cognitive Neuroscience. 9:1997;664-686
3. Binder J.R. Functional MRI of the language system. Moonen P.A.B.C.T.W. Functional MRI. 1999;407-419 Springer, Berlin
4. Binder J., McKiernan K., Parsons M., Westbury C., Possing E., Kaufman J., Buchanan L. Neural correlates lexical access during visual word recognition. Journal of Cognitive Neuroscience. 15:2003;372-393
5. Blonder L.X., Bowers D., Heilman K.M. The role of the right hemisphere in emotional communication. Brain and Cognition. 114:1991;1115-1127
6. Blonder L.X., Burns A.F., Bowers D., Moore R.W. Right hemisphere facial expressivity during natural conversation. Brain and Cognition. 21:1993;44-56
7. Broca P. Remarques sur le siège de la faculté du langage articulé: suivies d'une observation d'aphemie. Bulletin de la Societe Anatomie Paris. 6:1861;330-357
8. Calvert G.A., Brammer M.J., Iversen S.D. Crossmodal identification. Trends in Cognitive Science. 2:1998;247-253
9. Calvert G.A., Brammer M.J., Bullmore E.T., Campbell R., Iversen S.D., David A.S. Response amplification in sensory-specific cortices during crossmodal binding. NeuroReport. 10:1999;2619-2623
10. Campbell R., MacSweeney M., Surguladze S., Calvert G., McGuire P., Suckling J., Brammer M.J., David A. Cortical substrates for the perception of face actions: an fMRI study of the specificity of activation for seen speech and for meaningless lower-face acts (gurning). Cognitive Brain Research. 12:2001;233-243
11. Caplan D., Alpert N., Waters G. Effects of syntactic structure and propositional number on patterns of regional cerebral blood flow. Journal of Cognitive Neuroscience. 10:1998;541-552
12. Caplan D., Alpert N., Waters G. PET studies of syntactic processing with auditory sentence presentation. NeuroImage. 9:1999;343-351
13. Caplan D., Alpert N., Waters G., Olivieri A. Activation of Broca's area by syntactic processing under conditions of concurrent articulation. Human Brain Mapping. 9:2000;65-71
14. Caplan D., Vijayan S., Kuperberg G., West C., Waters G., Greve D., Dale A.M. Vascular responses to syntactic processing: event-related fMRI study of relative clauses. Human Brain Mapping. 15:2001;26-38
15. Carpenter P.A., Just M.A., Keller T.A., Eddy W.F., Thulborn K.R. Time course of fMRI-activation in language and spatial networks during sentence comprehension. NeuroImage. 10:1999;216-224
16. Chee M.W.L., O'Craven K.M., Bergida R., Rosen B.R., Savoy R.L. Auditory and visual word processing studied with fMRI. Human Brain Mapping. 7:1999;15-28
17. Craik F.I., Tulving E. Depth of processing and the retention of words in episodic memory. Journal of Experimental Psychology. General. 104:1975;268-294
18. Cutler A., Mehler J., Norris D., Segui J. Limits on bilingualism. Nature. 340:1989;229-230
19. Cutler A., Mehler J., Norris D., Segui J. The monolingual nature of speech segmentation by bilinguals. Cognitive Psychology. 24:1992;381-410
20. Davis M.H., Johnsrude I.S. Hierarchical processing in spoken language comprehension. Journal of Neuroscience. 23:2003;3423-3431
21. Driver J. Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature. 381:1996;66-68
22. Embick D., Marantz A., Miyashita Y., O'Neil W., Sakai K.L. A syntactic specialization for Broca's area. Proceedings of the National Academy of Science. 97:2000;6150-6154
23. Ferstl E.C., Cramon D.Y.v. The role of coherence and cohesion in text comprehension: an event-related fMRI study. Cognitive Brain Research. 11:2001;325-340
24. Fiebach C.J., Schlesewsky M., Friederici A.D. Syntactic working memory and the establishment of filler-gap dependencies: insights from ERPs and fMRI. Journal of Psycholinguistic Research. 30:2001;321-338
25. Fiez J.A., Raichle M.E., Balota D.A., Tallal P., et al. PET activation of posterior temporal regions during auditory word presentation and verb generation. Cerebral Cortex. 6:1996;1-10
26. Friederici A.D., Meyer M., Yves von Cramon D. Auditory language comprehension: an event-related fMRI study on the processing of syntactic and lexical information. Brain and Language. 74:2000;289-300
27. Friederici A.D., Opitz B., von Cramon D.Y. Segregating semantic and syntactic aspects of processing in the human brain: an fMRI investigation of different word types. Cerebral Cortex. 10:2000;698-705
28. Friederici A.D., Wang Y., Herrmann C.S., Maess B., Oertel U. Localization of early syntactic processes in frontal and temporal cortical areas: a magnetoencephalographic study. Human Brain Mapping. 11:2000;1-11
29. Friederici A.D., Rüschemeyer S.-A., Hahne A., Fiebach C.J. The role of left inferior frontal and superior temporal cortex in sentence comprehension: localizing syntactic and semantic processes. Cerebral Cortex. 13:2003;170-177
30. Friston K.J., Jezzard P., Turner R. Analysis of functional MRI time-series. Human Brain Mapping. 1:1994;153-171
31. George M.S., Parekh P.I., Rosinsky N., Ketter T.A., Kimbrell T.A., Heilman K.M., Herscovitch P., Post R.M. Understanding emotional prosody activates right hemisphere regions. Archives of Neurology. 53:1996;665-670
32. Hardison D. Bimodal speech perception by native and nonnative speakers of English: factors influencing the McGurk effect. Language Learning. 49:1999;213-283
33. Heilman K.M., Bowers D., Speedie L., Coslett H.B. Comprehension of affective and nonaffective prosody. Neurology. 34:1984;917-921
34. Just M.A., Carpenter P.A., Keller T.A., Eddy W.F., Thulborn K.R. Brain activation modulated by sentence comprehension. Science. 274:1996;114-116
35. Kennedy D.N., Lange N., Makris N., Bates J., Meyer J., Caviness V.S. Gyri of the human neocortex: an MRI-based analysis of volume and variance. Cerebral Cortex. 8:1998;372-384
36. Kounios J., Holcomb P. Concreteness effects in semantic processing: ERP evidence supporting dual-coding theory. Journal of Experimental Psychology. Learning, Memory, and Cognition. 20:1994;804-823
37. Kuhl P.K., Meltzoff A.N. The bimodal perception of speech in infancy. Science. 218:1982;1138-1141
38. Kuperberg G.R., McGuire P.K., Bullmore E.T., Brammer M.J., Rabe-Hesketh S., Wright I.C., Lythgoe D.J., Williams S.C.R., David A.S. Common and distinct neural substrates for pragmatic, semantic, and syntactic processing of spoken sentences: an fMRI study. Journal of Cognitive Neuroscience. 12:2000;321-341
39. MacSweeney M., Woll B., Campbell R., McGuire P.K., David A.S., Williams S.C.R., Suckling J., Calvert G.A., Brammer M.J. Neural systems underlying British Sign Language and audio-visual English processing in native users. Brain. 125:2002;1594-1606
40. Mazoyer B., Tzourio N., Frak V., Syrota A., Murayama N., Levrier O., Salamon G., Dehaene S., Cohen L., Mehler J. The cortical representation of speech. Journal of Cognitive Neuroscience. 5:1993;467-479
41. McGurk H., MacDonald J. Hearing lips and seeing voices. Nature. 264:1976;746-748
42. Mechelli A., Friston K.J., Price C.J. The effects of presentation rate during word and pseudoword reading: a comparison of PET and fMRI. Journal of Cognitive Neuroscience. 12:2000;145-156
43. Mechelli A., Gorno-Tempini M.L., Price C.J. Neuroimaging studies of word and pseudoword reading: consistencies, inconsistencies, and limitations. Journal of Cognitive Neuroscience. 15:2003;260-271
44. Meyer M., Friederici A.D., von Cramon D.Y. Neurocognition of auditory sentence comprehension: event related fMRI reveals sensitivity to syntactic violations and task demands. Cognitive Brain Research. 9:2000;19-33
45. Michael E.B., Keller T.A., Carpenter P.A., Just M.A. fMRI investigation of sentence comprehension by eye and by ear: modality fingerprints on cognitive processes. Human Brain Mapping. 13:2001;239-252
46. Neville H.J., Bavelier D., Corina D., Rauschecker J., Karni A., Lalwani A., Braun A., Clark V., Jezzard P., Turner R. Cerebral organization for language in deaf and hearing subjects: biological constraints and effects of experience. Proceedings of the National Academy of Science. 95:1998;922-929
47. Newman A.J., Bavelier D., Corina D., Jezzard P., Neville H.J. A critical period for right hemisphere recruitment in American Sign Language processing. Nature Neuroscience. 5:2002;76-80
48. Ni W., Constable R.T., Mencl W.E., Pugh K.R., Fulbright R.K., Shaywitz S.E., Shaywitz B.A., Gore J.C., Shankweiler D. An event-related neuroimaging study distinguishing form and content in sentence processing. Journal of Cognitive Neuroscience. 12:2000;120-133
49. Pell M.D. Fundamental frequency encoding of linguistic and emotional prosody by right hemisphere-damaged speakers. Brain and Language. 69:1999;161-192
50. Petersen S.E., Fox P.T., Posner M., Mintun M., Raichle M.E. Positron emission tomographic studies of the cortical anatomy of single-word processing. Nature. 331:1988;585-589
51. Petitto L.A., Zatorre R.J., Guana K., Nikelski E.J., Dostie D., Evans A.C. Speech-like cerebral activity in profoundly deaf people while processing signed languages: implications for the neural basis of all human language. Proceedings of the National Academy of Sciences. 97:2000;13961-13966
52. Poldrack R.A., Wagner A.D., Prull M.W., Desmond J.E., Glover G.H., Gabrieli J.D.E. Functional specialization for semantic and phonological processing in the left inferior prefrontal cortex. Neuroimage. 10:1999;15-35
53. Posner M.I., Raichle M.E. Images of Mind. 1994;Scientific American Library, New York. 257pp.
54. Price C., Wise R., Ramsay S., Friston K., Howard D., Patterson K., Frackowiak R. Regional response differences within the human auditory cortex when listening to words. Neuroscience Letters. 146:1992;179-182
55. Price C.J., Wise R., Frackowiak R. Demonstrating the implicit processing of visually presented words and pseudowords. Cerebral Cortex. 6:1996;62-70
56. Rademacher J., Galaburda A.M., Kennedy D.N., Filipek P.A., Caviness V.S. Human cerebral cortex: localization, parcellation and morphometry with magnetic resonance imaging. Journal of Cognitive Neuroscience. 4:1992;352-374
57. Reichle E.D., Carpenter P.A., Just M.A. The neural bases of strategy and skill in sentence-picture verification. Cognitive Psychology. 40:2000;261-295
58. Roeder B., Stock O., Neville H., Bien S., Roesler F. Brain activation modulated by the comprehension of normal and pseudo-word sentences of different processing demands: a functional magnetic resonance imaging study. NeuroImage. 15:2002;1003-1014
59. Ross E.D., Mesulam M.M. Dominant language functions of the right hemisphere?: prosody and emotional gesturing. Archives of Neurology. 36:1979;144-148
60. Ross E.D., Thompson R.D., Yenkowsky J. Lateralization of affective prosody in brain and the callosal integration of hemispheric language functions. Brain and Language. 56:1997;27-54
61. Santi A., Servos P., Vatikiotis-Bateson E., Kuratate T., Munhall K. Perceiving biological motion: dissociating visible speech from walking. Journal of Cognitive Neuroscience. 15:2003;800-809
62. Schlosser M.J., Aoyagi N., Fulbright R.K., Gore J.C., McCarthy G. Functional MRI studies of auditory comprehension. Human Brain Mapping. 1:1998;1-13
63. Scott S.K. Going beyond the information given: a neural system supporting semantic interpretation. NeuroImage. 19:2003;870-876
64. Soederfeldt B., Ingvar M., Roennberg J., Eriksson L. Signed and spoken language perception studied by positron emission tomography. Neurology. 49:1997;82-87
65. Stowe L.A., Paans A.M., Wijers A.A., Zwarts F., Mulder G., Vaalburg W. Sentence comprehension and word repetition: a positron emission tomography investigation. Psychophysiology. 36:1999;786-801
66. Stromswold K., Caplan D., Alpert N., Rauch S. Localization of syntactic comprehension by positron emission tomography. Brain and Language. 52:1996;452-473
67. Tucker D.M., Watson R.T., Heilman K.M. Discrimination and evocation of affectively intoned speech in patients with right parietal disease. Neurology. 27:1977;947-950
68. Turner R., Jezzard P., Wen K.K., Kwong D., LeBihan T., Zeffiro T., Balaban R.S. Functional mapping of the human visual cortex at 4 and 1.5 Tesla using deoxygeneration contrast EPI. Magnetic Resonance in Medicine. 29:1993;277-279
69. Vandenberghe R., Price C., Wise R., Josephs O., Frackowiak R. Functional anatomy of a common semantic system for words and pictures. Nature. 383:1996;254-256
70. Vandenberghe R., Nobre A.C., Price C.J. The response of left temporal cortex to sentences. Journal of Cognitive Neuroscience. 14:2002;550-560
71. Weintraub S., Mesulam M.M., Kramer L. Disturbances in prosody: a right hemisphere contribution to language. Archives of Neurology. 38:1981;742-744
72. Wernicke C. Der aphasische Symptomenkomplex. 1874;Cohn and Weigert, Breslau
73. Wise R., Chollet F., Hadar U., Friston K., Hoffner E., Frackowiak R. Distribution of cortical neural networks involved in word comprehension and word retrieval. Brain. 114:1991;1803-1817
74. Wise R.J.S., Scott S.K., Blank S.C., Mummery C.J., Murphy K., Warburton E.A. Separate neural sub-systems within "Wernicke's area" Brain. 124:2001;83-95
75. Zilles K., Armstrong E., Schleicher A., Kretschmann H.J. The human pattern of gyrification in the cerebral cortex. Anatomical Embryology. 179:1988;173-179