Multimodal lexical processing in auditory cortex is literacy skill dependent

Cerebral Cortex

Volumn 24, Issue 9, 2014, Pages 2464-2475

  McNorgan, Chris ^a   Awati, Neha ^a   Desroches, Amy S ^a   Booth, James R ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Audiovisual integration; Cross modal; Development; fMRI; Reading

Indexed keywords

ADOLESCENT; ARTICLE; AUDITORY CORTEX; AUDITORY STIMULATION; BRAIN REGION; CHILD; DECISION MAKING; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; LANGUAGE DEVELOPMENT; LANGUAGE PROCESSING; MALE; NORMAL HUMAN; PHONETICS; PRIORITY JOURNAL; SKILL; STIMULUS RESPONSE; VISUAL STIMULATION; GROWTH, DEVELOPMENT AND AGING; NEUROPSYCHOLOGICAL TEST; NUCLEAR MAGNETIC RESONANCE IMAGING; PATTERN RECOGNITION; PHYSIOLOGY; READING; SPEECH; SPEECH PERCEPTION;

ADOLESCENT; AUDITORY CORTEX; CHILD; FEMALE; HUMANS; JUDGMENT; LANGUAGE DEVELOPMENT; MAGNETIC RESONANCE IMAGING; MALE; NEUROPSYCHOLOGICAL TESTS; PATTERN RECOGNITION, VISUAL; PHONETICS; READING; SPEECH ACOUSTICS; SPEECH PERCEPTION;

EID: 84906990799     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bht100     Document Type: Article

References (53)

1. Baddeley A. 2012. Working memory: theories, models, and controversies. Annu Rev Psychol. 63:1-29.
2. Beauchamp MS, Lee KE, Argall BD, Martin A. 2004. Integration of auditory and visual information about objects in superior temporal sulcus. Neuron. 41:809-823. (Pubitemid 38326842)
3. Beauchamp MS, Nath AR, Pasalar S. 2010. fMRI-Guided transcranial magnetic stimulation reveals that the superior temporal sulcus is a cortical locus of the McGurk effect. J Neurosci. 30:2414-2417.
4. Bitan T, Burman DD, Chou TL, Lu D, Cone NE, Cao F, Bigio JD, Booth JR. 2007. The interaction between orthographic and phonological information in children: an fMRI study. Hum Brain Mapp. 28:880-891. (Pubitemid 47581345)
5. Blau V, van Atteveldt N, Ekkebus M, Goebel R, Blomert L. 2009. Reduced neural integration of letters and speech sounds links phonological and reading deficits in adult dyslexia. Curr Biol. 19:503-508.
6. Booth JR, Burman DD, Meyer JR, Gitelman DR, Parrish TB, Mesulam MM. 2004. Development of brain mechanisms for processing orthographic and phonologic representations. J Cogn Neurosci. 16:1234-1249. (Pubitemid 39274450)
7. Booth JR, Burman DD, Meyer JR, Gitelman DR, Parrish TB, Mesulam MM. 2002. Functional anatomy of intra- and cross-modal lexical tasks. Neuroimage. 16:7-22. (Pubitemid 34852468)
8. Buchsbaum BR, D'Esposito M. 2008. The search for the phonological store: from loop to convolution. J Cogn Neurosci. 20:762-778. (Pubitemid 351657334)
9. Buchsbaum BR, Olsen RK, Koch PF, Kohn P, Kippenhan JS, Berman KF. 2005. Reading, hearing, and the planum temporale. Neuroimage. 24:444-454. (Pubitemid 41359040)
10. Burgund ED, Kang HC, Kelly JE, Buckner RL, Snyder AZ, Petersen SE, Schlaggar BL. 2002. The feasibility of a common stereotactic space for children and adults in fMRI studies of development. Neuroimage. 17:184-200.
11. Calvert GA. 1997. Activation of auditory cortex during silent lipreading. Science. 276:593-596. (Pubitemid 27193683)
12. Calvert GA. 2001. Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex. 11:1110-1123. (Pubitemid 33108238)
13. Dehaene-Lambertz G, Dehaene S, Hertz-Pannier L. 2002. Functional neuroimaging of speech perception in infants. Science. 298:2013-2015. (Pubitemid 35425261)
14. Frith U. 1985. Beneath the surface of developmental dyslexia. In: Patterson K, Marshall J, Coltheart M, editors. Surface dyslexia, neuropsychological and cognitive studies of phonological reading. London: Erlbaum. p. 301-330.
15. Froyen D, Bonte M, van Atteveldt N, Blomert L. 2008. The long road to automation: neurocognitive development of letter-speech sound processing. J Cogn Neurosci. 21:567-580.
16. Froyen D, Van Atteveldt N, Bonte M, Blomert L. 2008. Cross-modal enhancement of the MMN to speech-sounds indicates early and automatic integration of letters and speech-sounds. Neurosci Lett. 430:23-28.
17. Golfinopoulos E, Tourville JA, Guenther FH. 2010. The integration of large-scale neural network modeling and functional brain imaging in speech motor control. Neuroimage. 52:862-874.
18. Goswami U, Ziegler JC, Dalton L, Schneider W. 2003. Nonword reading across orthographies: how flexible is the choice of reading units? Appl Psychol. 24:235-247. (Pubitemid 36891785)
19. Harm MW, Seidenberg MS. 1999. Phonology, reading acquisition, and dyslexia: insights from connectionist models. Psychol Rev. 106:491-528.
20. Hein G, Doehrmann O, Muller NG, Kaiser J, Muckli L, Naumer MJ. 2007. Object familiarity and semantic congruency modulate responses in cortical audiovisual integration areas. J Neurosci. 27:7881-7887. (Pubitemid 47173312)
21. Hein G, Knight RT. 2008. Superior temporal sulcus - it's my area: or is it? J Cogn Neurosci. 20:2125-2136.
22. Hickok G. 2012. The cortical organization of speech processing: feedback control and predictive coding the context of a dual-stream model. J Commun Disord. 45:393-402.
23. Hickok G. 2009. The functional neuroanatomy of language. Phys Life Rev. 6:121-143.
24. Hickok G, Okada K, Serences JT. 2009. Area Spt in the human planum temporale supports sensory-motor integration for speech processing. J Neurophysiol. 101:2725-2732.
25. Hickok G, Saberi K. 2012. Redefining the functional organization of the planum temporale region: space, objects, and sensory-motor integration. In: Poeppel D, Overath T, Popper AN, Fay RR, editors. The human auditory cortex. New York (NY): Springer. p. 333-350.
26. Kang HC, Burgund ED, Lugar HM, Petersen SE, Schlaggar BL. 2003. Comparison of functional activation foci in children and adults using a common stereotactic space. Neuroimage. 19:16-28. (Pubitemid 36627377)
27. Kayser C, Petkov CI, Augath M, Logothetis NK. 2007. Functional imaging reveals visual modulation of specific fields in auditory cortex. J Neurosci. 27:1824-1835.
28. Kayser C, Petkov CI, Logothetis NK. 2008. Visual modulation of neurons in auditory cortex. Cereb Cortex. 18:1560-1574. (Pubitemid 351882035)
29. Koelewijn T, Bronkhorst A, Theeuwes J. 2010. Attention and the multiple stages of multisensory integration: a review of audiovisual studies. Acta Psychol (Amst). 134:372.
30. Kuhl PK. 2004. Early language acquisition: cracking the speech code. Nat Rev Neurosci. 5:831-843. (Pubitemid 39482152)
31. Lancaster JL, Woldorff MG, Parsons LM, Liotti M, Freitas CS, Rainey L, Kochunov PV, Nickerson D, Mikiten SA, Fox PT. 2000. Automated Talairach Atlas labels for functional brain mapping. Hum Brain Mapp. 10:120-131. (Pubitemid 30456920)
32. Liberman AM, Mattingly IG. 1985. The motor theory of speech perception revised. Cognition. 21:1-36.
33. McClelland JL, Elman JL. 1986. The TRACE model of speech perception. Cognit Psychol. 18:1-86.
34. McGurk H, Macdonald J. 1976. Hearing lips and seeing voices. Nature. 264:746-748.
35. McNorgan C, Alvarez A, Bhullar A, Gayda J, Booth JR. 2011. Prediction of reading skill several years later depends on age and brain region: implications for developmental models of reading. J Neurosci. 31:9641-9648.
36. Miller LM, D'Esposito M. 2005. Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J Neurosci. 25:5884-5893. (Pubitemid 40911419)
37. Nath AR, Beauchamp MS. 2012. A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion. Neuroimage. 59:781-787.
38. Nath AR, Fava EE, Beauchamp MS. 2011. Neural correlates of interindividual differences in children's audiovisual speech perception. J Neurosci. 31:13963-13971.
39. Okada K, Smith KR, Humphries C, Hickok G. 2003. Word length modulates neural activity in auditory cortex during covert object naming. Neuroreport. 14:2323-2326.
40. Rauschecker JP. 2011. An expanded role for the dorsal auditory pathway in sensorimotor control and integration. Hear Res. 271:16-25.
41. Ross LA, Molholm S, Blanco D, Gomez-Ramirez M, Saint-Amour D, Foxe JJ. 2011. The development of multisensory speech perception continues into the late childhood years. Eur J Neurosci. 33:2329-2337.
42. Schlaggar BL, McCandliss BD. 2007. Development of neural systems for reading. Annu Rev Neurosci. 30:475-503. (Pubitemid 47218765)
43. Shaywitz SE, Shaywitz BA, Fletcher JM, Escobar MD. 1990. Prevalence of reading disability in boys and girls: results of the connecticut longitudinal study. JAMA. 264:998-1002. (Pubitemid 20260912)
44. Stevenson RA, James TW. 2009. Audiovisual integration in human superior temporal sulcus: inverse effectiveness and the neural processing of speech and object recognition. Neuroimage. 44:1210-1223.
45. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, Mazoyer B, Joliot M. 2002. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage. 15:273-289. (Pubitemid 34852226)
46. van Atteveldt N, Formisano E, Blomert L, Goebel R. 2007. The effect of temporal asynchrony on the multisensory integration of letters and speech sounds. Cereb Cortex. 17:962-974. (Pubitemid 46434637)
47. van Atteveldt N, Formisano E, Goebel R, Blomert L. 2004. Integration of letters and speech sounds in the human brain. Neuron. 43:271-282. (Pubitemid 38942966)
48. van Atteveldt N, Roebroeck A, Goebel R. 2009. Interaction of speech and script in human auditory cortex: insights from neuro-imaging and effective connectivity. Hear Res. 258:152-164.
49. van Atteveldt NM, Formisano E, Goebel R, Blomert L. 2007. Top-down task effects overrule automatic multisensory responses to letter-sound pairs in auditory association cortex. Neuroimage. 36:1345-1360. (Pubitemid 47001726)
50. Wechsler D. 1999. Wechsler abbreviated scale of intelligence. San Antonio (TX): The Psychological Corporation.
51. Woodcock RW, McGrew KS, Mather N. 2001. Woodcock-Johnson III Tests of Cognitive Abilities. Itasca, IL: Riverside Publishing.
52. Zeno S. 1995. The educator's word frequency guide. Brewster (NY): Touchstone Applied Science Associates.
53. Ziegler JC, Goswami U. 2005. Reading acquisition, developmental dyslexia, and skilled reading across languages: a psycholinguistic grain size theory. Psychol Bull. 131:3-29. (Pubitemid 40130968)