Neural correlates of interindividual differences in children's audiovisual speech perception

Journal of Neuroscience

Volumn 31, Issue 39, 2011, Pages 13963-13971

  Nath, Audrey R ^a   Fava, Eswen E ^a   Beauchamp, Michael S ^a  

^a UNIVERSITY OF TEXAS MEDICAL SCHOOL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; AUDITORY STIMULATION; BOLD SIGNAL; BRAIN FUNCTION; CHILD; CONTROLLED STUDY; EXTRASTRIATE BODY AREA; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUSIFORM FACE AREA; HEMODYNAMICS; HUMAN; HUMAN EXPERIMENT; MALE; NERVE CELL; NORMAL HUMAN; PRESCHOOL CHILD; PRIORITY JOURNAL; SCHOOL CHILD; SPEECH PERCEPTION; SUPERIOR TEMPORAL SULCUS; VISUAL STIMULATION;

ACOUSTIC STIMULATION; AGE FACTORS; AUDITORY PERCEPTION; BRAIN MAPPING; CHILD; FEMALE; HUMANS; INDIVIDUALITY; MALE; PHOTIC STIMULATION; SPEECH PERCEPTION; TEMPORAL LOBE; VISUAL CORTEX; VISUAL PERCEPTION;

EID: 80053262894     PISSN: 02706474     EISSN: 15292401     Source Type: Journal    
DOI: 10.1523/JNEUROSCI.2605-11.2011     Document Type: Article

References (94)

1. Argall BD, Saad ZS, Beauchamp MS (2006) Simplified intersubject averaging on the cortical surface using SUMA. Hum Brain Mapp 27:14-27.
2. Bahrick LE, Hernandez-Reif M, Flom R (2005) The development of infant learning about specific face-voice relations. Dev Psychol 41:541-552.
3. Beauchamp MS (2005) Statistical criteria in FMRI studies of multisensory integration. Neuroinformatics 3:93-113.
4. Beauchamp MS, Lee KE, Argall BD, MartinA (2004) Integration of auditory and visual information about objects in superior temporal sulcus. Neuron 41:809-823.
5. Beauchamp MS, Yasar NE, Frye RE, Ro T (2008) Touch, sound and vision in human superior temporal sulcus. Neuroimage 41:1011-1020.
6. Beauchamp MS, Nath AR, Pasalar S (2010) fMRI-guided transcranial magnetic stimulation reveals that the superior temporal sulcus is a cortical locus of the McGurk effect. J Neurosci 30:2414-2417.
7. Belin P, Zatorre RJ, Ahad P (2002) Human temporal-lobe response to vocal sounds. Brain Res Cogn Brain Res 13:17-26.
8. Benoit MM, Raij T, Lin FH, Jääskeläinen IP, Stufflebeam S (2010) Primary and multisensory cortical activity is correlated with audiovisual percepts. Hum Brain Mapp 31:526-538.
9. Bernstein LE, Auer ET Jr, Tucker PE (2001) Enhanced speechreading in deaf adults: can short-term training/practice close the gap for hearing adults? J Speech Lang Hear Res 44:5-18.
10. Blumsack JT, Bower CR, Ross ME (2007) Comparison of speechreading training regimens. Percept Mot Skills 105:988-996.
11. Booth JR, Burman DD, Meyer JR, Gitelman DR, Parrish TB, Mesulam MM (2004) Development of brain mechanisms for processing orthographic and phonologic representations. J Cogn Neurosci 16:1234-1249.
12. Brown TT, Lugar HM, Coalson RS, Miezin FM, Petersen SE, Schlaggar BL (2005) Developmental changes in human cerebral functional organization for word generation. Cereb Cortex 15:275-290.
13. Brown TT, Petersen SE, Schlaggar BL (2006) Does human functional brain organization shift from diffuse to fodal with development? Dev Sci 9:9-11.
14. Burnham D, Dodd B (2004) Auditory-visual speech integration by prelinguistic infants: perception of an emergent consonant in the McGurk effect. Dev Psychobiol 45:204-220.
15. Buxton RB, Wong EC, Frank LR (1998) Dynamics of blood flow and oxygenation changes during brain activation: the balloon model. Magn Reson Med 39:855-864.
16. Callan DE, Jones JA, Munhall K, Kroos C, Callan AM, Vatikiotis-Bateson E (2004) Multisensory integration sites identified by perception of spatial wavelet filtered visual speech gesture information. J Cogn Neurosci 16:805-816.
17. Calvert GA, Campbell R (2003) Reading speech from still and moving faces: the neural substrates of visible speech. J Cogn Neurosci 15:57-70.
18. Calvert GA, Campbell R, Brammer MJ (2000) Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr Biol 10:649-657.
19. Cao F, Khalid K, Lee R, Brennan C, Yang Y, Li K, Bolger DJ, Booth JR (2010) Development of brain networks involved in spoken work processing of Mandarin Chinese. Neuroimage 57:750-759.
20. Colin C, Radeau M, Deltenre P (2005) Top-down and bottom-up modulation of audiovisual integration in speech. Eur J Cogn Psychol 17:541-560.
21. Cone NE, Burman DD, Bitan T, Bolger DJ, Booth JR (2008) Developmental changes in brain regions involved in phonological and orthographic processing during spoken language processing. Neuroimage 41:623-635.
22. Cox RW (1996) AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput Biomed Res 29:162-173.
23. Dale AM, Fischl B, Sereno MI (1999) Cortical surface-based analysis. I. Segmentation and surface reconstruction. Neuroimage 9:179-194.
24. Devlin JT, Jamison HL, Gonnerman LM, Matthews PM (2006) The role of the posterior fusiform gyrus in reading. J Cogn Neurosci 18:911-922.
25. Dick AS, Solodkin A, Small SL (2010) Neural development of networks for audiovisual speech comprehension. Brain Lang 114:101-114.
26. Dodd B (1979) Lip reading in infants: attention to speech presented in-and out-of-synchrony. Cogn Psychol 11:478-484.
27. Dumoulin SO, Bittar RG, Kabani NJ, Baker CL Jr, Le Goualher G, Bruce Pike G, Evans AC (2000) A new anatomical landmark for reliable identification of human area V5/MT: a quantitative analysis of sulcal patterning. Cereb Cortex 10:454-463.
28. Dupont S, Aubin J, Menard L (2005) A study of the McGurk effect in 4 and 5-year-old French Canadian children. ZAS Papers Linguistics 40:1-17.
29. Fischl B, Sereno MI, Dale AM (1999) Cortical surface-based analysis. II: Inflation, flattening, and a surface-based coordinate system. Neuroimage 9:195-207.
30. Fonov V, Evans AC, Botteron K, Almli CR, McKinstry RC, Collins DL (2011) Unbiased average age-appropriate atlases for pediatric studies. Neuroimage 54:313-327.
31. Friston KJ, Rotshtein P, Geng JJ, Sterzer P, Henson RN (2006) A critique of functional localisers. Neuroimage 30:1077-1087.
32. Gagne ́ JP, Dinon D, Parsons J (1991) An evaluation of CAST: a Computer-Aided Speechreading Training program. J Speech Hear Res 34:213-221.
33. Genovese CR, Lazar NA, Nichols T (2002) Thresholding of statistical maps in functional neuroimaging using the false discovery rate. Neuroimage 15:870-878.
34. Gentilucci M, Cattaneo L (2005) Automatic audiovisual integration in speech perception. Exp Brain Res 167:66-75.
35. Gibson EJ, Pick A (2000) An ecological approach to perceptual learning and development. New York: Oxford UP.
36. Harris JJ, Reynell C, Attwell D (2011) The physiology of developmental changes in BOLD functional imaging signals. Dev Cogn Neurosci 1:199-216.
37. Hockley NS, Polka L (1994) A developmental study of audiovisual speech perception using the McGurk paradigm. J Acoust Soc Am 96:3309.
38. Hoeft F, McCandliss BD, Black JM, Gantman A, Zakerani N, Hulme C, Lyytinen H, Whitfield-Gabrieli S, Glover GH, Reiss AL, Gabrieli JD (2011) Neural systems predicting long-term outcome in dyslexia. Proc Natl Acad Sci U S A 108:361-366.
39. Horwitz B (2003) The elusive concept of brain connectivity. Neuroimage 19:466-470.
40. Ishai A, Schmidt CF, Boesiger P (2005) Face perception is mediated by a distributed cortical network. Brain Res Bull 67:87-93.
41. Kanwisher N, Yovel G (2006) The fusiform face area: a cortical region specialized for the perception of faces. Philos Trans R Soc Lond B Biol Sci 361:2109-2128.
42. Kessler H, Doyen-Waldecker C, Hofer C, Hoffmann H, Traue HC, Abler B (2011) Neural correlates of the perception of dynamic versus static facial expressions of emotion. Psychosoc Med 8:Doc03.
43. Kriegeskorte N, Simmons WK, Bellgowan PS, Baker CI (2009) Circular analysis in systems neuroscience: the dangers of double dipping. Nat Neurosci 12:535-540.
44. Kuhl PK, Meltzoff AN (1982) The bimodal perception of speech in infancy. Science 218:1138-1141.
45. Leroy F, Glasel H, Dubois J, Hertz-Pannier L, Thirion B, Mangin JF, Dehaene-Lambertz G (2011) Early maturation of the linguistic dorsay pathway in human infants. J Neurosci 31:1500-1506.
46. Lewkowicz DJ (2000) The Development of intersensory temporal perception: an epigenetic systems/limitations view. Psychological Bulletin 126:281-308.
47. Lidzba K, Schwilling E, Grodd W, Krageloh-Mann I, Wilke M (2011) Language comprehension vs. language production: age effects on fMRI activation. Brain Lang. Advance online publication. Retrieved August 18, 2001. doi:10.1016/j.bandl.2011.02.003.
48. MacDonald J, Andersen S, Bachmann T (2000) Hearing by eye: how much spatial degradation can be tolerated? Perception 29:1155-1168.
49. MacSweeney M, Woll B, Campbell R, McGuire PK, David AS, Williams SC, Suckling J, Calvert GA, Brammer MJ (2002) Neural systems underlying British Sign Language and audio-visual English processing in native users. Brain 125:1583-1593.
50. Massaro DW, Thompson LA, Barron B, Laren E (1986) Developmental changes in visual and auditory contributions to speech perception. J Exp Child Psychol 41:91-113.
51. McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264:746-748.
52. McIntosh AR, Gonzalez-Lima F (1994) Structural equation modeling and its application to network analysis in functional brain imaging. Hum Brain Mapp 2:2-22.
53. Mehler J, Bertoncini J, Barriere M (1978) Infant recognition of mother's voice. Perception 7:491-497.
54. Mehler J, Jusczyk P, Lambertz G, Halsted N, Bertoncini J, Amiel-Tison C (1988) A precursor of language acquisition in young infants. Cognition 29:143-178.
55. Miller LM, D'Esposito M (2005) Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J Neurosci 25:5884-5893.
56. Moon C, Panneton-Cooper R, Fifer WP (1993) Two-day olds prefer their native language. Infant Behav Dev 16:495-500.
57. Nath AR, Beauchamp MS (2011) Dynamic changes in superior temporal sulcus connectivity during perception of noisy audiovisual speech. J Neurosci 31:1704-1714.
58. Nath AR, Beauchamp MS (2011) A neural basis for interindividual differences in the McGurk effect, a multisensory speech illusion. Neuroimage. Advance online publication. Retrieved August 18, 2011. doi:10.1016/j.neuroimage.2011.07.024.
59. Nazzi T, Bertoncini J, Mehler J (1998) Language discrimination by newborns: toward an understanding of the role of rhythm. J Exp PsycholHum Percept Perform 24:756-766.
60. Oldfield RC (1971) The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9:97-113.
61. Olson IR, Gatenby JC, Gore JC (2002) A comparison of bound and unbound audio-visual information processing in human cerebral cortex. Cogn Brain Res 14:129-138.
62. Patterson ML, Werker JF (1999) Matching phonetic information in lips and voice is robust in 4.5-month-old infants. Infant Behav Dev 22:237-247.
63. Patterson RD, Johnsrude IS (2008) Functional imaging of the auditory processing applied to speech sounds. Philos Trans R Soc Lond B Biol Sci 363:1023-1035.
64. Poeppel D, Wharton C, Fritz J, Guillemin A, San Jose L, Thompson J, Bavelier D, Braun AR (2004) FMsweeps, syllables and word stimuli differentially modulate left and right non-primary auditory areas. Neuropsychologia 42:183-200.
65. Ramus F, Hauser MD, Miller C, Morris D, Mehler J (2000) Language discrimination by human newborns and by cotton-top tamarin monkeys. Science 288:349-351.
66. Richter W, Richter M (2003) The shape of the fMRI BOLD response in children and adults changes systematically with age. Neuroimage 20:1122-1131.
67. Rochat P (1999) Early social cognition: understanding others in the first months of life. Mahwah, NJ: Erlbaum.
68. Rosenblum LD, Schmuckler MA, Johnson JA (1997) The McGurk effect in infants. Percept Psychophys 59:347-357.
69. Ruytjens L, Albers F, van Dijk P, Wit H, Willemsen A (2006) Neural responses to silent lipreading in normal hearing male and female subjects. Eur J Neurosci 24:1835-1844.
70. Saad ZS, Glen DR, Chen G, Beauchamp MS, Desai R, Cox RW (2009) A new method for improving functional-to-structural MRI alignment using local Pearson correlation. Neuroimage 44:839-848.
71. Sabatinelli D, Fortune EE, Li Q, Siddiqui A, Krafft C, Oliver WT, Beck S, Jeffries J (2011) Emotional perception: meta-analyses of face and natural scene processing. Neuroimage 54:2524-2533.
72. Saxe R, Brett M, Kanwisher N (2006) Divide and conquer: a defense of functional localizers. Neuroimage 30:1088-1096.
73. Schlaggar BL, McCandliss BD (2007) Development of neural systems for reading. Annu Rev Neurosci 30:475-503.
74. Schlaggar BL, Brown TT, Lugar HM, Visscher KM, Miezin FM, Petersen SE (2002) Functional neuroanatomical differences between adults and school-age children in the processing of single words. Science 296:1476-1479.
75. Schorr EA, Fox NA, van Wassenhove V, Knudsen EI (2005) Audio-visual fusion in speech perception in children with cochlear implants. Proc Natl Acad Sci U S A 102:18748-18750.
76. Schroeter ML, Kupka T, Mildner T, Uludaǧ K, von Cramon DY (2006) Investigating the post-stimulus undershoot of the BOLD signal-a simultaneous fMRI and fNIRS study. Neuroimage 30:349-358.
77. Schwartz JL (2010) A reanalysis of McGurk data suggests that audiovisual fusion in speech perception is subject-dependent. J Acoust Soc Am 127:1584-1594.
78. Sekiyama K, Burnham D (2008) Impact of language on development of auditory-visual speech perception. Dev Sci 11:306-320.
79. Sekiyama K, Kanno I, Miura S, Sugita Y (2003) Auditory-visual speech perception examined by fMRI and PET. Neurosci Res 47:277-287.
80. Shaywitz BA, Shaywitz SE, Pugh KR, Mencl WE, Fulbright RK, Skudlarski P, Constable RT, Marchione KE, Fletcher JM, Lyon GR, Gore JC (2002) Disruption of posterior brain systems for reading in children with developmental dyslexia. Biol Psychiatry 52:101-110.
81. Stevenson RA, James TW (2009) Audiovisual integration in human superior temporal sulcus: inverse effectiveness and the neural processing of speech and object recognition. Neuroimage 44:1210-1223.
82. Tremblay C, Champoux F, Voss P, Bacon BA, Lepore F, Théoret H (2007) Speech and non-speech audio-visual illusions: a developmental study. PLoS ONE 2:e742.
83. Turkeltaub PE, Gareau L, Flowers DL, Zeffiro TA, Eden GF (2003) Development of neural mechanisms for reading. Nat Neurosci 6:767-773.
84. Turkeltaub PE, Flowers DL, Verbalis A, Miranda M, Gareau L, Eden GF (2004) The neural basis of hyperlexic reading: an fMRI case study. Neuron 41:11-25.
85. Upadhyay J, Silver A, Knaus TA, Lindgren KA, Ducros M, Kim DS, Tager-Flusberg H (2008) Effective and structural connectivity in the human auditory cortex. J Neurosci 28:3341-3349.
86. van Atteveldt N, Formisano E, Goebel R, Blomert L (2004) Integration of letters and speech sounds in the human brain. Neuron 43:271-282.
87. van Linden S, Vroomen J (2008) Audiovisual speech recalibration in children. J Child Lang 35:809-822.
88. Vul E, Harris C, Winkielman P, Pashler H (2009) Puzzlingly high correlations in fMRI studies of emotion, personality and social cognition. Perspect Psychol Sci 4:274-290.
89. Wallace MT, Carriere BN, Perrault TJ Jr, Vaughan JW, Stein BE (2006) The development of cortical multisensory integration. J Neurosci 26:11844-11849.
90. Weikum WM, Vouloumanos A, Navarra J, Soto-Faraco S, Sebastián-Gallés N, Werker JF (2007) Visual language discrimination in infancy. Science 316:1159.
91. Wilson M (1988) The MRC psycholinguistic database: machine readable dictionary, version 2. Behav Res Methods Instruments Comput 20:6-11.
92. Wright TM, Pelphrey KA, Allison T, McKeown MJ, McCarthy G (2003) Polysensory interactions along lateral temporal regions evoked by audiovisual speech. Cereb Cortex 13:1034-1043.
93. Yoon U, Fonov VS, Perusse D, Evans AC (2009) The effect of template choice on morphometric analysis of pediatric brain data. Neuroimage 45:769-777.
94. Zielinski BA, Gennatas ED, Zhou J, Seeley WW (2010) Network-level structural covariance in the developing brain. Proc Natl Acad Sci U S A 107: 18191-18196.