Brain responses and looking behavior during audiovisual speech integration in infants predict auditory speech comprehension in the second year of life

Frontiers in Psychology

Volumn 4, Issue JUL, 2013, Pages

  Kushnerenko, Elena ^a   Tomalski, Przemyslaw ^a,b   Ballieux, Haiko ^a   Potton, Anita ^a   Birtles, Deidre ^a   Frostick, Caroline ^a   Moore, Derek G ^a  

^a UNIVERSITY OF EAST LONDON   (United Kingdom)

^b UNIVERSITY OF WARSAW   (Poland)

Author keywords

Audiovisual speech integration; ERPs; Eye tracking; Infants' brain responses; Language development; Mismatch

Indexed keywords

EID: 84885369113     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2013.00432     Document Type: Article

References (39)

1. Bristow, D., Dehaene-Lambertz, G., Mattout, J., Soares, C., Gliga, T., Baillet, S., et al. (2009). Hearing faces: how the infant brain matches the face it sees with the speech it hears. J. Cogn. Neurosci. 21, 905-921. doi: 10.1162/jocn.2009.21076
2. Burnham, D., and Dodd, B. (2004). Auditory-visual speech integration by prelinguistic infants: perception of an emergent consonant in the McGurk effect. Dev. Psychobiol. 45, 204-220. doi: 10.1002/dev.20032
3. Campbell, R. C.-P. (2008). The processing of audio-visual speech: empirical and neural bases. Philos. Trans. R. Soc. Lond. B Biol. Sci. 363, 1001-1010. doi: 10.1098/rstb.2007.2155
4. Dehaene-Lambertz, G., and Dehaene, S. (1994). Speed and cerebral correlates of syllable discrimination in infants. Nature 28, 293-294. doi: 10.1038/370292a0
5. Desjardins, R. N., and Werker, J. F. (2004). Is the integration of heard and seen speech mandatory for infants? Dev. Psychobiol. 45, 187-203. doi: 10.1002/dev.20033
6. Friederici, A. D., Friedrich, M., and Christophe, A. (2007). Brain responses in 4-month-old infants are already language specific. Curr. Biol. 17, 1208-1211. doi: 10.1016/j.cub.2007.06.011
7. Gliga, T., and Csibra, G. (2009). One-year-old infants appreciate the referential nature of deictic gestures and words. Psychol. Sci. 20, 347-353. doi: 10.1111/j.1467-9280.2009.02295.x
8. Guiraud, J. A., Kushnerenko, E., Tomalski, P., Davies, K., Ribeiro, H., Johnson, M. H., et al. (2011). Differential habituation to repeated sounds in infants at high risk for autism. Neuroreport 22, 845-849. doi: 10.1097/WNR.0b013e32834c0bec
9. Guiraud, J. A., Tomalski, P., Kushnerenko, E., Ribeiro, H., Davies, K., Charman, T., et al. (2012). Atypical audiovisual speech integration in infants at risk for autism. PLoS ONE 7:e36428.doi: 10.1371/journal.pone.0036428
10. Hamilton, A., Plunkett, K., and Schafer, G. (2000). Infant vocabulary development assessed with a british communicative development inventory: lower scores in the UK than the USA. J. Child Lang. 27, 689-705.
11. Houston-Price, C., Plunkett, K., and Duffy, H. (2006). The use of social and salience cues in early word learning. J. Exp. Child Psychol. 95, 27-55. doi: 10.1016/j.jecp.2006.03.006
12. Howard, I. S., and Messum, P. (2011). Modeling the development of pronunciation in infant speech acquisition learning to pronounce. Motor Control 1, 85-117.
13. Kuhl, P. K., and Meltzoff, A. N. (1982). The bimodal perception of speech in infancy. Science 218, 1138-1141. doi: 10.1126/science.7146899
14. Kushnerenko, E., Ceponiené, R., Balan, P., Fellman, V., Näätänen, R., and Huotilainen, M. (2002). Maturation of the auditory change-detection response in infants: a longitudinal ERP study. Neuroreport 13, 1843-1848.
15. Kushnerenko, E., Teinonen, T., Volein, A., and Csibra, G. (2008). Electrophysiological evidence of illusory audiovisual speech percept in human infants. Proc. Natl. Acad. Sci. U.S.A. 105, 11442-11445. doi: 10.1073/pnas.0804275105
16. Kushnerenko, E., Tomalski, P., Ballieux, H., Ribeiro, H., Potton, A., Axelsson, E. L., et al. (2010). Audiovisual speech integration: visual attention to articulation affects brain responses in 6-9 month old infants. Paper presented at EPS/SEPEX, 15-17 April 2010, Granada, Spain. doi: 10.1016/j.wocn.2009.04.002
17. Kushnerenko, E., Tomalski, P., Ballieux, H., Ribeiro, H., Potton, A., Axelsson, E. L., et al. (2013). Brain responses to audiovisual speech mismatch in infants are associated with individual differences in looking behaviour. Eur. J. Neurosci. doi: 10.1111/ejn.12317
18. Kushnerenko, E., Winkler, I., Horváth, J., Näätänen, R., Pavlov, I., Fellman, V., et al. (2007). Processing acoustic change and novelty in newborn infants. Eur. J. Neurosci. 26, 265-274. doi: 10.1111/j.1460-9568.2007.05628.x
19. Lewkowicz, D. J., and Hansen-Tift, A. M. C.-P. (2012). Infants deploy selective attention to the mouth of a talking face when learning speech. Proc. Natl. Acad. Sci. U.S.A. 109, 1431-1436. doi: 10.1073/pnas.1114783109
20. Massaro, D. W. (1984). Children's perception of visual and auditory speech. Child Dev. 55, 1777-1788. doi: 10.2307/1129925
21. McGurk, H., and MacDonald, J. (1976). Hearing lips and seing voices. Nature 264, 746-748. doi: 10.1038/264746a0
22. Megnin, O., Flitton, A., Jones, C. R. G., De Haan, M., Baldeweg, T., and Charman, T. (2012). Audiovisual speech integration in autism spectrum disorders: ERP evidence for atypicalities in lexical-semantic processing. Autism Res. 5, 39-48. doi: 10.1002/aur.231
23. Nardini, M., Bedford, R., and Mareschal, D. (2010). Fusion of visual cues is not mandatory in children. Proc. Natl. Acad. Sci. U.S.A. 107, 17041-17046. doi: 10.1073/pnas.1001699107
24. Norrix, L. W., Plante, E., and Vance, R. (2006). Auditory-visual speech integration by adults with and without language-learning disabilities. J. Commun. Disord. 39, 22-36. doi: 10.1016/j.jcomdis.2005.05.003
25. Norrix, L. W., Plante, E., Vance, R., and Boliek, C. A. (2007). Auditory-visual integration for speech by children with and without specific language impairment. J. Speech Lang. Hear. Res. 50, 1639-1651. doi: 10.1044/1092-4388(2007/111)
26. Patterson, M. L., and Werker, J. F. (2003). Two-month-old infants match phonetic information in lips and voice. Dev. Sci. 6, 191-196. doi: 10.1111/1467-7687.00271
27. Pons, F., Andreu, L., Sanz-Torrent, M., Buil-Legaz, L., and Lewkowicz, D. J. (2013). Perception of audio-visual speech synchrony in Spanish-speaking children with and without specific language impairment. J. Child Lang. 40, 687-700. doi: 10.1017/S0305000912000189
28. Raizada, R. D. S., Richards, T. L., Meltzoff, A., and Kuhl, P. K. (2008). Socioeconomic status predicts hemispheric specialisation of the left inferior frontal gyrus in young children. Neuroimage 40, 1392-1401. doi: 10.1016/j.neuroimage.2008.01.021
29. Rosenblum, L. D., Schmuckler, M. A., and Johnson, J. A. (1997). The McGurk effect in infants. Percept. Psychophys. 59, 347-357. doi: 10.3758/BF03211902
30. Schietecatte, I., Roeyers, H., and Warreyn, P. (2012). Can infants' orientation to social stimuli predict later joint attention skills? Br. J. Dev. Psychol. 30, 267-282. doi: 10.1111/j.2044-835X.2011.02039.x
31. Stevens, C., Lauinger, B., and Neville, H. (2009). Differences in the neural mechanisms of selective attention in children from different socioeconomic backgrounds: an event-related brain potential study. Dev. Sci. 12, 634-646. doi: 10.1111/j.1467-7687.2009.00807.x
32. Sumby, W. H., and Pollack, I. (1954). Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 26, 212-215. doi: 10.1121/1.1907309
33. Tomalski, P., Moore, D. G., Ribeiro, H., Axelsson, E. L., Murphy, E. l., Karmiloff-Smith, A., et al. (2013). Socio-economic status and functional brain development -associations in early infancy. Dev. Sci. doi: 10.1111/desc.12079
34. Tomalski, P., Ribeiro, H., Ballieux, H., Axelsson, E. L., Murphy, E., Moore, D. G., et al. (2012). Exploring early developmental changes in face scanning patterns during the perception of audiovisual mismatch of speech cues. Eur. J. Dev. Psychol. 1-14. doi: 10.1080/17405629.2012.728076
35. Tsao, F.-M., Liu, H.-M., and Kuhl, P. K. (2004). Speech perception in infancy predicts language development in the second year of life: a longitudinal study. Child Dev. 75, 1067-1084. doi: 10.1111/j.1467-8624.2004.00726.x
36. Tucker, D. M. (1993). Spatial sampling of head electrical fields: the geodesic sensor net. Electroencephalogr. Clin. Neurophysiol. 87, 154-163.
37. Wagner, J. B., Luyster, R. J., Yim, J. Y., Tager-Flusberg, H., and Nelson, C. A. (2013). The role of early visual attention in social development. Int. J. Behav. Dev. 37, 118-124. doi: 10.1177/0165025412486064
38. Young, G. S., Merin, N., Rogers, S. J., and Ozonoff, S. (2009). Gaze behavior and affect at 6 months: predicting clinical outcomes and language development in typically developing infants and infants at risk for autism. Dev. Sci. 12, 798-814. doi: 10.1111/j.1467-7687.2009.00833.x
39. Zimmerman, I., Steiner, V., and Pond, R. (2002). Preschool Language Scale, 4th Edn. San Antonio: The Psychological Corporation.