Phonetic matching of auditory and visual speech develops during childhood: Evidence from sine-wave speech

Journal of Experimental Child Psychology

Volumn 129, Issue , 2015, Pages 157-164

  Baart, Martijn ^a   Bortfeld, Heather ^b,c   Vroomen, Jean ^d  

^a BASQUE CENTER ON COGNITION   (Spain)

^b UNIVERSITY OF CONNECTICUT   (United States)

^c HASKINS LABORATORIES   (United States)

^d TILBURG UNIVERSITY   (Netherlands)

Author keywords

Audiovisual speech; Cross modal correspondence; Development; Phonetic cues; Sine wave speech; Temporal cues

Indexed keywords

ASSOCIATION; CHILD; CHILD DEVELOPMENT; HUMAN; LIP READING; PHONETICS; PRESCHOOL CHILD; SPEECH; SPEECH PERCEPTION;

CHILD; CHILD DEVELOPMENT; CHILD, PRESCHOOL; CUES; HUMANS; LIPREADING; PHONETICS; SPEECH; SPEECH PERCEPTION;

EID: 84908354711     PISSN: 00220965     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jecp.2014.08.002     Document Type: Article

References (35)

1. Baart M., Stekelenburg J.J., Vroomen J. Electrophysiological evidence for speech-specific audiovisual integration. Neuropsychologia 2014, 53:115-121.
2. Baart M., Vroomen J., Shaw K., Bortfeld H. Degrading phonetic information affects matching of audiovisual speech in adults, but not in infants. Cognition 2014, 130:31-43.
3. Bristow D., Dehaene-Lamberts G., Mattout J., Soares C., Gliga T., Baillet S., et al. Hearing faces: How the infant brain matches the face it sees with the speech it hears. Journal of Cognitive Neuroscience 2009, 21:905-921.
4. Burnham D. Language specific speech perception and the onset of reading. Reading and Writing 2003, 16:573-609.
5. Burnham D., Dodd B. Auditory-visual speech perception as a direct process: The McGurk effect in human infants and across languages. Speechreading by humans and machines 1996, 103-114. Springer-Verlag, Berlin. D.G. Stork, M.E. Hennecke (Eds.).
6. de Gelder B., Vroomen J. Impaired speech perception in poor readers: Evidence from hearing and speech reading. Brain and Language 1998, 64:269-281.
7. Desjardins R.N., Rogers J., Werker J.F. An exploration of why preschoolers perform differently than do adults in audiovisual speech perception tasks. Journal of Experimental Child Psychology 1997, 66:85-110.
8. Desjardins R.N., Werker J.F. Is the integration of heard and seen speech mandatory for infants?. Developmental Psychobiology 2004, 45:187-203.
9. Erdener D., Burnham D. The relationship between auditory-visual speech perception and language-specific speech perception at the onset of reading instruction in English-speaking children. Journal of Experimental Child Psychology 2013, 116:120-138.
10. Eskelund K., Tuomainen J., Andersen T.S. Multistage audiovisual integration of speech: Dissociating identification and detection. Experimental Brain Research 2011, 208:447-457.
11. Grant K.W., van Wassenhove V., Poeppel D. Detection of auditory (cross-spectral) and auditory-visual (cross-modal) synchrony. Speech Communication 2004, 44:43-53.
12. Hockley N.S., Polka L.A. A developmental study of audiovisual speech perception using the McGurk paradigm. Journal of the Acoustical Society of America 1994, 96:3309.
13. Jerger S., Damian M.F., Spence M.J., Tye-Murray N., Abdi H. Developmental shifts in children's sensitivity to visual speech: A new multimodal picture-word task. Journal of Experimental Child Psychology 2009, 102:40-59.
14. Klucharev V., Möttönen R., Sams M. Electrophysiological indicators of phonetic and non-phonetic multisensory interactions during audiovisual speech perception. Cognitive Brain Research 2003, 18:65-75.
15. Knowland V.C., Mercure E., Karmiloff-Smith A., Dick F., Thomas M.S. Audio-visual speech perception: A developmental ERP investigation. Developmental Science 2014, 17:110-124.
16. Kopp F. Audiovisual temporal fusion in 6-month-old infants. Developmental Cognitive Neuroscience 2014, 9:56-67.
17. Kuhl P.K., Meltzoff A.N. The bimodal perception of speech in infancy. Science 1982, 218:1138-1141.
18. Kushnerenko E., Teinonen T., Volein A., Csibra G. Electrophysiological evidence of illusory audiovisual speech percept in human infants. Proceedings of the National Academy of Sciences of the United States of America 2008, 105:11442-11445.
19. Kushnerenko E., Tomalski P., Ballieux H., Potton A., Birtles D., Frostick C., et al. Brain responses and looking behavior during audiovisual speech integration in infants predict auditory speech comprehension in the second year of life. Frontiers in Psychology 2013, 4:432.
20. Kushnerenko E., Tomalski P., Ballieux H., Ribeiro H., Potton A., Axelsson E.L., et al. Brain responses to audiovisual speech mismatch in infants are associated with individual differences in looking behaviour. European Journal of Neuroscience 2013, 8:3363-3369.
21. Lewkowicz D.J. Infant perception of audio-visual speech synchrony. Developmental Psychology 2010, 46:66-77.
22. Massaro D.W. Children's perception of visual and auditory speech. Child Development 1984, 55:1777-1788.
23. McGurk H., MacDonald J. Hearing lips and seeing voices. Nature 1976, 264:746-748.
24. Parise C.V., Spence C., Ernst M.O. When correlation implies causation in multisensory integration. Current Biology 2012, 22:46-49.
25. Patterson M.L., Werker J.F. Two-month-old infants match phonetic information in lips and voice. Developmental Science 2003, 6:191-196.
26. Remez R.E., Rubin P.E., Pisoni D.B., Carrell T.D. Speech perception without traditional speech cues. Science 1981, 212:947-949.
27. Ross L.A., Molholm S., Blanco D., Gomez-Ramirez M., Saint-Amour D., Foxe J.J. The development of multisensory speech perception continues into the late childhood years. European Journal of Neuroscience 2011, 33:2329-2337.
28. Sekiyama K., Burnham D. Impact of language on development of auditory-visual speech perception. Developmental Science 2008, 11:306-320.
29. Smith L., Thelen E. Development as a dynamic system. Trends in Cognitive Sciences 2003, 7:343-348.
30. Stekelenburg J.J., Vroomen J. Electrophysiological evidence for a multisensory speech-specific mode of perception. Neuropsychologia 2012, 50:1425-1431.
31. Tuomainen J., Andersen T.S., Tiippana K., Sams M. Audio-visual speech perception is special. Cognition 2005, 96:B13-B22.
32. van Linden S., Vroomen J. Audiovisual speech recalibration in children. Journal of Child Language 2008, 35:809-822.
33. van Wassenhove V., Grant K.W., Poeppel D. Visual speech speeds up the neural processing of auditory speech. Proceedings of the National Academy of Sciences of the United States of America 2005, 102:1181-1186.
34. Vroomen J., Baart M. Phonetic recalibration only occurs in speech mode. Cognition 2009, 110:254-259.
35. Vroomen J., Stekelenburg J.J. Perception of intersensory synchrony in audiovisual speech: Not that special. Cognition 2011, 118:75-83.