Cross-modal matching of audio-visual german and french fluent speech in infancy

PLoS ONE

Volumn 9, Issue 2, 2014, Pages

  Kubicek, Claudia ^a   De Boisferon, Anne Hillairet ^b   Dupierrix, Eve ^b   Pascalis, Olivier ^b   Loevenbruck, Hélène ^b,c   Gervain, Judit ^d,e   Schwarzer, Gudrun ^a  

^a JUSTUS LIEBIG UNIVERSITY   (Germany)

^b UNIVERSITÉ PIERRE MENDÈS FRANCE   (France)

^c UNIV GRENOBLE ALPES   (France)

^d UNIVERSITÉ PARIS DESCARTES   (France)

^e CNRS   (France)

Author keywords

[No Author keywords available]

Indexed keywords

AGE DISTRIBUTION; ARTICLE; ASSOCIATION; AUDIOVISUAL FLUENT SPEECH; AUDITORY DISCRIMINATION; CONTROLLED STUDY; CROSS MODAL PERCEPTION; FACILITATION; FEMALE; HUMAN; INFANT; LANGUAGE ABILITY; LEARNING; MALE; PERCEPTION; SENSE OF COHERENCE; SPEECH; SPEECH DEVELOPMENT; VISUAL DISCRIMINATION; VISUAL INFORMATION; AUDITORY STIMULATION; CHILD DEVELOPMENT; DISCRIMINATION LEARNING; FRANCE; GERMANY; HEARING; LANGUAGE; LANGUAGE DEVELOPMENT; PHYSIOLOGY; VISION;

ACOUSTIC STIMULATION; ASSOCIATION LEARNING; AUDITORY PERCEPTION; CHILD DEVELOPMENT; DISCRIMINATION LEARNING; FEMALE; FRANCE; GERMANY; HUMANS; INFANT; LANGUAGE; LANGUAGE DEVELOPMENT; MALE; SPEECH; VISUAL PERCEPTION;

EID: 84895886297     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0089275     Document Type: Article

References (58)

1. McGurk H, MacDonald J (1976) Hearing Lips and Seeing Voices. Nature 264: 746-748.
2. Burnham D, Dodd B (2004) Auditory-visual speech integration by prelinguistic infants: Perception of an emergent consonant in the McGurk effect. Developmental Psychobiology 45: 204-220. (Pubitemid 39657558)
3. Kushnerenko E, Teinonen T, Volein A, Csibra G (2008) Electrophysiological evidence of illusory audiovisual speech percept in human infants. Proceedings of the National Academy of Sciences of the United States of America 105: 11442-11445.
4. Rosenblum LD, Schmuckler MA, Johnson JA (1997) The McGurk effect in infants. Perception & Psychophysics 59: 347-357. (Pubitemid 127456379)
5. Kuhl PK, Meltzoff AN (1982) The Bimodal Perception of Speech in Infancy. Science 218: 1138-1141.
6. Kuhl PK, Meltzoff AN (1984) The Intermodal Representation of Speech in Infants. Infant Behavior & Development 7: 361-381.
7. Patterson ML, Werker JF (1999) Matching phonetic information in lips and voice is robust in 4.5-month-old infants. Infant Behavior & Development 22: 237-247.
8. Patterson ML, Werker JF (2003) Two-month-old infants match phonetic information in lips and voice. Developmental Science 6: 191-196. (Pubitemid 36420229)
9. Walton GE, Bower TGR (1993) Amodal Representation of Speech in Infants. Infant Behavior & Development 16: 233-243.
10. Yeung HH, Werker JF (2013) Lip movements affect infants' audiovisual speech perception. Psychological Science 24: 603-612.
11. Pons F, Lewkowicz DJ, Soto-Faraco S, Sebastian-Galles N (2009) Narrowing of intersensory speech perception in infancy. Proceedings of the National Academy of Sciences of the United States of America 106: 10598-10602.
12. Lewkowicz DJ, Pons F (2013) Recognition of amodal language identity emerges in infancy. International Journal of Behavioral Development 37: 90-94.
13. Sai FZ (2005) The role of the mother's voice in developing mother's face preference: Evidence for intermodal perception at birth. Infant and Child Development 14: 29-50.
14. Streri A, Coulon M, Guellai B (2013) The foundations of social cognition: Studies on face/voice integration in newborn infants. International Journal of Behavioral Development 37: 79-83.
15. Aldridge MA, Braga ES, Walton GE, Bower TGR (1999) The intermodal representation of speech in newborns. Developmental Science 2: 42-46.
16. Baier R, Idsardi WJ, Lidz J (2007) Two-month-olds are sensitive to lip rounding in dynamic and static speech events. In: Vroomen J, Swerts M, Krahmer E, editors.
17. Dodd B (1979) Lip Reading in Infants - Attention to Speech Presented in-Synchrony and out-of-Synchrony. Cognitive Psychology 11: 478-484.
18. Lewkowicz DJ (2010) Infant Perception of Audio-Visual Speech Synchrony. Developmental Psychology 46: 66-77.
19. Lewkowicz DJ, Leo I, Simion F (2010) Intersensory Perception at Birth: Newborns Match Nonhuman Primate Faces and Voices. Infancy 15: 46-60.
20. Spelke ES (1979) Perceiving Bimodally Specified Events in Infancy. Developmental Psychology 15: 626-636.
21. MacKain K, Studdertkennedy M, Spieker S, Stern D (1983) Infant Intermodal Speech-Perception Is a Left-Hemisphere Function. Science 219: 1347-1349. (Pubitemid 13109174)
22. Walker-Andrews AS, Bahrick LE, Raglioni SS, Diaz I (1991) Infants' bimodal perception of gender. Ecological Psychology 3: 55-75.
23. Walker AS (1982) Inter-Modal Perception of Expressive Behaviors by Human Infants. Journal of Experimental Child Psychology 33: 514-535.
24. Pickens J, Field T, Nawrocki T, Martinez A, Soutullo D, et al. (1994) Full-Term and Preterm Infants Perception of Face Voice Synchrony. Infant Behavior & Development 17: 447-455.
25. Dodd B, Burnham D (1988) Processing speechread information. Volta-Review 90: 45-60.
26. Bahrick LE, Lickliter R (2000) Intersensory redundancy guides attentional selectivity and perceptual learning in infancy. Developmental Psychology 36: 190-201.
27. Bahrick LE, Liekliter R, Flom R (2004) Intersensory redundancy guides the development of selective attention, perception, and cognition in infancy. Current Directions in Psychological Science 13: 99-102. (Pubitemid 38783081)
28. Scott LS, Pascalis O, Nelson CA (2007) A domain-general theory of the development of perceptual discrimination. Current Directions in Psychological Science 16: 197-201.
29. Lewkowicz DJ, Ghazanfar AA (2006) The decline of cross-species intersensory perception in human infants. Proceedings of the National Academy of Sciences of the United States of America 103: 6771-6774.
30. Lewkowicz DJ, Sowinski R, Place S (2008) The decline of cross-species intersensory perception in human infants: Underlying mechanisms and its developmental persistence. Brain Research 1242: 291-302.
31. Kelly DJ, Quinn PC, Slater AM, Lee K, Ge LZ, et al. (2007) The other-race effect develops during infancy - Evidence of perceptual narrowing. Psychological Science 18: 1084-1089.
32. Pascalis O, de Haan M, Nelson CA (2002) Is face processing species-specific during the first year of life? Science 296: 1321-1323. (Pubitemid 34522788)
33. Weikum WM, Vouloumanos A, Navarra J, Soto-Faraco S, Sebastian-Galles N, et al. (2007) Visual language discrimination in infancy. Science 316: 1159-1159.
34. Kuhl PK, Tsao FM, Liu HM (2003) Foreign-language experience in infancy: Effects of short-term exposure and social interaction on phonetic learning. Proceedings of the National Academy of Sciences of the United States of America 100: 9096-9101. (Pubitemid 36899229)
35. Werker JF, Tees RC (1984) Cross-Language Speech-Perception - Evidence for Perceptual Reorganization during the 1st Year of Life. Infant Behavior & Development 7: 49-63.
36. Lewkowicz DJ, Kraebel KS (2004) The value of multimodal redundancy in the development of intersensory perception. In: Calvert G, Spence C, Stein B, editors. Handbook of Multisensory Processing. Cambridge: MIT. 655-678.
37. Schneirla TC (1957) The concept of development in comparative psychology. In: Harris DB, editor. The concept of development. Minneapolis: University of Minnesota Press. 78-108.
38. Schneirla TC (1965) Aspects of stimulation and organization in approach/withdrawal processes underlying vertebrate behavioral development. In: Lehrmann DS, Hinde RA, Shaw E, editors. Advances in the study of behavior. New York: Academic Press. 1-71.
39. Turkewitz G, Kenny PA (1982) Limitations on Input as a Basis for Neural Organization and Perceptual Development - a Preliminary Theoretical Statement. Developmental Psychobiology 15: 357-368. (Pubitemid 12017116)
40. Werker JF (1995) Exploring developmental changes in cross-language speech perception. In: Osherson D, Gleitman L, Liberman M, editors. An invitation to cognitive science Part I: Language. Cambridge, MA: MIT Press. 87-106.
41. Werker JF, Hall DG, Fais L (2004) Reconstruing U-Shaped Functions. Journal of Cognition and Development 5: 147-151. (Pubitemid 44783543)
42. Kubicek C, Hillairet de Boisferon A, Dupierrix E, Loevenbruck H, Gervain J, et al. (2013) Face-scanning behavior to silently-talking faces in 12-month-old infants: The impact of pre-exposed auditory speech. International Journal of Behavioral Development 37: 106-110.
43. Maurer D, Werker JF (2013) Perceptual narrowing during infancy: a comparison of language and faces. Developmental Psychobiology.
44. Gervain J, Mehler J (2010) Speech perception and language acquisition in the first year of life. Annual Review of Psychology 61: 191-218.
45. Gogate LJ, Bahrick LE (1998) Intersensory redundancy facilitates learning of arbitrary relations between vowel sounds and objects in seven-month-old infants. Journal of Experimental Child Psychology 69: 133-149. (Pubitemid 128430316)
46. Gogate LJ, Bahrick LE (2001) Intersensory Redundancy and 7-Month-Old Infants' Memory for Arbitrary Syllable-Object Relations. Infancy 2: 219-231. (Pubitemid 33670609)
47. Gogate LJ, Bahrick LE, Watson JD (2000) A study of multimodal motherese: The role of temporal synchrony between verbal labels and gestures. Child Development 71: 878-894.
48. Lewkowicz DJ, Hansen-Tift AM (2012) Infants deploy selective attention to the mouth of a talking face when learning speech. Proceedings of the National Academy of Sciences of the United States of America 109: 1431-1436.
49. Chandrasekaran C, Trubanova A, Stillittano S, Caplier A, Ghazanfar AA (2009) The Natural Statistics of Audiovisual Speech. Plos Computational Biology 5.
50. Kuhl PK, Williams KA, Lacerda F, Stevens KN, Lindblom B (1992) Linguistic Experience Alters Phonetic Perception in Infants by 6 Months of Age. Science 255: 606-608.
51. Polka L, Werker JF (1994) Developmental-Changes in Perception of Nonnative Vowel Contrasts. Journal of Experimental Psychology-Human Perception and Performance 20: 421-435.
52. Cashon CH, Cohen LB (2004) Beyond U-Shaped Development in Infants' Processing of Faces: An Information-Processing Account. Journal of Cognition and Development 5: 59-80. (Pubitemid 44783532)
53. Morton J, Johnson MH (1991) Conspec and Conlern - a 2-Process Theory of Infant Face Recognition. Psychological Review 98: 164-181.
54. Munhall KG, Jones JA, Callan DE, Kuratate T, Vatikiotis-Bateson E (2004) Visual prosody and speech intelligibility - Head movement improves auditory speech perception. Psychological Science 15: 133-137. (Pubitemid 38361306)
55. Yehia H, Rubin P, Vatikiotis-Bateson E (1998) Quantitative association of vocal-tract and facial behavior. Speech Communication 26: 23-43. (Pubitemid 128381217)
56. Oller DK (2000) The Emergence of the Speech Capacity. Mahwah, NJ: Lawrence Erlbaum.
57. Werker JF, Tees RC (1999) Influences on infant speech processing: Toward a new synthesis. Annual Review of Psychology 50: 509-535.
58. Werker JF, Yeung HH, Yoshida KA (2012) How Do Infants Become Experts at Native-Speech Perception? Current Directions in Psychological Science 21: 221-226.