Infants' use of synchronized visual information to separate streams of speech

Child Development

Volumn 76, Issue 3, 2005, Pages 598-613

  Hollich, George ^a,d   Newman, Rochelle S ^b   Jusczyk, Peter W ^c  

^a PURDUE UNIVERSITY   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c JOHNS HOPKINS UNIVERSITY   (United States)

^d PURDUE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ATTENTION; CHILD PSYCHOLOGY; CLINICAL TRIAL; CONTROLLED CLINICAL TRIAL; CONTROLLED STUDY; FEMALE; HUMAN; INFANT; LEARNING; MALE; ORIENTATION; PATTERN RECOGNITION; PERCEPTION; PSYCHOPHYSICS; RANDOMIZED CONTROLLED TRIAL; SOUND DETECTION; SPEECH PERCEPTION; VISION;

ATTENTION; CHILD PSYCHOLOGY; FEMALE; GENERALIZATION (PSYCHOLOGY); HUMANS; INFANT; MALE; ORIENTATION; PATTERN RECOGNITION, VISUAL; PERCEPTUAL MASKING; PSYCHOACOUSTICS; SOUND LOCALIZATION; SPEECH PERCEPTION; VISUAL PERCEPTION;

EID: 19744364672     PISSN: 00093920     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1467-8624.2005.00866.x     Document Type: Article

References (87)

1. Aronson, E., & Rosenbloom, S. (1971). Spatial co-ordination of auditory and visual information in early infant perception. Science, 1, 1161-1163.
2. Ashmead, D. H., Clifton, R. K., & Perris, E. E. (1987). Precision of auditory localization in human infants. Developmental Psychology, 23, 641-647.
3. Aslin, R. N., Woodward, J. Z., LaMendola, N. P., & Bever, T. G. (1996). Models of word segmentation in fluent maternal speech to infants. In J. L. Morgan & K. Demuth (Eds.), Signal to syntax: Bootstrapping from speech to grammar in early acquisition (pp. 117-134). Mahwah, NJ: Erlbaum.
4. Bahrick, L. E. (1987). Infants' intermodal perception of two levels of temporal structure in natural events. Infant Behavior and Development, 10, 387-416.
5. Bahrick, L. E. (1988). Intermodal learning in infancy: Learning on the basis of two kinds of invariant relations in audible and visible events. Child Development, 59, 197-209.
6. Bahrick, L. E. (1992). Infants' perceptual differentiation of amodal and modality-specific audio-visual relations. Journal of Experimental Child Psychology, 53, 197-209.
7. Bahrick, L. E. (2001). Increasing specificity in perceptual development: Infants' detection of nested levels of multimodal stimulation. Journal of Experimental Child Psychology, 79, 253-270.
8. Bahrick, L. E. (2004). The development of perception in a multimodal environment. In G. Bremner & A. Slater (Eds.), Theories of infant development (pp. 90-120). Malden, MA: Blackwell.
9. Bahrick, L. E., & Lickliter, R. (2000). Intersensory redundancy guides attentional selectivity and perceptual learning in infancy. Developmental Psychology, 36, 190-201.
10. Bahrick, L. E., Netto, D., & Hernandez-Reif, M. (1998). Intermodal perception of adult and child faces and voices by infants. Child Development, 69, 1263-1275.
11. Bargones, J. Y., & Werner, L. A. (1994). Adults listen selectively; infants do not. Psychological Science, 5, 170-174.
12. Bergman, M. (1971). Hearing and aging. Audiology, 10, 164-171.
13. Bernstein, L. E., & Demorest, M. E. (1993). Speech perception without audition. Journal of the Acoustical Society of America, 94, 1887.
14. Bregman, A. S., Abramson, J., Doehring, P., & Darwin, C. J. (1985). Spectral integration based on common amplitude modulation. Perception and Psychophysics, 37, 483-493.
15. Bregman, A. S., & Pinker, S. (1978). Auditory streaming and the building of timbre. Canadian Journal of Psychology, 32, 19-31.
16. Broadbent, D. E. (1952). Listening to one of two synchronous messages. Journal of Experimental Psychology, 44, 51-55.
17. Broadbent, D. E. (1954). The role of auditory localization in attention and memory span. Journal of Experimental Psychology, 47, 191-196.
18. Cassia, V. M., Turati, C., & Simion, F. (2004). Can a non-specific bias toward top-heavy patterns explain new-borns' face preference? Psychological Science, 15, 379-383.
19. Cherry, E. C. (1953). Some experiments in the recognition of speech, with one and two ears. Journal of the Acoustical Society of America, 25, 975-979.
20. Cutler, A. (1990). Exploiting prosodie probabilities in speech segmentation. In Altmann, G. T. M. (Ed.), Cognitive models of speech processing: Psycholinguistic and computational perspectives (pp. 105-121). Cambridge, MA: MIT Press.
21. Dannenbring, G. L., & Bregman, A. S. (1978). Streaming vs. fusion of sinusoidal components of complex tones. Perception and Psychophysics, 24, 369-376.
22. Dodd, B. (1979). Lip reading in infants: Attention to speech presented in- and out-of-synchrony. Cognitive Psychology, 11, 478-484.
23. Dodd, B., & Burnham, D. (1988). Processing speechread information. Volta Review: New Reflections on Speechreading, 90, 45-60.
24. Driver, J. (1996). Enhancement of selective listening by illusory mislocation of speech sounds due to lipreading. Nature, 381, 66-68.
25. Echols, C. H., Crowhurst, M. J., & Childers, J. B. (1997). The perception of rhythmic units in speech by infants and adults. Journal of Memory and Language, 36, 202-225.
26. Fernald, A., & Kuhl, P. (1987). Acoustic determinants of infant preference for motherese speech. Infant Behavior and Development, 10, 279-293.
27. Gibson, E. J. (1969). Principles of perceptual learning and development. New York: Appleton-Century Crofts.
28. Grant, K. W., & Seitz, P. F. (2000). The use of visible speech cues for improving auditory detection of spoken sentences. Journal of the Acoustical Society of America, 108, 1197-1208.
29. Green, K. P., & Kuhl, P. K. (1989). The role of visual information in the processing of place and manner features in speech perception. Perception & Psychophysics, 45, 34-42.
30. Green, K. P., & Kuhl, P. K. (1991). Integral processing of visual place and auditory voicing information during phonetic perception. Journal of Experimental Psychology: Human Perception and Performance, 17, 278-288.
31. Green, K. P., Kuhl, P. K., Meltzoff, A. N., & Stevens, E. B. (1991). Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect. Perception & Psychophysics, 50, 524-536.
32. Hay, J. C., Pick, H.L, & Ikeda, K. (1965). Visual capture produced by prism spectacles. Psychonomic Science, 2, 215-216.
33. Hirsh, I. J. (1950). The relation between localization and intelligibility. Journal of the Acoustic Society of America, 22, 196-200.
34. Hultsch, H., Schleuss, F., & Todt, D. (1999). Auditory-visual stimulus pairing enhances perceptual learning in a songbird. Animal Behavior, 58, 143-149.
35. Hygge, S., & Ronnberg, J. (1992). Normal-hearing and hearing-impaired subjects' ability to just follow conversation in competing speech, reversed speech, and noise backgrounds. Journal of Speech & Hearing Research, 35, 208-215.
36. Jack, C. E., & Thurlow, W. R. (1973). Effects of degree of visual association and angle of displacement on the "ventriloquism" effect. Perceptual and Motor Skills, 37, 967-969.
37. Johnson, E. K., & Jusczyk, P. W. (2001). Word segmentation by 8-month-olds: When speech cues count more than statistics. Journal of Memory and Language, 44, 1-20.
38. Johnson, M. H., & Morton, J (1991). Biology and cognitive development: The case of face recognition. Oxford, England: Blackwell.
39. Jones, D., Alford, D., Bridges, A., Tremblay, S., & Macken, B. (1999). Organizational factors in selective attention: The interplay of acoustic distinctiveness and auditory streaming in the irrelevant sound effect. Journal of Experimental Psychology: Learning, Memory, & Cognition, 25, 464-473.
40. Jusczyk, P. (1998). Constraining the search for structure in the input. Lingua, 106, 197-218.
41. Jusczyk, P. W., & Aslin, R. N. (1995). Infants' detection of the sound patterns of words in fluent speech. Cognitive Psychology, 29, 1-23.
42. Jusczyk, P. W., Cutler, A., & Redanz, N. J. (1993). Preference for the predominant stress patterns of English words. Child Development, 64, 675-687.
43. Jusczyk, P. W., Houston, D. M., & Newsome, M. (1999). The beginnings of word segmentation in English-learning infants. Cognitive Psychology, 39, 159-207.
44. Jusczyk, P. W., Luce, P. A., & Charles Luce, J. (1994). Infants' sensitivity to phonotactic patterns in the native language. Journal of Memory and Language, 33, 630-645.
45. Kuhl, P. K., & Meltzoff, A. N. (1982). The bimodal perception of speech in infancy. Science, 218, 1138-1141.
46. Kuhl, P. K., & Meltzoff, A. N. (1984). Intermodal speech perception. Infant Behavior and Development, 7, 361-381.
47. Kuhl, P. K., Williams, K. A., & Meltzoff, A. N. (1991). Cross-modal speech perception in adults and infants using non-speech auditory stimuli. Journal of Experimental Psychology: Human Perception and Performance, 17, 829-840.
48. Lewkowicz, D. J. (1986). Developmental changes in infants' bisensory response to synchronous durations. Infant Behavior and Development, 9, 335-353.
49. Lewkowicz, D. J., & Lickliter, R. (1994). The development of intersensory perception: Comparative perspectives. Hillsdale, NJ: Erlbaum.
50. MacKain, K., Studdert-Kennedy, M., Spieker, S., & Stern, D. (1983). Infant intermodal speech perception is a left-hemisphere function. Science, 219, 1347-1349.
51. Massaro, D. W. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Hillsdale, NJ: Erlbaum.
52. Massaro, D. W. (1998). Perceiving talking faces: From speech perception to a behavioral principle. Cambridge, MA: MIT Press.
53. Mateeff, S., Hohnsbein, J., & Noack, T. (1985). Dynamic visual capture: Apparent auditory motion induced by a moving visual target. Perception, 14, 721-727.
54. Mayo, L., Florentine, M., & Buus, S. (1997). Age of second-language acquisition and perception of speech in noise. Journal of Speech, Language & Hearing Research, 40, 686-693.
55. McGurk, H., & McDonald, J. (1976). Hearing lips and seeing voices: A new illusion. Nature, 264, 746-748.
56. McLeod, A., & Summerfield, A. Q. (1990). A procedure for measuring auditory and audio-visual speech-reception thresholds for sentences in noise: Rationale, evaluation, and recommendations for use. British Journal of Audiology, 24, 29-43.
57. Meltzoff, A. N., & Borton, R. W. (1979). Intermodal matching by human neonates. Nature, 282, 403-404.
58. Nelken, I., Rotmani, Y., & Yosef, O. B. (1999). Responses of auditory-cortex neurons to structural features of natural sounds. Nature, 397, 154-157.
59. Nelson, C. A. (2001). The development and neural bases of face recognition. Infant and Child Development, 10, 3-18.
60. Newman, R. S. (2003). Prosodic differences in mothers' speech to toddlers in quiet and noisy environments. Applied Psycholinguistics, 24, 539-560.
61. Newman, R. S., & Jusczyk, P. W. (1996). The cocktail party effect in infants. Perception & Psychophysics, 58, 1145-1156.
62. Nozza, R. J., Rossman, R. N. F., & Bond, L. C. (1991). Infant-adult differences in unmasking thresholds for the discrimination of consonant-vowel syllable pairs. Audiology, 30, 102-112.
63. Nozza, R. J., Rossman, R. N. F., Bond, L. C., & Miller, S. L. (1990). Infant speech-sound discrimination in noise. Journal of the Acoustical Society of America, 87, 339-350.
64. Nozza, R. J., & Wilson, W. R. (1984). Masked and unmasked puretone thresholds of infants and adults: Development of auditory frequency selectivity and sensitivity. Journal of Speech and Hearing Research, 27, 613-622.
65. Patterson, M. L., & Werker, J. F. (1999). Matching phonetic information in lips and voice is robust in 4.5 -month-old infants. Infant Behavior and Development, 22, 237-247.
66. Picard, M., & Bradley, J. (2001). Revisiting speech interference in classrooms. Audiology, 40, 221-244.
67. Pickens, J., Field, T., Nawrocki, T., Martinez, A., Soutullo, D., & Gonzalez, K. (1994). Full-term and preterm infants' perception of face-voice synchrony. Infant Behavior and Development, 17, 447-455.
68. Pollack, I., & Pickett, J. M. (1958). Stereophonic listening and speech intelligibility against voice babble. Journal of the Acoustic Society of America, 30, 131-133.
69. Reisberg, D. (1978). Looking where you listen: Visual cues and auditory attention. Acta Psychologica, 42, 331-341.
70. Reisberg, D., McLean, J., & Goldfield, A. (1987). Easy to hear but hard to understand: A lip-reading advantage with intact auditory stimuli. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lip-reading (pp. 97-114). Hillsdale, NJ: Erlbaum.
71. Rosenblum, L. D., Johnson, J. A., & Saldana, H. M. (1996). Visual kinematic information for embellishing speech in noise. Journal of Speech & Hearing Research, 39, 1159-1170.
72. Rosenblum, L. D., & Saldana, H. M. (1996). An audiovisual test of kinematic primitives for visual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 22, 318-331.
73. Rosenblum, L. D., Schmuckler, M. A., & Johnson, J. A. (1997). The McGurk effect in infants. Perception & Psychophysics, 59, 347-357.
74. Saffran, J. R., Aslin, R. N., & Newport, E. L. (1996). Statistical learning by 8-month-old infants. Science, 274, 1926-1928.
75. Sinnott, J. M., Pisoni, D. B., & Aslin, R. N. (1983). A comparison of pure tone auditory thresholds in human infants and adults. Infant Behavior & Development, 6, 3-17.
76. Spelke, E. S. (1979). Perceiving bimodally specified events in infancy. Developmental Psychology, 15, 626-636.
77. Spelke, E. S., & Owsley, C. J. (1979). Intermodal exploration and knowledge in infancy. Infant Behavior and Development, 2, 13-27.
78. Sumby, W. H., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-215.
79. Takata, Y., & Nábelek, A. K. (1990). English consonant recognition in noise and in reverberation by Japanese and American listeners. Journal of the Acoustical Society of America, 88, 663-666.
80. Trehub, S. E., Bull, D., & Schneider, B. A. (1981). Infants' detection of speech in noise. Journal of Speech and Hearing Research, 24, 202-206.
81. Turati, C. (2004). Why faces are not special to newborns: An alternative account of the face preference. Current Directions in Psychological Science, 13, 5-8.
82. van de Weijer, J (1998). Language input for word discovery. Nijmegen, Netherlands: Wageningen, Ponsen & Loijen.
83. van Wassenhove, V., Grant, K. W., & Poeppel, D. (2001, November). Timing of auditory-visual integration in the McGurk effect. Paper presented at the Society of Neuroscience annual meeting, San Diego, CA.
84. van Wassenhove, V., Grant, K. W., & Poeppel, D. (2002, April). Temporal integration in the McGurk effect. Paper presented at the Cognitive Neuroscience annual meeting, San Francisco, CA.
85. Walker, A. S. (1982). Intermodal perception of expressive behaviors by human infants. Journal of Experimental Child Psychology, 33, 514-535.
86. Walton, G. E., & Bower, T. G. R. (1993). Amodal representation of speech in infants. Infant Behavior and Development, 16, 223-243.
87. Warren, R. M. (1970). Perceptual restoration of missing speech sounds. Science, 167, 392-393.