Is the integration of heard and seen speech mandatory for infants?

Developmental Psychobiology

Volumn 45, Issue 4, 2004, Pages 187-203

  Desjardins, Renée N ^a   Werker, Janet F ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Audiovisual integration; Infants; Speech

Indexed keywords

ARTICLE; AUDITORY SYSTEM FUNCTION; CONTROLLED STUDY; FEMALE; HABITUATION; HEARING; HUMAN; HUMAN EXPERIMENT; INFANT; INTEGRATION; MALE; NORMAL HUMAN; SPEECH PERCEPTION; VISION; VISUAL SYSTEM FUNCTION;

ADULT; AGE FACTORS; ATTENTION; CHILD DEVELOPMENT; FEMALE; HABITUATION, PSYCHOPHYSIOLOGIC; HUMANS; INFANT; MALE; SPEECH PERCEPTION; VISUAL PERCEPTION;

EID: 10644252692     PISSN: 00121630     EISSN: None     Source Type: Journal    
DOI: 10.1002/dev.20033     Document Type: Article

References (60)

1. Atkinson, J. (1984). Human visual development over the first 6 months of life: A review and a hypothesis. Human Neurobiology, 3, 61-74.
2. Bahrick, L. (1983). Infants' perception of substance and temporal synchrony in multimodal events. Infant Behavior and Development, 6, 429-451.
3. Binnie, C. A., Montgomery, A. A., & Jackson, P. A. (1974). Auditory and visual contributions to the perception of consonants. Journal of Speech and Hearing Research, 17, 619-630.
4. Burnham, D., & Dodd, B. (1996) Auditory-visual speech perception as a direct process: The McGurk effect in human infants and across languages. In D. G. Stork & M. E. Hennecke (Eds.), Speechreading by humans and machines (pp. 103-114). Berlin: Springer-Verlag.
5. Burnham, D., & Sekiyama, K. (in press). Investigating auditory-visual speech perception develop using the ontogenetic and differential language methods. In E. Vatikiotis-Bateson, P. Perrier, & G. Bailey (Eds.), Advances in auditory-visual speech processing. Cambridge, MA: MIT Press.
6. Desjardins, R. N., Rogers, J., & Werker, J. F. (1997). An exploration of why preschoolers perform differently than do adults in audiovisual speech perception tasks. Journal of Experimental Child Psychology, 66, 85-110.
7. Dodd, B. (1977). The role of vision in the perception of speech. Perception, 6, 31-40.
8. Dodd, B. (1979). Lip-reading in infants: Attention to speech presented in-and-out-of-synchrony. Cognitive Psychology, 11, 478-484.
9. Fodor, J. (1993). The modularity of mind. Cambridge, MA: MIT Press.
10. Ghazanfar, A. A., & Logothetis, N. K. (2003). Facial expressions linked to monkey calls. Nature, 423, 937-938.
11. Green, K. P., Kuhl, P. K., & Meltzoff, A. N. (1988). Factors affecting the integration of auditory and visual information in speech: The effect of vowel environment. Journal of the Acoustical Society of America, 85, S155.
12. Green, K. P., Kuhl, P. K., & Meltzoff, A. N., & Stevens, E. B. (1991). Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect. Perception & Psychophysics, 38, 269-276.
13. Hockley, N. S. (1994). The development of audiovisual speech perception. Unpublished master's thesis, McGill University.
14. Hockley, N. S., & Polka, L. (1994). A developmental study of audiovisual speech perception using the McGurk paradigm. Poster presented as the 12th Meeting of the Acoustical Society of America, Austin, TX.
15. Horowitz, F. D., Paden, L., Bhana, K., & Self, P. (1972). An infant-control procedure for studying infant visual fixations. Developmental Psychology, 7, 90.
16. Johnson, F. M., Hicks, L. H., Goldberg, T., & Myslobodsky, M. S. (1988). Sex differences in lip reading. Bulletin of the Psychonomic Society, 26, 106-108.
17. Kuhl, P. K., & Meltzoff, A. N. (1982, December 10). The bimodal perception of speech in infancy. Science, 218, 1138-1141.
18. Kuhl, P. K., & Meltzoff, A. N. (1984). The intermodal representation of speech in infants. Infant Behavior and Development, 7, 361-381.
19. Legerstee, M. (1990). Infants use multimodal information to imitate speech sounds. Infant Behavior and Development, 13, 343-354.
20. Lewkowicz, D. J. (1994). Development of intersensory perception in human infants. In D. J. Lewkowicz & R. Lickliter (Eds.), The development of intersensory perception: Comparative perspectives (pp. 165-203). Hillsdale, NJ: Erlbaum.
21. Lewkowicz, D. J. (2000). Infants' perception of the audible, visible, and bimodal attributes of multimodal syllables. Child Development, 71, 1241-1257.
22. Liberman, A. M., & Mattingly, I. G. (1985). Motor theory of speech perception revised. Cognition, 21, 1-36.
23. Luh, K. E., & Levy, J. (1995). Interhemispheric cooperation: Left is left and right is right, but sometimes the twain shall meet. Journal of Experimental Psychology: Human Perception and Performance, 12, 1243-1258.
24. Manuel, S. Y., Repp, B. H., Liberman, A. M., & Studdert-Kennedy, M. (1983, November). Exploring the "McGurk Effect." Paper presented at 24th annual meeting of the Psychonomic Society, San Diego, CA.
25. Massaro, D. W. (1984). Children's perception of visual and auditory speech. Child Development, 55, 1777-1788.
26. Massaro, D. W. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Hillsdale, NJ: Erlbaum.
27. Massaro, D. W. (1998). Perceiving talking faces: From speech perception to a behavioral principle. Cambridge, MA: MIT Press.
28. Massaro, D. W., Cohen, M. M., & Smeele, P. M. T. (1995). Cross-linguistic comparisons in the integration of visual and auditory speech. Memory & Cognition, 23, 113-131.
29. Massaro, D. W., Thompson, L. A., Barron, B., & Laren, E. (1986). Developmental changes in visual and auditory contributions to speech perception. Journal of Experimental Child Psychology, 41, 93-113.
30. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
31. McKain, K., Studdert-Kennedy, M., Spieker, S., & Stern, D. (1983, March 18). Infant intermodal speech perception is a left-hemisphere function. Science, 219, 1347-1349.
32. Meltzoff, A. N., & Kuhl, P. K. (1994). Faces and speech: Intermodal processing of biologically relevant signals in infants and adults. In D. J. Lewkowicz & R. Lickliter(Eds.), The development of intersensory perception: Comparative perspectives (pp. 335-369). Hillsdale, NJ: Erlbaum.
33. Miller, G. A., & Nicely, P. E. (1955). An analysis of perceptual confusions among some English consonants. Journal of the Acoustical Society of America, 27, 338-352.
34. Ojemann, G. A. (1988). Effect of cortical and subcortical stimulation on human language and verbal memory. In F. Plum (Ed.), Language, communication and the brain (pp. 101-115). New York: Raven Press.
35. Ojemann, G. A. (1991). Cortical organization of language. Journal of Neuroscience, 11, 2281-2287.
36. Oller, D. K. (1980). The emergence of the sounds of speech in infancy. In G. Yeni-Komshian, J. Kavanagh, & C. Ferguson (Eds.), Child phonology: Vol. 1. Production (pp. 93-112). New York: Academic Press.
37. Patterson, M. L., & Werker, J. F. (1999). Matching phonetic information in lips and voices is robust in 4.5-month-old infants. Infant Behavior and Development, 22, 237-247.
38. Patterson, M. L., & Werker, J. F. (2002). Infants' ability to match dynamic phonetic and gender information in the face and voice. Journal of Experimental Child Psychology, 81, 93-115.
39. Patterson, M. L., & Werker, J. F. (2003). Two-month-old infants match phonetic information in lips and voice. Developmental Science, 6, 191-196.
40. Poulin-Dubois, D., Serbin, L., Kenyon, B., & Derbyshire, A. (1994). Infants' intermodal knowledge about gender. Developmental Psychology, 30, 436-442.
41. Rosenblum, L. D., Schmuckler, M. A., & Johnson, J. A. (1997). The McGurk effect in infants. Perception & Psychophysics, 59, 347-357.
42. Sams, M., Aulanko, R., Hamalainen, M., Hari, R., Lounasmaa, O. V., Lu, S.-T., & Simola, J. (1991). Seeing speech: Visual information from lip movements modifies activity in the human auditory cortex. Neuroscience Letters, 127, 141-145.
43. Sekiyama, K. (1997). Cultural and linguistic factors in audiovisual speech processing: The McGurk effect in Chinese subjects. Perception & Psychophysics, 59, 73-80.
44. Sekiyama, K., Kanno, I., & Sugita, M. (2003). Auditory-visual speech perception examined by fMRI and PET. Neuroscience Research, 47, 277-287.
45. Sekiyama, K., & Tohkura, Y. (1993). Inter-language differences in the influence of visual cues in speech perception. Journal of Phonetics, 21, 427-444.
46. Shaywitz, B. A., Shaywitz, S. E., Pugh, K. R., Constable, R. T., Skudiarski, P., Fulbright, R. K., Bronen, R. A., Fletcher, J. M., Shankweiler, D. P., Katz, L., & Gore, J. C. (1995). Sex differences in the functional organization of the brain for language. Nature, 373, 607-609.
47. Siva, N., Stevens, E. B., Kuhl, P. K., & Meltzoff, A. N. (1995). A comparison between cerebral-palsied and normal adults in the perception of auditory-visual illusions. Journal of the Acoustical Society of America, 98, 2983.
48. Spelke, E. S. (1976). Infants' intermodal perception of events. Cognitive Psychology, 8, 533-560.
49. Spelke, E. S., & Cortelyou, A. (1981). Perceptual aspects of social knowing: Looking and listening in infancy. In M. E. Lamb & L. R. Sherrod (Eds.), Infant social cognition: Empirical and theoretical considerations (pp. 61-84). Hillsdale, NJ: Erlbaum.
50. Spelke, E. S., & Owsley, C. J. (1979). Intermodal exploration and knowledge in infancy. Infant Behavior and Development, 2, 13-27.
51. Stark, R. E. (1980). Stages of speech development in the first year of life. In G. Yeni-Komshian, J. Kavanagh, & C. Ferguson (Eds.), Child phonology: Vol. 1. Production (pp. 73-90). New York: Academic Press.
52. Summerfield, Q. (1991). Visual perception of phonetic gestures. In I. G. Mattingly (Ed.), Modularity and the motor theory of speech perception (pp. 117-137). Hillsdale, NJ: Erlbaum.
53. Summerfield, Q., & McGrath, M. (1984). Detection and resolution of audio-visual incompatibility in the perception of vowels. Journal of Experimental Psychology, 36A, 51-74.
54. Tighe, T. J., & Powlison, L. B. (1978). Sex differences in infant habituation research: A survey and some hypotheses. Bulletin of the Psychonomic Society, 12, 337-340.
55. Walker, S., Bruce, V., & O'Malley, C. (1995). Facial identity and facial speech processing: Familiar faces and voices in the McGurk effect. Perception & Psychophysics, 57, 1124-1133.
56. Walker-Andrews, A. S., Bahrick, L. E., Raglioni, S. S., & Diaz, I. (1991). Infants' bimodal perception of gender. Ecological Psychology, 3, 55-75.
57. Walton, G. E., & Bower, T. G. R. (1993). Amodal representation of speech in infants. Infant Behavior and Development, 16, 233-243.
58. Watson, C. S., Qui, W. W., Chamberlain, M. M., & Li, X. (1996). Auditory and visual speech perception: Confirmation of a modality-independent source of individual differences in speech recognition. Journal of the Acoustical Society of America, 100, 1153-1162.
59. Werker, J. F., Frost, P. E., & McGurk, H. (1992). La langue et les lévres: Cross-language influences on bimodal speech perception. Canadian Journal of Psychology, 46, 551-568.
60. Whalen, D. H., Irwin, J., & Fowler, C. A. (1996). Audiovisual integration of speech based on minimal information. Journal of the Acoustical Society of America, 100, 2569.