Issues in the development of auditory-visual speech perception: Adults, infants, and children

8th International Conference on Spoken Language Processing, ICSLP 2004

Volumn , Issue , 2004, Pages 1137-1140

  Sekiyama, Kaoru ^a   Burnham, Denis ^b  

^a FUTURE UNIVERSITY HAKODATE   (Japan)

^b UNIVERSITY OF WESTERN SYDNEY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

SPEECH RECOGNITION;

AUDITORY-VISUAL; ENGLISH LANGUAGES; FUTURE RESEARCH DIRECTIONS; MCGURK EFFECT; VISUAL SPEECH;

VISUAL LANGUAGES;

EID: 85009067902     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (24)

1. Sumby, W.H. & Pollack, I. Visual contribution to speech intelligibility in noise, J. Acoust. Soc. Am., 26: 212-215, 1954.
2. McGurk, H. & MacDonald, J. Hearing lips and seeing voices, Nature, 264: 746-748, 1976.
3. Burnham, D. & Sekiyama, K. Investigating auditory-visual speech perception development using the ontogenetic and differential language methods. In Vatikiotis-Bateson, E., Perrier, P., & Bailly, G. (Eds.) Advances in auditory-visual speech processing. Cambridge: MIT Press (in press)
4. Sekiyama, K. & Tohkura, Y. McGurk effect in non-English listeners: Few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility, J. Acoust. Soc. Am., 90: 1797-1805, 1991.
5. Sekiyama, K. & Tohkura, Y. Inter-language differences in the influence of visual cues in speech perception, J. Phonetics, 21: 427-444, 1993.
6. Kuhl, P.K., Tsuzaki, M., Tohkura, Y., & Meltzoff, A.N. Human processing of auditory-visual information in speech perception: Potential for multimodal human-machine interfaces. Proceedings ICSLP. Tokyo: Acoust. Soc. Japan., 539-542, 1994.
7. Massaro, D.W., Cohen, M.M., Gesi, A., & Heredia, R. Tsuzaki, M. Bimodal speech perception: An examination across languages. J. Phonetics, 21: 445-478, 1993.
8. Sekiyama, K. Cultural and linguistic factors in audiovisual speech processing: the McGurk effect in Chinese subjects, Percept. Psychophys., 59: 73-80, 1997.
9. Sekiyama, K. Differences in auditory-visual speech perception between Japanese and Americans: McGurk effect as a function of incompatibility. J. Acoust. Soc. Japan, 15: 143-158, 1994.
10. Burnham, D., Ciocca, V., & Stokes, S. (2001) Auditory-visual perception of lexical tone. In P. Dalsgaard, B. Lindberg, & H. Benner (Eds) Proc. Eurospeec, Aalsborg, Denmark, ISCA, Bonn, Germany, 395-398, 2001
11. Burnham, D., Lau, S., Tam, H., & Schoknecht, C. (2001) Visual discrimination of Cantonese tone by tonal but non-Cantonese speakers, and by non-tonal language speakers. In Massaro, D., Light, J., & Geraci, K. (Eds) Proc. AV Speech Perception, Causal, 155-160, 2001.
12. Dodd, B. Lip reading in infants: Attention to speech presented in- and-out-of-synchrony. Cognitive Psychology, 11: 478-484, 1979
13. Burnham, D. & Dodd Familiarity and novelty in infant cross-language studies: Factors, problems, and a possible solution. In C. Rovee-Collier (Ed) Advances in Infancy Research, 12: 170-187, 1998.
14. Kuhl, P.K. & Meltzoff, A.N. The bimodal perception of speech in infancy. Science, 218, 1138-1141, 1982.
15. Patterson, M.L., & Werker, J.F. Two-month-old infants match phonetic information in lips and voice. Developmental Science, 6: 191-196, 2003.
16. MacKain, K., Studdert-Kennedy, M., Spieker, S., & Stern, D. Infant intermodal speech perception is a left-hemisphere function. Science, 219: 1347-1348, 1983.
17. Rosenblum, L.D., Schmuckler, M.A., & Johnson, J.A. The McGurk effect in infants. Perception & Psychophysics, 59, 347-357, 1997.
18. Desjardins, R.N. & Werker, J.F. 4-month-old female infants are influenced by visible speech. International Conference of Infant Studies, Providence RI, 1996
19. Massaro, D.W., Thompson, B.B., & Laren, E. Developmental changes in visual and auditory contributions to speech perception. J. Experimental Child Psychology, 41: 93-113, 1986.
20. Hockley, N.S. & Polka, L. A developmental study of audiovisual speech perception using the McGurk paradigm. J. Acoust. Soc. Am., 96: 3309, 1994.
21. Desjardins, R.N., Rogers, J. & Werker, J.F. An exploration of why preschoolers perform differently than do adults in audiovisual speech perception tasks. J. Experimental Child Psychology, 66: 85-110, 1997.
22. Siva, N., Stevens, E.B., Kuhl, P.K., & Meltzoff, A. N. A comparison between cerbral-palsied and normal adults in the perception of auditory-visual illusions. J. Acoust. Soc. Am., 98: 2983, 1995
23. Sekiyama, K., Burnham, D., Tam, H., & Erdener, D. Development of auditory-visual speech perception in Japanese and English speakers. J-L Schwartz, F. Berthommier, M-A. Cathiard, & D. Sodoyer (Eds) Proc. AV Speech Processing, St. Jorioz, France, Institut de la Communication Parlée, Grenoble, 43-46, 2003
24. Burnham, D. Language specific speech perception and the onset of reading. Reading and Writing: An Interdisciplinary Journal, 16: 573-609, 2003.