The use of visual cues in the perception of non-native consonant contrasts

Journal of the Acoustical Society of America

Volumn 119, Issue 3, 2006, Pages 1740-1751

  Hazan, Valerie ^a   Sennema, Anke ^a,d   Faulkner, Andrew ^a   Ortega Llebaria, Marta ^a,e   Iba, Midori ^b   Chung, Hyunsong ^c,f  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b KONAN UNIVERSITY   (Japan)

^c Daegu University   (South Korea)

^d UNIVERSITY OF POTSDAM   (Germany)

^e UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^f Korea National University of Education   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO-VISUAL CONDITIONS; AUDIO-VISUAL MODALITIES; AUDITORY PROFICIENCY; PHONETIC INFORMATION;

AUDIO ACOUSTICS; AUDITION; SPEECH; SPEECH RECOGNITION; STUDENTS; VISION;

SPEECH ANALYSIS;

ADOLESCENT; ADULT; ARTICLE; ASSOCIATION; AUDIOVISUAL EQUIPMENT; CONSONANT; CONTROLLED STUDY; CORRELATION ANALYSIS; HUMAN; HUMAN EXPERIMENT; INFORMATION; LANGUAGE; NORMAL HUMAN; PERCEPTION; PERFORMANCE; PHONETICS; PRIORITY JOURNAL; SENSITIVITY ANALYSIS; SPEECH PERCEPTION;

ADOLESCENT; ADULT; ANALYSIS OF VARIANCE; CASE-CONTROL STUDIES; CUES; FEMALE; HUMANS; LANGUAGE; MALE; MULTILINGUALISM; PHONETICS; PHOTIC STIMULATION; SPEECH PERCEPTION;

EID: 33644656540     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.2166611     Document Type: Article

References (53)

1. Abramson, A., and Lisker, L. (1972). " Voice-timing perception in Spanish word-initial stops., " Haskins Laboratories Status Report on Speech Research 2930, 15-25.
2. Aoyama, K., Flege, J. E., Guion, S. G., Akahane-Yamada, R., and Yamada, T. (2004). " Perceived phonetic distance and L2 learning: The case of Japanese r and English l and r, " J. Phonetics 32, 233-250
3. Best, C. (1995). " A direct realist view of cross-language speech perception., " in Speech Perception and Linguistic Experience: Theoretical and Methodological Issues, edited by, W. Strange, (York, Baltimore), pp. 171-204.
4. Best, C. T., and McRoberts, G. W. (2003). " Infant perception of nonnative consonant contrasts that adults assimilate in different ways., " Lang Speech 46, 183-216.
5. Binnie, C. A., Montgomery, A. A., and Jackson, P. L. (1974). " Auditory and visual contribution to the perception of consonants., " J. Speech Hear. Res. 17, 619-630.
6. Bradlow, A. R., Pisoni, D. B., Yamada, R. A., and Tohkura, Y. (1997). " Training Japanese listeners to identify English r and l. IV. Some effects of perceptual learning on speech production., " J. Acoust. Soc. Am. 101, 2299-2310.
7. Ching, Y. C. T. (1986). " Voice pitch information for the deaf., " in " Towards better communication, cooperation and coordination., " Proc. of the First Asia Pacific Regional Conference Deafness, Hong Kong, edited by, U. C. L. Engzell,, 340-343.
8. Cole, R. (1999). " Tools for research and education in speech science., " Proc. Int. Conf. Phon. Sc., San Francisco, 1277-1280.
9. Flege, J. E. (1995). " Second-language speech learning: theory, findings, and problems., " in: Speech Perception and Linguistic Experience: Theoretical and Methodological Issues, edited by, W. Strange, (York, Baltimore), pp. 229-273.
10. Flege, J. E., Frieda, E. M., and Nozawa, T. (1997). " Amount of native language (L1) use affects the pronunciation of an L2., " J. Phonetics 25, 169-186.
11. Flege, J., Schirru, C., and MacKay, I. (2003). " Interaction between the native and second language phonetic subsystems., " Speech Commun. 40, 467-491.
12. Fowler, C. (1986). " An event approach to the study of speech perception from a direct-realist perspective., " J. Phonetics 14, 3-28.
13. Gordon, P. C., Keyes, L., and Yung, Y. F. (2001). " Ability in perceiving nonnative contrasts: Performance on natural and synthetic speech stimuli., " Percept. Psychophys. 63, 746-758.
14. Grant, K. W., and Seitz, P. F. (1998). " Measures of auditory-visual integration in nonsense syllables and sentences., " J. Acoust. Soc. Am. 104, 2438-2450.
15. Green, D. M., and Swets, J. A. (1966). Signal Detection Theory and Psychophysics. (Wiley, New York).
16. Hardison, D. (1999). " Bimodal speech perception by native and nonnative speakers of English: Factors influencing the McGurk effect., " Lang. Learn. 49, 213-283.
17. Hardison, D. (2003). " Acquisition of second-language speech: Effects of visual cues, context, and talker variability., " J. Appl. Psychol. 24, 495-522.
18. Hardison, D. M. (2005). " Variability in bimodal spoken language processing by native and nonnative speakers of English: A closer look at effects of speech style., " Speech Commun. 46, 73-93.
19. Hazan, V., and Barrett, S. (2000). " The development of phonemic categorisation in children aged 6 to 12., " J. Phonetics 28, 377-396.
20. Hazan, V., and Rosen, S. (1991). " Individual variability in the perception of cues to place contrasts in initial stops., " Percept. Psychophys. 49, 187-200.
21. Hazan, V., Sennema, A., Iba, M., and Faulkner, A. (2005). " Effect of audiovisual perceptual training on the perception and production of consonants in Japanese learners of English., " Speech Commun. 47, 360-378.
22. Hualde, J. I. (2005). The Sounds of Spanish (Cambridge University Press, Cambridge).
23. Ingram, J. C. L., and Park, S.-G. (1998). " Language, context, and speaker effects in the identification and discrimination of English r and l by Japanese and Korean listeners., " J. Acoust. Soc. Am. 103, 1161-1174.
24. Iverson, P., Hazan, V., and Bannister, K. (2005). " Phonetic training with acoustic cue manipulations: A comparison of methods for teaching English r-l to Japanese adults., " J. Acoust. Soc. Am. 118, 3267-3278.
25. Iverson, P., Kuhl, P. K., Akahane-Yamada, R., Diesch, E., Tohkura, Y., Kettermann, A., and Siebert, C. (2003). " A perceptual interference account of acquisition difficulties for nonnative phonemes., " Cognition 87, B47-B57.
26. Kuhl, P. K. (1993). " Early linguistic experience and phonetic perception: Implications for theories of developmental speech perception., " J. Phonetics 21, 125-139.
27. Kuhl, P. K., and Meltzoff, A. N. (1982). " The bimodal perception of speech in infancy., " Science 218, 1138-1141.
28. Lee, B., and Lee, S.-H. (2004). " Korean Learners' Perception and Production of English Liquids., " Malsori (Phonetics) the Journal of Phonetic Society of Korea 52, 61-84.
29. Lotto, A. J., Sato, M., and Diehl, R. L. (2004). " Mapping the task for the second language learner: The case of Japanese acquisition of r and l, " From Sound to Sense: 50+ years of discoveries in speech communication, 11-13 June 2004, MIT, Conference proceedings, edited by, J. Slifka,,, S. Manuel,,, M. Matthies,, C181-C186.
30. Massaro, D. W. (1998). Perceiving Talking Faces: From Speech Perception to a Behavioral Principle (MIT Press, Cambridge, MA).
31. Massaro, D. W., Thompson, L. A., Barron, B., and Laren, E. (1986). " Developmental changes in visual and auditory contribution to speech perception., " J. Exp. Child Psychol. 41, 93-113.
32. Massaro, D. W., Tsuzaki, M., Cohen, M. M., Gesi, A., and Heredia, R. (1993). " Bimodal speech perception: An examination across languages., " J. Phonetics 21, 445-478.
33. Mayo, C., and Turk, A. (2004). " Adult-child differences in acoustic cue weighting are influenced by segmental context: Children are not always perceptually biased toward transitions., " J. Acoust. Soc. Am. 115, 3184-3194.
34. McGurk, H., and MacDonald, J. (1976). " Hearing lips and seeing voices., " Nature (London) 264, 746-748.
35. Navarro-Tomás, T. (1977). Manual de pronunciación española (Handbook of Spanish Pronunciation), 19th ed. Consejo Superior de Investigaciones Científicas (Publicaciones de la Revista de Filología Española, Madrid, Spain).
36. Nielsen, K. (2004). " Segmental differences in the visual contribution to speech intelligibility., " Proc. INTERSPEECH-2004, 2533-2536.
37. Nittrouer, S., and Miller, M. E. (1997). " Predicting developmental shifts in perceptual weighting schemes., " J. Acoust. Soc. Am. 101, 2253-2266.
38. O'Connor, J. D. (1967). Better English Pronunciation (Cambridge University Press, Cambridge).
39. Ortega-Llebaria, M., Faulkner, A., and Hazan, V. (2001). " Auditory-visual L2 speech perception: Effects of visual cues and acoustic-phonetic context for Spanish learners of English., " Proc. AVSP-2001, 149-154.
40. Patterson, M. L., and Werker, J. F. (1999). " Matching phonetic information in lips and voices is robust in 4.5-month -old infants., " Infant Behav. Dev. 22, 237-247.
41. Patterson, M. L., and Werker, J. F. (2003). " Two-month-old infants match phonetic information in lips and voice., " Dev. Science 6, 191-196.
42. Prieto, P. (2004). Foǹtica i Fonologia. Els Sons del Catal̀ (Phonetics and Phonology: the sounds of Catalan). Editorial UOC.
43. Quilis, A. (1993). Tratato de Fonología y Fońtica Españolas (Manual of Spanish Phonology and Phonetics). (Gredos, Madrid).
44. Sekiyama, K. (1997). " Cultural and linguistic factors in audiovisual speech processing: The McGurk effect in Chinese subjects., " Percept. Psychophys. 59, 73-80.
45. Sekiyama, K., and Tohkura, Y. (1993). " Inter-language differences in the influence of visual cues in speech perception., " J. Phonetics 21, 427-444.
46. Sekiyama, K., Burnham, D., Tam, H., and Erdener, D. (2003). " Auditory-visual speech perception development in Japanese and English speakers., " Proc. AVSP 2003, 43-47.
47. Sekiyama, K., Tohkura, Y., and Umeda, M. (1996). " A few factors which affect the degree of incorporating lip-read information into speech perception., " Proc. ICSLP1996, 1481-1484.
48. Sumby, W. H., and Pollack, I. (1954). " Visual contribution to speech intelligibility in noise., " J. Acoust. Soc. Am. 26, 212-215.
49. Summerfield, Q. (1983). " Audio-visual speech perception, lipreading and artificial stimulation., " in Hearing Science and Hearing Disorders, edited by, M. E. Lutman, and, M. P. Haggard, (Academic, London), pp. 131-182.
50. Walden, B., Prosek, R., Montgomery, A., Scherr, C. K., and Jones, C. J. (1977). " Effects of training on the visual recognition of consonants., " J. Speech Hear. Res. 20, 130-145.
51. Wei, J., Faulkner, A., and Fourcin, A. J. (1991). " An application of speech processing and encoding scheme for Chinese lexical tone and consonant perception by hearing impaired listeners., " Proc. Eurospeech"91, Genova, Italy.
52. Werker, J., and Tees, R. (1984). " Cross-language speech perception-evidence for perceptual reorganization during the first year of life., " Infant Behav. Dev. 7, 49-63.
53. Yamada, R. A. (1995). " Age of acquisition of second language speech sounds: Perception of American English., " in Speech Perception and Linguistic Experience, edited by, W. Strange, (York, Baltimore), pp. 305-320.