Influence of native language phonetic system on audio-visual speech perception

Journal of Phonetics

Volumn 37, Issue 3, 2009, Pages 344-356

  Wang, Yue ^a   Behne, Dawn M ^b   Jiang, Haisheng ^a  

^a SIMON FRASER UNIVERSITY   (Canada)

^b NORWEGIAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Norway)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 68249116827     PISSN: 00954470     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.wocn.2009.04.002     Document Type: Article

References (73)

1. Benguerel A.P., and Pichora-Fuller M.K. Coarticulation effects in lipreading. Journal of Speech and Hearing Research 25 (1982) 600-607
2. Bernstein L.E., Auer E., and Takayanagi S. Auditory speech detection in noise enhanced by lipreading. Speech Communication 44 (2004) 5-18
3. Best C.T. A direct realist view of cross-language speech perception. In: Strange W. (Ed). Speech perception and linguistic experience: Issues in cross-language research (1995), York, Baltimore 171-204
4. Best C.T., and Tyler M.D. Nonnative and second language speech perception: Commonalities and complementarities. In: Bohn O.-S., and Munroe M.J. (Eds). Language experience in second language speech learning: In honor of James Emil Flege (2007), John Benjamins, Amsterdam/Philadelphia
5. Binnie C.A., Montgomeery A.A., and Jackson P.L. Auditory and visual contributions to the perception of consonants. Journal of Speech and Hearing Research 17 (1974) 619-630
6. Burnham D., and Dodd B. Familiarity and novelty in infant cross-language studies: Factors, problems, and a possible solution. In: Rovee-Collier C. (Ed). Advances in infancy research (1998) 170-187
7. Burnham D., and Dodd B. Auditory-visual speech integration by prelinguistic infants: Perception of an emergent consonant in the McGurk effect. Developmental Psychobiology 45 (2004) 204-220
8. Burnham D., Lau S., Tam H., and Schoknecht C. Visual discrimination of Cantonese tone by tonal but non-Cantonese speakers, and by non-tonal language speakers. In: Massaro D., Light J., and Geraci K. (Eds). Proceedings of the international conference on auditory-visual speech processing (2001) 155-160
9. Chen, Y., & Hazan, V. (2007). Language effects on the degree of visual influence in audiovisual speech perception. In Proceedings of the 16th international congress of phonetic sciences (pp. 2177-2180). Saarbrueken, Germany.
10. Chen T., and Massaro D.W. Mandarin speech perception by ear and eye follows a universal principle. Perception and Psychophysics 66 (2004) 820-836
11. Cienkowski K.M., and Carney A.E. Auditory-visual speech perception and aging. Ear and Hearing 23 (2002) 439-449
12. Daniloff R.G., and Moll K. Coarticulation of lip rounding. Journal of Speech and Hearing Research 11 (1968) 707-721
13. Davis C., and Kim J. Audio--visual interactions with intact clearly audible speech. Quarterly Journal of Experimental Psychology 57A (2004) 1103-1121
14. De Gelder B., and Vroomen J. Auditory and visual speech perception in alphabetic and non-alphabetic Chinese/Dutch bilinguals. In: Harris R.J. (Ed). Cognitive processing in Bilinguals (1992), Elsevier, Amsterdam 413-426
15. Dodd B. The role of vision in the perception of speech. Perception 6 (1977) 31-40
16. Erber N.P. Interaction of audition and vision in the recognition of oral speech stimuli. Journal of Speech Language and Hearing Research 12 (1969) 423-425
17. Erdener V., and Burnham D. The role of audiovisual speech and orthographic information in nonnative speech production. Language Learning 55 (2005) 191-228
18. Faulkner A., and Rosen S. Contributions of temporal encodings of voicing, voicelessness, fundamental frequency, and amplitude variation to audio-visual and auditory speech perception. Journal of the Acoustical Society of America 106 (1999) 2063-2073
19. Flege J.E. Phonetic approximation in second language acquisition. Language Learning 30 (1980) 117-134
20. Flege J.E. Second language speech learning: Theory, findings, and problems. In: Strange W. (Ed). Speech perception and linguistic experience (1995), York, Baltimore 233-273
21. Flege J.E. Language contact in bilingualism: Phonetic system interactions. In: Cole J., and Hualde J. (Eds). Laboratory phonology Vol. 9 (2007), Mouton de Gruyter, Berlin
22. Flege J.E., Yeni-Komshian G., and Liu S. Age constraints on second language learning. Journal of Memory and Language 41 (1999) 78-104
23. Green K.P., and Kuhl P.K. The role of visual information in the processing of place and manner features in speech perception. Perception and Psychophysics 45 (1989) 34-42
24. Guion S.G., and Pederson E. Investigating the role of attention in phonetic learning. In: Bohn O.-S., and Munro M. (Eds). Language experience in second language speech learning (2007), John Benjamins, Amsterdam 57-77
25. Hardison D.M. Second-language spoken word identification: Effects of perceptual training, visual cues, and phonetic environment. Language Learning 49 (1999) 213-283
26. Hardison D.M. Acquisition of second-language speech: Effects of visual cues, context, and talker variability. Applied Psycholinguistics 24 (2003) 495-522
27. Hardison D.M. Second-language spoken word identification: Effects of perceptual training, visual cues, and phonetic environment. Applied Psycholinguistics 26 (2005) 579-596
28. Hardison D.M. Variability in bimodal spoken language processing by native and nonnative speakers of English: A closer look at effects of speech style. Speech Communication 46 (2005) 73-93
29. Hayashi, Y., & Sekiyama, K. (1998). Native-foreign language effect in the McGurk effect: A test with Chinese and Japanese. In AVSP-1998 (pp. 61-66).
30. Hazan A., Sennema A., Iba M., and Faulkner A. Effect of audiovisual perceptual training on the perception and production of consonants by Japanese learners of English. Speech Communication 47 (2005) 360-378
31. Hazan V., Sennema A., Faulkner A., and Ortega-Llebaria M. The use of visual cues in the perception of non-native consonant contrasts. Journal of the Acoustical Society of America 119 (2006) 1740-1751
32. Jongman A., Wang Y., and Kim B. Contributions of semantic and facial information to perception of nonsibilant fricatives. Journal of Speech Language and Hearing Research 46 (2003) 1367-1377
33. Jongman A., Wayland R., and Wong S. Acoustic characteristics of English fricatives. Journal of the Acoustical Society of America 108 (2000) 1252-1263
34. Kang S., and Lee H. An experimental study on English word-Initial consonant pronunciation learning by Korean students. Ohak Yonku/Language Research 38 (2002) 385-406
35. Kim D.J. A contrastive study of English and Korean phonology. Language Teaching 5 (1972) 1-36
36. Kuhl P.K., and Meltzoff A.N. The bimodal perception of speech in infancy. Science 218 (1982) 1138-1141
37. Ladefoged P., and Wu Z. Places of articulation: An investigation of Pekingese fricatives and affricates. Journal of Phonetics 12 (1984) 267-278
38. Lansing C.R., and McConkie G.W. Attention to facial regions in segmental and prosodic visual speech perception tasks. Journal of Speech, Language, and Hearing Research 42 (1999) 526-539
39. Lehiste I. Suprasegmentals (1970), The MIT Press, Cambridge, MA
40. Massaro D.W. Perceiving talking faces: From speech perception to a behavioral principle (1998), The MIT Press, Cambridge, MA
41. Massaro, D. W. (2001). Auditory visual speech processing. In Proceedings of the 7th European conference on speech communication and technology-Eurospeech 2001.
42. Massaro D.W., Tsuzaki M., Cohen M.M., Gesi A., and Heredia R. Bimodal speech perception: An examination across language. Journal of Phonetics 21 (1993) 445-478
43. McAllister R., Flege J., and Piske T. The influence of L1 on the acquisition of Swedish quantity by native speakers of Spanish, English, and Estonian. Journal of Phonetics 30 (2002) 229-258
44. McGurk, H., & Buchanan, L. (1981). Bimodal speech perception: Vision and hearing. Unpublished manuscript, Department of Psychology, University of Surrey.
45. McGurk H., and MacDonald J. Hearing lips and seeing voices. Nature 264 (1976) 746-748
46. McGurk H., and MacDonald J. Visual influences on speech perception processes. Perception and Psychophysics 24 (1978) 253-257
47. Nábelek A.K., and Robinson P.K. Monaural and binaural speech perception in reverberation for listeners of various ages. Journal of the Acoustical Society of America 71 (1982) 1242-1248
48. Navarra J., and Soto-Faraco S. Hearing lips in a second language: Visual articulatory information enables the perception of L2 sounds. Psychological Research 71 (2007) 4-12
49. Ortega-Llebaria M., Faulkner A., and Hazan V. Auditory-visual L2 speech perception: Effects of visual cues and acoustic-phonetic context for Spanish learners of English. In: Massaro D., Light J., and Geraci K. (Eds). Proceedings of the international conference on auditory-visual speech processing (2001) 149-154
50. Patterson M.L., and Werker J.F. Matching phonetic information in lips and voice is robust in 4.5-month-old infants. Infant Behavioral Development 22 (1999) 237-247
51. Patterson M.L., and Werker J.F. Two-month-old infants match phonetic information in lips and voice. Developmental Science 6 (2003) 191-196
52. Reisberg D., McLean J., and Goldfield A. Easy to hear but hard to understand: A lip-reading advantage with intact auditory stimuli. In: Dodd B., and Campbell R. (Eds). Hearing by eye: The psychology of lip-reading (1987), Erlbaum, London 97-113
53. Riney T.J., and Flege J.E. Changes over time in global foreign accent and liquid identifiability and accuracy. Studies in Second Language Acquisition 20 (1998) 213-244
54. Sams M., Manninen P., Surakka V., Helin P., and Katto R. McGurk effect in Finnish syllables, isolated words, and words in sentences: Effects of word meaning and sentence context. Speech Communication 26 (1998) 75-87
55. Schmidt A.M. Cross-language identification of consonants, Part 1: Korean perception of English. Journal of the Acoustical Society of America 99 (1996) 3201-3211
56. Sekiyama K. Differences in auditory-visual speech perception between Japanese and Americans: McGurk effect as a function of incompatibility. Journal of the Acoustical Society of Japan (E) 15 (1994) 143-158
57. Sekiyama K. Cultural and linguistic factors in audiovisual speech processing: The McGurk effect in Chinese subjects. Perception and Psychophysics 59 (1997) 73-80
58. Sekiyama K., and Tohkura Y. McGurk effect in non-English listeners: Few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility. Journal of the Acoustical Society of America 90 (1991) 1797-1805
59. Sekiyama K., and Tohkura Y. Inter-language differences in the influence of visual cues in speech perception. Journal of Phonetics 21 (1993) 427-444
60. Sekiyama K., Kanno I., Miura S., and Sugita Y. Auditory-visual speech perception examined by fMRI and PET. Neuroscience Research 47 (2003) 277-287
61. Sekiyama, K., Tohkura, Y., & Umeda, M. (1996). A few factors which affect the degree of incorporating lip-read information into speech perception. In Proceedings of the 4th International Conference on Spoken Language Processing (pp. 1481-1484). Philadelphia, PA.
62. Soto-Faraco S., Navarra J., Voloumanos A., Sebastián-Gallés N., Weikum, and Werker J.F. Discriminating languages by speechreading. Perception and Psychophysics 69 (2007) 218-231
63. Strange W. Levels of abstraction in characterizing cross-language phonetic similarity. In: Ohala J., Hasegawa Y., Ohala M., Granville D., and Bailey A. (Eds). Proceedings of the XIVth international congress of phonetic sciences (1999), University of California at Berkeley 2513-2519
64. Strange W., Yamada R., Kubo R., Trent S., and Nishi K. Effects of consonantal context on perceptual assimilation of American English vowels by Japanese listeners. Journal of the Acoustical Society of America 109 (2001) 1691-1704
65. Sumby W., and Pollack I. Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America 26 (1954) 212-215
66. Summerfield Q. Use of visual information for phonetic perception. Phonetica 36 (1979) 314-331
67. Svantesson J.O. Acoustic analysis of Chinese fricatives and affricates. Journal of Chinese Linguistics 14 (1986) 53-70
68. Takata Y., and Nábelek A.K. English consonant recognition in noise and in reverberation by Japanese and American listeners. Journal of the Acoustical Society of America 88 (1990) 663-666
69. Tse J.K. A spectrographic analysis of the coronal affricates and fricatives in Mandarin Chinese. Ying Yu Yen Chiu Chi K'an/Studies in English Literature and Linguistics 14 (1988) 149-199
70. Wang Y., Behne D., and Jiang H. Linguistic experience and audio-visual perception of nonnative fricatives. Journal of the Acoustical Society of America 124 (2008) 1716-1726
71. Weikum W.M., Vouloumanos A., Navarra J., Soto-Faraco S., Sebastián-Gallés N., and Werker J.F. Visual language discrimination in infancy. Science 25 (2007) 1159
72. Werker J.F., Frost P.E., and McGurk H. La langue et les levres: Cross-language influences on bimodal speech perception. Canadian Journal of Psychology 46 (1992) 551-568
73. Woodward M.F., and Barber C.G. Phoneme perception in lip reading. Journal of Speech and Hearing Research 3 (1960) 212-222