Effect of audiovisual perceptual training on the perception and production of consonants by Japanese learners of English

Speech Communication

Volumn 47, Issue 3, 2005, Pages 360-378

  Hazan, Valerie ^a   Sennema, Anke ^a   Iba, Midori ^b   Faulkner, Andrew ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b KONAN UNIVERSITY   (Japan)

Author keywords

Audiovisual perception; Perceptual training; Second language acquisition

Indexed keywords

PERSONNEL TRAINING; SPEECH ANALYSIS; SPEECH COMMUNICATION;

AUDIOVISUAL PERCEPTION; PERCEPTUAL TRAINING; SECOND LANGUAGE ACQUISITION;

SENSORY PERCEPTION;

EID: 26444551117     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2005.04.007     Document Type: Article

References (53)

1. K. Aoyama, J.E. Flege, S.G. Guion, R. Akahane-Yamada, and T. Yamada Perceived phonetic dissimilarity and L2 speech learning: the case of Japanese /r/ and English /l/ and /r/ J. Phonetics 32 2004 233 250
2. C. Best A direct realist view of cross-language speech perception W. Strange Speech Perception and Linguistic Experience: Theoretical and Methodological Issues 1995 York Press Baltimore 171 204
3. C. Best, G. McRoberts, and E. Goodell Discrimination of non-native consonant contrasts varying in perceptual assimilation to the listener's native phonological system J. Acoust. Soc. Amer. 109 2001 775 794
4. A. Bradlow, D. Pisoni, R. Akahane-Yamada, and Y. Tohkura Training Japanese listeners to identify English /r/ and /l/: IV. Some effects of perceptual learning on speech production J. Acoust. Soc. Amer. 101 1997 2299 2310
5. Cole, R., Massaro, D.W., de Villiers, J., Rundle, B., Shobaki, K., Wouters, J., Cohen, M., Beskow, J., Stone, P., Connors, Tarachow, A., Solcher, D., 1999. New tools for interactive speech and language training: using animated conversational agents in the classroom of profoundly deaf children. In: Proc. ITRW Methods and Tools in Speech Science Education (MATISSE), London, pp. 45-52.
6. M.E. Demorest, L.E. Bernstein, and G.P. DeHaven Generalizability of speechreading performance on nonsense syllables, words, and sentences: subjects with normal hearing J. Speech Hear. Res. 39 1996 697 713
7. J.E. Flege Second-language speech learning: theory, findings, and problems W. Strange Speech Perception and Linguistic Experience: Theoretical and Methodological Issues 1995 York Press Baltimore 229 273
8. Flege, J.E., 1998. Second-language learning: the role of subject and phonetic variables. In: Proc. StiLL ESCA Workshop, Stockholm, May 1998, pp. 1-8.
9. J.E. Flege Age of learning and second-language speech D.P. Birdsong Second Language Acquisition and the Critical Period Hypothesis 1999 Lawrence Erlbaum Hillsdale, NJ 101 132
10. C. Fowler An event approach to the study of speech perception from a direct-realist perspective J. Phonetics 14 1986 3 28
11. J.-P. Gagné, A.-J. Rochette, and M. Charest Auditory, visual and audiovisual clear speech Speech Comm. 37 2002 213 230
12. K.W. Grant, and P.F. Seitz Measures of auditory-visual integration in nonsense syllables and sentences J. Acoust. Soc. Amer. 104 1998 2438 2450
13. S.G. Guion, J.E. Flege, R. Ahahane-Yamada, and J.C Pruitt An investigation of current models of second language speech perception: the case of Japanese adults' perception of English consonants J. Acoust. Soc. Amer. 107 2000 2711 2725
14. D. Hardison Bimodal speech perception by native and nonnative talkers of English: factors influencing the McGurk effect Lang. Learn. 49 1999 213 283
15. D. Hardison Acquisition of second-language speech: effects of visual cues, context and talker variability Appl. Psycholinguist. 24 2003 495 522
16. V. Hazan, and S. Barrett The development of phonemic categorisation in children aged 6-12 J. Phonetics 28 2000 377 396
17. V. Hazan, and A. Simpson The effect of cue-enhancement on consonant intelligibility in noise: talker and listener effects Lang. Speech 43 2000 273 294
18. J.C.L. Ingram, and S.-G. Park Language, context, and speaker effects in the identification and discrimination of English /r/ and /l/ by Japanese and Korean listeners J. Acoust. Soc. Amer. 103 1998 1161 1174
19. P. Iverson, P.K. Kuhl, R. Akahane-Yamada, E. Diesch, Y. Tohkura, A. Kettermann, and C. Siebert A perceptual interference account of acquisition difficulties for non-native phonemes Cognition 87 2003 B47 B57
20. P.K. Kuhl Early linguistic experience and phonetic perception: implications for theories of developmental speech perception J. Phonetics 21 1993 125 139
21. P.K. Kuhl, and A.N. Meltzoff The bimodal perception of speech in infancy Science 218 1982 1138 1141
22. Lambacher, S., Martens, W., Kakeki, K., 2002. The influence of identification training on identification and production of the American English mid and low vowels by native talkers of Japanese. In: Proc. 7th Internat. Conf. on Spoken Lang. Proc., Denver, pp. 245-248.
23. E.H. Lenneberg Biological Foundations of Language 1967 John Wiley and Sons Inc New York
24. S. Lively, J. Logan, and D. Pisoni Training Japanese listeners to identify English /r/ and /l/. ll: the role of phonetic environments and talker variability in learning new perceptual categories J. Acoust. Soc. Amer. 94 1993 1242 1255
25. S.E. Lively, J.S. Logan, and D.B. Pisoni Training Japanese listeners to identify English /r/ and /l/. III: long- term retention of new phonetic categories J. Acoust. Soc. Amer. 96 1994 2076 2087
26. J.S. Logan, S.E. Lively, and D.B. Pisoni Training Japanese listeners to identify English /r/ and /l/: a first report J. Acoust. Soc. Amer. 89 1991 874 886
27. Lotto, A.J., Sato, M., Diehl, R.L., 2004. Mapping the task for the second language learner: the case for Japanese acquisition of /r/ and /l/. In: J. Slifka, S. Manuel, M. Matthies (Eds.), From Sound to Sense: 50+ years of Discoveries in Speech Communication, pp. C381-C386.
28. L.K. Marassa, and C.R. Lansing Visual word recognition in 2 facial motion conditions-full face versus lips-plus-mandible J. Speech Hear. Res. 38 1995 1387 1394
29. D.W. Massaro Perceiving Talking Faces: from Speech Perception to a Behavioral Principle 1998 MIT Press Cambridge, MA
30. Massaro, D.W., Cole, R. 2000. From Speech is special to talking heads in language learning. In: Proc. INSTIL, Dundee, Scotland, 153-161.
31. Massaro, D.W., Light, J., 2003. Read my tongue movements: bimodal learning to perceive and produce non-native speech /r/ and /l/. In: Proc. Eurospeech 2003, Geneva, Switzerland, pp. 2249-2252.
32. D.W. Massaro, and J. Light Using visible speech to train perception and production of speech for individuals with hearing loss J. Speech Lang. Hear. Res. 47 2004 304 320
33. D.W. Massaro, L.A. Thompson, B. Barron, and E. Laren Developmental changes in visual and auditory contribution to speech perception J. Exp. Child Psychol. 41 1986 93 113
34. L.H. Mayo, M. Florentine, and S. Buus Age of second-language acquisition and perception of speech in noise J. Speech Lang. Hear. Res. 40 1997 686 693
35. C. Mayo, and A. Turk Adult-child differences in acoustic cue weighting are influenced by segmental context: Children are not always perceptually biased toward transitions J. Acoust. Soc. Amer. 115 2004 3184 3194
36. H. McGurk, and J. MacDonald Hearing lips and seeing voices Nature 264 1976 746 748
37. S. Nittrouer, and M.E. Miller Predicting developmental shifts in perceptual weighting schemes J. Acoust. Soc. Amer. 101 1997 2253 2266
38. Ortega-Llebaria, M., Faulkner, A., Hazan, V., 2001. Auditory-visual L2 speech perception: effects of visual cues and acoustic-phonetic context for Spanish learners of English. In: Proc. AVSP-2001, pp. 149-154.
39. Ouni, S. Massaro, D.W., Cohen, M.M., Young, K., Jesse, A., 2003. Internationalization of a talking head. In: Proc. ICPhS, Barcelona, Spain, August 2003, pp. 2569-2572.
40. Sekiyama, K., Tohkura, Y., Umeda, M., 1996. A few factors which affect the degree of incorporating lip-read information into speech perception. In: Proc. ICSLP1996, Denver, USA, pp. 1481-1484.
41. K. Sekiyama, and Y. Tohkura Inter-language differences in the influence of visual cues in speech perception J. Phonetics 21 1993 427 444
42. K. Sekiyama Cultural and linguistic factors in audiovisual speech processing: the McGurk effect in Chinese subjects Percept. Psychophys. 59 1997 73 80
43. Sekiyama, K., Burnham, D., Tam, H., Erdener, D., 2003. Auditory-visual speech perception development in Japanese and English talkers. In: Proc. AVSP 2003, St. Jorioz, France, September 2003, pp. 43-47.
44. Sennema, A., Hazan, V., Faulkner, A., 2003. The role of visual cues in L2 consonant perception. In: Proc. 15th ICPhS, Barcelona, Spain, August 2003, pp. 135-138.
45. Siciliano, C., Faulkner, A., Williams, G., 2003. Lipreadability of a synthetic talking face in normal hearing and hearing-impaired listeners. In: Proc. AVSP 2003, St. Jorioz, France, September 2003, pp. 205-208.
46. W.H. Sumby, and I. Pollack Visual contribution to speech intelligibility in noise J. Acoust. Soc. Amer. 26 1954 212 215
47. Q. Summerfield Audio-visual speech perception, lipreading and artificial stimulation M.E. Lutman M.P. Haggard Hearing Science and Hearing Disorders 1983 Academic Press London 131 182
48. Y. Takata, and A.K. Nabelek English consonant recognition in noise and in reverberation by Japanese and American listeners J. Acoust. Soc. Amer. 88 1990 663 666
49. M.D. Tyler Resource consumption as a function of topic knowledge in nonnative and native comprehension Lang. Learn. 51 2001 257 280
50. Y. Wang, M.M. Spence, A. Jongman, and J.A. Sereno Training American listeners to perceive Mandarin tones J. Acoust. Soc. Amer. 106 1999 3649 3658
51. Y. Wang, A. Jongman, and J.A. Sereno Acoustic and perceptual evaluation of Mandarin tone productions before and after perceptual training J. Acoust. Soc. Amer. 113 2003 1033 1043
52. J.F. Werker, and R.C. Tees Cross-language speech perception: evidence for perceptual reorganization during the first year of life Infant Behavior Develop. 7 1984 47 63
53. R.A. Yamada Age and acquisition of second language speech sounds: perception of American English /r/ and /l/ by native talkers of Japanese W. Strange Speech Perception and Linguistic Experience: Theoretical and Methodological Issues 1995 York Press Baltimore 305 320