The effect of phonetic production training with visual feedback on the perception and production of foreign speech sounds

Journal of the Acoustical Society of America

Volumn 138, Issue 2, 2015, Pages 817-832

  Kartushina, Natalia ^a   Hervais Adelman, Alexis ^a   Frauenfelder, Ulrich Hans ^a   Golestani, Narly ^a  

^a UNIVERSITY OF GENEVA   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTIC PROPERTIES; VISUAL COMMUNICATION;

ACOUSTIC DISTANCE; CORRELATIONAL ANALYSIS; EXPERIMENTAL GROUPS; NON-NATIVE SPEAKERS; PRODUCTION PERFORMANCE; REAL TIME ANALYSIS; SECOND LANGUAGE LEARNERS; VOWEL DISCRIMINATION;

LINGUISTICS;

ADULT; BIOLOGICAL MODEL; COMPUTER SYSTEM; EDUCATION; FEMALE; HEARING; HUMAN; LANGUAGE; MALE; MULTILINGUALISM; PHONETICS; PHOTOSTIMULATION; PHYSIOLOGY; PSYCHOLOGICAL MODEL; PSYCHOMOTOR PERFORMANCE; SENSORY FEEDBACK; YOUNG ADULT;

ADULT; AUDITORY PERCEPTION; COMPUTER SYSTEMS; EDUCATION; FEEDBACK, SENSORY; FEMALE; HUMANS; LANGUAGE; MALE; MODELS, NEUROLOGICAL; MODELS, PSYCHOLOGICAL; MULTILINGUALISM; PHONETICS; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; YOUNG ADULT;

EID: 84939839186     PISSN: 00014966     EISSN: None     Source Type: Journal    
DOI: 10.1121/1.4926561     Document Type: Article

References (46)

1. Akahane-Yamada, R., McDermott, E., Adachi, T., Kawahara, H., and Pruitt, J.-S. (1998). "Computer-based second language production training by using spectrographic representation and HMM-based speech recognition scores," Proc. Interspeech 5, 1-4.
2. Alario, F. X., Goslin, J., Michel, V., and Laganaro, M. (2010). "The functional origin of the foreign accent: Evidence from the syllable-frequency effect in bilingual speakers," Psychol. Sci. 21 (1), 15-20. 10.1177/0956797609354725
3. Aliaga-García, C., and Mora, J. C. (2009). "Assessing the effects of phonetic training on L2 sound perception and production," in Recent Research in Second Language Phonetics/Phonology: Perception and Production, edited by M. A. Watkins, A. S. Rauber, and B. O. Baptista (Cambridge Scholars Publishing, Newcastle upon Tyne, UK), pp. 2-31.
4. Barr, D. J., Levy, R., Scheepers, C., and Tily, H. J. (2013). "Random effects structure for confirmatory hypothesis testing: Keep it maximal," J. Memory Lang. 68 (3), 255-278. 10.1016/j.jml.2012.11.001
5. Basbøl, H. (2005). The Phonology of Danish (Oxford University Press, New York), pp. 86-92.
6. Best, C. T. (1995). "A direct cross-realist view of cross-language speech perception," in Speech Perception and Linguistic Experience: Theoretical and Methodological Issues, edited by W. Strange (York Press, Baltimore, MD), pp. 171-204).
7. Boersma, P., and Weenink, D. (2010). "Praat: Doing phonetics by computer," [Computer program]. Version 5.2, http://www.praat.org/ (Last viewed October 19, 2010).
8. Bradlow, A. R., Pisoni, D. B., Akahane-Yamada, R., and Tohkura, Y. (1997). "Training Japanese listeners to identify English /r/ and /l/: IV. Some effects of perceptual learning on speech production," J. Acoust. Soc. Am. 101 (4), 2299-2310. 10.1121/1.418276
9. Carey, M. (2004). "CALL visual feedback for pronunciation of vowels: Kay Sona-Match," CALICO J. 21 (3), 571-601.
10. Catford, J. C., and Pisoni, D. B. (1970). "Auditory vs. articulatory training in exotic sounds," Modern Lang. J. 54 (7), 477-481. 10.2307/321767
11. Darcy, I., Dekydtspotter, L., Sprouse, R. A., Glover, J., Kaden, C., McGuire, M., and Scott, J. H. (2012). "Direct mapping of acoustics to phonology: On the lexical encoding of front rounded vowels in L1 English-L2 French acquisition," Second Lang. Res. 28 (1), 5-40. 10.1177/0267658311423455
12. Davis, M. H., Di Betta, A. M., Macdonald, M. J., and Gaskell, M. G. (2009). "Learning and consolidation of novel spoken words," J. Cogn. Neurosci. 21 (4), 803-820. 10.1162/jocn.2009.21059
13. Delvaux, V., Huet, K., Piccaluga, M., and Harmegnies, B. (2013). "Production training in Second Language Acquisition: A comparison between objective measures and subjective judgments," Proc. Interspeech 14, 2375-2379.
14. Dowd, A., Smith, J., and Wolfe, J. (1998). "Learning to pronounce vowel sounds in a foreign language using acoustic measurements of the vocal tract as feedback in real time," Lang. Speech 41 (1), 1-20. 10.1177/002383099804100101
15. Escudero, P., and Boersma, P. (2004). "Bridging the gap between L2 speech perception research and phonological theory," Stud. Second Lang. Acquisit. 26 (04), 551-585. 10.1017/S0272263104040021
16. Flege, J. E. (1995). "Second language speech learning theory, findings, and problems," in Speech Perception and Linguistic Experience: Issues in Cross-Language Research, edited by W. Strange (York Press, Timonium, MD), pp. 233-277.
17. Flege, J. E. (2002). "Interactions between the native and second-language phonetic systems," in An Integrated View of Language Development: Papers in Honor of Henning Wode, edited by P. Burmeister, T. Piske, and A. Rohde (Wissenschaftlicher Verlag Trier, Trier), pp. 217-243.
18. Flege, J. E., MacKay, I. R., and Meador, D. (1999). "Native Italian speakers' perception and production of English vowels," J. Acoust. Soc. Am. 106 (5), 2973-2987. 10.1121/1.428116
19. Georgeton, L., Paillereau, N., Landron, S., Gao, J., and Kamiyama, T. (2012). "Analyse formantique des voyelles orales du français en contexte isolé: à la recherche d'une référence pour les apprenants de FLE (Formant analysis of the French oral vowels in isolated context: In a quest of a reference for French learners)," in Proceedings of JEP-TALN-RECITAL, pp. 145-152.
20. Golestani, N., and Pallier, C. (2007). "Anatomical correlates of foreign speech sound production," Cerebral Cortex 17 (4), 929-934. 10.1093/cercor/bhl003
21. Grønnum, N. (1997). "Danish vowels: The psychological reality of a morphophonemic representation," Proc. Journée dáEtudes Linguistiques [A day of Linguistic Studies] pp. 91-97.
22. Guenther, F. H. (1994). "A neural network model of speech acquisition and motor equivalent speech production," Biol. Cybern 72 (1), 43-53. 10.1007/BF00206237
23. Hu, X., Ackermann, H., Martin, J. A., Erb, M., Winkler, S., and Reiterer, S. M. (2013). "Language aptitude for pronunciation in advanced second language (L2) learners: Behavioural predictors and neural substrates," Brain Lang. 127 (3), 366-376. 10.1016/j.bandl.2012.11.006
24. Ingram, J. C., and Park, S.-G. (1997). "Cross-language vowel perception and production by Japanese and Korean learners of English," J. Phonetics 25 (3), 343-370. 10.1006/jpho.1997.0048
25. Kartushina, N., and Frauenfelder, U. H. (2014). "On the effects of L2 perception and of individual differences in L1 production on L2 pronunciation," Frontiers Psychol. 5 (1246), 1-17. 10.3389/fpsyg.2014.01246
26. Lametti, D. R., Rochet-Capellan, A., Neufeld, E., Shiller, D. M., and Ostry, D. J. (2014). "Plasticity in the human speech motor system drives changes in speech perception," J. Neurosci. 34 (31), 10339-10346. 10.1523/JNEUROSCI.0108-14.2014
27. Leather, J. (1996). "Interrelation of perceptual and productive learning in the initial acquisition of second-language tone," in Second-Language Speech: Structure and Process, edited by A. James and J. Leather (Mouton de Gruyter, Berlin), pp. 75-101.
28. Liberman, A. M., and Mattingly, I. G. (1985). "The motor theory of speech perception revised," Cognition 21 (1), 1-36. 10.1016/0010-0277(85)90021-6
29. Lively, S. E., Logan, J. S., and Pisoni, D. B. (1993). "Training Japanese listeners to identify English/r/and/l/. II: The role of phonetic environment and talker variability in learning new perceptual categories," J. Acoust. Soc. Am. 94 (3 Pt 1), 1242-1255. 10.1121/1.408177
30. Loizou, P. (1998). "COLEA: A MATLAB software tool for speech analysis," Dallas, TX. Available at http://ecs.utdallas.edu/loizou/speech/colea.htm (Last viewed October 4, 2011).
31. Lopez-Soto, T., and Kewley-Port, D. (2009). "Relation of perception training to production of codas in English as a Second Language," J. Acoust. Soc. Am. 125, 2756. 10.1121/1.4784637
32. Massaro, D. W., Bigler, S., Chen, T. H., Perlman, M., and Ouni, S. (2008). "Pronunciation training: The role of eye and ear," Proc. Interspeech 9, 2623-2626.
33. Ménard, L., Schwartz, J.-L., Boë, L.-J., Kandel, S., and Vallée, N. (2002). "Auditory normalization of French vowels synthesized by an articulatory model simulating growth from birth to adulthood," J. Acoust. Soc. Am. 111 (4), 1892-1905. 10.1121/1.1459467
34. Öster, A.-M. (1997). "Auditory and visual feedback in spoken L2 teaching," in Reports from the Department of Phonetics, Umeå University, PHONUM 4, 145-148.
35. Pallier, C., Colomé, A., and Sebastián-Gallés, N. (2001). "The influence of native-language phonology on lexical access: Exemplar-based versus abstract lexical entries," Psychol. Sci. 12 (6), 445-449. 10.1111/1467-9280.00383
36. Peperkamp, S., and Bouchon, C. (2011). "The relation between perception and production in L2 phonological processing," Proc. Interspeech 12, 161-164.
37. Perrachione, T. K., Lee, J., Ha, L. Y. Y., and Wong, P. C. M. (2011). "Learning a novel phonological contrast depends on interactions between individual differences and training paradigm design," J. Acoust. Soc. Am. 130 (1), 461-472. 10.1121/1.3593366
38. Pillot-Loiseau, C., Antolík Kocjančič, T., and Kamiyama, T. (2013). "Contribution of ultrasound visualisation to improving the production of the French /y/-/u/ contrast by four Japanese learners," in Proceedings of the PPLC13: Phonetics, Phonology, Languages in Contact. Contact Varieties, Multilingualism, Second Language Learning, pp. 86-89.
39. Piske, T., MacKay, I. R., and Flege, J. E. (2001). "Factors affecting degree of foreign accent in an L2: A review," J. Phon. 29 (2), 191-215. 10.1006/jpho.2001.0134
40. Saito, K., and Lyster, R. (2012). "Effects of form-focused instruction and corrective feedback on L2 pronunciation development of /r/ by Japanese Learners of English," Lang. Learn. 62 (2), 595-633. 10.1111/j.1467-9922.2011.00639.x
41. Sheldon, A., and Strange, W. (1982). "The acquisition of /r/ and /l/ by Japanese learners of English: Evidence that speech production can precede speech perception," Appl. Psycholinguist. 3 (3), 243-261. 10.1017/S0142716400001417
42. Simmonds, A. J., Wise, R. J. S., Dhanjal, N. S., and Leech, R. (2011). "A comparison of sensory-motor activity during speech in first and second languages," J. Neurophys. 106 (1), 470-478. 10.1152/jn.00343.2011
43. Steinlen, A. K. (2005). The Influence of Consonants on Native and Non-native Vowel Production: A Cross-Linguistic Study (Gunter Narr Verlag, Tübingen), pp. 71-117.
44. Wik, P. (2004). "Designing a virtual language tutor," in Proceedings of the XVIIth Swedish Phonetics Conference, Fonetik, pp. 136-139.
45. Wilson, S. M., and Gick, B. (2006). "Ultrasound technology and second language acquisition research," Proc. Generative Approach. Second Lang. Acquisit. 8, 148-152.
46. Wong, J. W. S. (2013). "The effects of perceptual and or productive training on the perception and production of English vowels /I/ and /i:/ by Cantonese ESL learners," Proc. Interspeech 14, 2113-2117.