On mispronunciation analysis of individual foreign speakers using auditory periphery models

Speech Communication

Volumn 55, Issue 5, 2013, Pages 691-706

  Koniaris, Christos ^a   Salvi, Giampiero ^a   Engwall, Olov ^a  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

Author keywords

Auditory model; Distortion measure; Perceptual assessment; Phoneme; Pronunciation error detection; Second language learning

Indexed keywords

AUDITORY MODELS; DISTORTION MEASURES; PERCEPTUAL ASSESSMENT; PHONEME; PRONUNCIATION ERROR DETECTION; SECOND LANGUAGE;

AUDITION;

SPEECH RECOGNITION;

EID: 84876245465     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2013.01.004     Document Type: Article

References (45)

1. J. Anderson-Hsieh, R. Johnson, and K. Koehler The relationship between native speaker judgments of nonnative pronunciation and deviance in segmentals, prosody, and syllable structure Lang. Learn. 42 1992 529 555
2. M.V. Andrianopoulos, K. Darrow, and J. Chen Multimodal standardization of voice among four multicultural populations formant structures J. Voice 15 2001 61 77
3. R. Bannert Problems in learning Swedish pronunciation and in understanding foreign accent Folia Linguistica 18 1984 193 222
4. A. Bregman Auditory Scene Analysis 1990 MIT Press Cambridge, MA 0-262-02297-4
5. S. Chatterjee, and W.B. Kleijn Auditory model-based design and optimization of feature vectors for automatic speech recognition IEEE Trans. Audio Speech Lang. Process. 19 2011 1813 1825
6. T. Dau, D. Püschel, and A. Kohlrausch A quantitative model of the effective signal processing in the auditory system. I. model structure J. Acoust. Soc. Amer. 99 1996 3615 3622
7. T. Dau, D. Püschel, and A. Kohlrausch A quantitative model of the effective signal processing in the auditory system. II. simulations and measurements J. Acoust. Soc. Amer. 99 1996 3623 3631
8. S.B. Davis, and P. Mermelstein Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences IEEE Trans. Acoust. Speech Signal Process 28 1980 357 366
9. R.L. Diehl, and K.R. Kluender On the objects of speech perception Ecol. Psychol. 1 1989 121 144
10. Digalakis, V.; 1992. Segment-based stochastic models of spectral dynamics for continuous speech recognition. Ph.D. Thesis. Boston University, Boston, MA, USA.
11. V. Digalakis, J.R. Rohlicek, and M. Ostendorf ML estimation of a stochastic linear system with the EM algorithm and its application to speech recognition IEEE Trans. Speech Audio Process. 1 1993 431 442
12. D.A. Eddins, and D.M. Green Temporal integration and temporal resolution In Hearing by B.C.J. Moore 1995 Academic Press San Diego, CA, USA 0-12-505626-5
13. Eskenazi, M.; Hansma, S.; 1998. The fluency pronunciation trainer. In: Speech Tech. Lang. Learn. Marholmen, Sweden, pp. 77-80.
14. J.E. Flege Second-language speech learning: Theory, findings, and problems W. Strange, Speech Perception and Linguistic Experience: Theoretical and Methodological Issues in Cross-Language Speech Research 1995 York Press Inc. Timonium, MD 233 272
15. H. Franco, H. Bratt, R. Rossier, V.R. Gadde, E. Shriberg, V. Abrash, and K. Precoda Eduspeak: A speech recognition and pronunciation scoring toolkit for computer-aided language learning applications Lang. Test. 27 2010 401 418
16. Franco, H.; Neumeyer, L.; Kim, Y.; Ronen, O.; 1997. Automatic pronunciation scoring for language instruction, in: IEEE Internat. Conf. Acoust.; Speech, Signal Process.; Munich, Germany, pp. 1471-1474.
17. W.R. Gardner, and B.D. Rao Theoretical analysis of the high-rate vector quantization of LPC parameters IEEE Trans. Speech Audio Process. 3 1995 367 381
18. S.G. Guion, J.E. Flege, R. Ahahane-Yamada, and J.C. Pruitt An investigation of current models of second language speech perception: The case of japanese adults' perception of english consonants J. Acoust. Soc. Amer. 107 2000 2711 2724
19. Kawai, G.; Hirose, K.; 1998. A method for measuring the intelligibility and nonnativeness of phone quality in foreign language pronunciation training. In: Internat. Conf. Spoken Lang. Process.; Sydney, Australia, pp. 1823-1826.
20. Koniaris, C.; Chatterjee, S.; Kleijn, W.B.; 2010a. Selecting static and dynamic features using an advanced auditory model for speech recognition. In: IEEE Internat. Conf. Acoust.; Speech, Signal Process.; Dallas, TX, USA, pp. 4342-4345.
21. Koniaris, C.; Engwall, O.; 2011a. Perceptual differentiation modeling explains phoneme mispronunciation by non-native speakers. In: IEEE Internat. Conf. Acoust.; Speech, Signal Process.; Prague, Czech Republic, pp. 5704-5707.
22. Koniaris, C.; Engwall, O.; 2011b. Phoneme level non-native pronunciation analysis by an auditory model-based native assessment scheme. In: Interspeech, Florence, Italy, pp. 1157-1160.
23. Koniaris, C.; Engwall, O.; Salvi, G.; 2012a. Auditory and dynamic modeling paradigms to detect L2 mispronunciations. In: Interspeech, Portland, OR, USA.
24. Koniaris, C.; Engwall, O.; Salvi, G.; 2012b. On the benefit of using auditory modeling for diagnostic evaluation of pronunciations. In: Internat. Symp. Autom. Detec. Errors Pronunc. Train. (IS ADEPT), Stockholm, Sweden, pp. 59-64.
25. C. Koniaris, M. Kuropatwinksi, and W.B. Kleijn Auditory-model based robust feature selection for speech recognition J. Acoust. Soc. Amer. 127 2010 EL73 EL79
26. P.K. Kuhl Early linguistic experience and phonetic perception: Implications for theories of developmental speech perception J. Phonetics 21 1993 125 139
27. Menzel, W.; Herron, D.; Bonaventura, P.; Morton, R.; 2000. Automatic detection and correction of non-native english pronunciations. In: Work. Intergr. Speech Tech. Lang. Learn. Assoc. Internat.; Dundee, UK, pp. 49-56.
28. N. Moustroufas, and V. Digalakis Automatic pronunciation evaluation of foreign speakers using unknown text Computer Speech & Language 21 2007 219 230
29. M.J. Munro, and T.M. Derwing Foreign accent, comprehensibility, and intelligibility in the speech of second language learners Lang. Learn. 45 1995 73 97
30. Neumeyer, L.; Franco, H.; Weintraub, M.; Price, P.; 1996. Automatic textindependent pronunciation scoring of foreign language student speech. In: Internat. Conf. Spoken Lang. Process.; Philadelphia, PA, USA, pp. 1457-1460.
31. van de Par, S.; Kohlrausch, A.; Charestan, G.; Heusdens, R.; 2002. A new psychoacoustical masking model for audio coding applications. In: IEEE Internat. Conf. Acoust.; Speech, Signal Process.; Orlando, FL, USA, pp. 1805-1808.
32. T. Piske, J. Flege, and I. MacKay Factors affecting degree of foreign accent in an l2: A review J. Phonetics 29 2001 191 215
33. J.H. Plasberg, and W.B. Kleijn The sensitivity matrix: Using advanced auditory models in speech and audio processing IEEE Trans. Audio Speech Lang. Process. 15 2007 310 319
34. D. Pressnitzer, M. Sayles, C. Micheyl, and I.M. Winter Perceptual organization of sound begins in the auditory periphery Curr. Biol. 18 2008 1124 1128
35. M. Richardson, J. Bilmes, and C. Diorio Hidden-articulator Markov models for speech recognition Speech Comm. 41 2003 511 529
36. P.M. Schmid, and G.H. Yeni-Komshian The effects of speaker accent and target predictability on perception of mispronunciations J. Speech Lang. Hear. Res. 42 1999 56 64
37. Sjölander, K.; 2003. An HMM-based system for automatic segmentation and alignment of speech. In: Fonetik, pp. 93-96.
38. K.N. Stevens Acoustic Phonetics 1998 MIT Press Cambridge, MA 0-262-69250-3
39. H. Strik, K. Truong, F. de Wet, and C. Cucchiarini Comparing different approaches for automatic pronunciation error detection Speech Comm. 51 2009 845 852
40. J. Tepperman, and S. Narayanan Using articulatory representations to detect segmental errors in nonnative pronunciation IEEE Trans. Audio Speech Lang. Process. 16 2008 8 22
41. Thorén, B.; 2008. The priority of temporal aspects in L2-Swedish prosody: Studies in perception and production. Ph.D. Thesis. Department of Linguistics, Stockholm University, Stockholm, Sweden.
42. S. Wei, G. Hu, Y. Hu, and R.H. Wang A new method for mispronunciation detection using support vector machine based on pronunciation space models Speech Comm. 51 2009 896 905
43. J.F. Werker, and R.C. Tees Cross-language speech perception: Evidence for perceptual reorganization during the first year of life Infant Behav. Dev. 7 1984 49 63
44. P. Wik, and A. Hjalmarsson Embodied conversational agents in computer assisted language learning Speech Comm. 51 2009 1024 1037
45. S.M. Witt, and S. Young Phone-level pronunciation scoring and assessment for interactive language learning Speech Comm. 30 2000 95 108