Automatic assessment of oral language proficiency and listening comprehension

Speech Communication

Volumn 51, Issue 10, 2009, Pages 864-874

  de Wet, F ^a   Van der Walt, C ^a   Niesler, T R ^a  

^a STELLENBOSCH UNIVERSITY   (South Africa)

Author keywords

Automatic language proficiency assessment; CALL; Goodness of pronunciation; Large scale assessment; Rate of speech

Indexed keywords

AUTOMATIC LANGUAGE PROFICIENCY ASSESSMENT; CALL; GOODNESS OF PRONUNCIATION; LARGE-SCALE ASSESSMENT; RATE OF SPEECH;

EXPERIMENTS; SPEECH PROCESSING; TESTING;

LINGUISTICS;

EID: 67650639037     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2009.03.002     Document Type: Article

References (31)

1. Bernstein, J., de Jong, J., Pisoni, D., Townshend, B., 2000. Two experiments on automatic scoring of spoken language proficiency. In: Proc. InSTILL 2000, University of Abertay, Dundee, pp. 57-61.
2. Chalhoub-Deville M. Language testing and technology: past and future. Lang. Learn. Technol. 5 2 (2001) 95
3. Cincarek, T., 2004. Pronunciation scoring for non-native speech. Master's thesis, Institut für Informatik, Friedrich-Alexander Universität, Erlangen-Nürnberg, Germany.
4. Cucchiarini C., Strik H., and Boves L. Different aspects of expert pronunciation quality ratings and their relation to scores produced by speech recognition algorithms. Speech Comm. 30 (2000) 109-119
5. Cucchiarini C., Strik H., and Boves L. Quantitative assessment of second language learners' fluency by means of automatic speech recognition technology. J. Acoust. Soc. Amer. 107 2 (2000) 989-999
6. Cucchiarini C., Strik H., and Boves L. Quantitative assessment of second language learners' fluency: comparisons between read and spontaneous speech. J. Acoust. Soc. Amer. 111 6 (2002) 2862-2873
7. Daneman M. Working memory as a predictor of verbal fluency. J. Psycholinguist. Res. 20 6 (1991) 445-464
8. De Wet, F., Van der Walt, C., Niesler, T.R., 2007. Automatic large-scale oral language proficiency assessment. In: Proc. Interspeech, Antwerp, Belgium, pp. 218-221.
9. Ellis N.C., and Sinclair S. Working memory in the acquisition of vocabulary and syntax: putting language in good order. Quart. J. Exp. Psychol. 49 A (1996) 234250
10. Franco H., Abrash V., Precoda K., Bratt H., Rao R., Butzberger J., Rossier R., and Cesari F.J. The SRI EduSpeak™ system: recognition and pronunciation scoring for language learning. Proc. InSTILL 2000 (2000), University of Abertay, Dundee 123-128
11. Fulcher G. Does thick description lead to smart tests? A data-based approach to rating scale construction. Lang. Test. 13 (1996) 208-238
12. Fulcher G. The testing of L2 speaking. In: Clapham C., and Corson D. (Eds). Encyclopedia of Language and Education: Language Testing and Assessment Vol. 17 (1997), Kluwer Academic, Dordrecht 75-85
13. Kawai, G., Hirose, K., 1998. A method for measuring the intelligibility and nonnativeness of phone quality in foreign language pronunciation training. In: Proc. ICSLP, Sydney, Australia.
14. Kenyon D.M., and Tschirner E. The rating of direct and semi-direct oral proficiency interviews: comparing performance at lower proficiency levels. Mod. Lang. J. 84 1 (2000) 85-101
15. Liscombe, J.J., 2007. Prosody and speaker state: paralinguistics, pragmatics and proficiency. Ph.D. thesis, Columbia University, Columbia, USA.
16. Moustroufas N., and Digalakis V. Automatic pronunciation evaluation of foreign speakers using unknown text. Comput. Speech Lang. 21 (2007) 219-230
17. Neri, A., Cucchiarini, C., Strik, H., 2006. ASR corrective feedback on pronunciation: does it really work? In: Proc. Interspeech, Pittsburgh, USA, pp. 1982-1985.
18. Neumeyer L., Franco H., Digalakis V., and Weintraub M. Automatic scoring of pronunciation quality. Speech Comm. 30 (2000) 83-93
19. Payne J.S., and Scott B.M. Synchronous CMC, working memory, and L2 oral proficiency development. Lang. Learn. Technol. 9 3 (2005) 35-54
20. Roux J.C., Louw P.H., and Niesler T.R. The African speech technology project: an assessment. Proc. 4th Internat. Conf. on Language Resources and Evaluation (2004), Lisbon, Portugal I:93-I:96
21. Spolsky B. Measured Words (1995), Oxford University Press, Oxford, UK
22. StatSoft, 2008. Statistica 8.0. .
23. Sundh, S., 2003. Swedish school leavers' oral proficiency in English. Ph.D. thesis, Uppsala University, Uppsala.
24. Upshur J.A., and Turner C.E. Constructing rating scales for second language tests. English Lang. Teach. J. 49 1 (1995) 3-12
25. Van der Walt C., De Wet F., and Niesler T.R. Oral proficiency assessment: the use of automatic speech recognition systems. South. African Linguist. Appl. Lang. Stud. 26 1 (2008) 135-146
26. Wigglesworth G. An investigation of planning time and proficiency level on oral test discourse. Lang. Test. 14 1 (1997) 85-106
27. Witt, S.M., 1999. Use of speech recognition in computer-assisted language learning. Ph.D. thesis, Department of Engineering, University of Cambridge, Cambridge, UK, November.
28. Witt S.M., and Young S.J. Phone-level pronunciation scoring and assessment for interactive language learning. Speech Comm. 30 (2000) 95-108
29. Xi X., Zechner K., and Bejar I. Extracting meaningful speech features to support diagnostic feedback: an ECD approach to automated scoring. Annual Meeting of National Council on Measurement in Education (2006), NCME, California, USA April
30. Young S., Evermann G., Hain T., Kershaw D., Moore G., Odell J., Ollason D., Povey D., Valtchev V., and Woodland P. The HTK Book, Version 3.2.1 (2002), Cambridge University Engineering Department
31. Zechner K., and Bejar I.I. Towards automatic scoring of non-native spontaneous speech. Proc. Human Language Technology Conf. of the North American Chapter of the ACL (2006), Association of Computational Linguistics, New York, USA 216-223 June