Highly accurate children's speech recognition for interactive reading tutors using subword units

Speech Communication

Volumn 49, Issue 12, 2007, Pages 861-873

  Hagen, Andreas ^a   Pellom, Bryan ^a   Cole, Ronald ^a  

^a UNIVERSITY OF COLORADO   (United States)

Author keywords

Language modeling; Literacy tutors; Reading tracking; Subword unit based speech recognition

Indexed keywords

DATA ACQUISITION; MATHEMATICAL MODELS; STATISTICAL METHODS;

ACOUSTIC MODELING; AUTOMATED LITERACY; SEARCH ARCHITECTURE; SPEECH TECHNOLOGY;

SPEECH RECOGNITION;

EID: 34748820596     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2007.05.004     Document Type: Article

References (42)

1. Aist, G., Chan, P., Huang, X., Jiang, L., Kennedy, R., Latimer, D., Mostow, J., Yeung, C., 1998. How effective is unsupervised data collection for children's speech recognition? In: Proc. ICSLP 98 Sydney, Australia.
2. Arcy, S., Wong, L., Russel, M., 2004. Recognition of read and spontaneous children's speech using two new corpora. In: Proc. ICSLP 2004, Jeju Island, Korea.
3. Banerjee, S., Beck, J., Mostow, J., 2003a. Evaluating the effect of predicting oral reading miscues. In: Proc. Eurospeech 2003, Geneva, Switzerland.
4. Banerjee, S., Mostow, J., Beck, J., Tam, W., 2003b. Improving language models by learning from speech recognition errors in a reading tutor that listens. In: Proc. Second Internat. Conf. on Applied Artificial Intelligence 2003, Fort Panhala, Kolhapur, India.
5. Bazzi, I., 2002. Modelling out-of-vocabulary words for robust speech recognition. Ph.D. Thesis, MIT, June 2002, Department of Electrical Engineering and Computer Science.
6. Cole, R., Hosom, P., Pellom, B., 2006a. University of Colorado Prompted and Read Children's Speech Corpus. Technical Report TR-CSLR-2006-02, Center for Spoken Language Research, University of Colorado, Boulder.
7. Cole, R., Pellom, B., 2006b. University of Colorado Read and Summarized Stories Corpus. Technical Report TR-CSLR-2006-03, Center for Spoken Language Research, University of Colorado, Boulder.
8. Cole R.A., Van Vuuren S., Pellom B., Hacioglu K., Ma J., Movellan J., Schwartz S., Wade-Stein D., Ward W., and Yan J. Perceptive animated interfaces: first steps toward a new paradigm for human-computer interaction. Proc. IEEE: Special Issue on Human-Computer Multimodal Interface 91 9 (2003) 1391-1405
9. Cole R., Wise B., and Van Vuuren S. How Marni teaches children to read. Educ. Technol. 47 1 (2006) 14-18
10. COLit, 2004. Colorado Literacy Tutor Project. .
11. Cosi, P., Pellom, B., 2005. Italian Children's speech recognition for advanced interactive literacy tutors. In: Proc. Eurospeech 2005, Lisbon, Portugal.
12. Creutz, M., Lagus, K., 2002. Unsupervised discovery of morphemes. In: Proc. Workshop on Morphological and Phonological Learning of ACL-02, Philadelphia, pp. 21-30.
13. Das, S., Nix D., Picheny, M., 1998. Improvements in children's speech recognition performance. In: Proc. ICASSP 98, Seattle, WA.
14. Eskenazi M. KIDS: A database of childrens speech. J. Acoust. Soc. Amer. 100 4, Part 2 (1996)
15. Fogarty, J., Dabbish, L., Steck, D.M., Mostow, J., 2001. Mining a database of reading mistakes: For what should an automated Reading Tutor listen? In: Proc. Tenth Internat. Conf. on Artificial Intelligence in Education (AI-ED) 2001, San Antonio, Texas.
16. Gales, M., 1997. Maximum likelihood linear transformations for HMM-based speech recognition. Technical Report, CUED/F-INFENG/TR291, Cambridge University.
17. Giuliani, D., Gerosa, M., 2003. Investigating recognition of children's speech. In: Proc. ICASSP 2003, Hong Kong.
18. Gustafson, J., Sjolander, K., 2002. Voice transformations for improving children's speech recognition in a publicly available dialogue system. In: Proc. ICSLP 2002, Denver, Colorado.
19. Hacioglu, K., Pellom, B., Ciloglu, T., Ozturk, O., Kurimo, M., Creutz, M., 2003. On lexicon creation for Turkish LVCSR. In: Proc. Eurospeech 2003, Geneva, Switzerland.
20. Hagen, A., Pellom, B., 2005a. A Multi-layered lexical-tree based token passing architecture for efficient recognition of subword speech units. In: The 2nd Language and Tech. Conf., Poznan, Poland.
21. Hagen, A., Pellom, B., 2005b. Data driven subword unit modeling for speech recognition and its application to interactive reading tutors. In: Interspeech 2005, Lisbon, Portugal.
22. Hagen, A., Pellom, B., Cole, R., 2003. Children's speech recognition with application to interactive books and tutors. In: IEEE Automatic Speech Recognition and Understanding (ASRU) Workshop, St. Thomas.
23. Hagen, A., Pellom, B., Van Vuuren, S., Cole, R., 2004. Advances in children's speech recognition within an interactive literacy tutor. HLT-NAACL, Boston, May 2004.
24. Lee, S., Potamianos, A., Narayanan, S., 1997. Analysis of children's speech: duration, pitch and formants, In: Proc. EUROSPEECH 97, Rhodes, Greece.
25. Lee S., Potamianos A., and Narayanan S. Acoustics of children's speech: developmental changes of temporal and spectral parameters. J. Acoust. Soc. Amer. 105 (1999) 1455-1468
26. Lee, K., Hagen, A., Romanyshyn, N., Martin, S., Pellom, B., 2004. Analysis and detection of reading miscues for interactive literacy tutors. COLING, Geneva, Switzerland.
27. Li, Q., Russell, M., 2002. An analysis of the causes of increased error rates in children's speech recognition. In: Proc. ICSLP 02, Denver, Colorado.
28. McCandless, M., 1992. Word rejection for a literacy tutor. S.B. Thesis, MIT, May 1992, Department of Electrical Engineering and Computer Science.
29. Mostow, J., Roth, S.F., Hauptmann, A.G., Kane, M., 1994. A prototype reading coach that listens. In: Proc. of AAAI-94, Seattle, WA, pp. 785-792.
30. Mostow, J., Beck, J., Winter, S., Wang, S., Tobin, B., 2002. Predicting oral reading miscues. In: ICSLP 2002, Denver, Colorado.
31. Pellom, B., 2001. SONIC: The University of Colorado Continuous Speech Recognizer. Technical Report TR-CSLR-2001-01, University of Colorado.
32. Pellom, B., Hacioglu, K., 2003. Recent improvements in the CU SONIC ASR system for noisy speech: the SPINE task. In: Proc. ICASSP 2003, Hong Kong.
33. Potamianos A., and Narayanan S. Robust recognition of children's speech. IEEE Trans. Speech Audio Process. 11 (2003) 603-616
34. Potamianos, A., Narayanan, S., Lee, S., 1997. Automatic speech recognition for children. In: Proc. EUROSPEECH 97, Rhodes, Greece.
35. Shobaki, K., Hosom, J.P., Cole, R., 2000. The OGI Kids' Speech Corpus and recognizers. In: Proc. ICSLP 2000, Beijing, China.
36. Siohan O., Myrvoll T., and Lee C.H. Structural maximum a posteriori linear regression for fast HMM adaptation. Computer, Speech and Language 16 (2002) 5-24
37. Spache, G.D., 1981. Diagnostic Reading Scales. Del, Monte Research Park, Monterey, CA 93940: CTB, Macmillan/McGraw-Hill.
38. Tam, Y.C., Mostow, J., Beck, J., Banerjee, S., 2003. Training a confidence measure for a reading tutor that listens. In: Proc. Eurospeech 2003, Geneva, Switzerland.
39. van Vuuren, S., Cole, R., Ngampatipatpong, N., 2006. Providing feedback to students while reading out loud in interactive books. Technical Report TR-CSLR-2006-01, Center for Spoken Language Research, University of Colorado, Boulder.
40. Welling, L.,Kanthak, S., Ney, H., 1999. Improved methods for vocal tract length normalization. In: Proc. ICASSP 99, Phoenix, Arizona.
41. Wise B., Cole R., Van Vuuren S., Schwartz S., Snyder L., Ngampatipatpong N., Tuantranont J., and Pellom B. Learning to read with a virtual tutor: foundations to literacy. In: Kinzer C., and Verhoeven L. (Eds). Interactive Literacy Education: Facilitating Literacy Environments through Technology (2005), Lawrence Erlbaum, Mahwah, NJ
42. Young, S.J., Russell, N.H., Thornton, J.H.S., 1989. Token passing: a simple conceptual model for connected speech recognition systems. Cambridge University, Technical Report CUED/F-INFENG/TR.38.