A framework for predicting speech recognition errors

Speech Communication

Volumn 46, Issue 2, 2005, Pages 153-170

  Fosler Lussier, Eric ^a   Amdal, Ingunn ^b   Kuo, Hong Kwang Jeff ^c  

^a Ohio State University   (United States)

^b NORWEGIAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Norway)

^c IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Automatic speech recognition; Error prediction; Lexical adaptation; Lexicon optimization; Pronunciation modeling

Indexed keywords

ALGORITHMS; ERROR ANALYSIS; FORMAL LANGUAGES; MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD ESTIMATION; OPTIMIZATION;

AUTOMATIC SPEECH RECOGNITION (ASR); ERROR PREDICTION; LEXICAL ADAPTATION; LEXICON OPTIMIZATION; PRONUNCIATION MODELING;

SPEECH RECOGNITION;

EID: 19944369427     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2005.03.003     Document Type: Conference Paper

References (40)

1. Bilmes, J., Zweig, G., 2002. The graphical models toolkit: An open source software system for speech and time-series processing. In: IEEE Internat. Conf. on Acoustics, Speech, and Signal Processing, Orlando, FL, June 2002, pp. 3916-3919.
2. Chase, L., 1997. Error-responsive feedback mechanisms for speech recognizers. PhD thesis, Carnegie Melon University.
3. Chen, Z., Lee, K.-F., Li, M.J., 2000. Discriminative training on language model. In: Proc. Internat. Conf. on Spoken Language Processing (ICSLP 2000), Bejing, China, October 2000, pp. 493-496.
4. N. Chomsky, and M. Halle The sound pattern of English 1968 Harper and Row New York
5. C. Cucchiarini Assessing transcription agreement: methodological aspects Clin. Linguist. Phonet. 10 2 1996 131 155
6. Deng, Y., Mahajan, M., Acero, A., 2003. Estimating speech recognition error rate without acoustic test data. In: Proc. Eurospeech, Geneva, Switzerland', pp. 929-932, September 2003.
7. Fosler-Lussier, J.E., 1999. Dynamic pronunciation models for automatic speech recognition. PhD thesis, University of California, Berkeley.
8. Fosler-Lussier, E., Williams, G., 1999. Not just what, but also when: Guided automatic pronunciation modeling for broadcast news. In: DARPA Broadcast News Workshop, Herndon, Virginia, March 1999.
9. Fosler-Lussier, E., Amdal, I., Kuo, H.-K.J., 2002. On the road to improved lexical confusability metrics. In: ISCA Tutorial and Research Workshop on Pronunciation Modeling and Lexicon Adaptation (PMLA-2002), Estes Park, Colorado, 2002.
10. V. Goel, S. Kumar, and W. Byrne Segmental minimum Bayes-risk decoding for automatic speech recognition IEEE Trans. Speech Audio Process. 12 2004 234 249
11. Goldberger, J., Gordon, S., Greenspan, H., 2003. An efficient image similarity measure based on approximations of kl-divergence between two Gaussian mixtures. In: Internat. Conf. on Computer Vision, pp. 487-493.
12. Greenberg, S., Hollenbach, J., Ellis, D., 1996. Insights into spoken language gleaned from phonetic transcription of the Switchboard Corpus. In: Proc. 4th Internat. Conf. on Spoken Language Processing (ICSLP-96), Philadelphia, Pennsylvania, October 1996, pp. S24-S27.
13. Greenberg, S., Chang, S., Hollenback, J., 2000. An introduction to the diagnostic evaluation of the Switchboard-Corpus automatic speech recognition systems. In: Proc. NIST Speech Transcription Workshop, College Park, Maryland, May 2000.
14. Hetherington, L., 1995. New words: Effect on recognition performance and incorporation issues. In: Proc. Eurospeech, Madrid, Spain, 1995, pp. 1645-1648.
15. Hirschberg, J., Litman, D., Swerts, M., 1999. Prosodic cues to recognition errors. In: Proc. Automatic Speech Recognition and Understanding Workshop (ASRU'99), Keystone, CO.
16. T. Holter, and T. Svendsen Maximum likelihood modelling of pronunciation variation Speech Comm. 29 1999 177 191
17. Jakobson, R., Fant, G., Halle, M., 1952. Preliminaries to speech analysis, Tech. Rep. 13, Acoustics Laboratory, Massachusetts Instutite of Technology.
18. J.M. Kessens, M. Wester, and H. Strik Improving the performance of a Dutch CSR by modeling within-word and cross-word pronunciation variation Speech Comm. 29 2-4 1999 193 207
19. Kuo, H.-K., Fosler-Lussier, E., Jiang, H., Lee, C.-H., 2002. Discriminative training of language models for speech recognition. In: Proc. Internat. Conf. on Acoustics, Speech, and Signal Processing, Orlando, Florida, May 2002, pp. 325-328.
20. Livescu, K., Glass, J., 2000. Lexical modeling of non-native speech for automatic speech recognition. In: Proc. Internat. Conf. on Acoustics, Speech, and Signal Processing, Istanbul, Turkey, 2000, pp. 1683-1686.
21. L. Mangu, E. Brill, and A. Stolcke Finding consensus in speech recognition: Word error minimization and other applications of confusion networks Comput. Speech Lang. 14 4 2000 373 400
22. McAllaster, D., Gillick, L., Scattone, F., Newman, M., 1998. Fabricating conversational speech data with acoustic models: A program to examine model-data mismatch. In: Proc. 5th Internat. Conf. on Spoken Language Processing (ICSLP-98), Sydney, Australia, December 1998, pp. 1847-1850.
23. G. Miller, and P. Nicely An analysis of perceptual confusions among some English consonants J. Acoust. Soc. Amer. 27 1955 338 352
24. Mohri, M., Riley, M., Hindle, D., Ljolje, A., Pereira, F., 1998. Full expansion of context-dependent networks in large vocabulary speech recognition. In: Proc. Internat. Conf. on Acoustics, Speech, and Signal Processing, Seattle, Washington, pp. 665-668.
25. Mou, X., Seneff, S., Zue, V., 2000. Context-dependent probabilistic hierarchical sub-lexical modelling using finite state transducers. In: Proc. Eurospeech, Alborg, Denmark, pp. 451-454.
26. National Institute of Standards and Technology, 2001. SCLITE scoring software. Available as part of the SCTK package from: .
27. Pitrelli, J., Fong, C., 1995. PHONEBOOK: NYNEX isolated words. Linguistic Data Consortium Catalog Number LDC95S27.
28. Potamianos, A., Ammicht, E., Kuo, H.-K.J., 2000. Dialogue management in the Bell Labs Communicator system. In: Proc. Internat. Conf. on Spoken Language Processing (ICSLP 2000), Bejing, China, October 2000, pp. 603-606.
29. W.H. Press, S. Teukolsky, W.T. Vetterling, and B.P. Flannery Numerical recipes in C: The art of scientific computing second ed. 1999 Cambridge University Press
30. H. Printz, and P.A. Olsen Theory and practice of acoustic confusability Comput. Speech Lang. 16 2002 131 164
31. Riley, M., 1991. A statistical model for generating pronunciation networks. In: Proc. Internat. Conf. on Acoustics, Speech, and Signal Processing, pp. 737-740.
32. Riley, M., Byrne, W., Finke, M., Khudanpur, S., Ljolje, A., McDonough, J., Nock, H., Saraclar, M., Wooters, C., Zavaliagkos, G., 1998. Stochastic pronunciation modelling from hand-labelled phonetic corpora. In: ESCA Tutorial and Research Workshop on Modeling Pronunciation Variation for Automatic Speech Recognition, Kerkrade, Netherlands, April 1998, pp. 109-116.
33. Schaaf, T., Kemp, T., 1997. Confidence measures for spontaneous speech recognition. In: Proc. Internat. Conf. on Acoustics, Speech, and Signal Processing, Munich, Germany, pp. 875-878.
34. Schramm, H., Beyerlein, P., 2002. Discriminative optimization of the lexical model. In: ISCA Tutorial and Research Workshop on Pronunciation Modeling and Lexicon Adaptation (PMLA-2002), Estes Park, Colorado.
35. Sloboda, T., Waibel, A., 1996. Dictionary learning for spontaneous speech recognition. In: Proc. 4th Internat. Conf. on Spoken Language Processing (ICSLP-96), pp. 2328-2331.
36. R. Sproat Multilingual Text-to-Speech synthesis: The Bell Labs approach 1998 Kluwer Dordrecht
37. W. Voiers Evaluationg processed speech using the diagnostic rhyme test Speech Technol. 1 1983 30 39
38. Wester, M., Fosler-Lussier, E., 2000. A comparison of data-derived and knowledge-based modeling of pronunciation variation. In: Proc. Internat. Conf. on Spoken Language Processing, Bejing, China, October 2000, pp. 270-273.
39. Williams, D.A.G., 1999. Knowing what you don't know: roles for confidence measures in automatic speech recognition. PhD thesis, University of Sheffield, Sheffield, England.
40. Zhou, Q., Lee, C.-H., Chou, W., Pargellis, A., 1997. Speech technology integration and research platform: a system study. In: Proc. Eurospeech, Rhodes, Greece, pp. 621-624.