Recognition confidence scoring and its use in speech understanding systems

Computer Speech and Language

Volumn 16, Issue 1, 2002, Pages 49-67

  Hazen, Timothy J ^a   Seneff, Stephanie ^a   Polifroni, Joseph ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SIMULATION; CONSTRAINT THEORY; FEATURE EXTRACTION; HUMAN COMPUTER INTERACTION; LEARNING SYSTEMS; LINGUISTICS; MAXIMUM LIKELIHOOD ESTIMATION; NATURAL LANGUAGE PROCESSING SYSTEMS; SPEECH ANALYSIS; WEATHER INFORMATION SERVICES; WORD PROCESSING;

RECOGNITION CONFIDENCE SCORING; SPEECH UNDERSTANDING; UTTERANCE; WEATHER INFORMATION SYSTEMS; WORD RECOGNITION;

SPEECH RECOGNITION;

EID: 0036460906     PISSN: 08852308     EISSN: None     Source Type: Journal    
DOI: 10.1006/csla.2001.0183     Document Type: Article

References (30)

1. Bazzi, I. & Glass J. (2000). Modeling out-of-vocabulary words for robust speech recognition. Proceedings of the International Conference on Spoken Language Processing, Beijing, China, volume 1, pp. 401-404.
2. Bergen, Z. & Ward, W. (1977). A senone based confidence measure for speech recognition. Proceedings of the European Conference on Speech Communication and Technology, Rhodes, Greece, pp. 819-822.
3. Chase, L. (1997). Word and acoustic confidence annotation for large vocabulary speech recognition. Proceedings of the European Conference on Speech Communication and Technology, Rhodes, Greece, pp. 815-818.
4. Chung, G. (2000). Automatically incorporating unknown words in JUPITER. Proceedings of the International Conference on Spoken Language Processing, Beijing, China, volume 4, pp. 520-523.
5. Cox, S. & Dasmahapatra, S. (1999). A high-level approach to confidence estimation in speech recognition. Proceedings of the European Conference on Speech Communication and Technology, Budapest, Hungary, pp. 41-44.
6. Gillick, L., Ito, Y. & Young, J. (1997). A probabilistic approach to confidence estimation and evaluation. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Munich, pp. 879-883.
7. Glass, J., Chang, J. & McCandless, M. (1996). A probabilistic framework for feature-based speech recognition. Proceedings of the International Conference on Spoken Language Processing, Philadelphia, pp. 2277-2280.
8. Glass, J., Hazen, T. & Hetherington, L. (1999). Real-time telephone-based speech recognition in the JUPITER domain. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Phoenix, pp. 61-64.
9. Hazen, T., Burianek, T., Polifroni, J. & Seneff, S. (2000). Recognition confidence scoring for use in speech understanding systems. Proceedings of the ISCA ASR2000 Tutorial and Research Workshop, Paris, pp. 213-220.
10. Hazen, T. & Bazzi, I. (2001). A comparison and combination of methods for OOV word detection and word confidence scoring. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Salt Lake City, pp. 397-400.
11. Hazen, T., Hetherington, I. & Park, A. (2001). FST-based recognition techniques for multi-lingual and multi-domain spontaneous speech. Proceedings of the European Conference on Speech Communication and Technology, Aalborg, Denmark, to appear.
12. Hetherington, L. (1994). A characterization of the problem of new, out-of-vocabulary words in continuous-speech recognition and understanding. PhD Thesis, MIT.
13. Kamppari, S. (1999). Word and phone level acoustic confidence scoring for speech understanding systems. Master's Thesis, MIT.
14. Kamppari, S. & Hazen, T. (2000). Word and phone level acoustic confidence scoring. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Istanbul, pp. 1799-2002.
15. Lleida, E. & Rose, R. (1996). Efficient decoding and training procedures for utterance verification in continuous speech recognition. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Atlanta, pp. 507-510.
16. Ma, C., Randolph, M. & Drish, J. (2001). A support vector machines-based rejection technique for speech recognition. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Salt Lake City, pp. 381-384.
17. Pao, C., Schmid, P. & Glass, J. (1998). Confidence scoring for speech understanding. Proceedings of the International Conference on Spoken Language Processing, Sydney, pp. 815-818.
18. Polifroni, J., Seneff, S., Glass, J. & Hazen, T. (1998). Evaluation methodology for a telephone-based conversational system. Proceedings of the International Conference on Language Resources and Evaluation, Granada, Spain, pp. 43-49.
19. Powell, M. (1964). An efficient method of finding the minimum of a function of several variables without calculating derivatives. The Computer Journal, 7, 155-162.
20. Rose, R., Yao, H., Riccardi, G. & Wright, J. (2000). Integration of utterance verification with statistical language modeling and spoken language understanding. Speech Communication, 34, 321-331.
21. Schaaf, T. & Kemp, T. (1997). Confidence measures for spontaneous speech recognition. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Munich, pp. 875-878.
22. Seneff, S. (1992). Tina: a natural language system for spoken language applications. Computational Linguistics, 18, 61-86.
23. Seneff, S. & Polifroni, J. (2001). Hypothesis selection and resolution in the MERCURY flight reservation system. Proceedings of the DARPA Human Language Technology Workshop, San Diego, to appear.
24. Sui, M., Gish, H. & Richardson, F. (1997). Improved estimation, evaluation and applications of confidence measures for speech recognition. Proceedings of the European Conference on Speech Communication and Technology, Rhodes, Greece, pp. 831-834.
25. Sui, M. & Gish, H. (1999). Evaluation of word confidence for speech recognition systems. Computer Speech and Language, 13, 299-319.
26. Wang, C. (2001). Prosodic modeling for improved speech recognition and understanding. PhD Thesis, MIT.
27. Wendemuth, A., Rose, G. & Dolfing, J. (1999). Advances in confidence measures for large vocabulary. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Phoenix, pp. 705-708.
28. Weintraub, M. et al. (1997). Neural-network based measures of confidence for word recognition. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Munich, pp. 887-890.
29. Williams, G. & Renals, S. (1999). Confidence measures from local posterior probability estimates. Computer Speech and Language, 13, 395-411.
30. Zue, V. et al. (2000). Jupiter: A telephone-based conversational interface for weather information. IEEE Transaction on Speech and Audio Processing, 8, 85-96.