Confidence measures for speech recognition: A survey

Speech Communication

Volumn 45, Issue 4, 2005, Pages 455-470

  Jiang, Hui ^a  

^a YORK UNIVERSITY   (Canada)

Author keywords

Automatic speech recognition (ASR); Bayes factors; Confidence measures (CM); Likelihood ratio testing (LRT); Utterance verification; Word posterior probability

Indexed keywords

DECISION MAKING; DYNAMIC PROGRAMMING; ERROR ANALYSIS; ERROR CORRECTION; SPEECH COMMUNICATION; STATISTICAL METHODS;

AUTOMATIC SPEECH RECOGNITION (ASR); BAYES FACTORS; CONFIDENCE MEASURES (CM); LIKELIHOOD RATIO TESTING (LRT); UTTERANCE VERIFICATION; WORD POSTERIOR PROBABILITY;

SPEECH RECOGNITION;

EID: 15844411850     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2004.12.004     Document Type: Article

References (65)

1. Afify, M., Liu, F., Jiang, H., Siohan, O., 2004. A new verification-based fast-match for large vocabulary continuous speech recognition. IEEE Trans. Speech Audio Processing, in press
2. L. Arslan, and J. Hansen Selective training for hidden Markov model with applications to speech classification IEEE Trans. Speech Audio Process. 7 1 1999 46 54
3. Asadi, A., Schwartz, R., Makhoul, J., 1990. Automatic detection of new words in a large vocabulary continuous speech recognition system. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 125-128
4. M.C. Benitez, A. Rubio, and A. Torre Different confidence measures for word verification in speech recognition Speech Commun. 32 2000 79 94
5. Chase, L., 1997. Word and acoustic confidence annotation for large vocabulary speech recognition. Proc. of European Conference on Speech Communication Technology, pp. 815-818
6. Chigier, B., 1992. Rejection and keyword spotting algorithms for a directory assistance city name recognition application. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. II-93-II-96
7. Cox, S., Rose, R., 1996. Confidence measures for the Switchboard database. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 511-514
8. S. Cox, and S. Dasmahapatra High-level approaches to confidence estimation in speech recognition IEEE Trans. Speech Audio Process. 10 7 2002 460 471
9. Eide, E., Gish, H., Jeanrenaud, P., Mielke, A., 1995. Understanding and improving speech recognition performance through the use of diagnostic tools. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 221-224
10. Garcia, M.C., Reichl, W., Ortmanns, S., 1999. On combining confidence measures in HMM-based speech recognizers. Proc. of Automatic Speech Recognition and Understanding Workshop
11. Gillick, L., Ito, Y., Young, J., 1997. A probabilistic approach to confidence estimation and evaluation. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 879-882
12. Y.-F. Gong Speech recognition in noisy environments: A survey Speech Commun. 16 1995 261 291
13. S. Goronzy Confidence measures Robust adaptation to non-native accents in automatic speech recognition 2002 Springer-Verlag Berlin 57 78 Chapter 7
14. Guo, G., Huang, C., Jiang, H., Wang, R.-H., 2004. A comparative study on various confidence measures in large vocabulary speech recognition. Proc. of the fourth International Symposium on Chinese Spoken Language Processing, Hong Kong, China
15. Hazen, T.J., Burianek, T., Polifroni, J., Seneff, S., 2000. Recognition confidence scoring for use in speech understanding systems. Proc. of ISCA ITRW Workshop on ASR, Paris, France
16. H. Jiang, and L. Deng A Bayesian approach to the verification problem: Applications to speaker verification IEEE Trans. Speech Audio Process. 9 8 2001 874 884
17. Jiang, L., Huang, X.-D., 1998. Vocabulary-independent word confidence measure using subword features. Proc. of International Conference on Spoken Language Processing
18. Jiang, H., Lee, C.-H., 2002. Utterance verification based on neighborhood information and Bayes Factors. Proc. of International Conference on Spoken Language Processing
19. H. Jiang, and C.-H. Lee A new approach to utterance verification based on neighborhood information in model space IEEE Trans. Speech Audio Process. 11 5 2003 425 434
20. H. Jiang, K. Hirose, and Q. Huo Robust speech recognition based on Bayesian prediction approach IEEE Trans. Speech Audio Process. 7 4 1999 426 440
21. Jiang, H., Soong, F.K., Lee, C.-H., 2001. A data selection strategy for utterance verification in continuous speech recognition. Proc. of European Conference on Speech Communication and Technology, pp. 2573-2576
22. Jitsuhiro, T., Takahashi, S., Aikawa, K., 1998. Rejection of out-of-vocabulary words using phoneme confidence likelihood. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 217-220
23. B.-H. Juang Speech recognition in adverse environments Computer Speech Language 5 1991 275 294
24. Kamppari, S.O., Hazen, T.J., 2000. Word and phone level acoustic confidence scoring. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 1799-1802
25. Kemp, T., Schaaf, T., 1997. Estimating confidence using word lattices. Proc. of European Conference on Speech Communication Technology, pp. 827-830
26. M.-W. Koo, C.-H. Lee, and B.-H. Juang Speech recognition and utterance verification based on a generalized confidence score IEEE Trans. Speech Audio Process. 9 8 2001 821 832
27. C.-H. Lee On stochastic feature and model compensation approaches to robust speech recognition Speech Commun. 25 1998 29 47
28. Lee, C.-H., 2001. Statistical confidence measures and their applications. Proc. of ICSP, August
29. Q Li, B.-H. Juang, Q. Zhou, and C.-H. Lee Automatic verbal information verification for user authentication IEEE Trans. Speech Audio Process. 8 5 2000 585 596
30. Li, Q., Jiang, H., Zhou, Q., Zheng, J., 2002. Automatic enrollment for speaker authentication. Proc. of International Conference on Spoken Language Processing
31. Liu, F., Afify, M., Jiang, H., Siohan, O., 2001. A new verification-based fast match approach to large vocabulary speech recognition. Proc. of European Conference on Speech Communication and Technology, pp. 851-854
32. E. Lleida, and R.C. Rose Utterance verification in continuous speech recognition: Decoding and training procedures IEEE Trans. Speech Audio Process. 6 2000 558 568
33. Maison, B., Gopinath, R., 2001. Robust confidence annotation and rejection for continuous speech recognition. Proc. of International Conference on Acoustics, Speech and Signal Processing
34. Matsui, T., Soong, F.K., Juang, B.-H., 2001. Verification of multi-class recognition decision using classification approach. Proc. of Automatic Speech Recognition and Understanding Workshop
35. Mathan, L., Miclet, L., 1991. Rejection of extraneous input in speech recognition applications, using multi-layer perceptrons and the trace of HMMs. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 93-96
36. Moreno, P.J., Logan, B., Raj, B., 2001. A boosting approach for confidence scoring. Proc. of European Conference on Speech Communication Technology
37. Neti, C.V., Roukos, S., Eide, E., 1997. Word-based confidence measures as a guide for stack search in speech recognition. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 883-886
38. M.G. Rahim, and C.-H. Lee String-based minimum verification error (SB-MVE) training for speech recognition Computer Speech Language 11 1997 147 160
39. M.G. Rahim, and C.-H. Lee A study on robust utterance verification for connected digits recognition J. Acoust. Soc. Am. 101 5 1997 2892 2902
40. M.G. Rahim, C.-H. Lee, and B.-H. Juang Discriminative utterance verification for connected digits recognition IEEE Trans. on Speech and Audio Processing 5 3 1997 266 277
41. Pao, C., Schmid, P., Glass, J., 1998. Confidence scoring for speech understanding systems. Proc. of International Conference on Spoken Language Processing
42. Rose, R.C., 1992. Discriminant wordspotting techniques for rejecting non-vocabulary utterances in unconstrained speech. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. II-105-II-108
43. Rose, R.C., Juang, B.H., Lee, C.H., 1995a. A training procedure for verifying string hypothesis in continuous speech recognition. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 281-284
44. Rueber, B., 1997. Obtaining confidence measures from sentence probabilities. Proc. of European Conference on Speech Communication Technology
45. San-Segundo, R., Pellom, B., Hacioglu, K., Ward, W., 2001. Confidence measures for spoken dialogue systems. Proc. of International Conference on Acoustics, Speech and Signal Processing
46. Schaaf, T., Kemp, T., 1997. Confidence measures for spontaneous speech recognition. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 875-878
47. M. Siu, and H. Gish Evaluation of word confidence for speech recognition systems Computer Speech Language 13 1999 299 319
48. Sukkar, R.A., 1994. Rejection for connected digit recognition based on GPD segmental discrimination. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. I-393-I-396
49. R.A. Sukkar, and C.-H. Lee Vocabulary independent discriminative utterance verification for nonkeyword rejection in subword based speech recognition IEEE Trans. Speech Audio Process. 4 6 1996 420 429
50. Sukkar, R.A., Wilpon J.G., 1993. A two pass classification for utterance rejection in keyword spotting. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. II-451-II-454
51. R.A. Sukkar, A.R. Setlur, C.-H. Lee, and J. Jacob Verifying and correcting recognition string hypotheses using discriminative utterance verification Speech Commun. 22 1997 333 342
52. Tan, B.T., Gu, Y., Thomas, T., 2000. Utterance verification based speech recognition system. Proc. of International Conference on Spoken Language Processing
53. Vergyri, D., 2000. Use of word level side information to improve speech recognition. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 1823-1826
54. Wallhoff, F., Willett, D., Rigoll, G., 2000. Frame-discriminative and confidence-driven adaptation for LVCSR. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 1835-1838
55. Weintraub, M., Beaufays, F., Rivlin, Z., Konig, Y., Stolcke, A., 1997. Neural-network based measures of confidence for word recognition. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 887-890
56. Wessel, F., Macherey, K., Schluter R., 1998. Using word probabilities as confidence measures. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 225-228
57. Wessel, F., Macherey, K., Ney., H., 1999. A comparison of word graph and N-best list based confidence measures. Proc. of European Conference on Speech Communication Technology, pp. 315-318
58. Wessel, F., Schluter, R., Ney, H., 2000. Using posterior word probabilities for improved speech recognition. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. 1587-1590
59. F. Wessel, R. Schluter, K. Macherey, and H. Ney Confidence measures for large vocabulary continuous speech recognition IEEE Trans. Speech Audio Process. 9 3 2001 288 298
60. Willett, D., Worm, A., Neukirchen, C., Rigoll, G., 1998. Confidence measures for HMM-based speech recognition. Proc. of International Conference on Spoken Language Processing
61. G. Williams, and S. Renals Confidence measures from local posterior probability estimates Computer Speech Language 13 1999 395 411
62. J.G. Wilpon, L.R. Rabiner, C.-H. Lee, and R. Goldman Automatic recognition of keywords in unconstrained speech using hidden Markov models IEEE Trans. Acoustics Speech Signal Process. 38 11 1990 1870 1878
63. Young, S.R., Ward, W., 1993. Learning new words from spontaneous speech. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. II-590-II-591
64. Young, S.R., 1994. Detecting misrecognitions and out-of-vocabulary words. Proc. of International Conference on Acoustics, Speech and Signal Processing, pp. II-21-II-24
65. Zhang, R., Rudnicky, A.I., 2001. Word level confidence annotation using combinations of features. Proc. of European Conference on Speech Communication Technology