A study on integrating acoustic-phonetic information into lattice rescoring for automatic speech recognition

Speech Communication

Volumn 51, Issue 11, 2009, Pages 1139-1153

  Siniscalchi, Sabato Marco ^a   Lee, Chin Hui ^b  

^a NORWEGIAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Norway)

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Continuous phone recognition; Knowledge based system; Large vocabulary continuous speech recognition; Lattice rescoring

Indexed keywords

ARTIFICIAL NEURAL NETWORK; AUTOMATIC SPEECH RECOGNITION; CONFIDENCE LEVELS; CONFIDENCE SCORE; CONNECTED DIGITS; CONTINUOUS PHONE RECOGNITION; DATA-DRIVEN; GENERIC FRAMEWORKS; LANGUAGE MODEL; LARGE VOCABULARY CONTINUOUS SPEECH RECOGNITION; LATTICE RESCORING; LOG LIKELIHOOD; LOG LIKELIHOOD RATIO; PHONE RECOGNITION; PHONETIC INFORMATION; PHONETIC PROPERTIES; SPEECH EVENTS;

ACOUSTICS; BACKPROPAGATION; BROADBAND NETWORKS; COMPUTATIONAL LINGUISTICS; CONTINUOUS SPEECH RECOGNITION; DATA COMMUNICATION SYSTEMS; KNOWLEDGE BASED SYSTEMS; MAXIMUM LIKELIHOOD ESTIMATION; NEURAL NETWORKS; REMELTING; TELEPHONE SETS; VOCABULARY CONTROL;

TELEPHONE SYSTEMS;

EID: 67650999674     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2009.05.004     Document Type: Article

References (59)

1. Bahl, L.R., Brown, P.F., deSouza, P.V., Mercer, R.L., 1986. Maximum mutual information estimation of HMM parameters for speech recognition. In: Proc. of ICASSP, Tokyo, Japan.
2. Bazzi, I., Glass, J., 2000. Modeling out-of-vocabulary words for robust speech recognition. In: Proc. of ICSLP, Beijing, China, pp. 401-404.
3. Bitar, N.N., Espy-Wilson, C.Y., 1996. Knowledge-based parameters for HMM speech recognition. In: Proc. of ICASSP, Atlanta, USA, pp. 29-32.
4. Bourlard H., and Morgan N. Connectionist Speech Recognition: A Hybrid Approach (1994), Kluwer, Boston, USA
5. Chen, I.-F., Lee, L.-S., 2006. A new framework for system combination based on integrated hypothesis space. In: Proc. of InterSpeech, Pittsurgh, USA, pp. 533-536.
6. Chen, B., Zhu, Q., Morgan, N., 2004. Learning long-term temporal features in LVCSR using neural networks. In: Proc. of InterSpeech, Jej Island, Korea, pp. 925-928.
7. Davis S., and Mermelstein P. Comparison of parametric representations for monosyllable word recognition in continuously spoken sentences. IEEE Trans. Acoust. Speech Signal Process. 28 4 (1980) 357-366
8. Eide, E., 2001. Distinctive features for use in an automatic speech recognition system. In: Proc. of EuroSpeech, Aalborg, Denmark, pp. 1613-1616.
9. Evermann, G., Woodland, P.C., 2000. Large vocabulary decoding and confidence estimation using word posterior probabilities. In: Proc. of ICASSP, Istanbul, Turkey, pp. 1655-1658.
10. Fant G. Acoustic Theory of Speech Production (1960), Mounton, Co., Den Haag, NL
11. Fiscus, J.G., 1997. A post-processing system to yield reduced word error rates: recogniser output voting error reduction (ROVER). In: Proc. of IEEE ASRU Workshop, Santa Barbara, USA, pp. 347-352.
12. Frankel J., Wester M., and King S. Articulatory feature recognition using dynamic Bayesian networks. Comput. Speech Lang. 21 4 (2007) 620-640
13. Fu, Q., Moreno, A.D., Juang, B.J., Zhou, L., Soong, F.K., 2006. Generalization of minimum classification error (MCE) training based on maximizing generalized posterior probability (GPP). In: Proc. of Interspeech, Pittsburgh, USA, pp. 681-684.
14. Garofolo, J.S., Lamel, L.F., Fisher, W.M., Fiscus, J.G., Pallett, D.S., Dahlgren, N.L., 1993. DARPA TIMIT Acoustic-Phonetic Continuous Speech Corpus, U.S. Dept. of Commerce, NIST, Gaithersburg, USA.
15. Goel V., and Byrne W. Minimum Bayes-risk automatic speech recognition. Comput. Speech Lang. 14 2 (2000) 115-135
16. Hacioglu, K., Pellom, B., Ward, W., 2004. Parsing speech into articulatory events. In: Proc. of ICASSP, Montreal, Canada, pp. 925-928.
17. Hasegawa, M. et al., 2005. Landmark-Based Speech Recognition: Report of the 2004 Johns Hopkins Summer Workshop. In: Proc. of ICASSP, Philadelphia, USA.
18. Haykin S. Neural Networks: A Comprehensive Foundation. second ed. (1998), Prentice Hall, NY, USA
19. International Phonetic Association, 1999. Handbook of the International Phonetic Association: A Guide to the Use of the International Phonetic Alphabet. Cambridge University Press.
20. Hermansky, H., Fousek, P., 2005. Multi-resolution RASTA filtering for TANDEM-based ASR. In: Proc. of InterSpeech, Lisbon, Portugal, pp. 361-364.
21. Jaakkola T., and Haussler D. Exploiting generative models in discriminative classifiers. In: Solla S., and Cohn D.A. (Eds). Advances in Neural Information Processing Systems (1999), MIT Press 487-493
22. Jian H., Li X., and Liu C. Large margin hidden Markov models for speech recognition. IEEE Trans. Audio Speech Lang. Process. 14 5 (2006) 1584-1595
23. Juang B.-H., Levinson S.E., and Sondhi M.M. Maximum likelihood estimation for multivariate mixture observation of Markov chains. IEEE Trans. Inform. Theory IT-32 2 (1986) 307-309
24. Kawahara T., Lee C.-H., and Juang B.-J. Flexible speech understanding based on combined key-phrase detection and verification. IEEE Trans. Speech Audio Process. 6 6 (1998) 558-568
25. Kay S.M. Fundamentals of Statistical Signal Processing Vol. 2 (1998), Detection Theory Prentice Hall, NJ, USA
26. Kirchhoff, K., 1998. Combining articulatory and acoustic information for speech recognition in noisy and reverberant environments. In: Proc. of ISCLP, Sydney, Australia, pp. 891-894.
27. Kirchhoff, K., 1999. Robust Speech Recognition Using Articulatory Information. Ph.D. Dissertation, University of Bielefeld, Germany.
28. Koo M.-W., Lee C.-H., and Juang B.-J. Speech recognition and utterance verification based on a generalized confidence score. IEEE Trans. Speech Audio Process. 9 8 (2001) 821-831
29. Launay, B., Siohan, O., Surendran, A.C., Lee, C.-H., 2002. Towards knowledge-based features for HMM based large vocabulary automatic speech recognition. In: Proc. of ICASSP, Orlando, USA, pp. 817-820.
30. Lee K., and Hon H. Speaker-independent phone recognition using hidden Markov models. IEEE Trans. Acoust. Speech Signal Process. 37 11 (1989) 1641-1648
31. Lee, C.-H., 1997. A unified statistical hypothesis testing approach to speaker verification and verbal information verification. In: Proc. of COST Workshop Speech Technology Public Telephone Network: Where Are We Today? Rhodes, Greece, pp. 62-73.
32. Lee, C.-H., 2004. From knowledge-ignorant to knowledge-rich modeling: a new speech research paradigm for next generation automatic speech recognition. In: Proc. of InterSpeech, Jeju Island, Korea, pp. 109-112.
33. Leonard, R.G., 1984. A database for speaker independent digit recognition. In: Proc. of ICSLP, San Diego, USA.
34. Li, J., Lee, C.-H., 2005. A study on knowledge source integration for rescoring in automatic speech recognition. In: Proc. of ICASSP, Philadelphia, USA, pp. 837-840.
35. Li, J., Tsao, Y., Lee, C.-H., 2005. On designing and evaluating speech event detectors. In: Proc. of InterSpeech, Lisbon, Portugal, pp. 3365-3368.
36. Li, J., Yuan, M., and Lee, C.-H., 2006. Soft margin estimation of hidden Markov model parameters. In: Proc. of InterSpeech, Pittsburgh, USA, pp. 2422-2425.
37. Li J., Yuan M., and Lee C.H. Approximate test risk bound minimization through soft margin estimation. IEEE Trans. Audio Speech Lang. Process. 15 8 (2007) 2393-2404
38. Levinson S.E. Structural methods in automatic speech recognition. Proc. IEEE 73 (1985) 1625-1650
39. Macherey, W., Haferkamp, Schlüter, L., Ney, H., 2005. Investigations on error minimizing training criteria for discriminative training in automatic speech recognition. In: Proc. of Interspeech, Lisboa, Portugal, pp. 2133-2136.
40. Mak, B., Lai, T.C., Hsiao, R., 2006. Improving reference speaker weighting adaptation by the use of maximum-likelihood reference speakers. In: Proc. of ICASSP, Toulouse, France, pp. 222-232.
41. Mangu, L., Brill, E., Stolcke, A., 1999. Finding consensus among words: lattice-based word error minimization In: Proc. of Eurospeech, Budapest, Hungary, pp. 495-498.
42. Metze, F., Waibel, A., 2002. A flexible stream architecture for ASR using articulatory features. In: Proc. of ICSLP, Denver, USA, pp. 16-20.
43. Metze, F., 2005. Articulatory Features for Conversational Speech Recognition. Ph.D. Dissertation. University of Karlsruhe, Germany.
44. Morris, J., Folser-Lussie, E., 2006. Combining phonetic attributes using conditional random fields. In: Proc. of Interspeech, Pittsburgh, Pennsylvania, pp. 597-600.
45. Niyogi P., and Sondhi M.M. Detecting stop consonants in continuous speech. J. Acoust. Soc. Amer. 111 2 (2002) 1063-1076
46. Rabiner L.R. A tutorial on hidden Markov models and selected application in speech recognition. Proc. IEEE 77 2 (1989) 257-286
47. Richardson M., Blimes J., and Diorio C. Hidden articulator Markov models for speech recognition. Speech Comm. 41 2 (2003) 511-529
48. Sakti, S., Markov, K., Nakamura, S., 2007. An HMM acoustic model incorporating various additional knowledge sources. In: Proc. of InterSpeech, Antwerp, Belgium, pp. 2117-2120.
49. Schwartz R., Nguyen L., and Makhoul J. Multiple-pass search strategies. In: Lee C.-H., Soong F.K., and Paliwal K.K. (Eds). Automatic Speech and Speaker Recognition (1996), Kluwer Academic Publishers, Norwell, MA, USA 29-456
50. Schwarz, P., Matějaka, P., Černocký, J., 2006. Hierarchical structures of neural networks for phoneme recognition. In: Proc. of ICASSP06, Toulouse, France, 325-328.
51. Siniscalchi, S.M., Li, J., Lee, C.-H., 2006. A study on lattice rescoring with knowledge scores for automatic speech recognition. In: Proc. of InterSpeech, Pittsburgh, USA, pp. 517-520.
52. Stolcke, A., Konig, Y., Weintraub, M., 1997. Explicit word error minimization in N-best list rescoring. In: Proc. of Eurospeech, Rhodes, Greece, pp. 163-165.
53. Stüker, S., Schultz, T., Metze, F., Waibel, A., 2003. Multilingual articulatory features. In: Proc. of ICASSP, Hong Kong, China, pp. 144-147.
54. Sukkar, R.A., Wilpon, J.G., 1993. A two pass classifier for utterance rejection in keyword spotting. In: Proc. of ICASSP, Minneapolis, USA, pp. 451-454.
55. Tang, M., Seneff, S., Zue, V.W., 2003. Modeling linguistic features in speech recognition. In: Proc. of Eurospeech, Geneva, Switzerland, pp. 2585-2588.
56. Tsao, Y., Li, J., Lee, C.-H., 2005. A study on separation between acoustic models and its applications. In: Proc. of InterSpeech, Lisbon, Portugal, pp. 1109-1112.
57. Wessel F., Schulter S., Macherey K., and Ney H. Confidence measures for large vocabulary continuous speech recognition. IEEE Trans. Speech Audio Process. 9 3 (2001) 288-298
58. Woodland, P.C., Odell, J., Valtchev, V., Young, S., 1994. Large vocabulary continuous speech recognition using HTK. In: Proc. of ICASSP, Adelaide, Australia, pp. 125-128.
59. Young S., Evermann G., Kershaw D., Moore G., Odell J., Ollason D., Povey D., Valtchev V., and Woodland P.C. The HTK Book (for HTK Version 3.4) (2007), Cambridge University Press, Cambridge, UK