Hierarchical search for large-vocabulary conversational speech recognition

IEEE Signal Processing Magazine

Volumn 16, Issue 5, 1999, Pages 84-107

  Deshmukh, Neeraj ^a   Ganapathiraju, Aravind ^a   Picone, Joseph ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTATIONAL COMPLEXITY; COMPUTATIONAL LINGUISTICS; DECODING; MATHEMATICAL MODELS; PATTERN RECOGNITION SYSTEMS; SPEECH ANALYSIS; SPEECH SYNTHESIS; STATISTICAL METHODS; TABLE LOOKUP; TREES (MATHEMATICS); VOCABULARY CONTROL;

BAYESIAN APPROACH; LARGE VOCABULARY CONTINUOUS SPEECH RECOGNITION (LVCSR);

CONTINUOUS SPEECH RECOGNITION;

EID: 85032751683     PISSN: 10535888     EISSN: None     Source Type: Journal    
DOI: 10.1109/79.790985     Document Type: Article

References (69)

1. F. Alleva, H. Hon, X. Huang, M. Hwang, R. Rosenfeld, and R. Weide, "Applying SPHINX-II to the DARPA Wall Street Journal CSR task," Proc. of DARPA Speech and Natural Language Processing Workshop, pp. 393-398, 1992.
2. B.S. Atal, "Effectiveness of linear prediction characteristics of the speech wave for automatic speaker identification and verification," J. Acoust. Soc. Amer., vol. 55, no. 6, pp. 1304-1312, 1974.
3. R.L. Bahl et al, "large vocabulary natural language continuous speech recognition," Proc. of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 465-467, May 1989.
4. L. Bahl, P.F. Brown, P.V. de Souza, and R.L. Mercer, "A tree-based statistical language model for natural language speech recognition," IEEE Tran. Acoustics, Speech and Signal Processing, vol. 37, no. 7, pp. 1001-1008, 1989.
5. L.R. Bahl, P.V. de Souza, P.S. Gopalakrishnan, D. Nahamoo, and M.A. Pichney, "Context dependent modeling of phones in continuous speech Using decision trees," Proc. of DARPA Speech and Natural Language Processing Workshop, pp. 264-270, 1991.
6. L.E. Baum, "An inequality and associated maximization technique in statistical estimation for probabilistic functions of Markov processes," Inequalities, vol. 1, pp. 1-8, 1972.
7. S. Browning, M. Russell and S. Downey, "Phoneme decision tree construction for automatic speech recognition," DRA Memorandum No. 4666, Defense Research Agency, 1993.
8. J.K. Chen and F.K. Soong, "An N-best candidates-based discriminative training for speech-recognition applications," IEEE Trans. on Speech and Audio Processing, vol. 2, no. 1, Part II, pp. 206-216, Jan. 1994.
9. G.F. Chollet and C. Gagnoulet, "On the evaluation of speech recognizers and databases using a reference system," Proc. of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 2026-2029, Paris, 1982.
10. Y.L. Chow and R.M. Schwartz, "The N-best algorithm: an efficient procedure for finding top N sentence hypotheses," Proc. of DARPA Speech and Natural Language Processing Workshop, pp. 199-202, Oct. 1989.
11. Y.L. Chow, M. Ostendorf-Dunham, O.A. Kimball, M.A. Krasner, G.F. Kubala, J. Makhoul, S. Roukos, and R.M. Schwartz, "BYBLOS: the BBN continuous speech-recognition system," Proc. of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 89-92, Apr. 1987.
12. R. Cole et al, "Alphadigits corpus," http://www.cse.ogi.edu/CSLU/corpora/alphadigit, Center for Spoken Language Understanding, Oregon Graduate Institute, 1997.
13. S.B. Davis and P. Mermelstein, "Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences," IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 28, no. 4, pp. 357-366, 1980.
14. J.R. Deller, J.G. Proakis, and J.H.L. Hansen, Discrete-Time Processing of Speech Signals, Macmillan Publishing, New York, 1993.
15. N. Deshmukh, A. Ganapathiraju, J. Hamaker, and J. Picone, "large vocabulary conversational speech recognition," http://www.isip.msstate.edu/ projects/speech/, Mississippi State University, Mississippi State, Mississippi, May 1999.
16. th IEEE Southeastern Symposium on System Theory, pp. 88-91, 1995.
17. V. Digalakis, P. Monaco and H. Murveit, "Genomes: generalized mixture tying in continuous hidden Markov model-based speech recognizers," IEEE Trans. Speech and Audio Processing, vol. 4, no. 4, pp. 281-289, 1996.
18. V.V. Digalakis, M. Ostendorf, and J.R. Rohlicek, "Fast algorithms for phone classification and recognition using segment-based models," IEEE Trans. Signal Processing, vol. 40, pp. 2885-2896, 1992.
19. S. Furui, "Cepstral analysis technique for automatic speaker verification," IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 29, no. 2, pp. 254-272, 1981.
20. A. Ganapathiraju, V. Goel, J. Picone, A. Corrada, G. Doddington, K. Kirchoff, M. Ordowski and B. Wheatley, "Syllable - a promising recognition unit for LVCSR," Proc. of the IEEE Automatic Speech Recognition and Understanding Workshop, pp. 207-214, Santa Barbara, CA, Dec. 1997.
21. A. Ganapathiraju et al, "WS97 syllable team final report," Proc. of the 1997 LVCSR Summer Research Workshop, Center for Language and Speech Processing, Johns Hopkins University, Baltimore, MD, Dec. 1997.
22. J. Godfrey, E. Holliman, and J. McDaniel, "SWITCHBOARD: telephone speech corpus for research and development," Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, San Francisco, CA, pp. 517-520, Mar. 1992.
23. P.S. Gopalakrishnan, L.R. Bahl, and R.L. Mercer, "A tree search strategy for large vocabulary continuous speech recognition," Proc. of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pp 572-575, May 1995.
24. J. Hamaker and B. Brown, "Experiments," http://www.isip.msstate.edu/projects/speech/ experiments/index.html, Mississippi State University, MI, May 1999.
25. H. Hermansky, "Perceptual linear predictive (PLP) analysis of speech," J. Acoust. Soc. Amer., vol. 87, no. 4, 1990.
26. X.D. Huang, F. Alleva, H.W. Hon, M.Y. Hwang, K.F. Lee, and R. Rosenfeld, "The SPHINX-II speech-recognition system: an overview," Computer, Speech, and Language, 1992.
27. X.D. Huang, H.W. Hon, M.Y. Hwang, and K.F. Lee, "A comparative study of discrete, semi-continuous and continuous hidden Markov models," IEEE Computer Speech and Language, vol. 7, no. 4, pp. 359-368, 1993.
28. M. Jardino, "Multilingual stochastic N-gram class language models," Proc. of the IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 1, pp. 161-163, May 1996.
29. F. Jelinek, Statistical Methods for Speech Recognition, MIT Press, Cambridge, MA, 1997.
30. nd European Conference on Speech Communication and Technology (Eurospeech), pp. 1037-1040, Genova, Italy, Sept. 1991.
31. F. Jelinek, R.L. Mercer, and S. Roukos, "Principles of lexical modeling for speech recognition," S. Furui and M.M. Sondhi, Eds., Advances in Speech Signal Processing, pp. 651-699, Marcel Dekker Inc., 1992.
32. R. Kuhn and R. de Mori, "A Cache Based Natural Language Model for Speech Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 14, pp. 570-583, 1992.
33. J. Kupiec, "Probabilistic models of short and long distance word dependencies in running text," Proc. of the ARPA Workshop on Speech and Natural Language, pp. 290-295, Feb. 1989.
34. J. Lafferty, D. Sleator, and D. Temperley, "Grammatical trigrams: a probabilistic model of link grammar," Proc. of the AAAI Fall Symposium on Probabilistic Approaches to Natural Language, pp. 89-97, Oct., 1992.
35. R. Lau, R. Rosenfeld, and S. Roukos, "Trigger-based language models: a maximum entropy approach," Proc. of the IEEE International Conference on Acoustics, Speech und Signal Processing, vol. 2, pp. 45-48, Apr. 1993.
36. K.F. Lee and F. Alleva, "Continuous speech recognition," in Advances in Speech Signal Processing, S. Furui and M.M. Sondhi, Eds., pp. 651-699, Marcel Dekker Inc., 1992.
37. K.F. Lee and H.W. Hon, "large vocabulary speaker-independent continuous speech recognition," Proc. of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 123-126, Apr. 1987.
38. B.T. Lowerre, "The HARPY speech-recognition system,"Ph.D. thesis, Carnegie Mellon University, 1976.
39. M. Mohri, M. Riley, D. Hindle, A. Ljolje, and F. Pereira, "Full expansion of context-dependent networks in large vocabulary speech recognition," Proc. of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 665-668, May 1998.
40. H. Murveit, J. Butzberger, V. Digalakis, and M. Weintraub, "Progressive-search algorithms for large vocabulary speech recognition," Proc. of DARPA Human Language Technology Workshop, Mar. 1993.
41. H. Murveit, P. Monaco, V. Digalakis, and J. Butzburger, "Techniques to achieve an accurate real-time, large vocabulary speech recognition system," Proc. of the ARPA Human Language Technology Workshop, pp. 368-373, Austin, TX, March 1995.
42. B.F. Necioglu, M. Ostendorf, and J.R. Rohlicek, "A Bayesian approach to speaker adaptation for the stochastic segment model," Proc. of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp. I-437-I-440, 1992.
43. H. Ney, "Dynamic programming parsing for context-free grammars in continuous speech recognition," IEEE Trans. Signal Processing, vol. 39, no. 2, pp. 336-341, Feb. 1991.
44. H. Ney, U. Essen, and R. Kneser, "On structuring probabilistic dependencies in stochastic language modeling," Computer Speech and Language, vol. 8, no. 1, pp. 1-38, 1994.
45. H. Ney, D. Mergel, A. Noll, and A. Paesler, "Data driven organization of the dynamic programming beam search for continuous speech recognition," IEEE Trans. Signal Processing, vol. 40, no. 2, pp. 272-281, Feb. 1992.
46. H. Ney and S. Ortmanns, "Dynamic programming search for continuous speech recognition," to appear in the IEEE Signal Processing Magazine, Sept. 1999.
47. L. Nguyen, R. Schwartz, F. Kubala, and P. Placeway, "Search algorithms for software-only real-time recognition with very large vocabularies," Proc. of DARPA Human Language Technology Workshop, pp. 91-95, Mar. 1993.
48. L. Nguyen, R. Schwartz, Y. Zhao, and G. Zavaliagkos, "Is N-best dead?" Proc. of DARPA Human Language Technology Workshop, pp. 386-388, Mar. 1994.
49. N.J. Nilsson, Problem Solving Methods in Artificial Intelligence, McGraw-Hill, New York, 1971.
50. J.J. Odell, V. Valtchev, P.C. Woodland, and S.J. Young, "A one-pass decoder design for large vocabulary recognition," Proc. of DARPA Speech and Natural Language Processing Workshop, pp. 380-385, 1992.
51. D. Pallett et al, "1995 benchmark tests for the ARPA spoken language program," Proc. of the ARPA Spoken Language Systems Technology Workshop, Harriman, NY, Feb. 1996.
52. D.B. Paul, "Algorithms for an optimal A* search and linearizing the search in the stack decoder," Proc. the IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 693-696, Toronto, Canada, 1991.
53. D.B. Paul, "An efficient A* stack decoder algorithm for continuous speech recognition with a stochastic language model," Proc. of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 405-409. Mar. 1992.
54. D.B. Paul, "The Lincoln large vocabulary stack decoder based HMM CSR," Proc. of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 374-379, Apr. 1993.
55. J. Picone, "Continuous speech recognition using hidden Markov models," IEEE Acoustics, Speech, and Signal Processing Magazine, vol. 7, no. 3, pp. 26-41, Jul. 1990.
56. J. Picone, "Signal modeling techniques in speech recognition," Proc. of the IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 81, no. 9, pp. 1215-1247, 1993.
57. L.R. Rabiner and B.H. Juang, Fundamentals of Speech Recognition, Prentice Hall, Englewood Cliffs, New Jersey, 1993.
58. A.J. Robinson, "An application of recurrent nets to phone probability estimation," IEEE Trans. Neural Networks, vol. 5, no. 2, pp. 298-305, 1994.
59. A.J. Robinson and F. Fallside, "A recurrent error propagation network speech-recognition system," Computer Speech and Language, vol. 5, no. 3, pp. 259-274, 1991.
60. J. Schalkwyk, D. Colton, and M. Fanty, "The CSLUsh toolkit for automatic speech recognition," Technical Report CSLU-011-1995, Center for Spoken Language Understanding, Oregon Graduate Institute of Science and Technology, Portland, Dec. 1995.
61. R. Schwartz and S. Austin, "A comparison of several approximate algorithms for finding multiple (N-best) sentence hypotheses," Proc. of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 701-704, 1991.
62. R.M. Schwartz and S. Austin, "Efficient, high-performance algorithms for N-best search," Proc. of DARPA Speech and Natural Language Processing Workshop, pp. 6-11, Jun. 1990.
63. R.D. Sharp, E. Bocchieri, C. Castillo, S. Parthasarathy, C. Roth, M. Riley, and J. Rowland, "The Watson speech-recognition engine," Proc. of the IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 4065-4068, May 1997.
64. K. Shobaki, "Learn about and experience spoken language technology," http://cslu.cse.ogi.edu/learn, Oregon Graduate Institute of Science and Technology, Portland, May 1999.
65. F.K. Soong and E.F. Huang, "A tree-trellis-based fast search for finding the N-best sentence hypotheses in continuous speech recognition," Proc. of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pp. 705-708, 1991.
66. th International Conference on Spoken Language Processing, vol. 6, pp. 2779-2782, Nov, 1998.
67. A.J. Viterbi, "Error bounds for convolutional codes and an asymptotically optimal decoding algorithm," IEEE Trans. Information Theory, vol. 13, pp. 260-269, Apr. 1967.
68. P. Woodland et al, HTK Version 1.5: User, Reference and Programmer Manuals, Entropic Research Labs Inc., 1995.
69. S.J. Young and P.C. Woodland, "State clustering in HMM-based continuous speech recognition," Computer Speech and Language, vol. 8, no. 4, pp. 369-384, 1993.