On automatic speech recognition at the dawn of the 21st century

IEICE Transactions on Information and Systems

Volumn E86-D, Issue 3, 2003, Pages 377-396

  Lee, Chin Hui ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Acoustic modeling; Automatic speech recognition; Dynamic programming; Feature extraction and detection; Heuristic search; Hidden Markov model; Language modeling; Lexical modeling; Maximum likelihood; Pattern recognition; String decoding; Utterance verification

Indexed keywords

ACOUSTICS; ALGORITHMS; COMPUTATIONAL METHODS; DYNAMIC PROGRAMMING; FEATURE EXTRACTION; MARKOV PROCESSES; MATHEMATICAL MODELS; SIGNAL PROCESSING; SPEECH ANALYSIS;

AUTOMATIC SPEECH RECOGNITION (ASR);

SPEECH RECOGNITION;

EID: 0038720005     PISSN: 09168532     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (99)

1. A. Acero, Acoustical and Environmental Robustness in Automatic Speech Recognition, Kluwer Academic Publishers, 1992.
2. J. Alien, "From Lord Rayleigh to Shannon: How do we decode speech?," Proc. ICASSP-2002, Orlando, 2002.
3. B.S. Atal, "Efficient coding of LPC parameters by temporal decomposition," Proc. ICASSP-83, pp.81-84, 1983.
4. L.R. Bahl, F. Jelinek, and R.L. Mercer, "A maximum likelihood approach to continuous speech recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol.5, no.2, pp.179-190, 1983.
5. L.R. Bahl, P.F. Brown, P.V. de Souza, and R.L. Mercer, "Maximum mutual information estimation of hidden Markov model parameters for speech recognition," Proc. ICASSP-86, pp.49-52, Tokyo, 1986.
6. L.E. Baum, T. Petrie, G. Soules, and N. Weiss, "A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains," Annal Math. Stat, vol.41, pp.164-171, 1970.
7. J.R. Bellegarda and D. Nahamoo, "Tied mixture continuous parameter modeling for speech recognition," IEEE Trans. Acoust., Speech Signal Process, vol.38, no.12, pp.2033-2045, 1990.
8. J.R. Bellegarda, "Exploiting latent semantic information for statistical language modeling," Proc. IEEE, vol.88, no.8, pp.1279-1296, 2000.
9. A. Biem, S. Katagiri, and B.-H. Juang, "Discriminative feature extraction for speech recognition," Proc. IEEE NN-SP Workshop, 1993.
10. H. Bourlard and N. Morgan, Connectionist Speech Recognition - A Hybrid Approach, Kluwer Academic Publishers, 1994.
11. H. Bourlard, "Non-stationary multi-channel (multi-stream) processing towards robust and adaptive ASR," Proc. Tampere Workshop on Robust Methods for Speech Recognition in Adverse Conditions, pp. 1-10, 1999.
12. J. Bridle, el al, "An investigation of segmental hidden dynamic models of speech coarticulation for automatic speech recognition," Final Report: 1998 Workshop on Language Engineering, pp.1-61, CLSP at Johns Hopkins University, 1998.
13. N. Chomsky and M. Halle, The Sound Pattern of English, Harper and Row, 1968.
14. W. Chou, "Discriminant-function-based minimum recognition error rate pattern recognition approach to automatic speech recognition," Proc. IEEE, vol.88, no.8, pp. 1201-1223, 2000.
15. K.W. Church, Phonological Parsing in Speech Recognition, Kluwer Academic Publishers, 1987.
16. R.V. Cox, C.A. Camm, L.R. Rabiner, J. Schroeter, and J.G. Wilpon, "Speeech and language processing for next-millennium communication services," Proc. IEEE, vol.88, no.8, pp.1237-1314, 2000.
17. S.B. Davis and P. Mermelstein, "Comparison of parametric representations of monosyllabic word recognition in continuously spoken sentences," IEEE Trans. Acoust., Speech Signal Process., vol.28, no.4, pp.357-366, 1980.
18. R. De Mori, ed., Spoken Dialogues with Computers, Academic Press, 1998.
19. L. Deng, "Computational models for speech production," Computational Models for Speech Pattern Processing (NATO ASI Serie), pp.199-214, Springer, 1997.
20. Y. Ephraim, "Statistical model based speech enhancement systems," Proc. IEEE, vol.80, no.10, pp.1526-1555, 1992.
21. G. Fant, Speech Sounds and Features, MIT Press, 1973.
22. J.G. Fiscus, "A post-processing system to yield reduced word error rates: Recognizer output voting error reduction (ROVER)," Proc. 1997 ASRU Workshop, pp.347-352, Santa Barbara, 1997.
23. J.L. Flanagan, Speech Analysis, Synthesis and Perception, 2nd edition, Springer-Verlag, 1972.
24. S. Furui, "Speaker-independent isolated word recognition using dynamic features of speech spectrum," IEEE Trans. Acoust., Speech Signal Process., vol.34, no.1, pp.52-59, 1986.
25. S. Furui and S. Nakamura (eds.), Proc. First International Workshop on Hands-Free Speech Communication, 2001.
26. M.J.F. Gales and S.J. Young, "Parallel model combination for speech recognition in noise," Technical Report, CUED/F-INFENG/TR135, 1993.
27. Y. Gao, R. Bakkis, J. Huang, and B. Zhang, "Multistage coarticulation model combining articulatory, formant and cepstral features," Proc. ICSLP, pp.91-94, 2000.
28. J.-L. Gauvain and C.-H. Lee, "Maximum a posteriori estimation for multivariate gaussian mixture observations of Markov chains," IEEE Trans. Speech Audio Process., vol.2, no.2, pp.291-298, 1994.
29. J.-L. Gauvain and L. Lamel, "Large vocabulary continuous speech recognition: Advances and applications," Proc. IEEE, vol.88, no.8, pp.1181-1200, 2000.
30. O. Ghitza, "Auditory nerve feedback as a basis for speech processing," Proc. ICASSP-88, pp.91-94, 1988.
31. A. Gersho and R.M. Gray, Vector Quantization and Signal Compression, Kluwer Academic Press, 1992.
32. Y. Gong, "Stochastic trajectory modeling and sentence searching for continuous speech recognition," IEEE Trans. Speech Audio Process., vol.5, no.l, pp.33-44, 1997.
33. S. Greenberg, J. Hollenback, and D. Ellis, "Insight into spoken language gleaned from phonetic transcription of the switchboard corpus," Proc. ICSLP-96, Philadelphia, 1996.
34. H.-W. Hon, Vocabulary-Independent Speech Recognition: The VOCIND System, Ph. D. Thesis, School of Computer Science, Carnegie Mellon University, 1992.
35. X. Huang and M.A. Jack, "Semi-continuous hidden Markov models for speech signal," Computer, Speech and Language, vol.3, pp.239-251, 1989.
36. Q. Huo and C.-H. Lee, "On-line adaptive learning of the continuous density hidden Markov model based on approximate recursive bayes estimate," IEEE Trans. Speech Audio Process., vol.5, no.2, pp.161-172, 1997.
37. Q. Huo and C.-H. Lee, "Robust speech recognition based on adaptive classification and decision strategies," Speech Communication, vol.34, nos.1-2, pp.175-194, 2001.
38. M. Hwang and X. Huang, "Share-distribution hidden Markov models for speech recognition," IEEE Trans. Speech Audio Process., vol.1, no.3, pp.414-420, 1993.
39. F. Jelinek, "The development of an experimental discrete dictation recognizer," Proc. IEEE, vol.73, no.10, pp.1616-1624, 1985.
40. F. Jelinek, Statistical Method for Speech Recognition, MIT Press, 1997.
41. H. Jiang, K. Hirose, and Q. Huo, "Robust speech recognition based on a Bayesian prediction approach," IEEE Trans. Speech Audio Process., vol.7, no.4, pp.426-440, 1999.
42. B.-H. Juang, "Maximum-likelihood estimation for mixture multivariate stochastic observations of Markov chains," AT&T Tech. J., vol.64, 1985.
43. B.-H. Juang and S. Furui, "Automatic speech recognition and understanding: A first step toward natural human-machine communication," Proc. IEEE, vol.88, no.8, pp.1142-1165, 2000.
44. J.-C. Junqua, H. Wakita, and H. Hermansky, "Evaluation and optimization of perceptually-based ASR Front-End," IEEE Trans. Speech Audio Process., vol.1, no.1, pp.39-48, 1993.
45. J.-C. Junqua and J.-P. Haton, Robustness in Automatic Speech Recognition: Fundamentals and Applications, Kluwer Academic Publishers, Boston, 1996.
46. S. Katagiri, B.-H. Juang, and C.-H. Lee, "Pattern recognition using a generalized probabilistic descent method," Proc. IEEE, vol.86, no.11, pp.2345-2373, 1998.
47. T. Kawahara, C.-H. Lee, and B.-H. Juang, "Key-phrase detection and verification for flexible speech understanding," IEEE Trans. Speech Audio Process., vol.6, no.6, pp.558-568, Nov. 1998.
48. D. Klatt, "Review of the ARPA speech understanding project," J. Acoust. Soc. Am., vol.62, no.6, 1977.
49. T. Kohonen, Self-Organizing Maps, Springer-Verlag, 1995.
50. M.-W. Koo, C.-H. Lee, and B.-H. Juang, "Speech recognition and utterance verification based on a generalized confidence score," IEEE Trans. Speech Audio Process., vol.9, no.8, pp.821-832, Nov. 2001.
51. B. Launay, O. Siohan, A.C. Surendran, and C.-H. Lee, "Towards knowledge-based features for HMM based large vocabulary automatic speech recognition," Proc. ICASSP-2002, Orlando, 2002.
52. W. Lea, ed., Trends in Speech Recognition, Prentice Hall, 1980.
53. C.-H. Lee, C.-H. Lin, and B.-H. Juang, "A study on speaker adaptation of the parameters of continuous density hidden Markov models," IEEE Trans. Acoust., Speech Signal Process., vol.39, no.4, pp.806-814, 1991.
54. C.-H. Lee, F.K. Soong, and K.K. Paliwal, eds., Automatic Speech and Speaker Recognition: Advanced Topics, Kluwer Academic Publishers, 1996.
55. C.-H. Lee, "A unified statistical hypothesis testing approach to speaker verification and verbal information verification," Proc. COST Workshop on Speech Technology in the Public Telephone Network, pp.62-73, Greece, 1997.
56. C.-H. Lee, "On stochastic feature and model compensation approaches to robust speech recognition," Speech Communication, vol.25, pp.29-47, 1998.
57. C.-H. Lee, "A detection approach to flexible speech recognition and understanding," 1998 Johns Hopkins University Summer Workshop, 1998.
58. C.-H. Lee and Q. Huo, "On adaptive decision rules and decision parameter adaptation for automatic speech recognition," Proc. IEEE, vol.88, no.8, pp.1241-1269, 2000.
59. C.-H. Lee, "Statistical confidence measures and their applications," Proc. ICSP-01, pp. 1021-1028, 2001.
60. K.-F. Lee, Automatic Speech Recognition - The Development of the SPHINX-System, Kluwer Academic Publishers, Boston, 1989.
61. C.J. Leggetter and P.C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models," Computer Speech and Language, vol.9, pp.171-185, 1995.
62. S.E. Levinson, "Structural methods in automatic speech recognition," Proc. IEEE, vol.73, no.10, pp.1625-1650, 1985.
63. R. Lippmann, "Speech recognition by human and machines," Speech Communication, vol.22, pp. 1-14, 1997.
64. A. Ljolje and M.D. Riley, "Optimal speech recognition using phone recognition and lexical access," Proc. ICSLP-92, pp.313-316, 1992.
65. L.R. Liporace, "Maximum likelihood estimation for multivariate observations of Markov sources," IEEE Trans. Inf. Theory, vol.28, no.5, pp.729-734, 1982.
66. J. Makhoul, F. Kubala, T. Leek, D. Liu, L. Nguyen, R. Schwartz, and A. Srivastava, "Speech and language technologies for audio indexing and retrieval," Proc. IEEE, vol.88, no.8, pp.1338-1353, 2000.
67. N. Merhav and C.-H. Lee, "A minimax classification approach with application to robust speech recognition," IEEE Trans. Speech Audio Process., vol.1, no.1, pp.90-100, 1993.
68. H. Ney and S. Ortmanns, "Progresses in dynamic programming search for LVCSR," Proc. IEEE, vol.88, no.8, pp.1224-1240, 2000.
69. P. Niyogi and P. Ramesh, "A detection framework for locating phonetic events," Proc. ICSLP-98, Sydney, 1998.
70. Y. Normandin and D. Morgera, "An improved MMIE training algorithm for speaker-independent small vocabulary, continuous speech recognition," Proc. ICASSP-91, pp.537-540, 1991.
71. J.P. Olive, A. Greenwood, J. Coleman, and A. Greenwood, Acoustics of American English Speech: A Dynamic Approach, Springer, 1993.
72. M. Ostendorf and S. Roukos, "A stochastic segment model for phoneme-based continuous speech recognition," IEEE Trans. Acoust., Speech Signal Process., vol.37, no.9, pp.1857-1869, 1989.
73. L.R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol.77, no.2, pp.257-286, 1989.
74. L.R. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition, Prentice-Hall, 1993.
75. P. Ramesh and P. Niyogi, "The voice feature for stop consonants: Acoustic phonetic analysis and automatic speech recognition experiments," Proc. ICSLP-98, Sydney, 1998.
76. R. Reddy, ed., Speech Recognition, Invited Papers Presented at the 1974 IEEE Symposium, Academic Press, 1974
77. M.D. Riley, "A statistical model for generating pronunciation networks," Proc. ICASSP-91, pp.737-740, 1991.
78. R.C. Rose, E.M. Hofstetter, and D.A. Reynold, "Integrated models of speech and background with application to speaker identification in noise," IEEE Trans. Speech Audio Process., vol.2, no.2, pp.245-257, 1994.
79. R. Rosenfeld, "Two decades of statistical language modeling: Where do we go from here?," Proc. IEEE, vol.88, no.8, pp.1279-1296, 2000.
80. A. Sankar and C.-H. Lee "A maximum likelihood approach to stochastic matching for robust speech recognition," IEEE Trans. Speech Audio Process., vol.4, no.3, pp.190-202, 1996.
81. R. Schwartz and Y.-L. Chow, "The N-best algorithm: An efficient and exact procedure for finding the N most likely sentence hypotheses,"- Proc. ICASSP-90, pp.81-84, 1990.
82. S. Seneff, "A joint synchrony/mean-rate model of auditory speech processing," J. Phonetics, vol.16, pp.55-76, 1988.
83. K. Shinoda and C.-H. Lee, "A structural bayes approach to speaker adaptation," IEEE Trans. Speech Audio Process., vol.9, no.3, pp.276-287, 2001.
84. O. Siohan, C. Chesta, and C.-H. Lee, "Joint maximum a posteriori adaptation of transformation and HMM parameters," IEEE Trans. Speech Audio Process., vol.9, no.4, pp.417-428, 2001.
85. F.K. Soong and E.F. Huang, "A tree-trellis based fast search for finding the N-best sentence hypotheses in continuous speech recognition," Proc. ICASSP-91, pp.703-706, 1991.
86. "Special Issue on Robust Speech Recognition," Speech Communication, vol.25, nos.1-3, 1998.
87. K. Stevens, Acoustic Phonetics, MIT Press, 1998.
88. R.A. Sukkar and C.-H. Lee, "Vocabulary independent discriminative utterance verification for non-keyword rejection in subword based speech recognition," IEEE Trans. Audio Speech Process., vol.4, no.6, pp.420-429, 1996.
89. E. Sumita, S. Yamada, K. Yamamoto, M. Paul, H. Kashioka, K. Ishikawa, and S. Shirai, "Solutions to problems inherent in spoken-language translation: The ATR-MATRIX approach," Proc. MT Summit VII, 1999.
90. A.C. Surendran, C.-H. Lee, and M. Rahim, "Nonlinear compensation for stochastic matching," IEEE Trans. Speech Audio Process., vol.7, no.6, pp.643-655, 1999.
91. J. Takami and S. Sagayama, "A successive state splitting algorithm for efficient allophone modeling," Proc. ICASSP-92, pp.I-573-576, 1992.
92. A.P. Varga and R.K. Moore, "Hidden Markov model decomposition of speech and noise," Proc. ICASSP-90, pp.845-848, 1990.
93. A. Waibel, P. Geutner, L.M. Tomokiyo, T. Schultz, and M. Woszczyna, "Multiliguality in speech and spoken language systems," Proc. IEEE, vol.88, no.8, pp.1166-1180, 2000.
94. J.G. Wilpon, L.R. Rabiner, C.-H. Lee, and E.R. Goldman, "Automatic recognition of keywords in unconstrained speech using hidden Markov models," IEEE Trans. Acoust., Speech Signal Process., vol.38, no.9, pp. 1870-1878, 1990.
95. S.J. Young, J.J. Odell, and P.C. Woodland, "Tree-based state tying for high accuracy acoustic modeling," Proc. ARPA Human Language Technology Workshop, 1994.
96. S. Young, J. Odell, D. Ollason, V. Valtchev, and P. Woodland, The HTK Book (for HTK Version 2.1), Cambridge University, 1997.
97. V.W. Zue, "Acoustic-phonetic knowledge representation: Implications from spectrograms reading experiments," Tutorial paper presented at the 1981 NATO ASI on Speech Recognition, Bonas, France, 1981.
98. V. Zue, J. Glass, M. Phillips, and S. Seneff, "The MIT summit speech recognition system: A progress report," Proc. DARPA Speech and Natural Language Workshop, pp. 179-189, 1989.
99. V.W. Zue and J.R. Glass, "Conversational interfaces: Advances and challenges," Proc. IEEE, vol.88, no.8, pp.1166-1180, 2000.