ML Estimation of a Stochastic Linear System with the EM Algorithm and Its Application to Speech Recognition

IEEE Transactions on Speech and Audio Processing

Volumn 1, Issue 4, 1993, Pages 431-442

  Digalakis, V ^a   Rohlicek, J R ^b   Ostendorf, M ^c  

^a SRI INTERNATIONAL   (United States)

^b BBN TECHNOLOGIES   (United States)

^c BOSTON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; DATA COMMUNICATION SYSTEMS; DATABASE SYSTEMS; ITERATIVE METHODS; LINEAR CONTROL SYSTEMS; MATHEMATICAL MODELS; PARAMETER ESTIMATION; SPEECH ANALYSIS; SPEECH RECOGNITION; STATE SPACE METHODS; STATISTICAL METHODS; VECTORS;

EXPECTATION MAXIMIZATION; HIDDEN MARKOV MODELS; STOCHASTIC LINEAR SYSTEM;

STOCHASTIC CONTROL SYSTEMS;

EID: 0027681974     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/89.242489     Document Type: Article

References (34)

1. H. Akaike, “Maximum likelihood identification of gaussian autoregressive moving average models,” Biometrica, vol, 60, no. 2, pp. 255–265, 1973.
2. K. J. Astrom and T. Bohlin, “Numerical identification of linear dynamic systems from normal operating records,” in Proc. 2nd IFAC Symp. on the Theory of Self-Adaptive Control Systems, pp. 96–111, 1965.
3. J. K. Baker, “The dragon system—an overview,” IEEE Trans, on Acoust., Speech and Signal Proc., vol. ASSP-23, pp. 24–29, Feb. 1975.
4. L. E. Baum, T. Petrie, G. Soules, and N. Weiss, “A maximization technique in the statistical analysis of probabilistic functions of finite state Markov chains,” Ann. Math. Stat., vol. 41, pp. 164–171, 1970.
5. P. F. Brown, “The acoustic-modeling problem in automatic speech recognition,” Ph.D. dissertation, Computer Science Department, CMU, 1987.
6. P. E. Caines, Linear Stochastic Systems. New York: Wiley, 1988.
7. A. P. Dempster, N. M. Laird, and D. B. Rubin, “Maximum likelihood estimation from incomplete data,” J. Royal Stat. Soc. (B), vol. 39, no. 1, pp. 1–38, 1977.
8. V. Digalakis, “Segment-based stochastic models of spectral dynamics for continuous speech recognition,” Ph.D. dissertation, E.C.S. Department, Boston University, 1992.
9. V. Digalakis, M. Ostendorf, and J. R. Rohlicek, “Improvements in the stochastic segment model for phoneme recognition,” in Proc. 2nd DARPA Workshop on Speech and Natural Language, pp. 332–338, Oct. 1989.
10. V. Digalakis, M. Ostendorf, and J.R. Rohlicek, “Fast algorithms for phone classification and recognition using segment-based models,” IEEE Trans. Signal Processing, vol. 40, pp. 2885–2896, Dec. 1992.
11. V. Digalakis, J. R. Rohlicek, and M. Ostendorf, “A dynamical system approach to continuous speech recognition,” in Proc. IEEE Int. Conf. Acoust., Speech, Signal Processing, pp. 289–292, Toronto, Canada, May 1991.
12. J. D. Gibson, B. Koo, and S. D. Gray, “Filtering of colored noise for speech enhancement and coding,” IEEE Trans, on Signal Processing, vol. 39, pp. 1732–1742, Aug. 1991.
13. N. K. Gupta and R. K. Mehra, “Computational aspects of maximum likelihood estimation and reduction in sensitivity function calculations,” IEEE Trans. Automatic Control, vol. AC-19, pp. 774–783, Dec. 1974.
14. F. Jelinek, “Continuous speech recognition by statistical methods,” IEEE Proc., vol. 64, pp. 532–556, Apr. 1976.
15. R. E. Kalman, “A new approach to linear filtering and prediction problems,” Trans. ASME, Series D, J. Basic Eng., vol. 82, pp. 35-45 Mar. 1960.
16. R. L. Kashyap, “Maximum likelihood identification of stochastic linear systems,” IEEE Trans. Automatic Control, vol. AC-15, pp. 25–34, Feb. 1970.
17. P. Kenny, M. Lennig, and P. Mermelstein, “A linear predictive HMM for vector-valued observations with applications to speech recognition,” IEEE Trans, on Acoust., Speech, and Signal Proc., vol. ASSP-38, pp. 220–225, Feb. 1990.
18. L. F. Lamel, R. H. Kassel, and S. Seneff, “Speech database development: Design and analysis of the acoustic-phonetic corpus,” in Proc. DARPA Speech Reconition Workshop, Rep. No. SAIC-86/1546 pp. 100–109, Feb. 1986.
19. K. F. Lee and H. W. Hon, “Speaker-independent phone recognition using hidden Markov models,” IEEE Trans, on Acoust., Speech, and Signal Proc., vol. ASSP-37, pp. 1641–1648, Nov. 1989.
20. E. Levin, “Word recognition using hidden control neural architecture,” in IEEE Int. Conf. Acoust., Speech, Signal Processing, pp. 433–436, Albuquerque, NM, Apr. 1990.
21. J. S. Lim and A. V. Oppenheim, “All-pole modeling of degraded speech,” IEEE Trans. Acoust., Speech, and Signal Proc., vol. ASSP-26, pp. 197–210, June 1978.
22. D. G. Luenberger, Linear and Nonlinear Programming, 2nd Ed. Reading, MA: Addison-Wesley, 1984.
23. D. Q. Mayne, “Parameter Estimation,” Automatica, vol. 3, pp. 245–255, 1966.
24. M. Ostendorf, A. Kannan, O. Kimball, R. Schwartz, S. Austin, and R. Rohlicek, “Integration of diverse recognition methodologies through reevaluation of N-best sentence hypotheses,” in Proc. DARPA Workshop on Speech and Natural Language, Monterey, CA, pp. 83–87, Feb. 1991.
25. M. Ostendorf and S. Roukos, “A stochastic segment model for phoneme-based continuous speech recognition,” IEEE Trans. Acoust., Speech, and Signal Proc., vol. ASSP-37, pp. 1857–1869, Dec. 1989.
26. S.U.H. Qureshi, “Adaptive equalization,” IEEE Proc., vol. 73, pp. 1349–1387, Sept. 1985.
27. L. R. Rabiner, J. G. Wilpon, and B.-H. Juang, “A segmental fc-means training procedure for connected word recognition,” AT&T Tech. J., pp. 21–40, May-June 1986.
28. H. E. Rauch, F. Tung, and C. T. Striebel, “Maximum likelihood estimates of linear dynamic systems,” AIAA J., vol. 3, pp. 1445–1450, Aug. 1965.
29. S. Roucos, M. Ostendorf, H. Gish, and A. Derr, “Stochastic segment modeling using the estimate-maximize algorithm,” in IEEE Int. Conf. Acoust., Speech, Signal Processing, pp. 127–130, New York, Apr. 1988.
30. N. R. Sandell, Jr., and K. I. Yared, “Maximum likelihood identification of state space models for linear dynamic systems,” Rep. ESL-R-814, Electron. Syst. Lab, M.I.T., Cambridge, MA, 1978.
31. R. H. Shumway and D. S. Stoffer, “An approach to time series smoothing and forecasting using the EM algorithm,” J. Time Series Analysis, vol. 3, no. 4, pp. 253–264, 1982.
32. D. A. Wilson and A. Kumar, “Derivative computations for the log likelihood function,” IEEE Trans. Automatic Control, vol. AC-21, pp. 230–232, Feb. 1982.
33. J. Zhang and J. W. Modestino, “The mean field theory in EM procedures for Markov random fields,” in Proc. IEEE Int. Symp. Information Theory, Budapest, Hungary, 167–169, June 1991.
34. V. Zue, J. Glass, M. Philips, and S. Seneff, “Acoustic segmentation and phonetic classification in the SUMMIT system,” in IEEE Int. Conf Acoust., Speech, Signal Processing, pp. 389–392, Glasgow, Scotland, May 1989.