On-Line Estimation of Hidden Markov Model Parameters Based on the Kullback-Leibler Information Measure

IEEE Transactions on Signal Processing

Volumn 41, Issue 8, 1993, Pages 2557-2573

  Krishnamurthy, Vikram ^a   Moore, John B ^a  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; PARAMETER ESTIMATION; SIGNAL FILTERING AND PREDICTION; SIMULATION; STOCHASTIC CONTROL SYSTEMS;

HIDDEN MARKOV MODEL; KULLBACK-LEIBLER INFORMATION MEASURE; ONLINE ESTIMATION;

SIGNAL PROCESSING;

EID: 0027797470     PISSN: 1053587X     EISSN: 19410476     Source Type: Journal    
DOI: 10.1109/78.229888     Document Type: Article

References (23)

1. D. Colqhoun and A. G. Hawkes, “On stochastic properties of single ion channels,” Proc. Roy. Soc. Ser. B, no. 211, pp. 205–235, 1981.
2. S. H. Chung, V. Krishnamurthy, and J. B. Moore, “Adaptive processing techniques based on hidden Markov models for characterizing very small channel currents buried in noise and deterministic interferences,” Phil. Trans. Roy. Soc., London, vol. 334, pp. 357–384, Dec. 1991.
3. V. Krishnamurthy and L. B. White, “Blind equalization of FIR channels with Markov inputs,” in Proc. IFAC ACASP’92, Grenoble, France July 1992, pp. 633–638.
4. P. H. Barry and J. M. Diamond, “Junction potentials, electrode standard potentials, and other problems in interpreting electrical properties in membranes,” J. Membrane Biology, vol. 3, pp. 93–122, 1970.
5. L. R. Rabiner, “A tutorial on hidden Markov models and selected applications in such speech recognition,” Proc. IEEE, vol. 77, no. 2, pp. 257–285, 1989.
6. L. E. Baum and T. Petrie, “Statistical interference for probabilistic functions of finite state Markov chains,” Ann. Math. Stat., vol. 37, pp. 1554–1563, 1966.
7. L. E. Baum, T. Petrie, G. Soules, and N. Weiss, “A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains,” Ann. Math. Stat., vol. 41, no. 1, pp. 164–171, 1970.
8. L. E. Baum, “An inequality and associated maximization technique in statistical estimation for probabilistic functions of Markov processes,” Inequalities, vol. 3, pp. 1–8, 1972.
9. A. P. Dempster, N. M. Laird, and D. B. Rubin, “Maximum likelihood from incomplete data via the EM algorithm,” J. Roy. Stat. Soc., ser. 39, vol. 6, pp. 1–38, 1977.
10. V. Krishnamurthy, J. B. Moore, and S. H. Chung, “Hidden Markov model signal processing for eliminating unknown deterministic interferences,” IEEE Trans. Automat. Contr., vol. 38, no. 1, pp. 146-152, Jan. 1993.
11. D. M. Titterington, A. F. M. Smith, and U. E. Makov, Statistical Analysis of Finite Mixture Distributions. New York: Wiley Series in and Mathematical Statistics, 1985.
12. J. B. Moore, “Discrete-time fixed-lag smoothing algorithms,” Automatica, vol. 9, no. 2, pp. 163–174, 1973.
13. D. Clements and B. D. O. Anderson, “A nonlinear fixed-lag smoother for finite-state Markov processes,” IEEE Trans. Inform. Theory, vol. JT-21, no. 4, pp. 446–452, July 1975.
14. W. M. Wonham, “Some applications of stochastic differential equations to optimal nonlinear filtering,” SIAM J. Contr., vol. 2, pp. 347-1965.
15. D. M. Titterington, “Recursive parameter estimation using incomplete data,” J. Roy. Stat. Soc. B, vol. 46, no. 2, 257–267, 1984.
16. J. Behboodian, “Information matrix for a mixture of two normal distributions,” J. Stat. Comput. Simul., vol. 1, pp. 295–314, 1972.
17. S. E. Levinson, L. R. Rabiner, and M. M. Sondhi, “An introduction to the application of the theory of probabilistic functions of a Markov process to automatic speech recognition,” Bell Syst. Theory J., no. 6, pp. 1035–1074, 1983.
18. M. V. Eyuboglu and S. V. H. Qureshi, “Reduced state sequence estimations with set partitioning and decision feedback,” IEEE Trans. Commun., no. 36, pp. 12–20, 1988.
19. E. Weinstein, M. Feder, and A. V. Oppenheim, “Sequential algorithms for parameter estimation based on the Kullback-Leibler information measure,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 38, no. 9, Sept. 1990.
20. V. Krishnamurthy, J. B. Moore, and S. H. Chung, “Hidden fractal model signal processing,” Signal Processing, vol. 24, pp. 177–192, 1991.
21. B. T. Polyak, “New method of stochastic approximation type,” Automat. Remote Contr., vol. 51, 937–946, 1990.
22. T. Soderstrom and P. Stoica, System Identification. Englewood Cliffs, NJ: Prentice-Hall, 1989.
23. I. B. Codings, V. Krishnamurthy, and J. B. Moore, “Recursive prediction error techniques for adaptive estimation of hidden Markov models,” in preparation.