Online learning algorithm of dynamic bayesian networks for nonstationary signal processing

International Journal of Innovative Computing, Information and Control

Volumn 5, Issue 4, 2009, Pages 1027-1041

  Cho, Hyun Cheol ^a   Lee, Kwon Soon ^a   Fadali, M Sami ^b  

^a Dong A University   (South Korea)

^b Department of Computer Science and Engineering   (United States)

Author keywords

Convergence property; Dynamic Bayesian networks; Hidden Markov model; Markov chain; Online estimation

Indexed keywords

EID: 64349098639     PISSN: 13494198     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (19)

1. H. C. Cho, M. S. F and K. S. Lee, Design of time-varying stochastic process with dynamic Bayesian networks, KIEE J. Electr. Eng. Technol., vol.2, no.4, pp.543-548, 2007.
2. J. M. Mendel, Lessons in Estimation Theory for Signal Processing, Communications, and Control, Prentice Hall, 1995.
3. T. K. Moon, The expectation-maximization algorithm, IEEE Signal Processing Magazine, vol.13, no.6, pp.47-60, 1996.
4. X. Huang, A. Acero and H.-W. Hon, Spoken Language Processing, Prentice Hall, 2001.
5. F. V. Nelwamondo, T. Marwala and U. Mahola, Early classifications of bearing faults using hidden Markov models, Gaussian mixture models, mel-frequency cepstral coefficients and fractals, International Journal of Innovative Computing, Information and Control, vol.2, no.6, pp.1281-1299, 2006.
6. D. Hernandez-Hernandez, S. I. Marcus and P. J. Fard, Analysis of a risk-sensitive control problem for hidden Markov chains, IEEE Trans, on Automatic Control, vol.44, no.5, pp.1093-1100, 1999.
7. H. C. Cho, S. M. Fadali and K. S. Lee, Probability density estimation with dynamic Bayesian networks, Int. J. of Control, Automation, & Systems, vol.6, no.2, pp.278-281, 2008.
8. P. Baldi and Y. Chauvin, Smooth on-line learning algorithm for hidden Markov models, Neural Computation, vol.6, no.2, pp.307-318, 1994.
9. J. J. Ford and J. B. Moore, Adaptive estimation of HMM transition probabilities, IEEE Trans, on Signal Processing, vol.46, no.5, pp. 1374-1385, 1998.
10. J. C. Stiller and G. Radons, Online estimation of hidden Markov models, IEEE Signal Processing Letters, vol.6, no.8, pp.213-215, 1999.
11. I. Cohen and A. Bronstein, Adaptive online learning of Bayesian network parameters, http://www.hpl.hp.com/techreports/2001/HPL-2001-156.pdf, 2001.
12. S.-Z. Zhang, H. Yu, N-H. Yang and X.-K Wang, An application of online learning algorithm for Bayesian network parameter, Proc. of the Second International Conf. on Machine Learning and Cybernetics, pp. 153-156, 2003.
13. E. Parzen, On estimation of a probability density function and mode, Annals of Mathematical Statistics, vol.33, no.3, pp.1065-1076, 1962.
14. B. W. Silverman, Density Estimation for Statistics and Data Analysis, Chapman & Hall/CRC, 1986.
15. V. Krishnamurthy, J. B. Moore and S.-H. Chung, Hidden Markov model signal processing in presence of unknown deterministic inferences, IEEE Transaction on Automatic Control, vol.38, no.l, pp.146-152, 1993.
16. R. J. Serfling, Approximation Theorems of Mathematical Statistics, Wiley, 1980.
17. W. J. Rugh, Linear System Theory, Prentice Hall, 1996.
18. H. Wang, A. Wang and Y. Wang, Online estimation algorithm for the unknown probability density functions of random parameters in auto-regression and exogenous stochastic systems, IEEE Proc-Control Theory Applications, vol.153, no.4, pp.462-468, 2006.
19. A. Rodriguez and E. T. Horst, Dynamic density estimation with financial applications, http://ftp.stat.duke.edu/WorkingPapers/06-21.pdf, 2006.