Variational Bayesian analysis for hidden Markov models

Australian and New Zealand Journal of Statistics

Volumn 51, Issue 2, 2009, Pages 227-244

  McGrory, C A ^a   Titterington, D M ^a,b  

^a QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

^b UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Bayesian analysis; Deviance information criterion (DIC); Hidden Markov model; Variational approximation

Indexed keywords

EID: 66749111812     PISSN: 13691473     EISSN: 1467842X     Source Type: Journal    
DOI: 10.1111/j.1467-842X.2009.00543.x     Document Type: Article

References (22)

1. Attias, H. (1999). Inferring parameters and structure of latent variable models by variational Bayes. Proceedings of the 15th Conference on Uncertainty in Artificial Intelligence, 30 July-1 August, eds K. Laskey, H. Prade, pp. 21 30. San Francisco : Morgan Kaufmann.
2. Baum, L.E., Petrie, T., Soules, G. Weiss, N. (1970). A maximization technique occurring in the statistical analysis of probabilistic functions of Markov chains. Ann. Math. Statist. 41, 164 171.
3. Boys, R.J. Henderson, D.A. (2004). A Bayesian approach to DNA sequence segmentation (with discussion). Biometrics 60, 573 588.
4. Celeux, G., Forbes, F., Robert, C. Titterington, D.M. (2006). Deviance Information Criteria for missing data models (with discussion). Bayesian Anal. 1, 651 674.
5. Chib, S. (1996). Calculating posterior distributions and modal estimates in Markov mixture models. J. Econometrics 75, 79 97. (Pubitemid 126372907)
6. Corduneanu, A. Bishop, C.M. (2001). Variational Bayesian model selection for mixture distributions. In Proceedings of the 8th International Conference on Artificial Intelligence and Statistics, 4-7 January, eds T. Jaakkola, T. Richardson, pp. 27 34. San Francisco : Morgan Kaufmann.
7. Francq, C. Roussignol, M. (1997). On white noise driven by hidden Markov chains. J. Time Series Anal. 18, 553 578. (Pubitemid 127462314)
8. Green, P.J. (1995). Reversible jump Markov chain Monte Carlo computation and Bayesian model determination. Biometrika 82, 711 732.
9. Green, P.J. Richardson, S. (2002). Hidden Markov models and disease mapping. J. Amer. Statist. Assoc. 97, 1055 1070. (Pubitemid 36136565)
10. Jaakkola, T.S. (2000). Tutorial on variational approximation methods. In Advanced Mean Field Methods, eds M. Opper, D. Saad, pp. 129 159. Cambridge, MA : MIT Press.
11. Jordan, M.I., Ghahramani, Z., Jaakkola, T.S. Saul, L.K. (1999). An introduction to variational methods for graphical models. Machine Learning 37, 183 233. (Pubitemid 30544678)
12. Lee, L., Attias, H. Deng, L. (2003). Variational inference and learning for segmental switching state space models of hidden speech dynamics. Proceedings of the International Conference on Acoustics, Speech and Signal Processing, Apr 2003, Hong Kong, pp. 920 923. Washington : IEEE.
13. MacDonald, I.L. Zucchini, W. (1997). Hidden Markov Models and Other Models for Discrete-valued Time Series. London : Chapman & Hall.
14. MacKay, D.J.C. (1997). Ensemble learning for hidden Markov models. Technical Report, Cavendish Laboratory, University of Cambridge. Available from URL : http://www.inference.phy.cam.ac.uk/mackay/ensemblePaper.pdf
15. MacKay, D.J.C. (2001). Local minima, symmetry-breaking, and model pruning in variational free energy minimization. Available from URL : http://www.inference.phy.cam.ac.uk/mackay/minima.pdf
16. McGrory, C.A. Titterington, D.M. (2007). Variational approximations in Bayesian model selection for finite mixture distributions. Comp. Statist. Data Anal. 51, 5352 5367. (Pubitemid 46694011)
17. Rabiner, L.R. (1989). A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77, 257 284.
18. Robert, C.P., Rydén, T. Titterington, D.M. (2000). Bayesian inference in hidden Markov models through the reversible jump Markov chain Monte Carlo method. J. Roy. Statist. Soc. Ser. B 62, 57 75.
19. Rydén, T., Teräsvirta, T. Åsbrink, S. (1998). Stylized facts of daily return series and the hidden Markov model. J. Appl. Econometr.13, 217 244.
20. Spiegelhalter, D.J., Best, N.G., Carlin, B.P. Van Der Linde, A. (2002). Bayesian measures of model complexity and fit (with discussion). J. Roy. Statist. Soc. Ser. B 64, 583 639.
21. Wang, B. Titterington, D.M. (2006). Convergence properties of a general algorithm for calculating variational Bayesian estimates for a normal mixture model. Bayesian Anal. 1, 625 650.
22. Winn, J. Bishop, C.M. (2005). Variational message passing. J. Mach. Learn. Res. 6, 661 694.