Latent-space variational bayes

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 30, Issue 12, 2008, Pages 2236-2242

  Sung, Jaemo ^a   Ghahramani, Zoubin ^b   Bang, Sung Yang ^a  

^a Pohang University of Science and Technology (POSTECH)   (South Korea)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Bayesian inference; Conjugate exponential family; Mixture of Bernoullis; Mixture of Gaussians; Variational method

Indexed keywords

BAYESIAN NETWORKS; COMPUTATIONAL COMPLEXITY; INFERENCE ENGINES; MIXTURES;

AND MODELS; APPROXIMATE DISTRIBUTIONS; APPROXIMATE INFERENCES; BAYESIAN INFERENCE; BAYESIAN INFERENCES; CONJUGATE-EXPONENTIAL FAMILY; DATA SETS; EXPECTATION MAXIMIZATIONS; EXPONENTIAL FAMILIES; FIRST ORDERS; GAUSSIANS; LATENT VARIABLES; MIXTURE OF GAUSSIANS; MODEL PARAMETERS; POSTE-RIORS; PRACTICAL IMPLEMENTATIONS; PROBABILISTIC MODELS; VARIATIONAL BAYES; VARIATIONAL BAYESIAN; VARIATIONAL METHOD; VARIATIONAL METHODS;

PROBABILITY DISTRIBUTIONS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BAYES THEOREM; COMPUTER SIMULATION; METHODOLOGY; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; COMPUTER SIMULATION; MODELS, THEORETICAL; PATTERN RECOGNITION, AUTOMATED;

EID: 56549085814     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2008.157     Document Type: Article

References (26)

1. W.H. Jefferys and J.O. Berger, "Occam's Razor and Bayesian Analysis," Am. Scientist, vol. 80, pp. 64-72, 1992.
2. C.E. Rasmussen and Z. Ghahramani, "Occam's Razor," Advances in Neural Information Processing Systems, vol. 13, MIT Press, 2001.
3. D.M. Chickering and D. Heckerman, "Efficient Approximation for the Marginal Likelihood of Bayesian Networks with Hidden Variables," Machine Learning, vol. 29, no. 2, pp. 181-212, 1997.
4. J.M. Bernardo and A.F.M. Smith, Bayesian Theory. John Wiley & Sons, 2000.
5. A. Gelman, J.B. Carlin, H.S. Stern, and D.B. Rubin, Bayesian Data Analysis. Chapman and Hall/CRC, 1995.
6. C.M. Bishop, Pattern Recognition and Machine Learning. Springer, 2006.
7. R.M. Neal, "Probabilistic Inference Using Markov Chain Monte Carlo Methods," Technical Report CRG-TR-93-1, Dept. of Computer Science, Univ. of Toronto, 1993.
8. C.P. Robert and G. Casella, Monte Carlo Statistical Methods. Springer-Verlag, 1999.
9. C. Andrieu, N.D. Freitas, A. Doucet, and M.I. Jordan, "An Introduction to MCMC for Machine Learning," Machine Learning, vol. 50, pp. 5-43, 2003.
10. D.J. Mackay, Information Theory, Inference, and Learning Algorithms Cambridge Univ. Press, 2003.
11. M. Jordan, Z. Ghahramani, T. Jaakkola, and L. Saul, "An Introduction to Variational Methods for Graphical Models," Machine Learning, vol. 72, no. 2, pp. 183-233, 1999.
12. T. Jaakkola, "Tutorial on Variational Approximation Methods," Advanced Mean Field Methods: Theory and Practice, M. Opper and D. Saad, eds., MIT Press, 2000.
13. H. Attias, "Variational Bayesian Framework for Graphical Models," Advances in Neural Information Processing Systems, vol. 12, MIT Press, 2000.
14. Z. Ghahramani and M.J. Beal, "Propagation Algorithms for Variational Bayesian Learning," Advances in Neural Information Processing Systems, vol. 13, MIT Press, 2001.
15. Z. Ghahramani and M.J. Beal, "Variational Inference for Bayesian Mixtures of Factor Analysers," Advances in Neural Information Processing Systems, vol. 12, MIT Press, 2000.
16. M.J. Beal and Z. Ghahramani, "The Variational Bayesian EM Algorithm for Incomplete Data: With Application to Scoring Graphical Model Structures," Bayesian Statistics, vol. 7, Oxford Univ. Press, 2003.
17. N. Ueda and Z. Ghahramani, "Bayesian Model Search for Mixture Models Based on Optimizing Variational Bounds," Neural Networks, vol. 15, pp. 1223-1241, 2002.
18. J. Winn and C. Bishop, "Variational Message Passing," J. Machine Learning Research, vol. 6, pp. 661-694, 2005.
19. M.J. Beal, "Variational Algorithms for Approximate Bayesian Inference," PhD dissertation, Gatsby Computational Neuroscience Unit, Univ. College London, 2003.
20. Y.W. Teh, D. Newman, and M. Welling, "A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation," Advances in Neural Information Processing Systems, vol. 19, 2007.
21. Y.W. Teh, K. Kurihara, and M. Welling, "Collapsed Variational Inference for HDP," Advances in Neural Information Processing Systems, vol. 20, 2008.
22. A.P. Dempster, N.M. Laird, and D.B. Rubin, "Maximum Likelihood from Incomplete Data via the EM Algorithm," J. Royal Statistical Soc. B vol. 39, pp. 1-38, 1977.
23. G. McLachlan and D. Peel, Finite Mixture Models. Wiley-Interscience, 2000.
24. S. Richardson and P.J. Green, "On Bayesian Analysis of Mixtures with an Unknown Number of Components," J. Royal Statistical Soc. B, vol. 59, pp. 731-792, 1997.
25. A. Asuncion and D. Newman, UCI Machine Learning Repository, http://www.ics.uci.edu/~mlearn/MLRepository.html, 2007.
26. M. Svensén and C.M. Bishop, "Robust Bayesian Mixture Modelling," Neurocomputing, vol. 64, pp. 235-252, 2004.