Variational inference via χ upper bound minimization

Advances in Neural Information Processing Systems

Volumn 2017-December, Issue , 2017, Pages 2733-2742

  Dieng, Adji B ^a   Tran, Dustin ^a   Ranganath, Rajesh ^b   Paisley, John ^a   Blei, David M ^a  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b PRINCETON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MARKOV PROCESSES; UNCERTAINTY ANALYSIS;

BLACK BOXES; EXPECTATION PROPAGATION; GAUSSIAN PROCESS CLASSIFICATIONS; LOWER BOUNDS; MARKOV CHAIN MONTE-CARLO; POSTERIOR UNCERTAINTIES; THREE MODELS; VARIATIONAL INFERENCE;

INFERENCE ENGINES;

EID: 85047018952     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. C. Robert and G. Casella. Monte Carlo Statistical Methods. Springer-Verlag, 2004.
2. M. Jordan, Z. Ghahramani, T. Jaakkola, and L. Saul. Introduction to variational methods for graphical models. Machine Learning, 37:183-233, 1999.
3. M. D. Hoffman, D. M. Blei, C. Wang, and J. Paisley. Stochastic variational inference. JMLR, 2013.
4. K. P. Murphy. Machine Learning: A Probabilistic Perspective. MIT press, 2012.
5. C. M. Bishop. Pattern recognition. Machine Learning, 128, 2006.
6. J. Hensman, M. Zwießele, and N. D. Lawrence. Tilted variational Bayes. JMLR, 2014.
7. T. Minka. A family of algorithms for approximate Bayesian inference. PhD thesis, MIT, 2001.
8. M. Kuss and C. E. Rasmussen. Assessing approximate inference for binary Gaussian process classification. JMLR, 6:1679-1704, 2005.
9. M. J. Beal. Variational algorithms for approximate Bayesian inference. University of London, 2003.
10. D. J. C. MacKay. Bayesian interpolation. Neural Computation, 4(3):415-447, 1992.
11. R. B. Grosse, Z. Ghahramani, and R. P. Adams. Sandwiching the marginal likelihood using bidirectional monte carlo. arXiv preprint arXiv:1511.02543 2015.
12. R. Ranganath, S. Gerrish, and D. M. Blei. Black box variational inference. In AISTATS, 2014.
13. D. P. Kingma and M. Welling. Auto-encoding variational Bayes. In ICLR, 2014.
14. D. J. Rezende, S. Mohamed, and D. Wierstra. Stochastic Backpropagation and Approximate Inference in Deep Generative Models. In ICML, 2014.
15. M. Opper and O. Winther. Gaussian processes for classification: Mean-field algorithms. Neural Computation, 12(11):2655-2684, 2000.
16. Andrew Gelman, Aki Vehtari, Pasi Jylänki, Tuomas Sivula, Dustin Tran, Swupnil Sahai, Paul Blomstedt, John P Cunningham, David Schiminovich, and Christian Robert. Expectation propagation as a way of life: A framework for Bayesian inference on partitioned data. arXiv preprint arXiv:1412.4869 2017.
17. Y. W. Teh, L. Hasenclever, T. Lienart, S. Vollmer, S. Webb, B. Lakshminarayanan, and C. Blundell. Distributed Bayesian learning with stochastic natural-gradient expectation propagation and the posterior server. arXiv preprint arXiv:1512.09327 2015.
18. Y. Li, J. M. Hernández-Lobato, and R. E. Turner. Stochastic Expectation Propagation. In NIPS, 2015.
19. T. Minka. Power EP. Technical report, Microsoft Research, 2004.
20. J. M. Hernández-Lobato, Y. Li, D. Hernández-Lobato, T. Bui, and R. E. Turner. Black-box α-divergence minimization. ICML, 2016.
21. Y. Li and R. E. Turner. Variational inference with Rényi divergence. In NIPS, 2016.
22. Rajesh Ranganath, Jaan Altosaar, Dustin Tran, and David M. Blei. Operator variational inference. In NIPS, 2016.
23. Volodymyr Kuleshov and Stefano Ermon. Neural variational inference and learning in undirected graphical models. In NIPS, 2017.
24. M. I. Jordan, Z. Ghahramani, T. S. Jaakkola, and L. K. Saul. An introduction to variational methods for graphical models. Machine Learning, 37(2):183-233, 1999.
25. T. Minka. Divergence measures and message passing. Technical report, Microsoft Research, 2005.
26. Yuri Burda, Roger Grosse, and Ruslan Salakhutdinov. Importance Weighted Autoencoders. In International Conference on Learning Representations, 2016.
27. Matthew D Hoffman. Learning Deep Latent Gaussian Models with Markov Chain Monte Carlo. In International Conference on Machine Learning, 2017.
28. D. J. C. MacKay. Information Theory, Inference, and Learning Algorithms. Cambridge Univ. Press, 2003.
29. A. E. Raftery. Bayesian model selection in social research. Sociological methodology, 25:111-164, 1995.
30. J. Paisley, D. Blei, and M. Jordan. Variational Bayesian inference with stochastic search. In ICML, 2012.
31. G. Dehaene and S. Barthelmé. Expectation propagation in the large-data limit. In NIPS, 2015.
32. Peter Sunehag, Jochen Trumpf, SVN Vishwanathan, Nicol N Schraudolph, et al. Variable metric stochastic approximation theory. In AISTATS, pages 560-566, 2009.
33. Dustin Tran, Alp Kucukelbir, Adji B Dieng, Maja Rudolph, Dawen Liang, and David M Blei. Edward: A library for probabilistic modeling, inference, and criticism. arXiv preprint arXiv:1610.09787 2016.
34. H. Kim and Z. Ghahramani. The em-ep algorithm for gaussian process classification. In Proceedings of the Workshop on Probabilistic Graphical Models for Classification (ECML), pages 37-48, 2003.
35. A. Miller, L. Bornn, R. Adams, and K. Goldsberry. Factorized point process intensities: A spatial analysis of professional basketball. In ICML, 2014.