Local expectation gradients for black box variational inference

Advances in Neural Information Processing Systems

Volumn 2015-January, Issue , 2015, Pages 2638-2646

  Titsias, Michalis K ^a   Lazaro Gredilla, Miguel ^b  

^a ATHENS UNIVERSITY OF ECONOMICS AND BUSINESS   (Greece)

^b Vicarious   (Greece)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; INFORMATION SCIENCE; RANDOM VARIABLES; STOCHASTIC SYSTEMS;

BLACK BOXES; DISCRETE RANDOM VARIABLES; GIBBS SAMPLING; LOCAL EXPECTATIONS; RAO BLACKWELLIZED; STOCHASTIC GRADIENT; VARIATIONAL INFERENCE; VARIATIONAL PARAMETERS;

INFERENCE ENGINES;

EID: 84965132073     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Christopher M. Bishop. Pattern Recognition and Machine Learning. Springer, 2006.
2. Jrg Bornschein and Yoshua Bengio. Reweighted wake-sleep. CoRR, pages-1-1, 2014.
3. Peter W. Glynn. Likelihood ratio gradient estimation for stochastic systems. Commun. ACM, 33(10):75-84, October 1990.
4. Geoffrey Hinton, Peter Dayan, Brendan J Frey, and Radford M Neal. The wake-sleep algorithm for unsupervised neural networks. Science, 268(5214):1158-1161, 1995.
5. Matthew D. Hoffman, David M. Blei, and Francis R. Bach. Online learning for latent dirichlet allocation. In NIPS, pages 856-864, 2010.
6. Matthew D. Hoffman, David M. Blei, Chong Wang, and John William Paisley. Stochastic variational inference. Journal of Machine Learning Research, 14(1):1303-1347, 2013.
7. Michael I. Jordan, Zoubin Ghahramani, Tommi S. Jaakkola, and Lawrence K. Saul. An introduction to variational methods for graphical models. Mach. Learn., 37(2):183-233, November 1999.
8. Diederik P. Kingma and Max Welling. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114, 2013.
9. A. Kucukelbir, R. Ranganath, A. Gelman, and D. M. Blei. Automatic variational inference in stan. In Advances in Neural Information Processing Systems, 28, 2015.
10. Andriy Mnih and Karol Gregor. Neural variational inference and learning in belief networks. In The 31st International Conference on Machine Learning (ICML 2014), 2014.
11. Radford M. Neal. Connectionist learning of belief networks. Artif. Intell., 56(1):71-113, July 1992.
12. John William Paisley, David M. Blei, and Michael I. Jordan. Variational bayesian inference with stochastic search. In ICML, 2012.
13. J. Peters and S. Schaal. Policy gradient methods for robotics. In Proceedings of the IEEE International Conference on Intelligent Robotics Systems (IROS 2006), 2006.
14. Rajesh Ranganath, Sean Gerrish, and David Blei. Black box variational inference. In Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics (AISTATS), page 814822, 2014.
15. Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra. Stochastic backpropagation and approximate inference in deep generative models. In The 31st International Conference on Machine Learning (ICML 2014), 2014.
16. Herbert Robbins and Sutton Monro. A Stochastic Approximation Method. The Annals of Mathematical Statistics, 22(3):400-407, 1951.
17. Ruslan Salakhutdinov and Iain Murray. On the quantitative analysis of Deep Belief Networks. In Andrew McCallum and Sam Roweis, editors, Proceedings of the 25th Annual International Conference on Machine Learning (ICML 2008), pages 872-879. Omnipress, 2008.
18. Tim Salimans and David A. Knowles. Fixed-form variational posterior approximation through stochastic linear regression. Bayesian Anal., 8(4):837-882, 12 2013.
19. Tim Salimans and David A. Knowles. On Using Control Variates with Stochastic Approximation for Variational Bayes and its Connection to Stochastic Linear Regression, January 2014.
20. Michalis K. Titsias and Miguel Lázaro-Gredilla. Doubly stochastic variational bayes for non-conjugate inference. In The 31st International Conference on Machine Learning (ICML 2014), 2014.
21. Ronald J. Williams. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Mach. Learn., 8(3-4):229-256, May 1992.