Markov Chain Monte Carlo and variational inference: Bridging the gap

32nd International Conference on Machine Learning, ICML 2015

Volumn 2, Issue , 2015, Pages 1218-1226

  Salimans, Tim ^a   Kingma, Diederik P ^b   Welling, Max ^b  

^a Algoritmica   (Netherlands)

^b UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION ALGORITHMS; ARTIFICIAL INTELLIGENCE; BAYESIAN NETWORKS; INFERENCE ENGINES; LEARNING SYSTEMS; MARKOV PROCESSES; STOCHASTIC SYSTEMS;

AUXILIARY RANDOM VARIABLE; INFERENCE ALGORITHM; MARKOV CHAIN MONTE-CARLO; THEORETICAL FOUNDATIONS; VARIATIONAL APPROXIMATION; VARIATIONAL BAYESIAN INFERENCES; VARIATIONAL INFERENCE; VARIATIONAL METHODS;

MONTE CARLO METHODS;

EID: 84969835291     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. Adler, Stephen L. Over-relaxation method for the monte carlo evaluation of the partition function for multi-quadratic actions. Physical Review D, 23(12):2901, 1981.
2. Albert, Jim. Bayesian Computation with R. Springer Science, New York. Second edition, 2009.
3. Bastien, Frédéric, Lamblin, Pascal, Pascanu, Razvan, Bergstra, James, Goodfellow, Ian, Bergeron, Arnaud, Bouchard, Nicolas, Warde-Farley, David, and Bengio, Yoshua. Theano: new features and speed improvements. arXiv preprint arXiv:1211.5590, 2012.
4. Dosovitskiy, Alexey, Springenberg, Jost Tobias, and Brox, Thomas. Learning to generate chairs with convolutional neural networks. arXiv preprint arXiv: 1411.5928, 2014.
5. Gregor, Karol, Danihelka, Ivo, Graves, Alex, and Wierstra, Daan. Draw: A recurrent neural network for image generation. arXiv preprint arXiv:1502.04623, 2015.
6. Hinton, Geoffrey E and Zemel, Richard S. Autoencoders, minimum description length, and helmholtz free energy. Advances in neural information processing systems, pp. 3-3, 1994.
7. Kingma, Diederik and Ba, Jimmy. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
8. Kingma, Diederik P and Welling, Max. Auto-Encoding Variational Bayes. Proceedings of the 2nd International Conference on Learning Representations, 2014.
9. Mnih, Andriy and Gregor, Karol. Neural variational inference and learning in belief networks. In The 31st International Conference on Machine Learning (ICML), 2014.
10. Neal, Radford. Mcmc using hamiltonian dynamics. Handbook of Markov Chain Monte Carlo, 2, 2011.
11. Paisley, John, Blei, David, and Jordan, Michael. Variational Bayesian inference with stochastic search. In Proceedings of the 29th International Conference on Machine Learning (ICML-12), pp. 1367-1374, 2012.
12. Ranganath, Rajesh, Gerrish, Sean, and Blei, David. Black box variational inference. In Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics, pp. 814-822, 2014.
13. Rezende, Danilo J, Mohamed, Shakir, and Wierstra, Daan. Stochastic backpropagation and approximate inference in deep generative models. In Proceedings of the 31st International Conference on Machine Learning (ICML-14), pp. 1278-1286, 2014.
14. Salimans, Tim and Knowles, David A. Fixed-form variational posterior approximation through stochastic linear regression. Bayesian Analysis, 8(4):837-882, 2013.
15. Uria, Benigno, Murray, Iain, and Larochelle, Hugo. A deep and tractable density estimator. In Proceedings of the 31th International Conference on Machine Learning, ICML 2014, Beijing, China, 21-26 June 2014, pp. 467-475, 2014. URL http://jmlr.org/proceedings/papers/v32/urial4.html.