Operator variational inference

Advances in Neural Information Processing Systems

Volumn , Issue , 2016, Pages 496-504

  Ranganath, Rajesh ^a   Altosaar, Jaan ^a   Tran, Dustin ^b   Blei, David M ^b  

^a PRINCETON UNIVERSITY   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BAYESIAN NETWORKS; OPTIMIZATION;

BAYESIAN INFERENCE; BLACK BOX ALGORITHMS; GENERATIVE MODEL; KULLBACK LEIBLER DIVERGENCE; MIXTURE MODEL; OPTIMIZATION PROBLEMS; STATISTICAL PROPERTIES; VARIATIONAL INFERENCE;

INFERENCE ENGINES;

EID: 85019244640     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Assaraf, R. and Caffarel, M. (1999). Zero-variance principle for monte carlo algorithms. In Phys. Rev. Let.
2. Barbour, A. D. (1988). Stein's method and poisson process convergence. Journal of Applied Probability.
3. Carpenter, B., Hoffman, M. D., Brubaker, M., Lee, D., Li, P., and Betancourt, M. (2015). The Stan Math Library: Reverse-mode automatic differentiation in C++. arXiv preprint arXiv:1509.07164.
4. Ghahramani, Z. and Beal, M. (2001). Propagation algorithms for variational Bayesian learning. In NIPS 13, pages 507-513.
5. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative adversarial nets. In Neural Information Processing Systems.
6. Hernández-Lobato, J. M., Li, Y., Rowland, M., Hernández-Lobato, D., Bui, T., and Turner, R. E. (2015). Black-box α-divergence Minimization. arXiv.org.
7. Hoffman, M., Blei, D., Wang, C., and Paisley, J. (2013). Stochastic variational inference. Journal of Machine Learning Research, 14(1303-1347).
8. Hornik, K., Stinchcombe, M., and White, H. (1989). Multilayer feedforward networks are universal approximators. Neural networks, 2(5):359-366.
9. Hyvärinen, A. (2005). Estimation of non-normalized statistical models by score matching. Journal of Machine Learning Research, 6 (Apr):695-709.
10. Jordan, M., Ghahramani, Z., Jaakkola, T., and Saul, L. (1999). Introduction to variational methods for graphical models. Machine Learning, 37:183-233.
11. Kingma, D. and Welling, M. (2014). Auto-encoding variational bayes. In (ICLR).
12. Kingma, D. P. and Ba, J. (2014). Adam: A method for stochastic optimization. CoRR, abs/1412.6980.
13. Kushner, H. and Yin, G. (1997). Stochastic Approximation Algorithms and Applications. Springer New York.
14. Li, Y. and Turner, R. E. (2016). Rényi divergence variational inference. arXiv preprint arXiv:1602.02311.
15. Maaløe, L., Sønderby, C. K., Sønderby, S. K., and Winther, O. (2016). Auxiliary deep generative models. arXiv preprint arXiv:1602.05473.
16. Minka, T. P. (2001). Expectation propagation for approximate Bayesian inference. In UAI.
17. Minka, T. P. (2004). Power EP. Technical report, Microsoft Research, Cambridge.
18. Nielsen, F. and Nock, R. (2013). On the chi square and higher-order chi distances for approximating f-divergences. arXiv preprint arXiv:1309.3029.
19. Ranganath, R., Gerrish, S., and Blei, D. (2014). Black Box Variational Inference. In AISTATS.
20. Ranganath, R., Tran, D., and Blei, D. M. (2016). Hierarchical variational models. In International Conference on Machine Learning.
21. Rezende, D. J. and Mohamed, S. (2015). Variational inference with normalizing flows. In Proceedings of the 31st International Conference on Machine Learning (ICML-15).
22. Rezende, D. J., Mohamed, S., and Wierstra, D. (2014). Stochastic backpropagation and approximate inference in deep generative models. In International Conference on Machine Learning.
23. Robbins, H. and Monro, S. (1951). A stochastic approximation method. The Annals of Mathematical Statistics, 22(3):pp. 400-407.
24. Salakhutdinov, R. and Murray, I. (2008). On the quantitative analysis of deep belief networks. In International Conference on Machine Learning.
25. Theis, L., van den Oord, A., and Bethge, M. (2016). A note on the evaluation of generative models. In International Conference on Learning Representations.
26. Titsias, M. and Lázaro-Gredilla, M. (2014). Doubly stochastic variational bayes for non-conjugate inference. In Proceedings of the 31st International Conference on Machine Learning (ICML-14), pages 1971-1979.
27. Wingate, D. and Weber, T. (2013). Automated variational inference in probabilistic programming. ArXiv e-prints.