Hierarchical variational models

33rd International Conference on Machine Learning, ICML 2016

Volumn 1, Issue , 2016, Pages 515-528

  Ranganath, Rajesh ^a   Tran, Dustin ^b   Blei, David M ^b  

^a PRINCETON UNIVERSITY   (United States)

^b Columbia University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION ALGORITHMS; ARTIFICIAL INTELLIGENCE; EQUIVALENCE CLASSES; LEARNING SYSTEMS;

COMPLEX STRUCTURE; EFFICIENT COMPUTATION; HIGH DIMENSIONS; LATENT VARIABLE; LATENT VARIABLE MODELS; VARIATIONAL APPROXIMATION; VARIATIONAL INFERENCE; VARIATIONAL MODELS;

COMPUTATIONAL EFFICIENCY;

EID: 84997769529     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. Agakov, F. V. and Barber, D. (2004). An auxiliary variational method. In Neural Information Processing Systems.
2. Bergstra, J., Breuleux, O., Bastien, F., Lamblin, P., Pascanu, R., Desjardins, G., Turian, J., Warde-Farley, D., and Bengio, Y. (2010). Theano: a CPU and GPU math expression compiler. In Proceedings of the Python for Scientific Computing Conference (SciPy).
3. Bishop, C. (2006). Pattern Recognition and Machine Learning. Springer New York.
4. Brown, L. (1986). Fundamentals of Statistical Exponential Families. Institute of Mathematical Statistics, Hayward, CA.
5. Dayan, P. (2000). Helmholtz machines and wake-sleep learning. Handbook of Brain Theory and Neural Network. MIT Press, Cambridge, MA.
6. Efron, B. (2012). Large-scale inference: empirical Bayes methods for estimation, testing, and prediction, volume 1. Cambridge University Press.
7. Gelman, A. and Hill, J. (2007). Data Analysis Using Regression and Multilevel/Hierarchical Models. Cambridge Univ. Press.
8. Gershman, S. J. and Blei, D. M. (2012). A tutorial on Bayesian nonparametric models. Journal of Mathematical Psychology, 56(1):1-12.
9. Ghahramani, Z. (1995). Factorial learning and the EM algorithm. In Advances in Neural Information Processing Systems, pages 617-624.
10. Ghahramani, Z. (1997). On structured variational approximations. Technical report.
11. Ghahramani, Z. and Beal, M. (2001). Propagation algorithms for variational Bayesian learning. In Neural Information Processing Systems.
12. Giordano, R. J., Broderick, T., and Jordan, M. I. (2015). Linear response methods for accurate covariance estimates from mean field variational bayes. In Neural Information Processing Systems.
13. Hoffman, M., Blei, D., Wang, C, and Paisley, J. (2013). Stochastic variational inference. Journal of Machine Learning Research, 14 (1303-1347).
14. Jaakkola, T. S. and Jordan, M. I. (1998). Improving the Mean Field Approximation Via the Use of Mixture Distributions. In Learning in Graphical Models, pages 163-173. Springer Netherlands, Dordrecht.
15. Jordan, M., Ghahramani, Z., Jaakkola, T., and Saul, L. (1999). Introduction to variational methods for graphical models. Machine Learning, 37:183-233.
16. Kingma, D. and Welling, M. (2014). Auto-encoding variational Bayes. In International Conference on Learning Representations.
17. Kucukelbir, A., Tran, D., Ranganath, R., Gelman, A., and Blei, D. M. (2016). Automatic differentiation variational inference. arXiv preprint arXiv:1603.00788.
18. Lawrence, N. (2000). Variational Inference in Probabilistic Models. PhD thesis.
19. Maaløe, L., Sønderby, C. K., Sønderby, S. K., and Winther, O. (2016). Auxiliary deep generative models. arXiv preprint arXiv: 1602.05473.
20. Mnih, A. and Gregor, K. (2014). Neural variational inference and learning in belief networks. In International Conference on Machine Learning.
21. Neal, R. (1990). Learning stochastic feedforward networks. Technical Repport CRG-TR-90-7: Department of Computer Science, University of Toronto.
22. Nelsen, R. B. (2006). An Introduction to Copulas (Springer Series in Statistics). Springer-Verlag New York, Inc.
23. Ranganath, R., Gerrish, S., and Blei, D. (2014). Black box variational inference. In Artificial Intelligence and Statistics.
24. Ranganath, R., Tang, L., Charlin, L., and Blei, D. M. (2015). Deep exponential families. In Artificial Intelligence and Statistics.
25. Rezende, D., Mohamed, S., and Wierstra, D. (2014). Stochastic backpropagation and approximate inference in deep latent Gaussian models. In International Conference on Machine Learning.
26. Rezende, D. J. and Mohamed, S. (2015). Variational inference with normalizing flows. In International Conference on Machine Learning.
27. Salimans, T., Kingma, D., and Welling, M. (2015). Markov chain Monte carlo and variational inference: Bridging the gap. In International Conference on Machine Learning.
28. Salimans, T., Knowles, D. A., et al. (2013). Fixed-form variational posterior approximation through stochastic linear regression. Bayesian Analysis, 8(4):837-882.
29. Saul, L. K. and Jordan, M. I. (1996). Exploiting tractable substructures in intractable networks. Neural Information Processing Systems.
30. Stan Development Team (2015). Stan: A C++ library for probability and sampling, version 2.8.0.
31. Stuhlmüller, A., Taylor, J., and Goodman, N. (2013). Learning stochastic inverses. In Neural Information Processing Systems.
32. Titsias, M. and Lázaro-Gredilla, M. (2014). Doubly stochastic variational Bayes for non-conjugate inference. In International Conference on Machine Learning.
33. Titsias, M. K. (2015). Local expectation gradients for doubly stochastic variational inference. In Neural Information Processing Systems.
34. Tran, D., Blei, D. M., and Airoldi, E. M. (2015). Copula variational inference. In Neural Information Processing Systems.
35. Tran, D., Blei, D. M., Kucukelbir, A., Dieng, A., Rudolph, M., and Liang, D. (2016a). Edward: A library for probabilistic modeling, inference, and criticism.
36. Tran, D., Ranganath, R., and Blei, D. M. (2016b). The variational Gaussian process. In International Conference on Learning Representations.
37. Wainwright, M. and Jordan, M. (2008). Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1(1-2):1-305.
38. Wallach, H., Murray, I., Salakhutdinov, R., and Mimno, D. (2009). Evaluation methods for topic models. In International Conference on Machine Learning.