Automatic variational inference in Stan

Advances in Neural Information Processing Systems

Volumn 2015-January, Issue , 2015, Pages 568-576

  Kucukelbir, Alp ^a   Ranganath, Rajesh ^b   Gelman, Andrew ^a   Blei, David M ^a  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b PRINCETON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; BAYESIAN NETWORKS; FACTORIZATION; INFORMATION SCIENCE; MIXTURES;

APPROXIMATE BAYESIAN INFERENCE; AUTOMATIC DIFFERENTIATIONS; BAYESIAN MODEL; GENERALIZED LINEAR MODEL; MATRIX FACTORIZATIONS; MCMC SAMPLING; PROBABILISTIC PROGRAMMING; VARIATIONAL INFERENCE;

INFERENCE ENGINES;

EID: 84965158671     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (25)

1. Michael I Jordan, Zoubin Ghahramani, Tommi S Jaakkola, and Lawrence K Saul. An introduction to variational methods for graphical models. Machine Learning, 37(2):183-233, 1999.
2. Martin J Wainwright and Michael I Jordan. Graphical models, exponential families, and variational inference. Foundations and Trends in Machine Learning, 1(1-2):1-305, 2008.
3. Matthew D Hoffman, David M Blei, Chong Wang, and John Paisley. Stochastic variational inference. The Journal of Machine Learning Research, 14(1):1303-1347, 2013.
4. Stan Development Team. Stan Modeling Language Users Guide and Reference Manual, 2015.
5. Matthew D Hoffman and Andrew Gelman. The No-U-Turn sampler. The Journal of Machine Learning Research, 15(1):1593-1623, 2014.
6. Diederik Kingma and Max Welling. Auto-encoding variational Bayes. arXiv:1312.6114, 2013.
7. Danilo J Rezende, Shakir Mohamed, and Daan Wierstra. Stochastic backpropagation and approximate inference in deep generative models. In ICML, pages 1278-1286, 2014.
8. Rajesh Ranganath, Sean Gerrish, and David Blei. Black box variational inference. In AISTATS, pages 814-822, 2014.
9. Tim Salimans and David Knowles. On using control variates with stochastic approximation for variational Bayes. arXiv preprint arXiv:1401.1022, 2014.
10. Michalis Titsias and Miguel Lázaro-Gredilla. Doubly stochastic variational Bayes for nonconjugate inference. In ICML, pages 1971-1979, 2014.
11. David Wingate and Theophane Weber. Automated variational inference in probabilistic programming. arXiv preprint arXiv:1301.1299, 2013.
12. Noah D Goodman, Vikash K Mansinghka, Daniel Roy, Keith Bonawitz, and Joshua B Tenenbaum. Church: A language for generative models. In UAI, pages 220-229, 2008.
13. Vikash Mansinghka, Daniel Selsam, and Yura Perov. Venture: a higher-order probabilistic programming platform with programmable inference. arXiv:1404.0099, 2014.
14. Frank Wood, Jan Willem van de Meent, and Vikash Mansinghka. A new approach to probabilistic programming inference. In AISTATS, pages 2-46, 2014.
15. John MWinn and Christopher M Bishop. Variational message passing. In Journal of Machine Learning Research, pages 661-694, 2005.
16. Christopher M Bishop. Pattern Recognition and Machine Learning. Springer New York, 2006.
17. David J Olive. Statistical Theory and Inference. Springer, 2014.
18. Manfred Opper and Cédric Archambeau. The variational Gaussian approximation revisited. Neural computation, 21(3):786-792, 2009.
19. Wolfgang Härdle and Léopold Simar. Applied multivariate statistical analysis. Springer, 2012.
20. Christian P Robert and George Casella. Monte Carlo statistical methods. Springer, 1999.
21. John Duchi, Elad Hazan, and Yoram Singer. Adaptive subgradient methods for online learning and stochastic optimization. The Journal of Machine Learning Research, 12:2121-2159, 2011.
22. Mark Girolami and Ben Calderhead. Riemann manifold langevin and hamiltonian monte carlo methods. Journal of the Royal Statistical Society: Series B, 73(2):123-214, 2011.
23. Andrew Gelman and Jennifer Hill. Data analysis using regression and multilevel/hierarchical models. Cambridge University Press, 2006.
24. John Canny. GaP: a factor model for discrete data. In ACM SIGIR, pages 122-129. ACM, 2004.
25. Mauricio Villegas, Roberto Paredes, and Bart Thomee. Overview of the ImageCLEF 2013 Scalable Concept Image Annotation Subtask. In CLEF Evaluation Labs and Workshop, 2013.