Automated variational inference for Gaussian process models

Advances in Neural Information Processing Systems

Volumn 2, Issue January, 2014, Pages 1404-1412

  Nguyen, Trung V ^a   Bonilla, Edwin V ^b  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

^b UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

COVARIANCE MATRIX; GAUSSIAN NOISE (ELECTRONIC); INFERENCE ENGINES; INFORMATION SCIENCE;

APPROXIMATE INFERENCE; GAUSSIAN PROCESS MODELS; GRADIENT-BASED OPTIMIZATION; INFERENCE ALGORITHM; MIXTURE OF GAUSSIANS; ORDERS OF MAGNITUDE; VARIATIONAL INFERENCE; VARIATIONAL METHODS;

GAUSSIAN DISTRIBUTION;

EID: 84937860160     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Carl Edward Rasmussen and Christopher K. I. Williams. Gaussian processes for machine learning. The MIT Press, 2006.
2. Radford M. Neal. Probabilistic inference using Markov chain Monte Carlo methods. Technical report, Department of Computer Science, University of Toronto, 1993.
3. Michael I Jordan, Zoubin Ghahramani, Tommi S Jaakkola, and Lawrence K Saul. An introduction to variational methods for graphical models. Springer, 1998.
4. Iain Murray, Ryan Prescott Adams, and David J.C. MacKay. Elliptical slice sampling. In AISTATS, 2010.
5. Mohammad E. Khan, Shakir Mohamed, Benjamin M. Marlin, and Kevin P. Murphy. A stick-breaking likelihood for categorical data analysis with latent Gaussian models. In AISTATS, pages 610-618, 2012.
6. Hannes Nickisch and Carl Edward Rasmussen. Approximations for binary Gaussian process classification. Journal of Machine Learning Research, 9(10), 2008.
7. Trung V. Nguyen and Edwin Bonilla. Efficient variational inference for Gaussian process regression networks. In AISTATS, pages 472-480, 2013.
8. Mohammad E. Khan, Shakir Mohamed, and Kevin P. Murphy. Fast Bayesian inference for non-conjugate Gaussian process regression. In NIPS, pages 3149-3157, 2012.
9. Miguel Lázaro-Gredilla. Bayesian warped Gaussian processes. In NIPS, pages 1628-1636, 2012.
10. Mark Girolami and Simon Rogers. Variational Bayesian multinomial probit regression with Gaussian process priors. Neural Computation, 18(8): 1790-1817, 2006.
11. Miguel Lázaro-Gredilla and Michalis Titsias. Variational heteroscedastic Gaussian process regression. In ICML, 2011.
12. Christopher K.I. Williams and David Barber. Bayesian classification with Gaussian processes. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 20(12): 1342-1351, 1998.
13. Edward Snelson, Carl Edward Rasmussen, and Zoubin Ghahramani. Warped Gaussian processes. In NIPS, 2003.
14. Jesper Møller, Anne Randi Syversveen, and Rasmus Plenge Waagepetersen. Log Gaussian Cox processes. Scandinavian journal of statistics, 25(3): 451-482, 1998.
15. Andrew G. Wilson, David A. Knowles, and Zoubin Ghahramani. Gaussian process regression networks. In ICML, 2012.
16. Rajesh Ranganath, Sean Gerrish, and David M. Blei. Black box variational inference. In AISTATS, 2014.
17. Manfred Opper and Cédric Archambeau. The variational Gaussian approximation revisited. Neural Computation, 21(3): 786-792, 2009.
18. Håvard Rue, Sara Martino, and Nicolas Chopin. Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations. Journal of the royal statistical society: Series b (statistical methodology), 71(2): 319-392, 2009.
19. Samuel J. Gershman, Matthew D. Hoffman, and David M. Blei. Nonparametric variational inference. In ICML, 2012.
20. Marco F. Huber, Tim Bailey, Hugh Durrant-Whyte, and Uwe D. Hanebeck. On entropy approximation for Gaussian mixture random vectors. In IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, 2008.
21. George Casella and Christian P. Robert. Rao-Blackwellisation of sampling schemes. Biometrika, 1996.
22. K. Bache and M. Lichman. UCI machine learning repository, 2013.
23. D. Cole, C. Martin-Moran, A.G. Sheard, H.K.D.H. Bhadeshia, and D.J.C. MacKay. Modelling creep rupture strength of ferritic steel welds. Science and Technology of Welding & Joining, 5(2): 81-89, 2000.
24. R.G. Jarrett. A note on the intervals between coal-mining disasters. Biometrika, 66(1): 191-193, 1979.
25. Simon Duane, Anthony D. Kennedy, Brian J. Pendleton, and Duncan Roweth. Hybrid Monte Carlo. Physics letters B, 195(2): 216-222, 1987.
26. Andrew Gelman and Donald B Rubin. Inference from iterative simulation using multiple sequences. Statistical science, pages 457-472, 1992.