Chained Gaussian processes

Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, AISTATS 2016

Volumn , Issue , 2016, Pages 1431-1440

  Saul, Alan D ^a   Hensman, James ^b   Vehtari, Aki ^c   Lawrence, Neil D ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b LANCASTER UNIVERSITY   (United Kingdom)

^c AALTO UNIVERSITY   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; GAUSSIAN NOISE (ELECTRONIC);

APPROXIMATE INFERENCE; GAUSSIAN PROCESS MODELS; GAUSSIAN PROCESSES; GENERALIZED LINEAR MODEL; LIKELIHOOD FUNCTIONS; LINEAR COMBINATIONS; NON-GAUSSIAN DATA; NONPARAMETRIC APPROACHES;

GAUSSIAN DISTRIBUTION;

EID: 85032981175     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Ryan Prescott Adams and Oliver Stegle. Gaussian process product models for nonparametric nonstationarity. In Proceedings of the 25th International Conference on Machine Learning, pages 1-8, 2008.
2. Mauricio Alvarez, Lorenzo Rosasco, and Neil D. Lawrence. Kernels for vector-valued functions: A review. Foundations and Trends in Machine Learning, 4(3):195-266, 2012. doi: 10.1561/2200000036.
3. Amir Dezfouli and Edwin V Bonilla. Scalable inference for Gaussian process models with black-box likelihoods. In C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama, and R. Garnett, editors, Advances in Neural Information Processing Systems 28, pages 1414-1422. Curran Associates, Inc., 2015.
4. John Duchi, Elad Hazan, and Yoram Singer. Adaptive subgradient methods for online learning and stochastic optimization. J. Mach. Learn. Res., 12:2121-2159, July 2011. ISSN 15324435.
5. Yarin Gal, Mark van der Wilk, and Carl E. Rasmussen. Distributed variational inference in sparse Gaussian process regression and latent variable models. In Zoubin Ghahramani, Max Welling, Corinna Cortes, Neil D. Lawrence, and Kilian Q. Weinberger, editors, Advances in Neural Information Processing Systems, volume 27, Cambridge, MA, 2014.
6. Andrew Gelman, John B. Carlin, Hal S. Stern, David B. Dunson, Aki Vehtari, and Donald B. Rubin. Bayesian Data Analysis, Third Edition. CRC Press, November 2013. ISBN 9781439840955.
7. Paul W. Goldberg, Christopher K. I. Williams, and Christopher M. Bishop. Regression with input-dependent noise: A Gaussian process treatment. In Michael I. Jordan, Michael J. Kearns, and Sara A. Solla, editors, Advances in Neural Information Processing Systems, volume 10, pages 493-499, Cambridge, MA, 1998. MIT Press.
8. R. Henderson, S. Shimakura, and Gorst D. Modeling spatial variation in leukemia survival data. Journal of the American Statistical Association, 97:965-972, 2002.
9. James Hensman, Nicold Fusi, and Neil D. Lawrence. Gaussian processes for big data. In Ann Nicholson and Padhraic Smyth, editors, Uncertainty in Artificial Intelligence, volume 29. AUAI Press, 2013a.
10. James Hensman, Neil D. Lawrence, and Magnus Rattray. Hierarchical Bayesian modelling of gene expression time series across irregularly sampled replicates and clusters. BMC Bioinformatics, 14(252), 2013b. doi: doi:10.1186/1471-2105-14-252.
11. James Hensman, Alexander G D G Matthews, and Zoubin Ghahramani. Scalable variational Gaussian process classification. In In 18th International Conference on Artificial Intelligence and Statistics, pages 1-9, San Diego, California, USA, May 2015.
12. Daniel Hernandez-Lobato, Viktoriia Sharmanska, Kristian Kersting, Christoph H Lampert, and Novi Quadrianto. Mind the nuisance: Gaussian process classification using privileged noise. In Z. Ghahramani, M. Welling, C. Cortes, N.D. Lawrence, and K.Q. Weinberger, editors, Advances in Neural Information Processing Systems 27, pages 837-845. Curran Associates, Inc., 2014.
13. Matthew D. Hoffman, David M. Blei, Chong Wang, and John Paisley. Stochastic variational inference. Journal of Machine Learning Research, 14:1303-1347, 2013.
14. Pasi Jylänki, Jarno Vanhatalo, and Aki Vehtari. Robust Gaussian process regression with a Student-t likelihood. J. Mach. Learn. Res., 12:3227-3257, November 2011. ISSN 1532-4435.
15. D. P. Kingma and M. Welling. Stochastic gradient VB and the variational auto-encoder. In 2nd International Conference on Learning Representations (ICLR), Banff, 2014.
16. Malte Kuß. Gaussian Process Models for Robust Regression, Classification, and Reinforcem ent Learning. PhD thesis, TU Darmstadt, April 2006.
17. Miguel Lazaro-Gredilla and Michalis Titsias. Variational heteroscedastic Gaussian process regression. In Lise Getoor and Tobias Scheffer, editors, Proceedings of the 28th International Conference on Machine Learning (ICML-11), ICML ’11, pages 841-848, New York, NY, USA, June 2011. ACM. ISBN 978-1-4503-0619-5.
18. D. Y. Lin and Zhiliang Ying. Semiparametric analysis of general additive-multiplicative hazard models for counting processes. The Annals o f Statistics, 23(5):1712-1734, 10 1995. doi: 10. 1214/aos/1176324320.
19. Scott Linderman and Ryan Adams. Discovering latent network structure in point process data. In ICML, 2014.
20. John Nelder and Robert Wedderburn. Generalized linear models. Journal of the Royal Statistical Society, A, 135(3), 1972. doi: 10.2307/2344614.
21. Trung V Nguyen and Edwin V Bonilla. Automated variational inference for Gaussian process models. In Z. Ghahramani, M. Welling, C. Cortes, N.D. Lawrence, and K.Q. Weinberger, editors, Advances in Neural Information Processing Systems 27, pages 1404-1412. Curran Associates, Inc., 2014.
22. Manfred Opper and Cedric Archambeau. The variational Gaussian approximation revisited. Neural Computation, 21(3):786-792, 2009.
23. Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra. Stochastic back-propagation and variational inference in deep latent Gaussian models. Technical report, 2014.
24. B. W. Silverman. Some aspects of the spline smoothing approach to non-parametric regression curve fitting (with discussion). Journal of the Royal Statistical Society, B, 47(1):1-52, 1985.
25. Edward Snelson and Zoubin Ghahramani. Sparse Gaussian processes using pseudo-inputs. In Yair Weiss, Bernhard Scholkopf, and John C. Platt, editors, Advances in Neural Information Processing Systems, volume 18, Cambridge, MA, 2006. MIT Press.
26. Edward Snelson, Carl Edward Rasmussen, and Zoubin Ghahramani. Warped Gaussian processes. In Sebastian Thrun, Lawrence Saul, and Bernhard Scholkopf, editors, Advances in Neural Information Processing Systems, volume 16, Cambridge, MA, 2004. MIT Press.
27. T. Tieleman and G Hinton. Divide the gradient by a running average of its recent magnitude. In: COURSERA: Neural Networks for Machine Learning, 2012.
28. Michalis K. Titsias. Variational learning of inducing variables in sparse Gaussian processes. In David van Dyk and Max Welling, editors, Proceedings of the Twelfth International Workshop on Artificial Intelligence and Statistics, volume 5, pages 567-574, Clearwater Beach, FL, 16-18 April 2009. JMLR W&CP5.
29. Ville Tolvanen, Pasi Jylanki, and Aki Vehtari. Expectation propagation for nonstationary heteroscedastic Gaussian process regression. In Machine Learning for Signal Processing (MLSP), 2014 IEEE International Workshop, 2014.
30. Richard E. Turner and Maneesh Sahani. Demodulation as probabilistic inference. IEEE Transactions on Audio, Speech, and Language Processing, 19:2398-2411, 2011.
31. Jarno Vanhatalo, Jaakko Riihimaki, Jouni Hartikainen, Pasi Jylanki, Ville Tolvanen, and Aki Vehtari. GPstuff: Bayesian modeling with Gaussian processes. Journal of Machine Learning Research, 14(1):1175—1179, 2013. http://mloss.org/software/view/451/.