Deep Gaussian processes

Journal of Machine Learning Research

Volumn 31, Issue , 2013, Pages 207-215

  Damianou, Andreas C ^a   Lawrence, Neil D ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BAYESIAN NETWORKS; GAUSSIAN NOISE (ELECTRONIC); STOCHASTIC SYSTEMS;

DEEP BELIEF NETWORKS; GAUSSIAN PROCESSES; LATENT VARIABLE MODELING; MARGINAL LIKELIHOOD; NUMBER OF LAYERS; SINGLE-LAYER MODELS; STOCHASTIC GRADIENT DESCENT; VARIATIONAL BOUNDS;

GAUSSIAN DISTRIBUTION;

EID: 84937432577     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (27)

1. Y. Bengio. Learning Deep Architectures for AI. Found. Trends Mach. Learn., 2(1): 1-127, Jan. 2009. ISSN 1935-8237. doi: 10.1561/2200000006.
2. Y. Bengio, A. C. Courville, and P. Vincent. Unsupervised feature learning and deep learning: A review and new perspectives. CoRR, abs/1206.5538, 2012.
3. A. C. Damianou and N. D. Lawrence. Deep Gaussian processes. NIPS workshop on Deep Learning and Unsupervised Feature Learning (arXiv: 1211.0358v1), 2012.
4. A. C. Damianou, M. Titsias, and N. D. Lawrence. Variational Gaussian process dynamical systems. In J. Shawe- Taylor, R. Zemel, P. Bartlett, F. Pereira, and K. Weinberger, editors, Advances in Neural Information Processing Systems 24, pages 2510-2518. 2011.
5. A. C. Damianou, C. H. Ek, M. K. Titsias, and N. D. Lawrence. Manifold relevance determination. In J. Langford and J. Pineau, editors, Proceedings of the International Conference in Machine Learning, volume 29, San Francisco, CA, 2012. Morgan Kauffman.
6. N. Durrande, D. Ginsbourger, and O. Roustant. Additive kernels for Gaussian process modeling. ArXiv e-prints 1103.4023, 2011.
7. D. Erhan, Y. Bengio, A. Courville, P.-A. Manzagol, P. Vincent, and S. Bengio. Why does unsupervised pre-training help deep learning? J. Mach. Learn. Res., 11: 625-660, Mar. 2010. ISSN 1532-4435.
8. M. Gönen and E. Alpaydin. Multiple kernel learning algorithms. J. Mach. Learn. Res., 12: 2211-2268, Jul 2011. ISSN 1532-4435.
9. J. Hensman and N. Lawrence. Gaussian processes for big data through stochastic variational inference. NIPS workshop on Big Learning, 2012.
10. G. Hinton. A Practical Guide to Training Restricted Boltzmann Machines. Technical report, 2010.
11. G. E. Hinton. Training products of experts by maximizing contrastive likelihood. Technical report, Tech. Rep., Gatsby Computational Neuroscience Unit, 1999.
12. G. E. Hinton and S. Osindero. A fast learning algorithm for deep belief nets. Neural Computation, 18: 2006, 2006.
13. G. E. Hinton and R. R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 303 (5786): 504-507, 2006.
14. M. Hoffman, D. Blei, C. Wang, and J. Paisley. Stochastic variational inference. ArXiv e-prints 1206.7051, 2012.
15. N. D. Lawrence. Gaussian process latent variable models for visualisation of high dimensional data. In In NIPS, page 2004, 2004.
16. N. D. Lawrence. Probabilistic non-linear principal component analysis with Gaussian process latent variable models. Journal of Machine Learning Research, 6: 1783-1816, 11 2005.
17. N. D. Lawrence and A. J. Moore. Hierarchical Gaussian process latent variable models. In Z. Ghahramani, editor, Proceedings of the International Conference in Machine Learning, volume 24, pages 481-488. Omnipress, 2007. ISBN 1-59593-793-3.
18. R. M. Neal. Bayesian Learning for Neural Networks. Springer, 1996. Lecture Notes in Statistics 118.
19. C. E. Rasmussen and C. K. I. Williams. Gaussian Processes for Machine Learning. Cambridge, MA, 2006. ISBN 0-262-18253-X.
20. R. Salakhutdinov and I. Murray. On the quantitative analysis of deep belief networks. In Proceedings of the International Conference on Machine Learning, volume 25, 2008.
21. E. Snelson, C. E. Rasmussen, and Z. Ghahramani. Warped Gaussian processes. In S. Thrun, L. Saul, and B. Schölkopf, editors, Advances in Neural Information Processing Systems 16. MIT Press, Cambridge, MA, 2004.
22. J. Snoek, R. P. Adams, and H. Larochelle. On nonparametric guidance for learning autoencoder representations. In Fifteenth International Conference on Artificial Intelligence and Statistics (AISTATS), 2012.
23. J. B. Tenenbaum, V. de Silva, and J. C. Langford. A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500): 2319-2323, 2000. doi: 10.1126/science.290.5500.2319.
24. J. B. Tenenbaum, C. Kemp, and P. Shafto. Theory-based bayesian models of inductive learning and reasoning. In Trends in Cognitive Sciences, pages 309-318, 2006.
25. M. Titsias. Variational learning of inducing variables in sparse Gaussian processes. JMLR W&CP, 5: 567-574, 2009.
26. M. K. Titsias and N. D. Lawrence. Bayesian Gaussian process latent variable model. In Y. W. Teh and D. M. Titterington, editors, Proceedings of the Thirteenth International Workshop on Artificial Intelligence and Statistics, volume 9, pages 844-851, Chia Laguna Resort, Sardinia, Italy, 13-16 May 2010. JMLR W&CP 9.
27. A. G. Wilson, D. A. Knowles, and Z. Ghahramani. Gaussian process regression networks. In J. Langford and J. Pineau, editors, Proceedings of the 29th International Conference on Machine Learning (ICML), Edinburgh, June 2012. Omnipress.