Using deep belief nets to learn covariance kernels for Gaussian processes

Advances in Neural Information Processing Systems 20 - Proceedings of the 2007 Conference

Volumn , Issue , 2008, Pages

  Salakhutdinov, Ruslan ^a   Hinton, Geoffrey ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

GAUSSIAN NOISE (ELECTRONIC);

COVARIANCE KERNEL; GAUSSIAN KERNELS; GAUSSIAN PROCESSES; GENERATIVE MODEL; GREEDY ALGORITHMS; HIGH-DIMENSIONAL; HIGHER-DIMENSIONAL; LEARN+; TOP LAYERS; UNLABELED DATA;

GAUSSIAN DISTRIBUTION;

EID: 85162037149     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (19)

1. J. K. Benedetti. On the nonparametric estimation of regression functions. Journal of the Royal Statistical Society series B, 39:248-253, 1977.
2. Y. Bengio and Y. Le Cun. Scaling learning algorithms towards AI. In L. Bottou, O. Chapelle, D. DeCoste, and J. Weston, editors, Large-Scale Kernel Machines. MIT Press, 2007.
3. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle. Greedy layer-wise training of deep networks. In Advances in Neural Information Processing Systems, 2006.
4. O. Chapelle, B. Schölkopf, and A. Zien. Semi-Supervised Learning. MIT Press, 2006.
5. G. E. Hinton. Training products of experts by minimizing contrastive divergence. Neural Computation, 14(8):1711-1800, 2002.
6. G. E. Hinton and R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313, 2006.
7. Geoffrey E. Hinton, Simon Osindero, and Yee Whye Teh. A fast learning algorithm for deep belief nets. Neural Computation, 18(7):1527-1554, 2006. (Pubitemid 44024729)
8. F. Lauer, C. Y. Suen, and G. Bloch. A trainable feature extractor for handwritten digit recognition. Pattern Recognition, 40(6):1816-1824, 2007. (Pubitemid 46402919)
9. N. D. Lawrence and J. Quiñonero Candela. Local distance preservation in the GP-LVM through back constraints. In William W. Cohen and Andrew Moore, editors, ICML, volume 148, pages 513-520. ACM, 2006.
10. N. D. Lawrence and M. I. Jordan. Semi-supervised learning via gaussian processes. In NIPS, 2004.
11. N. D. Lawrence and B. Schölkopf. Estimating a kernel Fisher discriminant in the presence of label noise. In Proc. 18th International Conf. on Machine Learning, pages 306-313. Morgan Kaufmann, San Francisco, CA, 2001.
12. T. P. Minka. Expectation propagation for approximate bayesian inference. In Jack Breese and Daphne Koller, editors, UAI, pages 362-369, San Francisco, CA, 2001. Morgan Kaufmann Publishers.
13. C. E. Rasmussen and C. Williams. Gaussian Processes for Machine Learning. The MIT Press, 2006.
14. R. Salakhutdinov and G. E. Hinton. Learning a nonlinear embedding by preserving class neighbourhood structure. In AI and Statistics, 2007.
15. M. Seeger. Covariance kernels from bayesian generative models. In Thomas G. Dietterich, Suzanna Becker, and Zoubin Ghahramani, editors, NIPS, pages 905-912. MIT Press, 2001.
16. M. Seeger. Gaussian processes for machine learning. Int. J. Neural Syst, 14(2):69-106, 2004.
17. V. Vapnik. Statistical Learning Theory. Wiley, 1998.
18. M. Welling, M. Rosen-Zvi, and G. Hinton. Exponential family harmoniums with an application to information retrieval. In NIPS 17, pages 1481-1488, Cambridge, MA, 2005. MIT Press.
19. Xiaojin Zhu, Jaz S. Kandola, Zoubin Ghahramani, and John D. Lafferty. Nonparametric transforms of graph kernels for semi-supervised learning. In NIPS, 2004.