Efficient learning of Deep Boltzmann Machines

Journal of Machine Learning Research

Volumn 9, Issue , 2010, Pages 693-700

  Salakhutdinov, Ruslan ^a   Larochelle, Hugo ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATE INFERENCE; BOLTZMANN MACHINES; DEEP BELIEF NETWORKS; DISCRIMINATIVE MODELS; EFFICIENT LEARNING; GENERATIVE MODEL; HANDWRITTEN DIGIT; HIDDEN LAYERS; HIDDEN VARIABLE; HIGH-DIMENSIONAL; LATENT VARIABLE; RECOGNITION MODELS; SENSORY INPUT; TOP-DOWN FEEDBACK; TOPDOWN; VISUAL OBJECT RECOGNITION;

ALGORITHMS; ARTIFICIAL INTELLIGENCE;

INFERENCE ENGINES;

EID: 84862291504     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (18)

1. Bengio, Y. (2009). Learning deep architectures for AI. Foundations and Trends in Machine Learning.
2. Bengio, Y., & LeCun, Y. (2007). Scaling learning algorithms towards AI. Large-Scale Kernel Machines. MIT Press.
3. Decoste, D., & Schölkopf, B. (2002). Training invariant support vector machines. Machine Learning, 46, 161.
4. Hinton, G., Dayan, P., Frey, B., & Neal, R. (1995). The" wakesleep" algorithm for unsupervised neural networks. Science, 268, 1158-1161.
5. Hinton, G. E., Osindero, S., & Teh, Y. W. (2006). A fast learning algorithm for deep belief nets. Neural Computation, 18, 1527-1554.
6. Hinton, G. E., & Sejnowski, T. (1983). Optimal perceptual inference. IEEE conference on Computer Vision and Pattern Recognition.
7. Larochelle, H., Erhan, D., & Vincent, P. (2009). Deep learning using robust interdependent codes. Proceedings of the International Conference on Artificial Intelligence and Statistics.
8. LeCun, Y., Huang, F. J., & Bottou, L. (2004). Learning methods for generic object recognition with invariance to pose and lighting. CVPR (2) (pp. 97-104).
9. Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009). Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations. ICML. ACM.
10. Lee, T. S., Mumford, D., Romero, R., & Lamme, V. (1998). The role of the primary visual cortex in higher level vision. Vision research, 38, 2429-2454.
11. Nair, V., & Hinton, G. (2010). 3D object recognition with deep belief nets. Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press.
12. Neal, R. M. (2001). Annealed importance sampling. Statistics and Computing, 11, 125-139.
13. Ranzato, M., Poultney, C., Chopra, S., & LeCun, Y. (2007). Efficient learning of sparse representations with an energy-based model. In NIPS 19, 1137-1144. Cambridge, MA: MIT Press.
14. Salakhutdinov, R. R. (2008). Learning and evaluating Boltzmann machines (Technical Report UTML TR 2008-002). Department of Computer Science, University of Toronto.
15. Salakhutdinov, R. R., & Hinton, G. E. (2009). Deep Boltzmann machines. Proceedings of the International Conference on Artificial Intelligence and Statistics.
16. Salakhutdinov, R. R., & Murray, I. (2008). On the quantitative analysis of deep belief networks. Proceedings of the International Conference on Machine Learning (pp. 872 - 879).
17. Torralba, A., Fergus, R., & Weiss, Y. (2008). Small codes and large image databases for recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
18. Younes, L. (1989). Parameter inference for imperfectly observed Gibbsian fields. Probability Theory Rel. Fields, 82, 625-645.