An empirical evaluation of deep architectures on problems with many factors of variation

ACM International Conference Proceeding Series

Volumn 227, Issue , 2007, Pages 473-480

  Larochelle, Hugo ^a   Erhan, Dumitru ^a   Courville, Aaron ^a   Bergstra, James ^a   Bengio, Yoshua ^a  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

FEEDFORWARD NEURAL NETWORKS; FUNCTION EVALUATION; PROBLEM SOLVING; SUPPORT VECTOR MACHINES;

DIGIT RECOGNITION; IMPRESSIVE PERFORMANCE;

LEARNING ALGORITHMS;

EID: 34547967782     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1273496.1273556     Document Type: Conference Paper

References (12)

1. Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007). Greedy layer-wise training of deep networks. Advances in Neural Information Processing Systems 19. MIT Press.
2. Bengio, Y., & Le Cun, Y. (2007). Scaling learning algorithms towards AI. In L. Bottou, O. Chapelle, D. DeCoste and J. Weston (Eds.), Large scale kernel machines. MIT Press.
3. Chang, C.-C., & Lin, C.-J. (2001). LIBSVM: a library for support vector machines. Software available at http://www.csie.ntu.edu.tw/~cjlin/ libsvm.
4. Decoste, D., & Scholkopf, B. (2002). Training invariant support vector machines. Machine Learning, 46, 161-190.
5. Hinton, G. (2002). Training products of experts by minimizing contrastive divergence. Neural Computation, 14, 1771-1800.
6. Hinton, G. (2006). To recognize shapes, first learn to generate images (Technical Report UTML TR 2006-003). University of Toronto.
7. Hinton, G., & Salakhutdinov, R. (2006). Reducing the dimensionality of data with neural networks. Science, 313, 504-507.
8. Hinton, G. E., Osindero, S., & Teh, Y. (2006). A fast learning algorithm for deep belief nets. Neural Computation, 18, 1527-1554.
9. LeCun, Y., Boser, B., Denker, J., Henderson, D., Howard, R., Hubbard, W., & Jackel, L. (1989). Backpropagation applied to handwritten zip code recognition. Neural Computation, 1, 541-551.
10. LeCun, Y., Huang, F.-J., & Bottou, L. (2004). Learning methods for generic object recognition with invariance to pose and lighting. Proceedings of CVPR'04. IEEE Press.
11. Salakhutdinov, R., & Hinton, G. (2007). Learning a nonlinear embedding by preserving class neighbourhood structure. To Appear in Proceedings of AISTATS'2007.
12. Welling, M., Rosen-Zvi, M., & Hinton, G. (2005). Exponential family harmoniums with an application to information retrieval. Advances in Neural Information Processing Systems 17. MIT Press.