Unsupervised discovery of nonlinear structure using contrastive backpropagation

Cognitive Science

Volumn 30, Issue 4, 2006, Pages 725-731

  Hinton, Geoffrey ^a   Osindero, Simon ^a   Welling, Max ^a   Teh, Yee Whye ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

Backpropagation; Distributed representations; Energy based models; Neural networks; Topographic maps; Unsupervised learning

Indexed keywords

EID: 33748852900     PISSN: 03640213     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15516709cog0000_76     Document Type: Article

References (10)

1. Bell, A. J., & Sejnowski, T. J. (1997). The "independent components" of natural scenes are edge filters. Vision Research, 37, 3327-3338.
2. Hinton, G. E. (2002). Training products of experts by minimizing contrastive divergence. Neural Computation, 14, 1771-1800.
3. Hinton, G. E., & Teh, Y. W. (2001). Discovering multiple constraints that are frequently approximately satisfied. In Proceedings of the Seventeenth Conference on Uncertainty in Artificial Intelligence (UAI-2001) (pp. 227-234). San Francisco: Morgan Kaufmann.
4. Hyvarinen, A., & Hoyer, P. O. (2001). A two-layer sparse coding model learns simple and complex cell receptive fields and topography from natural images. Vision Research, 41, 2413-2423.
5. Neal, R. M. (1996). Bayesian learning for neural networks (Lecture Notes in Statistics No. 118). New York: Springer.
6. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381, 607-609.
7. Osindero, S., Welling, M., & Hinton, G. E. (2006). Topographic product models applied to natural scene statistics. Neural Computation, 18, 381-414.
8. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning representations by back-propagating errors. Nature, 323, 533-536.
9. van Hateren, J. H., & van der Schaaf, A. (1998). Independent component filters of natural images compared with simple cells in primary visual cortex. Proceedings of the Royal Society of London B: Biological Sciences, 265, 359-366.
10. Werbos, P. J. (1990). Backpropagation through time: What it does and how to do it. Proceedings of the IEEE, 78, 1550-1560.