Generative models for discovering sparse distributed representations

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 352, Issue 1358, 1997, Pages 1177-1190

  Hinton, Geoffrey E ^a   Ghahramani, Zoubin ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0031590130     PISSN: 09628436     EISSN: None     Source Type: Journal    
DOI: 10.1098/rstb.1997.0101     Document Type: Review

References (26)

1. Barlow, H. 1989 Unsuperviscd learning. Neural Comput. 1, 295-311.
2. Becker, S. & Hinton, G. 1992 A self-organizing neural network that discovers surfaces in random-dot stereograms. Nature 355, 161-163.
3. Bishop, C. M., Svensen, M. & Williams, C. K. I. 1997 GTM: a principled alternative to the self-organizing map. Neural Comput. (In the press.)
4. Dempster, A., Laird, N. & Rubin, D. 1977 Maximum likelihood from incomplete data via the EM algorithm. Jl R. Statist. Soc. B 39, 1-38.
5. Devroye, L. 1986 Non-uniform random variate generation. New York: Springer.
6. Durbin, R. & Willshaw, D. 1987 An analogue approach to the travelling salesman problem using an elastic net method. Nature 326, 689-691.
7. Everitt, B. S. 1984 An introduction to latent variable models. London: Chapman & Hall.
8. Frey, B. J. 1997 Continuous sigmoidal belief networks trained using slice sampling. In Advances in neural information processing sjstems9 (ed. M. Mozer, M.Jordan & T. Petsche). Cambridge, MA: MIT Press.
9. Geman, S. & Geman, D. 1984 Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans. on Pattern Analysis and Machine Intelligence 6, 721-741.
10. Gilks, W. R. & Wild, P. 1992 Adaptive rejection sampling for Gibbs samplings. Appl. Statist. 41, 337-348.
11. Gregory, R. L. 1970 The intelligent eye. London: Wiedenfeld & Nicolson.
12. Hinton, G. E. & Sejnowski, T. J. 1986 Learning and relearning in Boltzmann machines. In Parallel distributed processing: explorations in the microstructure of cognition. Vol. 1: foundations (ed. D. E. Rumelhart & J. L. McClelland). Cambridge, MA: MIT Press.
13. Hinton, G. E. & Sejnowski, T. J. 1983 Optimal perceptual Inference. In Proc. of the IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 448-453. Washington, DC.
14. Hinton, G. E., Dayan, P., Frey, B. J. & Neal, R. M. 1995 The wake-sleep algorithm for unsupcrvised neural networks. Science 268, 1158-1161.
15. Horn, B. K. P. 1977 Understanding image intensities. Artif. Intell. 8, 201-231.
16. Jacobs, R. A., Jordan, M. I., Nowlan, S. J. & Hinton, G. E. 1991 Adaptive mixture of local experts. Neural Comput. 3, 79-87.
17. Kohonen, T. 1982 Self-organized formation of topologically correct feature maps. Biol. Cybern. 43, 59-69.
18. Lee, D. D. & Seung, H. S. 1997 Unsupervised learning by convex and conic coding. In Advances in neural information processing systems 9 (ed. M. Mozer, M. Jordan & T. Petsche). Cambridge, MA: MIT Press.
19. Lewicki, M. S. & Sejnowski, T. J. 1997 Bayesian unsupervised learning of higher order structure. In Advances in neural information processing sjstems 9 (ed. M. Mozer, M. Jordan & T. Petsche). Cambridge, MA: MIT Press.
20. Mumford, D. 1994 Neuronal architectures for pattern-theoretic problems. In Large-scale neuroneal theories of the brain (ed. C. Koch & J. L. Davis), pp. 125-152. Cambridge, MA: MIT Press.
21. Neal, R. M. 1992 Connectionist learning of belief networks. Artif. Intell. 56, 71-113.
22. Neal, R. M. & Dayan, P. 1996 Factor analysis using delta-rule wake-sleep learning. Technical report no. 9607, Dept. of Statistics, University of Toronto, Canada.
23. Olshausen, B. A. & Field, D. J. 1996 Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381, 607-609.
24. Pearl, J. 1988 Probabilistic reasoning in intelligent systems: networks of plausible inference. San Matco, CA: Morgan Kaufmann.
25. Rumelhart, D. E. & Zipser, D. 1985 Feature discovery by competitive learning. Cogn. Sci. 9, 75-112.
26. Rumelhart, D. E., Hinton, G. E. & Williams, R. J. 1986 Learning internal representations by back-propagating errors. Nature 323, 533-536.