Reducing the dimensionality of data with neural networks

Science

Volumn 313, Issue 5786, 2006, Pages 504-507

  Hinton, G E ^a   Salakhutdinov, R R ^a  

^a UNIVERSITY OF TORONTO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

CODES (SYMBOLS); NEURAL NETWORKS; PRINCIPAL COMPONENT ANALYSIS; SIGNAL ENCODING; VECTORS;

HIGH-DIMENSIONAL DATA; LOW-DIMENSIONAL CODES; MULTILAYER NEURAL NETWORK; SMALL CENTRAL LAYER;

DATA PROCESSING;

DATA; NETWORK DESIGN;

ARTICLE; ARTIFICIAL NEURAL NETWORK; CALCULATION; DATA ANALYSIS SOFTWARE; DATA EXTRACTION; DATA SYNTHESIS; ENERGY; LEARNING; MATHEMATICAL ANALYSIS; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; PROBABILITY; RANDOM SAMPLE;

EID: 33746600649     PISSN: 00368075     EISSN: 10959203     Source Type: Journal    
DOI: 10.1126/science.1127647     Document Type: Article

References (17)

1. D. C. Plaut, G. E. Hinton, Comput. Speech Lang. 2, 35 (1987).
2. D. DeMers, G. Cottrell, Advances in Neural Information Processing Systems 5 (Morgan Kaufmann, San Mateo, CA, 1993), pp. 580-587.
3. R. Hecht-Nielsen, Science 269, 1860 (1995).
4. N. Kambhatla, T. Leen, Neural Comput. 9, 1493 (1997).
5. P. Smolensky, Parallel Distributed Processing: Volume 1: Foundations, D. E. Rumelhart, J. L. McClelland, Eds. (MIT Press, Cambridge, 1986), pp. 194-281.
6. G. E. Hinton, Neural Comput. 14, 1711 (2002).
7. J. J. Hopfield, Proc. Natl. Acad. Sci. U.S.A. 79, 2554 (1982).
8. See supporting material on Science Online.
9. G. E. Hinton, S. Osindero, Y. W. Teh, Neural Comput. 18, 1527 (2006).
10. M. Welling, M. Rosen-Zvi, G. Hinton, Advances in Neural Information Processing Systems 17 (MIT Press, Cambridge, MA, 2005), pp. 1481-1488.
11. The MNIST data set is available at http://yann.lecun.com/exdb/mnist/ index.html.
12. The Olivetti face data set is available at www. cs.toronto.edu/roweis/ data.html.
13. The Reuter Corpus Volume 2 is available at http://trec.nist.gov/data/ reuters/reuters.html.
14. S. C. Deerwester, S. T. Dumais, T. K. Landauer, G. W. Furnas, R. A. Harshman, J. Am. Soc. Inf. Sci. 41, 391 (1990).
15. S. T. Roweis, L. K. Saul, Science 290, 2323 (2000).
16. J. A. Tenenbaum, V. J. de Silva, J. C. Langford, Science 290, 2319 (2000).
17. We thank D. Rumelhart, M. Welling, S. Osindero, and S. Roweis for helpful discussions, and the Natural Sciences and Engineering Research Council of Canada for funding. G.E.H. is a fellow of the Canadian Institute for Advanced Research.