Do we really need all these neurons?

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7887 LNCS, Issue , 2013, Pages 460-467

  Romero, Adriana ^a   Gatta, Carlo ^b  

^a UNIVERSITY OF BARCELONA   (Spain)

^b Barcelona Perception Computing Lab   (Spain)

Author keywords

classification; hidden units; Retricted Boltzmann Machine; unsupervised learning

Indexed keywords

BOLTZMANN MACHINES; HIDDEN UNITS; INCREMENTAL ALGORITHM; RESTRICTED BOLTZMANN MACHINE;

CLASSIFICATION (OF INFORMATION); IMAGE ANALYSIS; PATTERN RECOGNITION; UNSUPERVISED LEARNING;

ALGORITHMS;

EID: 84883159617     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-38628-2_54     Document Type: Conference Paper

References (9)

1. Smolensky, P.: Information processing in dynamical systems: foundations of harmony theory. In: Rumelhart, D.E., McClelland, J.L. (eds.) Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1, ch. 6, pp. 194-281. MIT Press, Cambridge (1986)
2. Freund, Y., Haussler, D.: Unsupervised learning of distributions on binary vectors using two layer networks. In: Advances in Neural Information Processing Systems 4, San Mateo, CA, USA, pp. 912-919 (1992)
3. Hinton, G.: Training products of experts by minimizing contrastive divergence. Neural Computation 14(8), 1771-1800 (2002)
4. Hinton, G.: A practical guide to training restricted boltzmann machines, version 1, University of Toronto. Tech. Rep. (2010)
5. Montufar, G., Rauh, J., Ay, N.: Expressive power and approximation errors of restricted boltzmann machines. In: Shawe-Taylor, J., Zemel, R.S., Bartlett, P.L., Pereira, F.C.N., Weinberger, K.Q. (eds.) NIPS, pp. 415-423 (2011)
6. Le Roux, N., Bengio, Y.: Representational power of restricted Boltzmann machines and deep belief networks. Neural Computation 20(6), 1631-1649 (2008)
7. Montufar, G., Ay, N.: Refinements of universal approximation results for deep belief networks and restricted boltzmann machines. Neural Computation 23(5), 1306-1319 (2011)
8. Lecun, Y., Cortes, C.: The MNIST database of handwritten digits
9. Shannon, C.E.: A mathematical theory of communication. Bell System Technical Journal 27(3), 379-423 (1948)