Deep boltzmann machines as feed-forward hierarchies

Journal of Machine Learning Research

Volumn 22, Issue , 2012, Pages 798-804

  Montavon, Grégoire ^a   Braun, Mikio L ^a   Müller, Klaus Robert ^a  

^a TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

SOFTWARE ENGINEERING;

DEEP BOLTZMANN MACHINES; DEEP NEURAL NETWORKS; FEATURE HIERARCHIES; FEED FORWARD; HIERARCHICAL STRUCTURES; INVARIANT REPRESENTATION; LAYER-WISE; OBSERVED DATA;

ARTIFICIAL INTELLIGENCE;

EID: 84872523237     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (15)

1. David H. Ackley, Geoffrey E. Hinton, and Terrence J. Sejnowski. A learning algorithm for Boltzmann machines. Cognitive Science, 9 (1): 147-169, 1985.
2. Yoshua Bengio, Pascal Lamblin, Dan Popovici, and Hugo Larochelle. Greedy layer-wise training of deep networks. In Advances in Neural Information Processing Systems 19, pages 153-160, 2007.
3. Mikio L. Braun, Joachim Buhmann, and Klaus-Robert Müller. On relevant dimensions in kernel feature spaces. Journal of Machine Learning Research, 9: 1875-1908, Aug 2008.
4. Dumitru Erhan, Yoshua Bengio, Aaron Courville, Pierre-AntoineManzagol, Pascal Vincent, and Samy Bengio. Why does unsupervised pre-training help deep learning? Journal of Machine Learning Research, 11: 625-660, 2010.
5. Isabelle Guyon, Gideon Dror, Vincent Lemaire, Graham Taylor, and David W. Aha. Unsupervised and transfer learning challenge. In Neural Networks (IJCNN), The 2011 International Joint Conference on, pages 793-800. IEEE, 2011.
6. Geoffrey E. Hinton and Ruslan R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313 (5786): 504-507, July 2006.
7. Geoffrey E. Hinton and Terrence J. Sejnowski. Learning and relearning in Boltzmann machines. Parallel Distributed Processing: Explorations in the Microstructure of Cognition, 1: 282-317, 1986.
8. Geoffrey E. Hinton, Simon Osindero, and Yee-Whye Teh. A fast learning algorithm for deep belief nets. Neural Computation, 18 (7): 1527-1554, 2006.
9. John J. Hopfield. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences, 79 (8): 2554, 1982.
10. Grégoire Montavon, Mikio Braun, and Klaus-Robert Müller. Kernel analysis of deep networks. Journal of Machine Learning Research, 12: 2563-2581, 2011.
11. Radford M. Neal. Probabilistic inference using Markov chain Monte Carlo methods. Technical report, University of Toronto, 1993.
12. Ruslan Salakhutdinov and Geoffrey Hinton. Deep Boltzmann machines. In Proceedings of the International Conference on Artificial Intelligence and Statistics, volume 5, pages 448-455, 2009.
13. Bernhard Schölkopf, Alexander Smola, and Klaus- Robert Müller. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10 (5): 1299-1319, 1998.
14. Tijmen Tieleman. Training restricted Boltzmann machines using approximations to the likelihood gradient. In Proceedings of the 25th International Conference on Machine Learning, pages 1064-1071, 2008.
15. Laurens van der Maaten. A new benchmark dataset for handwritten character recognition. Technical report, Tilburg University, 2009.