Contrastive divergence learning for the Restricted Boltzmann Machine

Proceedings - International Conference on Natural Computation

Volumn , Issue , 2013, Pages 18-22

  Liu, Jian Wei ^a   Chi, Guang Hui ^a   Luo, Xiong Lin ^a  

^a CHINA UNIVERSITY OF PETROLEUM   (China)

Author keywords

contrastive divergence learning; markov chain; restricted boltzmann machine

Indexed keywords

ARTIFICIAL INTELLIGENCE; EXPERIMENTS; MARKOV PROCESSES;

CONTRASTIVE DIVERGENCE; DEEP ARCHITECTURES; DEEP BELIEF NETWORK (DBN); ENERGY-BASED MODELS; MODELING PROCESS; RESTRICTED BOLTZMANN MACHINE; TRAINING ALGORITHMS;

LEARNING ALGORITHMS;

EID: 84901790749     PISSN: 21579555     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICNC.2013.6817936     Document Type: Conference Paper

References (14)

1. D. H. Ackley, G. E. Hinton. A learning algorithm for boltzmann machine. Cognitive Science,vol. 9, pp. 147-169, 1985.
2. N. Le Roux and Y. Bengio. Representational power of restricted boltzmann machines and deep belief networks. Neural Computation, vol. 20, no. 6,pp. 1631-1649, 2008.
3. Guillaume Desjardins, Aaron Courville, Yoshua Bengio, Pascal Vincent, Olivier Delalleau. Parallel Tempering for Training of Restricted Boltzmann Machines. Neural Computation, vol. 19, pp. 1527-1554, 2008.
4. Desjardins, G. , Courville, A. , Bengio, Y. , Vincent, P. and Delalleau, O. Tempered Markov Chain Monte Carlo for training of Restricted Boltzmann Machines. Neural Computation, vol. 20, pp. 1634-1678, 2009.
5. G. E. Hinton. Training products of experts by minimizing contrastive divergence. Neural Computation, vol. 14, pp. 1771-1800, 2002.
6. M. A. Carreira-Perpiñan and G. E. Hinton. On contrastive divergence learning. In Proceedings of the Tenth International Workshop on Artificial Intelligence and Statistics (AISTATS05), (R. G. Cowell and Z. Ghahramani, eds. ), pp. 33-40, Society for Artificial Intelligence and Statistics, 2005.
7. R. Salakhutdinov and G. E. Hinton. Deep Boltzmann machines. in Proceedings of The Twelfth International Conference on Artificial Intelligence and Statistics (AISTATS09), vol. 5, pp. 448-455, 2009.
8. Y. LeCun, S. Chopra, R. M. Hadsell, M. -A. Ranzato, and F. -J. Huang. A tutorial on energy-based learning. in Predicting Structured Data, pp. 191-246, G. Bakir and T. Hofman and B. Scholkopf and A. Smola and B. Taskar:MIT Press, 2006.
9. C. Andrieu, N. de Freitas, A. Doucet, and M. Jordan. An introduction to MCMC for machine learning. Machine Learning, vol. 50, pp. 5-43, 2003.
10. Y. Bengio. Learning deep architectures for AI. Foundations and Trends in Machine Learning, 2:1-127, 2009.
11. Welling, M. , Rosen-Zvi, M. , and Hinton, G. E. Exponential family harmoniums with an application to information retrieval. In Advances in Neural Information Processing Systems, pages1481-1488, Cambridge, MA. MIT Press.
12. Breuleux, O. , Bengio, Y. , & Vincent, P. Unlearning for better mixing (Technical Report 1349). Universitede Montreal/DIRO. 2010.
13. A. Fischer and C. Igel. Training RBMs depending on the signs of the CD approximation of the log-likelihood derivatives. In ESANN, 2011.
14. Y. Bengio and O. Delalleau. Justifying and generalizing contrastive divergence. Neur.comput. , 21:1601-1621, 2009.