Learning deep belief networks from non-stationary streams

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7553 LNCS, Issue PART 2, 2012, Pages 379-386

  Calandra, Roberto ^a   Raiko, Tapani ^b   Deisenroth, Marc Peter ^a   Pouzols, Federico Montesino ^c  

^a DARMSTADT UNIVERSITY OF TECHNOLOGY   (Germany)

^b AALTO UNIVERSITY   (Finland)

^c UNIVERSITY OF HELSINKI   (Finland)

Author keywords

Adaptive Deep Belief Networks; Adaptive Learning; Concept drift; Deep Belief Networks; Deep Learning; Generating samples; Generative model; Incremental Learning; Non stationary Learning

Indexed keywords

ADAPTIVE LEARNING; CONCEPT DRIFTS; DEEP BELIEF NETWORKS; DEEP LEARNING; GENERATING SAMPLES; GENERATIVE MODEL; INCREMENTAL LEARNING; NONSTATIONARY;

NEURAL NETWORKS;

BAYESIAN NETWORKS;

EID: 84867674920     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-33266-1_47     Document Type: Conference Paper

References (16)

1. Aggarwal, C.C., Han, J., Wang, J., Yu, P.S.: On demand classification of data streams. In: Proceedings of KDD 2004, pp. 503-508 (2004)
2. Angelov, P., Filev, D.P., Kasabov, N.: Evolving Intelligent Systems: Methodology and Applications. Wiley-IEEE Press (2010)
3. Bengio, Y., Lamblin, P., Popovici, D., Larochelle, H.: Greedy layer-wise training of deep networks. In: Proceedings of NIPS 2006, vol. 19, pp. 153-160 (2006)
4. Bifet, A. (ed.): Proceeding of the 2010 Conference on Adaptive Stream Mining: Pattern Learning and Mining from Evolving Data Streams (2010)
5. Cho, K., Raiko, T., Ilin, A.: Enhanced gradient and adaptive learning rate for training restricted Boltzmann machines. In: Proceedings of ICML 2011, pp. 105-112 (2011)
6. Erhan, D., Courville, A., Bengio, Y., Vincent, P.: Why does unsupervised pretraining help deep learning? In: Proceedings of AISTATS 2010, pp. 201-208.
7. Erhan, D., Manzagol, P.-A., Bengio, Y., Bengio, S., Vincent, P.: The difficulty of training deep architectures and the effect of unsupervised pre-training. In: Proceedings of AISTATS 2009, pp. 153-160 (2009)
8. Hinton, G.E., Osindero, S., Teh, Y.W.: A fast learning algorithm for deep belief nets. Neural Computation 18(7), 1527-1554 (2006)
9. Igel, C., Hüsken, M.: Improving the RPROP learning algorithm. In: Proceedings of NC 2000, pp. 115-121 (2000)
10. Last, M.: Online classification of nonstationary data streams. Intelligent Data Analysis 6(2), 129-147 (2002)
11. LeCun, Y., Cortes, C.: MNIST handwritten digit database (2010),
12. http://yann.lecun.com/exdb/mnist/
13. Quiñonero Candela, J., Sugiyama, M., Schwaighofer, A., Lawrence, N.D.: Dataset Shift in Machine Learning. The MIT Press (2009)
14. Riedmiller, M., Braun, H.: A direct adaptive method for faster backpropagation learning: the RPROP algorithm. In: IEEE International Conference on Neural Networks, vol. 1, pp. 586-591 (1993)
15. Salakhutdinov, R.: Learning deep generative models. PhD thesis, University of Toronto (2009)
16. Zliobaite, I.: Learning under concept drift: an overview. CoRR (2010)