Time series prediction using restricted boltzmann machines and backpropagation

Procedia Computer Science

Volumn 55, Issue , 2015, Pages 990-999

  Hrasko, Rafael ^a   Pacheco, Andŕe G C ^a   Krohling, Renato A ^a  

^a FEDERAL UNIVERSITY OF ESPÍRITO SANTO   (Brazil)

Author keywords

Deep belief network; Gaussian bernoulli; Restrict boltzmann machine; Time series prediction

Indexed keywords

BACKPROPAGATION; BACKPROPAGATION ALGORITHMS; COMPLEX NETWORKS; ELECTRONIC TRADING; FEEDFORWARD NEURAL NETWORKS; FORECASTING; NEURAL NETWORKS; SIGNAL PROCESSING; TIME SERIES;

ACCURATE ESTIMATION; BERNOULLI; BOLTZMANN MACHINES; DEEP BELIEF NETWORKS; REAL-WORLD PROBLEM; RESTRICTED BOLTZMANN MACHINE; TIME SERIES DATABASE; TIME SERIES PREDICTION;

WEATHER FORECASTING;

EID: 84960942441     PISSN: None     EISSN: 18770509     Source Type: Conference Proceeding    
DOI: 10.1016/j.procs.2015.07.104     Document Type: Conference Paper

References (20)

1. Box G, Jenkins G M, Reinsel G C. Time series analysis: Forecasting and control. Prentice Hall, New Jersey.
2. Van Veelen M, Nijhuis J, Spaanenburg B. Neural network approaches to capture temporal information. in: Computing Anticipatory Systems: CASYS'99-Third International Conference Vol. 517 AIP Publishing, 2000 pp. 361-371.
3. Sapankevych N I, Sankar R. Time series prediction using support vector machines: A survey. Computational Intelligence Magazine 4 (2) (2009) 24-38.
4. Kuremoto T, Kimura S, Kobayashi K, Obayashi M. Time series forecasting using a deep belief network with restricted Boltzmann machines. Neurocomputing 137 (2014) 47-56.
5. Haykin S. Neural networks: A comprehensive foundation. Prentice Hall, New Jersey.
6. Rumelhart D E, Hinton G E, Williams R J. Learning representations by back-propagating errors. Cognitive modeling 323 (9) (1986) 533-536.
7. Hagan M T, Menhaj M B. Training feed forward networks with the Marquardt algorithm. Transactions on Neural Networks 5 (6) (1994) 989-993.
8. Hinton G E, Salakhutdinov R. Reducing the dimensionality of data with neural networks. Science 313 (5786) (2006) 504-507.
9. Salama M A, Fahmy A A, et al.. Deep belief network for clustering and classification of a continuous data. in: IEEE International Symposium on Signal Processing and Information Technology 2010 pp. 473-477.
10. Ackley D H, Hinton G E, Sejnowski T J. A learning algorithm for Boltzmann machines. Cognitive science 9 (1) (1985) 147-169.
11. Hinton G E, Osindero S, Teh Y W. A fast learning algorithm for deep belief nets. Neural computation 18 (7) (2006) 1527-1554.
12. Eberhart R C, Shi Y. Computational intelligence: concepts to implementations Elsevier, 2011.
13. Memisevic R, Hinton G E. Learning to represent spatial transformations with factored higher-order Boltzmann machines. Neural Computation 22 (6) (2010) 1473-1492.
14. Xie G, Zhang X, Zhang Y, Liu C. Integrating supervised subspace criteria with restricted Boltzmann machine for feature extraction. in: IEEE International Joint Conference on Neural Networks (IJCNN) 2014 pp. 1622-1629.
15. Zhou S, Chen Q, Wang X. Active deep learning method for semi-supervised sentiment classification. Neurocomputing 120 (2013) 536- 546.
16. Larochelle H, Bengio Y. Classification using discriminative restricted Boltzmann machines. in: Proceedings of the 25th international conference on Machine learning ACM, 2008 pp. 536-543.
17. Hinton G E. Training products of experts by minimizing contrastive divergence. Neural computation 14 (8) (2002) 1771-1800.
18. Carreira-Perpinan M A, Hinton G E. On contrastive divergence learning. in: Proceedings of the tenth international workshop on artificial intelligence and statistics Citeseer, 2005 pp. 33-40.
19. Hinton G E. A practical guide to training restricted Boltzmann machines. Momentum 9 (1) (2010) 926.
20. Tanaka M, Okutomi M. A novel inference of a restricted Boltzmann machine. in: Proceedings of the 22nd IEEE International Conference on Pattern Recognition 2014 pp. 1526-1531.