Time series forecasting using a deep belief network with restricted Boltzmann machines

Neurocomputing

Volumn 137, Issue , 2014, Pages 47-56

  Kuremoto, Takashi ^a   Kimura, Shinsuke ^a   Kobayashi, Kunikazu ^b   Obayashi, Masanao ^a  

^a YAMAGUCHI UNIVERSITY   (Japan)

^b AICHI PREFECTURAL UNIVERSITY   (Japan)

Author keywords

CATS benchmark; Chaos; Deep belief nets; Multi layer perceptron; Restricted Boltzmann machine; Time series forecasting

Indexed keywords

CHAOS THEORY; INTELLIGENT COMPUTING; NETWORK LAYERS; NEURAL NETWORKS; PARTICLE SWARM OPTIMIZATION (PSO); TIME SERIES;

CATS BENCHMARK; DEEP BELIEF NETS; MULTI LAYER PERCEPTRON; RESTRICTED BOLTZMANN MACHINE; TIME SERIES FORECASTING;

FORECASTING;

EID: 84899568094     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.03.047     Document Type: Article

References (24)

1. S. Crone, K. Nikolopoulos, Results of the NN3 neural network forecasting competition, in: Proceedings of the 27th International Symposium on Forecasting Program, 2007, pp. 129.
2. Rumelhart D.E., Hinton G.E., Williams R.J. Learning representation by back-propagating errors. Nature 1986, 232:533-536.
3. R. Hecht-Nielsen, Theory of the backpropagation neural network, in: Proceedings of the International Joint Conference on Neural Networks, vol. 1, 1989, pp. 593-611.
4. V. Pacelli, V. Bevilacqua, M. Azzollini, An artificial neural network model to forecast exchange rates, J. Intell. Learn. Syst. Appl.3 (2011) 57-69.
5. Panchal G., Ganatra A., Kosta Y.P., Panchal D. Behaviour analysis of multilayer perceptrons with multiple hidden neurons and hidden layers. Int. J. Comput. Theory Eng. 2011, 3(2):332-337.
6. T. Kuremoto, M. Obayashi, A. Yamamoto, K. Kobayashi, Predicting chaotic time series by reinforcement learning, in: Proceedings of the 2nd International Conference on Computational Intelligence, Robotics and Autonomous Systems (CIRAS'03), 2003.
7. T. Kuremoto, M. Obayashi, K. Kobayashi, Forecasting time series by SOFNN with reinforcement learning, in: Proceedings of the 27th International Symposium on Forecasting (ISF 2007) Program, 2007, pp. 99.
8. Kuremoto T., Obayashi M., Kobayashi K. Neural forecasting systems. Reinforcement Learning: Theory and Applications 2008, 1-20. INTECH, Rijeca, Croatia. C. Weber, M. Elshaw, N.M. Mayer (Eds.).
9. Hinton G.E., Osindero S., The Y.W. A faster learning algorithm for deep belief nets. Neural Comput. 2006, 1(7):1527-1544.
10. Hinton G.E., Salakhutdinov R.R. Reducing the dimensionality of data with neural networks. Science 2006, 313:504-507.
11. Y. Bengio, P. Lamlin, D. Popovici, H. Larochelle, Greedy layer-wise training of deep networks, in: Proceedings of Advances in Neural Information Processing Systems (NIPS 2006), vol. 19, 2007, pp. 1-8.
12. Chen K., Salman A. Learning speaker-specific characteristics with a deep neural architecture. IEEE Trans. Neural Netw. 2011, 22(11).
13. Roux N.L., Bengio Y. Representational power of restricted Boltzmann machines and deep belief networks. Neural Comput. 2008, 20(6):1631-1649.
14. Ackley D.H., Hinton G.E., Sejnowski T.J. A learning algorithm for Boltzmann machines. Cogn. Sci. 1985, 9:147-169.
15. Hinton G.E., Sejnowski T.J. Learning and relearning in Boltzmann machines. Parallel Distributed Processing: Explorations in the Microstructure of Cognition. Volume 1: Foundations 1986, MIT Press, Cambridge, MA. D.E. Rumelhart, J.L. McClelland (Eds.).
16. J. Kennedy, R.C. Eberhart, Particle swarm optimization, in: Proceedings of the IEEE International Conference on Neural Networks, 1995, pp. 1942-1948.
17. Zhang G.P. Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing 2003, 50:159-175.
18. Gardner E., McKenzie E. Seasonal exponential smoothing with damped trends. Manag. Sci. 1989, 35(3):372-376.
19. A. Lendasse, E. Oja, O. Simula, M. Verleysen, Time series prediction competition: the CATS benchmark, in: Proceedings of the International Joint Conference on Neural Networks, 2004, pp. 1615-1620.
20. Lendasse A., Oja E., Simula O., Verleysen M. Time series prediction competition: the CATS benchmark. Neurocomputing 2007, 70:2325-2329.
21. Box G.E.P., Jenkins G. Time Series Analysis, Forecasting and Control 1976, Cambridge University Press, Cambridge.
22. G.E. Hinton, R.R. Salakhutdinov, Supporting online material, 2006. Matlab Code. http://www.sciencemag.org/.
23. Lorenz E.N. Deterministic nonperiodic flow. J. Atmos. Sci. 1963, 20:130-141.
24. T. Kuremoto, M. Obayashi, K. Kobayashi, Nonlinear prediction by reinforcement learning, in: Proceedings of the 1st International Conference on Intelligent Computing (ICIC 2005), D.S. Huang, X.P. Zhang, G.B. Huang, (Eds.), LNCS, Springer, vol. 3644, 2005, pp.1085-1094.