Time series forecasting by evolving artificial neural networks with genetic algorithms, differential evolution and estimation of distribution algorithm

Neural Computing and Applications

Volumn 22, Issue 1, 2013, Pages 11-20

  Donate, Juan Peralta ^a   Li, Xiaodong ^b   Sánchez, Germán Gutiérrez ^a   de Miguel, Araceli Sanchis ^a  

^a UNIVERSIDAD CARLOS III DE MADRID   (Spain)

^b RMIT UNIVERSITY   (Australia)

Author keywords

Artificial neural networks; Differential evolution; Estimation of distribution algorithm; Evolutionary computation; Forecasting; Genetic algorithms; Time series

Indexed keywords

EVOLUTIONARY ALGORITHMS; FORECASTING; GENETIC ALGORITHMS; TIME SERIES;

DIFFERENTIAL EVOLUTION; DIFFERENTIAL EVOLUTION ALGORITHMS; ESTIMATION OF DISTRIBUTION ALGORITHM (EDA); ESTIMATION OF DISTRIBUTION ALGORITHMS; EVOLUTIONARY ARTIFICIAL NEURAL NETWORKS; EVOLVING ARTIFICIAL NEURAL NETWORKS; NEURAL NETWORKS ARCHITECTURE; NON-LINEAR RELATIONSHIPS;

NEURAL NETWORKS;

EID: 84871997305     PISSN: 09410643     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00521-011-0741-0     Document Type: Article

References (46)

1. Makridakis S, Wheelwright S, Hyndman R (2008) Forecasting methods and applications, 2nd edn. Wiley, USA.
2. Nunn I, White T (2005) The application of antigenic search techniques to time series forecasting. GECCO. In: Preparation of papers for international journal of automation and computing 13, pp 353-360.
3. Cortez P (2010) Sensitivity analysis for time lag selection to forecast seasonal time series using neural networks and support vector machines. In Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN 2010), pp 3694-3701, Barcelona, Spain.
4. Crone S, Kourentzes N (2010) Feature selection for time series prediction a combined filter and wrapper approach for neural networks. Neurocomputing 73: 1923-1936.
5. Štěpnička M, Dvořák A, Pavliska V, Vavříčková L (2011) A linguistic approach to time series modeling with help of the F-transform. Fuzzy Sets Syst 180(1): 164-184. doi: 10. 1016/j. fss. 2011. 02. 017.
6. Kasabov N, Song Q (2002) Dens: Dynamic evolving neural-fuzzy inference system and its application for time-series prediction. IEEE Trans Fuzzy Syst 10: 144-154.
7. Peralta J, Gutierrez G, Sanchis A (2008) Adann: automatic design of artificial neural networks. In Proceedings of the 2008 GECCO conference companion on Genetic and evolutionary computation, GECCO'08, pp 1863-1870, New York, NY, USA.
8. Hassan R, Nath B, Kirley M (2007) A fusion model of HMM, ANN and GA for stock market forecasting. Expert Systems with Applications 33: 171-180.
9. Maqsood I, Khan MR, Abraham A (2007) An ensemble of neural networks for weather forecasting. Neural Comput Appl 13(2): 112-122.
10. Bengio S, Fessant F, Collobert D (1995) A connectionist system for medium term horizon time series prediction, In: Proc int workshop application neural networks to telecoms, pp 308-315.
11. Simon H (1998) Neural networks: a comprehensive foundation, 2nd edn. Prentice Hall, New Jersey.
12. Ferreira TA, Vasconcelos GC, Adeodato PJ (2008) A new intelligent system methodology for time series forecasting with artificial neural networks. Neural Process Lett 28(2): 113-129. doi: 10. 1007/s11063-008-9085-x.
13. Crone SF (2005) Stepwise selection of artificial neural networks models for time series prediction. Journal of Intelligent Systems, Department of Management Science Lancaster University Management School Lancaster, United Kingdom.
14. Zhang G, Patuwo BE, Hu MY (1998) Forecasting with artificial neural networks: the state of the art. Int J Forecast 14: 35-62.
15. Cortez P, Rocha M, Neves J (2004) Evolving time series forecasting ARMA models. J Heuristics 10(4): 415-429. doi: 10. 1023/B: HEUR. 0000034714. 09838. 1e.
16. T. Ash. Dynamic Node Creation in Backpropagation Networks ICS Report 8901, The Institute for Cognitive Science, University of California, San Diego (Saiensu-sh, 1988), 1988.
17. Fogel DB, Fogel LJ, Porto VW (1990) Evolving neural network. Biol Cybern 63: 487-493.
18. Gruau F (1992) Genetic synthesis of Boolean neural networks with a cell rewriting developmental process. Proceedings of COGANN-92 International Workshop on Combinations of Genetic Algorithms and Neural Networks, pp 55-74, IEEE Computer Society Press, Los Alamitos.
19. Yao X, Lin Y (1997) A new evolutionary system for evolving artificial neural networks. Transactions on Neural Networks 8(3): 694-713.
20. Kitano H (1990) Designing neural networks using genetic algorithms with graph generation system. Complex Systems 4: 461-476.
21. Abraham A (2004) Meta-learning evolutionary artificial neural networks. Neurocomputing Journal 56c: 1-38.
22. Yao X (1993) A review of evolutionary artificial neural networks. International Journal of Intelligent Systems 8(4): 539-567.
23. Cortez P, Rocha M, Neves J (2006) Time series forecasting by evolutionary neural networks. In: Rubuñal J, Dorado J (eds) Artificial Neural Networks in Real-Life Applications. chapter III. Idea Group Publishing, Hershey, pp 47-70.
24. Niska H, Hiltunena T, Karppinenb A, Ruuskanena J Kolehmainena M (2004) Evolving the neural network model for forecasting air pollution time series. Eng Appl Artif Intell 17(2): 159-167. ISSN: 0952-1976.
25. Chena Y-H, Chang F-J (2009) Evolutionary artificial neural networks for hydrological systems forecasting. J Hydrol 367(1-2): 125-137. ISSN: 0022-1694.
26. Chen Y, Yang B, Dong J (2005) Time-series prediction using a local linear wavelet neural network. Neurocomputing 69(4-6): 449-465.
27. Rivas VM, Merelo JJ, Castillo PA, Arenas MG, Castellano, JG (2003) Evolving RBF neural networks for time-series forecasting with EvRBF. Inform Sci 165(3-4): 207-220.
28. Araújo RA, Vasconselos GC, Ferreria AE (2007) Hybrid differential evolutionary system for financial time series forecasting. In: IEEE congress on evolutionary computation, pp 4329-4336.
29. Abdul-Kader HM (2009) Neural networks training based on differential evolution algorithm compared with other architectures for weather forecasting 34. Int J Comput Sci Netw Secur 9(3): 92-99.
30. Fogel D (1998) Evolutionary Computation: Toward a New Philosophy of Machine Intelligence. Wiley-IEEE Press, New Jersey.
31. Cybenko G (1989) Approximation by superposition of a sigmoidal function. Math Control Signals Syst 2: 303-314.
32. Prof. Dr. Andreas Zell WSI Computer Science Department, Computer Arquitecture, Software, Artif Neural Netw http://www-ra. informatik. uni-tuebingen. de/SNNS/.
33. Goldberg DE (1989) Genetic algorithms in search, optimization, and machine learning. Addison-Wesley Professional, Boston. ISBN 978-0201157675.
34. http://www. obitko. com/tutorials/genetic-algorithms/parameters. php. November 2010.
35. Storn R, Price K (1997) Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. J Global Opt 11: 341-359.
36. Wickramasinghe W, Li X (2008) Choosing leaders for multi-objective PSO algorithms using differential evolution, in Proceedings of the seventh international conference on simulated evolution and learning (SEAL'08), Lecture Notes in Computer Science (LNCS 5361), Springer, Berlin, pp 249-258.
37. Cotta C, Alba E, Sagarna R, Larrañaga P (2002) Adjusting weights in artificial neural networks using evolutionary algorithms. In: Larrañaga P, Lozano JA (eds) Estimation of distribution algorithms. A new tool for evolutionary computation. Kluwer, Dordrecht, pp 357-373.
38. Time Series Forecasting Competition for Neural Networks and Computational Intelligence. http://www. neural-forecastingcompetition. com. Accessed on October 2010.
39. Armstrong J (1985) Long-range forecasting. Wiley, New York.
40. Andrawis R, Atiya A (2009) A new Bayesian formulation for Holt's exponential smoothing. Journal of Forecasting 28(3): 218-234.
41. http://www. forecastpro. com/products/overview/index. htm. Accessed on December 2010.
42. Larrañaga P, Lozano JA (2001) Estimation of Distribution Algorithms. A new tool for evolutionary computation (genetic algorithms and evolutionary computation). Springer, Berlin.
43. David Schaffer J, Caruana RA, Eshelman LJ (1991) Using genetic search to exploit the emergent behavior of neural networks. MIT Press, Cambridge, pp 244-248.
44. Peralta J, Li X, Gutierrez G, Sanchis A (2010) Time series forecasting by evolving artificial neural networks using genetic algorithms and differential evolution. In Proceedings of the 2010 WCCI conference, IJCNN-WCCI'10, pages 3999-4006, Barcelona, Spain.
45. Peralta J, Gutierrez G, Sanchis A (2010) Time series forecasting by evolving artificial neural networks using genetic algorithms and estimation of distribution algorithms. In Proceedings of the 2010 WCCI conference, IJCNN-WCCI'10, Barcelona, Spain.
46. Hyndman RJ Time series data library, http://robjhyndman. com/TSDL/. Accessed on June 2011.