Chaotic time series prediction with residual analysis method using hybrid Elman-NARX neural networks

Neurocomputing

Volumn 73, Issue 13-15, 2010, Pages 2540-2553

  Ardalani Farsa, Muhammad ^a   Zolfaghari, Saeed ^a  

^a RYERSON UNIVERSITY   (Canada)

Author keywords

Chaos theory; Elman neural network; Embedding theorem; NARX neural network; Nonlinear time series prediction; Residual analysis

Indexed keywords

ELMAN NEURAL NETWORK; EMBEDDING THEOREMS; NARX NEURAL NETWORK; NONLINEAR TIME SERIES; RESIDUAL ANALYSIS;

CHAOS THEORY; FORECASTING; NEURAL NETWORKS; NUMERICAL METHODS; PHASE SPACE METHODS; TIME SERIES;

TIME SERIES ANALYSIS;

ANALYTIC METHOD; ARTICLE; ARTIFICIAL NEURAL NETWORK; CHAOTIC DYNAMICS; COMPUTER PREDICTION; COMPUTER SIMULATION; ELMAN NEURAL NETWORK; FOURIER TRANSFORMATION; FUZZY SYSTEM; INTERMETHOD COMPARISON; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; NONLINEAR AUTOREGRESSIVE MODEL WITH EXOGENOUS INPUT NEURAL NETWORK; NONLINEAR SYSTEM; PRIORITY JOURNAL; VALIDITY;

EID: 77955311883     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.06.004     Document Type: Article

References (68)

1. Abarbanel H. Analysis of Observed Chaotic Data 1996, Spinger-Verlag, New York.
2. M. Assaad, R. Boné, H. Cardot, Predicting chaotic time series by boosted recurrent neural networks, in: Proceedings of the International Conference on Neural Information Processing, vol. 4233, 2006, pp. 831-840.
3. Barreto G.A. Time series prediction with the self-organizing map: a review. Perspectives on Neural-Symbolic Integration 2006, P. Springer-Verlag, Hitzler, B. Hammer (Eds.).
4. Cao L. Practical method for determining the minimum embedding dimension of a scalar time series. Physica D 1997, 110:43-50.
5. Das A., Das P. Chaotic analysis of the foreign exchange rates. Applied Mathematics and Computation 2007, 185:388-396.
6. Denkmayr K., Cugnon P. About sunspot number medium-term predictions. Solar-Terrestrial Prediction Workshop V 1997, 103. Hiraiso Solar Terrestrial Research Center, Japan. G. Heckman (Ed.).
7. H. Dhahri, A.M. Alimi, The modified differential evolution and the RBF (MDE-RBF) neural network for time series prediction, in: Proceedings of the International Joint Conference on Neural Networks, Vancouver, Canada, 2006, pp. 2938-2943.
8. Diaconescu E. The use of NARX neural networks to predict chaotic time series. WSEAS Transactions on Computer Research 2008, 3(3):182-191.
9. Elman J.L. Finding structure time. Cognitive Science 1990, 14:179-211.
10. D. Foresee, M. Hagan, Gauss-Newton approximation to Bayesian learning, in: Proceedings of the International Joint Conference on Neural Networks, 1997, pp. 1930-1935.
11. Frank R.J., Davey N., Hunt S.P. Time series prediction and neural networks. Journal of Intelligent and Robotic Systems 2001, 31(1-3):91-103.
12. Frazier C., Kockelman K.M. Chaos Theory & Transportation Systems: an Instructive. Transportation Research Record 2004, 1897:9-17.
13. E.S. Garcia-Trevino, V. Alarcon-Aquino, Single-step prediction of chaotic time series using wavelet-networks, in: Proceedings of the Electronics, Robotics and Automotive Mechanics Conference, vol. 1, 2006, pp. 243-248.
14. Gholipour A., Araabi B.N., Lucas C. Predicting chaotic time series using neural and neurofuzzy models: a comparative study. Neural Processing Letters 2006, 24:217-239.
15. Hagan M.T., Demuth H.B., Beale M.H. Neural Network Design 1996, PWS Publishing, Boston.
16. Harris C.M., Todd R.W., Bungard S.J., Lovitt R.W., Morris J.G., Kell D.B. The dielectric permittivity of microbial suspensions at radio-frequencies: a novel method for the estimation of microbial biomass. Enzyme Microbial Technology 1987, 9:181-186.
17. Haykin S. Neural Networks: a Comprehensive Foundation 1998, Prentice Hall PTR.
18. Hilborn R.C. Chaos and Nonlinear Dynamics: an Introduction for Scientists and Engineers 2001, Oxford University Press, Oxford. 2nd edition.
19. H. Inoue, Y. Fukunaga, H. Narihisa, Efficient hybrid neural network for chaotic time series prediction, in: Proceedings of the International Conference on Artificial Neural Networks, 2001, pp. 712-718.
20. Jang J.S.R., Sun C.T., Mizutani E. Neuro-Fuzzy and Soft Computing 1997, Prentice-Hall, Englewood cliffs, New Jersey.
21. Kaplan D., Glass L. Understanding Nonlinear Dynamics 1995, Springer-Verlag, New York.
22. Kennel M.B. Method to distinguish possible chaos from colored noise and to determine embedding parameters. Physical Review A 1992, 46:3111-3118.
23. Kim D., Kim C. Forecasting time series with genetic-fuzzy predictor ensemble. IEEE Transactions on Fuzzy Systems 1997, 5:523-535.
24. Kodogiannis V., Lolis A. Forecasting financial time series using neural network and fuzzy system-based techniques. Neural Computing and Applications 2002, 11:90-102.
25. T. Koskela, M. Lehtokangas, J. Saarinen, K. Kaski, Time series prediction with multilayer perceptron, FIR and Elman neural networks, in: Proceedings of the World Congress on Neural Networks, 1996, pp. 491-496.
26. Koskela T., Varsta M., Heikkonen J., Kaski S. Time series prediction using recurrent SOM with local linear models. International Journal of Knowledge-based Intelligent Engineering Systems 1998, 2(1):60-68.
27. Leontaritis I.J., Billings S.A. Input-output parametric models for nonlinear systems-part I: deterministic nonlinear systems. International Journal of Control 1985, 41(2):303-328.
28. F. Liu, C. Quek, G.S. Ng, Neural network model for time series prediction by reinforcement learning, in: Proceedings of the International Joint Conference on Neural Networks, Montreal, Canada, 2005.
29. Ljung L. System Identification: Theory for the User 1999, Prentice-Hall, Englewood Cliffs, New Jersey. 2nd Edition.
30. Lorenz E.N. Deterministic non-periodic flows. Journal of Atmospheric Science 1963, 20:130-141.
31. Lorenz E.N. The Essence of Chaos 1993, University of Washington Press, Seattle.
32. Q. Ma, Q. Zheng, H. Peng, T. Zhong, L. Xu, Chaotic time series prediction based on evolving recurrent neural networks, in: Proceedings of the Sixth International Conference on Machine Learning and Cybernetics, Hong Kong, 2007.
33. MacKay D.J.C. Bayesian interpolation. Neural Computation 1992, 4(3):415-447.
34. MacKey M.C., Glass L. Oscillation and chaos in physiological control systems. Science 1977, 197(4300):287-289.
35. D. Martinez-Rego, O. Fontenla-Romero, A. Alonso-Betanzos, A method for time series prediction using a combination of linear models, in: Proceedings of the European Symposium on Artificial Neural Network - Advances in Computational Intelligence and Learning, Bruges, Belgium, 2008.
36. J. McNames, A nearest trajectory strategy for time series prediction, in: Proceedings of the International Workshop on Advanced Black-Box Techniques for Nonlinear Modeling, Katholieke Universiteit Leuven, Belgium, 1998, pp. 112-128.
37. McNish A.G., Lincoln J.V. Prediction of sunspot numbers. Transactions American Geophysical Union 1949, 30:673.
38. Menezes J.M., Barreto G.A. Long-term time series prediction with the NARX network: an empirical evaluation. Neurocomputing 2008, 71:3335-3343.
39. A.S. Nair, J.C. Liu, L. Rilett, S. Gupta, Non-linear analysis of traffic flow, in: Proceedings of the IEEE Intelligent Transportation Systems Conference, Oakland, 2001, pp. 25-29.
40. Norgaard M., Ravn O., Poulsen N.K., Hansen L.K. Neural Networks for Modelling and Control of Dynamic Systems 2000, Springer, Berlin.
41. Palit A.K., Popovic D. Computational Intelligence in Time Series Forecasting: Theory and Engineering Applications 2005, Springer. 1st edition.
42. Park Y.R., Murray T.J., Chen C. Predicting sun spots using a layered perceptron neural network. IEEE Transactions on Neural Networks 1996, 1(2):501-505.
43. J.C. Principe, N.R. Euliano, and W.C. Lefebvre, Neural and Adaptive Systems: Fundamentals through Simulations, (John Wiley & Sons, Inc. 1999).
44. Qian B., Rasheed K. Stock market prediction with multiple classifiers. Applied Intelligence 2007, 26:25-33.
45. Rojas I., Pomares H., Bernier J.L., Ortega J., Pino B., Pelayo F.J., Prieto A. Time series analysis using normalized PG-RBF network with regression weights. Neurocomputing 2002, 42:267-285.
46. Rojas I., Valenzuelab O., Rojasa F., Guillena A., Herreraa L.J., Pomaresa H., Marquezb L., Pasadasb M. Soft-computing techniques and ARMA model for time series prediction. Neurocomputing 2008, 71:519-537.
47. Sapankevych N., Sankar R. Time series prediction using support vector machines: a survey. IEEE Computational Intelligence Magazine 2009, 4(2):24-38.
48. Seiji K., Hiroaki S., Hiroshi S. Development of very-short-term load forecasting based on chaos theory. Electrical Engineering in Japan 2004, 148:55-63.
49. Sello S. Solar cycle forecasting: a nonlinear dynamics approach. Astronomy & Astrophysics 2001, 377:312-320.
50. SIDC (World Data Center for the Sunspot Index), http://sidc.oma.be/index.php3.
51. Simon G., Lendasse A., Cottrell M., Fort J.C., Verleysen M. Time series forecasting: obtaining long term trends with self-organizing maps. Pattern Recognition Letters 2005, 26(12):1795-1808.
52. Sprott J.C. Chaos and Time Series Analysis 2003, Oxford University Press, Oxford.
53. Takens F. Detecting strange attractors in turbulence, in dynamic systems and turbulence, Lecture Notes in Mathematics 1981, Springer Verlag, Berlin, 366-381.
54. D. Tao, H. Xiao, Chaotic time series prediction based on radial basis function network, in: Proceedings of the 8th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing, vol. 1, 2007, pp. 595-599.
55. Tenti P. Forecasting foreign exchange rates using recurrent neural networks. Applied Artificial Intelligence 1996, 10:567-581.
56. Teo K., Wang L., Lin Z. Wavelet packet multi-layer perceptron for chaotic time series prediction: effects of weight initialization. Computational Science 2001, 2074:310-317.
57. TSTOOL v. 1.11, http://www.physik3.gwdg.de/tstool.
58. X. Wang, H. Zhang, C. Zhang, X. Cai, J. Wang, Prediction of chaotic time series using LS-SVM with automatic parameter selection, in: Proceedings of the Sixth International Conference on Parallel and Distributed Computing - Applications and Technologies, 2005, pp. 962-965.
59. Y. Wang, W. Jiang, S. Yuan, J. Wang, Forecasting chaotic time series based on improved genetic Wnn, in: Proceedings of the Fourth International Conference on Natural Computation, Jinan, China, 2008.
60. J.D. Wichard, M. Ogorzalek, Time series prediction with ensemble models, in: Proceedings of the IJCNN, Budapest, Hungary, 2004, pp. 1625-1629.
61. Wilding R. Chaos, complexity and supply-chains. Logistics Focus 1998, 6:8-10.
62. Wilding R. Chaos theory: implications for supply chain management. International Journal of Logistics Management 1998, 9:43-56.
63. Wolf A., Swift J.B., Swinney H.L., Vastano J.A. Determining Lyapunov exponents from a time series. Physica D 1985, 16:285-317.
64. Zhang G., Patuwo B.E., Hu M.Y. Forecasting with artificial neural networks: the state of the art. International Journal of Forecasting 1998, 14(1):35-62.
65. Zhang J., Chung H.S., Lo W. Chaotic Time series prediction using a neuro-fuzzy system with time-delay coordinates. IEEE Transactions on Knowledge and Data Engineering 2008, 20(7):956-964.
66. Zhang J., Man K.F. Time series prediction using recurrent neural network in multi-dimension embedding phase space. IEEE International Conference on Systems, Man, and Cybernetics 1998, 2:11-14.
67. J. Zhang, K.F. Man, J.Y. Ke, Time series prediction using Lyapunov exponents in embedding phase space, in: Proceedings of the Fourth International Conference on Signal Processing, vol. 1, 1998, pp. 221-224.
68. Zhang L. Artificial Neural Network Model and Its Application 1993, Fudan University Press, Shanghai.