A neural network based linear ensemble framework for time series forecasting

Neurocomputing

Volumn 157, Issue , 2015, Pages 231-242

  Adhikari, Ratnadip ^a  

^a LNM INSTITUTE OF INFORMATION TECHNOLOGY   (India)

Author keywords

Artificial neural networks; Combining forecasts; Forecasting accuracy; Time series forecasting; Weights selection

Indexed keywords

FORECASTING; LINEAR NETWORKS; TIME SERIES;

COMBINING FORECASTS; FORECASTING ACCURACY; NON-PARAMETRIC STATISTICAL TESTS; NOVEL NEURAL NETWORK; REAL-WORLD TIME SERIES; TIME SERIES FORECASTING; TIME SERIES FORECASTS; WEIGHTS SELECTION;

NEURAL NETWORKS;

ACCURACY; ARTICLE; ARTIFICIAL NEURAL NETWORK; FORECASTING; INTERMETHOD COMPARISON; LINEAR SYSTEM; MATHEMATICAL MODEL; PREDICTION; PRIORITY JOURNAL; SYSTEMATIC ERROR; TIME SERIES ANALYSIS; VALIDATION PROCESS;

EID: 84924080929     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2015.01.012     Document Type: Article

References (51)

1. Bates J.M., Granger C.W.J. The combination of forecasts. Oper. Res. Q. 1969, 20(4):451-468.
2. Andrawis R.R., Atiya A.F., El-Shishiny H. Forecast combinations of computational intelligence and linear models for the NN5 time series forecasting competition. Int. J. Forecast. 2011, 27(3):672-688.
3. Hibon M., Evgeniou T. To combine or not to combine. selecting among forecasts and their combinations. Int. J. Forecast. 2005, 21(1):15-24.
4. Gheyas I.A., Smith L.S. A novel neural network ensemble architecture for time series forecasting. Neurocomputing 2011, 74(18):3855-3864.
5. J.S. Armstrong, Principles of Forecasting: A Handbook for Researchers and Practitioners, vol. 30, Kluwer Academic Publishers, Boston, USA, 2001.
6. Makridakis S., Hibon M. The M3-Competition. results, conclusions and implications. Int. J. Forecast. 2000, 16(4):451-476.
7. Timmermann A. Forecast combinations. Handb. Econ. Forecast. 2006, 1:135-196.
8. Jose V.R.R., Winkler R.L. Simple robust averages of forecasts: some empirical results. Int. J. Forecast. 2008, 24(1):163-169.
9. De Gooijer J.G., Hyndman R.J. 25 years of time series forecasting. Int. J. Forecast. 2006, 22(3):443-473.
10. De Menezes L.M., W Bunn D., Taylor J.W. Review of guidelines for the use of combined forecasts. Eur. J. Oper. Res. 2000, 120(1):190-204.
11. Granger C.W.J., Ramanathan R. Improved methods of combining forecasts. J. Forecast. 1984, 3(2):197-204.
12. Aksu C., Gunter S.I. An empirical analysis of the accuracy of SA, ERLS and NRLS combination forecasts. Int. J. Forecast. 1992, 8(1):27-43.
13. Dickinson J. Some comments on the combination of forecasts. Oper. Res. Q. 1975, 205-210.
14. Bunn D.W. A Bayesian approach to the linear combination of forecasts. Oper. Res. Q. 1975, 325-329.
15. Krogh A., Vedelsby J. Neural network ensembles, cross validation, and active learning. Adv. Neural Inf. Process. Syst. 1995, 20:231-238.
16. Zhou Z.-H., Wu J., Tang W. Ensembling neural networks: many could be better than all. Artif. Intell. 2002, 137(1):239-263.
17. Clemen R.T. Combining forecasts: a review and annotated bibliography. Int. J. Forecast. 1989, 5(4):559-583.
18. Lemke C., Gabrys B. Meta-learning for time series forecasting and forecast combination. Neurocomputing 2010, 73(10):2006-2016.
19. Freitas P.S., Rodrigues A.J. Model combination in neural-based forecasting. Eur. J. Oper. Res. 2006, 173(3):801-814.
20. Pollock D. Recursive estimation in econometrics. Comput. Stat. Data Anal. 2003, 44(1):37-75.
21. French S. Linear combination of forecasts-a comment. J. Oper. Res. Soc. 1981, 32:937-938.
22. Makridakis S., Winkler R.L. Averages of forecasts: some empirical results. Manag. Sci. 1983, 29(9):987-996.
23. Box G.E.P., Jenkins G.M., Reinsel G.C. Time Series Analysis: Forecasting and Control 1994, Prentice-Hall, Englewood Cliffs, USA.
24. Box G.E.P., Jenkins G.M. Time Series Analysis: Forecasting and Control 1970, Holden-Day, California. 3rd edition.
25. Zhang G., Eddy Patuwo B., Y Hu M. Forecasting with artificial neural networks: the state of the art. Int. J. Forecast. 1998, 14(1):35-62.
26. Zhang G.P. Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing 2003, 50:159-175.
27. Elman J.L. Finding structure in time. Cognit. Sci. 1990, 14(2):179-211.
28. Lim C.P., Goh W.Y. The application of an ensemble of boosted Elman networks to time series prediction: a benchmark study. Int. J. Comput. Intell. 2005, 3(2):119-126.
29. Vapnik V. The Nature of Statistical Learning Theory 1995, Springer-Verlag, New York.
30. Suykens J.A.K., Vandewalle J. Least squares support vector machines classifiers. Neural Process. Lett. 1999, 9(3):293-300.
31. Hamzaçebi C. Improving artificial neural networks[U+05F3] performance in seasonal time series forecasting. Inf. Sci. 2008, 178(23):4550-4559.
32. Hornik K., Stinchcombe M., White H. Multilayer feedforward networks are universal approximators. Neural Netw. 1989, 2(5):359-366.
33. Rumelhart D.E., Hinton G.E., Williams R.J. Learning representations by backpropagating errors. Nature 1986, 323(6188):533-536.
34. Adhikari R., Agrawal R.K. Forecasting strong seasonal time series with artificial neural networks. J. Sci. Ind. Res. 2012, 71(10):657-666.
35. Adhikari R., Agrawal R.K. Performance evaluation of weights selection schemes for linear combination of multiple forecasts. Artif. Intell. Rev. 2012, 1-20. 10.1007/s10462-012-9361-z.
36. Zhao J., Zhu X., Wang W., Liu Y. Extended Kalman filter-based Elman networks for industrial time series prediction with GPU acceleration. Neurocomputing 2013, 118:215-224.
37. Demuth H., Beale M., Hagan M. Neural Network Toolbox User[U+05F3]s Guide 2010, The MathWorks, Natic, MA.
38. S. Kumar, Neural Networks: A Classroom Approach, Tata McGraw-Hill Education, India, 2004.
39. T. Farooq, A. Guergachi, S. Krishnan, Chaotic time series prediction using knowledge based Greens kernel and least-squares support vector machines, in: IEEE International Conference on Systems, Man and Cybernetics (ISIC), 2007, IEEE, Montreal, Canada, 2007, pp. 373-378.
40. O. Chapelle, Support Vector Machines: Introduction Principles, Adaptive Tuning and Prior Knowledge (Ph.D. thesis), University of Paris, France, 2002.
41. Zhang G.P. A neural network ensemble method with jittered training data for time series forecasting. Inf. Sci. 2007, 177(23):5329-5346.
42. Markham I.S., Rakes T.R. The effect of sample size and variability of data on the comparative performance of artificial neural networks and regression. Comput. Oper. Res. 1998, 25(4):251-263.
43. Burges C.J. A tutorial on support vector machines for pattern recognition. Data Min. Knowl. Discov. 1998, 2(2):121-167.
44. Stock J.H., Watson M.W. Combination forecasts of output growth in a seven-country data set. J. Forecast. 2004, 23(6):405-430.
45. G.H. Golub, C.F. Van Loan, Matrix computations, 3rd edition, vol. 3, The John Hopkins University Press, Baltimore, USA, 2012.
46. Kuncheva L.I. Combining Pattern Classifiers: Methods and Algorithms 2004, John Wiley & Sons, Hoboken, New Jersey.
47. Anthony M. Probabilistic analysis of learning in artificial neural networks. the PAC model and its variants. Neural Comput. Surv. 1998, 1:1-60.
48. R.J. Hyndman, Time Series Data Library (TSDL), 2013, Available online at url:(01-01-13). http://robjhyndman.com/TSDL/.
49. Dickey D.A., Fuller W.A. Distribution of the estimators for autoregressive time series with a unit root. J. Am. stat. Assoc. 1979, 74(366a):427-431.
50. Delft Center for Systems and Control, 2013, MATLAB Toolbox ARMASA, [Online], url: (12-07-13). http://www.dcsc.tudelft.nl/Research/Software.
51. Hollander M., Wolfe D.A., Chicken E. Nonparametric Statistical Methods 2013, vol. 751. John Wiley & Sons, Hoboken, New Jersey.