Feature selection for time series prediction - A combined filter and wrapper approach for neural networks

Neurocomputing

Volumn 73, Issue 10-12, 2010, Pages 1923-1936

  Crone, Sven F ^a   Kourentzes, Nikolaos ^a  

^a LANCASTER UNIVERSITY   (United Kingdom)

Author keywords

Artificial neural networks; Automatic model specification; Feature selection; Forecasting; Input variable selection; Time series prediction

Indexed keywords

ARTIFICIAL NEURAL NETWORK; AUTOMATIC MODELS; FEATURE SELECTION; INPUT VARIABLE SELECTION; TIME SERIES PREDICTION;

COMPETITION; FEATURE EXTRACTION; FORECASTING; PATTERN RECOGNITION SYSTEMS; SPECIFICATIONS; TIME SERIES;

NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; FILTER; FORECASTING; METHODOLOGY; PREDICTION; PRIORITY JOURNAL; SPATIAL AUTOCORRELATION ANALYSIS; TIME SERIES ANALYSIS;

EID: 77952552084     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.01.017     Document Type: Article

References (63)

1. Zhang G.Q., Patuwo B.E., Hu M.Y. Forecasting with artificial neural networks: the state of the art. International Journal of Forecasting 1998, 14(1):35-62.
2. Hornik K. Approximation capabilities of multilayer feedforward networks. Neural Networks 1991, 4(2):251-257.
3. Makridakis S., Hibon M. The M3-competition: results, conclusions and implications. International Journal of Forecasting 2000, 16(4):451-476.
4. Hill T., O'Connor M., Remus W. Neural network models for time series forecasts. Management Science 1996, 42(7):1082-1092.
5. Zhang G.P., Qi M. Neural network forecasting for seasonal and trend time series. European Journal of Operational Research 2005, 160(2):501-514.
6. Armstrong J.S. Findings from evidence-based forecasting: methods for reducing forecast error. International Journal of Forecasting 2006, 22(3):583-598.
7. Anders U., Korn O. Model selection in neural networks. Neural Networks 1999, 12(2):309-323.
8. Taylor J.W., de Menezes L.M., McSharry P.E. A comparison of univariate methods for forecasting electricity demand up to a day ahead. International Journal of Forecasting 2006, 22(1):1-16.
9. Curry B., Morgan P.H. Model selection in neural networks: some difficulties. European Journal of Operational Research 2006, 170(2):567-577.
10. Bishop C.M. Neural Networks for Pattern Recognition 1995, Oxford University Press, Oxford.
11. Haykin S.S. Neural Networks: A Comprehensive Foundation 1999, Prentice-Hall, Upper Saddle River, NJ. 2nd ed.
12. Box G.E.P., Jenkins G.M., Reinsel G.C., et al. Time Series Analysis: Forecasting and Control 1994, Prentice-Hall, Englewood Cliffs, NJ [u.a.]. 3rd ed.
13. Dorffner G. Neural networks for time series processing. Neural Network World 1996, 6(4):447-468.
14. Lapedes A., Farber R. How neural nets work. Neural Information Processing Systems 1988, 442-456. American Institute of Physics, New York. D.Z. Anderson (Ed.).
15. Anders U., Korn O., Schmitt C. Improving the pricing of options: a neural network approach. Journal of Forecasting 1998, 17(5-6):369-388.
16. Lachtermacher G., Fuller J.D. Backpropagation in time-series forecasting. Journal of Forecasting 1995, 14(4):381-393.
17. Bunn D.W. Non-traditional methods of forecasting. European Journal of Operational Research 1996, 92(3):528-536.
18. Liao K.P., Fildes R. The accuracy of a procedural approach to specifying feedforward neural networks for forecasting. Computers & Operations Research 2005, 32(8):2151-2169.
19. Adya M., Collopy F. How effective are neural networks at forecasting and prediction? A review and evaluation. Journal of Forecasting 1998, 17(5-6):481-495.
20. Kohavi R., John G.H. Wrappers for feature subset selection. Artificial Intelligence 1997, 97(1-2):273-324.
21. Balkin S.D., Ord J.K. Automatic neural network modeling for univariate time series. International Journal of Forecasting 2000, 16(4):509-515.
22. Liitiainen E., Lendasse A. Long-term prediction of time series using state-space models. Artificial Neural Networks - Icann 2006, Pt 2 2006, 4132:181-190.
23. Miche Y., Sorjamaa A., Lendasse A. OP-ELM: theory, experiments and a toolbox. Artificial Neural Networks - Icann 2008, Pt I 2008, 5163:145-154.
24. Sorjamaa A., Hao J., Reyhani N., et al. Methodology for long-term prediction of time series. Neurocomputing 2007, 70(16-18):2861-2869.
25. A. Sorjamaa, Y. Miche, R. Weiss, et al., Long-term prediction of time series using NNE-based projection and OP-ELM, in: 2008 IEEE International Joint Conference on Neural Networks, vols. 1-8, 2008, pp. 2674-2680.
26. Refenes A.P.N., Zapranis A.D. Neural model identification, variable selection and model adequacy. Journal of Forecasting 1999, 18(5):299-332.
27. Medeiros M.C., Terasvirta T., Rech G. Building neural network models for time series: a statistical approach. Journal of Forecasting 2006, 25(1):49-75.
28. Yang J.Y., Olafsson S. Optimization-based feature selection with adaptive instance sampling. Computers & Operations Research 2006, 33(11):3088-3106.
29. Piramuthu S. Evaluating feature selection methods for learning in data mining applications. European Journal of Operational Research 2004, 156(2):483-494.
30. Viaene S., Baesens B., Van den Poel D., et al. Wrapped input selection using multilayer perceptrons for repeat-purchase modeling in direct marketing. International Journal of Intelligent Systems in Accounting, Finance & Management 2001, 10(2):115-126.
31. Kim Y.S., Street W.N., Russell G.J., et al. Customer targeting: a neural network approach guided by genetic algorithms. Management Science 2005, 51:264.
32. Box G.E.P., Jenkins G.M. Time Series Analysis: Forecasting and Control 1970, Holden-Day, San Francisco.
33. Reilly D. The AUTOBOX system. International Journal of Forecasting 2000, 16(4):531-533.
34. Goodrich R.L. The Forecast Pro methodology. International Journal of Forecasting 2000, 16(4):533-535.
35. Zhang G., Patuwo B.E., Hu M.Y. Forecasting with artificial neural networks: the state of the art. International Journal of Forecasting 1998, 14(1):35-62.
36. Lachtermacher G., Fuller J.D. Backpropagation in time-series forecasting. Journal of Forecasting 1995, 14(4):381.
37. Tang Z.Y., Fishwick P.A. Feed-forward neural nets as models for time series forecasting. ORSA Journal on Computing 1993, 5(4):374-386.
38. Makridakis S., Wheelwright S.C., Hyndman R.J. Forecasting: Methods and Applications 1998, John Wiley & Sons Inc., New York, p. 642. 3rd ed.
39. Hand D.J. Data mining: statistics and more?. American Statistician 1998, 52(2):112-118.
40. Swanson N.R., White H. Forecasting economic time series using flexible versus fixed specification and linear versus nonlinear econometric models. International Journal of Forecasting 1997, 13(4):439-461.
41. Qi M., Maddala G.S. Economic factors and the stock market: a new perspective. Journal of Forecasting 1999, 18(3):151-166.
42. Dahl C.M., Hylleberg S. Flexible regression models and relative forecast performance. International Journal of Forecasting 2004, 20(2):201-217.
43. Kay S.M., Marple S.L. Spectrum analysis - a modern perspective. Proceedings of the IEEE 1981, 69(11):1380-1419.
44. Box G.E.P., Jenkins G.M., Reinsel G.C. Time Series Analysis: Forecasting and Control 1994, Prentice-Hall Inc., New Jersey. 3rd ed.
45. Ghysels E., Osborn D.R. The Econometric Analysis of Seasonal Time Series 2001, Cambridge University Press, Cambridge.
46. S. Crone, N. Kourentzes, Forecasting seasonal time series with multilayer perceptrons - an empirical evaluation of input vector specifications for deterministic seasonality, pp. 232-238.
47. Neuneier R., Zimmermann H.-G. How to train neural networks. Neural Networks: Tricks of the Trade 1998, 373-423. Springer, Berlin, New York. G. Orr, K.-R. Müller (Eds.).
48. Nelson M., Hill T., Remus W., et al. Time series forecasting using neural networks: should the data be deseasonalized first?. Journal of Forecasting 1999, 18(5):359-367.
49. Zhou L., Collopy F., Kennedy M. The Problem of Neural Networks in Business Forecasting - An Attempt to Reproduc th Hill, O'Connor and Remus Study 2003, Case Wetsern Reserve University, Cleveland.
50. S.F. Crone, J. Guajardo, R. Weber, The impact of Data Preprocessing on Support Vector Regression and Artificial Neural Networks in Time Series Forecasting.
51. S.F. Crone, J. Guajardo, R. Weber, A study on the ability of Support Vector Regression and Neural Networks to Forecast Basic Time Series Patterns.
52. S.F. Crone, S. Lessmann, S. Pietsch, An empirical Evaluation of Support Vector Regression versus Artificial Neural Networks to Forecast basic Time Series Patterns.
53. Granger C.W.J. Extracting information from mega-panels and high-frequency data. Statistica Neerlandica 1998, 52(3):258-272.
54. Hornik K., Stinchcombe M., White H. Multilayer feedforward networks are universal approximators. Neural Networks 1989, 2(5):359-366.
55. S.F. Crone, N. Kourentzes, Input variable selection for time series prediction with neural networks - an evaluation of visual, autocorrelation and spectral analysis for varying seasonality, pp. 195-205.
56. Heravi S., Osborn D.R., Birchenhall C.R. Linear versus neural network forecasts for European industrial production series. International Journal of Forecasting 2004, 20(3):435-446.
57. Adya M., Collopy F., Armstrong J.S., et al. Automatic identification of time series features for rule-based forecasting. International Journal of Forecasting 2001, 17(2):143-157.
58. Fildes R. The evaluation of extrapolative forecasting methods. International Journal of Forecasting 1992, 8(1):81-98.
59. Tashman L.J. Out-of-sample tests of forecasting accuracy: an analysis and review. International Journal of Forecasting 2000, 16(4):437-450.
60. Tashman L. Out-of-sample tests of forecasting accuracy: an analysis and review. International Journal of Forecasting 2000, 16:437-450.
61. Armstrong J.S., Collopy F. Error measures for generalizing about forecasting methods: empirical comparisons. International Journal of Forecasting 1992, 8(1):69-80.
62. Fildes R., Makridakis S. Forecasting and loss functions. International Journal of Forecasting 1988, 4(4):545-550.
63. Gardner E.S. Exponential smoothing: the state of the art - Part II. International Journal of Forecasting 2006, 22(4):637-666.