A weighted LS-SVM based learning system for time series forecasting

Information Sciences

Volumn 299, Issue , 2015, Pages 99-116

  Chen, Thao Tsen ^a   Lee, Shie Jue ^a  

^a NATIONAL SUN YAT SEN UNIVERSITY   (Taiwan)

Author keywords

Multi step forecasting; Mutual information; Nearest neighbor; Support vector machine; Time series forecasting

Indexed keywords

ARTIFICIAL INTELLIGENCE; DECISION MAKING; LEARNING SYSTEMS; NEAREST NEIGHBOR SEARCH; SUPPORT VECTOR MACHINES; TIME SERIES;

FORECASTING MODELING; MACHINE LEARNING TECHNIQUES; MULTI-STEP FORECASTING; MUTUAL INFORMATIONS; NEAREST NEIGHBORS; STATISTICAL APPROACH; TIME SERIES FORECASTING; WEIGHTED LEAST SQUARES;

FORECASTING;

EID: 84961292151     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2014.12.031     Document Type: Article

References (72)

1. M. Abdollahzade, A. Miranian, H. Hassani, and H. Iranmanesh A new hybrid enhanced local linear neuro-fuzzy model based on the optimized singular spectrum analysis and its application for nonlinear and chaotic time series forecasting Inform. Sci. 295 2015 107 125
2. R. Adhikari, and R.K. Agrawal A homogeneous ensemble of artificial neural networks for time series forecasting Int. J. Comput. Appl. 32 7 2011 1 8
3. D.W. Aha, D. Kibler, and M.K. Albert Instance-based learning algorithms Mach. Learn. 6 1 1991 37 66
4. S.K. Bag ANN based prediction of blast furnace parameters Inst. Eng. 68 1 2007 37 42
5. Y. Bao, T. Xiong, and Z. Hu PSO-MISMO modeling strategy for multistep-ahead time series prediction IEEE Trans. Cybernet. 44 5 2014 655 668
6. G.E.P. Box, G.M. Jenkins, and G.C. Reinsel Time Series Analysis: Forecasting And Control 2008 Wiley
7. M. Božić, M. Stojanović, Z. Stajić, and N. Floranović Mutual information-based inputs selection for electric load time series forecasting Entropy 15 2013 926 942
8. B.-J. Chen, M.-W. Chang, and C.-J. Lin Load forecasting using support vector machines: a study on EUNITE competition 2001 IEEE Trans. Power Syst. 19 4 2004 1821 1830
9. S.-M. Chen TAIEX forecasting based on fuzzy time series and fuzzy variation groups IEEE Trans. Fuzzy Syst. 19 1 2011 1 12
10. S.-M. Chen, and Y.-C. Chang Multi-variable fuzzy forecasting based on fuzzy clustering and fuzzy rule interpolation techniques Inform. Sci. 180 24 2010 4772 4783
11. S.-M. Chen, H.-P. Chu, and T.-W. Sheu TAIEX forecasting using fuzzy time series and automatically generated weighted of multiple factors IEEE Trans. Syst. Man Cybernet. Part A 42 6 2012 1485 1495
12. S.-M. Chen, G.M.T. Manalu, J.-S. Pan, and H.-C. Liu Fuzzy forecasting based on two-factors second-order fuzzy-trend logical relationship groups and particle swarm optimization techniques IEEE Trans. Cybernet. 43 3 2013 1102 1117
13. Y. Chen, B. Yang, and J. Dong Time-series prediction using a local linear wavelet neural network Neurocomputing 69 4-6 2006 449 465
14. S.F. Crone, and N. Kourentzes Feature selection for time series prediction - a combined filter and wrapper approach for neural networks Neurocomputing 73 10-12 2010 1923 1936
15. Dow Jones Web Site. < http://www.djindexes.com/ >.
16. EUNITE Data Set. < http://neuron.tuke.sk/competition/index.php >.
17. V.H. Ferreira, and A.P. Alves da Silva Toward estimating autonomous neural network-based electric load forecasters IEEE Trans. Power Syst. 22 4 2007 1554 1562
18. B. Gas Self-organizing multi-layer perceptron IEEE Trans. Neural Netw. 21 11 2010 1766 1779
19. F. Gaxiola, P. Melin, F. Valdez, and O. Castillo Interval type-2 fuzzy weight adjustment for backpropagation neural networks with application in time series prediction Inform. Sci. 260 2014 1 14
20. M. Ghiassi, and H. Saidane A dynamic architecture for artificial neural networks Neurocomputing 63 2005 397 413
21. J. G De Gooijer, and R.J. Hyndman 25 years of time series forecasting Int. J. Forecast. 22 3 2006 443 473
22. J.A. Guajardo, R. Weber, and J. Miranda A model updating strategy for predicting time series with seasonal patterns Appl. Soft Comput. 10 1 2010 276 283
23. E. Guresen, G. Kayakutlu, and T.U. Daim Using artificial neural network models in stock market index prediction Expert Syst. Appl. 38 8 2011 10389 10397
24. M.T. Hagan, H.B. Demuth, and M.H. Beale Neural Network Design 1995 PWS Pub. Co.
25. J. Han, M. Kamber, and J. Pei Data Mining: Concepts and Techniques 2011 Morgan Kaufmann
26. T. Hastie, R. Tibshirani, and J. Friedman The Elements of Statistical Learning 2008 Springer New York
27. H.S. Hippert, D.W. Bunn, and R.C. Souza Large neural networks for electricity load forecasting: are they overfitted? Int. J. Forecast. 21 3 2005 425 434
28. Z. Huang, M.-L. Shyu, k-NN based LS-SVM framework for long-term time series prediction, in: 2010 IEEE International Conference on Information Reuse and Integration, 2010, pp. 69-74.
29. Z. Huang, and M.-L. Shyu Recent trends in information reuse and integration Long-term Time Series Prediction using k-NN based LS-SVM Framework with Multi-value Integration 2012 Springer Vienna 191 209 (Chapter 9)
30. K.-C. Hung, and K.-P. Lin Long-term business cycle forecasting through a potential intuitionistic fuzzy least-squares support vector regression approach Inform. Sci. 224 2013 37 48
31. J.-S.R. Jang, Fuzzy modeling using generalized neural networks and Kalman filter algorithm, in: Proceedings of the Ninth National Conference on Artificial Intelligence (AAAI-91), 1991, pp. 762-767.
32. J.-S.R. Jang ANFIS: adaptive-network based fuzzy inference systems IEEE Trans. Syst. Man Cybernet. 23 3 1993 665 685
33. Z. Ji, B. Wang, S. Deng, and Z. You Predicting dynamic deformation of retaining structure by LSSVR-based time series method Neurocomputing 137 2014 165 172
34. N. Kaneko, S. Matsuzaki, M. Ito, H. Oogai, and K. Uchida Application of improved local models of large scale database-based online modeling to prediction of molten iron temperature of blast furnace ISIJ Int. 50 7 2010 939 945
35. H. Kantz Nonlinear Time Series Analysis 2003 Cambridge University Press
36. M. Khashei, and M. Bijari An artificial neural network (p, d, q) model for time series forecasting Expert Syst. Appl. 37 1 2010 479 489
37. M. Khashei, and M. Bijari Which methodology is better for combining linear and nonlinear models for time series forecasting? J. Ind. Syst. Eng. 4 4 2011 265 285
38. A. Kraskov, H. Stgbauer, and P. Grassberger Estimating mutual information Phys. Rev. E 69 6 2004 066138
39. A. Kusiak, H. Zheng, and Z. Song Short-term prediction of wind farm power: a data mining approach IEEE Trans. Energy Convers. 24 1 2009 125 136
40. Laser Time Series Data Set. < http://www-psych.stanford.edu/andreas/Time-Series/SantaFe.html >.
41. S.-J. Lee, and C.-S. Ouyang A neuro-fuzzy system modeling with self-constructing rule generation and hybrid SVD-based learning IEEE Trans. Fuzzy Syst. 11 3 2003 341 353
42. W. Li Mutual information functions versus correlation functions J. Stat. Phys. 60 5-6 1990 823 837
43. C.-F. Liu, C.-Y. Yeh, and S.-J. Lee Application of type-2 neuro-fuzzy modeling in stock price prediction Appl. Soft Comput. 12 4 2012 1348 1358
44. LS-SVM Program. < http://www.esat.kuleuven.be/sista/lssvmlab/ >.
45. J. McNames A nearest trajectory strategy for time series prediction Proceedings of the International Workshop on Advanced Black-Box Techniques for Nonlinear Modeling 1998 K.U. Leuven Belgium 112 128
46. J. McNames, B. Widrow, J.H. Friedman, J.P. How, Innovations in Local Modeling for Time Series Prediction, 1999. < http://web.cecs.pdx.edu/mcnames/Publications/Dissertation.pdf >.
47. A. Miranian, and M. Abdollahzade Developing a local least-squares support vector machines-based neuro-fuzzy model for nonlinear and chaotic time series prediction IEEE Trans. Neural Netw. Learn. Syst. 24 2 2013 207 218
48. NASDAQ Web Site. < http://www.nasdaq.com/ >.
49. M. Negnevitsky Artificial Intelligence: A Guide to Intelligent Systems 2004 Addison-Wesley
50. C.-S. Ouyang, W.-J. Lee, and S.-J. Lee A TSK-type neuro-fuzzy network approach to system modeling problems IEEE Trans. Syst. Man Cybernet. - Part B: Cybernet. 35 4 2005 751 767
51. Poland Data Set. < http://research.ics.aalto.fi/eiml/datasets.shtml >.
52. N.I. Sapankevych, and R. Sankar Time series prediction using support vector machines: a survey IEEE Comput. Intell. Mag. 4 2 2009 24 38
53. A. Sfetsos, and C. Siriopoulos Time series forecasting with a hybrid clustering scheme and pattern recognition IEEE Trans. Syst. Man Cybernet. Part A 34 3 2004 399 405
54. G. Silviu Information Theory with Applications 1977 McGraw-Hill
55. O. Song, and B.S. Chissom Fuzzy time series and its models Fuzzy Sets Syst. 54 3 1993 269 277
56. O. Song, and B.S. Chissom Forecasting enrollments with fuzzy time series - Part I Fuzzy Sets Syst. 54 1 1993 1 9
57. O. Song, and B.S. Chissom Forecasting enrollments with fuzzy time series - Part II Fuzzy Sets Syst. 62 1 1994 1 8
58. A. Sorjamaa, J. Hao, and A. Lendasse Mutual information and k-nearest neighbors approximator for time series prediction Lect. Notes Comput. Sci. 3657 2005 553 558
59. A. Sorjamaa, J. Hao, N. Reyhani, Y. Ji, and A. Lendasse Methodology for long-term prediction of time series Neurocomputing 70 16-18 2007 2861 2869
60. J.H. Stock, and M.W. Watson Introduction to Econometrics 2010 Addison-Wesley
61. H. Stogbauer, A. Kraskov, S.A. Astakhov, and P. Grassberger Least-dependent-component analysis based on mutual information Phys. Rev. E 70 2004 066123
62. M.B. Stojanović, M.M. Božić, M.M. Stanković, and Z.P. Stajić A methodology for training set instance selection using mutual information in time series prediction Neurocomputing 141 2014 236 245
63. Sunspot Data Set. < http://sidc.oma.be/sunspot-data/ >.
64. J.A.K. Suykens, J. De Brabanter, L. Lukas, and J. Vandewalle Weighted least squares support vector machines: robustness and sparse approximation Neurocomputing 48 1-4 2002 85 105
65. J.A.K. Suykens, T.V. Gestel, J.D. Brabanter, B.D. Moor, and J. Vandewalle Least Squares Support Vector Machines 2002 World Scientific Publishing Company
66. TAIEX Web Site. < http://www.tese.com.tw/en/products/indices/tsec/taiex.php >.
67. F.E.H. Tay, and L.J. Cao Modified support vector machines in financial time series forecasting Int. J. Forecast. 48 1 2002 69 84
68. S.S. Torbaghan, A. Motamedi, H. Zareipour, L.A. Tuan, Mediumterm electricity price forecasting, in: North American Power Symposium (NAPS) 2012, 2012, pp. 1-8.
69. W.W.S. Wei Time Series Analysis: Univariate and Multivariate Methods 2005 Pearson
70. G.P. Zhang Time series forecasting using a hybrid ARIMA and neural network model Neurocomputing 50 2003 159 175
71. L. Zhang, W.-D. Zhou, P.-C. Chang, J.-W. Yang, and F.-Z. Li Iterated time series prediction with multiple support vector regression models Neurocomputing 99 2013 411 422
72. H. Zou, and Y. Yang Combining time series models for forecasting Int. J. Forecast. 20 1 2004 69 84