Design of specific-to-problem kernels and use of kernel weighted K-nearest neighbours for time series modelling

Neurocomputing

Volumn 73, Issue 10-12, 2010, Pages 1965-1975

  Rubio, Gins ^a   Herrera, Luis Javier ^a   Pomares, Héctor ^a   Rojas, Ignacio ^a   Guillén, Alberto ^a  

^a UNIVERSITY OF GRANADA   (Spain)

Author keywords

Kernel methods; Kernel weighted K Nearest Neighbours; Least squares support vector machines; Parallelization of kernel methods; Specific to problem kernels; Time series modelling

Indexed keywords

K-NEAREST NEIGHBOURS; KERNEL METHODS; LEAST SQUARES SUPPORT VECTOR MACHINES; PARALLELIZATIONS; PROBLEM KERNEL;

FEATURE EXTRACTION; FORECASTING; SUPPORT VECTOR MACHINES;

TIME SERIES;

ARTICLE; ARTIFICIAL NEURAL NETWORK; BEHAVIOR; COMPUTER INPUT DEVICE; COMPUTER PROGRAM; COST; ELECTRICAL CONDUCTIVITY PARAMETERS; K NEAREST NEIGHBOR; KERNEL METHOD; KERNEL WEIGHTED K NEAREST NEIGHBOR; LEAST SQUARE SUPPORT VECTOR MACHINE; MATHEMATICAL ANALYSIS; PERIODICITY; PREDICTION; PRIORITY JOURNAL; REGRESSION ANALYSIS; TIME SERIES ANALYSIS; TRAINING;

EID: 77952547396     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2009.11.029     Document Type: Article

References (30)

1. Ahdesmäki M., Lähdesmäki H., Pearson R.K., Huttunen H., Yli-Harja O. Robust detection of periodic time series measured from biological systems. BMC Bioinformatics 2005, 6:117.
2. Brahim-Belhouari S., Bermak A. Gaussian process for nonstationary time series prediction. Computational Statistics & Data Analysis 2004, 47(4):705-712. available at 〈http://ideas.repec.org/a/eee/csdana/v47y2004i4p705-712.html〉.
3. Brailovsky V.L., Barzilay O., Shahave R. On global, local, mixed and neighborhood kernels for support vector machines. Pattern Recognition Letters 1999, 20(11-13):1183-1190.
4. Brown M.P., Grundy W.N., Lin D., Cristianini N., Sugnet C.W., Fuery T.S., Ares M., Haussler D. Knowledge-based analysis of microarray gene expression data using support vector machines. Proceedings National Academy of Sciences of the United States of America 2000, 97:262-267.
5. N. Kourentzes, S.F. Crone, Automatic modelling of neural networks for time series prediction-in search of a uniform methodology across varying time frequencies, in: ESTSP'08: Proceedings of the European Symposium on Time Series Prediction, 2008, pp. 117-127.
6. Dasarathy B.V. Nearest Neighbor (NN) Norms: NN Pattern Classification Techniques 1990, IEEE Computer Society Press, Los Alamitos.
7. Dutilleul P. Multi-frequential periodogram analysis and the detection of periodic components in time series. Communications in Statistics-Theory and Methods 2001, 30:1063-1098.
8. Peter Graf H., Cosatto E., Bottou L., Durdanovic I., Vapnik V. Parallel support vector machines: the cascade svm. In Advances in Neural Information Processing Systems 2005, 521-528. MIT Press, Cambridge, USA.
9. A. Guillen, I. Rojas, G. Rubio, H. Pomares, L.J. Herrera, J. Gonzalez, A new interface for mpi in matlab and its application over a genetic algorithm, in: Proceedings of the European Symposium on Time Series Prediction, 2008.
10. Herrera L.J., Pomares H., Rojas I., Guillén A., Prieto A., Valenzuela O. Recursive prediction for long term time series forecasting using advanced models. Neurocomputing 2007, 70(16-18):2870-2880.
11. L.J. Herrera, H. Pomares, I. Rojas, A. Guillén, G. Rubio, On incorporating seasonal information on recursive time series predictors, in: Proceedings of ICANN: International Conference on Artificial Neural Networks (2), 2007, pp. 506-515.
12. T. Joachims, Text categorization with support vector machines: Learning with many relevant features. Technical Report 23, LS VIII, University of Dortmund, 1997.
13. A.J. Keane, A. Choudhury, P.B. Nair, A data parallel approach for large-scale gaussian process modeling, in: Proceedings of the Second SIAM International Conference on Data Mining, 2002.
14. A. Lendasse, F. Corona, J. Hao, N. Reyhani, M. Verleysen, Determination of the mahalanobis matrix using nonparametric noise estimations, in: Proceedings of ESANN: European Symposium on Artificial Neural Networks, 2006, pp. 227-232.
15. A.T. Lora, J.R. Santos, A comparison of two techniques for next-day electricity price forecasting, in: Third International Conference on Intelligent Data Engineering and Automated Learning, Lecture Notes in Computer Science, vol. 2412, Springer, Berlin, 2002, pp. 384-390.
16. MacKay D.J.C. Introduction to Gaussian processes. Neural Networks and Machine Learning 1998, 133-166. Kluwer Academic Publishers B.V., Dordrecht, The Netherlands, NATO ASI Series. C.M. Bishop (Ed.).
17. Mladenović N., Hansen P. Variable neighborhood search. Computers and Operations Research 1997, 24:1097-1100.
18. K.-R. Müller, A.J. Smola, G. Rätsch, B. Schölkopf, J. Kohlmorgen, V. Vapnik, Using support vector machines for time series prediction, 2000.
19. Pearson W.R., Wood T., Zhang Z., Miller W. Comparison of dna sequences with protein sequences. Genomics 1997, 46(1):24-36.
20. Rasmussen C.E., Williams C.K.I. Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning) 2005, The MIT Press, Cambridge, USA.
21. G. Rubio, A. Guillen, L.J. Herrera, H. Pomares, I. Rojas, Use of specific-to-problem kernel functions for time series modeling, in: ESTSP'08: Proceedings of the European Symposium on Time Series Prediction, 2008, pp. 177-186.
22. Rubio G., Pomares H., Rojas I., Guillén A. Creation of specific-to-problem kernel functions for function approximation. IWANN '09: Proceedings of the 10th International Work-Conference on Artificial Neural Networks 2009, 335-342. Springer-Verlag, Berlin, Heidelberg.
23. Schölkopf B., Simard P., Smola A., Vapnik V. Prior knowledge in support vector kernels. Advances in Neural Information Processing Systems 1998, 640-646. MIT Press, Cambridge, MA. M. Jordan, M. Kearns, S. Solla (Eds.).
24. Schölkopf B., Smola A.J. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond 2001, MIT Press, Cambridge, MA, USA.
25. K. Sim, Context kernels for text categorization, Master's thesis, Australian National University, 2001.
26. Sorjamaa A., Hao J., Lendasse A. Mutual information and K-nearest neighbors approximator for time series prediction. Lecture Notes in Computer Science 2005, 3697:553-558.
27. Suykens J.A.K., Van Gestel T., De Brabanter J., De Moor B., Vandewalle J. Least Squares Support Vector Machines 2002, World Scientific Publishing, Singapore.
28. Thiessen U., van Brakel R. Using support vector machines for time series prediction. Chemometrics and Intelligent Laboratory Systems 2003, 69:35-49.
29. Van Gestel T., Suykens J.A.K., Baestaens D.-E., Lambrechts A., Lanckriet G., Vandaele B., De Moor B., Vandewalle J. Financial time series prediction using least squares support vector machines within the evidence framework. Neural Networks, IEEE Transactions on 2001, 12(4):809-821.
30. M. Vlachos, P.S. Yu, V. Castelli, On periodicity detection and structural periodic similarity, in: Proceedings of SDM: SIAM International Conference on Data Mining, 2005.