Automatic clustering-based identification of autoregressive fuzzy inference models for time series

Neurocomputing

Volumn 73, Issue 10-12, 2010, Pages 1937-1949

  Pouzols, Federico Montesino ^a   Barros, Angel Barriga ^b  

^a AALTO UNIVERSITY   (Finland)

^b UNIVERSITY OF SEVILLE   (Spain)

Author keywords

Clustering; Fuzzy clustering; Fuzzy inference; Supervised learning; Times series prediction

Indexed keywords

ACCURATE PREDICTION; APRIORI; AUTO-REGRESSIVE; AUTOMATIC CLUSTERING; AUTOMATIC IDENTIFICATION; CLUSTERING; CLUSTERING FOR FUNCTION APPROXIMATIONS; CLUSTERING METHODS; COMPUTATIONAL REQUIREMENTS; EXTREME LEARNING MACHINE; FUZZY INFERENCE MODEL; FUZZY INFERENCE SYSTEMS; FUZZY METHODS; LEAST SQUARES SUPPORT VECTOR MACHINES; MODEL SELECTION; MULTI LAYER PERCEPTRON; NON-PARAMETRIC; RBF NETWORK; RESIDUAL VARIANCE; TIMES SERIES;

APPROXIMATION ALGORITHMS; AUTOMATION; ELECTRONIC DATA INTERCHANGE; FORECASTING; FUZZY CLUSTERING; FUZZY INFERENCE; FUZZY SYSTEMS; MEMBERSHIP FUNCTIONS; RADIAL BASIS FUNCTION NETWORKS; SUPERVISED LEARNING; SUPPORT VECTOR MACHINES; TIME SERIES;

CLUSTERING ALGORITHMS;

ACCURACY; ARTICLE; ARTIFICIAL NEURAL NETWORK; FUZZY SYSTEM; IMPROVED CLUSTERING FOR FUNCTION APPROXIMATION ALGORITHM; INFORMATION PROCESSING; LEARNING ALGORITHM; MACHINE LEARNING; MATHEMATICAL ANALYSIS; METHODOLOGY; PERCEPTRON; PREDICTION; PRIORITY JOURNAL; PROCESS OPTIMIZATION; SUPPORT VECTOR MACHINE; VALIDATION PROCESS;

EID: 77952550094     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2009.11.028     Document Type: Article

References (52)

1. Abonyi J., Babuska R., Szeifert F. Modified Gath-Geva fuzzy clustering for identification of Takagi-Sugeno fuzzy models. IEEE Transactions on Systems, Man and Cybernetics, Part B 2002, 32(5):612-621.
2. Angelov P.P., Filev D.P. An approach to online identification of Takagi-Sugeno fuzzy models. IEEE Transactions on Systems, Man and Cybernetics-Part B: Cybernetics 2004, 34(1):484-498.
3. Battiti R. First and second order methods for learning: between steepest descent and Newton's method. Neural Computation 1992, 4(2):141-166.
4. I. Baturone, F.J. Moreno-Velo, A. Gersnoviez, A CAD approach to simplify fuzzy system descriptions, in: 15th IEEE International Conference on Fuzzy Systems (FUZZ-IEEE'06), 2006.
5. Bishop C.M. Neural Networks for Pattern Recognition 1996, Oxford University Press.
6. Box G., Jenkins G.M., Reinsel G. Time Series Analysis: Forecasting & Control 1994, Prentice Hall. third ed.
7. Chang Y.-H.O., Ayyub B.M. Fuzzy regression methods-a comparative assessment. Fuzzy Sets and Systems 2001, 119(2):187-203.
8. Chatfield C. The Analysis of Time Series. An Introduction 2003, CRC Press. sixth ed.
9. S.L. Chiu, A cluster estimation method with extension to fuzzy model identification, in: IEEE Conference on Fuzzy Systems, IEEE World Congress on Computational Intelligence, Orlando, FL, USA, 1994.
10. Advances in Fuzzy Clustering and its Applications 2007, John Wiley & Sons Ltd., West Sussex, England. J.V. de Oliveira, W. Pedrycz (Eds.).
11. E. Eirola, E. Liitiäinen, A. Lendasse, F. Corona, M. Verleysen, Using the delta test for variable selection, in: M. Verleysen (Ed.), ESANN 2008, European Symposium on Artificial Neural Networks, Bruges, Belgium, 2008.
12. ESTSP: European Symposium on Time Series Prediction (June 2009). http://www.estsp.org.
13. Gath I., Geva A.B. Unsupervised optimal fuzzy clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence 1989, 11(7):773-780.
14. González J., Rojas I., Pomares H., Ortega J., Prieto A. A new clustering technique for function approximation. IEEE Transactions on Neural Networks 2002, 13(1):132-142.
15. Guillén A., González J., Rojas I., Pomares H., Herrera L.J., Valenzuela O., Prieto A. Using fuzzy logic to improve a clustering technique for function approximation. Neurocomputing 2007, 70(16-18):2853-2860.
16. E.E. Gustafson, W.C. Kessel, Fuzzy clustering with a fuzzy covariance matrix, in: 17th Symposium on Adaptive Processes, 1978 IEEE Conference on Decision and Control, San Diego, CA, 1978.
17. Huang G.-B., Zhu Q.Y., Siew C.K. Extreme learning machine: theory and applications. Neurocomputing 2006, 70(1-3):489-501.
18. Jang J.-S.R., Sun C.-T., Mizutani E. Neuro-Fuzzy and Soft Computing A Computational Approach to Learning and Machine Intelligence 1997, Prentice Hall, Upper Saddle River, New Jersey.
19. Jones A.J. New tools in non-linear modelling and prediction. Computational Management Science 2004, 2(1):109-149.
20. Kasabov N.K., Song Q. DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction. IEEE Transactions on Fuzzy Systems 2002, 10(2):144-154.
21. A. Lendasse (Ed.), The second European Symposium on Time Series Prediction (ESTSP'08), 2008 (September 2008).
22. Lendasse A., Lee J., Wertz V., Verleyssen M. Forecasting electricity consumption using nonlinear projection and self-organizing maps. Neurocomputing 2002, 48(1):299-311.
23. Liitiäinen E., Lendasse A., Corona F. Bounds on the mean power-weighted nearest neighbour distance. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences 2008, 464(2097):2293-2301.
24. Liitiäinen E., Verleysen M., Corona F., Lendasse A. Residual variance estimation in machine learning. Neurocomputing 2009, 72(16-18):3692-3703.
25. Least Squares-Support Vector Machines Matlab/C Toolbox (April 2008). http://www.esat.kuleuven.ac.be/sista/lssvmlab.
26. Magoulas G.D., Vrahatis M.N., Androulakis G.S. Improving the convergence of the backpropagation algorithm using learning rate adaptation methods. Neural Computation 1999, 1769-1796.
27. Mendel J.M. Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions 2001, Prentice Hall PTR.
28. Y. Miche, A. Sorjamaa, A. Lendasse, OP-ELM: theory, experiments and a toolbox, in: 18th International Conference on Artificial Neural Networks (ICANN), Lecture Notes in Computer Science, vol. 5163, Prague, Czech Republic, 2008.
29. Mitra S., Hayashi Y. Neuro-fuzzy rule generation: survey in soft computing framework. IEEE Transactions on Neural Networks 2000, 11(3):748-768.
30. Møller M.F. A scaled conjugate gradient algorithm for fast supervised learning. Neural Networks 1993, 6(4):525-533.
31. F. Montesino-Pouzols, A. Barriga, Regressive fuzzy inference models with clustering identification: application to the ESTSP08 competition, in: The Second European Symposium on Time Series Prediction, Porvoo, Finland, 2008.
32. F. Montesino-Pouzols, A. Lendasse, A. Barriga, Autoregressive time series prediction by means of fuzzy inference systems using nonparametric residual variance estimation, Fuzzy Sets and Systems, in press.
33. F. Montesino-Pouzols, A. Lendasse, A. Barriga, Fuzzy inference based autoregressors for time series prediction using nonparametric residual variance estimation, in: 17th IEEE International Conference on Fuzzy Systems (FUZZ-IEEE'08), IEEE World Congress on Computational Intelligence, Hong Kong, China, 2008.
34. F. Montesino-Pouzols, A. Lendasse, A. Barriga, xftsp: a tool for time series prediction by means of fuzzy inference systems, in: Fourth IEEE International Conference on Intelligent Systems (IS'08), Varna, Bulgaria, 2008.
35. Moreno-Velo F.J., Baturone I., Barriga A., Sánchez-Solano S. Automatic tuning of complex fuzzy systems with Xfuzzy. Fuzzy Sets and Systems 2007, 158(18):2026-2038.
36. F.J. Moreno-Velo, I. Baturone, S. Sánchez-Solano, A. Barriga, Rapid design of fuzzy systems with Xfuzzy, in: 12th IEEE International Conference on Fuzzy Systems (FUZZ-IEEE'03), St. Louis, MO, USA, 2003.
37. Fuzzy Modeling and Control: Selected Works of M. Sugeno 1999, CRC Press Inc. H.T. Nguyen, N.R. Prasad (Eds.).
38. Pi H., Peterson C. Finding the embedding dimension and variable dependencies in time series. Neural Computation 1994, 6(3):509-520.
39. Riedmiller M. Advanced supervised learning in multi-layer perceptrons-from backpropagation to adaptive learning algorithms. Computer Standards and Interfaces 1994, 16(3):265-278.
40. Rojas I., Pomares H., Ortega J., Prieto A. Self-organized fuzzy system generation from training examples. IEEE Transactions on Fuzzy Systems 2000, 8(1):23-36.
41. Rong H.-J., Sundararajan N., Huang G.-B., Saratchandran P. Sequential adaptive fuzzy inference system for nonlinear system identification and prediction. Fuzzy Sets and Systems 2006, 157(9):1260-1275.
42. Rutkowski L. Flexible Neuro-Fuzzy Systems. Structures, Learning and Performance Evaluation 2004, Kluwer Academic Publishers, Boston, MA, USA.
43. Sorjamaa A., Hao J., Reyhani N., Ji Y., Lendasse A. Methodology for long-term prediction of time series. Neurocomputing 2007, 70(16-18):2861-2869.
44. A. Sorjamaa, Y. Miche, R. Weiss, A. Lendasse, Long-term prediction of time series using NNE-based projection and OP-ELM, in: 2008 International Joint Conference on Neural Networks (IJCNN 2008), IEEE World Congress on Computational Intelligence, Hong Kong, China, 2008.
45. Suykens J.A.K., Van Gestel T., De Brabanter J., De Moor B., Vandewalle J. Least Squares Support Vector Machines 2002, World Scientific, Singapore.
46. Takagi T., Sugeno M. Fuzzy identification of systems and its applications to modeling and control. IEEE Transactions on Systems, Man, and Cybernetics 1985, 15(1):116-132.
47. Time Series Datasets, Time Series Prediction and Chemoinformatics Group (November 2009). http://www.cis.hut.fi/projects/tsp.
48. R.A.M. Van der Linden, the SIDC Team, Online Catalogue of the Sunspot Index, RWC Belgium, World Data Center for the Sunspot Index, Royal Observatory of Belgium, years 1748-2007 (January 2008). http://sidc.oma.be/html/sunspot.html.
49. Wang L.X. The WM method completed: a flexible system approach to data mining. IEEE Transactions on Fuzzy Systems 2003, 11(6):768-782.
50. Weigend A., Gershenfeld N. Times Series Prediction: Forecasting the Future and Understanding the Past 1994, Addison-Wesley Publishing Company.
51. The Xfuzzy Development Environment: Fuzzy Logic Design Tools (June 2009). http://www.imse-cnm.csic.es/Xfuzzy.
52. Ying H. Sufficient conditions on uniform approximation of multivariate functions by general Takagi-Sugeno fuzzy systems with linear rule consequent. IEEE Transactions on Systems, Man, and Cybernetics Part A: Systems and Humans 1998, 28(4):515-520.