A fuzzy system constructed by rule generation and iterative linear svr for antecedent and consequent parameter optimization

IEEE Transactions on Fuzzy Systems

Volumn 20, Issue 2, 2012, Pages 372-384

  Juang, Chia Feng ^a   Hsieh, Cheng Da ^b  

^a NATIONAL CHUNG HSING UNIVERSITY   (Taiwan)

^b HSIUPING INSTITUTE OF TECHNOLOGY   (Taiwan)

Author keywords

Fuzzy modeling; fuzzy neural networks (FNNs); neural fuzzy systems (NFSs); series prediction; support vector regression (SVR); support vectors (SVs)

Indexed keywords

EMPIRICAL RISK MINIMIZATION; FREE PARAMETERS; FUZZY IF-THEN RULES; FUZZY MODELING; FUZZY REGRESSION MODELS; INPUT SPACE; K-MEANS CLUSTERING ALGORITHM; LINEAR COMBINATION COEFFICIENTS; NEURAL FUZZY SYSTEMS; PARAMETER LEARNING; PARAMETER OPTIMIZATION; RULE GENERATION; STRUCTURAL RISK MINIMIZATION; SUPPORT VECTOR; SUPPORT VECTOR REGRESSION (SVR); TAKAGI-SUGENO;

COST FUNCTIONS; FUZZY RULES; FUZZY SYSTEMS; LEARNING ALGORITHMS; REGRESSION ANALYSIS;

FUZZY NEURAL NETWORKS;

EID: 84859724131     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2011.2174997     Document Type: Article

References (40)

1. L. X. Wang, Adaptive Fuzzy Systems and Control: Design and Stability Analysis. Englewood Cliffs, NJ: Prentice-Hall, 1994.
2. B. M. Wilamowski, "Neural network architectures and learning algorithms," IEEE Ind. Electron. Mag., vol. 3, no. 4, pp. 56-63, Dec. 2009.
3. N. Jin and D. Liu, "Wavelet basis function neural networks for sequential learning," IEEE Trans. Neural Netw., vol. 19, no. 3, pp. 523-528, Mar. 2008. (Pubitemid 351411575)
4. E. E. Elattar, J. Goulermas, and Q. H.Wu, "Electric load forecasting based on locally weighted support vector regression," IEEE Trans. Syst., Man, Cyber. C, Appl. Rev., vol. 40, no. 4, pp. 438-447, Jul. 2010.
5. O. A. Omitaomu, M. K. Jeong, and A. B. Badiru, "Online support vector regression with varying parameters for time-dependent data," IEEE Trans. Syst., Man, Cyber. A, Syst. Humans, vol. 41, no. 1, pp. 191-197, Jan. 2011.
6. S. Crino andD. E. Brown, "Global optimizationwith multivariate adaptive regression splines," IEEE Trans. Syst., Man, Cyber. B, Cybern., vol. 37, no. 2, pp. 333-340, Apr. 2007. (Pubitemid 46523223)
7. C. J. Lu, T. S. Lee, and C.M. Lian, "Sales forecasting of IT products using a hybrid MARS and SVR model," in Proc. IEEE Int. Conf. Data Mining Workshops, 2010, pp. 593-599.
8. A. Chen and A. Hong, "Sample-efficient regression trees (SERT) for semiconductor yield loss analysis," IEEE Trans. Semicond. Manuf., vol. 23, no. 3, pp. 358-369, Aug. 2010.
9. B. Li, L. Duan, and L. Peng, "Efficient microarchitectural vulnerabilities prediction using boosted regression trees and patient rule inductions," IEEE Trans. Comput., vol. 59, no. 5, pp. 593-607, May 2010.
10. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Berlin, Germany: Springer, 2001, ch. 10.
11. C. F. Juang, I. F. Chung, and C. H. Hsu, "Automatic construction of feedforward/recurrent fuzzy systems by clustering-aided simplex particle swarm optimization," Fuzzy Sets Syst., vol. 158, no. 18, pp. 1979-1996, Sep. 2007.
12. C. F. Juang and C. T. Lin, "An on-line self-constructing neural fuzzy inference network and its applications," IEEE Trans. Fuzzy Syst., vol. 6, no. 1, pp. 12-32, Feb. 1998.
13. N. K. Kasabov and Q. Song, "DENFIS: Dynamic evolving neural-fuzzy inference system and its application for time-series prediction," IEEE Trans. Fuzzy Syst., vol. 10, no. 2, pp. 144-154, Apr. 2002. (Pubitemid 34554860)
14. C. F. Juang and Y. W. Tsao, "A self-evolving interval type-2 fuzzy neural network with on-line structure and parameter learning," IEEE Trans. Fuzzy Syst., vol. 16, no. 6, pp. 1411-1424, Dec. 2008.
15. D. Coyle, G. Prasad, and T. M. McGinnity, "Faster self-organizing fuzzy neural network training and a hyperparameter analysis for a braincomputer interface," IEEE Trans. Syst., Man, Cyber. B, Cybern., vol. 39, no. 6, pp. 1458-1471, Dec. 2009.
16. J. D. J. Rubio, "SOFMLS: Online self-organizing fuzzy modified least squares network," IEEE Trans. Fuzzy Syst., vol. 17, no. 6, pp. 1296-1309, Dec. 2009.
17. H. Song, C. Miao, W. Roel, Z. Shen, and F. Catthoor, "Implementation of fuzzy cognitive maps based on fuzzy neural network and application in prediction of time series," IEEE Trans. Fuzzy Syst., vol. 18, no. 2, pp. 233-250, Apr. 2010.
18. H. Han and J. Qiao, "A self-organizing fuzzy neural network based on a growing-and-pruning algorithm," IEEE Trans. Fuzzy Syst., vol. 18, no. 6, pp. 1129-1143, Dec. 2010.
19. C. F. Juang, T. C. Chen, andW.Y. Cheng, "Speedup of implementing fuzzy neural networks with high-dimensional inputs through parallel processing on graphic processing units," IEEE Trans. Fuzzy Syst., vol. 19, no. 4, pp. 717-728, Aug. 2011.
20. N. Cristianini and J. S.-Taylor, An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge, U.K: Cambridge Univ. Press, 2000.
21. B. Scholkopf and A. J. Smola, Learning with kernels: Support Vector Machines,Regularization, Optimization, and Beyond. Cambridge,MA: MIT Press, 2002.
22. C. C. Chuang, "Fuzzy weighted support vector regression with a fuzzy partition," IEEE Trans. Syst., Man, Cyber. B, Cybern., vol. 37, no. 3, pp. 630-640, Jun. 2007.
23. X. Li, B. Hu, and R. Du, "Predicting the parts weight in plastic injection molding using least squares support vector regression," IEEE Trans. Syst., Man, Cyber. C, Appl. Rev., vol. 38, no. 6, pp. 827-833, Nov. 2008.
24. J. H. Chiang and P. Y. Hao, "Support vector learning mechanism for fuzzy rule-based modeling: A new approach," IEEE Trans. Fuzzy Syst., vol. 12, no. 1, pp. 1-11, Jan. 2004.
25. J. M. Leski, "TSK-fuzzy modeling based on ε-insensitive learning," IEEE Trans. Fuzzy Syst., vol. 13, no. 2, pp. 181-193, Apr. 2005. (Pubitemid 40556000)
26. L.Wang, Z. C. Mu, and H. Guo, "Fuzzy rule-based support vector regression system," J. Control Theory Appl., vol. 3, no. 3, pp. 230-234, Aug. 2005.
27. C. T. Lin, S. F. Liang, C. M. Yeh, and K. W. Fan, "Fuzzy neural network design using support vector regression for function approximation with outliers," in Proc. IEEE Int. Conf. Syst.,Man, Cyber., Oct. 2005, pp. 2763-2768. (Pubitemid 41674806)
28. C. F. Juang and C. D Hsieh, "TS-fuzzy system-based support vector regression," Fuzzy Sets Syst., vol. 160, no. 17, pp. 2486-2504, Sep. 2009.
29. C. F. Juang and C. D. Hsieh, "A locally recurrent fuzzy neural network with support vector regression for dynamic system modeling," IEEE Trans. Fuzzy Syst., vol. 18, no. 2, pp. 261-273, Apr. 2010.
30. C. F. Juang, R. B. Huang, andW. Y. Cheng, "An interval type-2 fuzzy neural network with support vector regression for noisy regression problems," IEEE Trans. Fuzzy Syst., vol. 18, no. 4, pp. 686-699, Aug. 2010.
31. D. Kukolj and E. Levi, "Identification of complex systems based on neural and Takagi-Sugeno fuzzy model," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 1, pp. 272-282, Feb. 2004.
32. N. R. Pal and S. Saha, "Simultaneous structure identification and fuzzy rule generation for Takagi-Sugeno models," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 6, pp. 1626-1638, Dec. 2008.
33. C. C. Chang and C. J. Lin. (2006). LIBSVM: A Library for Support Vector Machines [Online]. Available: http://www.csie.ntu.edu.tw/∼cjlin/libsvm/ index.html
34. Y. Chen and J. Z. Wang, "Kernel machines and additive fuzzy systems: Classification and function approximation," in Proc. 12th IEEE Int. Conf. Fuzzy Syst., St. Louis, MO, 2003, vol. 2, pp. 789-795.
35. J. M. Mendel, "Computing derivatives in interval type-2 fuzzy logic system," IEEE Trans. Fuzzy Syst., vol. 12, no. 1, pp. 84-98, Feb. 2004.
36. C.J. Lin and C.T. Lin, "An ART-based fuzzy adaptive learning control network," IEEE Trans. Fuzzy Syst., vol. 5, no. 4, pp. 477-496, Nov. 1997.
37. A. S.Weigend and N. A. Gersehnfield, Time Series Prediction: Forecasting the Future and Understanding the Past. Reading, MA:Addison-Wesley, 1994.
38. S. Singh, "Noise impact on time-series forecasting using an intelligent pattern matching technique," Pattern Recognit., vol. 32, no. 8, pp. 1389-1398, Aug. 1999.
39. A. S. Weigend, B. A. Huberman, and D. E. Rumelhart, "Predicting the future:Aconnectionist approach," Int. J. Neural Syst., vol. 1, pp. 193-209, 1990.
40. V. Vapnik, The Nature of Statistical Leaning Theory. NewYork: Springer, 1995.