Robust Neurofuzzy Rule Base Knowledge Extraction and Estimation Using Subspace Decomposition Combined with Regularization and D-Optimality

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 34, Issue 1, 2004, Pages 598-608

  Hong, Xia ^a   Harris, Chris J ^b   Chen, Sheng ^b  

^a UNIVERSITY OF READING   (United Kingdom)

^b UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Neurofuzzy networks; Optimal experimental design; Orthogonal decomposition; Regularization; Subspace

Indexed keywords

ALGORITHMS; FUZZY CONTROL; INFORMATION RETRIEVAL; KNOWLEDGE ACQUISITION; LEAST SQUARES APPROXIMATIONS; LINEAR SYSTEMS; MATRIX ALGEBRA; NEURAL NETWORKS; PARAMETER ESTIMATION; REGRESSION ANALYSIS;

NEUROFUZZY NETWORKS; OPTIMAL EXPERIMENTAL DESIGN; ORTHOGONAL DECOMPOSITION; REGULARIZATION; SUBSPACE;

KNOWLEDGE BASED SYSTEMS;

EID: 0742290017     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2003.817089     Document Type: Article

References (27)

1. C. J. Harris, X. Hong, and Q. Gan, Adaptive Modeling, Estimation and Fusion From Data: A Neurofuzzy Approach. Berlin, Germany: Springer-Verlag, 2002.
2. M. Brown and C. J. Harris, Neurofuzzy Adaptive Modeling and Control, Kernel Hempstead, U.K.: Prentice-Hall, 1994.
3. K. M. Bossley, "Neurofuzzy Modeling Approaches in System Identification," Ph.D. thesis, Dept. ECS, Univ. Southampton, U.K., 1997.
4. R. Murray-Smith and T. A. Johansen, Multiple Model Approaches to Modeling and Control. London, U.K.: Taylor and Francis, 1997.
5. T. Takagi and M. Sugeno, "Fuzzy identification of systems and its applications to modeling and control," IEEE Trans. Syst., Man, Cybern., vol. SMC-15, pp. 116-132, 1985.
6. M. Feng and C. J. Harris, "Adaptive neurofuzzy control for a class of state-dependent nonlinear processes," Int. J. Syst. Sci., vol. 29, no. 7, pp. 759-771, 1998.
7. H. Wang, M. Brown, and C. J. Harris, "Modeling and control of nonlinear, operating point dependent systems via associative memory networks," J. Dynam. Contr., vol. 6, pp. 199-218, 1996.
8. R. Bellman, Adaptive Control Processes. Princeton, NJ: Princeton Univ. Press, 1966.
9. J. S. R. Jang, C. T. Sun, and E. Mizutani, Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. Upper Saddle River, NJ: Prentice-Hall, 1997.
10. S. Chen, S. A. Billings, and W. Luo, "Orthogonal least squares methods and their applications to nonlinear system identification," Int. J. Contr., vol. 50, pp. 1873-1896, 1989.
11. S. Chen, Y. Wu, and B. L. Luk, "Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks," IEEE Trans. on Neural Networks, vol. 10, pp. 1239-1243, 1999.
12. M. J. L. Orr, "Regularization in the selection of radial basis function centers," Neural Comput., vol. 7, no. 3, pp. 954-975, 1995.
13. H. Akaike, "A new look at the statistical model identification," IEEE Trans. Automat. Contr., vol. AC-19, pp. 716-723, 1974.
14. A. C. Atkinson and A. N. Donev, Optimum Experimental Designs. Oxford, U.K.: Clarendon, 1992.
15. X. Hong and C. J. Harris, "Nonlinear model structure detection using optimum experimental design and orthogonal least squares," IEEE Trans. Neural Networks, vol. 12, pp. 435-439, Mar. 2001.
16. _, "Nonlinear model structure design and construction using orthogonal least squares and d-optimality design," IEEE Trans. Neural Networks, vol. 13, pp. 1245-1250, Sept. 2001.
17. S. Chen, "Local regularization assisted orthogonal least squares regression," Int. J. Contr., 2003, submitted for publication.
18. S. Chen, X. Hong, and C. J. Harris, "Sparse kernel regression modeling using combined locally regularised orthogonal least squares and d-optimality experimental design," IEEE Trans. Automat. Contr., 2003, to be published.
19. T. Taniguchi, K. Tanaka, H. Ohtake, and H. O. Wang, "Model construction, rule reduction and rubust compensation for generalized form of Takagi-Sugeno fuzzy systems," IEEE Trans. Fuzzy Syst., vol. 9, pp. 525-538, Dec. 2001.
20. Y. Jin, "Fuzzy modeling of high dimensional systems: complexity reduction and interpretability improvement," IEEE Trans. Fuzzy Syst., vol. 8, pp. 212-221, June 2000.
21. H. Roubos and M. Setnes, "Compact and transparent fuzzy models and classifiers through iterative complexity reduction," IEEE Trans. Fuzzy Syst., vol. 9, pp. 516-524, Dec. 2001.
22. X. Hong and C. J. Harris, "A neurofuzzy network knowledge extraction and extended Gram-Schmidt algorithm for model subspace decomposition," IEEE Trans. Fuzzy Syst., to be published.
23. P. Dierckx, Curve and Surface Fitting With Splines. Oxford, U.K.: Clarendon, 1995.
24. S. R. Gunn, M. Brown, and K. Bossley, "Network performance assessment for neurofuzzy data modeling," Intell. Data Anal., pp. 313-323, 1997.
25. K. W. Gruenberg and A. J. Weir, Linear Geometry. New York: Van Nostrand, 1967.
26. T. Soderström and P. Stoica, System Identification. Englewood Cliffs, NJ: Prentice-Hall, 1989.
27. D. W. Marquardt, "Generalized inverse, ridge regression, biased linear estimation and nonlinear estimation," Technometrics, vol. 12, no. 3, pp. 591-612, 1970.