A novel locally regularized automatic construction method for RBF neural models

Neurocomputing

Volumn 98, Issue , 2012, Pages 4-11

  Du, Dajun ^a   Li, Xue ^a   Fei, Minrui ^a   Irwin, George W ^b  

^a SHANGHAI UNIVERSITY   (China)

^b QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

Author keywords

Center selection; Leave one out (LOO) cross validation; Linear in the parameters model; Radial basis function (RBF) neural networks; Regularization

Indexed keywords

ALTERNATIVE APPROACH; AUTOMATIC CONSTRUCTION; AUTOMATIC CONSTRUCTION METHODS; CENTER SELECTION; CROSS VALIDATION; ERROR CRITERION; FAST RECURSIVE ALGORITHMS; LEAVE-ONE-OUT; MODEL PARAMETERS; NETWORK CONSTRUCTION; NETWORK SIZE; NEURAL MODELS; ORIGINAL MODEL; ORTHOGONAL LEAST SQUARES; RADIAL BASIS FUNCTION NEURAL NETWORKS; RADIAL BASIS FUNCTIONS; REGULARIZATION; TERMINATION CRITERIA;

ITERATIVE METHODS; NONLINEAR DYNAMICAL SYSTEMS;

RADIAL BASIS FUNCTION NETWORKS;

ALGORITHM; ANALYTICAL PARAMETERS; ARTICLE; AUTOMATION; COMPUTER ANALYSIS; CONTROLLED STUDY; ERROR; INTERMETHOD COMPARISON; MATHEMATICAL MODEL; MEAN SQUARE ERROR; ORTHOGONAL LEAST SQUARE; PRIORITY JOURNAL; RADIAL BASED FUNCTION; VALIDATION STUDY;

EID: 84867197544     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2011.05.045     Document Type: Article

References (36)

1. Montazer G.A., Sabzevari R., Ghorbani F. Three-phase strategy for the OSD learning method in RBF neural networks. Neurocomputing 2009, 72:1797-1802.
2. Zhang R., Huang G.-B., Sundararajan N., Saratchandran P. Improved GAP-RBF network for classification problems. Neurocomputing 2007, 70:3011-3018.
3. Li Y., Sundararaian N., Saratchandran P. Neuro-controller design for nonlinear fighter aircraft maneuver using fully tuned RBF networks. Automatica 2001, 37:1293-1301.
4. Seshagiri S., Khalil H.K. Output feedback control of nonlinear systems using RBF neural networks. IEEE Trans. Neural Networks 2000, 11:69-79.
5. Zhu Q.M., Billings S.A. Fast orthogonal identification of nonlinear stochastic models and radial basis function neural networks. Int. J. Control 1996, 64:871-886.
6. Elanayar V.T.S., Shin Y.C. Radial basis function neural network for approximation and estimation of nonlinear stochastic dynamic systems. IEEE Trans. Neural Networks 1994, 5:594-603.
7. Xu L., Krzyzak A., Yuille A. On radial basis function nets and kernel regression: statistical consistency, convergence rates, and receptive field size. Neural Networks 1994, 7(4):609-628.
8. Pedrycz W. Conditional fuzzy clustering in the design of radial basis function neural networks. IEEE Trans. Neural Networks 1998, 9:601-612.
9. Huang G.-B., Chen L., Siew C.-K. Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans. Neural Networks 2006, 17(4):879-892.
10. Huang G.-B., Chen L. Convex incremental extreme learning machine. Neurocomputing 2007, 70:3056-3062.
11. Huang G.-B., Chen L. Enhanced random search based incremental extreme learning machine. Neurocomputing 2008, 71:3460-3468.
12. Huang G.-B., Saratchandran P., Sundararajan N. An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks. Cybern. B: Cybern. 2004, 34(6):2284-2292.
13. Huang G.-B., Saratchandran P., Sundararajan N. A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation. IEEE Trans. Neural Networks 2005, 16(1):57-67.
14. Barry Gomm J., Yu D. Selecting radial basis function network centres with recursive orthogonal least squares training. IEEE Trans. Neural Networks 2000, 11(2):306-314.
15. Chen S., Billings S.A., Luo W. Orthogonal least squares methods and their application to nonlinear system identification. Int. J. Control 1989, 50(5):1873-1896.
16. Chen S., Hong X., Harris C.J., Wang X.X. Identification of nonlinear systems using generalized kernel models. IEEE Trans. Control Syst. Technol. 2005, 13(3):401-411.
17. Chen S., Hong X., Luk B.L., Harris C.J. Construction of tunable radial basis function networks using orthogonal forward selection. IEEE Trans. Syst. Man Cybern. B: Cybern. 2009, 39(2):457-466.
18. Li K., Peng J., Irwin G.W. A fast nonlinear model identification method. IEEE Trans. Autom. Control 2005, 50(8):1211-1216.
19. Peng J., Li K., Irwin G.W. A novel continuous forward algorithm for RBF neural modelling. IEEE Trans. Autom. Control 2007, 52(1):117-122.
20. Poggio T., Torre V., Koch C. Computational vision and regularization theory. Nature 1985, 317:314-319.
21. Hoerl A.E., Kennard R.W. Ridge regression: biased estimation for nonorthogonal problems. Technometrics 1970, 12(1):55-67.
22. Chen S. Local regularization assisted orthogonal least squares regression. Neurocomputing 2006, 69(4-6):559-585.
23. Akaike H. A new look at the statistical model identification. IEEE Trans. Autom. Control 1974, 19(6):716-723.
24. Hong X., Sharkey P.M., Warwick K. Automatic nonlinear predictive model-construction algorithm using forward regression and the PRESS static. IEE Proc. Control Theory Appl. 2003, 150(3):245-254.
25. Hong X., Mitchell R.J. Backward elimination model construction for regression and classification using leave one out criteria. Int. J. Syst. Sci. 2007, 38(2):101-113.
26. Hong X., Chen S., Harris C.J. A fast linear-in-the-parameters classifier construction algorithm using orthogonal forward selection to minimize leave-one-out misclassification rate. Int. J. Syst. Sci. 2008, 39(2):119-125.
27. Stone M. Cross validatory choice and assessment of statistical predictions. J. R. Stat. Soc. 1974, 36(1):117-147.
28. Chen S., Hong X., Harris C.J., Sharkey P.M. Sparse modelling using orthogonal forward regression with PRESS statistic and regularization. IEEE Trans. Syst. Man Cybern. B: Cybern. 2004, 34(2):898-911.
29. Cawley G.C., Talbot N.L.C. Fast exact leave-one-out cross-validation of sparse least-squares support vector machines. Neural Networks 2004, 17:1467-1475.
30. Li K., Peng J., Bai E-W. A two-stage algorithm for identification of nonlinear dynamic systems. Automatica 2006, 42(7):1189-1197.
31. Hong X., Mitchell R.J., Chen S., Harris C.J., Li K., Irwin G.W. Model selection approaches for non-linear system identification: a review. Int. J. Syst. Sci. 2008, 39(10):925-946.
32. R.H. Myers. Classical and Modern Regression with Applications, PWS-KENT, Boston, 1990.
33. Tipping M.T. Sparse Bayesian learning and the relevance vector machine. J. Mach. Learn. Res. 2001, 1:211-244.
34. MacKay D.J.C. Neural Comput. 1992, 4(3):415-447. Bayesian Interpolation.
35. Narendra K.S., Parthasarathy K. Identification and control of dynamical systems using neural networks. IEEE Trans. Neural Networks 1990, 1(1):4-27.
36. Peng H., Ozaki T., Haggan-Ozaki V., Toyoda Y. A parameter optimization method for radial basis function type models. IEEE Trans. Neural Networks 2003, 14(2):432-438.