Two-stage mixed discrete-continuous identification of radial basis function (RBF) neural models for nonlinear systems

IEEE Transactions on Circuits and Systems I: Regular Papers

Volumn 56, Issue 3, 2009, Pages 630-643

  Li, Kang ^a   Peng, Jian Xun ^a   Bai, Er Wei ^b  

^a QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

^b IA United States   (United States)

Author keywords

Computational complexity analysis; Continuous parameter optimization; Nonlinear system identification; Radial basis function (RBF) neural modeling; Structure determination; Subset selection

Indexed keywords

CALCULATIONS; COMPUTATIONAL COMPLEXITY; FUNCTIONS; ITERATIVE METHODS; NONLINEAR DYNAMICAL SYSTEMS; NONLINEAR SYSTEMS;

COMPUTATIONAL COMPLEXITY ANALYSIS; CONTINUOUS PARAMETERS; NEURAL MODELING; STRUCTURE DETERMINATION; SUBSET SELECTION;

STRUCTURAL OPTIMIZATION;

EID: 63449091970     PISSN: 10577122     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSI.2008.2002545     Document Type: Article

References (59)

1. C. Li and X. Liao, "Robust stability and robust periodicity of delayed recurrent neural networks with noise disturbance," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 53, no. 10, pp. 2265-2273, Oct. 2006.
2. S.-Y. Peng, P. Hasler, and D. Anderson, "An analog programmable multidimensional radial basis function based classifier," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 54, no. 10, pp. 2148-2158, Oct. 2007.
3. Y.-D. Jou and F.-K. Chen, "Least-squares design of FIR filters based on a compacted feedback neural network," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 54, no. 5, pp. 427-431, May 2007.
4. J. de Jesus Rubio and W. Yu, "Stability analysis of nonlinear system identification via delayed neural networks," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 54, no. 2, pp. 161-165, Feb. 2007.
5. G.-B. Huang, Q.-Y. Zhu, K. Z. Mao, C.-K. Siew, P. Saratchandran, and N. Sundararajan, "Can threshold networks be trained directly?," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 53, no. 3, pp. 187-191, Mar. 2006.
6. P. Thiran, G. Setti, and M. Hasler, "An approach to information propagation in 1-dimensional cellular neural networks - Part I: Local diffusion," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 45, no. 8, pp. 777-789, Jun. 1998.
7. J. Park and I. Sandberg, "Universal approximation using radial-basis-function networks," Neural Comput., vol. 3, no. 2, pp. 246-257, 1991.
8. S. Chen and S. A. Billings, "Neural networks for nonlinear dynamic system modeling and identification," Int. J. Control, vol. 56, no. 2, pp. 319-346, 1992.
9. Q. M. Zhu and S. A. Billings, "Fast orthogonal identification of nonlinear stochastic models and radial basis function neural networks," Int. J. Control, vol. 64, no. 5, pp. 871-886, Jul. 1996.
10. F. L. Lewis, S. Jagannathan, and A.Yesildirek, Neural Network Control of Robot Manipulators and Nonlinear Systems. London, U.K.: Taylor & Francis, 1999.
11. X. Hong, C. J. Harris, S. Chen, and P. M. Sharkey, "Robust nonlinear model identification methods using forward regression," IEEE Trans. Syst., Man Cybern. A, Syst., Humans, vol. 33, no. 4, pp. 514-523, Jul. 2003.
12. S. N. Huang, K. K. Tan, and T. H. Lee, "Adaptive motion control using neural network approximations," Automatica, vol. 38, no. 2, pp. 227-233, Feb. 2002.
13. S. S. Ge, C. C. Hang, T. H. Lee, and T. Zhang, Stable Adaptive Neural Network Control. Boston, MA: Kluwer, 2001.
14. G.-B. Huang, P. Saratchandran, and N. Sundararajan, "A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation," IEEE Trans. Neural Netw., vol. 16, no. 1, pp. 57-67, Jan. 2005.
15. G.-B. Huang, L. Chen, and C.-K. Siew, "Universal approximation using incremental constructive feedforward networks with random hidden nodes," IEEE Trans. Neural Netw., vol. 17, no. 4, pp. 879-892, Jul. 2006.
16. G.-B. Huang and C.-K. Siew, "Extreme learning machine: RBF network case," in Proc. 8th ICARCV, Kunming, China, Dec. 6-9, 2004, vol. 2, pp. 1029-1036.
17. Y. Li, S. Qiang, X. Zhuang, and O. Kaynak, "Robust and adaptive back-stepping control for nonlinear systems using RBF neural networks," IEEE Trans. Neural Netw., vol. 15, no. 3, pp. 693-701, May 2004.
18. K. Li, J. Peng, and E. W. Bai, "A two-stage algorithm for identification of nonlinear dynamic systems," Automatica, vol. 42, no. 7, pp. 1189-1197, 2006.
19. J. Peng, K. Li, and D. S. Huang, "A hybrid forward algorithm for RBF neural network construction," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1439-1451, Nov. 2006.
20. L. Ljung, System Identification: Theory for the User. Englewood Cliffs, NJ: Prentice-Hall, 1987.
21. S. Chen, S. A. Billings, and W. Luo, "Orthogonal least squares methods and their application to non-linear system identification," Int. J. Control, vol. 50, no. 5, pp. 1873-1896, Nov. 1989.
22. X. Wang, S. Chen, D. Lowe, and C. Harris, "Parsimonious least squares support vector regression using orthogonal forward selection with the generalised kernel model," Int. J. Model. Identification Control, vol. 1, no. 4, pp. 245-256, 2006.
23. X. Wang, S. Chen, D. Lowe, and C. Harris, "Sparse support vector regression based on orthogonal forward selection for the generalised kernel model," Neurocomputing, vol. 70, no. 1-3, pp. 462-474, Dec. 2006.
24. S. Chen, X. Wang, and C. Harris, "Construction of RBF classifiers with tunable units using orthogonal forward selection based on leave-one-out misclassification rate," in Proc. Int. Joint Conf. Neural Netw., Vancouver, Canada, Jul. 16-21, 2006, pp. 6390-6394.
25. S. Chen, X. Wang, and C. Harris, "NARX-based nonlinear system identification using orthogonal least squares basis hunting," IEEE Trans. Control Syst. Technol., vol. 16, no. 1, pp. 78-84, Jan. 2008.
26. M. Vogt, "Combination of radial basis function neural networks with optimized learning vector quantization," in Proc. IEEE Int. Conf. Neural Netw., 1993, vol. 83, pp. 1841-1846.
27. E. L. Sutanto, J. D. Mason, and K. Warwick, "Mean-tracking clustering algorithm for radial basis function center selection," Int. J. Control, vol. 67, no. 6, pp. 961-977, Aug. 1997.
28. D. Marquardt, "An algorithm for least-squares estimation of nonlinear parameters," SIAM J. Appl. Math., vol. 11, no. 2, pp. 431-441, Jun. 1963.
29. N. B. Karayiannis, "Reformulated radial basis neural networks trained by gradient descent," IEEE Trans. Neural Netw., vol. 10, no. 3, pp. 657-671, May 1999.
30. S. McLoone, M. D. Brown, G. W. Irwin, and G. Lightbody, "A hybrid linear/nonlinear training algorithm for feedforward neural networks," IEEE Trans. Neural Netw., vol. 9, no. 4, pp. 669-684, Jul. 1998.
31. x decomposition process," Control Eng. Pract., vol. 12, no. 2, pp. 191-203, Feb. 2004.
32. C. Panchapakesan, M. Palaniswami, D. Ralph, and C. Manzie, "Effects of moving the center's in an RBF network," IEEE Trans. Neural Netw., vol. 13, no. 6, pp. 1299-1307, Nov. 2002.
33. N. Ampazis and S. J. Perantonis, "Two highly efficient second-order algorithms for training feedforward networks," IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1064-1074, Sep. 2002.
34. H. Akaike, "New look at the statistical model identification," IEEE Trans. Autom. Control, vol. AC-19, no. 6, pp. 716-723, Dec. 1974.
35. F. Gustafsson and H. Hjalmarsson, "Twenty-one ML estimators for model selection," Automatica, vol. 31, no. 10, pp. 1377-1392, Oct. 1995.
36. K. Z. Mao and S. A. Billings, "Algorithms for minimal model structure detection in nonlinear dynamic system identification," Int. J. Control, vol. 68, no. 2, pp. 311-330, Sep. 1997.
37. T. P. Chen and H. Chen, "Approximation capability to functions of several variables, nonlinear functionals, and operators by radial basis function neural networks," IEEE Trans. Neural Netw., vol. 6, no. 4, pp. 904-910, Jul. 1995.
38. K. Li, J. Peng, and G. W. Irwin, "A fast nonlinear model identification method," IEEE Trans. Autom. Control, vol. 50, no. 8, pp. 1211-1216, Aug. 2005.
39. M. J. L. Orr, "Regularization on the selection of radial basis function centers," Neural Comput., vol. 7, no. 3, pp. 606-623, May 1995.
40. X. Hong and S. Billings, "Givens rotation based fast backward elimination algorithm for RBF neural network pruning," Proc. Inst. Elect. Eng. - Control Theory Appl., vol. 144, no. 5, pp. 381-384, Sep. 1997.
41. X. Hong, C. Harris, M. Brown, and S. Chen, "Backward elimination methods for associative memory network pruning," Int. J. Hybrid Intell. Syst., vol. 1, no. 1/2, pp. 90-99, Apr. 2004.
42. J. B. Gomm and D. L. Yu, "Selecting radial basis function network centers with recursive orthogonal least squares training," IEEE Trans. Neural Netw., vol. 11, no. 2, Mar. 2000.
43. A. Sherstinsky and R. W. Picard, "On the efficiency of the orthogonal least squares training method for radial basis function networks," IEEE Trans. Neural Netw., vol. 7, no. 1, pp. 195-200, Jan. 1996.
44. K. M. Adeney and M. J. Korenberg, "Iterative fast orthogonal search algorithm for mdl-based training of generalized single-layer network," Neural Netw., vol. 13, no. 7, pp. 787-799, Sep. 2000.
45. J. Gonzalez, I. Rojas, J. Ortega, H. Pomares, F. J. Fernandez, and A. F. Diaz, "Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation," IEEE Trans. Neural Netw., vol. 14, no. 6, pp. 1478-1495, Nov. 2003.
46. K. Li and J.-X. Peng, "System oriented neural networks - Problem formulation, methodology and application," Int. J. Pattern Recognit. Artif. Intell., vol. 20, no. 2, pp. 143-158, 2006.
47. J. Peng and K. Li, "A novel GA-based neural modeling platform for nonlinear dynamic systems," in Proc. IFAC World Congr. Autom. Control, Prague, Czech Republic, Jul. 2005.
48. C. Cortes and V. Vapnik, "Support-vector networks," Mach. Learn. vol. 20, no. 3, pp. 273-297, Sep. 1995.
49. J. A. K. Suykens, T. V. Gestel, J. D. Brabanter, B. D. Moor, and J. Vandewalle, Least Squares Support Vector Machines., Singapore: World Scientific, 2002.
50. A. Kuh and P. D. Wilde, "Comments on "Pruning error minimization in least squares support vector machines"," IEEE Trans. Neural Netw. vol. 18, no. 2, pp. 606-609, Mar. 2007.
51. K. Mao, "Feature subset selection for support vector machines through discriminative function pruning analysis," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 1, pp. 60-67, Feb. 2004.
52. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge, U.K.: Cambridge Univ. Press, 2000.
53. X.-L. Xia, K. Li, and G. W. Irwin, "Improved training of an optimal sparse least squares support vector machine," in Proc. IFAC World Congr., Seoul, Korea, 2008.
54. S. Chen, S. A. Billings, C. F. N. Cowan, and P. M. Grant, "Practical identification of NARMAX models using radial basis functions," Int. J. Control, vol. 52, no. 6, pp. 1327-1350, Dec. 1990.
55. S. Chen, X. Wang, and D. Brown, "Sparse incremental regression modeling using correlation criterion with boosting search," IEEE Signal Process. Lett., vol. 12, no. 3, pp. 198-201, Mar. 2005.
56. W. C. Chan, C. Chan, K. Cheung, and C. Harris, "On the modeling of nonlinear dynamic systems using support vector neural networks," Eng. Appl. Artif. Intell., vol. 14, pp. 105-113, 2001.
57. C.-C. Chang and C.-J. Lin, LIBSVM: A Library for Support Vector Machines [Online]. Available: http://www.csie.ntu.edu.tw/~cjlin/libsvm 2001
58. G. L. Zhang and S. A. Billings, "Radial basis function network configuration using mutual information and the orthogonal least squares algorithm," Neural Netw., vol. 9, no. 9, pp. 1619-1637, Dec. 1996.
59. x emission in a coal-fired power generation plant," Control Eng. Pract., vol. 12, no. 6, pp. 707-723, Jun. 2004.