Multiobjective criteria for neural network structure selection and identification of nonlinear systems using genetic algorithms

IEE Proceedings: Control Theory and Applications

Volumn 146, Issue 5, 1999, Pages 373-382

  Liu, G P ^a   Kadirkamanathan, V ^b  

^a Alstom UK   (United Kingdom)

^b UNIVERSITY OF SHEFFIELD   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; GENETIC ALGORITHMS; IDENTIFICATION (CONTROL SYSTEMS); LEAST SQUARES APPROXIMATIONS; MATHEMATICAL MODELS; NEURAL NETWORKS; OPTIMIZATION; POLYNOMIALS;

GAUSSIAN RADIAL BASIS FUNCTION NETWORK; MULTIOBJECTIVE CRITERIA; PERFORMANCE INDEX; VOLTERRA POLYNOMIAL;

NONLINEAR CONTROL SYSTEMS;

EID: 0033340056     PISSN: 13502379     EISSN: None     Source Type: Journal    
DOI: 10.1049/ip-cta:19990501     Document Type: Article

References (38)

1. POWELL, M.J.D: 'Approximation Theory and Methods' (Cambridge University Press, 1981)
2. SPRECHER, D.A.: 'On the structure of continuous functions of several variables', Trans. Am. Math. Soc., 1965, 115, pp. 340-355
3. BILLINGS, S.A., and CHEN, S.: 'Neural Networks and System Identification', in WARWICK, K. et al. (Eds.): 'Neural networks for systems and control', 1992, pp. 181-205
4. CHEN, S., BILLINGS, S.A., and GRANT, P.M.: 'Nonlinear system identification using neural networks', Int. J. Control, 1990, 51, (6), pp. 1191-1214
5. KADIRKAMANATHAN, V.: 'Sequential learning in artificial neural networks', 1991. Ph. D Thesis, University of Cambridge, U.K.
6. KADIRKAMANATHAN, V., and NIRANJAN, M.: 'A function estimation approach to sequential learning with neural networks', Neural Comp., 1993, 5, pp. 954-957
7. KADIRKAMANATHAN, V.: 'Bayesian inference for basis function selection in nonlinear system identification using genetic algorithms', in SKILLING, J. and SIBISI, S. (Eds.) 'Maximum entropy and Bayesian methods' (Kluwer, 1995)
8. KUSCHEWSKI, J.G., HUI, S., and ZAK, H.S.: 'Application of feedforward neural networks to dynamical system identification and control', IEEE Trans. Control Syst. Technol., 1993, l, (1), pp. 37-49
9. LIU, G.P., KADIRKAMANATHAN, V., and BILLINGS, S.A.: 'Sequential identification of nonlinear systems by neural networks', Proceedings of the 3rd European Control Conference, Rome, 1995, pp. 2408-2413
10. LIU, G.P., KADIRKAMANATHAN, V., and BILLINGS, S.A.: 'Stable sequential identification of continuous nonlinear dynamical systems by growing RBF networks', Int. J. Control, 65, (1), pp. 53-69
11. NARENDRA, K.S., and PARTHASARATHY, K.: 'Identification and control of dynamical systems using neural networks', IEEE Trans. Neural Netw, 1990, 1, (1), pp. 4-27
12. QIN, S.Z., SU, HT., and MCAVOY, T.J.: 'Comparison of four net learning methods for dynamic system identification', IEEE Trans. Neural Net., 1992, 3, (1), pp. 122-130
13. WILLIS, M.J., MONTAGUE, G.A., MASSIMO, C. Di., THAM, M.T., and MORRIS, A.J.: 'Artificial neural networks in process estimation and control, Automatica, 1992, 28, (6), pp. 1181-1187
14. CYBENKO, G.: 'Approximation by superpositions of a sigmoidal function', Math. Control Signals Syst., 1989, 2, pp. 303-314
15. AKAIKE, H.: 'A new look at the statistical model identification', IEEE Trans., 1974, AC-19, pp. 716-723
16. MACKAY, D.J.C.: 'Bayesian interpolation', Neural Comput., 1992, 4, pp. 415-147
17. RISSANEN, J.: 'Stochastic Complexity in Statistical Inquiry' (World Scientific, Singapore, 1989)
18. CHEN, S., and BILLINGS, S.A.: 'Representations of non-linear systems: the NARMAX model', Int. J. Control, 1989, 49, (3), pp. 1013-1032
19. NERRAND, O., ROUSSELRAGOT, P., PERSONNAZ, L., and DREYFUS, G.: 'Training recurrent neural networks: why and how? An illustration in dynamical process modeling', IEEE Trans. Neural Netw., 1994, 5, (2), pp. 178-184
20. LIU, G.P., KADIRKAMANATHAN, V., and BILLINGS, S.A.: 'On-line identification of nonlinear systems using Volterra polynomial basis function neural networks', Neural Netw., 1998, 11, pp. 1645-1657
21. SCHETZEN, M.: 'The Volterra and Wiener theories of nonlinear systems' (Wiley, New York, 1980)
22. RAYNER, P.J., and LYNCH, M.: 'A new connectionist model based on a nonlinear adaptive filter'. Proceedings of the International Conference on Acoustics, speech and signal processing, Glasgow, UK, 1989, pp. 1191-1194
23. POWELL, M.J.D.: 'Radial basis functions for multivariable interpolation: A review', in MASON, J.C. and COX, M.G. (Eds.): 'Algorithms for Approximation' (Oxford University Press, 1987) pp. 143-167
24. BROOMHEAD, D.S., LOWE, D.: 'Multivariable functional interpolation and adaptive networks', Complex Systems, 1988, 2, pp. 321-355
25. MOODY, J.E., and DARKEN, C.J.: 'Fast learning in networks of locally-tuned process units', Neural Comput., 1, 1989, pp. 281-294
26. GOLDBERG, D.E.: 'Genetic Algorithm in Search, Optimization, and Machine Learning' (Addison Wesley, 1989)
27. DAVIS, L., (Ed.): 'Handbook of Genetic Algorithms' (Van Nostrand Reinhold, New York, 1991)
28. PATTON, R.J., and LIU, G.P., 'Robust control design via eigenstructure assignment, genetic algorithms and gradient-based optimization', IEE Proc. Control Theory Appl, 1994, 141, (3), pp. 202-208
29. SCHAFFER, J.D., CARUANA, R.A., and ESHELMAN, L.J.: 'Using genetic search to exploit the emergent behavior of Neural Networks', Physica D, 1990, 42, (1-3), pp. 244-248
30. WHITEHEAD, B.A., and CHOATE, T.D.: 'Evolving space-filling curves to distribute radial basis functions over an input space', IEEE Trans. Neural Net., 1994, 5, (1), pp. 15-23
31. FONSECA, C.M., MENDES, E.M., FLEMING, P.J., and BILLINGS, S.A.: 'Nonlinear model term selection with genetic algorithms', in Proceedings of IEE/IEEE workshop on Natural algorithms for signal processing, 1993, 27/1-27/8,
32. LIU, G.P., and KADIRKAMANATHAN, V.: 'Multiobjective criteria for nonlinear model selection and identification with neural networks', Report No. 508, Automatic Control and Systems Engineering Department, 1994, University of Sheffield
33. GEMAN, S., BIENESTOCK, E., and BOURSAT, R.: 'Neural networks and the bias/variance dilemma', Neural Comput., 1992, 4, pp. 1-58
34. WHIDBORNE, J.F., and LIU, G.P.: 'Critical Control Systems: Theory, Design and Applications' (Research Studies Press Limited, U.K., 1993)
35. ZAKIAN, V., and AL-NAIB, U.: 'Design of dynamical and control systems by the method of inequalities', Proc. IEE, 1973, 120, pp. 1421-1427
36. HAJELA, P., and LIN, C.Y.: in 'Genetic search strategies in multi-criterion optimal design', Struct. Optim., 1992, 4, pp. 99-107
37. SCHAFFER, J.D., ELBAUM, L.: 'Multiple objective optimization with vector valued genetic algorithms', in GREFENSTETTE, J.J (Ed.): Proceedings of the First International Conference on Genetic Algorithms, 1985, pp. 93-100
38. CHEN, D.S., JAIN, R.C.: 'A robust back propagation learning algorithm for function approximation', IEEE Trans. Neural Netw., 1994, 5, (3), pp. 467-479