An H∞ control approach to robust learning of feedforward neural networks

Neural Networks

Volumn 24, Issue 7, 2011, Pages 759-766

  Jing, Xingjian ^a  

^a HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

Author keywords

Feedforward neural network (FNN); H control; Linear matrix inequality (LMI)

Indexed keywords

ANALYSIS AND DESIGN; ATTENUATION LEVELS; CONTROL APPROACH; DISCRETE DYNAMIC SYSTEM; ESTIMATION ERRORS; LEARNING PARAMETERS; LEARNING PROBLEM; LINEAR MATRIX INEQUALITY (LMI); LINEAR MATRIX INEQUALITY OPTIMIZATIONS; OUTPUT DATA; ROBUST CONTROLLER DESIGN; ROBUST LEARNING; WEIGHT UPDATE;

CONTROLLERS; LEARNING ALGORITHMS; LINEAR MATRIX INEQUALITIES; OPTIMIZATION; ROBUST CONTROL;

FEEDFORWARD NEURAL NETWORKS;

ANALYTICAL ERROR; ARTICLE; ARTIFICIAL NEURAL NETWORK; INFORMATION PROCESSING; LEARNING ALGORITHM; NOISE; PRIORITY JOURNAL; THEORETICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; FEEDBACK; HUMANS; LEARNING; NEURAL NETWORKS (COMPUTER);

EID: 79960892816     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2011.03.015     Document Type: Article

References (20)

1. Behera L., Kumar S., Patnaik A. On adaptive learning rate that guarantees convergence in feedforward networks. IEEE Transactions on Neural Networks 2006, 17(5).
2. Bilski J., Rutkowski L. A fast training algorithm for neural networks. IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing 1998, 45(6):749-753.
3. Charalambous, C. (1992). Conjugate gradient algorithm for efficient training of artificial neural networks. In Institution of electrical engineers proc.(pp. 301-310). Vol. 139.
4. Hagan M.T., Demuth H.B., Beale M. Neural network design 1996, PWS Publishing Co., Boston.
5. Han H., Su C.Y., Stepanenko Y. Adaptive control of a class of nonlinear systems with nonlinearly parameterized fuzzy approximators. IEEE Transactions on Fuzzy Systems 2001, 9(2):315-323.
6. Haykin S. Neural networks: a comprehensive foundation 1999, Prentice-Hall, Englewood Cliffs, NJ.
7. Iiguni Y., Sakai H., Tokumaru H. A real-time learning algorithm for a multilayered neural netwok based on extended Kalman filter. IEEE Transactions on Signal Processing 1992, 40(4):959-966.
8. Jing X.J., Tan D.L., Wang Y.C. An LMI approach to stability of systems with severe time-delay. IEEE Transactions on Automatic Control 2004, 49(7):1192-1195.
9. Kuschewski J.G., Hui S., Zak S.H. Application of feedforward neural networks to dynamical system identification and control. IEEE Transactions on Control Systems Technology 1993, 1(1):37-49.
10. Lera G., Pinzolas M. Neighborhood based Levenberg-Marquardt algorithm for neural network training. IEEE Transactions on Neural Networks 2002, 13(5):1200-1203.
11. Man Z., Wu H.R., Liu S., Yue X. A new adaptive backpropagation algorithm based on Lyapunov stability theory for neural networks. IEEE Transactions on Neural Networks 2006, 17(6):1580-1591.
12. Nishiyama K., Suzuki K. H∞-learning of layered neural networks. IEEE Transactions on Neural Networks 2001, 12(6).
13. Osowski S., Bojarczak P., Stodolski M. Fast second order learning algorithm for feedforward multilayer neural network and its applications. Neural Networks 1996, 9(9):1583-1596.
14. Park J.H., Kim S.H., Moon C.J. Adaptive neural control for strict-feedback nonlinear systems without backstopping. IEEE Transactions on Neural Networks 2009, 20(7):1204-1209.
15. Park J., Sandberg I.W. Universal approximation using radial basis function networks. Neural Computation 1991, 3:246-257.
16. Riedmiller M., Braun H. A direct adaptive method for faster backpropagation learning: the RPROP algorithm. Proceedings of the 1993 IEEE inter. conf. on neural networks 1993, Vol. 1:586-591. IEEE, (IEEE; San Francisco, California; March 28- April 1) (IEEE catalog number: 93CH3274-8).
17. Sarkar D. Methods to speed up error back propagation learning algorithm. ACM Computing Surveys 1995, 27(4):519-544.
18. Sastry P. Backpropagation algorithm with momentum. IEEE Transactions on Neural Networks 1994, 5(3):505-506.
19. Shao H., Wu W. Convergence of BP algorithm with variable learning rates for FNN training. Proceedings of the fifth mexican international conference on artificial intelligence 2006, IEEE computer Society, (catalog number 0-7695-2722-1/06).
20. Wei H.L., Billings S.A. Model structure selection using an integrated forward orthogonal search algorithm assisted by squared correlation and mutual information. International Journal of Modelling, Identification and Control 2008, 3(4):341-356.