Dynamic pruning algorithm for multilayer perceptron based neural control systems

Neurocomputing

Volumn 69, Issue 16-18, 2006, Pages 2097-2111

  Ni, Jie ^a   Song, Qing ^a  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

Conic sector; Dynamic pruning; Multilayer perceptron; Neural network; Robust control

Indexed keywords

ALGORITHMS; CLOSED LOOP CONTROL SYSTEMS; CONTROL SYSTEM SYNTHESIS; ESTIMATION; OPTIMAL CONTROL SYSTEMS; ROBUSTNESS (CONTROL SYSTEMS); SYSTEM STABILITY;

CLOSED-LOOP STABILITY; CONIC SECTOR; DYNAMIC PRUNING; ROBUST NEURAL CONTROL SYSTEM;

MULTILAYER NEURAL NETWORKS;

ALGORITHM; ANALYTICAL ERROR; ARTICLE; ARTIFICIAL NEURAL NETWORK; CONTROL SYSTEM; CONTROLLED STUDY; FEEDBACK SYSTEM; INTERNET; LEARNING; MATHEMATICAL COMPUTING; MONTE CARLO METHOD; PRIORITY JOURNAL; SIMULATION;

EID: 33748413020     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2005.09.010     Document Type: Article

References (31)

1. Baum E.B., and Haussler D. What size gives valide generalization. Neural Comput. 1 (1989) 151-160
2. Canete J.F.D., Barreiro A., Cerezo A.G., and Moral I.G. An input-output based stabilization criterion for neural-network control of nonlinear systems. IEEE Trans. Neural Networks 12 (2001) 1491-1497
3. Cluett V.R., Shah L., and Fisher G. Robustness analysis of discrete-time adaptive control systems using input-output stability theory: a tutorial. IEE Proc. Part D 135 (1988) 133-141
4. Colub G.H., and Loan C.F.V. Matrix Computation (1983), North Oxford Academic, Oxford, UK
5. Daniel Patino H., Carelli R., and Kuchen B.R. Neural networks for advanced control of robot manipulators. IEEE Trans. Neural Networks 13 (2002) 343-354
6. Denker J., Schwartz D., Wittner B., Solla S., and Howard R. Large automatic learning, rule extraction, and generalization. Complex Syst. 1 (1987) 877-922
7. Ge S.S., and Wang C. Direct adaptive NN control of a class of nonlinear systems. IEEE Trans. Neural Networks 13 (2002) 214-221
8. B. Hassibi, D.G. Stork, Second-order derivatives for network pruning: optimal brain surgeon, Advances in Neural Information Processing Systems, 1993, pp. 164-171.
9. Haykin S. Neural Network-A Comprehensive Foundation (1999), Prentice-Hall, Englewood Cliffs, NJ
10. Jagannathan S. Control of a class of nonlinear discrete-time systems using multilayer neural networks. IEEE Trans. Neural Networks 12 (2001) 1113-1120
11. Karystinos G.N., and Pados D.A. On overfitting, generalization, and randomly expanded training sets. IEEE Trans. Neural Networks 11 (2000) 1050-1057
12. Y. Le Cun, Generalization and network design strategies, Connectionism in Perspective, 1989, pp. 143-155.
13. Y. Le Cun, J.S. Denker, S.A. Solla, Optimal brain damage, Advances in Neural Information Processing Systems 2, 1993, pp. 598-605.
14. Lee M., and Choi H.-S. A robust neural controller for underwater robot manipulators. IEEE Trans. Neural Networks 11 (2000) 1465-1470
15. Lewis F.L., Abdallah C.T., and Dawson D.M. Control of Robot Manipulators (1993), MacMillan, New York
16. J. Ni, Q. Song, Adaptive simultaneous perturbation based pruning for a class of nonlinear control systems, Neural Networks, submitted for publication.
17. Ortega R., Praly L., and Laudau I.D. Robustness of discrete-time direct adaptive controllers. IEEE Trans. Automat. Control 30 (1985) 1179-1187
18. Polycarpou M.M., and Ioannou P.A. Learning and convergence analysis of neural-type structured networks. IEEE Trans. Neural Networks 3 (1992) 39-50
19. Rumelhart D.E., Hinton G.E., and Williams R.J. Learning representations by backpropagation errors. Nature 323 (1986) 533-536
20. Safanov M.G. Stability and Robustness of Multivariable Feedback Systems (1980), MIT Press, Cambridge, MA
21. Song Q., Hu W.J., Yin L., and Soh Y.C. Robust adaptive dead zone technology for fault-tolerant control of robot manipulators. J. Intell. Robotic Syst. 33 (2002) 113-137
22. Song Q., Hu W.J., and Zhao T.N. Robust neural controller for variable airflow volume system. IEE Proc. Control Theory Appl. 150 (2003) 112-118
23. Song Q., Katebi R., and Grimble M.J. Robust multivariable implicit adaptive control. IMA J. Math. Control Inf. 10 (1993) 49-70
24. Q. Song, J.C. Spall, Y.C. Soh, Robust neural network tracking controller using simultaneous perturbation stochastic approximation, Proceedings of the IEEE Conference on Decision and Control, 9-12 December 2003, Maui, Hawaii, pp. 6194-6199.
25. Song Q., Xiao J., and Soh Y.C. Robust backpropagation training algorithm for multilayered neural tracking controller. IEEE Trans. Neural Networks 10 (1999) 1133-1141
26. Spall J.C. Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE Trans. Automat. Control 37 (1992) 332-341
27. Spall J.C. Adaptive stochastic approximation by the simultaneous perturbation method. IEEE Trans. Automat. Control 45 (2000) 1839-1853
28. Spall J.C., and Cristion J.A. A neural network controller for systems with unmodeled dynamics with applications to water plant treatment. IEEE Trans. Syst. Man Cybern. Part B 27 (1997) 369-375
29. Spall J.C., and Cristion J.A. Model free control of nonlinear stochastic systems with discrete-time measurements. IEEE Trans. Automat. Control 43 (1998) 1198-1210
30. Sun F., Sun Z., and Woo P. Stable neural-network-based adaptive control for sampled-data nonlinear systems. IEEE Trans. Neural Networks 9 (1998) 956-968
31. Wang I.J., and Chong E.K.P. A deterministic analysis of stochastic approximation with randomized directions. IEEE Trans. Automat. Control 43 (1998) 1745-1749