Zhang neural network versus gradient-based neural network for time-varying linear matrix equation solving

Neurocomputing

Volumn 74, Issue 17, 2011, Pages 3708-3712

  Guo, Dongsheng ^a   Yi, Chenfu ^b   Zhang, Yunong ^a  

^a SUN YAT SEN UNIVERSITY   (China)

^b JIANGXI UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

Author keywords

Global exponential convergence; Gradient based neural network; Linear matrix equation; Time varying; Zhang neural network

Indexed keywords

ENERGY FUNCTIONS; ERROR FUNCTION; GLOBAL EXPONENTIAL CONVERGENCE; GRADIENT BASED; IMPLICIT DYNAMICS; LINEAR MATRIX EQUATIONS; NOVEL DESIGN; THEORETICAL SOLUTIONS; TIME VARYING;

COMPUTER SIMULATION; RECURRENT NEURAL NETWORKS; ZINC COMPOUNDS;

MATRIX ALGEBRA;

ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER MODEL; CONTROLLED STUDY; GRADIENT BASED NEURAL NETWORK; INTERMETHOD COMPARISON; MATHEMATICAL ANALYSIS; MATHEMATICAL COMPUTING; ONLINE SYSTEM; PRIORITY JOURNAL; ZHANG NEURAL NETWORK;

EID: 84864591960     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2011.05.021     Document Type: Article

References (27)

1. Ding F., Chen T. Gradient based iterative algorithms for solving a class of matrix equations. IEEE Transactions on Automatic Control 2005, 50(8):1216-1221.
2. Lin Y. Minimal residual methods augmented with eigenvectors for solving Sylvester equations and generalized Sylvester equations. Applied Mathematics and Computation 2006, 181(1):487-499.
3. Gu C., Xue H. A shift-splitting hierarchical identification method for solving Lyapunov matrix equations. Linear Algebra and its Applications 2009, 430(5-6):1517-1530.
4. Fuhrmann P.A. A functional approach to the Stein equation. Linear Algebra and its Applications 2010, 432(12):3031-3071.
5. Zhang Y., Jiang D., Wang J. A recurrent neural network for solving Sylvester equation with time-varying coefficients. IEEE Transactions on Neural Networks 2002, 13(5):1053-1063.
6. Zhang Y., Wang J. Global exponential stability of recurrent neural networks for synthesizing linear feedback control systems via pole assignment. IEEE Transactions on Neural Networks 2002, 13(3):633-644.
7. Chong E.K.P., Hui S., zak S.H. An analysis of a class of neural networks for solving linear programming problems. IEEE Transactions on Automatic Control 1999, 44(11):1995-2006.
8. Zhang Y., Leithead W.E. Exploiting Hessian matrix and trust-region algorithm in hyperparameters estimation of Gaussian process. Applied Mathematics and Computation 2005, 171(2):1264-1281.
9. Zhang Y., Ge S.S. Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Transactions on Neural Networks 2005, 16(6):1477-1490.
10. Zhang Y., Ma W., Cai B. From Zhang neural network to Newton iteration for matrix inversion. IEEE Transactions on Circuits and Systems I: Regular Papers 2009, 56(7):1405-1415.
11. Zhang Y., Yang Y., Tan N., Cai B. Zhang neural network solving for time-varying full-rank matrix Moore-Penrose inverse. Computing 2011, 10.1007/s00607-010-0133-9.
12. Pearlmutter B.A. Gradient calculations for dynamic recurrent neural networks: a survey. IEEE Transactions on Neural Networks 1995, 6(5):1212-1228.
13. Tsoi A.C., Tan S. Recurrent neural networks: a constructive algorithm, and its properties. Neurocomputing 1997, 15(3-4):309-326.
14. Joya G., Atencia M.A., Sandoval F. Hopfield neural networks for optimization: study of the different dynamics. Neurocomputing 2002, 43(1-4):219-237.
15. Xie W.F., Zhu Y.Q., Zhao Z.Y., Wong Y.K. Nonlinear system identification using optimized dynamic neural network. Neurocomputing 2009, 72(13-15):3277-3287.
16. Wang J. A recurrent neural network for real-time matrix inversion. Applied Mathematics and Computation 1993, 55(1):89-100.
17. Yeung K.S., Kumbi F. Symbolic matrix inversion with application to electronic circuits. IEEE Transactions on Circuits and Systems 1988, 35(2):235-238.
18. Y. Zhang, Revisit the analog computer and gradient-based neural system for matrix inversion, in: Proceedings of the IEEE International Symposium on Intelligent Control, 2005, pp. 1411-1416.
19. Zhang Y., Chen K., Tan H. Performance analysis of gradient neural network exploited for online time-varying matrix inversion. IEEE Transactions on Automatic Control 2009, 54(8):1940-1945.
20. Manherz R.K., Jordan B.W., Hakimi S.L. Analog methods for computation of the generalized inverse. IEEE Transactions on Automatic Control 1968, 13(5):582-585.
21. Maeda Y., Wakamura M. Simultaneous perturbation learning rule for recurrent neural networks and its FPGA implementation. IEEE Transactions on Neural Networks 2005, 16(6):1664-1672.
22. Li Z., Zhang Y. Improved Zhang neural network model and its solution of time-varying generalized linear matrix equations. Expert Systems with Applications 2010, 37(10):7213-7218.
23. Liu L., Shao H., Nan D. Recurrent neural network model for computing largest and smallest generalized eigenvalue. Neurocomputing 2008, 71(16-18):3589-3594.
24. Hung D.L., Wang J. Digital hardware realization of a recurrent neural network for solving the assignment problem. Neurocomputing 2003, 51:447-461.
25. Zhang Y., Ma W., Li X.D., Tan H.Z., Chen K. MATLAB Simulink modeling and simulation of LVI-based primal-dual neural network for solving linear and quadratic programs. Neurocomputing 2009, 72(7-9):1679-1687.
26. Horn R.A., Johnson C.R. Topics in Matrix Analysis 1991, Cambridge University Press, Cambridge.
27. Mead C. Analog VLSI and Neural Systems 1989, Addison-Wesley, Reading, MA.