Zhang neural network and its application to Newton iteration for matrix square root estimation

Neural Computing and Applications

Volumn 21, Issue 3, 2012, Pages 453-460

  Zhang, Yunong ^a   Yang, Yiwen ^a   Cai, Binghuang ^a   Guo, Dongsheng ^a  

^a SUN YAT SEN UNIVERSITY   (China)

Author keywords

Discrete time model; Line search algorithm; Matrix square root; Newton iteration; Recurrent neural networks

Indexed keywords

DISCRETE-TIME; DISCRETE-TIME MODEL; ENERGY FUNCTIONS; ERROR FUNCTION; GRADIENT BASED; LINE SEARCH ALGORITHM; MATRIX PROBLEM; MATRIX SQUARE ROOT; MATRIX SQUARE ROOTS; NEWTON ITERATIONS; SPECIAL CLASS; STEP SIZE; TIME VARYING;

LEARNING ALGORITHMS; RECURRENT NEURAL NETWORKS;

ZINC COMPOUNDS;

EID: 84858151057     PISSN: 09410643     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00521-010-0445-x     Document Type: Article

References (22)

1. Iannazzo B (2003) A note on computing the matrix square root. Calcolo 40: 273-283. doi: 10. 1007/s10092-003-0079-9.
2. Charles RJ, Kazuyoshi O, Robert R (2001) Uniqueness of matrix square roots and an application. Linear Algebra Appl 323(1): 51-60. doi: 10. 1016/S0024-3795(00)00243-3.
3. Higham NJ (2008) Functions of matrices: theory and computation. Society for Industrial and Applied Mathematics, USA.
4. Mohammed AH, Ali AH, Syed R (2000) Fixed point iterations for computing square roots and the matrix sign function of complex matrices. In: Proceedings of IEEE Conference on Decision and Control, 4253-4258. doi: 10. 1109/CDC. 2001. 914567.
5. Denman E, Beavers N (1976) The matrix sign function and computations in systems. Appl Math Comput 2: 63-94. doi: 10. 1016/0096-3003(76)90020-5.
6. Meini B (2003) The matrix square root from a new functional perspective: theoretical results and computational issues. Technical Report 1455, Dipartimento di Matematica, Universitá di Pisa, Pisa.
7. Ortega JM (1972) Numerical analysis: a second course. Academic Press, New York.
8. Long J, Hu X, Zhang L (2008) Newton's method with exact line search for the square root of a matrix. J Phys Conf Ser 96: 1-5. doi: 10. 1088/1742-6596/96/1/012034.
9. Tank DW, Hopfield JJ (1986) Simple 'neural' optimization networks: an A/D converter, signal decision circuit, and a linear programming. IEEE Trans Circuits Syst 33(5): 533-541. doi: 10. 1109/TCS. 1986. 1085953.
10. Dan Z, Huang WZ, Huang Y (2010) Chaos and rigorous verification of horseshoes in a class of Hopfield neural networks. Neural Comput Appl 19(1): 159-166. doi: 10. 1007/s00521-009-0269-8.
11. Zhang Y, Jiang D, Wang J (2002) A recurrent neural network for solving Sylvester equation with time-varying coefficients. IEEE Trans Neural Netw 13(5): 1053-1063. doi: 10. 1109/TNN. 2002. 1031938.
12. Yildiz N (2005) Layered feedforward neural network is relevant to empirical physical formula construction: A theoretical analysis and some simulation results. Phys Lett A 345(1-3): 69-87. doi: 10. 1016/j. physleta. 2005. 06. 116.
13. Zhang Y, Li Z (2009) Zhang neural network for online solution of time-varying convex quadratic program subject to time-varying linear-equality constraints. Phys Lett A 373: 1639-1643. doi: 10. 1016/j. physleta. 2009. 03. 011.
14. Zhang Y, Ge SS (2005) Design and analysis of a general recurrent neural network model for time-varying matrix inversion. IEEE Trans Neural Netw 16(6): 1477-1490. doi: 10. 1109/TNN. 2005. 857946.
15. Zhang Y, Ma W, Cai B (2009) From Zhang neural network to Newton iteration for matrix inversion. IEEE Trans Circuits Syst I 56(7): 1405-1415. doi: 10. 1109/TCSI. 2008. 2007065.
16. Zhang Y (2005) Revisit the analog computer and gradient-based neural system for matrix inversion. In: Proceedings of IEEE international symposium on intelligent control, pp 1411-1416. doi: 10. 1109/. 2005. 1467221.
17. Benner P, Byers R (1998) An exact line search method for solving generalized continuous-time algebraic Riccati equations. IEEE Trans Automat Control 43(1): 101-107. doi: 10. 1109/9. 654908.
18. Shi ZJ (2004) Convergence of line search methods for unconstrained optimization. Appl Math Comput 157(2): 393-405. doi: 10. 1016/j. amc. 2003. 08. 058.
19. Diniz-Ehrhardt MA, Martłnez JM, Raydan M (2008) A derivative-free nonmonotone line-search technique for unconstrained optimization. J Comput Appl Math 219(2): 383-397. doi: 10. 1016/j. cam. 2007. 07. 017.
20. Mead C (1989) Analog VLSI and neural systems. Addison-Wesley, Reading.
21. The MathWorks Inc (2008) Simulink 7 Getting Started Guide. Natick, MA.
22. Carneiro NCF, Caloba LP (1995) A new algorithm for analog matrix inversion. In: Proceedings of the 38th midwest symposium on circuits systems, vol 1, pp 401-404. doi: 10. 1109/MWSCAS. 1995. 504461.