Nonlinearly activated neural network for solving time-varying complex sylvester equation

IEEE Transactions on Cybernetics

Volumn 44, Issue 8, 2014, Pages 1397-1407

  Li, Shuai ^a   Li, Yangming ^b  

^a Stevens Institute of Technology   (United States)

^b INSTITUTE OF INTELLIGENT MACHINES   (China)

Author keywords

Complex valued recurrent neural network; complex valued Sylvester equation; finite time convergence; sign bi power function

Indexed keywords

CHEMICAL ACTIVATION; COMPUTATIONAL COMPLEXITY; COMPUTER SIMULATION; NONLINEAR EQUATIONS; RECURRENT NEURAL NETWORKS; TIME VARYING NETWORKS; ZINC COMPOUNDS;

ACTIVATION FUNCTIONS; COMPLEX-VALUED NEURAL NETWORKS; COMPLEX-VALUED RECURRENT NEURAL NETWORKS; FINITE-TIME CONVERGENCE; GLOBAL CONVER-GENCE; REAL-TIME CALCULATIONS; SYLVESTER EQUATION; ZHANG NEURAL NETWORK (ZNN);

COMPLEX NETWORKS;

EID: 84904628819     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2013.2285166     Document Type: Article

References (39)

1. M. Harker and P. Leary, "Least squares surface reconstruction from gradients: Direct algebraic methods with spectral, Tikhonov, and constrained regularization," in Proc. IEEE CVPR, 2011, pp. 2529-2536.
2. H. Lee and J. Choi, "Linear time-varying eigenstructure assignment with flight control application," IEEE Trans. Aerospace Electron. Syst., vol. 40, no. 1, pp. 145-157, Jan. 2004.
3. R. H. Bartels and G. W. Stewart, "Solution of the matrix equation AX + XB = C," Commun. ACM, vol. 15, no. 9, pp. 820-826, Sep. 1972.
4. T. Stykel, "Numerical solution and perturbation theory for generalized Lyapunov equations," Linear Algebra Its Appl., vol. 349, nos. 1-3, pp. 155-185, 2002.
5. M. Monsalve, "Block linear method for large scale Sylvester equations," Comput. Appl. Math., vol. 27, no. 1, pp. 47-59, 2008.
6. D. P. Mandic and V. S. L. Goh, Complex Valued Nonlinear Adaptive Filters: Noncircularity, Widely Linear and Neural Models, vol. 59. New York, NY, USA: Wiley, 2009.
7. S. Li, Y. Li, and Z. Wang, "A class of finite-time dual neural networks for solving quadratic programming problems and its k-winners-take-all application," Neural Netw., vol. 39, pp. 27-39, Mar. 2013.
8. S. Li, B. Liu, and Y. Li, "Selective positive-negative feedback produces the winner-take-all competition in recurrent neural networks," IEEE Trans. Neural Netw. Learning Syst., vol. 24, no. 2, pp. 301-309, Feb. 2013.
9. M. Husken and P. Stagge, "Recurrent neural networks for time series classification," Neurocomputing, vol. 50, pp. 223-235, Jan. 2003. (Pubitemid 36124143)
10. S. Li, S. Chen, B. Liu, Y. Li, and Y. Liang, "Decentralized kinematic control of a class of collaborative redundant manipulators via recurrent neural networks," Neurocomputing, vol. 91, no. 0, pp. 1-10, 2012.
11. T. Ogata, S. Nishide, H. Kozima, K. Komatani, and H. Okuno, "Intermodality mapping in robot with recurrent neural network," Pattern Recognit. Lett., vol. 31, no. 12, pp. 1560-1569, 2010.
12. S. Li, H. Cui, Y. Li, B. Liu, and Y. Lou, "Decentralized control of collaborative redundant manipulators with partial command coverage via locally connected recurrent neural networks," Neural Comput. Appl., vol. 23, nos. 3-4, pp. 1051-1060, Sep. 2013.
13. Y. Li, S. Li, and Y. Ge, "A biologically inspired solution to simultaneous localization and consistent mapping in dynamic environments," Neurocomputing, vol. 104, no. 0, pp. 170-179, 2013.
14. K. Smith, "Neural networks for combinatorial optimization: A review of more than a decade of research," INFORMS J. Comput., vol. 11, pp. 15-34, Jan. 1999.
15. S. Li and F. Qin, "A dynamic neural network approach for solving nonlinear inequalities defined on a graph and its application to distributed, routing-free, range-free localization of WSNs," Neurocomputing, vol. 117, no. 0, pp. 72-80, 2013.
16. S. Li, Z. Wang, and Y. Li, "Using Laplacian eigenmap as heuristic information to solve nonlinear constraints defined on a graph and its application in distributed range-free localization of wireless sensor networks," Neural Process. Lett., vol. 37, no. 3, pp. 1-14, Apr. 2013.
17. R. Yang, Z. Zhang, and P. Shi, "Exponential stability on stochastic neural networks with discrete interval and distributed delays," IEEE Trans. Neural Netw., vol. 21, no. 1, pp. 169-175, Jan. 2010.
18. R. Yang, H. Gao, and P. Shi, "Novel robust stability criteria for stochastic Hopfield neural networks with time delays," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 2, pp. 467-474, Apr. 2009.
19. F. Ding and T. Chen, "Gradient based iterative algorithms for solving a class of matrix equations," IEEE Trans. Automatic Control, vol. 50, no. 8, pp. 1216-1221, Aug. 2005. (Pubitemid 41410122)
20. B. Zhou, Z. Li, G. Duan, and Y. Wang, "Weighted least squares solutions to general coupled Sylvester matrix equations," J. Comput. Appl. Math., vol. 224, no. 2, pp. 759-776, Feb. 2009.
21. Y. Zhang and S. Ge, "Design and analysis of a general recurrent neural network model for time-varying matrix inversion," IEEE Trans. Neural Netw., vol. 16, no. 6, pp. 1477-1490, Nov. 2005. (Pubitemid 41709645)
22. L. Xiao and Y. Zhang, "Zhang neural network versus gradient neural network for solving time-varying linear inequalities," IEEE Trans. Neural Netw., vol. 22, no. 10, pp. 1676-1684, Oct. 2011.
23. Y. Zhang, W. Ma, and B. Cai, "From Zhang neural network to Newton iteration for matrix inversion," IEEE Trans. Circuits Syst. I: Reg. Papers, vol. 56, no. 7, pp. 1405-1415, Jul. 2009.
24. Y. Zhang, C. Yi, D. Guo, and J. Zheng, "Comparison on Zhang neural dynamics and gradient-based neural dynamics for online solution of nonlinear time-varying equation," Neural Comput. Appl., vol. 20, no. 1, pp. 1-7, 2011.
25. T. Nitta, Complex-Valued Neural Networks: Utilizing High-Dimensional Parameters. Hershey, PA, USA: Information Science Reference-Imprint of IGI Publishing, 2009.
26. A. Hirose, "Complex-valued neural networks: The merits and their origins," in Proc. IJCNN'09, pp. 1237-1244.
27. A. Uncini, L. Vecci, P. Campolucci, and F. Piazza, "Complex-valued neural networks with adaptive spline activation function for digital-radiolinks nonlinear equalization," IEEE Trans. Signal Process., vol. 47, no. 2, pp. 505-514, Feb. 1999.
28. A. R. Hafiz, M. F. Amin, and K. Murase, "Real-time hand gesture recognition using complex-valued neural network (CVNN)," in Proc. ICONIP'11, vol. 1. pp. 541-549.
29. A. Pande and V. Goel, "Complex-valued neural network in image recognition: A study on the effectiveness of radial basis function," in Proc. World Acad. Sci. Eng. Technol., vol. 26. 2007, pp. 220-225.
30. D. Mandic and V. S. L. Goh, Complex Valued Nonlinear Adaptive Filters: Noncircularity, Widely Linear and Neural Models. New York, NY, USA: Wiley, 2009.
31. A. Hirose, Complex-Valued Neural Networks. Berlin, Germany: Springer, 2006.
32. Y. Zhang and C. Yi, Zhang Neural Networks and Neural-Dynamic Method. Hauppauge, NY, USA: Nova Science, Oct. 2011.
33. Y. Zhang, Z. Li, and K. Li, "Complex-valued Zhang neural network for online complex-valued time-varying matrix inversion," Appl. Math. Comput., vol. 217, no. 24, pp. 10066-10073, 2011.
34. R. Horn and C. Johnson, Topics in Matrix Analysis, Cambridge, U.K.: Cambridge Univ. Press, 1991.
35. Y. Zhang, Z. Fan, and Z. Li, "Zhang neural network for online solution of time-varying Sylvester equation," in Proc. ISICA'07, pp. 276-285.
36. Y. Zhang, D. Jiang, and J. Wang, "A recurrent neural network for solving Sylvester equation with time-varying coefficients," IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1053-1063, Sep. 2002.
37. H. Khalil, Nonlinear Systems, 3rd ed. Englewood Cliffs, NJ, USA: Prentice-Hall, Dec. 2001.
38. S. Buss, "Introduction to inverse kinematics with Jacobian transpose, pseudoinverse and damped least squares methods," Technical report, Dept. Math. Univ. of California, San Diego, CA, USA, 2004.
39. S. L. Campbell and C. D. Meyer, Generalized Inverses of Linear Transformations. Philadephia, PA, USA: Soc. Ind. Appl. Math., 2009.