Boundedness and complete stability of complex-valued neural networks with time delay

IEEE Transactions on Neural Networks and Learning Systems

Volumn 24, Issue 8, 2013, Pages 1227-1238

  Zhou, Bo ^a   Song, Qiankun ^a  

^a CHONGQING JIAOTONG UNIVERSITY   (China)

Author keywords

Boundedness; complete stability; complex valued neural network (CVNN); linear matrix inequality (LMI); time delay

Indexed keywords

BOUNDEDNESS; BOUNDEDNESS CONDITIONS; COMPACT SETS; COMPLETE STABILITY; COMPLEX-VALUED; COMPLEX-VALUED NEURAL NETWORKS; ENERGY MINIMIZATION METHODS; LINEAR MATRIX INEQUALITY (LMIS);

COMPLEX NETWORKS; LINEAR MATRIX INEQUALITIES;

TIME DELAY;

ALGORITHM; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; HUMAN; NONLINEAR SYSTEM; TIME;

ALGORITHMS; COMPUTER SIMULATION; HUMANS; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; TIME FACTORS;

EID: 84880917373     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2247626     Document Type: Article

References (67)

1. A. Hirose, Complex-Valued Neural Networks, 2nd ed. New York, USA: Springer-Verlag, 2012.
2. I. Aizenberg, Complex-Valued Neural Networks with Multi-Valued Neurons. New York, USA: Springer-Verlag, 2011.
3. I. Aizenberg, N. N. Aizenberg, and J. P. L. Vandewalle, Multi-Valued and Universal Binary Neurons: Theory, Learning, Applications. New York, USA: Springer-Verlag, 2000.
4. I. Aizenberg, D. V. Paliy, J. M. Zurada, and J. T. Astola, "Blur identification by multilayer neural network based on Multi-valued neurons," IEEE Trans. Neural Netw., vol. 19, no. 5, pp. 883-898, May 2008. (Pubitemid 351728823)
5. I. Aizenberg and C. Moraga, "Multilayer feedforward neural network based on multi-valued neurons (MLMVN) and a backpropagation learning algorithm," Soft Comput., vol. 11, no. 2, pp. 169-183, Sep. 2007. (Pubitemid 44336453)
6. S. Fiori, "Nonlinear complex-valued extensions of hebbian learning: An essay," Neural Comput., vol. 17, no. 4, pp. 779-838, Apr. 2005.
7. S. Fiori, "Learning by criterion optimization on a unitary unimodular matrix group," Int. J. Neural Syst., vol. 18, no. 2, pp. 87-103, Apr. 2008. (Pubitemid 351730108)
8. H. Leung and S. Haykin, "The complex backpropagation algorithm," IEEE Trans. Signal Process., vol. 39, no. 9, pp. 2101-2104, Sep. 1991. (Pubitemid 21690086)
9. R. Savitha, S. Suresh, and N. Sundararajan, "A fully complex-valued radial basis function network and its learning algorithm," Int. J. Neural Syst., vol. 19, no. 4, pp. 253-267, Aug. 2009.
10. R. Savitha, S. Suresh, N. Sundararajan, and P. Saratchandran, "A new learning algorithm with logarithmic performance index for complex-valued neural networks," Neurocomputing, vol. 72, nos. 16-18, pp. 3771-3781, Oct. 2009.
11. S. Fiori, "Extended Hebbian learning for blind separation of complexvalued sources," IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 50, no. 4, pp. 195-202, Apr. 2003.
12. T. Kim and T. Adali, "Fully complex multi-layer perceptron network for nonlinear signal processing," J. Very Large Scale Integr. (VlSI) Signal Process. Syst., vol. 32, nos. 1-2, pp. 29-43, Aug. 2002. (Pubitemid 34974358)
13. A. Hirose and S. Yoshida, "Generalization characteristics of complexvalued feedforward neural networks in relation to signal coherence," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 4, pp. 541-551, Apr. 2012.
14. D. H. Dini and D. P. Mandic, "Class of widely linear complex Kalman filters," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 5, pp. 775-786, May 2012.
15. A. Hirose, Complex-Valued Neural Networks: Theories and Applications (Innovative Intellegence), vol. 5. Singapore: World Scientific, 2003.
16. G. M. Georgiou and C. Koutsougeras, "Complex domain backpropagation," IEEE Trans. Circuits Syst. II, Analog Dig. Signal Process., vol. 39, no. 5, pp. 330-334, May 1992.
17. N. Benvenuto and F. Piazza, "On the complex backpropagation algorithm," IEEE Trans. Signal Process., vol. 40, no. 4, pp. 967-969, Apr. 1992.
18. T. Nitta, "Solving the XOR problem and the detection of symmetry using a single complex-valued neuron," Neural Netw., vol. 16, no. 8, pp. 1001-1005, Oct. 2003.
19. S. L. Goh and D. P. Mandic, "A complex-valued RTRL algorithm for recurrent neural networks," Neural Comput., vol. 16, no. 12, pp. 2699-2713, Dec. 2004. (Pubitemid 39604014)
20. S. L. Goh and D. P. Mandic, "An augmented CRTRL for complex-valued recurrent neural networks," Neural Netw., vol. 20, no. 10, pp. 1061-1066, Dec. 2007. (Pubitemid 350180354)
21. S. L. Goh and D. P. Mandic, "Stochastic gradient-adaptive complexvalued nonlinear neural adaptive filters with a gradient-adaptive step size," IEEE Trans. Neural Netw., vol. 18, no. 5, pp. 1511-1516, Sep. 2007. (Pubitemid 47408549)
22. S. L. Goh and D. P. Mandic, "An augmented extended Kalman filter algorithm for complex-valued recurrent neural networks," Neural Comput., vol. 19, no. 4, pp. 1039-1055, Apr. 2007.
23. D. P. Mandic and S. L. Goh, Complex Valued Nonlinear Adaptive Filters Noncircularity, Widely Linear and Neural Models. New York: USA: Wiley, 2009.
24. I. Yamada, K. Slavakis, and K. Yamada, "An efficient robust adaptive filtering algorithm based on parallel subgradient projection techniques," IEEE Trans. Signal Process., vol. 50, no. 5, pp. 1091-1101, May 2002. (Pubitemid 34515269)
25. D. P. Mandic and J. A. Chambers, Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability. New York, USA: Wiley, 2001.
26. D. P. Mandic, S. Javidi, S. L. Goh, A. Kuh, and K. Aihara, "Complexvalued prediction of wind profile using augmented complex statistics," Renewable Energy, vol. 34, no. 1, pp. 196-201, Jan. 2009.
27. S. Jankowski, A. Lozowski, and J. M. Zurada, "Complex-valued multistate neural associative memory," IEEE Trans. Neural Netw., vol. 7, no. 6, pp. 1491-1496, Nov. 1996. (Pubitemid 126780488)
28. M. K. Muezzinoglu, C. Guzelis, and J. M. Zurada, "A new design method for the complex-valued multistate hopfield associative memory," IEEE Trans. Neural Netw., vol. 14, no. 4, pp. 891-899, Jul. 2003.
29. J. H. Mathews and R. W. Howell, Complex Analysis for Mathematics and Engineering, 3rd ed. Boston, MA, USA: Jones & Bartlett, 1997.
30. J. Hu and J. Wang, "Global stability of complex-valued recurrent neural networks with time-delays," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 6, pp. 853-865, Jun. 2012.
31. T. Chen, W. Lu, and G. Chen, "Dynamical behaviors of a large class of general delayed neural networks," Neural Comput., vol. 17, no. 4, pp. 949-968, Apr. 2005.
32. S. Hu and J. Wang, "Global robust stability of a class of discrete-time interval neural networks," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 53, no. 1, pp. 129-138, Jan. 2006. (Pubitemid 43141936)
33. J. Cao, K. Yuan, and H. X. Li, "Global asymptotical stability of generalized recurrent neural networks with multiple discrete delays and distributed delays," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1646-1651, Nov. 2006. (Pubitemid 44824277)
34. C. Li and X. Liao, "Global robust stability criteria for interval delayed neural networks via an LMI approach," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 53, no. 9, pp. 901-905, Sep. 2006. (Pubitemid 46511475)
35. X. Liao, G. Chen, and E. N. Sanchez, "Delay-dependent exponential stability analysis of delayed neural networks: An LMI approach," Neural Netw., vol. 15, no. 7, pp. 855-866, Sep. 2002. (Pubitemid 35299581)
36. S. Xu, J. Lam, D. W. C. Ho, and Y. Zou, "Novel global asymptotic stability criteria for delayed cellular neural networks," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 52, no. 6, pp. 349-353, Jun. 2005. (Pubitemid 40986454)
37. Q. Song, "Exponential stability of recurrent neural networks with both time-varying delays and general activation functions via LMI approach," Neurocomputing, vol. 71, nos. 13-15, pp. 2823-2830, Aug. 2008.
38. Z. Wang, Y. Liu, M. Li, and X. Liu, "Stability analysis for stochastic Cohen-grossberg neural networks with mixed time delays," IEEE Trans. Neural Netw., vol. 17, no. 3, pp. 814-820, May 2006.
39. H. Zhang, Z. Wang, and D. Liu, "Global asymptotic stability of recurrent neural networks with multiple time-varying delays," IEEE Trans. Neural Netw., vol. 19, no. 5, pp. 855-873, May 2008. (Pubitemid 351728821)
40. V. S. H. Rao and G. R. Murthy, "Global dynamics of a class of complex valued neural networks," Int. J. Neural Syst., vol. 18, no. 2 pp. 165-171, Apr. 2008. (Pubitemid 351730114)
41. C. Duan and Q. Song, "Boundedness and stability for discrete-time delayed neural network with complex-valued linear threshold neurons," Discrete Dyn. Nat. Soc., vol. 2010, pp. 368379-1-368379-19, Jun. 2010.
42. M. Bohner, V. S. H. Rao, and S. Sanyal, "Global stability of complexvalued neural networks on time scales," Differ. Equ. Dyn. Syst., vol. 19, nos. 1-2, pp. 3-11, Jan. 2011.
43. W.-H. Chen and W. X. Zheng, "A new method for complete stability analysis of cellular neural networks with time delay," IEEE Trans. Neural Netw., vol. 21, no. 7, pp. 1126-1139, Jul. 2010.
44. Z. Zeng and W. X. Zheng, "Multistability of neural networks with timevarying delays and concave-convex characteristics," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 2, pp. 293-305, Feb. 2012.
45. L. Zhang, Z. Yi, J. Yu, and P. A. Heng, "Some multistability properties of bidirectional associative memory recurrent neural networks with unsaturating piecewise linear transfer functions," Neurocomputing, vol. 72, nos. 16-18, pp. 3809-3817, Oct. 2009.
46. K. C. Tan, H. Tang, and W. Zhang, "Qualitative analysis for recurrent neural networks with linear threshold transfer functions," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 52, no. 5, pp. 1003-1012, May 2005. (Pubitemid 40773626)
47. X. Xie, R. H. Hahnloser, and H. S. Seung, "Selectively grouping neurons in recurrent networks of lateral inhibition," Neural Comput., vol. 14, no. 11, pp. 2627-2646, Nov. 2002.
48. L. Zhang, Z. Yi, and J. Yu, "Multiperiodicity and attractivity of delayed recurrent neural networks with unsaturating piecewise linear transfer functions," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 158-167, Jan. 2008. (Pubitemid 351279234)
49. R. L. T. Hahnloser, "On the piecewise analysis of networks of linear threshold neurons," Neural Netw., vol. 11, no. 4, pp. 691-697, Jun. 1998. (Pubitemid 28400269)
50. H. Tang, K. C. Tan, and E. J. Teoh, "Dynamics analysis and analog associative memory of networks with LT neurons," IEEE Trans. Neural Netw., vol. 17, no. 2, pp. 409-418, Mar. 2006. (Pubitemid 43380064)
51. H. Wersing, W. J. Beyn, and H. Ritter "Dynamical stability conditions for recurrent neural networks with unsaturating piecewise linear transfer functions," Neural Comput., vol. 13, no. 8, pp. 1811-1825, Sep. 2001. (Pubitemid 33594317)
52. Z. Yi, K. K. Tan, and T. H. Lee, "Multistability analysis for recurrent neural networks with unsaturating piecewise linear transfer functions," Neural Comput., vol. 15, no. 3, pp. 639-662, Mar. 2003. (Pubitemid 37049820)
53. L. Zhang, Z. Yi, S. L. Zhang, and P. A. Heng, "Activity invariant sets and exponentially stable attractors of linear threshold discrete-time recurrent neural networks," IEEE Trans. Autom. Control, vol. 54, no. 6, pp. 1341-1347, Jun. 2009.
54. M. Forti, "Some extensions of a new method to analyze complete stability of neural networks," IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1230-1238, Sep. 2002.
55. M. Forti and A. Tesi, "A new method to analyze complete stability of PWL cellular neural networks," Int. J. Bifurc. Chaos, vol. 11, no. 3, pp. 655-676, Mar. 2001.
56. J. Si and A. N. Michel, "Analysis and synthesis of a class of discretetime neural networks with multilevel threshold neurons," IEEE Trans. Neural Netw., vol. 6, no. 1, pp. 105-116, Jan. 1995.
57. C. W. Wu and L. O. Chua, "A more rigorous proof of complete stability of cellular neural networks," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 44, no. 4, pp. 370-371, Apr. 1997. (Pubitemid 127768836)
58. Z. Yi and K. K. Tan, "Multistability of discrete-time recurrent neural networks with unsaturating piecewise linear activation functions," IEEE Trans. Neural Netw., vol. 15, no. 2, pp. 329-336, Mar. 2004.
59. Z. Yi, K. K. Tan, L. Zhang, and J. Yu, "Permitted and forbidden sets in discrete-time linear threshold recurrent neural networks," IEEE Trans. Neural Netw., vol. 20, no. 6, pp. 952-963, Jun. 2009.
60. W. Zhou and J. M. Zurada, "Discrete-time recurrent neural networks with complex-valued linear threshold neurons," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 56, no. 8, pp. 669-673, Aug. 2009.
61. W. Zhou and J.M. Zurada, "A class of discrete time recurrent neural networks with multivalued neurons," Neurocomputing, vol. 72, nos. 16-18, pp. 3782-3788, Oct. 2009.
62. N. Takahashi and L. O. Chua, "On the complete stability of nonsymmetric cellular neural networks," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 45, no. 7, pp. 754-758, Jul. 1998. (Pubitemid 128745119)
63. M. A. Cohen and S. Grossberg, "Absolute stability of global pattern formation and parallel memory storage by competitive neural networks," IEEE Trans. Syst. Man Cybern., vol. 13, no. 5, pp. 815-826, Sep. 1983.
64. Q. Zhang, X. P. Wei, and J. Xu, "An improved result for complete stability of delayed cellular neural networks," Automatica, vol. 41, no. 2, pp. 333-337, Feb. 2005. (Pubitemid 41536584)
65. Z. Zeng and J. Wang, "Complete stability of cellular neural networks with time-varying delay," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 53, no. 4, pp. 944-955, Apr. 2006.
66. N. Takahashi and T. Nishi, "A generalization of some complete stability conditions for cellular neural networks with delay," IEICE Trans. Fundam. Electron. Commun. Comput. Sci., vol. E85-A, no. 9, pp. 2044-2051, Sep. 2002.
67. N. Takahashi, "A new sufficient condition for complete stability of cellular neural networks with delay," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 47, no. 6, pp. 793-799, Jun. 2000.