Multistability of second-order competitive neural networks with nondecreasing saturated activation functions

IEEE Transactions on Neural Networks

Volumn 22, Issue 11, 2011, Pages 1694-1708

  Nie, Xiaobing ^a   Cao, Jinde ^a  

^a SOUTHEAST UNIVERSITY   (China)

Author keywords

Competitive neural networks; multistability; saturated activation functions; second order interactions

Indexed keywords

ACTIVATION FUNCTIONS; COMPETITIVE NEURAL NETWORK; CORNER POINT; DECOMPOSITION OF STATE SPACE; EQUILIBRIUM POINT; EXPONENTIALLY STABLE; INEQUALITY TECHNIQUES; LOCAL EXPONENTIAL STABILITY; MULTISTABILITY; SATURATED ACTIVATION FUNCTIONS; SECOND ORDERS; SECOND-ORDER INTERACTION; SUFFICIENT CONDITIONS; SUFFICIENT CRITERION;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; STATISTICAL MODEL;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SIMULATION; LINEAR MODELS; MODELS, STATISTICAL; NEURAL NETWORKS (COMPUTER);

EID: 80455154999     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2164934     Document Type: Article

References (40)

1. A. Meyer-Base, S. S. Pilyugin, and Y. Chen, "Global exponential stability of competitive neural networks with different times scales," IEEE Trans. Neural Netw., vol. 14, no. 3, pp. 716-719, May 2003.
2. H. Lu and Z. He, "Global exponential stability of delayed competitive neural networks with different time scales," Neural Netw., vol. 18, no. 3, pp. 243-250, Apr. 2005.
3. H. Lu and S. Amari, "Global exponential stability of multitime scale competitive neural networks with nonsmooth functions," IEEE Trans. Neural Netw., vol. 17, no. 5, pp. 1152-1164, Sep. 2006.
4. X. Nie and J. Cao, "Exponential stability of competitive neural networks with time-varying and distributed delays," Proc. Inst. Mech. Eng., Part I: J. Syst. Control Eng., vol. 222, no. 6, pp. 583-594, Sep. 2008.
5. E. Kosmatopoulos and M. Christodoulou, "Structural properties of gradient recurrent high-order neural networks," IEEE Trans. Circuits Syst. II, vol. 42, no. 9, pp. 592-603, Sep. 1995.
6. P. Paretto and J. Niez, "Long term memory storage capacity of multiconnected neural networks," Biol. Cybern., vol. 54, no. 1, pp. 53-63, 1986.
7. A. Dembo, O. Farotimi, and T. Kailath, "High-order absolutely stable neural networks," IEEE Trans. Circuits Syst., vol. 38, no. 1, pp. 57-65, Jan. 1991.
8. A. Y. Alanis, E. N. Sanchez, and A. G. Loukianov, "Discrete-time adaptive backstepping nonlinear control via high-order neural networks," IEEE Trans. Neural Netw., vol. 18, no. 4, pp. 1185-1195, Jul. 2007.
9. S. Zhang, Z. Jing, and J. Li, "Fast learning high-order neural networks for pattern recognition," Electron. Lett., vol. 40, no. 19, pp. 1207-1208, Sep. 2004.
10. J. Cao, J. Liang, and J. Lam, "Exponential stability of high-order bidirectional associative memory neural networks with time delays," Phys. D, vol. 199, no. 3, pp. 425-436, Dec. 2004.
11. D. W. C. Ho, J. Liang, and J. Lam, "Global exponential stability of impulsive high-order BAM neural networks with time-varying delays," Neural Netw., vol. 19, no. 10, pp. 1581-1590, Dec. 2006.
12. H. Gu, H. Jiang, and Z. Teng, "Stability and periodicity in high-order neural networks with impulsive effects," Nonlin. Anal.: TMA, vol. 68, no. 10, pp. 3186-3200, May 2008.
13. X. Liu and Q. Wang, "Impulsive stabilization of high-order Hopfieldtype neural networks with time-varying delays," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 71-79, Jan. 2008.
14. C. Zheng, H. Zhang, and Z. Wang, "Novel exponential stability criteria of high-order neural networks with time-varying delays," IEEE Trans. Syst., Man, Cybern., vol. 41, no. 2, pp. 486-496, Apr. 2011.
15. L. O. Chua and L. Yang, "Cellular neural networks: Theory," IEEE Trans. Circuits Syst., vol. 35, no. 10, pp. 1257-1272, Oct. 1988.
16. J. Hopfield, "Neurons with graded response have collective computational properties like those of two state neurons," Proc. Natl. Acad. Sci. Unit. States Amer., vol. 81, no. 10, pp. 3088-3092, May 1984.
17. M. Morita, "Associative memory with nonmonotone dynamics," Neural Netw., vol. 6, no. 1, pp. 115-126, 1993.
18. J. Foss, A. Longtin, B. Mensour, and J. Milton, "Multistability and delayed recurrent loops," Phys. Rev. Lett., vol. 76, no. 4, pp. 708-711, Jan. 1996.
19. Z. Zeng and J. Wang, "Multiperiodicity and exponential attractivity evoked by periodic external inputs in delayed cellular neural networks," Neural Comput., vol. 18, no. 4, pp. 848-870, Apr. 2006.
20. Z. Zeng and J. Wang, "Multiperiodicity of discrete-time delayed neural networks evoked by periodic external inputs," IEEE Trans. Neural Netw., vol. 17, no. 5, pp. 1141-1151, Sep. 2006.
21. J. Cao, G. Feng, and Y. Wang, "Multistability and multiperiodicity of delayed Cohen-Grossberg neural networks with a general class of activation functions," Phys. D, vol. 237, no. 13, pp. 1734-1749, Aug. 2008.
22. C. Cheng, K. Lin, and C. Shih, "Multistability in recurrent neural networks," SIAM J. Appl. Math., vol. 66, no. 4, pp. 1301-1320, Mar. 2006.
23. C. Cheng, K. Lin, and C. Shih, "Multistability and convergence in delayed neural networks," Phys. D, vol. 225, no. 1, pp. 61-74, Jan. 2007.
24. X. Nie and J. Cao, "Multistability of competitive neural networks with time-varying and distributed delays," Nonlin. Anal.: RWA, vol. 10, no. 2, pp. 928-942, Apr. 2009.
25. K. Lin and C. Shih, "Multiple almost periodic solutions in nonautonomous delayed neural networks," Neural Comput., vol. 19, no. 12, pp. 3392-3420, Dec. 2007.
26. C. Cheng and C. Shih, "Complete stability in multistable delayed neural networks," Neural Comput., vol. 21, no. 3, pp. 719-740, Mar. 2009.
27. G. Huang and J. Cao, "Multistability in bidirectional associative memory neural networks," Phys. Lett. A, vol. 372, no. 16, pp. 2842-2854, Apr. 2008.
28. G. Huang and J. Cao, "Delay-dependent multistability in recurrent neural networks," Neural Netw., vol. 23, no. 2, pp. 201-209, Mar. 2010.
29. Z. Yi and K. Tan, "Multistability of discrete-time recurrent neural networks with unsaturating piecewise linear activation functions," IEEE Trans. Neural Netw., vol. 15, no. 2, pp. 329-336, Mar. 2004.
30. L. Zhang, Z. Yi, and J. Li, "Multiperiodicity and attractivity of delayed recurrent neural networks with unsaturating piecewise linear transfer functions," IEEE Trans. Neural Netw., vol. 19, no. 1, pp. 158-167, Jan. 2008.
31. Z. Huang, X. Wang, and C. Feng, "Multiperiodicity of periodically oscillated discrete-time neural networks with transient excitatory selfconnections and sigmoidal nonlinearities," IEEE Trans. Neural Netw., vol. 21, no. 10, pp. 1643-1655, Oct. 2010.
32. L. Wang, W. Lu, and T. Chen, "Multistability and new attraction basins of almost-periodic solutions of delayed neural networks," IEEE Trans. Neural Netw., vol. 20, no. 10, pp. 1581-1593, Oct. 2009.
33. L. Wang, W. Lu, and T. Chen, "Coexistence and local stability of multiple equilibria in neural networks with piecewise linear nondecreasing activation functions," Neural Netw., vol. 23, no. 2, pp. 189-200, Mar. 2010.
34. W. Pan, Z. Wang, H. Gao, and X. Liu, "Monostability and multistability of genetic regulatory networks with different types of regulation functions," Nonlin. Anal.: RWA, vol. 11, no. 4, pp. 3170-3185, Aug. 2010.
35. W. Pan, Z. Wang, H. Gao, Y. Li, and M. Du, "On multistability of delayed genetic regulatory networks with multivariable regulation functions," Math. Biosci., vol. 228, no. 1, pp. 100-109, Nov. 2010.
36. Z. Zeng, T. Huang, and W. Zheng, "Multistability of recurrent neural networks with time-varying delays and the piecewise linear activation function," IEEE Trans. Neural Netw., vol. 21, no. 8, pp. 1371-1377, Aug. 2010.
37. E. Kaslik and S. Sivasundaram, "Impulsive hybrid discrete-time Hopfield neural networks with delays and multistability analysis," Neural Netw., vol. 24, no. 4, pp. 370-377, May 2011.
38. E. Kaslik and S. Sivasundaram, "Multiple periodic solutions in impulsive hybrid neural networks with delays," Appl. Math. Comput., vol. 217, no. 10, pp. 4890-4899, Jan. 2011.
39. Z. Huang, Q. Song, and C. Feng, "Multistability in networks with selfexcitation and high-order synaptic connectivity," IEEE Trans. Circuits Syst. I, vol. 57, no. 8, pp. 2144-2155, Aug. 2010.
40. Z. Huang, C. Feng, and S. Mohamad, "Multistable learning dynamics in second-order neural networks with time-varying delays," Int. J. Comput. Math., vol. 88, no. 7, pp. 1327-1346, May 2011.