Limit set dichotomy and multistability for a class of cooperative neural networks with delays

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 9, 2012, Pages 1473-1485

  Di Marco, Mauro ^a   Forti, Mauro ^a   Grazzini, Massimo ^a   Pancioni, Luca ^a  

^a UNIVERSITY OF SIENA   (Italy)

Author keywords

Cooperative dynamical systems; delayed neural networks; limit set dichotomy; monotone semiflows; multistability

Indexed keywords

COOPERATIVE DYNAMICAL SYSTEMS; DELAYED NEURAL NETWORKS; LIMIT SET DICHOTOMIES; MONOTONE SEMI-FLOWS; MULTI STABILITIES;

DYNAMICAL SYSTEMS; PIECEWISE LINEAR TECHNIQUES;

NEURAL NETWORKS;

ALGORITHM; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; FEEDBACK SYSTEM; PROCEDURES; STATISTICAL MODEL;

ALGORITHMS; COMPUTER SIMULATION; FEEDBACK; MODELS, STATISTICAL; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED;

EID: 84876136561     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2205703     Document Type: Article

References (67)

1. M. A. Cohen and S. Grossberg, "Absolute stability of global pattern formation and parallel memory storage by competitive neural networks," IEEE Trans. Syst., Man, Cybern., vol. 13, no. 5, pp. 815-825, Sep.-Oct. 1983.
2. L. O. Chua and L. Yang, "Cellular neural networks: Theory," IEEE Trans. Circuits Syst., vol. 35, no. 10, pp. 1257-1272, Oct. 1988.
3. J. H. Li, A. N. Michel, and W. Porod, "Qualitative analysis and synthesis of a class of neural networks," IEEE Trans. Circuits Syst., vol. 35, no. 8, pp. 976-986, Aug. 1988.
4. P. Thiran, G. Setti, and M. Hasler, "An approach to information propagation in 1-D cellular neural networks-part I: Local diffusion," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 45, no. 8, pp. 777-789, Aug. 1998.
5. M. Gilli, "Stability of cellular neural networks and delayed cellular neural networks with nonpositive templates and nonmonotonic output functions," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 41, no. 8, pp. 518-528, Aug. 1994.
6. Z. Zeng and J. Wang, "Complete stability of cellular neural networks with time-varying delays," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 53, no. 4, pp. 944-955, Apr. 2006.
7. C. Cheng, K. Lin, and C. Shih, "Multistability and convergence in delayed neural networks," Phys. D, Nonlinear Phenomena, vol. 225, pp. 61-74, Jan. 2007.
8. J. Cao, G. Feng, and Y. Wang, "Multistability and multiperiodicity of delayed Cohen-Grossberg neural networks with a general class of activation functions," Phys. D, vol. 237, no. 13, pp. 1734-1749, 2008.
9. M. Di Marco, M. Forti, M. Grazzini, P. Nistri, and L. Pancioni, "Lyapunov method and convergence of the full-range model of CNNs," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 55, no. 11, pp. 3528-3541, Dec. 2008.
10. Z. Zeng, T. Huang, and W. Zheng, "Multistability of recurrent neural networks with time-varying delays and the piecewise linear activation function," IEEE Trans. Neural Netw., vol. 21, no. 8, pp. 1371-1377, Aug. 2010.
11. W. Chen and W. Zheng, "A new method for complete stability analysis of cellular neural networks with time delay," IEEE Trans. Neural Netw., vol. 21, no. 7, pp. 1126-1139, Jul. 2010.
12. G. Huang and J. Cao, "Delay-dependent multistability in recurrent neural networks," Neural Netw., vol. 23, no. 2, pp. 201-209, 2010.
13. W. Pan, Z. Wang, H. Gao, and X. Liu, "Monostability and multistability of genetic regulatory networks with different types of regulation functions," Nonlinear Anal., Real World Appl., vol. 11, no. 4, pp. 3170-3185, Aug. 2010.
14. W. Lu, L.Wang, and T. Chen, "On attracting basins of multiple equilibria of a class of cellular neural networks," IEEE Trans. Neural Netw., vol. 22, no. 3, pp. 381-394, Mar. 2011.
15. L. O. Chua and T. Roska, "Stability of a class of nonreciprocal neural networks," IEEE Trans. Circuits Syst., vol. 37, no. 12, pp. 1520-1527, Dec. 1990.
16. K. Wang and A. N. Michel, "Robustness and perturbation analysis of a class of nonlinear systems with applications to neural networks," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 41, no. 1, pp. 24-32, Jan. 1994.
17. M. Di Marco, M. Forti, and A. Tesi, "Existence and characterization of limit cycles in nearly symmetric neural networks," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 49, no. 7, pp. 979-992, Jul. 2002.
18. C. M. Marcus and R. M. Westervelt, "Stability of analog neural network with delay," Phys. Rev. A, vol. 39, no. 1, pp. 347-359, 1989.
19. P. V. D. Driessche and X. Zou, "Global attractivity in delayed Hopfield neural network models," SIAM J. Appl. Math., vol. 58, pp. 1878-1890, Dec. 1998.
20. J. Li, A. N. Michel, and W. Porod, "Analysis and synthesis of a class of neural networks: Linear systems operating on a closed hypercube," IEEE Trans. Circuits Syst., vol. 36, no. 11, pp. 1405-1422, Nov. 1989.
21. P. P. Civalleri, M. Gilli, and L. Pandolfi, "On stability of cellular neural networks with delay," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 40, no. 3, pp. 157-165, Mar. 1993.
22. P. Baldi and A. F. Atiya, "How delays affect neural dynamics and learning," IEEE Trans. Neural Netw., vol. 5, no. 4, pp. 612-621, Apr. 1994.
23. H. Ye, A. Michel, and K. Wang, "Qualitative analysis of Cohen-Grossberg neural networks with multiple delays," Phys. Rev. E, vol. 51, no. 3, pp. 2611-2618, 1995.
24. L. O. Chua and T. Roska, Cellular Neural Networks and Visual Computing: Foundation and Applications. Cambridge, U.K.: Cambridge Univ. Press, 2005.
25. J. J. Hopfield, "Neurons with graded response have collective computational properties like those of two-state neurons," Proc. Nat. Acad. Sci., vol. 81, pp. 3088-3092, May 1984.
26. S. Haykin, Neural Networks: A Comprehensive Foundation. Englewood Cliffs, NJ: Prentice-Hall, 1999.
27. M. P. Kennedy and L. O. Chua, "Unifying the Tank and Hopfield linear programming circuit and the canonical nonlinear programming circuit of Chua and Lin," IEEE Trans. Circuits Syst., vol. 34, no. 2, pp. 210-214, Feb. 1987.
28. M. Forti and A. Tesi, "New conditions for global stability of neural networks with application to linear and quadratic programming problems," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 42, no. 7, pp. 354-366, Jul. 1995.
29. M. Forti and A. Tesi, "A new method to analyze complete stability of PWL cellular neural networks," Int. J. Bifurcat. Chaos, vol. 11, no. 3, pp. 655-676, Mar. 2001.
30. C. W. Shih, "Complete stability for a class of cellular neural networks," Int. J. Bifurcat. Chaos, vol. 11, pp. 169-177, Jan. 2001.
31. Z. Yi, K. K. Tan, and T. H. Lee, "Multistability analysis for recurrent neural networks with unsaturating piecewise linear transfer functions," Neural Comput., vol. 15, pp. 639-662, Mar. 2003.
32. W. Lu, L. Wang, and T. Chen, "Coexistence and local stability of multiple equilibria in neural networks with piecewise linear nondecreasing activation functions," Neural Netw., vol. 23, no. 2, pp. 189-200, Mar. 2010.
33. L. O. Chua, C. A. Desoer, and E. S. Kuh, Linear and Nonlinear Circuits. New York: McGraw-Hill, 1987.
34. J. Lin and R. Unbehauen, "Canonical piecewise-linear networks," IEEE Trans. Neural Netw., vol. 6, no. 1, pp. 43-50, Jan. 1995.
35. M. Di Marco, M. Forti, M. Grazzini, and L. Pancioni, "Limit set dichotomy and convergence of cooperative piecewise linear neural networks," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 58, no. 5, pp. 1052-1062, May 2011.
36. M. Di Marco, M. Forti, M. Grazzini, and L. Pancioni, "Convergence of a class of cooperative standard cellular neural network arrays," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 59, no. 4, pp. 772-783, Apr. 2012.
37. H. L. Smith, "Monotone dynamical systems: An introduction to the theory of competitive and cooperative systems," in Mathematical Surveys and Monographs, vol. 41. Providence, RI: AMS, 1995.
38. M. Hirsch and H. Smith, "Monotone dynamical systems," in Handbook of Differential Equations, Ordinary Differential Equations, vol. 2, A. Canada, P. Drabek, and A. Fonda, Eds. Amsterdam, The Netherlands: Elsevier, 2005
39. H. Smith, "Monotone semiflows generated by functional differential equations," J. Different. Equations, vol. 66, no. 3, pp. 420-442, 1987.
40. E. D. Sontag and Y. Wang, "A cooperative system which does not satisfy the limit set dichotomy," J. Different. Equations, vol. 224, no. 2, pp. 373-384, 2006.
41. D. Angeli, M. W. Hirsch, and E. D. Sontag, "Attractors in coherent systems of differential equations," J. Different. Equations, vol. 246, pp. 3058-3076, Jan. 2009.
42. H. H. Shaefer, Banach Lattices and Positive Operators. Berlin, Germany: Springer-Verlag, 1974.
43. J. K. Hale and S. M. V. Lunel, Introduction to Functional Differential Equations (Applied Mathematical Sciences), vol. 99. New York: Springer-Verlag, 1993.
44. T. Roska, C. W. Wu, M. Balsi, and L. O. Chua, "Stability and dynamics of delay-type general and cellular neural networks," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 39, no. 6, pp. 487-490, Jun. 1992.
45. H. Smith, An Introduction to Delay Differential Equations with Applications to the Life Sciences (Texts in Applied Mathematics). New York: Springer-Verlag, 2010.
46. M. Di Marco, M. Forti, M. Grazzini, and L. Pancioni, "A note on the dichotomy of limit sets for cooperative CNNs with delays," in Proc. IEEE Int. Symp. Circuits Syst., Paris, France, Jun. 2010, pp. 2035-2038.
47. M. Di Marco, M. Forti, M. Grazzini, and L. Pancioni, "The dichotomy of omega-limit sets fails for cooperative standard CNNs," in Proc. Cellular Nanoscale Netw. Appl., Berkeley, CA, Feb. 2010, pp. 1-5.
48. W. Walter, "On strongly monotone flows," Ann. Polonici Math. LXVI, vol. 21, pp. 269-274, 1997.
49. Q. Zhang, X. Wei, and J. Xu, "An improved result for complete stability of delayed cellular neural networks," Automatica, vol. 41, pp. 333-337, Feb. 2005.
50. X. Li, C. Ma, and L. Huang, "Invariance principle and complete stability for cellular neural networks," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 53, no. 3, pp. 202-206, Mar. 2006.
51. C. Shih and J. Tseng, "Convergent dynamics for multistable delayed neural networks," Nonlinearity, vol. 21, no. 10, pp. 2361-2389, 2008.
52. N. Takahashi and L. Chua, "On the complete stability of nonsymmetric cellular neural networks," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 45, no. 7, pp. 754-758, Jul. 1998.
53. N. Takahashi, "A new sufficient condition for complete stability of cellular neural networks with delay," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 47, no. 6, pp. 793-799, Jun. 2000.
54. X. Liao, J. Wang, and Z. Zeng, "Global asymptotic stability and global exponential stability of delayed cellular neural networks," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 52, no. 7, pp. 403-409, Jul. 2005.
55. M. Hirsch, "Convergent activation dynamics in continuous time networks," Neural Netw., vol. 2, no. 5, pp. 331-349, 1989.
56. T. Roska, C. W. Wu, M. Balsi, and L. Chua, "Stability and dynamics of delay-type general and cellular neural networks," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 39, no. 6, pp. 487-490, Jun. 1992.
57. G. Setti, P. Thiran, and C. Serpico, "An approach to information propagation in 1-D cellular neural networks-part II: Global propagation," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 45, no. 8, pp. 790-811, Aug. 1998.
58. L. O. Chua and C. W. Wu, "On the universe of stable cellular neural networks," Int. J. Circuit Theory Appl., vol. 20, pp. 497-517, Sep.-Oct. 1992.
59. P. Thiran, Dynamics and Self-Organization of Locally Coupled Neural Networks. Lausanne, Switzerland: Presses Polytechniques et Universitaires Romandes, 1997.
60. H. Matano, "Existence of nontrivial unstable sets for equilibriums of strongly order-preserving systems," J. Faculty Sci. Univ. Tokyo, vol. 30, no. 3, pp. 645-673, 1984.
61. H. L. Smith and H. R. Thieme, "Quasi convergence and stability for strongly order-preserving semiflows," SIAM J. Math. Anal., vol. 21, no. 3, pp. 673-692, May 1990.
62. H. L. Smith and H. Thieme, "Strongly order-preserving semiflows generated by functional differential equations," J. Different. Equations, vol. 93, pp. 332-363, May 1991.
63. H. L. Smith and H. R. Thieme, "Convergence for strongly orderpreserving semiflows," SIAM J. Math. Anal., vol. 22, no. 4, pp. 1081-1101, Jul. 1991.
64. T. Yi and L. Huang, "Convergence and stability for essentially strongly order-preserving semiflows," J. Different. Equations, vol. 221, no. 1, pp. 36-57, Feb. 2006.
65. T. Yi and L. Huang, "Dynamics of smooth essentially strongly order-preserving semiflows with application to delay differential equations," J. Math. Anal. Appl., vol. 338, no. 2, pp. 1329-1339, Feb. 2008.
66. J. Jiang and Y. Wang, "On the ω-limit set dichotomy of cooperating Kolmogorov systems," Positivity, vol. 7, no. 3, pp. 185-194, 2003.
67. G. Sansone, Equazioni Differenziali in Campo Reale, vol. 11. Bologna, Italy: Zanichelli, 1948.