Limit set dichotomy and convergence of cooperative piecewise linear neural networks

IEEE Transactions on Circuits and Systems I: Regular Papers

Volumn 58, Issue 5, 2011, Pages 1052-1062

  Di Marco, Mauro ^a   Forti, Mauro ^a   Grazzini, Massimo ^a   Pancioni, Luca ^a  

^a UNIVERSITY OF SIENA   (Italy)

Author keywords

Convergence; cooperative neural networks; dynamical systems; limit set dichotomy; monotone and eventually strongly monotone semiflows

Indexed keywords

CHEMICAL ACTIVATION; DYNAMICAL SYSTEMS; LINEAR NETWORKS; NEURONS; PIECEWISE LINEAR TECHNIQUES;

CONVERGENCE; COOPERATIVE NEURAL NETWORKS; HORIZONTAL SEGMENTS; LIMIT SET DICHOTOMIES; MONOTONE SEMI-FLOWS; PIECEWISE-LINEAR NEURAL NETWORK; STRONGLY-MONOTONES; TECHNIQUES AND TOOLS;

NEURAL NETWORKS;

EID: 79955522019     PISSN: 15498328     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSI.2010.2091194     Document Type: Article

References (43)

1. H. L. Smith, Monotone Dynamical Systems: An Introduction to the Theory of Competitive and Cooperative Systems, ser. Mathematical Surveys and Monographs. Providence, RI: Amer. Math. Soc., 1995, 41.
2. M. Hirsch and H. Smith, Monotone dynamical systems in Handbook of Differential Equations, Ordinary Differential Equations (Second Volume), A. Canada, P. Drabek, A. Fonda, Eds. Amsterdam, The Netherlands: Elsevier, 2005 [Online]. Available: http://math.la.asu.edu/halsmith/book.html
3. M. W. Hirsch, Systems of differential equations which are competitive or cooperative. I: Limit sets SIAM J. Math. Anal., 13, 167-179, 1982.
4. M. W. Hirsch, Systems of differential equations which are competitive or cooperative. II: Convergence almost everywhere SIAM J. Math. Anal., 16, 423-439, 1985.
5. M. W. Hirsch, Stability and convergence in strongly monotone dynamical systems J. Reine Angew. Math., 383, 1-53, 1988.
6. H. L. Smith and H. R. Thieme, Quasi convergence and stability for strongly order-preserving semiflows SIAM J. Math. Anal., 21, 3, 673-692, 1990.
7. H. L. Smith and H. Thieme, Strongly order preserving semiflows generated by functional differential equations J. Differential Equations, 93, 332-363, May 1991.
8. H. L. Smith and H. R. Thieme, Convergence for strongly order-preserving semiflows SIAM J. Math. Anal., 22, 4, 1081-1101, 1991.
9. P. Hess, Periodic-Parabolic Boundary Value Problems and Positivity. New York: Longman Scientific and Technical, 1991.
10. D. Angeli and E. D. Sontag, Monotone control systems IEEE Trans. Autom. Control, 48, 1684-1698, Oct. 2003.
11. E. D. Sontag and Y.Wang, A cooperative system which does not satisfy the limit set dichotomy J. Differential Equations, 224, 373-384, 2006. (Pubitemid 43592017)
12. M. Hirsch, Convergent activation dynamics in continuous time networks Neural Netw., 2, 331-349, 1989. (Pubitemid 20609006)
13. L. O. Chua and T. Roska, Stability of a class of nonreciprocal neural networks IEEE Trans. Circuits Syst., 37, 1520-1527, Dec. 1990.
14. T. Roska, C. W.Wu,M. Balsi, L. O. Chua, Stability and dynamics of delay-type general and cellular neural networks IEEE Trans. Circuits Syst. I, 39, 487-490, Jun. 1992.
15. A. Berman and R. J. Plemmons, Nonnegative Matrices in the Mathematical Sciences. New York: Academic, 1979.
16. L. O. Chua and L. Yang, Cellular neural networks: Theory IEEE Trans. Circuits Syst., 35, 10, 1257-1272, Oct. 1988.
17. J. Li, A. N. Michel, W. Porod, Analysis and synthesis of a class of neural networks: Linear systems operating on a closed hypercube IEEE Trans. Circuits Syst., 36, 1405-1422, Nov. 1989. (Pubitemid 20642393)
18. M. P. Kennedy and L. O. Chua, Neural networks for nonlinear programming IEEE Trans. Circuits Syst. I, 35, 554-562, May 1988.
19. R. Dogaru, K. R. Crounse, L. O. Chua, Pyramidal cells: A novel class of adaptive coupling cells and their applications for cellular neural networks IEEE Trans. Circuits Syst. I, 45, 1077-1090, Oct. 1998. (Pubitemid 128745935)
20. J. D. Yu and R. W. Newcomb, A multilevel neural network for A/D conversion IEEE Trans. Neural Netw., 4, 470-483, May 1993.
21. J. Lin and R. Unbehauen, Canonical piecewise-linear networks IEEE Trans. Neural Netw., 6, 43-50, 1995.
22. C. W. Shih, Complete stability for a class of cellular neural networks Int. J. Bifurcation Chaos, 11, 169-177, 2001.
23. M. Di Marco, M. Forti, M. Grazzini, L. Pancioni, The dichotomy of omega-limit sets fails for cooperative standard CNNs presented at the CNNA2010, Berkeley, CA, Feb. 3-5, 2010.
24. J. Hopfield, Neural networks and physical systems with emergent collective computational abilities Proc. Nat. Acad. Sci., 79, 2554-2558, Apr. 1982.
25. J. H. Li, A. N. Michel, W. Porod, Qualitative analysis and synthesis of a class of neural networks IEEE Trans. Circuits Syst., 35, 8, 976-986, Aug. 1988.
26. A. N. Michel, J. A. Farrell, W. Porod, Qualitative analysis of neural networks IEEE Trans. Circuits Syst., 36, 2, 229-243, Feb. 1989.
27. P. P. Civalleri, M. Gilli, L. Pandolfi, On stability of cellular neural networks with delay IEEE Trans. Circuits Syst. I, 40, 157-165, 1993.
28. M. Forti and A. Tesi, Absolute stability of analytic neural networks: An approach based on finite trajectory length IEEE Trans. Circuits Syst. I, 51, 12, 2460-2469, Dec. 2004. (Pubitemid 40009467)
29. M. Di Marco, M. Forti, M. Grazzini, P. Nistri, L. Pancioni, Lyapunov method and convergence of the full-range model of CNNs IEEE Trans. Circuits Syst. I, 55, 11, 3528-3541, Dec. 2008.
30. M. Vidyasagar, Minimum-seeking properties of analog neural networks with multilinear objective functions IEEE Trans. Autom. Control, 40, 1359-1375, Aug. 1995.
31. S. Hu and J.Wang, Absolute exponential stability of a class of continuous- time recurrent neural networks IEEE Trans. Neural Netw., 14, 1, 35-45, Jan. 2003.
32. Z. Zeng and J. Wang, Complete stability of cellular neural networks with time-varying delays IEEE Trans. Circuits Syst. I, 53, 4, 944-955, Apr. 2006.
33. W. Lu and J. Wang, Convergence analysis of a class of nonsmooth gradient systems IEEE Trans. Circuits Syst. I, 55, 11, 3514-3527, Dec. 2008.
34. M. Di Marco, M. Forti, A. Tesi, Existence and characterization of limit cycles in nearly symmetric neural networks IEEE Trans. Circuits Syst. I, 49, 7, 979-992, Jul. 2002. (Pubitemid 34861844)
35. M. Di Marco, M. Forti, M. Grazzini, L. Pancioni, Limit set dichotomy and convergence of semiflows defined by cooperative standard CNNs Int. J. Bifurcation Chaos, to be published.
36. C. Kuratowski, Topologie I et II. Sceaux, France: Editions Jacques Gabay, 1992.
37. H. Matano, Existence of nontrivial unstable sets for equilibriums of strongly order preserving systems J. Fac. Sci. Univ. Tokio, 30, 645-673, 1984.
38. T. Yi and L. Huang, Convergence and stability for essentially strongly order-preserving semiflows J. Differential Equations, 221, 1, 36-57, 2006. (Pubitemid 43056749)
39. T. Yi and L. Huang, Dynamics of smooth essentially strongly orderpreserving semiflows with application to delay differential equations J. Math. Anal. Appl., 338, 2, 1329-1339, 2008.
40. J. Jiang and Y. Wang, On the w-limit set dichotomy of cooperating kolmogorov systems Positivity, 7, 3, 185-194, 2003. (Pubitemid 38118199)
41. D. Angeli, M. W. Hirsch, E. D. Sontag, Attractors in coherent systems of differential equations J. Differential Equations, 246, 3058-3076, 2009.
42. B. R. Gelbaum, Linear Algebra: Basics, Practice and Theory. New York: North-Holland, 1989.
43. G. Sansone, Equazioni Differenziali in Campo Reale. Bologna, Italy: Zanichelli, 1948, 11.