Convergent dynamics of nonreciprocal differential variational inequalities modeling neural networks

IEEE Transactions on Circuits and Systems I: Regular Papers

Volumn 60, Issue 12, 2013, Pages 3227-3238

  Di Marco, Mauro ^a   Forti, Mauro ^a   Grazzini, Massimo ^a   Pancioni, Luca ^a  

^a UNIVERSITY OF SIENA   (Italy)

Author keywords

Convergence; cooperative dynamical systems; differential variational inequalities; Kamke M ller condition; limit set dichotomy; neural networks

Indexed keywords

DYNAMICAL SYSTEMS; JACOBIAN MATRICES; LINEAR SYSTEMS; NEURAL NETWORKS; VARIATIONAL TECHNIQUES;

CONTINUOUSLY DIFFERENTIABLE; CONVERGENCE; CONVERGENCE OF SOLUTIONS; COOPERATIVE DYNAMICAL SYSTEMS; DIFFERENTIAL INCLUSIONS; DIFFERENTIAL VARIATIONAL INEQUALITY; LIMIT SET DICHOTOMIES; MULTIPLE EQUILIBRIUM POINTS;

CELLULAR NEURAL NETWORKS;

EID: 84890047563     PISSN: 15498328     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSI.2013.2265959     Document Type: Article

References (52)

1. M. A. Cohen and S. Grossberg, "Absolute stability of global pattern formation and parallel memory storage by competitive neural networks," IEEE Trans. Syst., Man, Cybern., vol. SMC-13, pp. 815-825, Sep./Oct. 1983.
2. L. O. Chua and L. Yang, "Cellular neural networks: Theory," IEEE Trans. Circuits Syst., vol. 35, no. 10, pp. 1257-1272, Oct. 1988.
3. J. H. Li, A. N. Michel, and W. Porod, "Qualitative analysis and synthesis of a class of neural networks," IEEE Trans. Circuits Syst., vol. 35, no. 8, pp. 976-986, Aug. 1988.
4. M. Hirsch, "Convergent activation dynamics in continuous time networks," Neural Netw., vol. 2, pp. 331-349, 1989. (Pubitemid 20609006)
5. N. Takahashi and L. Chua, "On the complete stability of nonsymmetric cellular neural networks," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 45, no. 7, pp. 754-758, Jul. 1998. (Pubitemid 128745119)
6. P. Thiran, G. Setti, and M. Hasler, "An approach to information propagation in 1-D cellular neural networks-Part I: Local diffusion," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 45, pp. 777-789, Aug. 1998. (Pubitemid 128745123)
7. M. Gilli, "Stability of cellular neural networks and delayed cellular neural networks with nonpositive templates and nonmonotonic output functions," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 41, no. 8, pp. 518-528, Aug. 1994.
8. Z. Yi, K. K. Tan, and T. H. Lee, "Multistability analysis for recurrent neural networks with unsaturating piecewise linear transfer functions," Neural Comput., vol. 15, pp. 639-662, Mar. 2003. (Pubitemid 37049820)
9. Z. Zeng and J. Wang, "Complete stability of cellular neural networks with time-varying delays," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 53, no. 4, pp. 944-955, Apr. 2006.
10. C. Cheng, K. Lin, and C. Shih, "Multistability and convergence in delayed neural networks," Physica D, Nonlinear Phenom., vol. 225, pp. 61-74, Jan. 2007. (Pubitemid 44854234)
11. J. Cao, G. Feng, and Y. Wang, "Multistability and multiperiodicity of delayed Cohen-Grossberg neural networks with a general class of activation functions," Physica D, vol. 237, no. 13, pp. 1734-1749, 2008.
12. M. Di Marco, M. Forti, M. Grazzini, P. Nistri, and L. Pancioni, "Lyapunov method and convergence of the full-range model of CNNs," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 55, no. 11, pp. 3528-3541, Dec. 2008.
13. Z. Zeng, T. Huang, and W. Zheng, "Multistability of recurrent neural networks with time-varying delays and the piecewise linear activation function," IEEE Trans. Neural Netw., vol. 21, pp. 1371-1377, Aug. 2010.
14. W. Lu, L. Wang, and T. Chen, "On attracting basins of multiple equilibria of a class of cellular neural networks," IEEE Trans. Neural Netw., vol. 22, no. 3, pp. 381-394, Mar. 2011.
15. M. Di Marco, M. Forti, M. Grazzini, and L. Pancioni, "Limit set dichotomy and multistability for a class of cooperative neural networks with delays," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, pp. 1473-1485, Sep. 2012.
16. J. J. Hopfield, "Neurons with graded response have collective computational properties like those of two-state neurons," Proc. Natl. Acad. Sci., vol. 81, pp. 3088-3092, May 1984. (Pubitemid 14109528)
17. L. O. Chua and T. Roska, "Stability of a class of nonreciprocal neural networks," IEEE Trans. Circuits Syst., vol. 37, pp. 1520-1527, Dec. 1990.
18. K.Wang and A. N. Michel, "Robustness and perturbation analysis of a class of nonlinear systems with applications to neural networks," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 41, no. 1, pp. 24-32, Jan. 1994.
19. M. Di Marco, M. Forti, and A. Tesi, "Bifurcations and oscillatory behavior in a class of competitive cellular neural networks," Int. J. Bifurcation Chaos, vol. 10, no. 6, pp. 1267-1293, Jun. 2000.
20. M. Forti and A. Tesi, "New conditions for global stability of neural networks with application to linear and quadratic programming problems," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 42, no. 7, pp. 354-366, Jul. 1995.
21. J. P. Aubin and A. Cellina, Differential Inclusions. Berlin, Germany: Springer-Verlag, 1984.
22. G. De Sandre,M. Forti, P. Nistri, and A. Premoli, "Dynamical analysis of full-range cellular neural networks by exploiting differential variational inequalities," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 54, no. 8, pp. 1736-1749, Aug. 2007. (Pubitemid 47272695)
23. J. Pang and D. Stewart, "Differential variational inequalities," Math. Programm., Ser. A, vol. 113, pp. 345-424, 2008. (Pubitemid 351187739)
24. J. Li, A. N. Michel, and W. Porod, "Analysis and synthesis of a class of neural networks: Linear systems operating on a closed hypercube," IEEE Trans. Circuits Syst., vol. 36, pp. 1405-1422, Nov. 1989. (Pubitemid 20642393)
25. A. Rodríguez-Vázquez, S. Espejo, R.Domínguez-Castro, J. L.Huertas, and E. Sánchez-Sinencio, "Current-mode techniques for the implementation of continuous-and discrete-time cellular neural networks," IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 40, pp. 132-146, Mar. 1993. (Pubitemid 23700456)
26. T. Roska and L. O. Chua, "The CNN universal machine: An analogic array computer," IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 40, pp. 163-173, Mar. 1993. (Pubitemid 23700453)
27. A. Rodríguez-Vázquez, G. Liñán-Cembrano, L. Carranza, E. Roca-Moreno, R. Carmona-Galán, F. Jiménez-Garrido, R. Domínguez-Castro, and S. E. Meana, "ACE16k: The third generation of mixed-signal SIMD-CNN ACE chips towards VSoCs," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 51, no. 5, pp. 851-863, May 2004.
28. M. Hirsch and H. Smith, "Monotone dynamical systems," in Handbook of Differential Equations, Ordinary Differential Equations, A. Canada, P. Drabek, and A. Fonda, Eds. Amsterdam, The Netherlands: Elsevier, 2005, vol. 2.
29. M. Di Marco, M. Forti, M. Grazzini, and L. Pancioni, "A study on semiflows generated by cooperative full-range CNNs," Int. J. Circuit Theory Appl., vol. 40, pp. 1191-1208, Dec. 2012.
30. H. L. Smith, Monotone Dynamical Systems: An Introduction to the Theory of Competitive and Cooperative Systems, in Mathematical Surveys and Monographs. Providence, RI: Amer. Math. Soc., 1995, vol. 41.
31. M. W. Hirsch, "Systems of differential equations which are competitive or cooperative. II: Convergence almost everywhere," SIAM J. Math. Anal., vol. 16, pp. 423-439, 1985.
32. J. P. Aubin and H. Frankowska, Set-Valued Analysis. Boston, MA, USA: Birkauser, 1990.
33. T. Rockafellar and R. Wets, Variational Analysis. Berlin, Germany: Springer-Verlag, 1997.
34. M. Forti, P. Nistri, and M. Quincampoix, "Convergence of neural networks for programming problems via a nonsmooth Lojasiewicz inequality," IEEE Trans. Neural Netw., vol. 17, pp. 1471-1486, Nov. 2006. (Pubitemid 44824261)
35. H. Demuth and M. Beale, Neural Network Toolbox User's Guide. The Mathworks, Inc., 1992.
36. A. N. Michel, J. Si, and G. Yen, "Analysis and synthesis of a class of discrete-time neural networks described on hypercubes," IEEE Trans. Neural Netw., vol. 2, no. 1, pp. 32-46, 1991.
37. D. Liu and A. Michel, Dynamical Systems with Saturation Nonlinearities. London, U.K.: Springer, 1994, vol. 195, Lecture Notes in Control and Information Sciences.
38. F. Albertini and D. D'Alessandro, "Asymptotic stability of continuoustime systems with saturation nonlinearities," Syst. Control Lett., vol. 29, no. 3, pp. 175-180, 1996. (Pubitemid 126411675)
39. L. Hou and A. Michel, "Asymptotic stability of systems with saturation constraints," IEEE Trans. Autom. Control, vol. 43, no. 8, pp. 1148-1154, 1998. (Pubitemid 128737400)
40. B. Calvert, "Linear systems in a saturated mode and convergence as gain becomes large of asymptotically stable equilibrium points of neural nets," Circuits, Syst., Signal Process., vol. 18, no. 3, pp. 241-267, 1999.
41. B. Calvert, "Global asymptotic stability for a linear system in a saturated mode," Syst. Control Lett., vol. 40, no. 1, pp. 9-14, 2000.
42. I. Varga, G. Elek, and S. Zak, "On the brain-state-in-a-convex- domain neural models," Neural Netw., vol. 9, no. 7, pp. 1173-1184, 1996. (Pubitemid 26379325)
43. M. Vidyasagar, "Location and stability of the high-gain equilibria of nonlinear neural networks," IEEE Trans. Neural Netw., vol. 4, pp. 660-672, Jul. 1993.
44. C. Oh and S. Zak, "Large-scale pattern storage and retrieval using generalized brain-state-in-a-box neural networks," IEEE Trans. Neural Netw., vol. 21, no. 4, pp. 633-643, 2010.
45. M. Di Marco, M. Forti, M. Grazzini, and L. Pancioni, "Lojasiewicz inequality and exponential convergence of the full-range model of CNNs," Int. J. Circuit Theory Appl., vol. 40, pp. 409-419, Apr. 2012.
46. M. Di Marco, M. Forti, M. Grazzini, and L. Pancioni, "On global exponential stability of standard and full-range CNNs," Int. J. Circuit Theory Appl., vol. 36, no. 5-6, pp. 653-680, Jul.-Sep. 2008.
47. M. Di Marco, M. Grazzini, and L. Pancioni, "Global robust stability criteria for interval delayed full-range cellular neural networks," IEEE Trans. Neural Netw., vol. 22, no. 4, pp. 666-671, 2011.
48. M. Forti, "Some extensions of a new method to analyze complete stability of neural networks," IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1230-1238, Sep. 2002.
49. F. Corinto and M. Gilli, "Comparison between the dynamic behaviour of Chua-Yang and full-range cellular neural networks," Int. J. Circuit Theory Appl., vol. 31, pp. 423-441, Sep./Oct. 2003.
50. M. Di Marco, M. Forti, M. Grazzini, and L. Pancioni, "Limit set dichotomy and convergence of cooperative piecewise linear neural networks," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 58, pp. 1052-1062, May 2011.
51. M. Di Marco, M. Forti, M. Grazzini, and L. Pancioni, "The dichotomy of omega-limit sets fails for cooperative standard CNNs," in Proc. CNNA, Berkeley, CA, USA, Feb. 3-5, 2010.
52. M. DiMarco, M. Forti, M. Grazzini, and L. Pancioni, "Convergence of a class of cooperative standard cellular neural network arrays," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 59, no. 4, pp. 772-783, Apr. 2012.