Convergence analysis of a class of nonsmooth gradient systems

IEEE Transactions on Circuits and Systems I: Regular Papers

Volumn 55, Issue 11, 2008, Pages 3514-3527

  Lu, Wenlian ^a   Wang, Jun ^b  

^a FUDAN UNIVERSITY   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Absolute stability; Differential inclusion; Nonsmooth cost function; ojasiewicz inequality

Indexed keywords

CHEMICAL ACTIVATION; COST FUNCTIONS; DIFFERENTIAL EQUATIONS; DYNAMICAL SYSTEMS; NONLINEAR DYNAMICAL SYSTEMS;

ABSOLUTE STABILITY; ACTIVATION FUNCTIONS; CONVERGENCE ANALYSIS; DIFFERENTIAL INCLUSIONS; DIFFERENTIAL SYSTEMS; FIRST ORDER DERIVATIVES; NEURAL NETWORK MODEL; NON-SMOOTH COST FUNCTIONS;

NEURAL NETWORKS;

EID: 58049205433     PISSN: 10577122     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSI.2008.925816     Document Type: Article

References (37)

1. J. J. Hopfield, "Neural networks and physical systems with emergent collective computational abilities," Proc. Nat. Acad. Sci., vol. 79, no. 8, pp. 2554-2558, Apr. 1982.
2. J. J. Hopfield, "Neurons with graded response have collective computational properties like those of two-stage neurons," Proc. Nat. Acad. Sci., Biol., vol. 81, pp. 3088-3092, 1984.
3. M. Vidyasagar, "Minimum-seeking properties of analog neural networks with multilinear objective functions," IEEE Trans. Autom. Control vol. 40, no. 8, pp. 1359-1375, Aug. 1995.
4. L. O. Chua and L. Yang, "Cellular neural networks: Theory," IEEE Trans.Circuits Syst., vol. 35, no. 10, pp. 1257-1272, Oct. 1988.
5. L. O. Chua and L. Yang, "Cellular neural networks: Application," IEEE Trans.Circuits Syst., vol. 35, no. 10, pp. 1273-1290, Oct. 1988.
6. M. A. Cohen and S. Grossberg, "Absolute stability of global pattern formation and parallel memory storage by competitive neural networks," IEEE Trans. Syst., Man, Cybern., vol. 13, no. 15, pp. 815-821, Sep. 1983.
7. M. Hirsh, "Convergence activation dynamics in continuous time networks," Neural Netw., vol. 2, pp. 331-349, 1989.
8. A. N. Michel and D. L. Gray, "Analysis and synthesis of neural networks with lower block triangular interconnecting structure," IEEE Trans. Circuits Syst., vol. 37, no. 10, pp. 1267-1283, Oct. 1990.
9. M. Forti and A. Tesi, "New conditions for global stability of neural networks with application to linear and quadratic programming problems," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 42, no. 7, pp. 354-366, Jul. 1995.
10. X. X. Liao and J. Wang, "Algebraic criteria for global exponential stability of cellular neural networks with multiple time delays," IEEE Trans. Circuit Syst. I, Fundam. Theory Appl., vol. 50, no. 2, pp. 268-275, Feb. 1995.
11. P. Van Den Driessche and X. Zou, "Global attractivity in delayed Hopfield neural networks models," SIAM J. Appl. Math., vol. 58, no. 6, pp. 1878-1890, Dec. 1998.
12. T. Chen and S. Amari, "Stability of asymmetric Hopfield networks," IEEE Trans. Neural Netw., vol. 12, no. 1, pp. 159-163, Jan. 2001.
13. J. Cao, "Global stability conditions for delayed CNNs," IEEE Trans. Circuit Syst. I, Fundam. Theory Appl., vol. 48, no. 11, pp. 1330-1333, Nov. 2001.
14. J. Cao and J. Wang, "Global asymptotic stability of a general class of recurrent neural networks with time-varying delays," IEEE Trans. Circuit Syst. I, Fundam. Theory Appl., vol. 50, no. 1, pp. 34-44, Jan. 2003.
15. Z. Zeng, J. Wang, and X. X. Liao, "Global exponential stability of a general class of recurrent neural networks with time-varying delays," IEEE Trans. Circuit Syst. I, Fundam. Theory Appl., vol. 50, no. 10, pp. 1353-1358, Oct. 2003.
16. W. Lu and T. Chen, "New conditions on global stability of Cohen-Grossberg neural networks," Neural Comput., vol. 15, no. 5, pp. 1173-1189, May 2003.
17. Z. Zeng, J. Wang, and X. Liao, "Stability analysis of delayed cellular neural networks described using cloning templates," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 51, no. 11, pp. 2313-2324, Nov. 2004.
18. T. Chen and L. Wang, "Power-rate global stability of dynamical systems with unbounded time-varying delays," IEEE Trans. Circuits Syst. II, Exp. Briefs, vol. 54, no. 8, pp. 705-709, Aug. 2007.
19. G. De Sandre, M. Forti, P. Nistri, and A. Premoli, "Dynamical analysis of full-range cellular neural networks by exploiting differential variational inequalities," IEEE Trans. Circuits Systs. I, Reg. Papers, vol. 54, no. 8, pp. 1736-1749, Aug. 2007.
20. M. Forti and A. Tesi, "Absolute stability of analytic neural networks: An approach based on finite trajectory length," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 51, no. 12, pp. 2460-2469, Dec. 2004.
21. M. Forti, P. Nistri, and M. Quincampoix, "Convergence of neural networks for programming problems via a nonsmooth Łojasiewicz inequality," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1471-1486, Nov. 2006.
22. M. Forti and A. Tesi, "The Łojasiewicz exponent at equilibrium point of a standard CNN is 1/2," Int. J. Bifurc. Chaos, vol. 16, no. 8, pp. 2191-2205, 2006.
23. C.-Y. Cheng, K.-H. Lin, and C.-W. Shin, "Multistability in recurrent neural networks," SIAM J. Appl. Math., vol. 66, no. 4, pp. 1301-1320, 2006.
24. F. H. Clarke, Optimization and Nonsmooth Analysis. Philadelphia, PA: SIAM, 1983.
25. T. Rockafellar and R. J.-B. Wets, Variational Analysis. Berlin, Germany: Springer-Verlag, 1998.
26. J. P. Aubin and H. Frankowska, Set-Valued Analysis. Cambridge, MA: Birkhäuser, 1990.
27. J. P. Aubin and A. Cellina, Differential Inclusions. Berlin, Germany: Springer-Verlag, 1984.
28. J. P. Aubin, Viability Theory. Cambridge, MA: Birhäuser, 1991.
29. M. Degiovanni, "Evolution equations with lack of convexity," Nonlin. Anal., Theory, Meth., Appl., vol. 9, no. 12, pp. 1401-1443, 1985.
30. E. Bierstone and P. Milman, "Semianalytic and subanalytic sets," IHES Publ. Math., vol. 67, no. 1, pp. 5-42, Jan. 1988.
31. L. Van Den Dries and C. Miller, "Geometrices categories and o-minimal structure," Duke Math. J., vol. 84, pp. 497-540, 1996.
32. S. Łojasiewicz, "Une proprieté topologique des sous-ensembles analytiques réels," Colloques Internationaux Du C.N.R.S. Leséquations Aux Dériveés Partielles, vol. 117, pp. 87-89, 1963.
33. S. Łojasiewicz, "Sur la géométrie semi- et sous-analytique," Ann. Inst. Fourier, vol. 43, pp. 1575-1595, 1993.
34. J. Bolte, A. Daniilidis, and A. Lewis, "The Łojasiewicz inequality for nonsmooth functions with applications to subgradient dynamical systems," SIAM J. Optim., vol. 17, no. 4, pp. 1205-1223, 2007.
35. J. Bolte, A. Daniilidis, and A. Lewis, "A nonsmooth Morse-Sard theorem for subanalytic functions," J. Math. Anal. Appl., vol. 321, no. 2, pp. 729-740, Sep. 2006.
36. S. G. Krantz and H. R. Parks, A Primer of Real Analytic Functions, 2nd ed. Cambridge, MA: Birkhäuser, 2002.
37. A. Sard, "The measure of critical values of differential map," Bull. Amer. Math, vol. 48, pp. 883-890, 1942.