Convergence of neural networks for programming problems via a nonsmooth Łojasiewicz inequality

IEEE Transactions on Neural Networks

Volumn 17, Issue 6, 2006, Pages 1471-1486

  Forti, Mauro ^a   Nistri, Paolo ^a   Quincampoix, Marc ^b  

^a UNIVERSITY OF SIENA   (Italy)

^b UNIVERSITÉ DE BRETAGNE OCCIDENTALE   (France)

Author keywords

ojasiewicz inequality; Convergence in finite time; Exponential convergence; Generalized gradient; Neural networks (NNs); Programming problems

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; LINEAR PROGRAMMING; MATHEMATICAL MODELS; PROBLEM SOLVING; QUADRATIC PROGRAMMING;

EXPONENTIAL CONVERGENCE; FINITE TIME CONVERGENCE; GENERALIZED GRADIENT; PROGRAMMING PROBLEMS;

NEURAL NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; EVALUATION; INFORMATION RETRIEVAL; METHODOLOGY; SIGNAL PROCESSING;

ALGORITHMS; INFORMATION STORAGE AND RETRIEVAL; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; SIGNAL PROCESSING, COMPUTER-ASSISTED;

EID: 37849187126     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2006.879775     Document Type: Article

References (29)

1. D. W. Tank and J. J. Hopfield, "Simple 'neural' optimization networks: an A/D converter, signal decision circuit, and a linear programming circuit, IEEE Trans. Circuits Syst., vol. 33, no. 5, pp. 533-541, May 1986.
2. M. P. Kennedy and L. O. Chua, "Neural networks for nonlinear programming," IEEE Trans. Circuits Syst., vol. 35, no. 5, pp. 554-562, May 1988.
3. A. Rodríguez-Vázquez, R. Domínguez-Castro, A. Rueda, J. L. Huertas, and E. Sánchez-Sinencio, "Nonlinear switched-capacitor "neural" networks for optimization problems," IEEE Trans. Circuits Syst., vol. 37, no. 3, pp. 384-398, Mar. 1990.
4. A. Cichocki and R. Unbehauen, Neural Networks for Optimization and Signal Processing. Chichester, U.K.: Wiley, 1993.
5. E. K. P. Chong, S. Hui, and S. H. Zak, "An analysis of a class of neural networks for solving linear programming problems," IEEE Trans. Autom. Control, vol. 44, no. 11, pp. 1095-2006, Nov. 1999.
6. X. Liang and J. Wang, "A recurrent neural network for nonlinear optimization with a continuously differentiable objective function and bound constraints," IEEE Trans. Neural Netw., vol. 11, no. 6, pp. 1251-1262, Nov. 2000.
7. X. Gao, L. Z. Liao, and W. Xue, "A neural network for a class of convex quadratic minimax problems with constraints," IEEE Trans. Neural Netw., vol. 15, no. 3, pp. 622-628, May 2004.
8. H. Qi and L. Qi, "Deriving sufficient conditions for global asymptotic stability of delayed neural networks via nonsmooth analysis," IEEE Trans. Neural Netw., vol. 15, no. 1, pp. 99-109, Jan. 2004.
9. L. V. Ferreira, E. Kaszkurewicz, and A. Bhaya, "Solving systems of linear equations via gradient systems with discontinuous right hand sides: Application to LS-SVM," IEEE Trans. Neural Netw., vol. 16, no. 2, pp. 501-505, Mar. 2005.
10. Y. Xia and J. Wang, "A recurrent neural network for solving nonlinear convex programs subject to linear constraints," IEEE Trans. Neural Netw., vol. 16, no. 2, pp. 379-386, Mar. 2005.
11. M. Forti, P. Nistri, and M. Quincampoix, "Generalized neural network for nonsmooth nonlinear programming problems," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 51, no. 9, pp. 1741-1754, Sep. 2004.
12. M. Forti and A. Tesi, "Absolute stability of analytic neural networks: an approach based on finite trajectory length," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 51, no. 12, pp. 2460-2469, Dec. 2004.
13. J. Palis and W. De Melo, Geometric Theory of Dynamical Systems. Berlin, Germany: Springer-Verlag, 1982.
14. S. Łojasiewicz, "Sur le problème de la division," Studia Math., vol. T. XVIII, pp. 87-136, 1959.
15. S. Łojasiewicz, "Ensembles semi-analytiques" Institut des Hautes Études Scientifique Notes, 1965.
16. J. P. Aubin and A. Cellina, Differential Inclusions. Berlin, Germany: Springer-Verlag, 1984.
17. J. P. Aubin and H. Frankowska, Set-Valued Analysis. Boston, MA: Birkauser, 1990.
18. T. Rockafellar and R. Wets, Variational Analysis. Berlin, Germany: Springer-Verlag, 1997.
19. C. A. Floudas and V. Visweswaran, "Quadratic optimization," in Handbook of Global Optimization, R. Horst and P. M. Pardalos, Eds. London, U.K.: Kluwer, 1990.
20. D. P. Bertsekas, "Necessary and sufficient conditions for a penalty method to be exact," Math. Programming, vol. 9, pp. 87-99, 1975.
21. M. P. Glazos, S. Hui, and S. H. Zak, "Sliding modes in solving convex programming problems," Soc. Ind. Appl. Math. (SIAM) J. Control Optim., vol. 36, pp. 680-697, Mar. 1998.
22. J. Ekeland and R. Temam, Convex Analysis and Variational Problems. Amsterdam, The Netherlands: North-Holland & Elsevier, 1976.
23. J. Bolte, A. Daniilidis, and A. Lewis, "The Lojasiewicz inequality for nonsmooth subanalytic functions with applications to subgradient dynamical systems (condensed version)," J. Math. Anal. Applicat. 2006 [Online]. Available: http://legacy.orie.cornell.edu/~aslewis/, submitted for publication
24. S. Łojasiewicz, "Sur les trajectoires du gradient d'une fonction analytique," in Seminari di Geometria 1982-1983. Bologna, Italy: Università di Bologna, Istituto di Geometria, Dipartimento di Matematica, 1984, pp. 115-117.
25. S. H. Zak, V. Upatising, and S. Hui, "Solving linear programming problems with neural networks: A comparative study," IEEE Trans. Neural Netw., vol. 6, no. 1, pp. 94-104, Jan. 1995.
26. L. O. Chua and L. Yang, "Cellular neural networks: Theory," IEEE Trans. Circuits Syst., vol. 35, no. 10, pp. 1257-1272, Oct. 1988.
27. V. Visweswaran and C. A. Floudas, "A global optimization algorithm (GOP) for certain classes of nonconvex NLPs - II. Application of theory and test problems," Comp. Chem. Eng., vol. 4, pp. 1419-1434, 1990.
28. A. Bacciotti and F. Ceragioli, "Nonsmooth optimal regulation and discontinuous stabilization," Abstract Appl. Anal., vol. 2003, pp. 1159-1195, 2003.
29. B. Paden and D. Shevitz, "Lyapunov stability theory of nonsmooth systems," IEEE Trans. Autom. Control, vol. 39, no. 9, pp. 1910-1914, Sep. 1994.