Subgradient-based neural networks for nonsmooth nonconvex optimization problems

IEEE Transactions on Neural Networks

Volumn 20, Issue 6, 2009, Pages 1024-1038

  Bian, Wei ^a   Xue, Xue ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Convergence in finite time; Differential inclusion; Neural network; Nonsmooth nonconvex optimization; Slow solution

Indexed keywords

CONSTRAINT SET; CONVERGENCE IN FINITE TIME; CRITICAL POINTS; DIFFERENTIAL INCLUSION; DIFFERENTIAL INCLUSIONS; EQUALITY CONSTRAINTS; EQUILIBRIUM POINT; EQUILIBRIUM POINT SET; FEASIBLE REGIONS; FINITE TIME; GLOBAL SOLUTIONS; INEQUALITY CONSTRAINT; NON-CONVEX OBJECTIVE FUNCTIONS; NON-SMOOTH; NONSMOOTH NONCONVEX OPTIMIZATION; OBJECTIVE FUNCTIONS; PENALTY PARAMETERS; SLOW SOLUTION; SUBGRADIENT;

CONVEX OPTIMIZATION; DIFFERENTIAL EQUATIONS; EQUATIONS OF STATE; NEURAL NETWORKS; OPTIMIZATION;

SET THEORY;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; METHODOLOGY; NONLINEAR SYSTEM; THEORETICAL MODEL;

ALGORITHMS; COMPUTER SIMULATION; MODELS, THEORETICAL; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; PATTERN RECOGNITION, AUTOMATED;

EID: 67649321486     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2009.2016340     Document Type: Article

References (29)

1. J. J. Hopfield and D. W. Tank, "Neural computation of decision in optimization problems," Biol. Cybern., vol. 52, pp. 141-152, 1985.
2. M. P. Kennedy and L. O. Chua, "Neural networks for nonlinear programming," IEEE Trans. Circuit Syst., vol. CAS-35, no. 5, pp. 554-562, May 1988.
3. D. W. Tank and J. J. Hopfield, "Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit," IEEE Trans. Circuits Syst., vol. CAS-33, no. 5, pp. 533-541, May 1986.
4. A. Rodríguez-Vázque, R. Domínguez-Castro, A. Rueda, J. L. Huertas, and E. Sánchez-Sinencio, "Nonlinear switched-capacitor 'neural' networks for optimization problems," IEEE Trans. Circuits Syst., vol. 37, no. 3, pp. 384-398, Mar. 1990.
5. A. Cichocki and R. Unbehauen, Neural Networks for Optimization and Signal Processing. Chichester, U.K.: Wiley, 1993.
6. E. K. P. Chong, S. Hui, and S. H. Zak, "An analysis of a class of neural networks for solving linear programming problems," IEEE Trans. Autom. Control, vol. 44, no. 11, pp. 1995-2006, Nov. 1999.
7. X. Liang and J. Wang, "A recurrent neural network for nonlinear optimization with a continuously differentiable objective function and bound constraints," IEEE Trans. Neural Netw., vol. 11, no. 6, pp. 1251-1262, Nov. 2000.
8. X. Gao, L. Z. Liao, and W. Xue, "A neural network for a class of convex quadratic minimax problems with constraints," IEEE Trans. Neural Netw., vol. 15, no. 3, pp. 622-628, May 2004.
9. H. Qi and L. Qi, "Deriving sufficient conditions for global asymptotic stability of delayed neural networks via nonsmooth analysis," IEEE Trans. Neural Netw., vol. 15, no. 1, pp. 99-109, Jan. 2004.
10. L. V. Ferreira, E. Kaszkurewicz, and A. Bhaya, "Solving systems of linear equations via gradient systems with discontinuous right hand sides: Applications to LS-SVM," IEEE Trans. Neural Netw., vol. 16, no. 2, pp. 501-505, Mar. 2005.
11. M. Forti and A. Tesi, "New conditions for global stability of neural networks with application to linear and quadratic programming problems," IEEE Trans. Circuits Syst. I, Fund. Theory Appl., vol. 42, no. 7, pp. 354-366, Jul. 1995.
12. Y. Xia and J. Wang, "A recurrent neural network for nonlinear convex programs subject to linear constraint," IEEE Trans. Neural Netw., vol. 16, no. 2, pp. 379-386, Mar. 2005.
13. M. Forti, P. Nistri, and M. Quincampoix, "Generalized neural network for nonsmooth nonlinear programming problems," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 51, no. 9, pp. 1741-1754, Sep. 2004.
14. W. L. Lu and T. P. Chen, "Dynamical behaviors of Cohen-Grassberg neural networks with discontinuous activation functions," Neural Netw., vol. 18, pp. 231-242, 2005.
15. W. L. Lu and T. P. Chen, "Dynamical behaviors of delayed neural network systems with discontinuous activation functions," Neural Comput., vol. 18, pp. 683-708, 2006.
16. Q. Liu and J. Wang, "Neural information proceedings, PT 2," in Lecture Notes in Computer Science. Berlin, Germany: Springer-Verlag, 2006, vol. 4233, pp. 1004-1013.
17. P. Nistri and M. Quincampoix, "On the dynamics of a differential inclusion built upon a nonconvex constrained minimization problem," J. Optim. Theory Appl., vol. 123, no. 3, pp. 659-672, 2005.
18. M. Forti, P. Nistri, and M. Quincampoix, "Convergence of neural networks for programming problems via a nonsmooth Łojasiewicz inequality," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1471-1486, Nov. 2006.
19. F. H. Clarke, Optimization and Non-Smooth Analysis. New York: Wiley, 1969.
20. L. O. Chua, C. A. Desoer, and E. S. Kuh, Linear and Nonlinear Circuits. New York: McGraw-Hill, 1987.
21. J. P. Aubin and A. Cellina, Differential Inclusion: Set-Valued Maps and Viability Theory. Berlin, Germany: Springer-Verlag, 1984.
22. J. P. Aubin and H. Frankowska, Set-Valued Analysis. Berlin, Germany: Birkäuser, 1990.
23. R. T. Rockafellar and R. J. Wets, Variational Analysis. Berlin, Germany: Springer-Verlag, 1998.
24. B. E. Paden and S. S. Sastry, "Calculus for computing Filippov's differential inclusion with application to the variable structure control of robot manipulator," IEEE Trans. Circuits Syst., vol. CAS-34, no. 1, pp. 73-82, Jan. 1987.
25. V. I. Utkin, Sliding Modes and Their Application in Variable Structure System. Moscow, Russia: Mir, 1987.
26. A. F. Filippove, Differential Equations With Discontinuous Right-Hand Side, ser. Mathematics and Its Applications (Soviet Series). Boston, MA: Kluwer, 1988.
27. S. K. Korovin and V. I. Utkin, "Using sliding modes in static optimization and nonlinear programming," Automatica, vol. 10, pp. 385-399, 1974.
28. V. I. Utkin, Sliding Modes and Their Application in Variable Structure Systems. Moscow, Russia: Mir, 1978.
29. V. I. Utkin, Sliding Modes in Control and Optimization. Berlin, Germany: Springer-Verlag, 1992.