A one-layer recurrent neural network for constrained nonsmooth invex optimization

Neural Networks

Volumn 50, Issue , 2014, Pages 79-89

  Li, Guocheng ^a   Yan, Zheng ^b   Wang, Jun ^b  

^a BEIJING INFORMATION SCIENCE AND TECHNOLOGY UNIVERSITY   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Exact penalty function; Finite time convergence; Invex optimization; Recurrent neural network

Indexed keywords

OPTIMAL SYSTEMS; RECURRENT NEURAL NETWORKS;

CONSTRAINT FUNCTIONS; EXACT PENALTY FUNCTIONS; FINITE-TIME CONVERGENCE; GLOBALLY CONVERGENT; NONCONVEX OPTIMIZATION; OBJECTIVE FUNCTIONS; OPTIMAL SOLUTION SETS; OPTIMIZATION PROBLEMS;

CONSTRAINED OPTIMIZATION;

ARTICLE; ARTIFICIAL NEURAL NETWORK; MATHEMATICAL MODEL; PRIORITY JOURNAL; PROCESS OPTIMIZATION; RECURRENT NEURAL NETWORK;

EXACT PENALTY FUNCTION; FINITE TIME CONVERGENCE; INVEX OPTIMIZATION; RECURRENT NEURAL NETWORK;

ALGORITHMS; COMPUTER SIMULATION; HUMANS; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS;

EID: 84888770601     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2013.11.007     Document Type: Article

References (38)

1. Aubin J., Cellina A. Differential inclusions 1984, Springer-Verlag, Berlin.
2. Ben-Israel A., Mond B. What is invexity?. Bulletin of the Australian Mathematical Society, Series B 1986, 28:1-9.
3. Bian W., Xue X. Subgradient-based neural networks for nonsmooth nonconvex optimization problems. IEEE Transactions on Neural Networks 2009, 20:1024-1038.
4. Cheng L., Hou Z., Lin Y., Tan M., Zhang W.C., Wu F. Recurrent neural network for nonsmooth convex optimization problems with applications to the identification of genetic regulatory networks. IEEE Transactions on Neural Networks 2011, 22:714-726.
5. Chong E., Hui S., Zak S. An analysis of a class of neural network for solving linear programming problems. IEEE Transactions on Automatic Control 1999, 44:1995-2006.
6. Clarke F. Optimization and non-smooth analysis 1969, Wiley, New York.
7. Craven B.D. Duality for generalized convex fractional programs. Generalized concavity in optimization and economics 1981, Academic Press, New York. S. Schaible, W.T. Ziemba (Eds.).
8. Filippov A. Differential equations with discontinuous right-hand side 1988, Kluwer Academic, Dordrecht.
9. Forti M., Nistri P., Quincampoix M. Generalized neural network for nonsmooth nonlinear programming problems. IEEE Transactions on Circuits and Systems. I 2004, 51:1741-1754.
10. Forti M., Nistri P., Quincampoix M. Convergence of neural network for programming problems via a nonsmooth Łojasiewicz inequality. IEEE Transactions on Neural Networks 2006, 17:1471-1485.
11. Frenk J., Schaible S. Fractional programming. Handbook of generalized convexity and generalized monotonicity 2005, Springer.
12. Gao X. A novel neural network for nonlinear convex programming. IEEE Transactions on Neural Networks 2004, 15:613-621.
13. Guo Z., Liu Q., Wang J. A one-layer recurrent neural network for pseudoconvex optimization subject to linear equality constraints. IEEE Transactions on Neural Networks 2011, 22:1892-1900.
14. Hanson M.A. On sufficiency of the Kuhn-Tucker conditions. Journal of Mathematical Analysis and Applications 1981, 80:545-550.
15. Hopfield J.J., Tank D.W. Neural computation of decisions in optimization problems. Biological Cybernetics 1985, 52:141-152.
16. Hosseini A., Wang J., Hosseini S.M. A recurrent neural network for solving a class of generalized convex optimization problems. Neural Networks 2013, 44:78-86.
17. Hu X., Wang J. Solving pseudomonotone variational inequalities and pseudoconvex optimization problems using the projection neural network. IEEE Transactions on Neural Networks 2006, 17:1487-1499.
18. Hu X., Wang J. Design of general projection neural network for solving monotone linear variational inequalities and linear and quadratic optimization problems. IEEE Transactions on Systems, Man and Cybernetics. Part B: Cybernetics 2007, 37:1414-1421.
19. Kennedy M.P., Chua L.O. Neural networks for nonlinear programming. IEEE Transactions on Circuits and Systems 1988, 35:554-562.
20. Li G., Song S., Wu C. Generalized gradient projection neural networks for nonsmooth optimization problems. Science China Information Sciences 2010, 53:990-1005.
21. Liu Q., Guo Z., Wang J. A one-layer recurrent neural network for constrained pseudoconvex optimization and its application for dynamic portfolio optimization. Neural Networks 2012, 26:99-109.
22. Liu Q., Wang J. Finite-time convergent recurrent neural network with a hard-limiting activation function for constrained optimization with piecewise-linear objective functions. IEEE Transactions on Neural Networks 2011, 22:601-613.
23. Liu Q., Wang J. A one-layer recurrent neural network for constrained nonsmooth optimization. IEEE Transactions on Systems, Man and Cybernetics. Part B: Cybernetics 2011, 40:1323-1333.
24. Liu Q., Wang J. A one-layer projection neural network for nonsmooth optimization subject to linear equalities and bound constraints. IEEE Transactions on Neural Networks and Learning Systems 2013, 24:812-824.
25. Nazemi A.R. A dynamic system model for solving convex nonlinear optimization problems. Communications in Nonlinear Science and Numerical Simulation 2012, 17:1696-1705.
26. Opial Z. Weak convergence of the sequence of successive approximations for nonexpansive mappings. Bulletion of the American Mathematical Society 1967, 73:591-597.
27. Pardalos, P. (2008). Nonconvex optimization and its application. Berlin, Heidelberg.
28. Penot J., Quan P. Generalized convexity of functions and generalized monotonicity of set-valued maps. Journal of Optimiation Theory and Applications 1997, 92:343-356.
29. Tank D.W., Hopfield J.J. Simple 'neural' optimization networks: an A/D converter, signal decision circuit, and a linear programming circuit. IEEE Transactions on Circuits and Systems 1986, 33:533-541.
30. Wang J. Analysis and design of a recurrent neural network for linear programming. IEEE Transactions on Circuits and Systems. I 1993, 40:613-618.
31. Wang J. A deterministic annealing neural network for convex programming. Neural Networks 1994, 7:629-641.
32. Wang J. Primal and dual assignment networks. IEEE Transactions on Neural Networks 1997, 8:784-790.
33. Xia Y., Feng G., Wang J. A novel neural network for solving nonlinear optimization problems with inequality constraints. IEEE Transactions on Neural Networks 2008, 19:1340-1353.
34. Xia Y., Leung H., Wang J. A projection neural network and its application to constrained optimization problems. IEEE Transactions on Circuits and Systems. I 2002, 49:447-458.
35. Xia Y., Wang J. A dual neural network for kinematic control of redundant robot manipulators. IEEE Transactions on Systems, Man and Cybernetics. Part B: Cybernetics 2001, 31:147-154.
36. Xia Y., Wang J. A general projection neural network for solving optimization and related problems. IEEE Transactions on Neural Networks 2004, 15:318-328.
37. Xue X., Bian W. Subgradient-based neural networks for nonsmooth convex optimization problems. IEEE Transactions on Circuits and Systems. I 2008, 55:2378-2391.
38. Zhang S., Constantinides A.G. Lagrange programming neural network. IEEE Transactions on Circuits and Systems. II 1992, 39:441-452.