A new one-layer recurrent neural network for nonsmooth pseudoconvex optimization

Neurocomputing

Volumn 120, Issue , 2013, Pages 655-662

  Qin, Sitian ^a   Bian, Wei ^a   Xue, Xiaoping ^a  

^a HARBIN INSTITUTE OF TECHNOLOGY   (China)

Author keywords

Nonsmooth pseudoconvex optimization problem; One layer recurrent neural network

Indexed keywords

EQUILIBRIUM POINT SET; GLOBALLY CONVERGENT; LINEAR EQUALITY CONSTRAINTS; OBJECTIVE FUNCTIONS; OPTIMAL SOLUTIONS; OPTIMIZATION PROBLEMS; PSEUDOCONVEX; PSEUDOCONVEX OPTIMIZATIONS;

OPTIMAL SYSTEMS; RECURRENT NEURAL NETWORKS;

OPTIMIZATION;

ARTICLE; ARTIFICIAL NEURAL NETWORK; CONTROLLED STUDY; LINEAR SYSTEM; MATHEMATICAL COMPUTING; MATHEMATICAL PHENOMENA; NONSMOOTH PSEUDOCONVEX OPTIMIZATION; ONE LAYER RECURRENT NEURAL NETWORK; PRIORITY JOURNAL; SYSTEM ANALYSIS;

EID: 84882858703     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2013.01.025     Document Type: Article

References (46)

1. Aubin J.P., Cellina A. Differential Inclusions 1984, Springer-Verlag, Berlin, Germany.
2. Clarke F. Optimization and Nonsmooth Analysis 1983, Wiley, New York.
3. Guo Z.S., Liu Q.S., Wang J. A one-layer recurrent neural network for pseudoconvex optimization subject to linear equality constraints. IEEE Trans. Neural Netw. 2011, 22:1892-1900.
4. Liu Q.S., Guo Z.S., Wang J. A one-layer recurrent neural network for constrained pseudoconvex optimization and its application for dynamic portfolio optimization. Neural Netw. 2012, 26:99-109.
5. Bazaraa M.S., Sherali H.D., Shetty C.M. Nonlinear Programming. Theory and Algorithms 1993, Wiley, New York. 2nd ed.
6. Cichocki A., Unbehauen R. Neural Networks for Optimization and Signal Processing 1993, Wiley, London, UK.
7. Penot J., Quang P. Generalized convexity of functions and generalized monotonicity of set-valued maps. J. Optim. Theory Appl. 1997, 92:343-356.
8. Filippov A.F. Differential equations with discontinuous right-hand side. Transl. Am. Math. Soc. 1964, 42:199-231.
9. G. Li, S. Song, C. Wu, Z. Du, A neural network model for non-smooth optimization over a compact convex subset, in: Proceedings of ISNN 2006, LNCS 3971, 2006, pp. 344-349.
10. Solodov M.V., Tseng P. Modified projection-type methods for monotone variational inequalities. SIAM J. Control Optim. 1996, 2:1814-1830.
11. Konnov I.V. A class of combined iterative methods for solving variational inequalities. J. Optim. Theory Appl. 1997, 94:677-693.
12. Tank D., Hopfield J. Simple neural optimization networks. An a/d converter, signal decision circuit, and a linear programming circuit. IEEE Trans. Circuits Syst. 1986, 33:533-554.
13. Kennedy M., Chua L. Neural networks for nonlinear programming. IEEE Trans. Circuits Syst. 1988, 35:554-562.
14. Bouzerdoum A., Pattison T. Neural network for quadratic optimization with bound constraints. IEEE Trans. Neural Netw. 1993, 4:293-304.
15. Zhang S., Constantinides A. Lagrange programming neural networks. IEEE Trans. Circuits Syst. II 1992, 39:441-452.
16. Wang J. Primal and dual neural networks for shortest-path routing. IEEE Trans. Syst. Man Cybern. A Syst. Hum. 1998, 28:864-869.
17. Xia Y. A new neural network for solving linear and quadratic programming problems. IEEE Trans. Neural Netw. 1996, 7:1544-1548.
18. Xia Y., Feng G., Wang J. A recurrent neural network with exponential convergence for solving convex quadratic program and related linear piecewise equations. Neural Netw. 2004, 17:1003-1015.
19. Qin S.T., Xue X.P. Dynamical analysis of neural networks of subgradient system. IEEE Trans. Autom. Control 2010, 55:2347-2352.
20. Qin S.T., Xue X.P. Dynamical behavior of a class of nonsmooth gradient-like systems. Neurocomputing 2010, 73:2632-2641.
21. Qin S.T., Xue X.P. Global exponential stability and global convergence in finite time of neural networks with discontinuous activations. Neural Process. Lett. 2009, 29:189-204.
22. Qin S.T., Xue X.P., Wang P. Global exponential stability of almost periodic solution of delayed neural networks with discontinuous activations. Inf. Sci. 2013, 220:367-378.
23. Xia Y., Wang J. A recurrent neural network for solving nonlinear convex programs subject to linear constraints. IEEE Trans. Neural Netw. 2005, 16:379-386.
24. Forti M., Nistri P., Quincampoix M. Generalized neural network for nonsmooth nonlinear programming problems. IEEE Trans. Circuits Syst. I 2004, 51:1741-1754.
25. Liu Q., Wang J. A one-layer recurrent neural network with a discontinuous activation function for linear programming. Neural Comput. 2008, 20:1366-1383.
26. Liu Q., Wang J. A one-layer recurrent neural network with a discontinuous hard-limiting activation function for quadratic programming. IEEE Trans. Neural Netw. 2008, 19:558-570.
27. Xia Y., Wang J. A one-layer recurrent neural network for support vector machine learning. IEEE Trans. Syst. Man Cybern. B 2004, 34:1261-1269.
28. Xue X., Bian W. Subgradient-based neural networks for nonsmooth convex optimization problems. IEEE Trans. Circuits Syst. I 2008, 55:2378-2391.
29. Bian W., Xue X. Subgradient-based neural networks for nonsmooth nonconvex optimization problems. IEEE Trans. Neural Netw. 2009, 20:1024-1038.
30. Liu Q., Cao J., Chen G. A novel recurrent neural network with finite time convergence for linear programming. Neural Comput. 2010, 22:2962-2978.
31. Forti M., Nistri P., Quincampoix M. Convergence of neural networks for programming problems via a nonsmooth Łojasiewicz inequality. IEEE Trans. Nerual Netw. 2006, 17:1471-1486.
32. Gao X., Liao L. A new one-layer neural network for linear and quadratic programming. IEEE Trans. Nerual Netw. 2010, 21:918-929.
33. Cheng L., Hou Z.G. Recurrent neural network for non-smooth convex optimization problems with application to the identification of genetic regulatory networks. IEEE Trans. Neural Netw. 2011, 22:714-726.
34. Henrion D., Lasserre J.B. Solving nonconvex optimization problems. IEEE Trans. Control Syst. 2004, 24:72-83. 1024-1038.
35. Levi E.E. Studi sui punti singolari essenziali delle funzioni analitiche di due o pi variabili complesse. Ann. Mat. Pura Appl. 1910, 17:61-68.
36. Hu X., Wang J. Solving pseudomonotone variational inequalities and pseudoconvex optimization problems using the projection neural network. IEEE Trans. Neural Netw. 2006, 17:1487-1499.
37. Dinkelbach W. On nonlinear fractional programming. Manage. Sci. 1967, 13:492-498.
38. Li X. An efficient approach to a class of non-smooth optimization problems. Sci. China (Ser. A) 1994, 37:323-330.
39. Cheng L., Hou Z.G., Tan M. A delayed projection neural network for solving linear variational inequalities. IEEE Trans. Neural Netw. 2009, 20:915-925.
40. Cheng L., Hou Z.G., Tan M. A neutral-type delayed projection neural network for solving nonlinear variational inequalities. IEEE Trans. Circuits Syst. I 2008, 55:806-810.
41. Liu Q.S., Dang C.Y., Cao J.D. A novel recurrent neural network with one neuron and finite-time convergence for k-winners-take-all operation. IEEE Trans. Neural Netw. 2010, 21:1140-1148.
42. Liu Q.S., Wang J. A one-layer recurrent neural network for constrained nonsmooth optimization. IEEE Trans. Syst. Man Cybern. B 2011, 41:1323-1333.
43. Forti M., Nistri P. Global convergence of neural networks with discontinuous neuron activations. IEEE Trans. Circuits Syst. I 2003, 50:1421-1435.
44. Forti M., Nistri P., Papini D. Global exponential stability and global convergence in finite time of delayed neural networks with infinite gain. IEEE Trans. Neural Netw. 2005, 16:1449-1463.
45. Lu W., Chen T. Dynamical behaviors of delayed neural network systems with discontinuous activation functions. Neural Comput. 2006, 18:683-708.
46. W. Bian, X. Xue, Neural network for solving constrained convex optimization problems with global attractivity. IEEE Trans. Circuits Syst. I, 60 (2013) 710-723.