A one-layer recurrent neural network for constrained nonsmooth optimization

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 41, Issue 5, 2011, Pages 1323-1333

  Liu, Qingshan ^a   Wang, Jun ^b  

^a SOUTHEAST UNIVERSITY   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Convergence; differential inclusion; Lyapunov function; nonsmooth optimization; recurrent neural networks

Indexed keywords

CONVERGENCE; DECISION VARIABLES; DESIGN PARAMETERS; DIFFERENTIAL INCLUSIONS; GLOBAL CONVEXITY; LOWER BOUNDS; LYAPUNOV; NONCONVEX; NONSMOOTH OPTIMIZATION; NONSMOOTH OPTIMIZATION PROBLEMS; NUMERICAL EXAMPLE; OBJECTIVE FUNCTIONS; OPTIMAL SOLUTIONS; OPTIMIZATION PROBLEMS; STATE VARIABLES;

COMPUTER SIMULATION; CONSTRAINED OPTIMIZATION; DIFFERENTIAL EQUATIONS; LYAPUNOV FUNCTIONS; NETWORK LAYERS; PROBLEM SOLVING;

RECURRENT NEURAL NETWORKS;

ARTICLE; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; NONLINEAR SYSTEM;

COMPUTER SIMULATION; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS;

EID: 80052913883     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2011.2140395     Document Type: Article

References (36)

1. J. Aubin and A. Cellina, Differential Inclusions: Set-Valued Maps and Viability Theory. New York: Springer-Verlag, 1984.
2. W. Bian and X. Xue, "Subgradient-based neural networks for nonsmooth nonconvex optimization problems," IEEE Trans. Neural Netw., vol. 20, no. 6, pp. 1024-1038, Jun. 2009.
3. A. Bouzerdoum and T. Pattison, "Neural network for quadratic optimization with bound constraints," IEEE Trans. Neural Netw., vol. 4, no. 2, pp. 293-304, Mar. 1993. (Pubitemid 23640394)
4. F. Clarke, Optimization and Nonsmooth Analysis. New York: Wiley, 1983.
5. A. Filippov, Differential Equations With Discontinuous Righthand Sides. Boston, MA: Kluwer, 1988, ser. Mathematics and its applications (Soviet series).
6. M. Forti, M. Grazzini, P. Nistri, and L. Pancioni, "Generalized Lyapunov approach for convergence of neural networks with discontinuous or non-Lipschitz activations," Phys. D, vol. 214, no. 1, pp. 88-99, Feb. 2006. (Pubitemid 43131061)
7. M. Forti, P. Nistri, and M. Quincampoix, "Generalized neural network for nonsmooth nonlinear programming problems," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 51, no. 9, pp. 1741-1754, Sep. 2004.
8. M. Forti, P. Nistri, and M. Quincampoix, "Convergence of neural networks for programming problems via a nonsmooth £ojasiewicz inequality," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1471-1486, Nov. 2006. (Pubitemid 44824261)
9. X. Hu and J. Wang, "Solving pseudomonotone variational inequalities and pseudoconvex optimization problems using the projection neural network," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1487-1499, Nov. 2006. (Pubitemid 44824262)
10. X. Hu and J. Wang, "Design of general projection neural networks for solving monotone linear variational inequalities and linear and quadratic optimization problems," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 5, pp. 1414-1421, Oct. 2007. (Pubitemid 47534605)
11. X. Hu and B. Zhang, "A new recurrent neural network for solving convex quadratic programming problems with an application to the k-winnerstake-all problem," IEEE Trans. Neural Netw., vol. 20, no. 4, pp. 654-664, Apr. 2009.
12. M. Kennedy and L. Chua, "Neural networks for nonlinear programming," IEEE Trans. Circuits Syst., vol. 35, no. 5, pp. 554-562, May 1988.
13. G. Li, S. Song, C. Wu, and Z. Du, "A neural network model for nonsmooth optimization over a compact convex subset," in Proc. 3rd ISNN, vol. 3971, Springer LNCS, 2006, pp. 344-349. (Pubitemid 44046131)
14. Q. Liu and J. Cao, "A recurrent neural network based on projection operator for extended general variational inequalities," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 3, pp. 928-938, Jun. 2010.
15. Q. Liu and J. Wang, "A one-layer recurrent neural network with a discontinuous activation function for linear programming," Neural Comput., vol. 20, no. 5, pp. 1366-1383, May 2008.
16. Q. Liu and J. Wang, "A one-layer recurrent neural network with a discontinuous hard-limiting activation function for quadratic programming," IEEE Trans. Neural Netw., vol. 19, no. 4, pp. 558-570, Apr. 2008. (Pubitemid 351583574)
17. Q. Liu and J.Wang, "A one-layer recurrent neural network for non-smooth convex optimization subject to linear equality constraints," in Proc. 15th ICONIP, vol. 5507, Springer LNCS, 2009, pp. 1003-1010.
18. S. Liu and J. Wang, "A simplified dual neural network for quadratic programming with its KWTA application," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1500-1510, Nov. 2006. (Pubitemid 44824263)
19. W. Lu and T. Chen, "Dynamical behaviors of delayed neural network systems with discontinuous activation functions," Neural Comput., vol. 18, no. 3, pp. 683-708, Mar. 2006. (Pubitemid 43543835)
20. C. Maa and M. Shanblatt, "Linear and quadratic programming neural network analysis," IEEE Trans. Neural Netw., vol. 3, no. 4, pp. 580-594, Jul. 1992.
21. R. Rockafellar, "Linear-quadratic programming and optimal control," SIAM J. Control Optim., vol. 25, no. 3, pp. 781-814, May 1987.
22. D. Tank and J. Hopfield, "Simple neural optimization networks: An a/d converter, signal decision circuit, and a linear programming circuit," IEEE Trans. Circuits Syst., vol. CAS-33, no. 5, pp. 533-541, May 1986. (Pubitemid 16595842)
23. Q. Tao, X. Liu, and X. Cui, "A linear optimization neural network for associative memory," Appl. Math. Comput., vol. 171, no. 2, pp. 1119-1128, Dec. 2005. (Pubitemid 43131097)
24. J.Wang, "Analysis and design of a recurrent neural network for linear programming," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 40, no. 9, pp. 613-618, Sep. 1993.
25. J. Wang, "A deterministic annealing neural network for convex programming," Neural Netw., vol. 7, no. 4, pp. 629-641, 1994.
26. J. Wang, "Primal and dual neural networks for shortest-path routing," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 28, no. 6, pp. 864-869, Nov. 1998. (Pubitemid 128748092)
27. Y. Xia, "A new neural network for solving linear and quadratic programming problems," IEEE Trans. Neural Netw., vol. 7, no. 6, pp. 1544-1548, Nov. 1996.
28. Y. Xia, G. Feng, and J. Wang, "A recurrent neural network with exponential convergence for solving convex quadratic program and related linear piecewise equations," Neural Netw., vol. 17, no. 7, pp. 1003-1015, Sep. 2004. (Pubitemid 39093818)
29. Y. Xia, G. Feng, and J. Wang, "A primal-dual neural network for online resolving constrained kinematic redundancy in robot motion control," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 35, no. 1, pp. 54-64, Feb. 2005. (Pubitemid 40226198)
30. Y. Xia, H. Leung, and J. Wang, "A projection neural network and its application to constrained optimization problems," IEEE Trans. Circuits Syst. I, Fundam. Theory Appl., vol. 49, no. 4, pp. 447-458, Apr. 2002. (Pubitemid 34515146)
31. Y. Xia and J. Wang, "A general projection neural network for solving monotone variational inequalities and related optimization problems," IEEE Trans. Neural Netw., vol. 15, no. 2, pp. 318-328, Mar. 2004.
32. Y. Xia and J. Wang, "A one-layer recurrent neural network for support vector machine learning," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 2, pp. 1261-1269, Apr. 2004.
33. Y. Xia and J. Wang, "A recurrent neural network for nonlinear convex optimization subject to nonlinear inequality constraints," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 51, no. 7, pp. 1385-1394, Jul. 2004.
34. X. Xue and W. Bian, "Subgradient-based neural networks for nonsmooth convex optimization problems," IEEE Trans. Circuits Syst. I, Reg. Papers, vol. 55, no. 8, pp. 2378-2391, Sep. 2008.
35. Y. Yang and J. Cao, "Solving quadratic programming problems by delayed projection neural network," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1630-1634, Nov. 2006. (Pubitemid 44829047)
36. S. Zhang and A. Constantinides, "Lagrange programming neural networks," IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 39, no. 7, pp. 441-452, Jul. 1992. (Pubitemid 23579814)