A one-layer projection neural network for nonsmooth optimization subject to linear equalities and bound constraints

IEEE Transactions on Neural Networks and Learning Systems

Volumn 24, Issue 5, 2013, Pages 812-824

  Liu, Qingshan ^a   Wang, Jun ^b,c  

^a SOUTHEAST UNIVERSITY   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^c DALIAN UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Differential inclusion; Global convergence; Lyapunov function; Nonsmooth optimization; Projection neural network

Indexed keywords

DESIGN AND IMPLEMENTATIONS; DIFFERENTIAL INCLUSIONS; GLOBAL CONVER-GENCE; LINEAR EQUALITY CONSTRAINTS; NONSMOOTH OPTIMIZATION; NONSMOOTH OPTIMIZATION PROBLEMS; OPTIMIZATION PROBLEMS; PROJECTION NEURAL NETWORK;

LYAPUNOV FUNCTIONS; OPTIMIZATION; RECURRENT NEURAL NETWORKS;

CONVEX OPTIMIZATION;

ALGORITHM; ARTIFICIAL NEURAL NETWORK; COMPUTER SIMULATION; HUMAN; NONLINEAR SYSTEM; PROBLEM SOLVING;

ALGORITHMS; COMPUTER SIMULATION; HUMANS; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; PROBLEM SOLVING;

EID: 84876337591     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2013.2244908     Document Type: Article

References (49)

1. J. Aubin and A. Cellina, Differential Inclusions: Set-Valued Maps and Viability Theory. New York, USA: Springer-Verlag, 1984.
2. A. Auslender, Optimisation: Méthodes Numériques. Paris, France: Masson, 1976.
3. M. Bazaraa, H. Sherali, and C. Shetty, Nonlinear Programming: Theory and Algorithms, 3rd Ed. Hoboken, New Jersey, New York, USA: Wiley, 2006.
4. W. Bian and X. Xue, "Subgradient-based neural networks for nonsmooth nonconvex optimization problems," IEEE Trans. Neural Netw., vol. 20, no. 6, pp. 1024-1038, Jun. 2009.
5. A. Bouzerdoum and T. Pattison, "Neural network for quadratic optimization with bound constraints," IEEE Trans. Neural Netw., vol. 4, no. 2, pp. 293-304, Mar. 1993. (Pubitemid 23640394)
6. X. Chen, R. Womersley, and J. Ye, "Minimizing the condition number of a Gram matrix," SIAM J. Optim., vol. 21, no. 1, pp. 127-148, 2011.
7. L. Cheng, Z. Hou, Y. Lin, M. Tan, W. Zhang, and F. Wu, "Recurrent neural network for non-smooth convex optimization problems with application to the identification of genetic regulatory networks," IEEE Trans. Neural Netw., vol. 22, no. 5, pp. 714-726, May 2011.
8. E. Chong, S. Hui, and S. Zak, "An analysis of a class of neural networks for solving linear programming problems," IEEE Trans. Autom. Control, vol. 44, no. 11, pp. 1995-2006, Nov. 1999. (Pubitemid 30531636)
9. F. Clarke, Optimization and Nonsmooth Analysis. New York, USA: Wiley, 1983.
10. A. Filippov, Differential Equations with Discontinuous Righthand Sides, Mathematics and its applications (Soviet series). Boston, USA: Kluwer Academic Publishers, 1988.
11. M. Forti, M. Grazzini, P. Nistri, and L. Pancioni, "Generalized lyapunov approach for convergence of neural networks with discontinuous or nonlipschitz activations," Physica D, vol. 214, no. 1, pp. 88-99, 2006. (Pubitemid 43131061)
12. M. Forti and P. Nistri, "Global convergence of neural networks with discontinuous neuron activations," IEEE Trans. Circuits Syst.-I, vol. 50, no. 11, pp. 1421-1435, Nov. 2003.
13. M. Forti, P. Nistri, and D. Papini, "Global exponential stability and global convergence in finite time of delayed neural networks with infinite gain," IEEE Trans. Neural Netwo., vol. 16, no. 6, pp. 1449-1463, Nov. 2005. (Pubitemid 41709643)
14. M. Forti, P. Nistri, and M. Quincampoix, "Generalized neural network for nonsmooth nonlinear programming problems," IEEE Trans. Circuits Syst.-I, vol. 51, no. 9, pp. 1741-1754, Sep. 2004.
15. M. Forti, P. Nistri, and M. Quincampoix, "Convergence of neural networks for programming problems via a nonsmooth Łojasiewicz inequality," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1471-1486, Nov. 2006. (Pubitemid 44824261)
16. X. Gao, "A novel neural network for nonlinear convex programming," IEEE Trans. Neural Netw., vol. 15, no. 3, pp. 613-621, May 2004.
17. X. Hu and J. Wang, "Solving pseudomonotone variational inequalities and pseudoconvex optimization problems using the projection neural network," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1487-1499, Nov. 2006. (Pubitemid 44824262)
18. X. Hu and J. Wang, "Design of general projection neural networks for solving monotone linear variational inequalities and linear and quadratic optimization problems," IEEE Trans. Sys., Man Cybern.-B, vol. 37, no. 5, pp. 1414-1421, Oct. 2007.
19. X. Hu and J. Wang, "An improved dual neural network for solving a class of quadratic programming problems and its k-winners-take-all application," IEEE Trans. Neural Netw., vol. 19, no. 12, pp. 2022-2031, Dec. 2008.
20. X. Hu and B. Zhang, "A new recurrent neural network for solving convex quadratic programming problems with an application to the k-winners-take-all problem," IEEE Trans. Neural Netw., vol. 20, no. 4, pp. 654-664, Apr. 2009.
21. M. Kennedy and L. Chua, "Neural networks for nonlinear programming," IEEE Trans. Circuits Syst., vol. 35, no. 5, pp. 554-562, May 1988.
22. D. Kinderlehrer and G. Stampacchia, An Introduction to Variational Inequalities and Their Applications, New York, USA: Academic Press, 1982.
23. G. Li, S. Song, C. Wu, and Z. Du, "A neural network model for nonsmooth optimization over a compact convex subset," in Proc. 3rd Int. Symp. Neural Netw., 2006, pp. 344-349.
24. Q. Liu, J. Cao, and Y. Xia, "A delayed neural network for solving linear projection equations and its analysis," IEEE Trans. Neural Netw., vol. 16, no. 4, pp. 834-843, Jul. 2005. (Pubitemid 41064315)
25. Q. Liu, Z. Guo, and J. Wang, "A one-layer recurrent neural network for constrained pseudoconvex optimization and its application for portfolio optimization," Neural Netw., vol. 26, pp. 99-109, Feb. 2012.
26. Q. Liu and J. Wang, "A one-layer recurrent neural network with a discontinuous activation function for linear programming," Neural Comput., vol. 20, no. 5, pp. 1366-1383, 2008.
27. Q. Liu and J. Wang, "A one-layer recurrent neural network with a discontinuous hard-limiting activation function for quadratic programming," IEEE Trans. Neural Netw., vol. 19, no. 4, pp. 558-570, Apr. 2008. (Pubitemid 351583574)
28. Q. Liu and J. Wang, "A one-layer recurrent neural network for nonsmooth convex optimization subject to linear equality constraints," in Proc. 15th Int. Conf. Neural Inf. Proc. 2009, pp. 1003-1010.
29. Q. Liu and J. Wang, "Finite-time convergent recurrent neural network with a hard-limiting activation function for constrained optimization with piecewise-linear objective functions," IEEE Trans. Neural Netw., vol. 22, no. 4, pp. 601-613, Apr. 2011.
30. Q. Liu and J. Wang, "A one-layer recurrent neural network for constrained nonsmooth optimization," IEEE Trans. Syst., Man, Cybern.-B, vol. 41, no. 5, pp. 1323-1333, Oct. 2011.
31. S. Liu and J. Wang, "A simplified dual neural network for quadratic programming with its kwta application," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1500-1510, Nov. 2006. (Pubitemid 44824263)
32. W. Lu and T. Chen, "Dynamical behaviors of delayed neural network systems with discontinuous activation functions," Neural Comput., vol. 18, no. 3, pp. 683-708, 2006. (Pubitemid 43543835)
33. C. Maa and M. Shanblatt, "Linear and quadratic programming neural network analysis," IEEE Trans. Neural Netw., vol. 3, no. 4, pp. 580-594, Jul. 1992.
34. D. Mandic and J. Chambers, Recurrent Neural Networks For Prediction: Learning Algorithms, Architectures, and Stability. New York, USA: Wiley, 2001.
35. P. Maréchal and J. Ye, "Optimizing condition numbers," SIAM J. Optim., vol. 20, no. 2, pp. 935-947, 2010.
36. J. Penot and P. Quang, "Generalized convexity of functions and generalized monotonicity of set-valued maps," J. Optim. Theory Appl., vol. 92, no. 2, pp. 343-356, 1997.
37. D. Tank and J. Hopfield, "Simple neural optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit," IEEE Trans. Circuits Syst., vol. 33, no. 5, pp. 533-541, May 1986. (Pubitemid 16595842)
38. Q. Tao, J. Cao, M. Xue, and H. Qiao, "A high performance neural network for solving nonlinear programming problems with hybrid constraints," Phys. Lett. A, vol. 288, no. 2, pp. 88-94, 2001. (Pubitemid 32927485)
39. J. Wang, "Analysis and design of a recurrent neural network for linear programming," IEEE Trans. Circuits Syst.-I, vol. 40, no. 9, pp. 613-618, Sep. 1993.
40. J. Wang, "A deterministic annealing neural network for convex programming," Neural Netw., vol. 7, no. 4, pp. 629-641, 1994.
41. Y. Xia, G. Feng, and J. Wang, "A novel recurrent neural network for solving nonlinear optimization problems with inequality constraints," IEEE Trans. Neural Netw., vol. 19, no. 8, pp. 1340-1353, Aug. 2008.
42. Y. Xia, H. Leung, and J. Wang, "A projection neural network and its application to constrained optimization problems," IEEE Trans. Circuits Syst.-I, vol. 49, no. 4, pp. 447-458, Apr. 2002.
43. Y. Xia and J. Wang, "A general methodology for designing globally convergent optimization neural networks," IEEE Trans. Neural Netw., vol. 9, no. 6, pp. 1331-1343, Nov. 1998. (Pubitemid 128742412)
44. Y. Xia and J. Wang, "Global exponential stability of recurrent neural networks for solving optimization and related problems," IEEE Trans. Neural Netw., vol. 11, no. 4, pp. 1017-1022, Jul. 2000.
45. Y. Xia and J. Wang, "A dual neural network for kinematic control of redundant robot manipulators," IEEE Trans. Syst., Man Cybern.-B, vol. 31, no. 1, pp. 147-154, Feb. 2001.
46. Y. Xia and J. Wang, "A general projection neural network for solving monotone variational inequalities and related optimization problems," IEEE Trans. Neural Netw., vol. 15, no. 2, pp. 318-328, Mar. 2004.
47. Y. Xia and J. Wang, "A recurrent neural network for solving nonlinear convex programs subject to linear constraints," IEEE Trans. Neural Netw., vol. 16, no. 2, pp. 379-386, Mar. 2005. (Pubitemid 40390821)
48. X. Xue and W. Bian, "Subgradient-based neural networks for nonsmooth convex optimization problems," IEEE Trans. Circuits Syst.-I, vol. 55, no. 8, pp. 2378-2391, Sep. 2008.
49. S. Zhang and A. Constantinides, "Lagrange programming neural networks," IEEE Trans. Circuits Syst.-II, vol. 39, no. 7, pp. 441-452, Jul. 1992.