Convergence analysis of a discrete-time recurrent neural network to perform quadratic real optimization with bound constraints

IEEE Transactions on Neural Networks

Volumn 9, Issue 6, 1998, Pages 1344-1351

  Pérez Ilzarbe, María José ^a  

^a PUBLIC UNIVERSITY OF NAVARRE   (Spain)

Author keywords

Convergence of numerical methods; Discrete time systems; Gradient methods; Optimization methods; Recurrent neural networks

Indexed keywords

CONSTRAINT THEORY; CONVERGENCE OF NUMERICAL METHODS; LAGRANGE MULTIPLIERS; OPTIMIZATION;

BOUND CONSTRAINTS; GRADIENT METHODS; QUADRATIC REAL OPTIMIZATION;

RECURRENT NEURAL NETWORKS;

EID: 0032208895     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.728385     Document Type: Article

References (22)

1. M. S. Bazaraa and C. Shetty, Nonlinear Programming: Theory and Algorithms. New York: Wiley, 1979.
2. D. G. Luenberger, Linear and Nonlinear Programming. Reading, MA: Addison-Wesley, 1984.
3. J. J. Hopfield, "Neurons with graded response have computational properties like those of two state neurons," in Proc. Nat. Academy Sci., 1984, vol. 81, pp. 3088-3092.
4. J. J. Hopfield and D. W. Tank, "Neural computation of decision in optimization problems," Biol. Cybern., vol. 52, pp. 141-152, 1985.
5. D. W. Tank and J. J. Hopfield, "Simple neural optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit," IEEE Trans. Circuits Syst., vol. 33, pp. 533-541, 1986.
6. M. P. Kennedy and L. O. Chua, "Neural networks for nonlinear programming," IEEE Trans. Circuits Syst., vol. 35, pp. 554-562, 1988.
7. J. Chen and M. A. Shanblatt, "Improved neural networks for linear and nonlinear programming," Int. J. Neural Syst., vol. 2, no. 4, pp. 331-339, 1992.
8. S. Z. Li, "Improving convergence and solution quality of Hopfield-type neural networks with augmented Lagrange multipliers," IEEE Trans. Neural Networks, vol. 7, pp. 1507-1516, 1996.
9. S. Sudharsanan and M. Sundareshan, "Exponential stability and systematic synthesis of a neural network for quadratic minimization," Neural Networks, vol. 4, no. 5, pp. 599-613, 1991.
10. A. Bouzerdoum and T. R. Pattison, "Neural network for quadratic optimization with bound constraints," IEEE Trans. Neural Networks, vol. 4, pp. 293-304, 1993.
11. J. B. Galván and M. J. Pérez-Ilzarbe, "Two neural networks for solving the linear system identification problem," in Proc. IEEE Int. Conf. Neural Networks, 1994, pp. 3226-3230.
12. M. J. Pérez-Ilzarbe, "A discrete-time recurrent neural network for quadratic optimization," in Proc. Int. Conf. EANN'95, 1995, pp. 335-342.
13. P. Koiran, "Dynamics of discrete-time, continuous state Hopfield networks," Neural Comput., vol. 6, pp. 459-468, 1994.
14. J. A. Anderson, "Cognitive and psychological computation with neural models," IEEE Trans. Syst., Man, Cybern., vol. 13, pp. 799-815, 1983.
15. S. Grossberg, "Nonlinear neural networks: Principles, mechanisms, and architectures," Neural Networks, vol. 1, pp. 17-61, 1988.
16. H. J. Greenberg, "Equilibria of the brain-state-in-a-box (BSB) neural model," Neural Networks, vol. 1, pp. 323-324, 1988.
17. A. N. Michel, J. Si, and G. Yen, "Analysis and synthesis of a class of discrete-time neural networks described on hypercubes," IEEE Trans. Neural Networks, vol. 2, pp. 32-46, 1991.
18. S. Hui and S. H. Zak, "Dynamical analysis of the brain-state-in-a-box (BSB) neural models," IEEE Trans. Neural Networks, vol. 3, pp. 86-94, 1992.
19. R. Perfetti, "A synthesis procedure for brain-state-in-a-box neural networks," IEEE Trans. Neural Networks, vol. 6, pp. 1071-1080, 1995.
20. A. Greenbaum and G. H. Rodrigue, "Optimal preconditioners of a given sparsity pattern," Comput. Sci. Numer. Math., vol. 29, pp. 610-634, 1989.
21. G. H. Golub and C. F. Van Loan, Matrix Computations. Oxford, U.K.: North Oxford Academic, 1983.
22. M. Abramowitz and I. A. Stegun, Ed., Handbook of Mathematical Functions. New York: Dover, 1972.