Global optimization for neural network training

Computer

Volumn 29, Issue 3, 1996, Pages 45-54

  Shang, Yi ^a,b,c,d   Wah, Benjamin W ^a,b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b University of Illinois at Urbana Champaign   (United States)

^c UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA   (China)

^d INSTITUTE OF COMPUTING TECHNOLOGY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; BACKPROPAGATION; CALCULATIONS; DIFFERENCE EQUATIONS; ERRORS; FUNCTIONS; LEARNING SYSTEMS; OPTIMIZATION;

GLOBAL OPTIMIZATION; NONLINEAR OPTIMIZATION VIA EXTERNAL LEAD;

FEEDFORWARD NEURAL NETWORKS;

EID: 0030104504     PISSN: 00189162     EISSN: None     Source Type: Trade Journal    
DOI: 10.1109/2.485892     Document Type: Review

References (12)

1. A. Torn and A. Zilinskas, Global Optimization, Springer-Verlag, New York, 1987.
2. D.G. Luenberger, Linear and Nonlinear Programming, Addison-Wesley, Reading, Mass., 1984.
3. R. Battiti, "First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method," Neural Computation, Vol. 4, No. 2, 1992, pp. 141-166.
4. L.C.W. Dixon, "Neural Networks and Unconstrained Optimization," in Algorithms for Continuous Optimization: The State of the Art, E. Spedicato, ed., Kluwer Academic, The Netherlands, 1994, pp. 513-530.
5. A.V. Levy et al., Topics in Global Optimization, Lecture Notes in Mathematics No. 909, Springer-Verlag, New York, 1981.
6. A.C. Hindmarsh, "ODEPACK, a Systematized Collection of ODE Solvers," in Scientific Computing (R.S. Stepleman, ed.), North Holland, Amsterdam, 1983, pp. 55-64.
7. S.E. Fahlman and C. Lebiere, "The Cascade-Correlation Learning Architecture," in Advances in Neural Information Processing Systems 2, D.S. Touretzky, ed., Morgan Kaufmann, San Mateo, Calif., 1990, pp. 524-532.
8. J. Hwang et al., "Regression Modeling in Back-Propagation and Projection Pursuit Learning," IEEE Trans. Neural Networks, Vol. 5, May 1994, pp. 1-24.
9. A. Corana et al., "Minimizing Multi-Modal Functions of Continuous Variables with the Simulated Annealing Algorithm," ACM Trans. Mathematical Software, Vol. 13, No. 3, 1987, pp. 262-280.
10. Z. Michalewicz, Genetic Algorithms + Data Structure = Evolution Programs, Springer-Verlag, New York, 1994.
11. J. Sprave, "Linear Neighborhood Evolution Strategies," Proc. Third Ann. Conf. Evolutionary Programming, World Scientific, 1994.
12. T.J. Sejnowski and C.R. Rosenberg, "Parallel Networks That Learn to Pronounce English Text," Complex Systems, Vol. 1, No. 1, Feb. 1987, pp. 145-168.