Global Optimization for Fast Multilayer Perceptron Training

Proceedings of the International Joint Conference on Neural Networks

Volumn 1, Issue , 2003, Pages 410-414

  Lee, Jaewook ^a  

^a Pohang University of Science and Technology (POSTECH)   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; BACKPROPAGATION; COMPUTER SIMULATION; ERROR ANALYSIS; FUNCTIONS; GLOBAL OPTIMIZATION; GRADIENT METHODS; HEURISTIC METHODS; LEARNING SYSTEMS;

SCALAR FUNCTIONS;

MULTILAYER NEURAL NETWORKS;

EID: 0141684809     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (17)

1. H. Ammar and Y. Cherruault, Approximation of a several variables function by a one variable function and application to global optimization, Math. Comp. Modeling, Vol 18(2), pp. 17-21, 1993.
2. J. Barben, V.Protopopescu, and D. Reister, TRUST: A deterministic algorithm for global optimization, Science, vol. 276, pp. 1094-1097, 1997.
3. R. Battiti and F. Masulli, BFGS Optimization for Faster Autimated Supervisa Learning, Int. Neural-Netwo Conf., vol. 2, pp. 757-760, 1990.
4. R. Battiti, First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Methods Neural Computation, vol. 4, no. 2, pp. 141-166, 1992.
5. S. Becker and Y. Le Cun, Improving the Convergence of Backpropagatian Learning with Second Order Methods, Pro. of the 1988 Connectionist Models Summer School, pp. 29-37, 1989.
6. C. M. Bishop, Neural Networks for Pattern Recognition, Oxford Univ. Press, New York, 1995.
7. R. O. Duda, P. E. Hart, and D. O. Stork, Pattern Classification, John Wiley & Sons, New York, 2001.
8. P.Fletcher, Practical Methods of Optimization, Wiley, New York, 1987.
9. S. Haykin, Neural Networks: A Comprehensive Foundation, Prentice-Hall, New York, 1999.
10. R. A. Jacobs, Increased rates of convergence through learning rate adaptation, Neural Networks vol.1, pp. 295-307, 1988.
11. Jaewook Lee, Trajectory-based Methods for Global Optimization, Ph.D.dissertation, Cornell Univ., NY, 1999.
12. Jaewook Lee and H.D.Chiang, Theory of stability regions of a class of non-hyperbolic dynamical systems and its applications to constraint satisfaction problems, IEEE Trans. on Circuits and Systems- Part I: Fundamental theory and applications, Vol. 49-(2), pp. 196-209, Feb. 2002.
13. G. D. MAgoulas, M. N. Vrahatis, and G. S. Androulakis, Effective backpropagation training with variable stepsize, Neural Networks vol.10, no. 1, pp. 69-82, 1997.
14. J.J. More and D.C. Sorensen, Computing a Trust Region Step, SIAM Journal on Scientific and Statistical Computing, Vol. 3, pp. 553-572, 1983.
15. S.-C. Ng, C.-C Cheung, and S.-H Leung, Deterministic weight evolution algorithm for solving local minima problem, Electronics Letter, Vol. 36, No. 12, pp. 1039-1041, 8th June 2000
16. Pinaki Roychowdhury, Y. P. Singh, and R. A. Chasarkar, Dynamic Tunneling Technique for Efficient Training of Multilayer Perceptrons, IEEE Trans. on Neural Networks, vol.10, No. 1, pp.48-55, 1999.
17. D. E. Rumerhart, G. E. Hinton, and R. J. Wiliams, Learning Internal Representations by Back-Propagation Error, Nature, vol.323, pp.535-536, 1986.