Fast Heuristic Global Learning algorithm for multilayer neural networks

Neural Processing Letters

Volumn 9, Issue 2, 1999, Pages 177-187

  Cho, Siu Yeung ^a   Chow, Tommy W S ^a  

^a CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; HEURISTIC METHODS; LEARNING ALGORITHMS; LEAST SQUARES APPROXIMATIONS; OPTIMIZATION;

HEURISTIC GLOBAL LEARNING;

MULTILAYER NEURAL NETWORKS;

EID: 0032670778     PISSN: 13704621     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1018685627113     Document Type: Article

References (15)

1. E. Aarts and J. Korst, Simulated Annealing and Boltzmann Machines: A Stochastic Approach to Combinatorial Optimization and Neural Computing, John Wiley & Sons, 1989.
2. R. Battiti and G. Tecchiolli, "Training neural nets with the reactive tabu search," IEEE Transactions on Neural Networks, Vol. 6, No. 5, pp. 1185-1200, September 1995.
3. N. Dodd, "Optimization of network structure using genetic techniques", Int. Joint. Conf. on Neural Networks, San Diego, 1990.
4. S.E. Fahlman and C. Lebiere, "The cascade-correlation learning architecture", Technical Report, CMU-CS-90-100, School of Computer Science, Carnegie Mellon University, 1990.
5. M. Gori and A. Tesi, "On the problem of local minima in backpropagation," IEEE Tran. Pattern Ana. Machine Intell., Vol. 14, No. 1, pp. 76-86, Jan. 1992.
6. M. Gori and A. Tesi, "Some examples of local minima during learning with back-propagation," Parallel Architectures and Neural Networks, Vietri sul Mare(IT), May 1990.
7. R. Horst and P.M. Pardalos, Handbooks of Global Optimization, Kluwer Academic Publishers, The Netherlands, 1995.
8. J. Hwang, S. Lay, M. Maechler, R.D. Martin and J. Schimert, "Regression modeling in backpropagation and projection pursuit learning", IEEE Trans, on Neural Networks, Vol. 5, pp. 1-24, May 1994.
9. C. Jones and C. Tsang, "On the convergence of feedforward neural networks incorporating terminal attractors," IEEE International Conference on Neural Networks, Vol. 2, pp. 929-935, San Francisco, CA, March-April 1993.
10. K.J. Lang and M.J. Witbrock, "Learning to tell two spiral apart", in Proc. of the 1988 Connectionist Models Summer School, Morgan Kaufmann, 1988.
11. J.R. McDonnell and D. Waagen, "Determining neural networks connectivity using evolutionary programming", Twenty-sixth Asilormar Conf. on Signals, Systems, and Computers, Monterey, CA, 1992.
12. S.S. Rao, Optimization theory and applications (2nd edn), John Wiley & Sons, New York, 1984.
13. Y. Shang and B.W. Wah, "Global optimization for neural network training," IEEE Computer, Vol. 29, No. 3, pp. 45-54, March 1996.
14. A. Torn and A. Zillinskas, Global Optimization, Springler-Verlag, 1987.
15. Q. Zheng and D. Zhuang, "Integral global optimization of constrained problems in functional spaces with discontinuous penalty functions," in C.A. Floudas and P.M. Pardalos, Recent Advances in Global Optimization, Princeton University Press, pp. 298-320, 1992.