Directed random search for multiple layer perceptron training

Neural Networks for Signal Processing - Proceedings of the IEEE Workshop

Volumn , Issue , 2001, Pages 193-202

  Seiffert, Udo ^a   Michaelis, Bernd ^a  

^a OTTO VON GUERICKE UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BACKPROPAGATION; BENCHMARKING; LEARNING ALGORITHMS; SEARCH ENGINES; TRANSFER FUNCTIONS;

DIRECTED RANDOM SEARCH (DRS);

MULTILAYER NEURAL NETWORKS;

EID: 0035783563     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. M. Minsky and S. Papert, Perceptrons: An introduction to computational geometry, Cambridge: MIT Press, 1969.
2. R.P. Lippmann, "An introduction to computing with neural nets," IEEE ASSP Magazine, vol. 4, no. 87, pp 4-23, 1987.
3. D.E. Rumelhart, G.E. Hinton and R.J. Williams, "Learning internal representations by error propagation," Rumelhart, D.E. et al. (eds.): Parallel distributed processing: Explorations in the microstructure of cognition, Cambridge: MIT Press, 1986, pp. 318-362.
4. D.B. Parker, "Learning-logic," Report No. TR47, Massachusetts Institute of Technology, Center for Computational Research in Economics and Management Science, 1985.
5. M.I. Jordan, "Why the logistic function? A tutorial discussion on probabilities and neural networks," Computational Cognitive Science Report No. 9503, Massachusetts Institute of Technology, 1995.
6. The Neural Network FAQ, ftp://ftp.sas.com/pub/neural/FAQ.html#questions.
7. A.J.F. van Rooij, L.C. Jain and R.P. Johnson, Neural network training using genetic algorithms, Singapore: World Scientific, 1996.
8. U. Seiffert and B. Michaelis, "On the gradient descent in Backpropagation and its substitution by a genetic algorithm," Proceedings of the IASTED International Conference on Applied Informatics, 2000, pp. 821-826.
9. U. Seiffert, "Multiple Layer Perceptron training using genetic algorithms," Proceedings of the European Symposium on Artificial Neural Networks, 2001, pp. 159-164.
10. J. Matyas, "Random optimization," Automation and Remote Control, vol. 26, pp. 246-253, 1965.
11. N. Babu, T. Shoman and Y. Sawaragi, "A modified convergence theorem for a random optimization method," Information Sci, vol. 13, pp. 159-166, 1977.
12. G. Schrack and M. Choit, "Optimized relative step size random searches," Mathematical Programming, vol. 10, pp. 230-244, 1976.
13. F.J. Solis and R.J.-B. Wets, "Minimization by random search techniques," Mathematics of Operations Research, vol. 6, no. 1, pp. 19-30, 1981.
14. N. Baba, "A new approach for finding the global minimum of error functions of neural networks," Neural Networks, vol. 2, pp. 367-373, 1989.
15. B.G. Batchelor, Practical approach to pattern recognition, New York: Plenum Press, 1974.
16. C.L. Blake, C.L. and C.J. Merz, C.J., UCI Repository of machine learning databases [http://www.ics.uci.edu/̃mleam/MLRepository.html], Irvine, CA: University of California, Department of Information and Computer Science.