A robust evolutionary algorithm for training neural networks

Neural Computing and Applications

Volumn 10, Issue 3, 2001, Pages 214-230

  Yang, Jinn Moon ^a   Kao, Cheng Yan ^b  

^a NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

^b NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Adaptive mutations; Evolutionary algorithm; Family competition; Multiple mutations; Neural networks

Indexed keywords

EID: 0035566378     PISSN: 09410643     EISSN: None     Source Type: Journal    
DOI: 10.1007/s521-001-8050-2     Document Type: Article

References (33)

1. Hornik K. Approximation capabilities of multilayer feedforward networks. Neural Networks 1991; 4: 251-257
2. Rumelhart DE, Hinton GE, Williams RJ. Learning internal representations by error propagation. In: DE Rumelhart, JL McClelland, editors, Parallel Distributed Processing: Explorations in the Microstructures of Cognition. MIT Press 1986; 318-362
3. Fahlamn SE, Lebiere C. The cascade-correlation learning architecture. In: DS Touretzky, editor, Advances in Neural Information Processing Systems II. Morgan-Kaufmann, 1990; 524-532
4. Hwang J-N, You S-S, Lay S-R, Jou I-C. The cascade-correlation learning: A projection pursuit learning perspective. IEEE Trans Neural Networks 1996; 7(2): 278-289
5. Schaffer JD, Whitley D, Eshelman LJ. Combinations of genetic algorithms and neural networks: A survey of the state of the art. Proc Int Workshop on Combinations of Genetic Algorithms and Neural Networks 1992; 1-37
6. Bengio Y, Simard P, Frasconi P. Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Networks 1994; 5(2): 157-166
7. Goldberg DE. Genetic algorithms in Search, Optimisation and Machine Learning. Addison-Wesley, 1989
8. Fogel DB. Evolutionary Computation: Toward a New Philosophy of Machine Intelligent. IEEE Press, 1995
9. Bäck T. Evolutionary Algorithms in Theory and Practice. Oxford University Press, 1996
10. Davidor Y. Epistasis variance: Suitability of a representation to genetic algorithms. Complex Systems 1990; 4: 368-383
11. Eshelman LJ, Schaffer JD. Real-coded genetic algorithms and interval-schemata. In: LD Whitley, editor, Foundation of Genetic Algorithms 2. Morgan Kaufmann, 1993; 187-202
12. Mühlenbein H, Schlierkamp-Voosen D. Predictive models for the breeder genetic algorithm I. Continuous parameters optimisation. Evolutionary Computation 1993; 1(1): 24-49
13. Yang J-M, Kao C-Y. Integrating adaptive mutations and family competition into genetic algorithms as function optimizer. Soft Computing 2000; 4(2): 89-102
14. Hart WE. Adaptive global optimisation with local search. PhD thesis, University of California, San Diego, 1994
15. Kitano H. Empirical studies on the speed of the convergence of neural network training using genetic algorithms. Proc Int Conf on Artificial Intelligence 1990; 789-795
16. Montana DJ, Davis L. Training feedforward neural networks using genetic algorithms. Proc Eleventh Int Joint Conf on Artificial Intelligence 1989; 762-767
17. Xiao J, Michalewicz Z, Zhang L, Trojanowski K. Adaptive evolutionary planner/navigator for mobile robots. IEEE Trans Evolutionary Computation 1997; 1(1): 18-28
18. Yang J-M, Chen Y-P, Horng J-T, Kao C-Y. Applying family competition to evolution strategies for constrained optimisation. In: Angeline PJ, Reynolds RG, McDonnell JR, Eberhart R, editors, Lecture Notes in Computer Science 1213. 1997; 201-211
19. Yang J-M, Kao C-Y, Horng J-T. Evolving neural induction regular languages using combined evolutionary algorithms. Proc 9th Int Conf on Artificial Intelligence 1996; 162-169
20. Bäck T, Schwefel H-P. An overview of evolution algorithms for parameter optimisation. Evolutionary Computation 1993; 1(1): 1-23
21. Schwefel H-P. Numerical Optimisation of Computer Models. Wiley, 1981
22. Rudolph G. Local convergence rates of simple evolutionary algorithms with cauchy mutations. IEEE Trans Evolutionary Computation 1997; 1(4): 249-258
23. Whitley D, Starkweather T, Bogart C. Genetic algorithms and neural networks: Optimizing connections and connectivity. Parallel Computing 1990; 14: 347-361
24. Jefferson D, Collins R, Cooperand C, Dyer M, Flowers M, Korf R, Taylor C, Wang A. Evolution as a theme in artificial life: The genesys/tracker system. Artificial Life II: Proc Workshop on Artificial Life 1990; 549-577
25. Angeline PJ, Saunders GM, Pollack JB. An evolutionary algorithm that constructs recurrent neural networks. IEEE Trans Neural Networks 1994; 5(1): 54-65
26. Lang KJ, Witbrock MJ. Learning to tell two spirals apart. Proc Connections Models Summer School. Morgan Kaufmann 1988; 52-59
27. Smieja F. The pandemonium system of reflective agents. IEEE Trans Neural Networks 1996; 7(1): 97-106
28. Juillú H, Pollack JB. Co-evolving intertwined spirals. Proc Fifth Annual Conference on Evolutionary Programming 1996
29. Tesauro G, Janssens B. Scaling relationships in backpropagation learning. Complex Systems 1988; 2: 39-84
30. Yao X, Liu Y. A new evolutionary system for evolving artificial neural networks. IEEE Trans Neural Networks 1996
31. Gorman RP, Sejnowski TJ. Analysis of hidden units in a layered network trained to classify sonar targets. Neural Networks 1988; 1: 75-89
32. Xu Y, Mural RJ, Einstein JR, Shah MB, Uberbacher EC. Grail: A multi-agent neural network system for gene identification. Proc IEEE 1996; 84(10): 1544-1552
33. Yang J-M, Kao C-Y. Flexible ligand docking using a robust evolutionary algorithm. J Computational Chemistry 2000; 21(11): 988-998