G-Prop-II: Global optimization of multilayer perceptrons using GAs

Proceedings of the 1999 Congress on Evolutionary Computation, CEC 1999

Volumn 3, Issue , 1999, Pages 2022-2027

  Castillo, P A ^a   Rivas, V ^a   Merelo, J J ^b   Gonzalez, J ^b   Prieto, A ^b   Romero, G ^b  

^a UNIVERSITY OF JAÉN   (Spain)

^b Dept of Architecture and Computer Technology ^*  (Spain)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; BACKPROPAGATION; ELECTRIC LOADS; GLOBAL OPTIMIZATION;

BENCH-MARK PROBLEMS; EVOLUTIVE ALGORITHMS; GENETIC OPERATORS; LEARNING PARAMETERS; MODEL SELECTION; MULTI LAYER PERCEPTRON; PARAMETER SPACES; TRAINING ALGORITHMS;

GENETIC ALGORITHMS;

EID: 84901465300     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CEC.1999.785523     Document Type: Conference Paper

References (31)

1. S. E. Fahlman. Faster-Learning Variations on Back-Propagation: An Empirical Study. Proceedings of the 1988 Connectionist Models Summer School, Morgan Kaufmann, 1988.
2. M. Ricdmiller and H. Braun. A Direct Adaptive Method for Faster Backpropagation Learning: The RPROP Algorithm. In Ruspini, H., (Ed.) Proc. of the ICNN93, San Francisco, pp. 586-591, 1993.
3. J. J. Merelo; M. Patón; A. Canas; A. Prieto and F. Morán. Optimization of a competitive learning neural network by genetic algorithms. IWANN93. Lectures Notes in Computer Science, vol. 686, 185-192, 1993.
4. P. A. Castillo; J. González; J. J. Merelo; V. Rivas; G. Romero; A. Prieto. G-Prop: Global Optimization of Multilayer Perceptions using GAs. Submitted to Neurocomputing, 1998.
5. Xin Yao and Yong Liu. Towards Designing Artificial Neural Networks by Evolution. Applied Mathematics and Computation, 91(1):83-90, 1998.
6. G. F. Miller; P. M Todd and S. U. Hegde. Designing neural networks using genetic algorithms. In J. D. Schajfer, editor, Proceedings of the Third International Conference on Genetic Algorithms, pages 379-384, San Mateo, 1989, 1989.
7. Ethem Alpaydm. GAL: Networks that grow when they learn and shrink when they forget. International Journal of Pattern Recognition and Artificial Intelligence, 8(1), 391-414, 1994.
8. Xin Yao. A review of evolutionary artificial neural networks. International Journal of Intelligent Systems, 8(4):539-67, April 1993.
9. S. Fahlman and C. Lebière. The Cascade-Correlation Learning Architecture. Neural Information Systems 2. Touretzky, D. S. (ed) Morgan-Kauffman, 524-532, 1990.
10. R. Parekh; J. Yang and Honavar V. Constructive neural network learning algorithms for multi-category realvalued pattern classification. Technical Report ISU-CS-TR-97-06, Department of Computer Science, Iowa State University., 1997.
11. J. Zhang; A. Morris. A sequential learning approach for single hidden layer neural networks. Neural Networks 11 (1997) 65-80, 1997.
12. T. Rathbun; S. Rogers; M. De Simio; M. Oxley. MLP iterative construction algorithm. Neurocomputing 17 (1997) 195-216, 1997.
13. T. Jasic and H. Poh. Analysis of Pruning in Backpropagation Networks for Artificial and Real World Mapping Problems. IWANN95. Lectures Notes in Computer Science, vol. 930, 239-245, 1995.
14. M. Pelillo and A. Fanelli. A Method of Pruning Layered Feed-Forward Neural Networks. IWANN93. Lectures Notes in Computer Science, vol. 686, 278-283, 1993.
15. Y. Le Cun; J. S. Denker; S. A. Solla. Optimal brain damage. Neural Information Systems 2. Touretzky, D. S. (ed) Morgan-Kauffman, pp. 598-605, 1990.
16. B. Hassibi; D. G. Stork; G. Wolff; T. Watanabe. Optimal Brain Surgeon: extensions and performance comparisons. In NlPS6, pp. 263-270, 1994.
17. Mads Hintz-Madsen; Lars Kai Hansen; Jan Larsen; Morten With Pedersen; Michael Larsen. Neural classifier construction using regularization, pruning and test error estimation. Neural Networks 11, 1659-1670, 1998.
18. A. P Topchy; O. A. Lebedko; V. V. Miagkikh. Fast learning in multilayered neural networks by means of hybrid evolutionary and gradient algorithms. to appear in Proc. of IC on Evolutionary Computation and Its Applications, Moscow, 1996.
19. I. De Falco; A. Iazzetta; P. Natale; E. Tarantino. Evolutionary Neural Networks for Nonlinear Dynamics Modeling. PPSN98. Lectures Notes in Computer Science, vol. 1498, 593-602, 1998.
20. David White and Panos Ligomenides. GANNet: A Genetic Algorithm for Optimizing Topology and Weights in Neural Network Design. IWANN93. Lectures Notes in Computer Science, vol. 686, 322-327, 1993.
21. G. Bebis; M. Georgiopoulos; T. Kasparis. Coupling weight elimination with genetic algorithms to reduce network size and preserve generalization. Neurocomputing 17 (1997) 167-194, 1997.
22. I. De Falco; A. Della Cioppa; A. Iazzetta; P. Natale; E. Tarantino. Optimizing Neural Networks for Time Series Prediction. Third World Conference on Soft Computing (WSC3), June 1998., 1998.
23. V. Petridis; S. Kazarlis; A. Papaikonomu and A. Filelis. A hybrid genetic algorithm for training neural networks. Artificial Neural Networks, 2, 953-956, 1992.
24. P. A. Castillo; J. González; J. J. Merelo; V. Rivas; G. Romero; A. Prieto. SA-Prop: Optimization of Multilayer Pcrceptron Parameters using Simulated Annealing. Submitted to IWANN99, 1998.
25. D. Whitley. The GENITOR Algorithm and Selection Presure: Why rank-based allocation of reproductive trials is best, in J. D. Schaffer (Ed.), Proceedings of The Third International Conference on Genetic Algorithms, Morgan Kauffmann, Publishers, 116-121, 1989.
26. Zbigniew Michalewicz. Genetic Algorithms + Data Structures =Evolution Programs, Third, Extended Edition. Springer-Verlag, 1996.
27. Werner Kinnebrock. Accelerating the standard backpropagation method using a genetic approach. Neurocomputing, 6, 583-588, 1994.
28. O. L. Mangasarian; R. Setiono and W. H. Wolberg. Pattern recognition via linear programming: Theory and application to medical diagnosis. Large-scale numerical optimization, Thomas E Coleman and Yuying Li, editors, S1AM Publications, Philadelphia 1990, pp 22-30, 1990.
29. Lutz Preehelt. PROBEN1 - A set of benchmarks and benchmarking rules for neural network training algorithms. Technical Report 21/94, Fakultät für Informatik, Univcrsität Karlsruhe, D-76128 Karlsruhe, Germany, September 1994.
30. J. J. Merelo; A. Prieto; F. Morán; R. Marabini and J. M Carazo. Automatic Classification of Biological Particles from Electron-microscopy Images Using Conventional and Genetic-algorithm Optimized Learning Vector Quantization. Neural Proccessing Letters 8:55-65, 1998, 1998.
31. D. J. Montana; L. Davis. Training feedforward neural networks using genetic algorithms. Proc. 11th Internat. Joint Conf. on Artificial Intelligence, 762-767, 1989.