Performance comparison of gradient descent and genetic algorithm based artificial neural networks training

Proceedings of the 2010 10th International Conference on Intelligent Systems Design and Applications, ISDA'10

Volumn , Issue , 2010, Pages 604-609

  Ahmad, Fadzil ^a,b   Isa, Nor Ashidi Mat ^a   Osman, Muhammad Khusairi ^b   Hussain, Zakaria ^b  

^a SCHOOL OF PHYSICS   (Malaysia)

^b UNIVERSITI TEKNOLOGI MARA   (Malaysia)

Author keywords

Artificial Neural Networks; Backpropagation; Classiffication error; Genetic Algorithm; Gradient descent; Rprop and levenberg marquardt

Indexed keywords

ARTIFICIAL NEURAL NETWORK; ARTIFICIAL NEURAL NETWORKS; BENCHMARK DATASETS; CLASSIFFICATION ERROR; CLASSIFICATION ERRORS; CROSSOVER OPERATIONS; DATA SETS; GENETIC-ALGORITHM-BASED ARTIFICIAL NEURAL NETWORKS; GRADIENT BASED; GRADIENT DESCENT; LEVENBERG-MARQUARDT; PERFORMANCE COMPARISON;

BACKPROPAGATION ALGORITHMS; CLASSIFICATION (OF INFORMATION); DESIGN; DISEASES; GENETIC ALGORITHMS; INTELLIGENT SYSTEMS; STANDARDIZATION; SYSTEMS ANALYSIS;

NEURAL NETWORKS;

EID: 79851500260     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISDA.2010.5687199     Document Type: Conference Paper

References (21)

1. M. Paliwal and U. A. Kumar, "Neural networks and statistical techniques: A review of applications," Expert Systems with Applications, vol. 36, pp. 2-17, 2009.
2. D. Rumelhart, G. Hinton, and R. Williams, "Learning representations by back-propagating errors," Nature 323, pp. 533-536, 1986. (Pubitemid 16025374)
3. D. Whitley, T. Starkweather, and C. Bogart, "Genetic algorithms and neural networks: Optimizing connections and connectivity," Parallel computing, vol. 14, pp. 347-361, 1990.
4. D. Goldberg, Genetic Algorithms in Search and Optimization: Addison-wesley, 1989.
5. D. Montana and L. Davis, "Training feedforward neural networks using genetic algorithms," in Proc. 11th Int. Joint Conf. Artificial Intelligence 1989, pp. 762-767.
6. P. J. B. Hancock, "Genetic algorithms and permutation problems: a comparison of recombination operators for neural net structure specification," in Combinations of Genetic Algorithms and Neural Networks, 1992., COGANN-92. International Workshop on, 1992, pp. 108-122.
7. Q. Cao and M. E. Parry, "Neural network earnings per share forecasting models: A comparison of backward propagation and the genetic algorithm," Decision Support Systems, vol. 47, pp. 32-41, 2009.
8. J. N. D. Gupta and R. S. Sexton, "Comparing backpropagation with a genetic algorithm for neural network training," Omega, vol. 27, pp. 679-684, 1999.
9. A. Ghaffari, H. Abdollahi, M. R. Khoshayand, I. S. Bozchalooi, A. Dadgar, and M. Rafiee-Tehrani, "Performance comparison of neural network training algorithms in modeling of bimodal drug delivery," International Journal of Pharmaceutics, vol. 327, pp. 126-138, 2006. (Pubitemid 44679811)
10. E. Alba and J. Chicano, "Training neural networks with GA hybrid algorithms," in Genetic and Evolutionary Computation - GECCO 2004: Springer Berlin / Heidelberg, 2004, pp. 852-863. (Pubitemid 39747279)
11. R. S. Sexton and R. E. Dorsey, "Reliable classification using neural networks: a genetic algorithm and backpropagation comparison," Decision Support Systems, vol. 30, pp. 11-22, 2000. (Pubitemid 32033659)
12. L. Prechelt, "Proben1: A set of neural network benchmark problems and benchmarking rules," Univ. Karlsruhe, Karlsruhe, Germany, Tech. Rep., 1994.
13. H. Demuth and M. Beale, "Neural network toolbox," MathWorks Version, vol. 4, 2001.
14. R. Neruda, "Hybrid evolutionary algorithm for multilayer perceptron networks with competitive performance," in Evolutionary Computation, 2007. CEC 2007. IEEE Congress on, 2007, pp. 1620-1627.
15. S. Chapman, MATLAB programming for engineers: Thomson Engineering, 2007.
16. P. Werbos, "Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences," Phd Thesis, Harvard University, 1974.
17. M. Riedmiller and H. Braun, "RPROP-A fast adaptive learning algorithm," in Proc. 1992 Int. Symp. Computer Information Sciences, Antalya, Turkey, 1992, pp. 279-285.
18. M. Riedmiller and H. Braun, "Rprop-description and implementation details," University of Karlsruhe, Tech. Rep., 1994.
19. M. Hagen and M. Menhaj, "Training feedforward networks with the Levenberg-Marquardt algorithm," IEEE Trans on Neural Networks, vol. 5, pp. 989-993, 1994.
20. J. More, "The Levenberg-Marquardt algorithm: implementation and theory," Numerical analysis, pp. 105-116, 1978.
21. R. Prudencio and T. Ludermir, "Neural Network Hybrid Learning: Genetic Algorithms & Levenberg-Marquardt," Springer-Verlag New York Inc, 2003, p. 464.