Simultaneous node pruning of input and hidden layers using genetic algorithms

Proceedings of the 7th International Conference on Machine Learning and Cybernetics, ICMLC

Volumn 6, Issue , 2008, Pages 3428-3433

  Heo, Gi Su ^a   Oh, Il Seok ^a  

^a Chonbuk National University   (South Korea)

Author keywords

Cross validation; Genetic algorithm; Node pruning; Optimization of neural networks

Indexed keywords

CONTROL THEORY; CYBERNETICS; DIESEL ENGINES; EDUCATION; GENETIC ALGORITHMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; METROPOLITAN AREA NETWORKS; OPTIMIZATION; ROBOT LEARNING; VEGETATION;

BACK-PROPAGATION ALGORITHMS; CONSTRUCTION METHODS; CROSS-VALIDATION; HIDDEN LAYERS; NETWORK SIZES; NEURAL NETWORK STRUCTURES; NODE PRUNING; PEAK PERFORMANCES; TWO LAYERS;

NEURAL NETWORKS;

EID: 57849084004     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICMLC.2008.4620997     Document Type: Conference Paper

References (20)

1. L. Fausett, Fundamentals of Neural Networks, Prentice Hall, 1994.
2. X. Yao, "Evolving Artificial Neural Networks," Proc. of the IEEE, Vol. 87, No. 9, pp. 1423-1447, 1999.
3. Y. Cun, J. S. Denker, and S. A. Solla, "Optimal Brain Damage," Advances in Neural Information Processing Systems 2, pp. 598 - 605, 1990.
4. B. Hassibi and D. G. Stork, "Second Order Derivatives for Network Pruning: Optimal Brain Surgeon," Advances in Neural Information Processing Systems 5, pp. 164-171, 1992.
5. B. E. Segee and M. J. Carter, "Fault Tolerance of Pruning Multilayer Networks," in Proc. Int. Joint Conf. Neural Networks, Vol. II (Seattle), pp. 447-452. 1991.
6. E. D. Karnin, "A Simple Procedure for Pruning Back-propagation trained Neural Networks," IEEE Trans. Neural Networks, Vol. 1, No. 2, pp. 239-242, 1990.
7. J. Branke, "Evolutionary Algorithms for Neural Network Design and Training," Proc. of the First Nordic Workshop on Genetic Algorithms and their Applications, 1995.
8. G. Miller, P. Todd, and S. Hedge, "Designing Neural Networks using Genetic Algorithms," Proc. 3rd Int. Joint Conf. on Genetic Algorithms, pp. 379-384, 1989.
9. I.-S. Oh, J.-S. Lee, and B.-R. Moon, "Hybrid Genetic Algorithms for Feature Selection," IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 26, No. 11, pp. 1424-1437, 2004.
10. G. Castellano and A. M. Fanelli, "An Iterative Pruning Algorithm for Feedforward Neural Networks," IEEE Trans. on Neural Networks, Vol. 8, No. 3, pp. 519-531, 1997.
11. W. Wang, W. Lu, A. Leung, S. M. Lo, Z. Xu, and X. Wang, "Optimal Feed-forward Neural Networks Based on the Combination of Constructing and Pruning by Genetic Algorithms," Proc. of the 2002 Int. Joint Conf. on Neural Networks, Vol. 1, pp. 636-641, 2002.
12. Z. Guo and R. E. Uhring, "Using Genetic Algorithms to Select Inputs for Neural Networks," Int. Workshop on Combinations of Genetic Algorithms and Neural Networks, pp. 223-234, 1992.
13. B. -R. Moon, Genetic Algorithms, Dooyangsa, 2003.
14. http://mleam.ics.uci.edu/MLRepository.html
15. Neural Network FAQ, 2004 [online] Available: ftp://ftp.sas.com/pub/ neural/FAQ.html, W. S. Sarles, periodic posting to the Usenet newsgroup comp.ai.neural-net, URL.
16. P. P. Palmes, T. Hayasaka, and S. Usui, "Mutation-Based Genetic Neural Network," IEEE Trans. on Neural Networks, Vol. 16, No. 3, pp. 587-600, 2005.
17. T. Q. Huynh and R. Setiono, "Effective Neural Network Pruning Using Cross-validation," Proc. Int. Joint Conf. on Neural Networks, pp. 972-977, 2005.
18. R. Quinlan, "C4.5: Programs for Machine Learning," Morgan Kanufman, San Mateo, CA, 1993.
19. E. Frank, Y. Wang, S. Inglis, G. Holmes, and I. H. Witten, "Using Model Trees for Classification," Machine Learning, Vol. 32, No. 1, pp. 63-76, 1997.
20. R. Setiono, "Feedforward Neural Network Construction Using Cross-validation," Neural Computation, Vol. 13, No. 12. pp. 2865-2877, 2001.