Effective neural network pruning using cross-validation

Proceedings of the International Joint Conference on Neural Networks

Volumn 2, Issue , 2005, Pages 972-977

  Huynh, Thuan Q ^a   Setiono, Rudy ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

DECISION THEORY; FUNCTIONS; PROBLEM SOLVING; TOPOLOGY; TREES (MATHEMATICS);

CROSS-VALIDATION; DECISION TREE; ERROR FUNCTION;

NEURAL NETWORKS;

EID: 33745937122     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2005.1555984     Document Type: Conference Paper

References (14)

1. S. Fahlman and C. Lebiere, "The cascade-correlation learning architecture," Advances in Neural Information Processing Systems 2, pp. 524-532, 1990.
2. M. Mezard and J. Nadal, "Learning in feedforward layered networks: The tiling algorithm," Journal of Physics A, vol. 12, no. 12, pp. 2191-2203, 1989.
3. J. Y. R. Parekh and V. Honavar, "Self-organizing network for optimum supervised learning," IEEE Trans. on Neural Networks, vol. 11, no. 2, pp. 436-451, 2000.
4. Y. LeCun, S. S. J.S. Denker, and L. Jackel, "Optimal brain damage," Advances in Neural Information Processing II, pp. 598-605, 1990.
5. A. Krogh and J. Hertz, "A simple weight decay can improve generalization," Advances in Neural Information Processing Systems 4, 1992.
6. A. M. S. Yasui and J. Zurada, "Convergence suppression and divergence facilitation: New approach to prune hidden layer and weights of feedforward neural networks," IEEE Intl. Symp. on Circuits and Systems, 1995.
7. R. Setiono, "A penalty function approach for pruning feedforward neural networks," Neural Computation, vol. 9, 1997.
8. K. Lang and M. Witbrock, "Learning to tell two spirals apart," Proceedings of the 1988 Connectionist summer school, 1988.
9. J. E. Dennis and R. B. Schnabel, "Numerical methods for unconstrainted optimization and nonlinear equations," Prentical Halls, Engelwood Cliffs, NJ, 1983.
10. L. Prechelt, "A quantitative study of experimental evaluation of neural network leraning algorithms," Neural Networks, vol. 9, pp. 457-462, 1996.
11. E. K. C. Blake and C. Merz, "Uci repository of machine learning databases," Irvine, CA: Uni of California, Department of Information and Computer Science, 1998.
12. S. I. G. H. E. Frank, Y. Wang and I. Witten, "Using model trees for classification," Machine Learning, vol. 32, no. 1, pp. 63-76, 1997.
13. R. Quinlan, "C4.5: Programs for machine learning," Morgan Kaufman, San Mateo, CA, 1993.
14. R. Setiono, "Feedforward neural network construction using cross-validation," Neural Computation, vol. 13, no. 12, pp. 2865-2877, 2001.