A Dual-Phase Technique for Pruning Constructive Networks

Proceedings of the International Joint Conference on Neural Networks

Volumn 1, Issue , 2003, Pages 559-564

  Thivierge, J P ^a   Rivest, F ^b   Shultz, T R ^a  

^a MCGILL UNIVERSITY   (Canada)

^b UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTATIONAL METHODS; COMPUTER SIMULATION; CORRELATION METHODS; ERROR ANALYSIS; OPTIMIZATION; PROBLEM SOLVING; TOPOLOGY; VECTORS;

OPTIMAL BRAIN DAMAGE (OBD);

NEURAL NETWORKS;

EID: 0141573281     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. LeCun, Y., Denker, J., & Solla, S. (1990). Optimal Brain Damage. In D. Touretzky (ed.), Advances in Neural Information Processing Systems. 2, 598-605. San Mateo, CA: Morgan Kaufmann.
2. Hassibi, B., Stork, D.G. (1993). Second order derivatives for network pruning: Optimal Brain Surgeon, Proceedings of Neural Information Processing Systems, 5, 164-171.
3. Mozer, MC & Smolensky, P. (1988). Skeletonization: A technique for trimming the fat from a network via relevance assessment. Advances in Neural Information Processing Systems, 1. Morgan Kaufmann. 107-115.
4. Reed, R. (1993). Pruning algorithms - a survey. IEEE Transactions on Neural Networks 4, 3-16.
5. Ghosh, J., Turner, K. (1994). Structural adaptation and generalization in supervised feed-forward networks. Neural Networks, 1, pp. 431-458.
6. Fiesler, E. (1994). Comparative bibliography of ontogenic neural networks. Proceedings of the International Conference on Artificial Neural Networks. ICANN'94. Sorrento, Italy, pp. 793-796.
7. Fahlman, S.E., Lebiere, C. (1989). The cascade-correlation learning architecture. Advances in Neural Information Processing Systems. 2, 525-532.
8. Waugh, S.G. (1995) Extending and benchmarking cascade-correlation. Ph.D. Thesis. University of Tasmania.
9. Lahnajarvi, J.T., Lehtokangas, M.I., Saarinen, J.P.P. (2002). Evaluation of constructive neural networks with cascaded architecture. Neurocomputing, 48, 573-607.
10. Rivest, F., & Shultz, T.R. (2002). Application of knowledge-based cascade-correlation to vowel recognition. IEEE International Joint Conference on Neural Networks 2002. pp. 53-58.
11. Shultz, T. R., & Rivest, F. (2001). Knowledge-based cascade correlation: Using knowledge to speed learning. Connection Science, 13, 43-72.
12. Hertz, Krogh, & Palmer (1991). Introduction to the theory of neural computation. Addison - Wesley Publ. Co, USA.
13. Hassibi, B., Stork, D.G., & Wolff, G. (1994) Optimal Brain Surgeon: Extensions and performance comparisons. Proceedings of Neural Information Processing Systems, VI, pp. 263-270.
14. Tresp, V., Neuneier, R., & Zimmermann, H.G. (1997). Early Brain Damage. Advances in Neural Information Processing Systems, 9.
15. Prechelt, L. (1994). PROBEN1 - A set of benchmarks and benchmarking rules for neural network training algorithms. Technical report 21/94, Fakultät für Informatik, Universität Karlsruhe.