A node pruning algorithm for feedforward neural network based on neural complexity

Proceedings of 2010 International Conference on Intelligent Control and Information Processing, ICICIP 2010

Volumn , Issue PART 1, 2010, Pages 406-410

  Zhang, Zhaozhao ^a,b   Qiao, Junfei ^a  

^a BEIJING UNIVERSITY OF TECHNOLOGY   (China)

^b LIAONING TECHNICAL UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

CONNECTION MATRICES; HIDDEN NODES; INFORMATION PROCESSING; NETWORK WEIGHTS; NEURAL COMPLEXITY; NODE PRUNING; NONLINEAR FUNCTIONS; PRE-PROCESSING; SELECT AND DELETE; SIMULATION RESULT;

COMPUTER SIMULATION; COVARIANCE MATRIX; DATA PROCESSING; FEEDFORWARD NEURAL NETWORKS; FUNCTIONS; INTELLIGENT CONTROL;

NETWORK ARCHITECTURE;

EID: 78649288454     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICICIP.2010.5564272     Document Type: Conference Paper

References (10)

1. GUO Wei, ZHANG Zhaozhao, "Application of entropy to pruning algorithm of BP neural network," Information and Control, vol 38, no. 5, pp. 633-637, Oct 2009.
2. Reed, R, "Pruning algorithm-A survey," IEEE Trans on Neural Networks, vol 4, no. 5, pp. 740-747, Sep 1993.
3. Ma L, Khorasani K, "New training strategies for constructive neural networks with application to regression problems," IEEE Trans on Neural Networks, vol 17, no. 4, pp. 589-609, Feb 2004.
4. Erdogmus D, Principe J C, "Generalized information potential criterion for adaptive system training," IEEE Trans on Neural Networks, vol 13, no. 5, pp. 1035-1044, Sep 2002.
5. Cun Y.L., Denker J S, Solla S A, "Optimal brain damage," Advances in Neural Information Processing Systems, No. 2, pp. 598-605, Feb 1990.
6. Hassibi B, Gstork D, "Second order derivatives for network pruning: Optimal brain surgeon," Advances in Neural Information Processing Systems, No. 5, pp. 164-171, Jul 1993.
7. Philippe Lauret, Eric Fock, Thierry Alex Mara, "A node pruning algorithm based on a fourier amplitude sensitivity test method," IEEE Trans on Neural Network, vol 17, no. 2, pp. 273-293, May 2006.
8. Qiao Jun-fei, Zhang Ying, Han Hong-gui, "Fast unit pruning algorithm for feed-forward neural network design," Applied Mathematics and Computation, vol 205, no. 2, pp. 662-667, Oct 2008.
9. Kwok T, Yeng D, "Objective functions for training new hidden units in constructive neural networks," IEEE Trans on Neural Networks, vol 8, no. 5, pp. 1131-1148, May 1997.
10. Xu Jinhua, Daniel W C Ho, "A new training and pruning algorithm based on node dependence and Jacbian rank deficiency," Neurocomputing, vol 70, No.1-3, Jun 2006.