A Neural Network pruning approach based on Compressive Sampling

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2009, Pages 3428-3435

  Yang, Jie ^a   Bouzerdoum, Abdesselam ^a   Phung, Son Lam ^a  

^a UNIVERSITY OF WOLLONGONG   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

COMPRESSIVE SAMPLING; COMPUTATIONAL COSTS; HIDDEN NEURONS; SALIENCY ANALYSIS;

COMPUTATIONAL COMPLEXITY;

NEURAL NETWORKS;

EID: 70449448556     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2009.5179045     Document Type: Conference Paper

References (21)

1. R. Reed, "Pruning algorithms-a survey, " IEEE Transactions on Neural Networks, vol. 4, pp. 740-747, May. 1993.
2. Y. Le Cun, J. S. Denker, and S. A. Solla, "Optimal brain damage, " Adv. Neural Inf. Process. Syst, vol. 2, pp. 598-605, 1990.
3. B. Hassibi and D. G. Stork, "second-order derivatives for network pruning: optimal brain surgeon, " Advances in Neural Information Processing Systems, vol. 5, pp. 164-171, 1993.
4. L. Prechelt, Probenl-A set of neural networks benchmark problems and benchmarking rules. Univ. Karlsruher, Karlsruher, Germany, Tech. Rep, 21/94, 1994.
5. M. Hagiwara, "Removal of hidden units and weights for backpropagation networks, " Proc. IEEE Int. Joint Conf. Neural Netw., pp. 351-354, 1993.
6. M. Mozer and P. Smolensky, "Skeletonization: a technique for trimming the fat from network via relevance assessment, " Advances in Neural Information Processing Systems, vol. 1, pp. 107-115, 1991.
7. J. Sietsma and R. Dow, "Creating artificial neural networks that generalize, " Neural Networks, vol. 4, no. 1, pp. 67-79, 1991.
8. Candes. E. J., Romberg. J, Tao. T., "Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information, " IEEE Trans. Inform. Theory, vol. 52, pp. 489-509, 2006.
9. Haupt, J.; Nowak, R., "Signal Reconstruction From Noisy Random Projections, " IEEE Trans. Inform. Theory, vol. 52, pp. 4036-4048, 2006.
10. Rauhut, H.; Schnass, K.; Vandergheynst, P.; "Compressed Sensing and Redundant Dictionaries, " IEEE Trans. Inform. Theory, vol. 54, pp. 2210-2219, May 2008.
11. Tropp, J. A. and Anna C. Gilbert, "Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit, " IEEE Trans. Inform. Theory, vol. 53, pp. 4655-4666, 2007.
12. Cotter, S. F, Rao, B. D, Kjersti Engan, Kreutz-Delgado, K, "Sparse solutions to linear inverse problems with multiple measurement vectors, " IEEE Transactions on Signal Processing, vol. 53, pp. 2477-2488, July. 2005.
13. J. Chen and X. Huo, "Theoretical Results on Sparse Representations of Multiple-Measurement Vectors, " IEEE Transactions on Signal Processing, vol. 54, No. 12, pp. 4634-4643, December 2006.
14. Lauret, P, Fock, E, Mara, T. A, "A node pruning algorithm based on a Fourier amplitude sensitivity test method, " IEEE Transactions on Neural Networks, vol. 17, pp. 273-293, March 2006.
15. S Amaril, "Information geometry on hierarchical of probability distributions, " IEEE Trans on Inf Theory, vol. 47, No. 5, pp. 1701-1711, 2001.
16. Y H Liu, S W Luo, A J Li, "Information geometry on pruning of neural network, " Intel Conf on Machine Learning and Cybernetics, Shanghai. 2004.
17. Remi Gribonval and Pierre Vandergheynst, "On the Exponential Convergence of Matching Pursuits in Quasi-Incoherent Dictionaries, " IEEE Transactions on Inf Theory, vol. 52, pp. 255-261, 2006.
18. J. Moody and P. J. Antsaklis, "The dependence identification neural network construction algorithm, " IEEE Trans on NEURAL NETWORK, vol. 7, pp. 3-15, Jan. 1996.
19. D. White and P. Ligomenides, "GANNet: A genetic algorithm for optimizing topology and weights in neural network design, " in International Workshop on Artificial Neural Networks, in New Trends in Neural Computation, Berlin, Germany:Springer-Verlag, pp. 332-327, 1993
20. S. Mallat and Z. Zhang, "Matching pursuits with time frequency dictionaries, " IEEE Transactions on Signal Processing, vol. 41, pp. 3397-3415, 1993.
21. Rao, B. D.; Engan, K.; Cotter, S. F.; Palmer, J.; Kreutz-Delgado, K.;, "Subset selection in noise based on diversity measure minimization, " IEEE Transactions on Signal Processing, vol. 51, pp. 760-770, 2003.