A structure optimization algorithm of neural networks for large-scale data sets

IEEE International Conference on Fuzzy Systems

Volumn , Issue , 2014, Pages 956-961

  Yang, Jie ^a   Ma, Jun ^a   Berryman, Matthew ^a   Perez, Pascal ^a  

^a UNIVERSITY OF WOLLONGONG   (Australia)

Author keywords

Large Scale Data Set; Neural Network Pruning; Neural Network Structure Optimization; Sparse Representation

Indexed keywords

FUZZY SYSTEMS; STRUCTURAL OPTIMIZATION;

COMPUTATION SYSTEMS; LARGE SCALE DATA SETS; NETWORK PRUNING; NEURAL NETWORK STRUCTURE OPTIMIZATION; ORIGINAL STRUCTURES; SPARSE REPRESENTATION; STRUCTURE OPTIMIZATION; TRAVEL MODE CHOICES;

NEURAL NETWORKS;

EID: 84912533215     PISSN: 10987584     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/FUZZ-IEEE.2014.6891662     Document Type: Conference Paper

References (21)

1. K. Methaprayoon, W.-J. Lee, S. Rasmiddatta, J. Liao, and R. Ross, " Multistage artificial neural network short-term load forecasting engine with front-end weather forecast," Industry Applications, IEEE Transactions on, vol. 43, no.6, pp. 1410-1416, Nov.-Dec.2007.
2. A. Yang, J. Bouzerdoum and S. Phung, " Dimensionality reduction using compressed sensing and its application to a large-scale visual recognition task," International Joint Conference on Neural Networks (IJCNN 2010), pp. 1-8, 2010.
3. J. Lim, " Finding features for real-time premature ventricular contraction detection using a fuzzy neural network system," Neural Networks, IEEE Transactions on, vol. 20, no.3, pp. 522-527, March 2009.
4. I. Daubechies, "Ten lectures on wavelets.philadelphia, pa: Siam, " 1992.
5. L. Preche lt, " Proben1-a set of neural networks benchmark problems and benchmarking rules.univ. karlsruher,karlsruher,germany,tech. rep, 21/94," 1994.
6. Y. LeCun,J. Denker,S. Solla Optimal brain damage Ad v. Neural Inf. Process.Syst 2 598-605 1990.
7. B. Hassibi and D. G. Stork, "second-order derivatives for network pruning: optimal brain surgeon, " Advances in Neural Information Processing S ystems, vol. 5, pp. 164-171, 1993.
8. M. Hagiwara, "Removal of hidden units and weights for back propagation networks, " in Neural Networks, 1993. IJCNN '93-Nagoya.Proceedings of 1993 International Joint Conference on, vol. 1, Oct. 1993, pp. 351-354 vol. 1.
9. R. Reed, "Pruning algorithms-a survey, " Neural Networks, IEEE Transactions on, vol. 4, no.5, pp. 740-747, Sep 1993.
10. M. Mozer and P. Smolensky, "Skeletonization: a technique for trimming the fat from network via relevance assessment, " Advances in Neura Information Processing Systems, vol. 1, pp. 107-115, 1991.
11. J. Sietsma and R. Dow, "Creating artificial neural networks that generalize, " Neural Networks, vol. 4, no.1, pp. 67-79, 1991.
12. P. Lauret, E. Fock, and T. Mara, " A node pruning algorithm based on a fourier amplitude sensitivity test method," Neural Networks, IEEE Transactions on, vol. 17, no.2, pp. 273-293, March 2006.
13. R. Parekh, J. Yang, and V. Honavar, " Constructive neural-network learning algorithms for pattern classification," Neural Networks, IEEE Transactions on, vol. 11, no.2, pp. 436-451, Mar 2000.
14. J. O. Moody and P. J. Antsaklis, " The dependence identification neural network construction algorithm," IEEE Transactions on Neural Networks, vol. 7, no.1, pp. 3-15, 1996.
15. D. White and P. Ligomenides, " Gannet: A genetic algorithm for optimizing topology and weights in neural network design," in International Workshop on Artificial Neural Networks, in New Trends in Neural Computation, 1993, pp. 332-327.
16. J. Gorodkin, L. K. Hansen, a.Krogh, C. Svarer, and O. Winther, " A quantitative study of pruning by optimal brain damage. " International journal of neural systems, vol. 4, no.2, pp. 159-69, June 1993. [Online]. Available: http://www.ncbi. nlm. nih. gov/pubmed/8044376
17. S. Cotter, B. Rao, K. Engan, and K. Kreutz-Delgado, " Sparse solutions to linear inverse problems with multiple measurement vectors," Signal Processing, IEEE Transactions on, vol. 53, no.7, pp. 2477-2488, July 2005.
18. J. Yang, A. Bouzerdoum, and S. L. Phung, "A neural network pruning approach based on compr essive sampling," in Neural Networks, 2009. IJCNN 2009. International Joint Conference on, June 2009, pp. 3428-3435.
19. J. Chen and X. Huo, "Theoretical results on sparse representations of multiple-measur ement vectors," Signal Processing, IEEE Transactions on, vol. 54, no.12, pp. 4634-4643, Dec.2006.
20. M. Riedmiller and H. Braun, "A direct adaptive method for faster backpropagation le arning: the rprop algorithm," in Neural Networks, 1993. IJCNN 1993. (IEEE World Congress on Computational Intelligence). IEEE International Joint Conference on, June 1993, pp. 586-591.
21. [Online]. Available: http://www.bts.nsw. gov. au/Statistics/Household-Travel-Survey/default. aspxFolderID=215#top