Cross-validation based weights and structure determination of Chebyshev-polynomial neural networks for pattern classification

Pattern Recognition

Volumn 47, Issue 10, 2014, Pages 3414-3428

  Zhang, Yunong ^a   Yin, Yonghua ^a   Guo, Dongsheng ^a   Yu, Xiaotian ^a   Xiao, Lin ^a  

^a SUN YAT SEN UNIVERSITY   (China)

Author keywords

Chebyshev polynomial; Cross validation; Neural network; Pattern classification; Robustness

Indexed keywords

NEURAL NETWORKS; PATTERN RECOGNITION; ROBUSTNESS (CONTROL SYSTEMS); SOFTWARE ENGINEERING;

CHEBYSHEV POLYNOMIALS; CLASSIFICATION DATASETS; CROSS VALIDATION; MULTI LAYER PERCEPTRON; MULTI-OUTPUT; NUMERICAL VERIFICATION; STRONG ROBUSTNESS; STRUCTURE DETERMINATION;

POLYNOMIALS;

EID: 84902369146     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.04.026     Document Type: Article

References (47)

1. H. Nakayama, and N. Kagaku Pattern classification by linear goal programming and its extensions J. Global Optim. 12 2 1998 111 126
2. R. Duda, P. Hart, and D. Stork Pattern Classification and Scene Analysis Part I. Pattern Classification second ed. 1995 John Wiley & Sons, Inc. New York
3. G.P. Zhang Neural networks for classification a survey IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev. 30 4 2000 451 462
4. H. Zhang, J. Liu, D. Ma, and Z. Wang Data-core-based fuzzy min-max neural network for pattern classification IEEE Trans. Neural Netw. 22 12 2011 2339 2352
5. X. Jiang, and A.H.K.S. Wah Constructing and training feed-forward neural networks for pattern classification Pattern Recognit. 36 4 2003 853 867
6. G. Ou, and Y.L. Murphey Multi-class pattern classification using neural networks Pattern Recognit. 40 1 2007 4 18
7. J.D. Paola, and R.A. Schowengerdt A detailed comparison of backpropagation neural network and maximum-likelihood classifiers for urban land use classification IEEE Trans. Geosci. Remote Sens. 33 4 1995 981 996
8. D.E. Rumelhart, and J.L. McClelland Parallel Distributed Processing 1986 MIT Press Cambridge
9. W. Zhou Verification of the nonparametric characteristics of backpropagation neural networks for image classification IEEE Trans. Geosci. Remote Sens. 37 2 1999 771 779
10. D. Wilson, T. Martinez, The need for small learning rates on large problems, in: International Joint Conference on Neural Networks, 2001, pp. 115-119.
11. X. Yu, and G. Chen On the local minima free condition of backpropagation learning IEEE Trans. Neural Netw. 6 5 1995 1300 1303
12. Y. Zhang, and N. Tan Weights direct determination of feedforward neural networks without iterative BP-training L. Wang, T. Hong, Intelligent Soft Computation and Evolving Data Mining 2010 IGI Globa Hershey 197 225
13. Y. Zhang, X. Yu, L. Xiao, W. Li, and Z. Fan Weights and structure determination of artificial neuronets W.J. Zhang, Self-Organization: Theories and Methods 2013 Nova Science Publishers New York 109 153 (Chapter 5)
14. Y. Zhang, Y. Yin, X. Yu, D. Guo, L. Xiao, Pruning-included weights and structure determination of 2-input neuronet using Chebyshev polynomials of Class 1, in: Proceedings of the 10th World Congress on Intelligent Control and Automation, 2012, pp. 700-705.
15. G.K. Smyth Polynomial approximation P. Armitage, T. Colton, Encyclopedia of Biostatistics Second Edition 2004 Wiley London 4136 4140
16. G. Caporale, and M. Cerrato Using Chebyshev polynomials to approximate partial differential equations Comput. Econ. 35 3 2010 235 244
17. T. Lee, and J. Jeng The Chebyshev-polynomials-based unified model neural networks for function approximation IEEE Trans. Syst. Man Cybern. Part B: Cybern. 28 6 1998 925 935
18. B. Park, K. Kim, S. Oh, H. Kim, Pattern classification using polynomial neural networks for two classes' problem, in: Proceedings of the Eighth Symposium on Advanced Intelligent Systems, 2007, pp. 476-480.
19. S. Satapathy, B. Biswal, P. Dash, G. Panda, Pattern classification using polynomial neural network, in: Proceedings of IEEE Conference on Cybernetics and Intelligent Systems, 2006, pp. 1-6.
20. J. Patra, and A. Kot Nonlinear dynamic system identification using Chebyshev functional link artificial neural networks IEEE Trans. Syst. Man Cybern. Part B: Cybern. 32 4 2002 505 511
21. L. D'Ambrosio Extension of Bernstein polynomials to infinite dimensional case J. Approx. Theory 140 2 2006 191 202
22. A. Sancetta, S.E. Satchell, Bernstein approximations to the copula function and portfolio optimization, in: Cambridge Working Papers in Economics 0105, Faculty of Economics, University of Cambridge, 2001.
23. F. Leung, H. Lam, S. Ling, and P. Tam Tuning of the structure and parameters of a neural network using an improved genetic algorithm IEEE Trans. Neural Netw. 14 1 2003 79 88
24. D. Svozil, V. Kvasnicka, and J. Pospichal Introduction to multi-layer feed-forward neural networks Chemom. Intell. Lab. Syst. 39 1997 43 62
25. G. Huang, Q. Zhun, and C. Siew Extreme learning machine theory and applications Neurocomputing 70 2006 489 501
26. O. Fujita Statistical estimation of the number of hidden units for feedforward neural networks Neural Netw. 11 5 1998 851 859
27. E.J. Teoh, K.C. Tan, and C. Xiang Estimating the number of hidden neurons in a feedforward network using the singular value decomposition IEEE Trans. Neural Netw. 17 6 2006 1623 1629
28. R. Zhang, Y. Lan, G. Huang, and Z. Xu Universal approximation of extreme learning machine with adaptive growth of hidden nodes IEEE Trans. Neural Netw. Learn. Syst. 23 2 2012 365 371
29. Z. Zhang, X. Ma, and Y. Yang Bounds on the number of hidden neurons in three-layer binary neural networks Neural Netw. 16 7 2003 995 1002
30. S. Geisser The predictive sample reuse method with applications J. Am. Stat. Assoc. 70 350 1975 320 328
31. S. Arlot, and A. Celisse A survey of cross-validation procedures for model selection Stat. Surv. 4 2010 40 79
32. S. Chen, A. Wolfgang, C.J. Harris, and L. Hanzo Symmetric RBF classifier for nonlinear detection in multiple-antenna-aided systems IEEE Trans. Neural Netw. 19 5 2008 737 745
33. X. Hong, and S. Chen A new RBF neural network with boundary value constraints IEEE Trans. Syst. Man Cybern. Part B: Cybern. 39 1 2009 298 303
34. C.F. Dunkl, and Y. Xu Orthogonal Polynomials of Several Variables 2001 Cambridge University Press Cambridge
35. J. Su, and S. Ruan MATLAB Practical Guide 2008 Publishing House of Electronics Industry Beijing
36. A. Frank, and A. Asuncion UCI Machine Learning Repository 2010 School of Information and Computer Science, University of California Irvine, CA 〈 http://archive.ics.uci.edu/ml 〉
37. J. Bridge, S. Holden, L. Paulson, Machine learning for first-order theorem proving: learning to select a good heuristic, J. Autom. Reason., 10.1007/s10817-014-9301-5, in press.
38. Lonnie Hamm, B.W. Brorsen, and Martin T. Hagan Comparison of stochastic global optimization methods to estimate neural network weights Neural Process. Lett. 26 3 2007 145 158
39. Martin T. Hagan, Howard B. Demuth, and Mark H. Beale Neural Network Design 2002 China Machine Press Beijing
40. D.R. Wilson, T.R. Martinez, Heterogeneous radial basis function networks, in: Proceedings of the IEEE International Conference on Neural Networks, 1996, pp. 1263-1267.
41. S.S. Haykin Neural Networks A Comprehensive Foundation 1999 Prentice Hall International Editions Series London
42. Y. Zhang, K. Li, and N. Tang An RBF neural network classifier with centers, variances and weights directly determined Comput. Technol. Autom. 28 3 2009 5 9
43. C. Chang, and C. Lin LIBSVM a library for support vector machines ACM Trans. Intell. Syst. Technol. 2 3 2011 27:1 27:27 Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm
44. V. Vapnik, S. Golowich, A.J. Smola, Support vector method for function approximation, regression estimation, and signal processing, in: Neural Information Processing Systems, MIT Press, Cambridge, 1997, pp. 281-287.
45. C. Chuang, S. Su, J. Jeng, and C. Hsiao Robust support vector regression networks for function approximation with outliers IEEE Trans. Neural Netw. 13 6 2002 1322 1330
46. P.B. Brazdil, and C. Soares A comparison of ranking methods for classification algorithm selection R.L. Mantaras, E. Plaza, Machine Learning: ECML 2000 2000 Springer Berlin, Heidelberg 63 75
47. Y. Zhang, Y. Yang, B. Cai, and D. Guo Zhang neural network and its application to Newton iteration for matrix square root estimation Neural Comput. Appl. 21 3 2012 453 460.