Feature selection using localized generalization error for supervised classification problems using RBFNN

Pattern Recognition

Volumn 41, Issue 12, 2008, Pages 3706-3719

  Ng, Wing W Y ^a,b   Yeung, Daniel S ^a,b   Firth, Michael ^c   Tsang, Eric C C ^b   Wang, Xi Zhao ^d  

^a SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

^b HONG KONG POLYTECHNIC UNIVERSITY   (Hong Kong)

^c LINGNAN UNIVERSITY   (Hong Kong)

^d HEBEI UNIVERSITY   (China)

Author keywords

Feature selection; Generalization error; Neural network; RBFNN

Indexed keywords

CHLORINE COMPOUNDS; CLASSIFIERS; FEATURE EXTRACTION; FEEDFORWARD NEURAL NETWORKS; LEARNING SYSTEMS; NEURAL NETWORKS; RADIAL BASIS FUNCTION NETWORKS;

DATA-SETS; FEATURE REDUCTION; FEATURE SELECTION; FEATURE SELECTION METHODS; FEATURE SUBSET SELECTION; FEATURE SUBSETS; GENERALIZATION CAPABILITIES; GENERALIZATION ERROR; GENERALIZATION ERRORS; HIGH-DIMENSIONAL; HYBRID FILTERING; NEURAL NETWORK; PATTERN CLASSIFICATION PROBLEMS; RADIAL BASIS FUNCTION NEURAL NETWORK; RBFNN; SAMPLE SIZES; SUPERVISED CLASSIFICATION; TESTING ACCURACY; TRAINING ACCURACY; TRAINING SAMPLES;

CLASSIFICATION (OF INFORMATION);

EID: 49449083313     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2008.05.004     Document Type: Article

References (32)

1. Yeung D.S., Ng W.W.Y., Wang D., Tsang E.C.C., and Wang X.-Z. Localized generalization error and its application to architecture selection for radial basis function neural network. IEEE Trans. Neural Networks (2007) 1294-1305
2. Ng W.W.Y., Dorado A., Yeung D.S., Pedrycz W., and Izquierdo E. Image classification with the use of radial basis function neural networks and the minimization of localized generalization error. Pattern Recognition (2007) 19-32
3. Haykin S. Neural Networks (1998), Prentice-Hall, Englewood Cliffs, NJ
4. Moody J., and Darken C.J. Fast learning in networks of locally-tuned processing units. Neural Comput. (1989) 281-294
5. Blum L., and Langley P. Selection of relevant features and examples in machine learning. Artif. Intell. (1997) 245-271
6. Liu H., and Motoda H. Feature Selection for Knowledge Discovery and Data Mining (1998), Kluwer Academic Publisher, Dordrecht
7. Guyon I., and Elisseeff A. An introduction to variable and feature selection. J. Mach. Learn. Res. (2003) 1157-1182
8. Quinlan J.R. Decision trees and decision-making. IEEE Trans. SMC (1990) 339-346
9. Jolliffe I.T. Principal Component Analysis. second ed. (2002), Springer, Berlin
10. Malhi A., and Gao R.X. PCA-based feature selection scheme for machine defect classification. IEEE Trans. Instrum. Meas. (2004) 1517-1525
11. Battiti R. Using mutual information for selecting features in supervised neural net learning. IEEE Trans. Neural Networks (1994) 537-550
12. Peng H., Long F., and Ding C. Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. PAMI (2005) 1226-1238
13. Kwak N., and Choi C.-H. Input feature selection by mutual information based on parzen window. IEEE Trans. PAMI (2002) 1667-1671
14. Mitra P., Murthy C.A., and Pal S.K. Unsupervised feature selection using feature similarity. IEEE Trans. PAMI (2002) 301-312
15. Mao K.Z. Orthogonal forward selection and backward elimination algorithms for feature subset selection. IEEE Trans. SMC (Part B) (2004) 629-634
16. Fu X., and Wang L. Data dimensionality reduction with application to simplifying RBF network structure and improving classification performance. IEEE Trans. SMC (Part B) (2003) 399-409
17. Lashkia G.V., and Anthony L. Relevant, irredundant feature selection and noisy example elimination. IEEE Trans. SMC (Part B) (2004) 888-897
18. Kohavi R., and John G.H. Wrappers for feature subset selection. Artif. Intell. (1997) 273-324
19. Bi J., Bennett K.P., Embrechts M., Breneman C.M., and Song M. Dimensionality reduction via sparse support vector machines. J. Mach. Learn. Res. (2003) 1229-1243
20. Hastie T., Tibshirani R., and Friedman J. The Element of Statistical Learning (2001), Springer, Berlin
21. UCI Machine Learning Repository, 〈http://archive.ics.uci.edu/ml/〉.
22. Bhattacharjee A., Richards W.G., Staunton J., Li C., Monti S., Vasa P., Ladd C., Beheshti J., Bueno R., Gillette M., Loda M., Weber G., Mark E.J., Lander E.S., Wong W., Johnson B.E., Golub T.R., Sugarbaker D.J., and Meyerson M. Classification of human lung carcinomas by mRNA expression profiling reveals distinct adenocarcinoma subclasses. Proc. Natl. Acad. Sci. USA (2001) 13790-13795
23. Duffie D., and Singleton K. Credit Risk: Pricing, Measurement and Management (2003), Princeton University Press, Princeton
24. Poon W., and Firth M. Are unsolicited ratings lower? International evidence from bank ratings. J. Bus. Finance Accounting (2005) 1741-1771
25. Altman E. Bankruptcy, Credit Risk, and High Yield Junk Bonds (2001), Blackwell, Oxford
26. Beaver W.H., McNichols M.F., and Rhie J.W. Have financial statements become less informative? Evidence from the ability of financial ratios to predict bankruptcy. Rev. Accounting Stud. (2005) 93-122
27. Dechow P., and Schrand C. Earnings Quality, Monograph (2004), Research Foundation of the CFA Institute
28. Benston G.J., and Hartgraves A.L. Enron: what happened and what we can learn from it. J. Accounting Public Policy (2002) 105-127
29. V. Agarwal, R. Taffler, Comparing the performance of market-based and accounting-based bankruptcy prediction models, J. Banking Finance, 2008, to appear.
30. Weston J., Mukherjee S., Chapelle O., Pontil M., Poggio T., and Vapnik V. Feature selection for SVMs. Adv. Neural Inf. Process. Syst. (2001) 668-674
31. Scholkopf B., Sung K.K., Burges C.J.C., Girosi F., Niyogi P., Poggio T., and Vapnik V. Comparing support vector machines with Gaussian kernels to radial basis function classifiers. IEEE Trans. Signal Processing (1997) 2758-2765
32. Ng W.W.Y., Yeung D.S., Wang D., Tsang E.C.C., and Wang X.-Z. Localized generalization error of Gaussian based classifiers and visualization of decision boundaries. Soft Comput. (2007) 375-381