Combination of feature selection approaches with SVM in credit scoring

Expert Systems with Applications

Volumn 37, Issue 7, 2010, Pages 4902-4909

  Chen, Fei Long ^a   Li, Feng Chia ^a,b  

^a NATIONAL TSING HUA UNIVERSITY   (Taiwan)

^b Jen Teh Junior College   (Taiwan)

Author keywords

Decision tree; F score; Linear discriminate analysis; Rough sets theory; Support vector machine

Indexed keywords

CREDIT SCORING; CREDIT SCORING MODEL; DATA SETS; DISCRIMINATE ANALYSIS; F-SCORE; FEATURE SELECTION; FEATURE SPACE; FEATURES SELECTION; NON-PARAMETRIC; OPTIMAL SUBSETS; PRE-PROCESSING STEP; REDUNDANT FEATURES; ROUGH SET; ROUGH SETS THEORY; SVM CLASSIFIERS; SVM MODEL; SVM(SUPPORT VECTOR MACHINE); UNIVERSITY OF CALIFORNIA; WILCOXON SIGNED RANK TEST;

AGRICULTURAL PRODUCTS; CLASSIFIERS; DECISION TREES; FEATURE EXTRACTION; FUZZY CLUSTERING; ROUGH SET THEORY;

SUPPORT VECTOR MACHINES;

EID: 77950189091     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2009.12.025     Document Type: Article

References (39)

1. Amaldi E., and Kann V. On the approximability of minimizing nonzero variables or unsatisfied relations in linear systems. Theoretical Computer Science 209 1-2 (1998) 237-260
2. Bellotti T., and Crook J. Support vector machines for credit scoring and discovery of significant features. Expert Systems with Applications 36 2p2 (2008) 3302-3308
3. Breiman L., Friedman J.H., Olshen R.A., and Stone C.J. Classification and regression trees (1984), Wadsworth & Brooks, Monterey
4. Caballero, Y., Alvarez, D., Bel, R., & Garcia, M. M. (2007). Feature selection algorithms using rough set theory. In L. D. Mourelle, N. Nedjah, J. Kacprzyk & A. Abraham (Eds.), Proceedings of the 7th international conference on intelligent systems design and applications (pp. 407-411).
5. Camastra F. A SVM-based cursive character recognizer. Pattern Recognition 40 12 (2007) 3721-3727
6. Chang, C. -C., & Lin, C. -J. (2008). LIBSVM: A library for support vector machines.
7. Chen, Y. -W., & Lin, C. -J. (2005). Combining SVMs with various feature selection strategies.
8. Cho B.H., Yu H., Kim K.W., Kim T.H., Kim I.Y., and Kim S.I. Application of irregular and unbalanced data to predict diabetic nephropathy using visualization and feature selection methods. Artificial Intelligence in Medicine 42 1 (2008) 37-53
9. Chou C.H., Lin C.C., Liu Y.H., and Chang F. A prototype classification method and its use in a hybrid solution for multiclass pattern recognition. Pattern Recognition 39 4 (2006) 624-634
10. Dash M., and Liu H. Feature selection for classification. Intelligent Data Analysis 1 (1997) 131-156
11. DeLeo, J. M., & Rosenfeld, S. J. (2001). Essential roles for receiver operating, characteristic (ROC) methodology in classifier neural network applications. In Proceedings of the international joint conference on neural networks (IJCNN2001), Washington, DC, USA.
12. Fisher R.A. The use of multiple measurements in taxonomic problems. Annals of Eugenics 7 (1936) 179-188
13. Garbe C. Primary cutaneous melanoma-identification of prognostic groups and estimation of individual prognosis for 5093 patients. Cancer 75 (1995) 2484-2491
14. Garson G.D. Interpreting neural-network connection weights. AI Expert Systems in the Micro-electronic Age 6 4 (1991) 47-51
15. Guyon I., and Elisseeff A. An introduction to variable and feature selection. Journal of Machine Learning Research 3 (2003) 1157-1182
16. Hsu, C. W., Chang, C. C., & Lin, C. J. (2008). A practical guide to support vector classification.
17. Huang C.L., Chen M.C., and Wang C.J. Credit scoring with a data mining approach based on support vector machines. Expert Systems with Applications 33 4 (2007) 847-856
18. Huang C.L., Liao H.C., and Chen M.C. Prediction model building and feature selection with support vector machines in breast cancer diagnosis. Expert Systems with Applications 34 1 (2008) 578-587
19. Huang J.-J., Tzeng G.-H., and Ong C.-S. Two-stage genetic programming (2SGP) for the credit scoring model. Applied Mathematics and Computation 174 2 (2006) 1039-1053
20. John, G. H., Kohavi, R., & Pfleger, K. (1994). Irrelevant feature and the subset selection problem. In Proceedings of the eleventh international conference on machine learning.
21. Kudo M., and Sklansky J. Comparison of algorithms that select features for pattern classifiers. Pattern Recognition 33 1 (2000) 25-41
22. Lee T.-S., and Chen I.F. A two-stage hybrid credit scoring model using artificial neural networks and multivariate adaptive regression splines. Expert Systems with Applications 28 4 (2005) 743-752
23. Lee T.-S., Chiu C.-C., Lu C.-J., and Chen I.F. Credit scoring using the hybrid neural discriminant technique. Expert Systems with Applications 23 3 (2002) 245-254
24. Li T.-S. Feature selection for classification by using a Ga-based neural network approach. Journal of the Chinese Institute of Industrial Engineers 23 (2006) 55-64
25. Liu, H. A. M. H. (1998). Feature selection for knowledge discovery and data mining. Boston: Kluwer Academic Publishers.
26. Martens D., Baesens B., Van Gestel T., and Vanthienen J. Comprehensible credit scoring models using rule extraction from support vector machines. European Journal of Operational Research 183 3 (2007) 1466-1476
27. Ong C.-S., Huang J.-J., and Tzeng G.-H. Building credit scoring models using genetic programming. Expert Systems with Applications 29 1 (2005) 41-47
28. Pawlak (1984). Rough classification (Vol. 20, pp. 469-483). Academic Press Ltd.
29. Quinlan J.R. Discovering rules from large collections of examples: A case study. Expert Systems in the Micro-electroni (1979) 168-201
30. Saporta, G. (1990). Probability. Analysis of data and statistics (Technip).
31. Schebesch K.B., and Stecking R. Support vector machines for classifying and describing credit applicants: Detecting typical and critical regions. Journal of the Operational Research Society 56 9 (2005) 1082-1088
32. Skowron A., and Rauszer C. The discernibility matrices and functions in information systems. In: Slowinski R. (Ed). Intelligent decision support - Handbook of applications and advances of the rough sets theory (1992), Academic Publishers, Kluwer 311-362
33. Su C.T., and Yang C.H. Feature selection for the SVM: An application to hypertension diagnosis. Expert Systems with Applications 34 1 (2008) 754-763
34. Sun Q., Wang L.L., Lim S.H., and DeJong G. Robustness through prior knowledge: Using explanation-based learning to distinguish handwritten Chinese characters. International Journal on Document Analysis and Recognition 10 3-4 (2007) 175-186
35. Thomas L.C. A survey of credit and behavioural scoring: Forecasting financial risk of lending to consumers. International Journal of Forecasting 16 2 (2000) 149-172
36. In: Vapnik V.N. (Ed). The nature of statistical learning theory (1995), Springer-Verlag, New York
37. Wang X., Yang J., Teng X., Xia W., and Jensen R. Feature selection based on rough sets and particle swarm optimization. Pattern Recognition Letters 28 4 (2007) 459-471
38. West D. Neural network credit scoring models. Computers and Operations Research 27 11-12 (2000) 1131-1152
39. Zhao Y., Yao Y., and Luo F. Data analysis based on discernibility and indiscernibility. Information Sciences 177 22 (2007) 4959-4976