Ensemble classification based on supervised clustering for credit scoring

Applied Soft Computing Journal

Volumn 43, Issue , 2016, Pages 73-86

  Xiao, Hongshan ^a   Xiao, Zhi ^a   Wang, Yu ^a  

^a CHONGQING UNIVERSITY   (China)

Author keywords

Credit scoring; Diversity of base classifiers; Ensemble classification; Random sampling; Supervised clustering; Weighted voting

Indexed keywords

RISK ASSESSMENT;

BASE CLASSIFIERS; CREDIT SCORING; ENSEMBLE CLASSIFICATION; RANDOM SAMPLING; SUPERVISED CLUSTERING; WEIGHTED VOTING;

BENCHMARKING;

EID: 84959467883     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2016.02.022     Document Type: Article

References (60)

1. D.J. Hand, and W.E. Henley Statistical classification methods in consumer credit scoring: A review J. R. Stat. Soc. Ser. A (Stat. Soc.) 160 1997 523 541
2. G. Paleologo, A. Elisseeff, and G. Antonini Subagging for credit scoring models Eur. J. Oper. Res. 201 2010 490 499
3. Y. Yang Adaptive credit scoring with kernel learning methods Eur. J. Oper. Res. 183 2007 1521 1536
4. G. Wang, J. Ma, L. Huang, and K. Xu Two credit scoring models based on dual strategy ensemble trees Knowl. Based Syst. 26 2012 61 68
5. R.A. Eisenbeis Problems in applying discriminant in credit scoring models J. Bank. Financ. 2 1978 205 219
6. W.E. Henley Statistical Aspects of Credit Scoring (Ph.D. Thesis) 1995 Open University
7. W.E. Henley, and D.J. Hand A k-NN classifier for assessing consumer credit risk Statistician 65 1996 77 95
8. Y. Shi, Y. Peng, W. Xu, and X. Tang Data mining via multiple criteria linear programming: Applications in credit card portfolio management Int. J. Inf. Technol. Decis. Mak. 1 2002 131 151
9. Y. Peng, G. Kou, Y. Shi, and Z.X. Chen A multi-criteria convex quadratic programming model for credit data analysis Decis. Support Syst. 44 4 2008 1016 1030
10. T. Lee, C. Chiu, C. Lu, and I. Chen A two stage hybrid credit scoring model using artificial neural networks and multivariate adaptive regression splines Expert Syst. Appl. 28 2005 743 752
11. N.S. Halvaiee, and M.K. Akbari A novel model for credit card fraud detection using artificial immune systems Appl. Soft Comput. 24 2011 40 49
12. S.Y. Chang, and T.Y. Yeh An artificial immune classifier for credit scoring analysis Appl. Soft Comput. 12 2012 611 618
13. C. Ong, J. Huang, and G. Tzeng Building credit scoring models using genetic programming Expert Syst. Appl. 29 2005 41 47
14. Z. Huang, H.C. Chen, C.J. Hsu, W.H. Chen, and S.S. Wu Credit rating analysis with support vector machines and neural networks: A market comparative study Decis. Support Syst. 37 4 2004 543 558
15. S.T. Luo, B.W. Cheng, and C.H. Hsieh Prediction model building with clustering-launched classification and support vector machines in credit scoring Expert Syst. Appl. 36 2009 7562 7566
16. S. Bhattacharyya, S. Jha, K. Tharakunnel, and J.C. Westland Data mining for credit card fraud: A comparative study Decis. Support Syst. 50 2011 602 613
17. J.M. Tomczak, and M. Zieba Classification restricted Boltzmann machine for comprehensible credit scoring model Expert Syst. Appl. 42 2015 1789 1796
18. T. Harris Credit scoring using the clustered support vector machine Expert Syst. Appl. 42 2015 741 750
19. A. Tsymbal, M. Pechenizkiy, and P. Cunningham Diversity in search strategies for ensemble feature selection Inf. Fusion 6 2005 83 98
20. A.H.R. Ko, R. Sabourin, and A.S. Britto Jr. From dynamic classifier selection to dynamic ensemble selection Pattern Recognit. 41 2008 1718 1731
21. M.K. Lim, and S.Y. Sohn Cluster-based dynamic scoring model Expert Syst. Appl. 32 2007 427 431
22. L. Kuncheva A theoretical study on six classifier fusion strategies IEEE Trans. Pattern Anal. Mach. Intell. 24 2002 281 286
23. L. Kuncheva, and C. Whitaker Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy Mach. Learn. 51 2003 181 207
24. G. Brown, J. Wyatt, R. Harris, and X. Yao Diversity creation methods: A survey and categorization Inf. Fusion 6 2005 5 20
25. R. Pasti, and L.N. de Castro Bio-inspired and gradient-based algorithms to train MLPs: The influence of diversity Inf. Sci. 179 2009 1441 1453
26. M.P. Sesmero, J.M. Alonso-Weber, G. Gutierrez, A. Ledezma, and A. Sanchis An ensemble approach of dual base learners for multi-class classification problem Inf. Fusion 24 2015 122 136
27. L. Brieman Bagging predictors Mach. Learn. 24 1996 123 140
28. T.K. Ho The random subspace method for constructing decision forests IEEE Trans. Pattern Anal. Mach. Intell. 20 1998 832 844
29. R.E. Schapire, Y. Freund, P. Bartlett, and W.S. Lee Boosting the margin: A new explanation for the effectiveness of voting methods Ann. Stat. 26 1998 1651 1686
30. M. Wozniak, M. Grana, and E. Corchado A survey of multiple classifier systems as hybrid systems Inf. Fusion 16 2014 3 17
31. A.S. Britto Jr., R. Sabourin, and L.E.S. Oliveira Dynamic selection of classifiers-a comprehensive review Pattern Recognit. 47 2014 3665 3680
32. R. Liu, and B. Yuan Multiple classifier combination by clustering and selection Inf. Fusion 2 2001 163 168
33. D. Ruta, and B. Gabrys Classifier selection for majority voting Inf. Fusion 6 2005 63 81
34. J. Xiao, C. He, X. Jiang, and D. Liu A dynamic classifier ensemble selection approach for noise data Inf. Sci. 180 2010 3402 3421
35. T. Woloszynski, and M. Kurzynski A probabilistic model of classifier competence for dynamic ensemble selection Pattern Recognit. 44 2011 2656 2668
36. L. Li, B. Zou, Q. Hu, X. Wu, and D. Yu Dynamic classifier ensemble using classification confidence Neurocomputing 99 2013 581 591
37. Q. Dai, T. Zhang, and N. Liu A new reverse reduce-error ensemble pruning algorithm Appl. Soft Comput. 28 2015 237 249
38. I. Mendialdua, A. Arruti, E. Jauregi, E. Lazkano, and B. Sierra Classifier subset selection to construct multi-classifiers by means of estimation of distribution algorithms Neurocomputing 157 2015 46 60
39. P. Larranaga, and J. Lozano Estimation of Distribution Algorithms. A New Tool for Evolutionary Computation 2001 Kluwer Academic Press
40. S. Finlay Multiple classifier architectures and their application to credit risk assessment Eur. J. Oper. Res. 210 2011 368 378
41. J. Xiao, L. Xie, C. He, and X. Jiang Dynamic classifier ensemble model for customer classification with imbalanced class distribution Expert Syst. Appl. 39 2012 3668 3675
42. J. Kruppa, A. Schwarz, G. Arminger, and A. Ziegler Consumer credit risk: Individual probability estimates using machine learning Expert Syst. Appl. 40 2013 5125 5131
43. C.F. Tsai, Y.F. Hsu, and D.C. Yen A comparative study of classifier ensembles for bankruptcy prediction Appl. Soft Comput. 24 2014 977 984
44. M.N. Vrahatis, B. Boutsinas, P. Alevizos, and G. Pavlides The new k-windows algorithm for improving the k-mean clustering algorithm J. Complex. 18 2002 375 391
45. J.C. Bezdek Cluster validity with fuzzy sets J. Cybern. 3 1974 58 73
46. B. Rezaee A cluster validity index for fuzzy clustering Fuzzy Sets Syst. 161 2010 3014 3025
47. Y. Zhang, W. Wang, X. Zhang, and Y. Li A cluster validity index for fuzzy clustering Inf. Sci. 178 2008 1205 1218
48. K.L. Wu, and M.S. Yang A cluster validity index for fuzzy clustering Pattern Recognit. Lett. 26 9 2005 1275 1291
49. R.M. Ramze, B.P.F. Lelieveldt, and J.H.C. Reiber A new cluster validity indexes for the fuzzy c-mean Pattern Recognit. Lett. 19 1998 237 246
50. S. Vucetic, and Z. Obradovic Discovering homogeneous regions in spatial data through competition Proceedings of the 17th International Conference on Machine Learning Stanford, CA 2000 1091 1098
51. D.W. Hosmer, and L. Stanley Applied Logistic Regression 2000 Wiley New York
52. X. Xu, and Y. Wang Financial failure prediction using efficiency as a predictor Expert Syst. Appl. 36 2009 366 373
53. J. Han, and M. Kamber Data Mining: Concepts and Techniques 2nd ed. 2006 Morgan Kaufmann Publishers San Francisco, CA
54. V.N. Vapnik The Nature of Statistical Learning Theory 1995 Springer New York
55. Z. Hua, Y. Wang, X. Xu, B. Zhang, and L. Liang Predicting corporate financial distress based on integration of support vector machine and logistic regression Expert Syst. Appl. 33 2007 434 440
56. K. Coussement, and W. Buckinx A probability-mapping algorithm for calibrating the posterior probabilities: A direct marketing application Eur. J. Oper. Res. 214 2011 732 738
57. Z.H. Zhou, J. Wu, and W. Tang Ensembling neural networks: Many could be better than all Artif. Intell. 137 1-2 2002 239 263
58. T.G. Dietterich Approximate statistical tests for comparing supervised classification learning algorithms Neural Comput. 10 7 1998 1895 1923
59. E. Alpaydin Combined 5 × 2 cv F test for comparing supervised classification learning algorithms Neural Comput. 11 8 1999 1885 1892
60. E. Alpaydin Introduction to Machine Learning 2nd ed. 2010 MIT Press