Combining B&B-based hybrid feature selection and the imbalance-oriented multiple-classifier ensemble for imbalanced credit risk assessment

Technological and Economic Development of Economy

Volumn 21, Issue 3, 2015, Pages 351-378

  Sun, Jie ^a,b   Lee, Young Chan ^b   Li, Hui ^a   Huang, Qing Hua ^a  

^a ZHEJIANG NORMAL UNIVERSITY   (China)

^b Dongguk University   (South Korea)

Author keywords

Hybrid feature selection; Imbalance oriented multiple classifier ensemble; Imbalanced credit risk assessment; Imbalanced data set

Indexed keywords

EID: 84944035778     PISSN: 20294913     EISSN: 20294921     Source Type: Journal    
DOI: 10.3846/20294913.2014.884024     Document Type: Article

References (71)

1. Ahn, H.; Moon, H.; Fazzari, M.; Lima, N.; Chenb, J. J.; Kodell, R. L. 2007. Classification by ensembles from random partitions of high-dimensional data, Computational Statistics & Data Analysis 51(6): 166-177.
2. Angelini, E.; Tollo, G.; Roli, A. 2008. A neural network approach for credit risk evaluation, The Quarterly Review of Economics and Finance 48(4): 733-755. http://dx.doi.org/10.1016/j.qref.2007.04.001
3. Baesens, B.; Setiono, R.; Mues, C.; Vanthienen, J. 2003. Using neural network rule extraction and decision tables for credit risk evaluation, Management Science 49(3): 312-329. http://dx.doi.org/10.1287/mnsc.49.3.312.12739
4. Bellotti, T.; Crook, J. 2008. Support vector machines for credit scoring and discovery of significant features, Expert Systems with Applications 36(2): 3302-3308. http://dx.doi.org/10.1016/j.eswa.2008.01.005
5. Bellotti, T.; Crook, J. 2009. Credit scoring with macroeconomic variables using survival analysis, Journal of the Operational Research Society 60(12): 1699-1707. http://dx.doi.org/10.1057/jors.2008.130
6. Bellotti, T.; Matousek, R.; Stewart, C. 2011. A note comparing support vector machines and ordered choice models' predictions of international banks' ratings, Decision Support Systems 51(3): 682-687. http://dx.doi.org/10.1016/j.dss.2011.03.008
7. Besanko, D.; Thakor, A. 1987. Collateral and rationing: sorting equilibria in monopolistic and competitive credit markets, International Economic Review 28(3): 671-689. http://dx.doi.org/10.2307/2526573
8. Bester, H.; Sreening, V. 1985. Rationing in credit markets with imperfect information, American Economics Review 75(4): 850-855.
9. Boguslauskas, V.; Mileris, R.; Adlyte, R. 2011. New internal rating approach for credit risk assessment, Technological and Economic Development of Economy 17(2): 369-381. http://dx.doi.org/10.3846/20294913.2011.583721
10. Brown, I.; Mues, C. 2012. An experimental comparison of classification algorithms for imbalanced credit scoring data sets, Expert Systems with Applications 39(3): 3446-3453.
11. Chawla, N. V.; Bowyer, K. W.; Hall, L. O.; Kegelmeyer, W. P. 2002. SMOTE: synthetic minority oversampling technique, Journal of Artificial Intelligence Research 16: 321-357.
12. Chawla, N. V.; Japkowicz, N.; Kolcz, A. 2004. Editorial: special issue on learning from imbalanced data sets, SIGKDD Explorations 6(1): 1-6. http://dx.doi.org/10.1145/1007730.1007733
13. Chen, X. 2003. An improved branch and bound algorithm for feature selection, Pattern Recognition Letters 24(12): 1925-1933. http://dx.doi.org/10.1016/S0167-8655(03)00020-5
14. Chen, C.; Liaw, A.; Breiman, L. 2004. Using random forests to learn unbalanced data. California: University of California. 12 p.
15. Chen, W.; Ma, C.; Ma, L. 2007. Mining the customer credit using hybrid support vector machine technique, Expert Systems with Applications 36(4): 7611-7616. http://dx.doi.org/10.1016/j.eswa.2008.09.054
16. Chijoriga, M. M. 2011. Application of multiple discriminant analysis (MDA) as a credit scoring and risk assessment model, International Journal of Emerging Markets 6(2): 132-147.
17. Cimpoeru, S. 2011. Neural networks and their application in credit risk assessment. Evidence from the Romanian market, Technological and Economic Development of Economy 17(3): 519-534. http://dx.doi.org/10.3846/20294913.2011.606339
18. Constantinopoulos, C.; Likas, A. 2008. Semi-supervised and active learning with the probabilistic RBF classifier, Artificial Neural Networks 71(13): 2489-2498. http://dx.doi.org/10.1016/j.neucom.2007.11.039
19. Crook, J.; Edelman, D.; Thomas, L. 2007. Recent developments in consumer credit risk assessment, European Journal of Operational Research 183(3): 1447-1465. http://dx.doi.org/10.1016/j.ejor.2006.09.100
20. Dash, M.; Liu, H. 1997. Feature selection for classification, Intelligent Data Analysis 1(1-4): 131-156. http://dx.doi.org/10.1016/S1088-467X(97)00008-5
21. Dong, G.; Lai, K.; Yen, J. 2010. Credit scorecard based on logistic regression with random coefficients, Procedia Computer Science 1(1): 2463-2468. http://dx.doi.org/10.1016/j.procs.2010.04.278
22. Eisenbeis, R. 1997. Pitfalls in the application of discriminant analysis in business, finance, and economics, Journal of Finance 32(3): 875-900. http://dx.doi.org/10.1111/j.1540-6261.1977.tb01995.x
23. Ender, P. 2005. Multivariate analysis: more exploratory factor analysis [online], [cited 07 May 2012]. Available from Internet: http://www.philender.com/courses/multivariate/notes2/morefa.html
24. Fan, R.-E.; Chen, P.-H.; Lin, C.-J. 2005. Working set selection using second order information for training SVM, Journal of Machine Learning Research 6: 1889-1918.
25. Finlay, S. 2008. Towards profitability: a utility approach to the credit scoring problem, Journal of the Operational Research Society 59(7): 921-931. http://dx.doi.org/10.1057/palgrave.jors.2602394
26. Fisher, R. A. 1936. The use of multiple measurements in taxonomic problems, Annals of Eugenics 7(2): 179-188. http://dx.doi.org/10.1111/j.1469-1809.1936.tb02137.x
27. Florez-Lopez, R. 2010. Effects of missing data in credit risk scoring. A comparative analysis of methods to achieve robustness in the absence of sufficient data, Journal of the Operational Research Society 61(3): 486-501. http://dx.doi.org/10.1057/jors.2009.66
28. Garcia, V.; Sanchez, J. S.; Mollineda, R. A. 2012. On the effectiveness of preprocessing methods when dealing with different levels of class imbalance, Knowledge-Based Systems 25(1):13-21.
29. Guyon, I.; Elisseeff, A. 2003. An introduction to variable and feature selection, Journal of Machine Learning Research 3: 1157-1182.
30. Heijden, F.; Duin, R.; Ridder, D.; Tax, D. 2004. Classification, parameter estimation and state estimation: an engineering approach using MATLAB. The Atrium, Southern Gate, Chichester, West Sussex PO19 8SQ, England: Wiley. 423 p. http://dx.doi.org/10.1002/0470090154
31. Hillier, B.; Lbrahimo, M. 1993. Asymmetric information and models of credit rationing, Bulletin of Economic Research 45(4): 271-304. http://dx.doi.org/10.1111/j.1467-8586.1993.tb00571.x
32. Hofmann, H.; Stat, L. 1994. UCI machine learning repository [online], [cited 07 May 2012]. Available from Internet: http://archive.ics.uci.edu/ml
33. Huang, S. 2009. Integrating nonlinear graph based dimensionality reduction schemes with SVMs for credit rating forecasting, Expert Systems with Applications 36(4): 7515-7518. http://dx.doi.org/10.1016/j.eswa.2008.09.047
34. Huang, Z.; Chen, H.; Hsu, C.-J.; Chen, W.-H.; Wu, S. 2004. Credit rating analysis with support vector machine and neural networks: a market comparative study, Decision Support Systems 37(4): 543-558. http://dx.doi.org/10.1016/S0167-9236(03)00086-1
35. Hui, X.; Sun, J. 2006. An application of support vector machine to companies' financial distress prediction, Lecture Notes in Computer Science 3885: 274-282. http://dx.doi.org/10.1007/11681960_27
36. Kennedy, K.; Namee, B. M.; Delany, S. J. 2009. Learning without default: a study of one-class classification and the low-default portfolio problem, in Proc. of the 20th Irish Conference on Artificial Intelligence and Cognitive Science, 19-21 August 2009, Dublin, 174-187.
37. Khashman, A. 2010. Neural networks for credit risk evaluation: investigation of different neural models and learning schemes, Expert Systems with Applications 37: 6233-6239.
38. Kubat, M.; Matwin, S. 1997. Addressing the curse of imbalanced training sets: one-sided selection, in Proceedings of the 14th International Conference on Machine Learning, 8-12 July 1997. San Francisco: Morgan Kaufmann, 179-186.
39. Laha, A. 2007. Building contextual classifiers by integrating fuzzy rule based classification technique and k-nn method for credit scoring, Advanced Engineering Informatics 21: 281-291.
40. Lahsasna, A.; Ainon, R.; Wah, T. 2010. Credit scoring models using soft computing methods: a survey, International Arab Journal of Information Technology 7(2): 115-123.
41. Laitinen, E. 1999. Predicting a corporate credit analysis risk estimate by logistic and linear models, International Review of Financial Analysis 8(2): 97-121. http://dx.doi.org/10.1016/S1057-5219(99)00012-5
42. Lawler, E.; Wood, D. 1966. Branch-and-bound method: a survey, Operations Research 14(4): 699-719. http://dx.doi.org/10.1287/opre.14.4.699
43. Liu, J.; Li, J.; Xu, W. 2011. A weighted L(q) adaptive least squares support vector machine classifiers-robust and sparse approximation, Expert Systems with Applications 38(3): 2253-2259.
44. Liu, Y.; Wu, C.; Wang, M.; Qiao, M. 2005. The model of credit risk assessment in commercial banks on support vector machine, Forecasting 1(24): 52-55.
45. Maloof, M. 2003. Learning when data sets are imbalanced and when costs are unequal and unknown, in ICML-2003 Workshop on Learning from Imbalanced Data Sets II, 21-24 August 2003, Washington DC: AAAI Press, 1-8.
46. Martens, D.; Baesens, B.; Gestel, T.; Vanthienen, J. 2007. Comprehensible credit scoring models using rule extraction from support vector machines, European Journal of Operational Research 183(3): 1466-1476. http://dx.doi.org/10.1016/j.ejor.2006.04.051
47. Martens, D.; Gestel, T.; Backer, M.; Raf, H.; Jan, V.; Christophe, M.; Bart, B. 2010. Credit rating prediction using ant colony optimization, Journal of the Operational Research Society 61: 561-573. http://dx.doi.org/10.1057/jors.2008.164
48. McElduff, F.; Cortina-Borja, M.; Chan, S.-K.; Wade, A. 2010. When t-tests or Wilcoxon-Mann-Whitney tests won't do, Advances in Physiology Education 34(3): 128-133. http://dx.doi.org/10.1152/advan.00017.2010
49. Paleologo, G.; Elisseeff, A.; Antonini, G. 2010. Subagging for credit scoring models, European Journal of Operational Research 201(2): 490-499. http://dx.doi.org/10.1016/j.ejor.2009.03.008
50. Spearman, C. 1904. General intelligence, objectively determined and measured, The American Journal of Psychology 15(2): 201-292. http://dx.doi.org/10.2307/1412107
51. Stiglitz, J.; Wesiss, A. 1981. Credit rationing in markets with imperfect information, American Economics Review 71(3): 393-410.
52. Sun, J.; Li, H. 2011. Dynamic financial distress prediction using instance selection for the disposal of concept drift, Expert Systems with Applications 38(3): 2566-2576. http://dx.doi.org/10.1016/j.eswa.2010.08.046
53. Tsai, C. 2009. Feature selection in bankruptcy prediction, Knowledge-Based Systems 22(2): 120-127. http://dx.doi.org/10.1016/j.knosys.2008.08.002
54. Tsai, C.; Wu, J. 2008. Using neural network ensembles for bankruptcy prediction and credit scoring, Expert Systems with Applications 34(4): 2639-2649. http://dx.doi.org/10.1016/j.eswa.2007.05.019
55. Tseng, H.; Lin, G.; Tsai, L. 2011. An enforced support vector machine model for construction contractor default prediction, Automation in Construction 20(8): 1242-1249. http://dx.doi.org/10.1016/j.autcon.2011.05.007
56. Vapnik, V. 1996. The nature of statistical learning theory. New York: Springer-Verlag. 188 p.
57. Wang, G.; Hao, J.; Ma, J.; Jiang, H. 2011. A comparative assessment of ensemble learning for credit scoring, Expert Systems with Applications 38(1): 223-230. http://dx.doi.org/10.1016/j.eswa.2010.06.048
58. West, D.; Dellana, S.; Qian, J. 2005. Neural network ensemble strategies for financial decision applications, Computers & Operations Research 32(10): 2543-2559. http://dx.doi.org/10.1016/j.cor.2004.03.017
59. Williamson, S. 1986. Costly monitoring, financial intermediation, and equilibrium credit rationing, Journal of Monetary Economics 18(2): 159-179. http://dx.doi.org/10.1016/0304-3932(86)90074-7
60. Wu, C.; Guo, Y.; Xia, H. 2009. The model of credit risk assessment in commercial banks on fuzzy integral support vector machines ensemble, Operations Research and Management Science 2(18): 115-119.
61. Wu, C.; Guo, Y.; Zhang, X.; Xia, H. 2010. Study of personal credit risk assessment based on support vector machine ensemble, International Journal of Innovative Computing Information and Control 6(5): 2353-2360.
62. Xie, C.; Luo, C.; Yu, X. 2011. Financial distress prediction based on SVM and MDA methods: the case of Chinese listed companies, Quality & Quantity 45(3): 671-686. http://dx.doi.org/10.1007/s11135-010-9376-y
63. Xu, X.; Chen, Y.; Zheng, H. 2011. The comparison of enterprise bankruptcy forecasting method, Journal of Applied Statistics 38(2): 301-308. http://dx.doi.org/10.1080/02664760903406470
64. Yan, R.; Liu, Y.; Jin, R.; Alex, H. 2003. On predicting rare classes with SVM ensembles in scene classification, in IEEE International Conference on Acoustics, Speech and Signal Processing, 6-10 April 2003, Hong Kong, 21-24.
65. Yei, Z.; Wen, Y.; Lu, B. 2009. A survey of imbalanced pattern classification problems, CAAI Transactions on Intelligent Systems 4(2): 148-153.
66. Yu, L.; Wang, S.; Lai, K. 2008. Credit risk assessment with a multistage neural network ensemble learning approach, Expert Systems with Applications 34(2): 1434-1444. http://dx.doi.org/10.1016/j.eswa.2007.01.009
67. Yu, L.; Wang, S.; Lai, K. 2009. An intelligent-agent-based fuzzy group decision making model for financial multi-criteria decision support: the case of credit scoring, European Journal of Operational Research 195(3): 942-959. http://dx.doi.org/10.1016/j.ejor.2007.11.025
68. Yu, L.; Yao, X.; Wang, S.; Lai, K. K. 2011. Credit risk evaluation using a weighted least squares SVM classifier with design of experiment for parameter selection, Expert Systems with Applications 38(12): 15392-15399. http://dx.doi.org/10.1016/j.eswa.2011.06.023
69. Yu, L.; Yue, W.; Wang, S.; Lai, K. 2010. Support vector machine based multi-agent ensemble learning for credit risk evaluation, Expert Systems with Applications 37: 1351-1360.
70. Zhou, L.; Lai, K.; Yu, L. 2010a. Least squares support vector machines ensemble models for credit scoring, Expert Systems with Applications 37(1): 127-133. http://dx.doi.org/10.1016/j.eswa.2009.05.024
71. Zhou, X.; Jiang, W.; Shi, Y. 2010b. Credit risk evaluation by using nearest subspace method, Procedia Computer Science 1(1): 2449-2455. http://dx.doi.org/10.1016/j.procs.2010.04.276