Using semi-supervised classifiers for credit scoring

Journal of the Operational Research Society

Volumn 64, Issue 4, 2013, Pages 513-529

  Kennedy, K ^a   Namee, B Mac ^a   Delany, S J ^a  

^a DUBLIN INSTITUTE OF TECHNOLOGY   (Ireland)

Author keywords

banking; benchmarking; credit scoring; low default portfolio; one class classification; supervised classification

Indexed keywords

BENCHMARKING; OPERATIONS RESEARCH; RESEARCH;

BANKING; CREDIT SCORING; LOW-DEFAULT PORTFOLIO; ONE-CLASS CLASSIFICATION; SUPERVISED CLASSIFICATION;

CLASSIFICATION (OF INFORMATION);

EID: 84874596874     PISSN: 01605682     EISSN: 14769360     Source Type: Journal    
DOI: 10.1057/jors.2011.30     Document Type: Article

References (80)

1. Baesens B, Gestel TV, Viaene S, Stepanova M, Suykens J and Vanthienen J (2003). Benchmarking state-of-the-art classification algorithms for credit scoring. J Opl Res Soc 54(6): 627-635.
2. Baesens B, Mues C, Martens D and Vanthienen J (2009). 50 years of data mining and OR: Upcoming trends and challenges. J Opl Res Soc 60(Supp1): S16-S23.
3. Basel Committee on Banking Supervision (BCBS) (2001, Revised Edition 2005). The Internal Ratings-Based Approach-Consultative Document. Bank for International Settlements: Basel.
4. Basel Committee on Banking Supervision (BCBS) (2005, Comp v 2006). International Convergence of Capital Measurement and Capital Standards-A Revised Framework. Basel II. Bank for International Settlements: Basel.
5. Bellotti T and Crook J (2008). Credit scoring with macroeconomic variables using survival analysis. J Opl Res Soc 60(12): 1699-1707.
6. Bishop CM (1994). Novelty detection and neural network validation. IEE Proc-Vision, Image and Signal processing 141(4): 217-222.
7. Bishop CM (1995). Neural Networks for Pattern Recognition. Oxford University Press: UK.
8. British Bankers' Association (BBA) (2004). Low default portfolios, http://www.isda.org/c-and-a/pdf/ISDA-LIBA-BBALowDefaul-PortfolioPaper- January2005.pdf, accessed 25 June 2010.
9. Chandola V, Banerjee A and Kumar V (2009). Anomaly detection: A survey. ACM Comput Surveys (CSUR) 41(3): Article 15.
10. Chang C-C and Lin C-J (2001). LIBSVM: A library for support vector machines, http://www.csie.ntu.edu.tw/Bcjlin/libsvm.
11. Chawla NV, Japkowicz N and Kotcz A (2004). Special issue on learning from imbalanced data sets. ACMSIGKDD Explorations Newslett 6(1): 1-6.
12. Chawla N, Bowyer K, Hall L and Kegelmeyer W (2002). SMOTE: synthetic minority over-sampling technique. J Artif Intell Res 16: 321-357.
13. Chawla S, Hand D and Dhar V (2010). Outlier detection special issue. Data Mining Knowl Discov 20(2): 189-190.
14. (CML 2010). CML reports decline in arrears and repossessions http://www.cml.org.uk/cml/media/press/2680, accessed 12 August 2010.
15. Cover T and Hart P (1967). Nearest neighbor pattern classification. IEEE Trans Inform Theory 13(1): 21-27.
16. Desai V, Conway D, Crook J and Overstreet G (1997). Creditscoring models in the credit-union environment using neural networks and genetic algorithms. IMA J Mngt Math 8(4): 323.
17. Dionne G, Arts M and Guilleen M (1996). Count data models for a credit scoring system. J Empiric Fin 3(3): 303-325.
18. Duda RO and Hart PE (1973). Pattern Classification and Scene Analysis. Wiley: New York.
19. Duin R, Juszczak P, Paclik P, Pekalska E, de Ridder D, Tax D and Verzakov S (2008). PRTOOLS (V4.1.4). A Matlab toolbox for pattern recognition. Delft University of Technology, ICTG, NL, http://www.prtools.org.
20. Eisenbeis R (1977). Pitfalls in the application of discriminant analysis in business, finance, and economics. J Finance 32(3): 875-900.
21. Forrest A (2005). Likelihood approaches to low default portfolios. In: Credit Scoring & Credit Control IX. Credit Research Center, University of Edinburgh.
22. Friedman M (1937). The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J AmStat Assoc 32(200): 675-701.
23. Hand DJ (2006). Classifier technology and the illusion of progress. Stat Sci 21(1): 1-14.
24. Hand DJ (2009). Measuring classifier performance: A coherent alternative to the area under the ROC curve. Mach Learning 77(1): 103-123.
25. Hand DJ and Henley W (1993). Can reject inference ever work IMA J Mngt Math 5(1): 45.
26. Hand DJ and Yu K (2001). Idiot's Bayes: Not so stupid after all Int Statist Rev/Revue Intle de Statistique 69(3): 385-398.
27. Hand DJ and Zhou F (2010). Evaluating models for classifying customers in retail banking collections. J Opl Res Soc 61(10): 1540-1547.
28. Hastie T, Tibshirani R, Friedman J and Franklin J (2005). The elements of statistical learning: Data mining, inference and prediction. Math Intell 27(2): 83-85.
29. Hempstalk K (2009). Continuous typist verification using machine learning. PhD thesis, The University of Waikato, New Zealand.
30. Henley W and Hand D (1996). A k-nearest-neighbour classifier for assessing consumer credit risk. The Statistician 45(1): 77-95.
31. Hinton G (1989). Connectionist learning procedures. Artif Intell 40(1-3): 185-234.
32. Hoff K J, Tech M, Lingner T, Daniel R, Morgenstern B and Meinicke P (2008). Gene prediction in metagenomic fragments: A large scale machine learning approach. BMC Bioinformatics 9: 217.
33. Hoffmann F, Baesens B, Mues C, Van Gestel T and Vanthienen J (2007). Inferring descriptive and approximate fuzzy rules for credit scoring using evolutionary algorithms. Eur J Opl Res 177(1): 540-555.
34. Holm S (1979). A simple sequentially rejective multiple test procedure. Scand J Stat 6(2): 65-70.
35. Hosmer D and Lemeshow S (2000). Applied Logistic Regression. Wiley-Interscience: New York.
36. Ingolfsson S and Elvarsson B (2010). Cyclical adjustment of pointin-time PD. J Opl Res Soc 61(3): 374-380.
37. Japkowicz N (1999). Concept-learning in the absence of counterexamples: An autoassociation-based approach to classification. PhD thesis, Rutgers, The State University of New Jersey.
38. Juszczak P, Adams N, Hand D, Whitrow C and Weston D (2008). Off-the-peg and bespoke classifiers for fraud detection. Computat Statist Data Anal 52(9): 4521-4532.
39. Keogh E (2007). Why the lack of reproducibility is crippling research in data mining and what you can do about it. In: Proceedings of the 8th International Workshop on Multimedia DM (association with ACM SIGKDD 2007). ACM: New York, p. 2.
40. Khoshgoftaar T, Seiffert C, van Hulse J, Napolitano A and Folleco A (2007). Learning with limited minority class data. In: Wani MA, et al. (eds). Sixth International Conference on Machine Learning and Applications 2007. IEEE Computer Society, Cincinnati, OH, pp 348-353.
41. Kolcz A, Chowdhury A and Alspector J (2003). Data duplication: An imbalance problem. In: Fawcett T and Mishra N (eds). Machine Learning, Proceedings of Twentieth International Conference (ICML 2003) Workshop on Learning from Imbalanced Datasets (II), AAAI Press: Washington, DC.
42. Kraaijveld M and Duin R (1991). A criterion for the smoothing parameter for Parzen-estimators of probability density functions. Technical Report, Delft University of Technology.
43. Krivko M (2010). A hybrid model for plastic card fraud detection systems. Expert Syst Appl 37(8): 6070-6076.
44. Lee H and Cho S (2007). Focusing on non-respondents: Response modeling with novelty detectors. Expert Syst Appl 33(2): 522-530.
45. Lessmann S, Baesens B, Mues C and Pietsch S (2008). Benchmarking classification models for software defect prediction: A proposed framework and novel findings. IEEE Trans Software Eng 34(4): 485-496.
46. Malik M and Thomas L (2010). Modelling credit risk of portfolio of consumer loans. J Opl Res Soc 61(3): 411-420.
47. Martens D, Van Gestel T, De Backer M, Haesen J, Vanthienen R and Baesens B (2009). Credit rating prediction using ant colony optimization. J Opl Res Soc 61(4): 561-573.
48. Medema L, Koning R and Lensink R (2009). A practical approach to validating a PD model. Journal of Banking & Finance 33(4): 701-708.
49. Meehl P (1955). Clinical versus statistical prediction. J Consult Psychol 19: 155.
50. Michie D, Spiegelhalter D, Taylor C and Campbell J (1994). Machine Learning, Neural and Statistical Classification. Ellis Horwood: UK.
51. Moya M, Koch M and Hostetler L (1993). One-class classifier networks for target recognition applications. Technical Report SAND-93-0084C, Sandia National Labs, Albuquerque, NM, USA.
52. Nanni L and Lumini A (2009). An experimental comparison of ensemble of classifiers for bankruptcy prediction and credit scoring. Expert Syst Appl 36(2): 3028-3033.
53. Overstreet G, Bradley E and Kemp R (1992). The flat-maximum effect and generic linear scoring models: A test. IMA J Mngt Math 4(1): 97.
54. Parzen E (1962). On estimation of a probability density function and mode. Ann Math Stat 33(3): 1065-1076.
55. Pietruszkiewicz W (2008). Dynamical systems and nonlinear Kalman filtering applied in classification. In: Proc of 2008 7th IEEE International Conference Cybernetic International Systems. IEEE: New York, pp 263-268.
56. Piramuthu S (1999). Financial credit-risk evaluation with neural and neurofuzzy systems. Eur J Opl Res 112(2): 310-321.
57. Pluto K and Tasche D (2006). Estimating probabilities of default for low-default portfolios. The Basel II Risk Parameters: 79-103.
58. Provost F (2000). Machine learning from imbalanced data sets 101. In: Kautz HA and Porter BW (eds). Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence. AAAI Press/The MIT Press: Austin, TX.
59. Quinlan J (1993). C4.5: Programs for Machine Learning. Morgan Kaufmann: Los Altos, CA.
60. Ritter G and Gallegos M (1997). Outliers in statistical pattern recognition and an application to automatic chromosome classification. Pattern Recog Lett 18(6): 525-539.
61. Sabzevari H, Soleymani M and Noorbakhsh E (2007). A comparison between statistical and data mining methods for credit scoring in case of limited available data. Credit Research Center (CRC), University of Edinburgh.
62. Sarmiento T, Hong S andMay G (2005). Fault detection in reactive ion etching systems using one-class support vector machines. In: Carbone T, Werbaneth P, Fathulla A and Piliszczuk T (eds). Proceedings of IEEE/SEMI Advanced Semiconductor Manufacturing Conference and Workshop. IEEE: Munich, Germany, pp. 139-142.
63. Schebesch K and Stecking R (2005). Support vector machines for classifying and describing credit applicants: Detecting typical and critical regions. J Opl Res Soc 56(9): 1082-1088.
64. Stefanescu C, Tunaru R and Turnbull S (2009). The credit rating process and estimation of transition probabilities: A Bayesian approach. J Empiric Fin 16(2): 216-234.
65. Tang T and Chi L (2005). Predicting multilateral trade credit risks: Comparisons of logit and fuzzy logic models using ROC curve analysis. Expert Syst Appl 28(3): 547-556.
66. Tax D (2001). One-class classification. PhD thesis, Delft University of Technology.
67. Tax D (2009). DDtools, the Data Description Toolbox for Matlab. V1.7.3.
68. Tax D and Duin R (1999). Support vector domain description. Pattern Recog Lett 20(11-13): 1191-1199.
69. Tax D and Duin R (2000). Data description in subspaces. In: Werner B (ed). 15th International Conference on Pattern Recognition ICPR'00, Vol. 2. IEEE Computer Society: Barcelona, Spain.
70. Thomas L (2009). Consumer finance: Challenges for operational research. J Opl Res Soc 61(1): 41-52.
71. Thomas LC, Edelman DB and Crook JN (2002). Credit Scoring and its Applications. Society for Industrial Math: Philadelphia, PA.
72. Tsai C and Wu J (2008). Using neural network ensembles for bankruptcy prediction and credit scoring. Expert Syst Appl 34(4): 2639-2649.
73. van Gestel T and Baesens B (2009). Credit Risk Management: Basic Concepts. Oxford University Press: USA.
74. Vapnik V (1995). The Nature of Statistical Learning Theory. Springer Verlag: New York.
75. Vinciotti V and Hand DJ (2003). Scorecard construction with unbalanced class sizes. J Iranian Statist Soc 2(2): 189-205.
76. Webb A (2002). Statistical Pattern Recognition. Wiley: New York.
77. West D (2000). Neural network credit scoring models. Comput Opns Res 27(11-12): 1131-1152.
78. Westgaard S and van der Wijst N (2001). Default probabilities in a corporate bank portfolio: A logistic model approach. Eur J Opl Res 135(2): 338-349.
79. Witten IH and Frank E (2000). Weka machine learning algorithms in java. In: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations. Morgan Kaufmann Publishers: Los Altos, CA 265-320.
80. Xiao W, Zhao Q and Fei Q (2006). A comparative study of data mining methods in consumer loans credit scoring management. J Syst Sci Syst Eng 15(4): 419-435.