Instance sampling in credit scoring: An empirical study of sample size and balancing

International Journal of Forecasting

Volumn 28, Issue 1, 2012, Pages 224-238

  Crone, Sven F ^a   Finlay, Steven ^a  

^a LANCASTER UNIVERSITY   (United Kingdom)

Author keywords

Balancing; Credit scoring; Data pre processing; Over sampling; Sample size; Under sampling

Indexed keywords

EID: 84155194931     PISSN: 01692070     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijforecast.2011.07.006     Document Type: Article

References (54)

1. Anderson R. The credit scoring toolkit: theory and practice for retail credit risk management and decision automation 2007, Oxford University Press, Oxford.
2. Arminger G., Enache D., Bonne T. Analyzing credit risk data: a comparison of logistic discrimination, classification tree analysis, and feedforward networks. Computational Statistics 1997, 12(2):293-310.
3. Baesens B., Gestel T.V., Viaene S., Stepanova M., Suykens J., Vanthienen J. Benchmarking state-of-the-art classification algorithms for credit scoring. Journal of the Operational Research Society 2003, 54(5):627-635.
4. Banasik J., Crook J. Reject inference, augmentation, and sample selection. European Journal of Operational Research 2007, 183(3):1582-1594.
5. Banasik J., Crook J.N., Thomas L.C. Does scoring a sub-population make a difference?. International Review of Retail, Distribution and Consumer Research 1996, 6(2):180-195.
6. Barclay's (2008). Barlcay's annual report 2008. (accessed on 9.12.09). http://www.barclaysannualreport.com/ar2008/files/pdf/Annual_Report_2008.pdf.
7. Boyle M., Crook J.N., Hamilton R., Thomas L.C. Methods applied to slow payers. Credit scoring and credit control 1992, Clarendon Press, Oxford. L.C. Thomas, J.N. Crook, D.B. Edelman (Eds.).
8. Chawla, N. V. (2003). C4.5 and imbalanced datasets: investigating the effect of sampling method, probabilistic estimate, and decision tree structure. In Proceedings of the ICML'03 workshop on class imbalances.
9. Chawla N.V., Bowyer K.W., Hall L.O., Kegelmeyer W.P. SMOTE: synthetic minority over-sampling technique. Journal of Artificial Intelligence Research 2002, 16(1):321-357.
10. Chawla N.V., Japkowicz N., Kolcz A. Special issue on learning from imbalanced data sets. ACM SIGKDD: Explorations 2004, 6(1). guest editors.
11. Cohn D., Atlas L., Ladner R. Improving generalization with active learning. Machine Learning 1994, 15(2):201-221.
12. Crone S.F., Lessmann S., Stahlbock R. The impact of preprocessing on data mining: an evaluation of classifier sensitivity in direct marketing. European Journal of Operational Research 2006, 173(3):781-800.
13. Crook J.N., Edelman D.B., Thomas L.C. Recent developments in consumer credit risk assessment. European Journal of Operational Research 2007, 183(3):1447-1465.
14. Desai V.S., Conway D.G., Crook J., Overstreet G. Credit-scoring models in the credit union environment using neural networks and genetic algorithms. IMA Journal of Mathematics Applied in Business and Industry 1997, 8(4):323-346.
15. Drummond, C., & Holte, R. (2003). C4.5, class imbalance, and cost sensitivity: Why under-sampling beats over-sampling. In Proceedings of the ICML'03 workshop on learning from imbalanced data sets.
16. Evans D., Schmalensee R. Paying with plastic. The digital revolution in buying and borrowing 2005, The MIT Press, Cambridge, Massachusetts.
17. Finlay S.M. Predictive models of expenditure and indebtedness for assessing the affordability of new consumer credit applications. Journal of the Operational Research Society 2006, 57(6):655-669.
18. Finlay S. The management of consumer credit: theory and practice 2008, Palgrave Macmillan, Basingstoke, UK.
19. Fox J. Nonparametric simple regression 2000, Sage, Newbury Park.
20. Hand D.J. Good practice in retail credit scorecard assessment. Journal of the Operational Research Society 2005, 56(9):1109-1117.
21. Hand D.J. Measuring classifier performance: a coherent alternative to the area under the ROC curve. Machine Learning 2009, 77:103-123.
22. Hand D.J. Mining the past to determine the future: problems and possibilities. International Journal of Forecasting 2009, 25:441-451.
23. Hand D.J., Henley W.E. Can reject inference ever work?. IMA Journal of Management Mathematic 1993, 5:45-55.
24. Hand D.J., Henley W.E. Statistical classification methods in consumer credit scoring: a review. Journal of the Royal Statistical Society, Series A (Statistics in Society) 1997, 160(3):523-541.
25. Harrell F.E., Lee K.L., Mark D.B. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Statistics in Medicine 1996, 15(4):361-387.
26. Hasenjager M., Ritter H. Active learning with local models. Neural Processing Letters 1998, 7(2):107-117.
27. Henley W.E. Statistical aspects of credit scoring 1995, Open University, Milton Keynes.
28. Jentzsch N. Financial privacy: an international comparison of credit reporting systems 2007, Springer, New York.
29. Kim Y., Sohn S.Y. Technology scoring model considering rejected applicants and effect of reject inference. Journal of the Operational Research Society 2007, 58(10):1341-1347.
30. Laurikkala J. Instance-based data reduction for improved identification of difficult small classes. Intelligent Data Analysis 2002, 6(4):311-322.
31. Lewis E.M. An introduction to credit scoring 1992, Athena Press, San Rafael.
32. Liu Y., Schumann M. Data mining feature selection for credit scoring models. Journal of the Operational Research Society 2005, 56:1099-1108.
33. Lovie A.D., Lovie P. The flat maximum effect and linear scoring models for prediction. Journal of Forecasting 1986, 5(3):159-168.
34. Maloof, M. (2003). Learning when data sets are imbalanced and when costs are unequal and unknown. In Proceedings of the ICML'03 workshop on learning from imbalanced data sets.
35. Mays E. Handbook of credit scoring 2001, Glenlake Pub. Co. Fitzroy Dearborn Pub., Chicago.
36. McNab H., Wynn A. Principles and practice of consumer risk management 2003, The Chartered Institute of Bankers.
37. Miller M.J. Credit reporting systems and the international economy 2003, The MIT Press, Cambridge, Massachusetts.
38. Ong C.S., Huang J.J., Gwo-Hshiung T. Building credit scoring models using genetic programming. Expert Systems with Applications 2005, 29(1):41-47.
39. Piramuthu S. On preprocessing data for financial credit risk evaluation. Expert Systems with Applications 2006, 30:489-497.
40. Prati R.C., Batista G., Monard M.C. Learning with class skews and small disjuncts. Lecture notes in computer science 2004, Vol. 3731:296-306. Springer.
41. Quinlan J.R. C4.5: programs for machine learning 1992, Morgan-Kaufman, San Mateo, CA.
42. Siddiqi N. Credit risk scorecards: developing and implementing intelligent credit scoring 2006, John Wiley & Sons.
43. Somol P., Baesens B., Pudil P., Vanthienen J. Filter- versus wrapper-based feature selection for credit scoring. International Journal of Intelligent Systems 2005, 20:985-999.
44. Steyerberg E.W., Eijkemans M.J.C., Harrell F.E., Habbema J., Dik F. Prognostic modelling with logistic regression analysis: a comparison of selection methods in small data sets. Statistics in Medicine 2000, 19(8):1059-1079.
45. Tan P.-N., Steinbach M., Kumar V. Introduction to data mining 2006, Pearson Addison Wesley, Boston. 1st ed.
46. Thomas L.C. A survey of credit and behavioural scoring: forecasting financial risk of lending to consumers. International Journal of Forecasting 2000, 16(2):149-172.
47. Thomas L.C., Banasik J., Crook J.N. Recalibrating scorecards. Journal of the Operational Research Society 2001, 52(9):981-988.
48. Thomas L.C., Edelman D.B., Crook J.N. Credit scoring and its applications 2002, SIAM, Philadelphia.
49. Thomas L.C., Oliver R.W., Hand D.J. A survey of the issues in consumer credit modelling research. Journal of the Operational Research Society 2005, 56(9):1006-1015.
50. Verstraeten G., Van den Poel D. The impact of sample bias on consumer credit scoring performance and profitability. Journal of the Operational Research Society 2005, 56(8):981-992.
51. Weiss G.M. Mining with rarity: a unifying framework. ACM SIGKDD Explorations Newsletter 2004, 6(1):7-19.
52. Weiss G.M., Provost F. Learning when training data are costly: the effect of class distribution on tree induction. Journal of Artificial Intelligence Research 2003, 19:315-354.
53. West D. Neural network credit scoring models. Computers and Operations Research 2000, 27(11-12):1131-1152.
54. Wu I.-D., Hand D.J. Handling selection bias when choosing actions in retail credit applications. European Journal of Operational Research 2007, 183:1560-1568.