An empirical comparison of techniques for the class imbalance problem in churn prediction

Information Sciences

Volumn 408, Issue , 2017, Pages 84-99

  Zhu, Bing ^a,b   Baesens, Bart ^b,c   vanden Broucke, Seppe K L M ^b  

^a Department of Management Science and System Science   (China)

^b UNIVERSITY OF LEUVEN   (Belgium)

^c UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Benchmark experiment; Churn prediction; Class imbalance; Expected maximum profit measure

Indexed keywords

COST BENEFIT ANALYSIS; PROFITABILITY;

BENCHMARK EXPERIMENTS; CHURN PREDICTIONS; CLASS IMBALANCE; CLASS IMBALANCE PROBLEMS; CUSTOMER CHURN PREDICTION; EMPIRICAL - COMPARISONS; MAXIMUM PROFITS; STATE-OF-THE-ART TECHNIQUES;

FORECASTING;

EID: 85018384906     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2017.04.015     Document Type: Article

References (46)

1. [1] Ali, O., Ariturk, U., Dynamic churn prediction framework with more effective use of rare event data: the case of private banking. Expert Syst. Appl. 41:17 (2014), 7889–7903.
2. [2] Barua, S., Islam, M., Yao, X., MWMOTE-Majority weighted minority oversampling technique for imbalanced data set learning. IEEE Trans. Knowl. Data Eng. 26:2 (2014), 405–425.
3. [3] Batista, G.E., Prati, R.C., Monard, M.C., A study of the behavior of several methods for balancing machine learning training data. ACM Sigkdd Explorations Newsletter 6:1 (2004), 20–29.
4. [4] Burez, J., Poel, D.V.d., Handling class imbalance in customer churn prediction. Expert Syst Appl 36:3, Part 1 (2009), 4626–4636.
5. [5] Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P., SMOTE: syntheticminority over-sampling technique. J. Artif. Intell. Res. 16:3 (2002), 321–357.
6. [6] Chawla, N., Lazarevic, A., Hall, L., Bowyer, K.W., SMOTEBoost: improving prediction of the minority class in boosting. Proceeding of PKDD, 2003, 107–119.
7. [7] Chen, Z., Fan, Z., Sun, M., A hierarchical multiple kernel support vector machine for customer churn prediction using longitudinal behavioral data. Eur. J. Oper. Res. 223:2 (2012), 461–472.
8. [8] Chen, C., Liaw, A., Breiman, L., Using Random Forests to Learn Imbalanced Data, 2004, Statistics Department of University of California at Berkeley Technical report.
9. [9] Colgate, M., Danaher, P., Implementing a customer relationship strategy: the asymmetric impact of poor versus excellent execution. J. Acad. Market. Sci. 28:3 (2000), 375–387.
10. [10] Coussement, K., Lessmann, S., Verstraeten, G., A comparative analysis of data preparation algorithms for customer churn prediction: a case study in the telecommunication industry. Decis. Support Syst., 2016 Online first.
11. [11] sar, J.D., Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7 (2006), 1–30.
12. [12] Ertekin, S., Huang, J., Bottou, L., Giles, C.L., Learning on the border: active learning in imbalanced data classification. Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management, ACM, 2007, 127–136.
13. [13] V. García, V., Sànchez, J.S., Mollineda, R., On the effectiveness of preprocessing methods when dealing with different levels of class imbalance. Knowl. Based Syst. 25:1 (2012), 13–21.
14. [14] García, S., Herrera, F., Evolutionary undersampling for classification with imbalanced datasets: proposals and taxonomy. Evolut. Comput. 17:3 (2009), 275–306.
15. [15] Galar, M., Fernández, A., Barrenechea, E., Bustince, H., Herrera, F., Ordering-based pruning for improving the performance of ensembles of classifiers in the framework of imbalanced datasets. Inf. Sci. (Ny) 354 (2016), 178–196.
16. [16] Galar, M., Fernández, A., Barrenechea, E., Bustince, H., Herrera, F., A review on ensembles for the class imbalance problem: bagging-, boosting-, and hybrid-based approaches. IEEE Trans. Syst. Man Cybern. Part C 41:4 (2012), 463–484.
17. [17] Gordini, N., Veglio, V., Customers churn prediction and marketing retention strategies. An Application of Support Vector Machines Based on the AUC Parameter-Selection Technique in B2B E-Commerce Industry, Industrial Marketing Management, 2016 Online first.
18. [18] He, H., Bai, Y., Garcia, E.A., Li, S., ADASYN: adaptive synthetic sampling approach for imbalanced learning. Proceedings of IEEE International Joint Conference on Neural Networks, 2008, 1322–1328.
19. [19] Hido, S., Kashima, H., Takahashi, Y., Roughly balanced bagging for imbalanced data. Stat. Anal. Data Min. 2:5-6 (2009), 412–426.
20. [20] Idris, A., Rizwan, M., Khan, A., Churn prediction in telecom using random forest and PSO based data balancing in combination with various feature selection strategies. Comput. Elect. Eng. 38:6 (2012), 1808–1819.
21. [21] Jahromi, A., Stakhovych, S., Ewing, M., Managing b2b customer churn, retention and profitability. Ind. Market. Manage. 43:7 (2014), 1258–1268.
22. [22] Keramati, A., Jafari-Marandi, R., Aliannejadi, M., Ahmadian, I., Mozaffari, M., Abbasi, U., Improved churn prediction in telecommunication industry using data mining techniques. Appl. Soft Comput. 24 (2014), 994–1012.
23. [23] Kubat, M., Matwin, S., Addressing the curse of imbalanced training sets: one-sided selection. Proceeding of International Conference on Machine Learning, 1997, 179–186.
24. [24] Khoshgoftaar, T.M., Hulse, J.V., Napolitano, A., Comparing boosting and bagging techniques with noisy and imbalanced data. IEEE Trans. Syst. Man Cybern. Part A 99 (2010), 1–17.
25. [25] Lemmens, A., Croux, C., Bagging and boosting classification trees to predict churn. J. Market. Res. (JMR) 43 (2006), 276–286.
26. [26] X, L., Wu, J., Zhou, Z., Exploratory undersampling for class-imbalance learning. IEEE Trans. Syst. Man Cybern. Part B 39:2 (2009), 539–550.
27. [27] López, V., Fernández, A., Moreno-Torres, J.G., Herrera, F., Analysis of preprocessing vs. cost-sensitive learning for imbalanced classification, open problems on intrinsic data characteristics. Expert Syst. Appl. 39:7 (2012), 6585–6608.
28. [28] López, V., Fernández, A., García, S., Palade, V., Herrera, F., An insight into classification with imbalanced data: empirical results and current trends on using data intrinsic characteristics. Inf. Sci. (Ny) 250 (2013), 113–141.
29. [29] Neslin, S., Gupta, S., Kamakura, W., Lu, J., Mason, C., Detection defection: measuring and understanding the predictive accuracy of customer churn models. J. Market. Res. 43:2 (2006), 204–211.
30. [30] Raeder, T., Forman, G., Chawla, N.V., Learning from imbalanced data: evaluation matters. 2012, Data Mining: Found. Intell. Paradigms Springer, 315–331.
31. [31] Seiffert, C., Khoshgoftaar, T.M., Hulse, J.V., Folleco, A., An empirical study of the classification performance of learners on imbalanced and noisy software quality data. Inf. Sci. (Ny) 259 (2014), 571–595.
32. [32] Seiffert, C., Khoshgoftaar, T.M., Hulse, J.V., RUSBOost: a hybrid approach to alleviating class imbalance. IEEE Trans. Syst. Man Cybern. Part A 40:1 (2010), 185–197.
33. [33] Shin, H.J., Eom, D.H., Kim, S.S., One-class support vector machines-an application in machine fault detection and classification. Comput. Ind. Eng. 48:2 (2005), 395–408.
34. [34] Sun, Y., Kamel, M.S., Wong, A.K., Wang, Y., Cost-sensitive boosting for classification of imbalanced data. Pattern Recognit. 40:12 (2007), 3358–3378.
35. [35] Sun, Z., Song, Q., Zhu, X., Sun, H., X., B., Zhou, Y., A novel ensemble method for classifying imbalanced data. Pattern Recognit. 48:5 (2015), 1623–1637.
36. [36] Tsai, C., Lu, Y., Customer churn prediction by hybrid neural networks. Expert Syst. Appl. 36:10 (2009), 12547–12553.
37. [37] Ting, K.M., An instance-weighting method to induce cost-sensitive trees. IEEE Trans. Knowl. Data Eng. 14:3 (2002), 659–665.
38. [38] Yen, S.J., Lee, Y.S., Cluster-based under-sampling approaches for imbalanced data distributions. Expert Syst. Appl. 36:3 (2009), 5718–5727.
39. [39] Zhang, X., Zhu, J., Xu, S., Wan, Y., Predicting customer churn through interpersonal influence. Knowl.-Based Syst. 28 (2012), 97–104.
40. [40] Zhu, B., Baesens, B., Backiel, A., Broucke, S.v., Benchmarking sampling techniques for imbalance learning in churn prediction. J. Operat. Res. Soc., 2017, 10.1057/s41274-016-0176-1 Online first.
41. [41] Hulse, J.V., Khoshgoftaar, T.M., Napolitano, A., Experimental perspectives on learning from imbalanced data. Proceedings of the 24th International Conference on Machine learning, 2007, 935–942.
42. [42] Verbeke, W., Dejaeger, K., Martens, D., Hur, J., Baesens, B., New insights into churn prediction in the telecommunication sector: a profit driven data mining approach. Eur. J. Oper. Res. 218:1 (2012), 211–229.
43. [43] Verbraken, T., Verbeke, W., Baesens, B., A novel profit maximizing metric for measuring classification performance of customer churn prediction models. IEEE Trans. Knowl. Data Eng. 25:5 (2013), 961–973.
44. [44] Veropoulos, K., Campbell, C., Cristianini, N., Controlling the sensitivity of support vector machines. Proceedings of the international joint conference on AI, 1999, 55–60.
45. [45] Wang, S., Yao, X., Diversity analysis on imbalanced data sets by using ensemble models. IEEE Symposium on Computational Intelligence, 2009, 324–331.
46. [46] Xie, Y., Li, X., Ngai, E., Ying, M., Customer churn prediction using improved balanced random forests. Expert Syst. Appl. 36:3, Part 1 (2009), 5445–5449.