Benchmarking sampling techniques for imbalance learning in churn prediction

Journal of the Operational Research Society

Volumn 69, Issue 1, 2018, Pages 49-65

  Zhu, Bing ^a,b   Baesens, Bart ^b,c   Backiel, Aimée ^b   Vanden Broucke, Seppe K L M ^b  

^a Sichuan University   (China)

^b UNIVERSITY OF LEUVEN   (Belgium)

^c UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Churn prediction; class imbalance; maximum profit measure; sampling technique

Indexed keywords

COST BENEFIT ANALYSIS; PROFITABILITY;

CHURN PREDICTIONS; CLASS IMBALANCE; CUSTOMER CHURN PREDICTION; EMPIRICAL - COMPARISONS; MAXIMUM PROFITS; PERFORMANCE MEASURE; SAMPLING STRATEGIES; SAMPLING TECHNIQUE;

FORECASTING;

EID: 85014521443     PISSN: 01605682     EISSN: 14769360     Source Type: Journal    
DOI: 10.1057/s41274-016-0176-1     Document Type: Article

References (49)

1. Ali, O. G., & Ariturk, U. (2014). Dynamic churn prediction framework with more efective use of rare event data: The case of private banking. Expert Systems with Applications, 41(17), 7889-7903.
2. Baesens, B. (2014). Analytics in a big data world. New York, NY: Wiley.
3. Barua, S., Islam, M., & Yao, X. (2014). MWMOTE-majority weighted minority oversampling technique for imbalanced data set learning. IEEE Transactions on Knowledge and Data Engineering, 26(2), 405-425.
4. Batista, G. E., Prati, R. C., & Monard, M. C. (2004). A study of the behavior of several methods for balancing machine learning training data. ACM Sigkdd Explorations Newsletter, 6(1), 20-29.
5. Bhattacharya, C. B. (1998). When customers are members: Customer retention in paid membership contexts. Journal of the Academy of Marketing Science, 26(1), 31-44.
6. Bradley, A. P. (1997). The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognition, 30(7), 1145-1159.
7. Burez, J., & Van den Poel, D. (2009). Handling class imbalance in customer churn prediction. Expert Systems with Applications, 36(3), 4626-4636.
8. Chawla, N. V. (2003). C4.5 and imbalanced data sets: Investigating the effect of sampling method, probabilistic estimate, and decision tree structure. In Proceedings of the ICML.
9. Chawla, N. V., Bowyer, K. W., Hall, K. O., & Kegelmeyer, W. P. (2002). SMOTE: Synthetic minority over-sampling technique. Journal of Artifcial Intelligence Research, 16(3), 321-357.
10. Chen, Z. Y., Fan, Z. P., & Sun, M. (2012). A hierarchical multiple kernel support vector machine for customer churn prediction using longitudinal behavioral data. European Journal of Operational Research, 223(2), 461-472.
11. Colgate, M., & Danaher, P. (2000). Implementing a customer relationship strategy: The asymmetric impact of poor versus excellent execution. Journal of the Academy of Marketing Science, 28(3), 375-387.
12. Coussement, K., & Van den Poel, D. (2008a). Churn prediction in subscription services: An application of support vector machines while comparing two parameter-selection techniques. Expert Systems with Applications, 34(1), 313-327.
13. Coussement, K., & Van den Poel, D. (2008b). Integrating the voice of customers through call center emails into a decision support system for churn prediction. Information & Management, 45(3), 164-174.
14. De Bock, K. W., & Van den Poel, D. (2011). An empirical evaluation of rotation-based ensemble classifers for customer churn prediction. Expert Systems with Applications, 38(10), 12293-12301.
15. Demšar, J. (2006). Statistical comparisons of classifers over multiple data sets. Journal of Machine Learning Research, 7, 1-30.
16. Farquad, M. A. H., Ravi, V., & Raju, S. N. (2014). Churn prediction using comprehensible support vector machine: An analytical CRM application. Applied Sof Computing, 19, 31-40.
17. Ganesh, J., Arnold, M., & Reynolds, K. (2000). Understanding the customer base of service providers: An examination of the diferences between switchers and stayers. Journal of Marketing, 64(3), 65-87.
18. García, S., & Herrera, F. (2009). Evolutionary undersampling for classifcation with imbalanced datasets: Proposals and taxonomy. Evolutionary Computation, 17(3), 275-306.
19. García, S., Sánchez, J. S., & Mollineda, R. A. (2012). On the efectiveness of preprocessing methods when dealing with diferent levels of class imbalance. Knowledge-Based Systems, 25(1), 13-21.
20. Hadden, J., Tiwari, A., Roy, R., & Ruta, D. (2007). Computer assisted customer churn management: State-of-the-art and future trends. Computers & Operations Research, 34(10), 2902-2917.
21. Hand, D. J. (2009). Measuring classifer performance: A coherent alternative to the area under the ROC curve. Machine Learning, 77(1), 103-123.
22. Han, H., Wang, W. Y., & Mao, B. H. (2005). Borderline-SMOTE: A new over-sampling method in imbalanced data sets learning. In Proceedings international conference on intelligent computing (pp 878-887).
23. He, H., Bai Y., Garcia, E. A., & Li, S. (2008). ADASYN: Adaptive synthetic sampling approach for imbalanced learning. In Proceedings of IEEE international joint conference on neural networks (pp 1322-1328).
24. He, H., & Garcia, E. A. (2009). Learning from imbalanced data. IEEE Transactions on Knowledge and Data Engineering, 21(9), 1263-1284.
25. Holm, S. (1970). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6, 65-70.
26. Jahromi, A. T., Stakhovych, S., & Ewing, M. (2014). Managing B2B customer churn, retention and proftability. Industrial Marketing Management, 43(7), 1258-1268.
27. Jamal, Z., & Bucklin, R. E. (2006). Improving the diagnosis and prediction of customer churn: A heterogeneous hazard modeling approach. Journal of Interactive Marketing, 20(3-4), 16-29.
28. Keramati, A., Jafari-Marandi, R., Aliannejadi, M., Ahmadian, L., & Mozafari, M., & Abbasi, U, (2014). Improved churn prediction in telecommunication industry using data mining techniques. Applied Sof Computing, 24, 994-1012.
29. Khoshgofaar, T., Seifert C., Van Hulse, J., Napolitano, A., & Folleco, A. (2007). Learning with limited minority class data. In Proceeding of international conference on machine learning and applications (pp 348-353).
30. Kubat M., & Matwin S. (1997). Addressing the curse of imbalanced training sets: One-sided selection. In: Proceedings of international conference on machine learning (pp 179-186).
31. Lima, E., Mues, C., & Baesens, B. (2009). Domain knowledge integration in data mining using decision tables: Case studies in churn prediction. Journal of the Operational Research Society, 8(8), 1096-1106.
32. Lemmens, A., & Croux, C. (2006). Bagging and boosting classifcation trees to predict churn. Journal of Marketing Research (JMR), 43(2), 276-286.
33. López, V., Fernández, A., García, S., Palade, V., & Herrera, F. (2013). An insight into classifcation with imbalanced data: Empirical results and current trends on using data intrinsic characteristics. Information Sciences, 250, 113-141.
34. Marqués, A. I., García, V., & Sánchez, J. S. (2013). On the suitability of resampling techniques for the class imbalance problem in credit scoring. Journal of the Operational Research Society, 64(7), 1060-1070.
35. Neslin, S., Gupta, S., Kamakura, W., Lu, J., & Mason, C. (2006). Detection defection: Measuring and understanding the predictive accuracy of customer churn models. Journal of Marketing Research, 43(2), 204-211.
36. Raeder, T., Forman G., & Chawla, N. V. (2012). Learning from imbalanced data: Evaluation matters. In: Data mining: Foundations and intelligent paradigms (pp 315-331). Springer.
37. Seifert, C., Khoshgofaar, T. M., Van Hulse, J., & Folleco, A. (2014). An empirical study of the classifcation performance of learners on imbalanced and noisy sofware quality data. Information Sciences, 259, 571-595.
38. Sun, Y., Wong, A. K., & Kamel, M. S. (2009). Classifcation of imbalanced data: A review. International Journal of Pattern Recognition and Artifcial Intelligence, 23(4), 687-719.
39. Van Hulse, J Khoshgofaar, T. M., & Napolitano, A. (2007). Experimental perspectives on learning from imbalanced data. In Proceedings of the 24th international conference on machine learning (pp 935-942).
40. Verbeke, W., Martens, D., Mues, C., & Baesens, B. (2011). Building comprehensible customer churn prediction models with advanced rule induction techniques. Expert Systems with Applications, 38(3), 2354-2364.
41. Verbeke, W., Dejaeger, K., Martens, D., Hur, J., & Baesens, B. (2012). New insights into churn prediction in the telecommunication sector: A proft driven data mining approach. European Journal of Operational Research, 218(1), 211-229.
42. Weiss, G. M. (2004). Mining with rarity: A unifying framework. ACM Sigkdd Explorations Newsletter, 6(1), 7-19.
43. Weiss, G. M., & Provost, F. (2003). Learning when training data are costly: The effect of class distribution on tree induction. Journal of Artifcial Intelligence Research, 19, 315-354.
44. Xiao, J., Xie, L., He, C., & Jiang, X. (2012). Dynamic classifer ensemble model for customer classifcation with imbalanced distribution. Expert Systems with Applications, 39(3), 3668-3675.
45. Xie, Y., Li, X., Ngai, E., & Ying, M. (2009). Customer churn prediction using improved balanced random forests. Expert Systems with Applications, 36(3), 5445-5449.
46. Yang, P., Xu, L., Zhou, B. B., Zhang, Z., & Zomaya, A. Y. (2009). A particle swarm based hybrid system for imbalanced medical data sampling. BMC Genomics, 10(Suppl 3), S34.
47. Yang, Q., & Wu, X. (2006). Challenging problems in data mining research. International Journal of Information Technology Decision Making, 5(4), 597-604.
48. Yen, S. J., & Lee, Y. S. (2009). Cluster-based under-sampling approaches for imbalanced data distributions. Expert Systems with Applications, 36(3), 5718-5727.
49. Zeithaml, V., Berry, L., & Parasuraman, A. (1996). The behavioural consequences of service quality. Journal of Marketing, 60(2), 31-46.