A critical assessment of imbalanced class distribution problem: The case of predicting freshmen student attrition

Expert Systems with Applications

Volumn 41, Issue 2, 2014, Pages 321-330

  Thammasiri, Dech ^a   Delen, Dursun ^b   Meesad, Phayung ^a   Kasap, Nihat ^c  

^a KING MONGKUT'S UNIVERSITY OF TECHNOLOGY NORTH BANGKOK   (Thailand)

^b OKLAHOMA STATE UNIVERSITY   (United States)

^c SABANCI UNIVERSITY   (Turkey)

Author keywords

Attrition; Imbalanced class distribution; Prediction; Sampling; Sensitivity analysis; SMOTE; Student retention

Indexed keywords

ACADEMIC INSTITUTIONS; ATTRITION; CLASSIFICATION METHODS; CLASSIFICATION PERFORMANCE; CLASSIFICATION TECHNIQUE; IMBALANCED CLASS; SMOTE; STUDENT RETENTION;

DECISION TREES; FORECASTING; SAMPLING; SENSITIVITY ANALYSIS; SUPPORT VECTOR MACHINES;

STUDENTS;

EID: 84885955704     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2013.07.046     Document Type: Article

References (52)

1. R. Alkhasawneh Developing a hybrid model to predict student first year retention and academic success in STEM disciplines using neural networks 2011 Virginia Commonwealth University
2. I. Brown, and C. Mues An experimental comparison of classification algorithms for imbalanced credit scoring data sets Expert Systems with Applications 39 3 2012 3446 3453
3. J. Burtner The use of discriminant analysis to investigate the influence of non-cognitive factors on engineering school persistence Journal of Engineering Education 94 2005 335 338 (Pubitemid 41165341)
4. A.F. Cabrera, J.-E.A. Nora, and M.B. Castafne Structural equations modeling test of an integrated model of student retention The Journal of Higher Education 64 2 1993 123 139
5. N.V. Chawla, K.W. Bowyer, L.O. Hall, and W.P. Kegelmeyer SMOTE: Synthetic minority over-sampling technique Journal of Artificial Intelligence Research 16 2002 341 378
6. Chawla, N. V., Lazarevic, A., Hall, L. O., & Bowyer, K. W. (2003). SMOTEBoost: Improving prediction of the minority class in boosting. In Seventh European conference on principles and practice of knowledge discovery in databases (PKDD) (pp. 107-119). Dubrovnik, Croatia. (Pubitemid 37231089)
7. F. David, and F. Renea Predictors of first-year student retention in the community college Community College Review 36 2 2008 68 88
8. D. Delen A comparative analysis of machine learning techniques for student retention management Decision Support Systems 49 4 2010 498 506
9. D. Delen Predicting student attrition with data mining methods Journal of College Student Retention 13 1 2011 17 35
10. Drummond, C., & Holte, R. C. (2003). C4.5, class imbalance, and cost sensitivity: Why under-sampling beats over-sampling. In Workshop on learning from imbalanced datasets II, ICML. Washington, DC.
11. E. Duman, Y. Ekinci, and A. Tanriverdi Comparing alternative classifiers for database marketing: The case of imbalanced datasets Expert Systems with Applications 39 2012 48 53
12. B.L. Garton, and A.L. Ball The academic performance and retention of college of agriculture students Journal of Agricultural Education 43 1 2002 46 56
13. J.G. Glynn, P.L. Sauer, and T.E. Miller A logistic regression model for the enhancement of student retention: The identification of at-risk freshmen International Business & Economics Research Journal 1 8 2002 79 86
14. R. Gong, and S.H. Huang A Kolmogorov-Smirnov statistic based segmentation approach to learning from imbalanced datasets: With application in property refinance prediction Expert Systems with Applications 39 2012 6192 6200
15. H. Guo, and H.L. Viktor Learning from imbalanced data sets with boosting and data generation: The DataBoost-IM approach SIGKDD Explorations Newsletter 6 2004 30 39
16. Haibo, H., Yang, B., Garcia, E. A., & Shutao, L. (2008). ADASYN: Adaptive synthetic sampling approach for imbalanced learning. In Proceedings of the IEEE international joint conference on neural networks, IJCNN 2008. (IEEE World Congress on Computational Intelligence) (pp. 1322-1328).
17. Han, H., Wang, W. -Y., & Mao, B. -H. (2005). Borderline-SMOTE: A new over-sampling method in imbalanced data sets learning. In First international conference on intelligent computing (ICIC) (pp. 878-887). Hefei, China. (Pubitemid 41491129)
18. S. Herzog Estimating student retention and degree-completion time: Decision trees and neural networks vis-à-vis regression New Directions for Institutional Research 131 2006 17 33 John Wiley & Sons, Inc. Published online in Wiley Interscience
19. Z.J. Kovačić Predicting student success by mining enrolment data Research in Higher Education Journal 15 2012 1 20
20. Lauría, E. J. M., Baron, J. D., Devireddy, M., Sundararaju, V., & Jayaprakash, S. M. (2012). Mining academic data to improve college student retention: An open source perspective. In Second international conference on learning analytics and knowledge (pp. 139-142) Vancouver, BC, Canada.
21. R. Laza, R. Pavon, M. Reboiro-Jato, and F. Fedz-Riverola Evaluating the effect of unbalanced data in biomedical document classification Journal of Integrative Bioinformatics 8 3 2011 1 13
22. D.-C. Li, C.-W. Liu, and S.C. Hu A learning method for the class imbalance problem with medical data sets Computers in Biology and Medicine 40 2010 509 518
23. H. Li, and J. Sun Forecasting business failure: The use of nearest-neighbour support vectors and correcting imbalanced samples - evidence from the Chinese hotel industry Tourism Management 33 3 2012 622 634
24. Q. Li, H. Swaminathan, and J. Tang Development of a classification system for engineering student characteristics affecting college enrollment and retention Journal of Engineering Education 98 2009 361 376
25. T.W. Liao Classification of weld flaws with imbalanced class data Expert Systems with Applications 35 2008 1041 1052
26. S.H. Lin Data mining for student retention management Journal of Computing Sciences in Colleges 27 4 2012 92 99
27. Lin, J. J. J., Imbrie, P. K., & Reid, K. J. (2009). Student retention modelling: An evaluation of different methods and their impact on prediction results. In Proceedings of the research in engineering education symposium 2009 Palm Cove, QLD.
28. Lindsey, R., Lewis, O., Pashler, H., & Mozer, M. (2010). Predicting students' retention of facts from feedback during study. In Proceedings of the 32nd annual conference of the cognitive science society. Austin, TX: Cognitive Science Society.
29. Luna, J. (2000). Predicting student retention and academic success at new mexico tech, New Mexico Institute of Mining and Technology, Socorro, New Mexico.
30. T.M. Mitchell Machine learning 1977 McGraw-Hill New York
31. P.A. Murtaugh, L.D. Burns, and J. Schuster Predicting the retention of university students Research in Higher Education 40 3 1999 355 371
32. A. Nandeshwar, T. Menzies, and A. Nelson Learning patterns of university student retention Expert Systems with Applications 38 12 2011 14984 14996
33. D.L. Olson, and D. Delen Advanced data mining techniques 2008 Springer-verlag Berlin, Heidelberg
34. D.L. Olson, D. Delen, and Y. Meng Comparative analysis of data mining models for bankruptcy prediction Decision Support Systems 52 2 2012 464 473
35. S.W. Pyke, and P.M. Sheridan Logistic regression analysis of graduate student retention Canadian Journal of Higher Education 23 2 1993 44 64
36. J.R. Quinlan Induction of decision trees Machine Learning 1 1 1986 81 106
37. Salazar, A., Gosalbez, J., Bosch, I., Miralles, R., & Vergara, L. (2004).A case study of knowledge discovery on academic achievement, student desertion and student retention. In Second international conference on information technology: Research and education, 2004, ITRE 2004 (pp. 150-154). (Pubitemid 41718266)
38. Schreiner, L. A. (2009). Linking student satisfaction and retention. Research study: Azusa Pacific University.
39. D.M. Scott, G.I. Spielmans, and D.C. Julka Predictors of academic achievement and retention among College freshmen: A longitudinal study College Student Journal 38 1 2004 66 80
40. C.-T. Su, L.-S. Chen, and Y. Yih Knowledge acquisition through information granulation for imbalanced data Expert Systems with Applications 31 2006 531 541 (Pubitemid 43831633)
41. J. Taeho, and J. Nathalie Class imbalances versus small disjuncts ACM SIGKDD Explorations Newsletter 6 2004 40 49
42. Tinto, V. (1987). Leaving college: Rethinking the causes and cures of student attrition. University of Chicago Press, 5801 S. Ellis Avenue, Chicago, IL 60637.
43. C.P. Veenstra, E.L. Dey, and G.D. Herrin A model for freshman engineering retention Advances in Engineering Education 1 3 2009 1 33
44. L. Xu, and M.-Y. Chow A classification approach for power distribution systems fault cause identification IEEE Transactions on Power Systems 21 1 2006 53 60 (Pubitemid 43204702)
45. S.K. Yadav, B. Bharadwaj, and S. Pal Data mining applications: A comparative study for predicting student's performance International Journal of Innovative Technology & Creative Engineering 1 12 2012 13 19
46. S.K. Yadav, and S. Pal Data mining: A prediction for performance improvement of engineering students using classification World of Computer Science and Information Technology Journal (WCSIT) 2 2 2012 51 56
47. J.S. Yazdi, F. Kalantary, and H.S. Yazdi Prediction of liquefaction potential based on CPT up-sampling Computers & Geosciences 44 0 2012 10 23
48. C.H. Yu, S. DiGangi, A. Jannasch-Pennell, and C. Kaprolet A data mining approach for identifying predictors of student retention from sophomore to junior year Journal of Data Science 8 2010 307 325
49. Yu, F. H., DiGangi, E., Jannasch-Pennell, A., Lo, W., & Kaprolet, C. (2007). A data-mining approach to differentiate predictors of retention. Educause Southwest Conference. Austin, TX.
50. Zhang, Y., & Oussena, S. (2010). Use data mining to improve student retention in higher education - a case study. In 12th International conerence on enterprise information systems. Portugal.
51. G. Zhang, T.J. Anderson, M.W. Ohland, and B.R. Thorndyke Identifying factors influencing engineering student graduation: A longitudinal and cross-institutional study Journal of Engineering Education 93 4 2004 313 320
52. Z.-H. Zhou, and X.-Y. Liu Training cost-sensitive neural networks with methods addressing the class imbalance problem IEEE Transactions on Knowledge and Data Engineering 18 2006 63 77 (Pubitemid 43145089)