Determining the optimal re-sampling strategy for a classification model with imbalanced data using design of experiments and response surface methodologies

Expert Systems with Applications

Volumn 38, Issue 4, 2011, Pages 4222-4227

  Tong, Lee Ing ^a   Chang, Yung Chia ^a   Lin, Shan Hui ^a  

^a NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

Author keywords

Classifier; Design of experiments; Imbalanced data; Machine learning; Re sampling strategy; Response surface methodologies; The area under ROC curve

Indexed keywords

AREA UNDER ROCS; IMBALANCED DATA; MACHINE-LEARNING; RESAMPLING; RESPONSE SURFACE METHODOLOGY;

CLASSIFIERS; DESIGN OF EXPERIMENTS; LEARNING ALGORITHMS; LEARNING SYSTEMS; MACHINE DESIGN; OPTIMIZATION; SAMPLING; SURFACE PROPERTIES;

CLASSIFICATION (OF INFORMATION);

EID: 78650689032     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2010.09.087     Document Type: Article

References (21)

1. Asuncion, A.; Newman, D. J. (2007). UCI machine learning repository. Irvine, CA: University of California, School of Information and Computer Science. < http://www.ics.uci.edu/∼mlearn/MLRepository.html >
2. R. Barandela, J.S. Sánchez, V. García, and E. Rangel Strategies for learning in class imbalanced problems Pattern Recognition 36 2003 849 851
3. R. Barandela, R.M. Vadovinos, J.S. Sánchez, and F.J. Ferri The imbalanced training sample problem: Under or over sampling Lecture Note in Computer Science 3138 2004 806 814
4. G.E.P. Box, and D.W. Behnken Some new three level designs for the study of quantitative variables Technometrics 2 1960 455 475
5. A.P. Bradley The use of the area under the ROC curve in the evaluation of machine learning algorithms Pattern Recognition 30 1997 1145 1159
6. T. Fawcett An introduction to ROC analysis Pattern Recognition Letters 27 8 2006 861 874
7. D.J. Hand, and R.J. Till A simple generalization of the area under the ROC curve for multiple class classification problems Machine Learning 45 2001 171 186
8. J.A. Hanley, and B.J. McNeil The meaning and the use of the area under a receiver operating characteristic (ROC) curve Radiology 143 1982 29 36
9. He, G.; Han, H.; Wang, W. (2005). An Over-sampling expert system for learning from imbalanced data sets. In Proceedings of the international conference on neural networks and brain (Vol. 1, pp. 537-541).
10. K.B. Irani, J. Cheng, U.M. Fayyand, and Z. Qian Applying machine learning to semiconductor manufacturing IEEE Expert 8 1993 41 47
11. M. Jahani, M. Alizadeh, M. Pirozifard, and A. Qudsevali Optimization of enzymatic degumming process for rice bran oil using response surface methodology LWT - Food Science and Technology 41 10 2008 1892 1898
12. Japkowicz, N. (2000). Learning from imbalanced data sets: A comparison of various strategies. In Proceedings of learning from imbalanced data (pp. 10-15).
13. N. Japkowicz, and S. Stephen The class imbalance problem: A systematic study Intelligent Data Analysis 6 5 2002 429 449
14. Lin, X. Y.; Wu, J.; Zhou, Z. H. (2006). Exploratory under-sampling for class-imbalance learning. In Proceedings of international conference on data mining (pp. 965-969).
15. McCarthy, K.; Zabar, B.; Weiss, G. (2005). Does cost-sensitive learning beat sampling for classifying rare classes? In Proceedings of the 1st international workshop on utility-based data mining (pp. 69-77).
16. D.C. Montgomery Design and analysis of experiment 6th ed. 2005 John Wiley and Sons New York
17. C. Phua, D. Alahakoon, and V. Lee Minority report in fraud detection: Classification of skewed data ACM SIGKDD 6 2004 50 59
18. Provost, F. (2000). Machine learning from imbalanced data sets 101. In Proceedings of the AAAI'2000 workshop on imbalanced data sets.
19. Provost, F.; Fawcett, T.; Kohavi, R. (1998). The case against accuracy estimation for comparing induction algorithms. In Proceedings of the 15th international conference on machine learning (pp. 445-453).
20. J.R. Quinlan C4.5: Program for machine learning 1993 Morgan Kaufmann San Mateo, CA
21. S. Shin, Y. Guo, M. Choi, and C. Kim Development of a robust data mining method using CBFS and RSM Lecture Notes in Computer Science 4378 2007 377 388