A Kolmogorov-Smirnov statistic based segmentation approach to learning from imbalanced datasets: With application in property refinance prediction

Expert Systems with Applications

Volumn 39, Issue 6, 2012, Pages 6192-6200

  Gong, Rongsheng ^a   Huang, Samuel H ^a  

^a 705 Engineering Research Center   (United States)

Author keywords

Decision tree; Imbalanced data; Kolmogorov Smirnov statistic; Property refinance prediction; Segmentation

Indexed keywords

CLASS IMBALANCE; COMPLEX PROBLEMS; DECISION TREE METHOD; IMBALANCED DATA; IMBALANCED DATA-SETS; KOLMOGOROV-SMIRNOV; LOGISTIC REGRESSION MODELS; OPTIMAL SAMPLING; POOR PERFORMANCE; RESAMPLING METHOD; STANDARD CLASSIFICATION MODELS; STATISTIC-BASED; SUB-PROBLEMS; TRAINING DATA;

CLASSIFICATION (OF INFORMATION); DECISION TREES; FEATURE EXTRACTION; FORECASTING; FORESTRY; IMAGE SEGMENTATION; REGRESSION ANALYSIS;

TREES (MATHEMATICS);

ALGORITHMS; CLASSIFICATION; FORECASTS; IMAGE ANALYSIS; REGRESSION ANALYSIS; SEGMENTATION; STATISTICAL ANALYSIS;

EID: 84856534206     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2011.12.011     Document Type: Article

References (31)

1. Agarwal, R., & Joshi, M. (2001). PNrule: A new classification framework in data mining (a case-study in network intrusion detection), In Proceedings of 1st SIAM international conference on data mining, Chicago, IL.
2. R. Barandela, J.S. Sanchez, V. Garcia, and E. Rangel Strategies for learning in class imbalance problems Pattern Recognition 36 2003 849 851
3. L. Breiman, J. Freidman, R. Olshen, and C. Stone Classification and regression tree 1984 Wadsworth International Group Belmont, CA
4. Carvalho, D. R., & Freitas, A. A. (2002). A genetic algorithms with sequential niching for discovering small-disjunct rules. in proceedings of genetic and evolutionary computation, San Francisco, CA.
5. Chan, P. K., & Stolfo, S. J. (1998). Toward scalable learning with non-uniform class and cost distributions: A case study in credit card fraud detection. In Proceedings of the 4th international conference on knowledge discovery and data mining.
6. N.V. Chawla, K.W. Bowyer, L.O. Hall, and W.P. Kegelmeyer SMOTE: Synthetic minority over-sampling techniques Journal of Artificial Research 16 2002 321 357 (Pubitemid 43057176)
7. G. Cohen, M. Hilario, H. Sax, S. Hugonnet, and A. Geissbuhler Learning from imbalanced data in surveillance of nosocomial infection Artificial Intelligence in Medicine 37 2006 7 18
8. Corder, G. W., & Foreman, D. I. (2009). Nonparametric statistics for non-statisticians: A step-by-step approach.
9. Drummond, C., & Holte, R. C. (2003). C4.5, Class imbalance and cost sensitivity: Why under-sampling beats over-sampling. In Proceedings of international conference on machine learning. workshop on learning from imbalanced data sets, Washington, DC.
10. A. Estabrooks, T. Jo, and N. Japkowicz A multiple resampling method for learning from imbalanced data sets Computational Intelligence 20 1 2004 18 36
11. Evangelista, P. F. (2006). The unbalanced classification problem: detecting breaches in security. Ph.d. Dissertation, Department of Decision Sciences and Engineering System, Rensselaer Polytechnic Institute.
12. T. Fawcett, and F. Provost Adaptive fraud prevention Data Mining and Knowledge Discovery 3 1 1997 291 316
13. Flach, P. A. (2003). The geometry of ROC space: Understanding machine learning metrics through ROC isometrics. In Proceedings of 12th International Conference on Machine Learning, Washington DC.
14. G. Forman An extensive empirical study of feature selection metrics for text classification Journal of Machine Learning Research 3 2003 1289 1305
15. R. Gong, S.H. Huang, and T. Chen Robust and efficient rule extraction through data summarization and its application in welding fault diagnosis IEEE Transactions on Industrial Informatics 4 3 2008 198 208
16. T.K. Ho, and M. Basu Complexity measures of supervised classification problems IEEE Transactions on Pattern Analysis and Machine Learning 24 3 2002 289 300 (Pubitemid 35289347)
17. Holte, R. C., Acker, L. E., & Porter, B. W. (1989). Concept learning and the problem of small disjuncts. In Proceedings of the 11th joint international conference on artificial intelligence.
18. S.H. Huang Dimensionality reduction in automatic knowledge acquisition IEEE Transactions on Knowledge and Data Engineering 15 6 2003 1364 1373
19. N. Japkowicz, and S. Stephen The class imbalance problem: A systematic study Intelligent Data Analysis. 6 5 2002 429 450
20. Kerber, R. (1992). ChiMerge: Discretization of continuous attributes. In Proceedings of the 9th International Conference on Artificial Intelligence.
21. Kubat, M., & Matwin, S. (1997). Addressing the curse of imbalanced training sets: One-sided selection. In Proceedings of the 14th international conference on machine learning.
22. Ling, C. X., & Li, C. (1998). Data mining for direct marketing: Problems and solutions. In Proceedings of the 4th international conference on knowledge discovery and data mining, New York, NY.
23. C.X. Ling, V. Sheng, and Q. Yang Test strategies for cost-sensitive decision trees IEEE Transactions on Knowledge and Data Engineering 18 8 2006 1055 1067 (Pubitemid 44109535)
24. H. Liu, and R. Setiono Feature selection via discretization of numeric attributes IEEE Transactions on Knowledge and Data Engineering 9 4 1997 642 645 (Pubitemid 127776408)
25. M.A. Mazurowski, P.A. Habas, J.M. Zurada, J.Y. Lo, J.A. Baker, and G.D. Tourassi Training neural network classifiers for medical decision making: the effects of imbalanced datasets on classification performance Neural Network 21 2-3 2008 427 436
26. Provost, F. (2000). Machine learning from imbalanced data sets 101. Invited paper for the AAAI'2000 workshop on imbalanced data sets.
27. J.R. Quinlan Improved estimates for the accuracy of small disjuncts Machine Learning 6 1 1991 93 98 (Pubitemid 21727224)
28. J.R. Quinlan C4.5: Programs for machine learning 1993 Morgan Kaufmann San Mateo, CA
29. B. Raskutti, and A. Kowalczyk Extreme re-balancing for SVMs: A case study ACM SIGKDD Explorations Newsletter - Special Issue on Learning from Imbalanced Datasets 6 1 2004 60 69
30. Veropoulos, K., Campbell, C., & Cristianini N. (1999). Controlling the sensitivity of support vector machines. In Proceedings of international joint conference on artificial intelligence.
31. G.M. Weiss Mining with rarity: A unifying framework ACM SIGKDD Explorations Newsletter - Special Issue on Learning from Imbalanced Datasets 6 1 2004 7 19