When costs are unequal and unknown: A subtree grafting approach for unbalanced data classification

Decision Sciences

Volumn 42, Issue 4, 2011, Pages 803-829

  Lee, Jong Seok ^a   Zhu, Dan ^b  

^a Sungkyunkwan University   (South Korea)

^b IOWA STATE UNIVERSITY   (United States)

Author keywords

And unknown costs; Tree induction; Unbalanced data classification

Indexed keywords

EID: 84859819289     PISSN: 00117315     EISSN: 15405915     Source Type: Journal    
DOI: 10.1111/j.1540-5915.2011.00332.x     Document Type: Article

References (38)

1. Asuncion, A., & Newman, D. J. (2007). UCI machine learning repository. Irvine, CA : University of California, School of Information and Computer Science. Retrieved July 27, 2010, from
2. Bansal, G., Sinha, A., & Zhao, H. (2008). Tuning data mining methods for cost-sensitive regression: A study in loan charge-off forecasting. Journal of Management Information Systems, 25(3), 315-336.
3. Batista, G., Prati, M., & Monard, M. (2004). A study of the behavior of several methods for balancing machine learning training data. SIGKDD Explorations: Special Issue on Imbalanced Data Sets, 6(1), 20-29.
4. Breiman, L., Friedman, J., Olshen, R. A., & Stone, C. (1984). Classification and regression trees. Belmont, CA : Wadsworth.
5. Campadelli, P., Casiraghi, E., & Valentini, G. (2005). Support vector machines for candidate nodules classification. Neurocomputing, 68, 281-288.
6. Chai, X., Deng, L., Yang, Q., & Ling, C. X. (2004). Test-cost sensitive naive Bayes classification. Proceedings of the 4th IEEE International Conference on Data Mining, Brighton, UK, 51-58.
7. Chan, P. K., Fan, W., Prodromidis, A. L., & Stolfo, S. J. (1999). Distributed data mining in credit card fraud detection. IEEE Intelligent Systems, 14(6), 67-74.
8. Chang, C.-C., & Lin, C.-J. (2001). LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology, 2(27), 1-27. Software available at
9. Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002). SMOTE: Synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, 16, 321-357.
10. Domingos, P. (1999). MetaCost: A general method for making classifiers cost-sensitive. Proceedings of the 5th SIGKDD International Conference on Knowledge Discovery and Data Mining, San Diego, CA, 155-164.
11. Drummond, C., & Holte, R. C. (2000). Exploiting the cost (in)sensitivity of decision tree splitting criteria. Proceedings of the 17th International Conference on Machine Learning, San Jose, CA, 239-246.
12. Duda, R. O., Hart, P. E., & Stork, D. G. (2001) Pattern classification, New York : Wiley.
13. Elkan, C. (2001). The foundations of cost-sensitive learning. Proceedings of the 17th International Joint Conference on Artificial Intelligence, Seattle, WA, 973-978.
14. Fan, W., Stolfo, S. J., Zhang, J., & Chan, P. K. (1999). AdaCost: Misclassification cost-sensitive boosting. Proceedings of the 16th International Conference on Machine Learning, Bled, Slovenia, 97-105.
15. Fawcett, T. (2008). PRIE: A system for generating rulelists to maximize ROC performance. Data Mining and Knowledge Discovery, 17(2), 207-224.
16. Guo, H., & Viktor, H. (2004). Learning from imbalanced data sets with boosting and data generation: The DataBoost-IM approach. SIGKDD Explorations: Special Issue on Imbalanced Data Sets, 6(1), 30-39.
17. Hastie, T., Tibshirani, R., & Friedman, J. (2001). The elements of statistical learning: Data mining, inference, and prediction. New York : Springer.
18. Hueglin, C., & Vannotti, F. (2001). Data mining techniques to improve forecast accuracy in airline business. Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, 438-442.
19. Japkowicz, N., Myers, C., & Gluck, M. (1995). A novelty detection approach to classification. Proceedings of the 14th International Joint Conference on Artificial Intelligence, Montreal, Canada, 518-523.
20. Kubat, M., Holte, R., & Matwin, S. (1998). Machine learning for the detection of oil spills in satellite radar images. Machine Learning, 30(2), 195-215.
21. Kubat, M., & Matwin, S. (1997). Addressing the curse of imbalanced data sets: One-sided sampling. Proceedings of 14th International Conference on Machine Learning, Nashville, TN, 179-186.
22. Ling, C. X., & Li, C. (1998). Data mining for direct marketing: Problems and solutions. Proceedings of 4th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, 73-79.
23. Padmaja, T. M., Dhulipalla, N., Bapi, R. S., & Krishna, P. R. (2007). Unbalanced data classification using extreme outlier elimination and sampling techniques for fraud detection. Proceedings of the 15th International Conference on Advanced Computing and Communication, Guwahati, India, 511-516.
24. Pazzani, M., Merz, C., & Murphy, P. (1994). Reducing misclassification costs. Proceedings of the 11th International Conference of Machine Learning, New Brunswick, NJ, 217-225.
25. Phua, C., Alahakoon, D., & Lee, V. (2004). Minority report in fraud detection: Classification of skewed data. SIGKDD Explorations: Special Issue on Imbalanced Data Sets, 6(1), 50-59.
26. Provost, F., & Domingos, P. (2003). Tree induction for probability-based ranking. Machine Learning, 52(3), 199-215.
27. Provost, F., & Fawcett, T. (2001). Robust classification systems for imprecise environments. Machine Learning, 42(3), 203-231.
28. Quinlan, J. R. (1993). C4.5: Programs for machine learning, San Mateo, CA : Morgan Kaufmann.
29. Sinha, A. P., & May, J. H. (2005). Evaluating and tuning predictive data mining models using receiver operating characteristic curves. Journal of Management Information Systems, 21(3), 249-280.
30. Tang, Y., Zhang, Y.-Q., Chawla, N. V., & Krasser, S. (2009). SVMs modeling for highly imbalanced classification. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 39(1), 281-288.
31. Ting, K. M. (2002). An instance-weighting method to induce cost-sensitive trees. IEEE Transactions on Knowledge and Data Engineering, 14(3), 659-665.
32. Weiss, G. M., & Provost, F. (2003). Learning when training data are costly: The effect of class distribution on tree induction. Journal of Artificial Intelligence Research, 19, 315-354.
33. Weiss, G. M., Zadrozny, B., & Saar-Tsechansky, M. (2010). Guest editorial: Special issue on utility-based data mining. Data Mining and Knowledge Discovery, 17(2), 129-135.
34. Zadrozny, B., & Elkan, C. (2001). Learning and making decisions when costs and probabilities are both unknown. Proceedings of the 7th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, 204-213.
35. Zhang, G., & Berardi, V. L. (1998). An investigation of neural networks in thyroid function diagnosis. Health Care Management Science, 1(1), 29-37.
36. Zhang, J., & Mani, I. (2003). KNN approach to unbalanced data distributions: A case study involving information extraction. Proceedings of the 20th ICML Workshop on Learning from Imbalanced Data Sets, Washington, DC, 42-48.
37. Zhao, H. (2007). A multi-objective genetic programming approach to developing Pareto optimal decision tress. Decision Support Systems, 43(3), 809-826.
38. Zhu, D., Premkumar, G., Zhang, X., & Chu, C.-H. (2001). Data mining for network intrusion detection: A comparison of alternative methods. Decision Sciences, 32(4), 635-660.