To Combat Multi-Class Imbalanced Problems by Means of Over-Sampling Techniques

IEEE Transactions on Knowledge and Data Engineering

Volumn 28, Issue 1, 2016, Pages 238-251

  Abdi, Lida ^a   Hashemi, Sattar ^a  

^a SHIRAZ UNIVERSITY   (Iran)

Author keywords

Mahalanobis distance; Multi class imbalance problems; over sampling techniques

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; SAMPLING;

CLASS IMBALANCE PROBLEMS; COVARIANCE STRUCTURES; DATA ORIENTED TECHNIQUES; MAHALANOBIS DISTANCES; MULTI-CLASS PROBLEMS; OVER SAMPLING; SKEWED DISTRIBUTION; UNDERLYING DISTRIBUTION;

LEARNING ALGORITHMS;

EID: 84961631662     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2015.2458858     Document Type: Conference Paper

References (57)

1. J. Aczél and Z. Daróczy, On Measures of Information and Their Characterizations. New York, NY, USA: Academic, 1975.
2. J. Alcalá, A. Fernández, J. Luengo, J. Derrac, S. García, L. Sánchez, and F. Herrera, "KEEL data-mining software tool: Data set repository, integration of algorithms and experimental analysis framework," J. Multiple-Valued Logic Soft. Comput., vol. 17, pp. 255-287, 2010.
3. G. E. A. P. A. Batista, R. C. Prati, and W. C. Monard, "A study of the behavior of several methods for balancing machine learning training data," ACM Sigkdd Explorations Newslett., vol. 6, no. 1, pp. 20-29, 2004.
4. A. P. Bradley, "The use of the area under the roc curve in the evaluation of machine learning algorithms," Pattern Recognit., vol. 30, no. 7, pp. 1145-1159, 1997.
5. L. Breiman, "Bagging predictors," Mach. Learn., vol. 24, no. 2, pp. 123-140, 1996.
6. C. Bunkhumpornpat, K. Sinapiromsaran, and C. Lursinsap, "Safelevel-smote: Safe-level-synthetic minority over-sampling technique for handling the class imbalanced problem," in Proc. 13th Pacific-Asia Conf. Adv. Knowl. Discovery Data Mining, 2009, pp. 475-482.
7. N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, "SMOTE: Synthetic minority over-sampling technique," J. Artif. Intell. Res., no. 16, pp. 341-378, 2002.
8. N. V. Chawla, N. Japkowicz, and A. Kotcz, "Editorial: Special issue on learning from imbalanced data sets," ACM Sigkdd Explorations Newslett., vol. 6, no. 1, pp. 1-6, 2004.
9. N. V. Chawla, A. Lazarevic, L. O. Hall, and K. W. Bowyer, "SMOTEBoost: Improving prediction of the minority class in boosting," in Proc. 7th Eur. Conf. Principles Practice Knowl. Discovery Databases, 2003, pp. 107-119.
10. S. Chen and H. He, "Sera: Selectively recursive approach towards nonstationary imbalanced stream data mining," in Proc. Int. Joint Conf. Neural Netw., 2009, pp. 522-529.
11. S. Chen and H. He, "Towards incremental learning of nonstationary imbalanced data stream: A multiple selectively recursive approach," Evolving Syst., vol. 2, no. 1, pp. 35-50, 2011.
12. S. Chen, H. He, K. Li, and S. Desai, "Musera: Multiple selectively recursive approach towards imbalanced stream data mining," in Proc. Int. Joint Conf. Neural Netw., 2010, pp. 1-8.
13. D. A. Cieslak, T. R. Hoens, N. V. Chawla, and W. P. Kegelmeyer, "Hellinger distance decision trees are robust and skewinsensitive," Data Mining Knowl. Discovery, vol. 24, no. 1, pp. 136-158, 2012.
14. W. W. Cohen, "Fast effective rule induction in machine learning," in Proc. 12th Int. Conf. Mach. Learn., 1995, pp. 115-123.
15. J. Demmel, I. Dumitriu, and O. Holtz, "Fast linear algebra is stable," Numerische Mathematik, vol. 108, no. 1, pp. 59-91, 2007.
16. J. Demšar, "Statistical comparisons of classifiers over multiple data sets," The J. Mach. Learn. Res., vol. 7, pp. 1-30, 2006.
17. O. J. Dunn, "Multiple comparisons among means," J. Am. Statist. Assoc., vol. 56, no. 293, pp. 52-64, 1961.
18. X. Fan, K. Tang, and T. Weise, "Margin-based over-sampling method for learning from imbalanced datasets," in Proc. 15th Pacific-Asia Conf. Adv. Knowl. Discovery Data Mining, 2011, pp. 309-320.
19. A. Fernández, V. López, M. Galar, M. D. Jesus, and F. Herrera, "Analysing the classification of imbalanced data-sets with multiple classes: Binarization techniques and ad-hoc approaches," Knowl.-Based Syst., vol. 42, pp. 97-110, 2013.
20. F. Fernández-Navarro, C. Hervás-Martínez, and P. Antonio Gutiérrez, "A dynamic over-sampling procedure based on sensitivity for multi-class problems," Pattern Recognit., vol. 44, no. 8, pp. 1821-1833, 2011.
21. A. Frank and A. Asuncion. (2010). UCI machine learning repository [Online]. Available: http://archive.ics.uci.edu/ml
22. Y. Freund and R. E. Schapire, "Experiments with a new boosting algorithm," in Proc. Int. Conf.Mach. Learn., 1996, vol. 96, pp. 148-156.
23. M. Friedman, "The use of ranks to avoid the assumption of normality implicit in the analysis of variance," J. Am. Statist. Assoc., vol. 32, no. 200, pp. 675-701, 1937.
24. V. García, J. S. Sánchez, and R. A. Mollineda, "On the effectiveness of preprocessing methods when dealing with different levels of class imbalance," Knowl.-Based Syst., vol. 25, no. 1, pp. 13-21, 2012.
25. H. Han, W.-Y. Wang, and B.-H. Mao, "Borderline-SMOTE: A new over-sampling method in imbalanced data sets learning," in Proc. Int. Conf. Adv. Intell. Comput., 2005, pp. 878-887.
26. D. J. Hand and R. J. Till, "A simple generalisation of the area under the roc curve for multiple class classification problems," Mach. Learn., vol. 45, no. 2, pp. 171-186, 2001.
27. J. A. Hanley and B. J. McNeil, "The meaning and use of the area under a receiver operating characteristic (roc) curve," Radiology, vol. 143, no. 1, pp. 29-36, 1982.
28. P. E. Hart, "The condensed nearest neighbor rule (corresp.)," IEEE Trans. Inf. Theory, vol. 14, no. 3, pp. 515-516, May 1968.
29. T. Hastie, R. Tibshirani, et al., "Classification by pairwise coupling," The Ann. Statist., vol. 26, no. 2, pp. 451-471, 1998.
30. H. He, Y. Bai, E. A. Garcia, and S. Li, "ADASYN: Adaptive synthetic sampling approach for imbalanced learning," in Proc. IEEE Int. Joint Conf. Neural Netw (IEEE World Congress Comput. Intell)., 2008, pp. 1322-1328.
31. H. He and E. A. Garcia, "Learning from imbalanced data," IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1263-1284, Sep. 2009.
32. R. L. Iman and J. M. Davenport, "Approximations of the critical region of the fbietkan statistic," Commun. Statist.-Theory Methods, vol. 9, no. 6, pp. 571-595, 1980.
33. M. V. Joshi, V. Kumar, and R. C. Agarwal, "Evaluating boosting algorithms to classify rare classes: Comparison and improvements," in Proc. IEEE Int. Conf. DataMining, 2001, pp. 257-264.
34. S. B. Kotsiantis, I. Zaharakis, and P. Pintelas, "Supervised machine learning: A review of classification techniques," pp. 3-24, 2007.
35. M. Kubat, R. Holte, and S. Matwin, "Learning when negative examples abound," in Proc. 9th Eur. Conf. Mach. Learn., 1997, pp. 146-153.
36. M. Kubat, S. Matwin, et al., "Addressing the curse of imbalanced training sets: One-sided selection," in Proc. 14th Int. Conf. Mach. Learn., 1997, vol. 97, pp. 179-186.
37. T. W. Liao, "Classification of weld flaws with imbalanced class data," Expert Syst. Appl., vol. 35, no. 3, pp. 1041-1052, 2008.
38. M. Lin, K. Tang, and X. Yao, "Dynamic sampling approach to training neural networks for multiclass imbalance classification," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 4, pp. 647-660, Apr. 2013.
39. P. C. Mahalanobis, "On the generalized distance in statistics," in Proc. Nat. Instit. Sci., 1936, vol. 2, pp. 49-55.
40. A. Orriols-Puig and E. Bernadó-Mansilla, "Evolutionary rulebased systems for imbalanced data sets," Soft Comput., vol. 13, no. 3, pp. 213-225, 2009.
41. R. C. Prati, G. E. A. P. A. Batista, and M. C. Monard, "Class imbalances versus class overlapping: An analysis of a learning system behavior," in Proc. Adv. Artif. Intell., 2004, pp. 312-321.
42. K. Puntumapon and K. Waiyamai, "A pruning-based approach for searching precise and generalized region for synthetic minority over-sampling," in Proc. 16th Pacific-Asia Conf. Adv. Knowl. Discovery Data Mining, 2012, pp. 371-382.
43. J. R. Quinlan, C4.5: Programs for Machine Learning, vol. 1. San Mateo, CA, USA: Morgan Kaufmann, 1993.
44. R. Rifkin and A. Klautau, "In defense of one-vs-all classification," The J. Mach. Learn. Res., no. 5, pp. 101-141, 2004.
45. C. V. Rijsbergen, Information Retrieval. London, U.K.: Butterworth, 1979.
46. W. A Rivera, A. Goel, and J. P. Kincaid, "Oups: A combined approach using smote and propensity score matching," in Proc. 13th Int. Conf. Mach. Learn. Appl., 2014, pp. 424-427.
47. Y. Sun, M. S. Kamel, and Y. Wang, "Boosting for learning multiple classes with imbalanced class distribution," in Proc. 6th Int. Conf. Data Mining, 2006, pp. 592-602.
48. K. Tang, R. Wang, and T. Chen, "Towards maximizing the area under the ROC Curve for multi-class classification problems," in Proc. 25th AAAI Conf. Artif. Intell., 2011, pp. 483-488.
49. J. Tian, H. Gu, and W. Liu, "Imbalanced classification using support vector machine ensemble," Neural Comput. Appl., vol. 20, no. 2, pp. 203-209, 2011.
50. I. Tomek, "Two modifications of CNN," IEEE Trans. Syst., Man Cybern., vol. 6, no. 11, pp. 769-772, Nov. 1976.
51. B. X. Wang and N. Japkowicz, "Imbalanced data set learning with synthetic samples," in Proc. IRIS Mach. Learn. Workshop, Ottawa, Canada, Jun. 2004.
52. S. Wang and X. Yao, "Multiclass imbalance problems: Analysis and potential solutions," IEEE Trans. Syst., Man Cybern., vol. 42, no. 4, pp. 1119-1130, Aug. 2012.
53. G. M. Weiss and F. Provost, "The Effect of Class Distribution on Classifier Learning: An Empirical Study," Department of Computer Science, Rutgers University, New Jersey, Tech. Rep. ML-TR-44, 2001.
54. D. Wilson, "Asymptotic properties of nearest neighbor rules using edited data," IEEE Trans. Syst., Man Cybern., no. 3, pp. 2:408-421, 1972.
55. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques. San Mateo, CA, USA: Morgan Kaufmann, 2005.
56. X.-M. Zhao, X. Li, L. Chen, and K. Aihara, "Protein classification with imbalanced data," Proteins: Structure, Function Bioinf., vol. 70, no. 4, pp. 1125-1132, 2008.
57. Z.-H. Zhou and X.-Y. Liu, "Training cost-sensitive neural networks with methods addressing the class imbalance problem," IEEE Trans. Knowl. Data Eng., vol. 18, no. 1, pp. 63-77, Jan. 2006.