Noise Reduction A Priori Synthetic Over-Sampling for class imbalanced data sets

Information Sciences

Volumn 408, Issue , 2017, Pages 146-161

  Rivera, William A ^a  

^a UNIVERSITY OF CENTRAL FLORIDA   (United States)

Author keywords

Class imbalance; Classification; NRAS; OUPS; SMOTE

Indexed keywords

CLASSIFICATION (OF INFORMATION); VIRTUAL REALITY;

CLASS IMBALANCE; CLASS IMBALANCE PROBLEMS; CLASS IMBALANCED DATA SETS; GROUP MEMBERSHIPS; NRAS; OUPS; SELECTIVE SAMPLING; SMOTE;

NOISE ABATEMENT;

EID: 85018316823     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2017.04.046     Document Type: Article

References (37)

1. [1] Baldi, P., Brunak, S., Chauvin, Y., Assessing the accuracy of prediction algorithms for classification: an overview. Bioinformatics 16:5 (2000), 412–424.
2. [2] Batista, G.E., Prati, R.C., Monard, M.C., A study of the behavior of several methods for balancing machine learning training data. ACM SIGKDD Explorations Newsl., 6(1), 2004, 20, 10.1145/1007730.1007735.
3. [3] Bunkhumpornpat, C., Sinapiromsaran, K., Lursinsap, C., Safe-Level-SMOTE: Safe-Level-Synthetic Minority Over-Sampling TEchnique. Adv. Knowl. Discov. Data Min., 2009, 475–482.
4. [4] Chawla, N.V., Bowyer, K.W., Hall, L.O., Philip, W., SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16 (2002), 321–357.
5. [5] D'Agostino, R.B., Tutorial in biostatistics: propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Stat. Med. 2281 (1998), 2265–2281.
6. [6] Demšar, J., Demšar, J., Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7 (2006), 1–30, 10.1016/j.jecp.2010.03.005.
7. [7] Domingos, P., Metacost: a general method for making classifiers cost-sensitive. Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1999.
8. [8] Estabrooks, A., Jo, T., Japkowicz, N., A multiple resampling method for learning from imbalanced data sets. Comput. Intell. 20:1 (2004), 18–36, 10.1111/j.0824-7935.2004.t01-1-00228.x.
9. [9] Fernández, A., García, S., Herrera, F., Addressing the classification with imbalanced data: open problems and new challenges on class distribution. Hybrid Artif. Intell. Syst., 2011, 1–10.
10. [10] Fu, J., Lee, S., Certainty-based active learning for sampling imbalanced datasets. Neurocomputing 119 (2013), 350–358, 10.1016/j.neucom.2013.03.023.
11. [11] García, S., Fernández, A., Luengo, J., Herrera, F., Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power. Inf. Sci. 180:10 (2010), 2044–2064, 10.1016/j.ins.2009.12.010.
12. [12] García, V., Sánchez, J., Mollineda, R.A., On the effectiveness of preprocessing methods when dealing with different levels of class imbalance. Knowl. Based Syst. 25:1 (2012), 13–21, 10.1016/j.knosys.2011.06.013.
13. [13] Guo, H., Viktor, H.L., Learning from imbalanced data sets with boosting and data generation: the DataBoost-IM approach. ACM SIGKDD Explorations Newsl. 6:1 (2004), 30–39.
14. [14] Guo, X., Yin, Y., Dong, C., Yang, G., Zhou, G., On the class imbalance problem. 2008 Fourth International Conference on Natural Computation, 2008, 192–201, 10.1109/ICNC.2008.871.
15. [15] Han, H., Wang, W.-y., Mao, B.-h., Borderline-SMOTE: a New Over-Sampling Method. Advances in Intelligent Computing, 2005, 878–887.
16. [16] Haro-garcia, A.D., Garcia-Perajas, N., A scalable method for instance selection for class-imbalance datasets. Intelligent Systems Design and Applications (ISDA), 2011, 1383–1390.
17. [17] He, H., Garcia, E.A., Learning from imbalanced data. IEEE Trans. Knowl. Data Eng. 21:9 (2009), 1263–1284, 10.1109/TKDE.2008.239.
18. [18] Japkowicz, N., Learning from imbalanced data sets: a comparison of various strategies. AAAI Workshop on Learning From Imbalanced Data Sets, 2000, 0–5.
19. [19] Junfei, C., Qingfeng, W., Huailin, D., An empirical study on ensemble selection for class-imbalance data sets. 2010 5th International Conference on Computer Science & Education, 2010, 477–480, 10.1109/ICCSE.2010.5593573.
20. [20] Liu, X.-y., Zhou, Z.-h., The influence of class imbalance on cost-sensitive learning: an empirical study. Sixth International Conference on Data Mining (ICDM’06), 2006, 970–974, 10.1109/ICDM.2006.158.
21. [21] López, V., Fernández, A., García, S., Palade, V., Herrera, F., An insight into classification with imbalanced data: empirical results and current trends on using data intrinsic characteristics. Inf. Sci. 250 (2013), 113–141, 10.1016/j.ins.2013.07.007.
22. [22] López, V., Fernández, A., Herrera, F., On the importance of the validation technique for classification with imbalanced datasets: addressing covariate shift when data is skewed. Inf. Sci. 257 (2014), 1–13, 10.1016/j.ins.2013.09.038.
23. [23] MacIejewski, T., Stefanowski, J., Local neighbourhood extension of SMOTE for mining imbalanced data. IEEE SSCI 2011: Symposium Series on Computational Intelligence - CIDM 2011: 2011 IEEE Symposium on Computational Intelligence and Data Mining, 2011, 104–111, 10.1109/CIDM.2011.5949434.
24. [24] Prati, R., Batista, G., Monard, M., Learning with class skews and small disjuncts. Advances in Artificial Intelligence SBIA 2004, 2004, 296–306.
25. [25] Raeder, T., Forman, G., Chawla, N.V., Learning from imbalanced data: evaluation matters. Data Mining: Foundations and Intelligent Paradigms, 2012, Springer Berlin Heidelberg, 315–331.
26. [26] Rivera, W.A., Asparouhov, O., Safe Level OUPS for improving target concept learning in imbalanced data sets. IEEE SoutheastCon 2015, 2015.
27. [27] Rivera, W.A., Goel, A., Kincaid, J.P., OUPS: a combined approach using SMOTE and propensity score matching. Proceedings of the 2014 13th International Conference on Machine Learning and Applications, 1, 2014, 424–427, 10.1109/ICMLA.2014.106.
28. [28] Sáez, J.a., Luengo, J., Stefanowski, J., Herrera, F., SMOTEIPF: addressing the noisy and borderline examples problem in imbalanced classification by a re-sampling method with filtering. Inf. Sci. 291 (2015), 184–203, 10.1016/j.ins.2014.08.051.
29. [29] Sun, Y., Kamel, M.S., Wang, Y., Boosting for learning multiple classes with imbalances class distribution. Proceedings - IEEE International Conference on Data Mining, ICDM, 2006, 592–602, 10.1109/ICDM.2006.29.
30. [30] Thanathamathee, P., Lursinsap, C., Handling imbalanced data sets with synthetic boundary data generation using bootstrap re-sampling and AdaBoost techniques. Pattern Recognit. Lett. 34:12 (2013), 1339–1347, 10.1016/j.patrec.2013.04.019.
31. [31] Tian, J., Gu, H., Liu, W., Imbalanced classification using support vector machine ensemble. Neural Comput. Appl. 20:2 (2010), 203–209, 10.1007/s00521-010-0349-9.
32. [32] Vorraboot, P., Rasmequan, S., Chinnasarn, K., Lursinsap, C., Improving classification rate constrained to imbalanced data between overlapped and non-overlapped regions by hybrid algorithms. Neurocomputing 152 (2015), 429–443, 10.1016/j.neucom.2014.10.007.
33. [33] Weiss, G.M., Data mining and knowledge discovery handbook. Data Mining and Knowledge Discovery Handbook 1 (2010), 747–757, 10.1007/978-0-387-09823-4.
34. [34] Weiss, G.M., The impact of small disjuncts on classifier learning. Stahlbock, R., Crone, S.F., Lessmann, S., (eds.) Data Mining Annals of Information Systems, 8, 2010, Springer US, Boston, MA, 193–226, 10.1007/978-1-4419-1280-0.
35. [35] Yin, L., Ge, Y., Xiao, K., Wang, X., Quan, X., Feature selection for high-dimensional imbalanced data. Neurocomputing 105 (2013), 3–11, 10.1016/j.neucom.2012.04.039.
36. [36] Zadrozny, B., Elkan, C., Learning and making decisions when costs and probabilities are both unknown. Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD '01, 2001, 204–213, 10.1145/502512.502540.
37. [37] Zhang, Y.-P., Zhang, L.-N., Wang, Y.-C., Cluster-based majority under-sampling approaches for class imbalance learning. 2010 2nd IEEE International Conference on Information and Financial Engineering, 2010, 400–404, 10.1109/ICIFE.2010.5609385.