Classifying imbalanced data sets using similarity based hierarchical decomposition

Pattern Recognition

Volumn 48, Issue 5, 2015, Pages 1653-1672

  Beyan, Cigdem ^a   Fisher, Robert ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Class imbalance problem; Clustering; Hierarchical decomposition; Minority majority classes; Outlier detection

Indexed keywords

ANOMALY DETECTION; HIERARCHICAL CLUSTERING; STATISTICS;

ACCURATE PERFORMANCE; CLASS IMBALANCE PROBLEMS; CLASSIFICATION OF DATA; CLASSIFICATION PERFORMANCE; CLUSTERING; HIERARCHICAL DECOMPOSITIONS; MINORITY-MAJORITY CLASSES; STATE-OF-ART METHODS;

CLASSIFICATION (OF INFORMATION);

EID: 84921689324     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.10.032     Document Type: Article

References (72)

1. K.N. Rao, T.V. Rao, D.R. Lakshmi, and A. Novel Class Imbalance learning method using subset filtering Int. J. Sci. Eng. Res. 3 9 2012 1 9
2. M. Galar, A. Fernandez, E. Barrenechea, and F. Herrera EUSBoost: enhancing ensembles for highly imbalanced data-sets by evolutionary undersampling Pattern Recognit. 46 2013 3460 3471
3. V.C. Chawla, K.W. Bowyer, L.O. Hall, and W.P. Kegelmeyer SMOTE: synthetic minority over-sampling technique J. Artif. Intell. Res. 16 2002 321 357
4. S. García, and F. Herrera Evolutionary undersampling for classification with imbalanced datasets: proposals and taxonomy Evol. Comput. 17 2009 275 306
5. Y. Tang, Y.Q. Zhang, N.V. Chawla, and S. Krasser SVMs modeling for highly imbalanced classification IEEE Trans. Syst. Man Cybern. Part B 39 1 2009 281 288
6. B. Das, N.C. Krishnan, and D.J. Cook Handling imbalanced and overlapping classes in smart environments prompting dataset Springer Book on Data Mining for Services in Studies in Computational Intelligence 2012
7. N. Japkowicz, and S. Stephen The class imbalance problem: a systematic study Intell. Data Anal. 6 5 2002 429 449
8. M. Kubat, S. Matwin, Addressing the curse of imbalanced training sets: one-sided selection, in: Proceedings of the 14th International Conference on Machine Learning (ICML'97), 1997, pp. 179-186.
9. R. Batuwita, and V. Palade Adjusted geometric-mean: a novel performance measure for imbalanced bioinformatics dataset learning J. Bioinform. Comput. Biol. 10 4 2012 1 23
10. J. Huang, and C.X. Ling Using AUC and accuracy in evaluating learning algorithms IEEE Trans. Knowl. Data Eng. 17 3 2005 299 310
11. S. Vajda, G.A. Fink, Strategies for training robust neural network based digit recognizers on unbalanced data set, in: Proceedings of the 12th Conference on Frontiers in Handwriting Recognition, 2010, pp. 148-153.
12. G. Wu, E.Y. Chang, Class-boundary alignment for imbalanced dataset learning, in: Proceedings of International Conference on Machine Learning 2003 Workshop on Learning from Imbalanced Data Sets II, Washington, DC, 2003.
13. M. Pazzani, C. Merz, P. Murphy, K. Ali, T. Hume, C. Brunk, Reducing misclassification costs, in: Proceedings of the 11th International Conference on Machine Learning, 1994, pp. 217-225.
14. P. Domingos, Metacost: a general method for making classifiers cost-sensitive, in: Proceedings of the 5th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1999, pp. 155-164.
15. N. Japkowicz, The class imbalance problem: significance and strategies, in: Proceedings of the 2000 International Conference on Artificial Intelligence, Special Track on Inductive Learning, 2000.
16. C. Ling, C. Li, Data mining for direct marketing problems and solutions, in: Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining, 1998.
17. M. Galar, A. Fernandez, E. Barrenechea, H. Bustince, and F. Herrera A review on ensembles for the class imbalance problem: bagging, boosting and hybrid-based approaches IEEE Trans. Syst. Man. Cybern. Part C: Appl. Rev. 42 4 2012 463 484
18. L. Breiman Bagging predictors Mach. Learn. 24 1996 123 140
19. Y. Freund, and R.E. Schapire A decision-theoretic generalization of on-line learning and an application to boosting J. Comput. Syst. Sci. 55 1 1997 119 139
20. N.V. Chawla, A. Lazarevic, L.O. Hall, K.W. Bowyer, Smoteboost: improving prediction of the minority class in boosting, in: Proceedings of the Seventh European Conference on Principles and Practice of Knowledge Discovery in Databases, 2003, pp. 107-119.
21. B. Epshtein, S. Ullman, Feature hierarchies for object classification, in: Proceedings of International Conference on Computer Vision (ICCV), 2005, pp. 220-227.
22. Y. Chen, M.M. Crawford, J. Ghosh, Integrating support vector machines in a hierarchical output space decomposition framework, in: Proceedings of the IEEE International Symposium on Geoscience and Remote Sensing, vol. 2, 2004, pp. 949-952.
23. C. Chen, A. Liaw, and L. Breiman Using random forest to learn imbalanced data (Available at:) Technical Report 666 2004 Statistics Department, University of California Berkeley
24. R.A. Johnson, N.V. Chawla, J.J. Hellman, Species distribution modeling and prediction: a class imbalance problem, in: Proceedings of Intelligent Data Understanding (CIDU), 2012, pp. 9-16.
25. H. Han, W.Y. Wang, and B.H. Mao Borderline-SMOTE: a new over-sampling method in imbalanced data sets learning Adv. Intell. Comput. 2005 878 887
26. S. Hu, Y. Liang, L. Ma, Y. He, MSMOTE: improving classification performance when training data is imbalanced, in: Proceedings of 2nd International Workshop on Computer Science Engineering, vol. 2, 2009, pp. 13-17.
27. S. Barua, M. Islam, X. Yao, and K. Murase MWMOTE-majority weighted minority oversampling technique for imbalanced data set learning IEEE Trans. Knowl. Data Eng. 26 2 2014 405 425
28. P. Radivojac, N.V. Chawla, K. Dunker, and Z. Obradovic Classification and knowledge discovery in protein databases J. Biomed. Inform. 37 4 2004 224 239
29. X.Y. Liu, J. Wu, and Z.H. Zhou Exploratory undersampling for class imbalance learning IEEE Trans. Syst. Man Cybern. Part B 39 2 2009 539 550
30. C. Seiffert, T.M. Khoshgoftaar, J. Hulse, and A. Napolitano RUSBoost: a hybrid approach to alleviating class imbalance IEEE Trans. Syst. Man Cybern. Part A: Syst. Hum. 20 1 2010
31. B.X. Wang, and N. Japkowicz Boosting support vector machines for imbalanced data sets Lect. Notes Artif. Intell. 4994 2008 38 47
32. S. Tan Neighbor-weighted k-nearest neighbor for unbalanced text corpus Expert Syst. Appl. 28 4 2005 667 671
33. G. Fumera, F. Roli, Cost-sensitive learning in support vector machines, in: Proceedings of the Workshop Machine Learning, Methods and Applications, held in the Context of the 8th meeting of the Italian Association of Artificial Intelligence, 2002.
34. C. Drummond, R.C. Holte, Exploiting the cost (in)sensitivity of decision tree splitting criteria, in: Proceedings of the Seventeenth International Conference on Machine Learning (ICML), 2000, pp. 239-246.
35. D.P. Williams, V. Myers, and M.S. Silvious Mine classification with imbalanced data IEEE Geosci. Remote Sens. Lett. 6 3 2009
36. S. Kotsiantis, D. Kanellopoulos, and P. Pintelas Handling unbalanced datasets: a review GESTS Int. Trans. Comput. Sci. Eng. 30 1 2006 25 36
37. R. Longadge, S.S. Dongre, and L. Malik Class imbalance problem in data mining: review Int. J. Comput. Sci. Netw. 2 1 2013
38. V. Lopez, A. Fernandez, S. Garcia, V. Palade, and F. Herrera An insight into classification with imbalanced data: empirical results and current trends on using intrinsic characteristics Inf. Sci. 150 2013 113 141
39. H. He, and E.A. Garcia Learning from imbalanced data IEEE Trans. Knowl. Data Eng. 21 9 2009 1263 1284
40. C.N. Silla, and A.A. Freitas A survey of hierarchical classification across different application domains Data Min. Knowl. Discov. 22 1-2 2010 31 72
41. N. Cesa-Bianchi, C. Gentile, and L. Zaniboni Incremental algorithms for hierarchical classification J. Mach. Learn. Res. 7 2006 31 54
42. F. Wu, J. Zhang, and V. Honavar Learning classifiers using hierarchically structured class taxonomies Proceedings of the Symposium on Abstraction, Reformulation, and Approximation vol. 3607 2005 Springer 313 320
43. T. Li, M. Ogihara, Music genre classification with taxonomy, in: Proceedings of IEEE International Conference on Acoustics Speech and Signal Processing, 2005, pp. 197-200.
44. P.N. Bennett, N. Nguyen, Refined experts: improving classification in large taxonomies, in: Proceedings of the 32nd International ACM SIGIR conference on Research and development in information retrieval, 2009, pp. 11-18.
45. C.N. Silla Jr., and A.A. Freitas Selecting different protein representations and classification algorithms in hierarchical protein function prediction Intell. Data Anal. J. 15 6 2011 979 999
46. S. Kumar, J. Ghosh, and M.M. Crawford Hierarchical fusion of multiple classifiers for hyperspectral data analysis Pattern Anal. Appl. 5 2002 210 220
47. P.Y. Hao, J.H. Chiang, and Y.K. Tu Hierarchically SVM classification based on support vector clustering method and its application to document categorization Expert Syst. Appl. 33 2007 627 635
48. C.O.A. Freitas, L.S. Oliveira, S.B.K. Aires, and F. Bortolozzi Metaclasses and zoning mechanism applied to handwriting recognition J. Univers. Comput. Sci. 14 2 2008 211 223
49. Y. Peng, C. Lin, M. Sun, Audio classification using binary hierarchical classifiers with feature selection for healthcare applications, in: Proceedings of IEEE International Symposium on Circuits and Systems, 2008, pp. 3238-3241.
50. P.X. Huang, B.J. Boom, B.F. Fisher, Underwater live fish recognition using a balanced-guaranteed optimized tree, in: Proceedings of 11th Asian Conference on Computer Vision (ACCV), 2012.
51. C. Freeman, D. Kulic, and O. Basir Joint feature selection and hierarchical classifier design IEEE Int. Conf. Syst. Man Cybern. 2011 1728 1734
52. B.J. Frey, and D. Dueck Clustering by passing messages between data points Science 2007 972 997
53. N. Anjum, and A. Cavallaro Multifeature object trajectory clustering for video analysis IEEE Trans. Circuits Syst. Video Technol. 18 11 2008 1555 1564
54. P. Pudil, J. Novovicova, and J. Kittler Floating search methods in feature selection Pattern Recognit. Lett. 15 11 1994 1119 1125
55. X. He, D. Cai, P. Niyogi, Laplacian score for feature selection, in: Advances in Neural Information Processing Systems, vol. 18, 2005.
56. D. Cai, C. Zhang, X. He, Unsupervised feature selection for multi-cluster data, in: Proceedings of ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2010, pp. 333-342.
57. D. Yao, J. Yang, and Xiaojuan Zhan An improved random forest algorithm for class-imbalanced data classification and its application in pad risk factors analysis Open Electric. Electron. Eng. J. 7 2013 62 70
58. J. Alcalá-Fdez, A. Fernández, J. Luengo, J. Derrac, S. García, L. Sánchez, and F. Herrera KEEL data-mining software tool: dataset repository, integration of algorithms and experimental analysis framework J. Mult.-Valued Logic Soft Comput. 17 2-3 2011 255 287
59. V.G. Sigillito, S.P. Wing, L.V. Hutton, and K.B. Baker Classification of radar returns from the ionosphere using neural networks Johns Hopkins APL Tech. Dig. 10 1989 262 266
60. C.L. Blake., C.J. Merz, UCI repository of machine learning databases, 1998, 〈http://archive.ics.uci.edu/ml/〉 (accessed 28.10.13).
61. Y. Hayashi Neural expert system using fuzzy teaching input and its application to medical diagnosis Inf. Sci. Appl. 1 1994 47 58
62. J.W. Smith, J.E. Everhart, W.C. Dickson, W.C. Knowler, R.S. Johannes, Using the ADAP learning algorithm to forecast the onset of diabetes mellitus, in: Proceedings of the Symposium on Computer Applications and Medical Care, 1988, pp. 261-265.
63. S. Weiss, I. Kapouleas, An empirical comparison of pattern recognition. neural nets and machine learning classification methods, in: Proceedings of the 11th International Joint Conference of Artificial Intelligence, 1989, pp. 781-787.
64. M.R. Boutell, J. Luo, X. Shen, and C.M. Brown Learning multi-label scene classification Pattern Recognit. 37 9 2004 1757 1771
65. M. Kubat, R. Holte, and S. Matwin Machine learning for the detection of oil spills in satellite radar images Mach. Learn. 30 1998 195 215
66. J.R. Quinlan C4.5: Programs for Machine Learning 1993 Morgan Kaufmann Publishers San Francisco, CA, USA
67. L. Breiman, J.H. Friedman, R.A. Olshen, and C.J. Stone Classification and Regression Trees 1984 Wadsworth Belmont CA
68. S. García, and F. Herrera An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons J. Mach. Learn. Res. 9 2008 2677 2694
69. S. Garcia, A. Fernandez, J. Luengo, and F. Herrera Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power Inf. Sci. 180 2010 2044 2064
70. J. Demsar Statistical comparisons of classifiers over multiple datasets J. Mach. Learn. Res. 7 2006 1 30
71. S. Holm A simples equentially rejective multiple test procedure Scand. J. Stat. 6 1979 65 70
72. S. McDonagh, C. Beyan, P.X. Huang, and R.B. Fisher Applying semi-synchronised task farming to large-scale computer vision problems Int. J. High Perform. Comput. Appl. 2014 1 24