Parameter-free classification in multi-class imbalanced data sets

Data and Knowledge Engineering

Volumn 87, Issue , 2013, Pages 109-129

  Cerf, Loïc ^a   Gay, Dominique ^b   Selmaoui Folcher, Nazha ^c   Crémilleux, Bruno ^d   Boulicaut, Jean François ^e  

^a FEDERAL UNIVERSITY OF MINAS GERAIS   (Brazil)

^b ORANGE LABS   (France)

^c UNIVERSITÉ DE LA NOUVELLE CALÉDONIE   (New Caledonia)

^d UNIVERSITÉ DE CAEN   (France)

^e UNIVERSITÉ DE LYON   (France)

Author keywords

Association rules; Classification; Imbalanced data set; Multi class context; One Versus Each framework

Indexed keywords

ASSOCIATION RULES;

BENCHMARK DATA; CLASSIFICATION BASED ON ASSOCIATION RULES; CLASSIFICATION RULES; IMBALANCED DATA-SETS; MULTI-CLASS CONTEXT; MULTI-CLASS IMBALANCED DATUM; ONE VS ALLS; ONE-VERSUS-EACH FRAMEWORK;

CLASSIFICATION (OF INFORMATION);

EID: 84884974416     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2013.06.001     Document Type: Article

References (61)

1. R. Agrawal, T. Imielinski, and A.N. Swami Mining association rules between sets of items in large databases Proceedings SIGMOD'93 1993 ACM Press 207 216
2. B. Liu, W. Hsu, and Y. Ma Integrating classification and association rule mining Proceedings KDD'98 1998 AAAI Press 80 86
3. W. Li, J. Han, and J. Pei CMAR: accurate and efficient classification based on multiple class-association rules Proceedings ICDM'01 2001 IEEE Computer Society 369 376
4. B. Crémilleux, and J.-F. Boulicaut Simplest rules characterizing classes generated by delta-free sets Proceedings ES'02 2002 Springer 33 46
5. M.-L. Antonie, and O.R. Zaïane An associative classifier based on positive and negative rules Proceedings DMKD'04 2004 ACM Press 64 69
6. E. Baralis, and S. Chiusano Essential classification rule sets ACM Transactions on Database Systems 29 4 2004 635 674
7. N.V. Chawla, N. Japkowicz, and A. Kotcz Editorial: special issue on learning from imbalanced data sets ACM SIGKDD Explorations 6 1 2004 1 6
8. G.I. Webb Discovering significant rules Proceedings KDD'06 2006 ACM Press 434 443
9. F. Verhein, and S. Chawla Using significant positively associated and relatively class correlated rules for associative classification of imbalanced datasets Proceedings ICDM'07 2007 IEEE Computer Society 679 684
10. B. Arunasalam, and S. Chawla CCCS: a top-down associative classifier for imbalanced class distribution Proceedings KDD'06 2006 ACM Press 517 522
11. G. Dong, and J. Li Efficient mining of emerging patterns: discovering trends and differences Proceedings KDD'99 1999 ACM Press 43 52
12. K. Ramamohanarao, and H. Fan Patterns based classifiers World Wide Web 10 1 2007 71 83
13. P.K. Novak, N. Lavrac, and G.I. Webb Supervised descriptive rule discovery: a unifying survey of contrast set, emerging pattern and subgroup mining Journal of Machine Learning Research 10 2009 377 403
14. G. Dong, and J. Bailey Contrast Data Mining: Concepts, Algorithms, and Applications 2012 Chapman & Hall/CRC
15. L. Geng, and H.J. Hamilton Interestingness measures for data mining: a survey ACM Computing Surveys 38 3 2006
16. P.-N. Tan, M. Steinbach, and V. Kumar Introduction to Data Mining 2005 Addison-Wesley
17. R.T. Ng, L.V.S. Lakshmanan, J. Han, and A. Pang Exploratory mining and pruning optimizations of constrained association rules Proceedings SIGMOD'98 1998 ACM Press 13 24
18. G. Grahne, L.V.S. Lakshmanan, and X. Wang Efficient mining of constrained correlated sets Proceedings ICDE'00 2000 IEEE Computer Society 512 521
19. J. Pei, and J. Han Can we push more constraints into frequent pattern mining? Proceedings KDD'00 2000 ACM Press 350 354
20. X. Yin, and J. Han CPAR: classification based on predictive association rules Proceedings SDM'03, SIAM 2003 369 376
21. J. Wang, and G. Karypis On mining instance-centric classification rules IEEE Transactions on Knowledge and Data Engineering 18 11 2006 1497 1511
22. J. Li, G. Dong, K. Ramamohanarao, and L. Wong DeEPs: a new instance-based lazy discovery and classification system Machine Learning 54 2 2004 99 124
23. W.W. Cohen Fast effective rule induction Proceedings ICML'95 1995 Morgan Kaufmann 115 123
24. F. Coenen The LUCS-KDD software, library http://www.csc.liv.ac.uk/#frans/ KDD/Software/ 2004
25. J. Alcalá-Fdez, L. Sánchez, S. García, M. del Jesus, S. Ventura, J. Garrell, J. Otero, C. Romero, J. Bacardit, V. Rivas, J. Fernández, and F. Herrera KEEL: a software tool to assess evolutionary algorithms for data mining problems Soft Computing - A Fusion of Foundations, Methodologies and Applications 13 3 2009 307 318
26. A. Asuncion, and D. Newman UCI machine learning repository http://archive.ics.uci.edu/ml/ 2007
27. U.M. Fayyad, and K.B. Irani Multi-interval discretization of continous-valued attributes for classification learning Proceedings IJCAI'93 1993 Morgan Kaufmann 1022 1027
28. J. Demsar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30
29. J.R. Quinlan, and R.M. Cameron-Jones FOIL: a midterm report Proceedings ECML'93 1993 Springer 3 20
30. J. Fürnkranz, and G. Widmer Incremental reduced error pruning Proceedings ICML'94 1994 Morgan Kaufmann 70 77
31. V. Jovanoski, and N. Lavrac Classification rule learning with APRIORI-C Proceedings EPIA'01 2001 Springer 44 51
32. M.-L. Antonie, and O.R. Zaïane Text document categorization by term association Proceedings ICDM'02 2002 IEEE Computer Society 19 26
33. R. Agrawal, and R. Srikant Fast algorithms for mining association rules in large databases Proceedings VLDB'94 1994 Morgan Kaufmann 487 499
34. J. Han, J. Pei, and Y. Yin Mining frequent patterns without candidate generation W. Chen, J.F. Naughton, P.A. Bernstein, Proceedings SIGMOD'00 2000 ACM Press 1 12
35. G. Dong, X. Zhang, L. Wong, and J. Li CAEP: classification by aggregating emerging patterns Proceedings DS'99 1999 Springer 30 42
36. J. Li, G. Dong, and K. Ramamohanarao Making use of the most expressive jumping emerging patterns for classification Knowledge and Information Systems 3 2 2001 131 145
37. J. Bailey, T. Manoukian, and K. Ramamohanarao Classification using constrained emerging patterns Proceedings WAIM'03 2003 Springer 226 237
38. H. Fan, and K. Ramamohanarao Fast discovery and the generalization of strong jumping emerging patterns for building compact and accurate classifiers IEEE Transactions on Knowledge and Data Engineering 18 6 2006 721 737
39. S.-H. Park, and J. Fürnkranz Efficient pairwise classification Proceedings ECML'07 2007 Springer 658 665
40. J. Fürnkranz Round robin classification Journal of Machine Learning Research 2 2002 721 747
41. R. Barandela, J.S. Sánchez, V. García, and E. Rangel Strategies for learning in class imbalance problems Pattern Recognition 36 3 2003 849 851
42. N.V. Chawla, K.W. Bowyer, L.O. Hall, and W.P. Kegelmeyer SMOTE: synthetic minority over-sampling technique Journal of Artificial Intelligence Research 16 2002 321 357
43. J.V. Hulse, and T. Khoshgoftaar Knowledge discovery from imbalanced and noisy data Data & Knowledge Engineering 68 12 2009 1513 1542
44. T. Dietterich, D. Margineantu, F. Provost, and P. Turney ICML 2000 Workshop on Cost-sensitive Learning 2000
45. K.M. Ting An instance-weighting method to induce cost-sensitive trees IEEE Transactions on Knowledge and Data Engineering 14 3 2002 659 665
46. B. Zadrozny, J. Langford, and N. Abe Cost-sensitive learning by cost-proportionate example weighting ICDM'03 2003 435 442
47. P. Domingos Metacost: a general method for making classifiers cost-sensitive KDD'99 1999 155 164
48. Y. Sun, M.S. Kamel, A.K.C. Wong, and Y. Wang Cost-sensitive boosting for classification of imbalanced data Pattern Recognition 40 12 2007 3358 3378
49. Z. Qin, C. Zhang, T. Wang, and S. Zhang Cost sensitive classification in data mining ADMA'10 2010 1 11
50. B. Liu, Y. Ma, and C.K. Wong Improving an association rule based classifier PKDD'00 2000 504 509
51. B. Zadrozny, and C. Elkan Learning and making decisions when costs and probabilities are both unknown KDD'01 2001 204 213
52. P. Lenca, S. Lallich, T.-N. Do, and N.-K. Pham A comparison of different off-centered entropies to deal with class imbalance for decision trees PAKDD'08 2008 634 643
53. D.A. Cieslak, T.R. Hoens, N.V. Chawla, and W.P. Kegelmeyer Hellinger distance decision trees are robust and skew-insensitive Data Mining and Knowledge Discovery 24 1 2012 136 158
54. P. Jeatrakul, K.W. Wong, and C.C. Fung Classification of imbalanced data by combining the complementary neural network and smote algorithm K.W. Wong, B.S.U. Mendis, A. Bouzerdoum, ICONIP (2), Vol. 6444 of Lecture Notes in Computer Science 2010 Springer 152 159
55. T. Liu, Y. Liang, and W. Ni A learning strategy for highly imbalanced classification C. Xu, R. Steinmetz, A. El-Saddik, C.-W. Ngo, X. Wu, ICIMCS, ACM International Conference Proceeding Series, ACM 2011 116 119
56. S. Ertekin, and C. Rudin On equivalence relationships between classification and ranking algorithms Journal of Machine Learning Research 12 2011 2905 2929
57. N.V. Chawla, N. Japkowicz, and Z.-H. Zhou PAKDD'09 Workshop: Data Mining When Classes are Imbalanced and Errors Have Costs 2009
58. Y. Sun, A.K.C. Wong, and M.S. Kamel Classification of imbalanced data: a review International Journal of Pattern Recognition and Artificial Intelligence 23 4 2009 687 719
59. S. Zhang, X. Wu, C. Zhang, and J. Lu Computing the minimum-support for mining frequent patterns Knowledge and Information Systems 15 2 2008 233 257
60. F. Coenen, and P.H. Leng The effect of threshold values on association rule based classification accuracy Data & Knowledge Engineering 60 2 2007 345 360
61. N.V. Chawla, D.A. Cieslak, L.O. Hall, and A. Joshi Automatically countering imbalance and its empirical relationship to cost Data Mining and Knowledge Discovery 17 2 2008 225 252