IIvotes ensemble for imbalanced data

Intelligent Data Analysis

Volumn 16, Issue 5, 2012, Pages 777-801

  Błaszczyński, Jerzy ^a   Deckert, Magdalena ^a   Stefanowski, Jerzy ^a   Wilk, Szymon ^a  

^a POZNAN UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

ensemble classifiers; Imbalanced data; informed re sampling; Ivotes adaptive ensemble; SPIDER method

Indexed keywords

ENSEMBLE CLASSIFIERS; IMBALANCED DATA; IVOTES ADAPTIVE ENSEMBLE; RESAMPLING; SPIDER METHOD;

CLASSIFIERS; FORESTRY;

DECISION TREES;

ADAPTIVE SYSTEMS; CLASSIFICATION; DATA PROCESSING; DECISION THEORY; SAMPLING;

EID: 84868684788     PISSN: 1088467X     EISSN: 15714128     Source Type: Journal    
DOI: 10.3233/IDA-2012-0551     Document Type: Article

References (49)

1. G. Batista, R. Prati and M. Monard, A study of the behaviour of several methods for balancing machine learning training data, ACM SIGKDD Explorations Newsletter 6(1) (2004), 20-29
2. E. Bauer and R. Kohavi, An empirical comparison of voting classification algorithms: Bagging, boosting, and variants, Machine Learning 36(1) (1999), 105-139.
3. J. Błaszczyński, J. Stefanowski and M. Zajac, Ensembles of abstaining classifiers based on rule sets, In Proceedings of the 18th International Symposium on Foundations of Intelligent Systems, ISMIS2009, LNAI 5722 (2009), 382-391.
4. J. Błaszczyński, M. Deckert, J. Stefanowski and Sz. Wilk, Integrating selective pre-processing of imbalanced data with Ivotes ensemble, In Proceedings of 7th International Conference RSCTC 2010 LNAI 6086 (2010), 148-157.
5. L. Breiman, Pasting small votes for classification in large databases and on-line, Machine Learning 36 (1999), 85-103.
6. N. Chawla, K. Bowyer, L. Hall and W. Kegelmeyer, SMOTE: Synthetic minority over-sampling technique, Journal of Artifical Intelligence Research 16 (2002), 341-378.
7. N. Chawla, A. Lazarevic, L. Hall and K. Bowyer, SMOTEBoost: Improving prediction of the minority class in boosting, In Proceedings of the Principles of Knowledge Discovery in Databases, PKDD2003 (2003), 107-119. (Pubitemid 37231089)
8. N. Chawla, Data mining for imbalanced datasets: An overview, Chapter in O. Maimon and L. Rokach eds, The Data Mining and Knowledge Discovery Handbook, Springer-Verlag, 2005, pp. 853-867.
9. P. Clark and T. Niblett, The CN2 induction algorithm, Machine Learning 3(4) (1989), 261-283.
10. C. Cohagan, J. Grzymala-Busse and Z. Hippe, A comparison of three voting methods for bagging with the MLEM2 algorithm, In Proceedings of the Intelligent Data Engineering and Automated Learning, IDEAL 2010, Springer-Verlag (2010), 118-125.
11. P. Domingos and M. Pazzani, On the optimality of the simple Bayesian classifier under zero-one loss, Machine Learning 29(2) (1997), 103-130. (Pubitemid 127510035)
12. S. Cost and S. Salzberg, A weighted nearest neighbour algorithm for learning with symbolic features, Machine Learning Journal 10(1) (1993), 1213-1228.
13. T. Fawcett, Using rule sets to maximize ROC performance, In Proceedings of the IEEE International Conference on Data Mining IEEE Computer Society (2001), 131-138.
14. M. Galar, A. Fernandez, E. Barrenechea, H. Bustince and F. Herrera, A review on ensembles for class imbalance problem: Bagging, boosting and hybrid based approaches, Accepted for publication in IEEE Transactions on Systems, Man, and Cybernetics-Part C, 2011.
15. V. Garcia, J.S. Sanchez and R.A. Mollineda, An empirical study of the behaviour of classifiers on imbalanced and overlapped data sets, In Progress in Pattern Recognition, Image Analysis and Applications LNCS 4756 (2007), 397-406.
16. J.W. Grzymala-Busse, Managing uncertainty in machine learning from examples, In Proceedings of the 3rd International Symposium in Intelligent Systems (1994), 70-94.
17. J.W. Grzymala-Busse, L.K. Goodwin and X. Zheng, An approach to imbalanced data sets based on changing rule strength, Learning from Imbalanced Data Sets, AAAI Workshop at the 17th Conference on AI (2000), 69-74.
18. J.W. Grzymala-Busse and J. Stefanowski, Three approaches to numerical attribute discretization for rule induction, International Journal of Intelligent Systems 16(1) (2001), 29-38. (Pubitemid 32089955)
19. H. Guo and H. Victor, Learning from imbalanced data sets with boosting and data generation: The DataBoost IM approach, ACM SIGKDD Explorations Newsletter 6(1) (2004), 30-39.
20. H. He and E. Garcia, Learning from imbalanced data, IEEE Transactions on Data and Knowledge Engineering 21(9) (2009), 1263-1284.
21. A. Jakulin, I. Bratko, D. Smrke, J. Demsar and B. Zupan, Attribute interactions in medical data analysis, M. Dojat, E. Keravnou and Barahona, eds, Proceedings of the 9th Conference on Artificial Intelligence in Medicine in Europe, AIME 2003 LNCS 2780 (2003), 229-238. (Pubitemid 37342897)
22. N. Japkowicz, Class imbalance: Are we focusing on the right issue? In Proceedings II Workshop on Learning from Imbalanced Data Sets, ICML2003 (2003), 17-23.
23. T. Jo and N. Japkowicz, Class imbalances versus small disjuncts, ACM SIGKDD Explorations Newsletter 6(1) (2004), 40-49.
24. I. Kononenko and M. Kukar, Machine learning and data mining, Horwood Pub, 2007.
25. M.G. Karagiannopoulos, D.S. Anyfantis, S.B. Kotsiantis and E. Pintelas, Local cost sensitive learning for handling imbalanced data sets, In Proceedings of the Mediterranean Conference on Control Automation (2007), 1-6.
26. W. Klement, Sz. Wilk, W. Michalowski and S. Matwin, Classifying severly imbalanced data, In Proceedings of the Canadian AI 2011 Conference, LNAI 6657 (2011), 258-263.
27. M. Kubat and S. Matwin, Addresing the curse of imbalanced training sets: one-side selection, In Proceedings of the 14th International Conference on Machine Learning, ICML1997 (1997), 179-186.
28. L. Kuncheva, Combining pattern classifiers, methods and algorithms, Wiley, 2004.
29. J. Laurikkala, Improving identification of difficult small classes by balancing class distribution, Technical Report A-2001-2, University of Tampere, 2001.
30. M.S. Lee, J.K. Rhee, B.H. Kim and B.T. Zhang, AESNB: Active example selection with Naïve Bayes classifier for learning from imbalanced biomedical data, In Proceedings of the 9th IEEE International Conference on Bioinformatics and BioEngineering (2009), 15-21.
31. R.S. Michalski, I. Mozetic, J. Hong and N. Lavrac, The multi-purpose incremental learning system AQ15 and its testing application in three medical domains, In Proceedings of 5th National Conference on AI, AAAI-Press (1986), 619-625.
32. K. Napierala, J. Stefanowski and Sz. Wilk, Learning from imbalanced data in presence of noisy and borderline examples, In Proceedings of 7th International Conference RSCTC 2010, LNAI 6086 (2010), 158-167.
33. J.R. Quinlan, C4.5: Programs for machine learning, Morgan Kaufmann, 1992.
34. F. Provost, Machine learning from imbalanced data sets 101 extended abstract, Invited paper for the AAAI 2000 Workshop on Imbalanced Data Sets, Technical Report WS-00-05, 2000.
35. R. Prati, G. Batista and M. Monard, Class imbalance versus class overlapping: An analysis of a learning system behaviour, In Proceedings of 3rd Mexican International Conference on Artificial Intelligence (2004), 312-321. (Pubitemid 38716795)
36. I. Rish, An empirical study of the naive Bayes classifier, Proceedings of the IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence (2001), 41-46.
37. U. Rucket and S. Kramer, Towards tight bounds for rule learning, In Proceedings of the 21st International Conference on Machine Learning, ICML2004 (2004), 711-718. (Pubitemid 40290872)
38. R.E. Schapire, The boosting approach to machine learning: An overview, D.D. Denison, M.H. Hansen, C. Holmes, B. Mallick and B. Yu, eds, Nonlinear Estimation and Classification, Springer-Verlag, 2003.
39. J. Stefanowski, The rough set based rule induction technique for classification problems, In Proceedings of the 6th European Conference on Intelligent Techniques and SoftComputing EUFIT-98 (1998), 109-113.
40. J. Stefanowski, Algorithms of rule induction for knowledge discovery (in Polish), Habilitation Thesis published as Series Rozprawy no. 361, Poznan University of Technology Press, (2001), 18-21.
41. J. Stefanowski, Extending rule based classifiers for dealing with imbalanced data, In Proceedings of the AI-METH 2005, Recent Developments in Artificial Intelligence Methods, AI-Meth Series (2005), 203-208.
42. J. Stefanowski, On combined classifiers, rule induction and rough sets, Transactions on Rough Sets 6 (2007), 329-350. (Pubitemid 351256450)
43. J. Stefanowski and S. Wilk, Improving rule based classifiers induced by MODLEM by selective pre-processing of im-balanced data, In Proceedings of the RSKD Workshop at ECML/PKDD (2007), 54-65.
44. J. Stefanowski and Sz. Wilk, Selective pre-processing of imbalanced data for improving classification performance, In Proceedings of 10th International Conference DaWaK 2008, LNCS 5182 (2008), 283-292.
45. J. Stefanowski and Sz. Wilk, Extending rule-based classifiers to improve recognition of imbalanced classes, Z.W. Ras and A. Dardzinska, eds, Advances in Data Management, Studies in Computational Intelligence 223 (2009), 131-154.
46. J. Van Hulse, T. Khoshgoftarr and A. Napolitano, Experimental perspectives on learning from imbalanced data, In Proceedings of the 24th International Conference on Machine Learning (2007), 935-942.
47. B. Wang and N. Japkowicz, Boosting support vector machines for imbalanced data sets, Knowledge and Information Systems 25(1) (2010), 1-20.
48. G.M. Weiss, Mining with rarity: A unifying framework, ACM SIGKDD Explorations Newsletter 6(1) (2004), 7-19.
49. D.R. Wilson and T. Martinez, Reduction techniques for instance-based learning algorithms, Machine Learning Journal 38 (2000), 257-286. (Pubitemid 30572450)