Tackling the problem of classification with noisy data using Multiple Classifier Systems: Analysis of the performance and robustness

Information Sciences

Volumn 247, Issue , 2013, Pages 1-20

  Sáez, José A ^a   Galar, Mikel ^b   Luengo, Julián ^c   Herrera, Francisco ^a  

^a UNIVERSITY OF GRANADA   (Spain)

^b PUBLIC UNIVERSITY OF NAVARRE   (Spain)

^c UNIVERSITY OF BURGOS   (Spain)

Author keywords

Attribute noise; Class noise; Classification; Multiple Classifier System; Noisy data

Indexed keywords

ATTRIBUTE NOISE; CLASS NOISE; CLASSIFICATION ALGORITHM; CLASSIFIER LEARNING; COMBINATION METHOD; INDIVIDUAL CLASSIFIERS; MULTIPLE CLASSIFIER SYSTEMS; NOISY DATA;

ALGORITHMS;

CLASSIFICATION (OF INFORMATION);

EID: 84880920627     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2013.06.002     Document Type: Article

References (54)

1. J. Alcalá-Fdez, A. Fernández, J. Luengo, J. Derrac, S. García, L. Sánchez, and F. Herrera KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework Journal of Multiple-Valued Logic and Soft Computing 17 2011 255 287
2. J. Alcalá-Fdez, L. Sánchez, S. García, M. del Jesus, S. Ventura, J. Garrell, J. Otero, C. Romero, J. Bacardit, V. Rivas, J. Fernández, and F. Herrera KEEL: a software tool to assess evolutionary algorithms for data mining problems Soft Computing-A Fusion of Foundations, Methodologies and Applications 13 2009 307 318
3. C. Catal, O. Alan, and K. Balkan Class noise detection based on software metrics and ROC curves Information Sciences 181 2011 4867 4877
4. W.W. Cohen Fast effective rule induction Proceedings of the Twelfth International Conference on Machine Learning 1995 Morgan Kaufmann Publishers 115 123
5. C. Cortes, and V. Vapnik Support vector networks Machine Learning 20 1995 273 297
6. J. Demšar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30
7. T. Dietterich An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization Machine Learning 40 2000 139 157
8. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification second ed. 2001 John Wiley New York
9. J. Furnkranz Noise-tolerant windowing Journal of Artificial Intelligence Research 8 1997 129 164
10. S. García, A. Fernández, J. Luengo, and F. Herrera Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: experimental analysis of power Information Sciences 180 2010 2044 2064
11. S. García, and F. Herrera An extension on statistical comparisons of classifiers over multiple data sets for all pairwise comparisons Journal of Machine Learning Research 9 2008 2677 2694
12. R.M. Haralick The table look-up rule Communications in Statistics-Theory and Methods A5 1976 1163 1191
13. M.A. Hernández, and S.J. Stolfo Real-world data is dirty: data cleansing and the merge/purge problem Data Mining and Knowledge Discovery 2 1998 9 37
14. T.K. Ho Multiple classifier combination: lessons and next steps A. Kandel, E. Bunke, Hybrid Methods in Pattern Recognition 2002 World Scientific 171 198
15. T.K. Ho, J.J. Hull, and S.N. Srihari Decision combination in multiple classifier systems IEEE Transactions on Pattern Analysis and Machine Intelligence 16 1994 66 75
16. J.L. Hodges, and E.L. Lehmann Ranks methods for combination of independent experiments in analysis of variance Annals of Mathematical Statistics 33 1962 482 497
17. S. Holm A simple sequentially rejective multiple test procedure Scandinavian Journal of Statistics 6 1979 65 70
18. Y.S. Huang, and C.Y. Suen A method of combining multiple experts for the recognition of unconstrained handwritten numerals IEEE Transactions on Pattern Analysis and Machine Intelligence 17 1995 90 93
19. P.J. Huber Robust Statistics 1981 John Wiley and Sons New York
20. T. Khoshgoftaar, J. Van Hulse, and A. Napolitano Comparing boosting and bagging techniques with noisy and imbalanced data IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 41 2011 552 568
21. J. Kittler, M. Hatef, R. Duin, and J. Matas On combining classifiers IEEE Transactions on Pattern Analysis and Machine Intelligence 20 1998 226 239
22. I. Kononenko, and M. Kukar Machine Learning and Data Mining: Introduction to Principles and Algorithms 2007 Horwood Publishing Limited
23. L. Kuncheva Combining Pattern Classifiers: Methods and Algorithms 2004 Wiley
24. L.I. Kuncheva Diversity in multiple classifier systems Information Fusion 6 2005 3 4
25. R. Maclin, D. Opitz, An empirical evaluation of bagging and boosting, in: Proceedings of the Fourteenth National Conference on Artificial Intelligence and Ninth Conference on Innovative Applications of Artificial Intelligence, pp. 546-551.
26. E. Mandler, and J. Schuermann Combining the classification results of independent classifiers based on the Dempster/Shafer theory of evidence E.S. Gelsema, L.N. Kanal, Pattern Recognition and Artificial Intelligence 1988 North-Holland Amsterdam 381 393
27. U. Maulik, and D. Chakraborty A robust multiple classifier system for pixel classification of remote sensing images Fundamenta Informaticae 101 2010 286 304
28. V.D. Mazurov, A.I. Krivonogov, and V.S. Kazantsev Solving of optimization and identification problems by the committee methods Pattern Recognition 20 1987 371 378
29. G.J. McLachlan Discriminant Analysis and Statistical Pattern Recognition 2004 John Wiley and Sons
30. R.K. Nath Fingerprint recognition using multiple classifier system Fractals 15 2007 273 278
31. D. Nettleton, A. Orriols-Puig, and A. Fornells A study of the effect of different types of noise on the precision of supervised learning techniques Artificial Intelligence Review 33 2010 275 306
32. R. Polikar Ensemble based systems in decision making IEEE Circuits and Systems Magazine 6 2006 21 45
33. B. Qian, and K. Rasheed Foreign exchange market prediction with multiple classifiers Journal of Forecasting 29 2010 271 284
34. J.R. Quinlan, Induction of decision trees, in: Machine Learning, pp. 81-106.
35. J.R. Quinlan The effect of noise on concept learning Machine Learning: An Artificial Intelligence Approach 1986 Morgan Kaufmann Publishers 149 166
36. J.R. Quinlan C4.5: Programs for Machine Learning 1993 Morgan Kaufmann Publishers San Francisco, CA, USA
37. C. Seiffert, T.M. Khoshgoftaar, J. Van Hulse, and A. Folleco An empirical study of the classification performance of learners on imbalanced and noisy software quality data Information Sciences 2011 10.1016/j.ins.2010.12.016
38. L. Shapley, and B. Grofman Optimizing group judgmental accuracy in the presence of interdependencies Public Choice 43 1984 329 343
39. C.M. Teng Correcting noisy data Proceedings of the Sixteenth International Conference on Machine Learning 1999 Morgan Kaufmann Publishers San Francisco, CA, USA 239 248
40. C.M. Teng Polishing blemishes: issues in data correction IEEE Intelligent Systems 19 2004 34 39
41. D.M. Titterington, G.D. Murray, L.S. Murray, D.J. Spiegelhalter, A.M. Skene, J.D.F. Habbema, and G.J. Gelpke Comparison of discriminant techniques applied to a complex data set of head injured patients Journal of the Royal Statistical Society, Series A (General) 144 1981 145 175
42. R.Y. Wang, V.C. Storey, and C.P. Firth A framework for analysis of data quality research IEEE Transactions on Knowledge and Data Engineering 7 1995 623 640
43. K.D. Wemecke A coupling procedure for the discrimination of mixed data Biometrics 48 1992 497 506
44. D.R. Wilson, and T.R. Martinez Improved heterogeneous distance functions Journal of Artificial Intelligence Research 6 1997 1 34
45. M. Woźniak, M. Graña, and E. Corchado A survey of multiple classifier systems as hybrid systems Information Fusion 2013 http://dx.doi.org/10.1016/j.inffus.2013.04.006
46. X. Wu Knowledge Acquisition from Databases 1996 Ablex Publishing Corp. Norwood, NJ, USA
47. X. Wu, V. Kumar, J. Ross Quinlan, J. Ghosh, Q. Yang, H. Motoda, G.J. McLachlan, A. Ng, B. Liu, P.S. Yu, Z.H. Zhou, M. Steinbach, D.J. Hand, and D. Steinberg Top 10 algorithms in data mining Knowledge and Information Systems 14 2007 1 37
48. X. Wu, and X. Zhu Mining with noise knowledge: error-aware data mining IEEE Transactions on Systems, Man, and Cybernetics 38 2008 917 932
49. L. Xu, A. Krzyzak, and C.Y. Suen Methods of combining multiple classifiers and their applications to handwriting recognition IEEE Transactions on Systems, Man, and Cybernetics 22 1992 418 435
50. Y. Zhang, and X. Wu Integrating induction and deduction for noisy data mining Information Sciences 180 2010 2663 2673
51. S. Zhong, T.M. Khoshgoftaar, and N. Seliya Analyzing software measurement data with clustering techniques IEEE Intelligent Systems 19 2004 20 27
52. X. Zhu, and X. Wu Class noise vs. attribute noise: a quantitative study Artificial Intelligence Review 22 2004 177 210
53. X. Zhu, X. Wu, Q. Chen, Eliminating class noise in large datasets, in: Proceeding of the Twentieth International Conference on Machine Learning, pp. 920-927.
54. X. Zhu, X. Wu, and Y. Yang Error detection and impact-sensitive instance ranking in noisy datasets Proceedings of the Nineteenth National Conference on Artificial Intelligence 2004 AAAI Press 378 383