A dynamic classifier ensemble selection approach for noise data

Information Sciences

Volumn 180, Issue 18, 2010, Pages 3402-3421

  Xiao, Jin ^a   He, Changzheng ^a   Jiang, Xiaoyi ^b   Liu, Dunhu ^c  

^a SICHUAN UNIVERSITY   (China)

^b UNIVERSITY OF MÜNSTER   (Germany)

^c CHENGDU UNIVERSITY OF INFORMATION TECHNOLOGY   (China)

Author keywords

Dynamic ensemble selection; GMDH; Multiple classifier systems; Noise immunity ability

Indexed keywords

ARTIFICIAL NOISE; ATTRIBUTE NOISE; BIAS VARIANCE DECOMPOSITION; CLASSIFICATION ERRORS; DATA SETS; DYNAMIC CLASSIFIERS; DYNAMIC ENSEMBLE; ENSEMBLE STRATEGIES; GMDH; GROUP METHOD OF DATA HANDLING; MULTIPLE CLASSIFIER SYSTEMS; NOISE DATA; NOISE IMMUNITY; RANDOM SUBSPACES; SELECTION STRATEGIES; STATISTICAL ANALYSIS; STRATEGIC ROLE;

CLASSIFIERS; STATISTICAL METHODS;

DATA HANDLING;

EID: 77958150674     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2010.05.021     Document Type: Article

References (65)

1. R. Banfield, L. Hall, K. Bowyer, W. Kegelmeyer, A new ensemble diversity measure applied to thinning ensemble, in: T. Windeatt, F. Roli (Eds.), Multiple Classifier Systems, Fourth International Workshop, MCS 2003, Guilford, UK, Lecture Notes in Computer Science, vol. 2709, 2003, pp. 306-316.
2. B. Baruque, E. Corchado, A. Mata, and J.M. Corchado A forecasting solution to the oil spill problem based on a hybrid intelligent system Information Sciences 180 10 2010 2029 2043
3. L. Breiman Bagging predictors Machine Learning 24 2 1996 123 140
4. S.B. Cho Pattern recognition with neural networks combined by genetic algorithm Fuzzy Sets and Systems 103 2 1999 339 347
5. B.V. Dasarathy, and B.V. Sheela A composite classifier system design: concepts and methodology Proceedings of the IEEE 67 5 1978 708 713
6. J. Demsar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30
7. L. Didaci, G. Giacinto, F. Roli, and G.L. Marcialis A study on the performances of dynamic classifier selection based on local accuracy estimation Pattern Recognition 38 11 2005 2188 2191
8. T.G. Dietterich An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization Machine Learning 40 2 2000 139 157
9. P. Domingos, A unified bias-variance decomposition for zero-one and squared loss, in: Proceedings of the 17th National Conference on Artificial Intelligence, 2000, pp. 564-569.
10. D. Fagundes, A. Canuto, Applying weights in the functioning of the dynamic classifier selection method, in: Proceedings of the Ninth Brazilian Symposium on Neural Networks, 2006, pp. 23-27.
11. U.M. Fayyad, K.B. Irani, Multi-interval discretization of continuous-valued attributes for classification learning, in: Proceedings of 13th International Joint Conference on Artificial Intelligence, 1993, pp. 1022-1027.
12. A. Fernández, M.J. del Jesus, and F. Herrera On the 2-tuples based genetic tuning performance for fuzzy rule based classification systems in imbalanced data-sets Information Sciences 180 8 2010 1268 1291
13. M. Friedman The use of ranks to avoid the assumption of normality implicit in the analysis of variance Journal of the American Statistical Association 32 200 1937 675 701
14. M. Friedman A comparison of alternative tests of significance for the problem of m rankings The Annals of Mathematical Statistics 11 1 1940 86 92
15. S. German, E. Bienenstock, and R. Doursat Neural networks and the bias/variance dilemma Neural Computation 4 1 1992 1 58
16. G. Giacinto, and F. Roli Adaptive selection of image classifiers Proceedings of the Ninth ICIAP, Florence Lecture Notes in Computer Science vol. 1310 1997 Springer Berlin 38 45
17. G. Giacinto, and F. Roli Design of effective neural network ensembles for image classification Image and Vision Computing Journal 19 9-10 2001 697 705
18. G. Giacinto, and F. Roli Dynamic classifier selection based on multiple classifier behaviour Pattern Recognition 34 9 2001 1879 1881
19. D.Q. Han, C.Z. Han, Y. Yang, Combination of heterogeneous multiple classifiers based on evidence theory, in: Proceedings of the 2007 International Conference on Wavelet Analysis and Pattern Recognition, Beijing, 2007, pp. 573-578.
20. C.Z. He Self-organising Data Mining and Economic Forecasting 2005 Science Publish Beijing
21. T.K. Ho The random space method for constructing decision forests IEEE Transactions on Pattern Analysis and Machine Intelligence 20 8 1998 832 844
22. R.L. Iman, and J.M. Davenport Approximations of the critical region of the Friedman statistic Communications in Statistics, Part A - Theory Methods 9 6 1980 571 595
23. A.G. Ivakhnenko Heuristic self-organization in problems of engineering cybernetics Automatica 6 2 1970 207 219
24. A.G. Ivakhnenko, and V.S. Stepasko Noise Immunity for Modeling 1985 Naukova dumka Kiev
25. A.H.R. Ko, R. Sabourin, and A. de Souza Britto Jr. From dynamic classifier selection to dynamic ensemble selection Pattern Recognition 41 5 2008 1718 1731
26. R. Kohavi, and D.H. Wolpert Bias plus variance decomposition for zero-one loss functions Proceedings of ICML-96, Bari, Italy 1996 Morgan Kaufman San Mateo, CA 275 283
27. X. Kong, Q. Wei, and G. Chen An approach to discovering multi-temporal patterns and its application to financial databases Information Sciences 180 6 2010 873 885
28. L. Kuncheva, and C. Whitaker Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy Machine Learning 51 2 2003 181 207
29. L.I. Kuncheva, Clustering-and-selection model for classifier combination, in: Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies, Brighton, UK, 2000, pp. 185-188.
30. L.I. Kuncheva Switching between selection and fusion in combining classifiers: an experiment IEEE Transactions on Systems, Man and Cybernetics - Part B 32 2 2002 146 156
31. A. Lipnickas, J. Korbicz, Adaptive selection of neural networks for a committee decision, in: IEEE International Workshop on Intelligent Data Acquisition and Advanced Computing System: Technology and Applications, 2003, pp. 109-114.
32. R. Liu, and B. Yuan Multiple classifier combination by clustering and selection Information Fusion 2 2001 163 168
33. H.R. Madala, and A.G. Ivakhnenko Inductive Learning Algorithms for Complex Systems Modeling 1994 CRC Press Boca Raton, FL
34. R. Mallipeddi, S. Mallipeddi, and P.N. Suganthan Ensemble strategies with adaptive evolutionary programming Information Sciences 180 9 2010 1571 1581
35. M. Mannino, Y.J. Yang, and Y. Ryu Classification algorithm sensitivity to training data with non representative attribute noise Decision Support Systems 46 3 2009 743 751
36. M. Mehrara, A. Moeini, M. Ahrari, and A. Erfanifard Investigating the efficiency in oil futures market based on GMDH approach Expert Systems with Applications 36 4 2009 7479 7483
37. P. Melville, R. Mooney, Constructing diverse classifier ensembles using artificial training examples, in: Proceedings of 18th International Joint Conference on Artificial Intelligence, Acapulco, Mexico, 2003, pp. 505-510.
38. P. Melville, N. Shah, L. Mihalkova, and R.J. Mooney Experiments on ensembles with missing and noisy data Proceedings of Fifth International Workshop on Multiple Classifier Systems (MCS-2004), Cagliari, Italy, June LNCS vol. 3077 2004 Springer Verlag 293 302
39. J.A. Muller, and F. Lemke Self-Organising Data Mining: An Intelligent Approach to Extract Knowledge from Data 2000 Libri Hamburg
40. P.B. Nemenyi, Distribution-free multiple comparisons, Ph.D. Thesis, Princeton University, New Jersey, 1963.
41. D. Opitz Feature selection for ensembles Proceedings of 16th National Conference on Artificial Intelligence 1999 AAAI Press 379 384
42. R. Pasti, and L.N. de Castro Bio-inspired and gradient-based algorithms to train MLPs: the influence of diversity Information Sciences 179 10 2009 1441 1453
43. C. Perlich, F. Provost, and J. Simonoff Tree induction vs. logistic regression: a learning-curve analysis Journal of Machine Learning Research 4 2 2003 211 255
44. J. Perols, K. Chari, and M. Agrawal Information market-based decision fusion Management Science 55 5 2009 827 842
45. A. Reid, and M. Catterall Invisible data quality issues in a CRM implementation Journal of Database Marketing and Customer Strategy Management 12 4 2005 305 314
46. L. Rokach Collective-agreement-based pruning of ensembles Computational Statistics and Data Analysis 53 4 2009 1015 1026
47. A. Santana, R.G.F. Soares, A.M.P. Canuto, M.C.P. Souto, A dynamic classifier selection method to build ensembles using accuracy and diversity, in: Proceedings of the Ninth Brazilian Symposium on Neural Networks (SBRN), 2006, pp. 36-41.
48. E.M.D. Santos, R. Sabourin, P. Maupin, Ambiguity-guided dynamic selection of ensemble of classifiers, in: Proceedings of International Conference on Information Fusion, 2007.
49. E.M.D. Santos, R. Sabourin, and P. Maupin A dynamic overproduce-and- choose strategy for the selection of classifier ensembles Pattern Recognition 41 10 2008 2993 3009
50. D. Sheskin Handbook of Parametric and Nonparametric Statistical Procedures third ed. 2004 CRC Press Boca Raton, FL
51. S. Singh, and M. Singh A dynamic classifier selection and combination approach to image region labelling Signal Processing Image Communication 20 3 2005 219 231
52. A. Tsymbal, S. Puuronen, and D.W. Patterson Ensemble feature selection with the simple Bayesian classification Information Fusion 4 2 2003 87 100
53. A. Ulas, M. Semerci, O.T. Yildiz, and E. Alpaydin Incremental construction of classifier and discriminant ensembles Information Sciences 179 9 2009 1298 1318
54. G. Valentini An experimental bias-variance analysis of SVM ensembles based on resampling techniques IEEE Transactions on System, Man and Cybernetics - Part B 35 6 2005 1252 1271
55. A. Verikasa, A. Lipnickas, and K. Malmqvista Soft combination of neural classifiers: a comparative study Pattern Recognition Letters 20 4 1999 429 444
56. D. West, and S. Dellana Diversity of ability and cognitive style for group decision processes Information Sciences 179 5 2009 542 558
57. F. Wilcoxon Individual comparisons by ranking methods Biometrics 1 6 1945 80 83
58. T. Windeatt Diversity measures for multiple classifier system analysis and design Information Fusion 6 1 2005 21 36 (special issue on Diversity in Multiple Classifier Systems)
59. K. Woods, W.P. Kegelmeyer, and K. Bowyer Combination of multiple classifiers using local accuracy estimates IEEE Transactions on Pattern Analysis and Machine Intelligence 19 4 1997 405 410
60. X.F. Wu, Z.X. Chen, Recognition of Exon/Intron boundaries using dynamic ensembles, in: Proceedings of the Computational Systems Bioinformatics Conference (CSB), 2004, pp. 485-486.
61. J. Xiao, C.Z. He, and X.Y. Jiang Structure identification of Bayesian classifiers based on GMDH Knowledge-Based Systems 22 6 2009 461 470
62. G. Yang, Y. Lin, and P. Bhattacharya A driver fatigue recognition model based on information fusion and dynamic Bayesian network Information Sciences 180 10 2010 1942 1954
63. S. Yue, J.S. Wang, T. Wu, and H. Wang A new separation measure for improving the effectiveness of validity indices Information Sciences 180 5 2010 748 764
64. Z.H. Zhou, J. Wu, and W. Tang Ensembling neural networks: many could be better than all Artificial Intelligence 137 1-2 2002 239 263
65. X.Q. Zhu, and X.D. Wu Class noise vs. attribute noise: a quantitative study of their impacts Artificial Intelligence Review 22 3 2004 177 210