Using Bayesian networks for selecting classifiers in GP ensembles

Information Sciences

Volumn 258, Issue , 2014, Pages 200-216

  De Stefano, C ^a   Folino, G ^b   Fontanella, F ^a   Scotto Di Freca, A ^a  

^a UNIVERSITY OF CASSINO AND SOUTHERN LAZIO   (Italy)

^b ICAR CNR   (Italy)

Author keywords

Bayesian Networks; Classifier ensemble; Evolutionary computation; Genetic programming

Indexed keywords

CLASSIFICATION ACCURACY; CLASSIFICATION PERFORMANCE; CLASSIFIER ENSEMBLES; ENSEMBLE TECHNIQUES; G-P ALGORITHMS; GENERALIZATION CAPACITY; SELECTION TECHNIQUES; VOTING STRATEGIES;

DATA MINING; DECISION TREES; EVOLUTIONARY ALGORITHMS; GENETIC PROGRAMMING;

BAYESIAN NETWORKS;

EID: 84889092001     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2013.09.049     Document Type: Article

References (44)

1. The Sloan Digital Sky Survey (SDSS). < http://www.sdss.org/ >.
2. Battista Biggio, Giorgio Hall, and Fabio Roli Multiple classifier systems for robust classifier design in adversarial environments International Journal of Machine Learning and Cybernetics 1 1-4 2010
3. R. Agrawal, M. Mehta, J. Shafer, SPRINT: a scalable parallel classifier for data mining, in: Proc. of 22th International Conference on Very Large Data Bases (VLDB), vol. 96, 1996, pp. 544-555.
4. R. Banfield, L. Hall, K. Bowyer, and W. Kegelmeyer Ensembles diversity measures and their application to thinning Information Fusion 6 2005 49 62
5. L. Breiman Bagging predictors Machine Learning 24 2 1996 123 140
6. E. Cantú-Paz, and C. Kamath Inducing oblique decision trees with evolutionary algorithms IEEE Transaction on Evolutionary Computation 7 1 2003 54 68
7. C. Chow, and C. Liu Approximating discrete probability distributions with dependence trees IEEE Transactions on Information Theory 14 3 1968 462 467
8. I. Christou, G. Gekas, and A. Kyrikou A classifier ensemble approach to the tv-viewer profile adaptation problem International Journal of Machine Learning and Cybernetics 3 4 2012 313 326
9. G. Cooper, E. Herskovits, A Bayesian method for constructing Bayesian belief networks from databases, in: Proceedings of the 7th Conference on Uncertainty in Artificial Intelligence, 1991, pp. 86-94.
10. C. De Stefano, C. D'Elia, A. Scotto di Freca, and A. Marcelli Classifier combination by Bayesian networks for handwriting recognition International Journal of Pattern Recognition and Artificial Intelligence 23 5 2009 887 905
11. C. De Stefano, F. Fontanella, C. Marrocco, A. Scotto di Freca, A Hybrid Evolutionary Algorithm for Bayesian Networks Learning: An Application to Classifier Combination, In EvoApplications (1), 2010, pp. 221-230.
12. A. Ekárt, and S.Z. Németh Maintaining the diversity of genetic programs Lecture Notes in Computer Science, EuroGP 2002 2278 2002 162 171
13. G. Folino, C. Pizzuti, and G. Spezzano A cellular genetic programming approach to classification Proc. Of the Genetic and Evolutionary Computation Conference (GECCO 1999) 1999 Morgan Kaufman Orlando, Florida 1015 1020
14. G. Folino, C. Pizzuti, and G. Spezzano GP ensembles for large-scale data classification IEEE Transaction on Evolutionary Computation 10 5 2006 604 616
15. G. Folino, C. Pizzuti, and G. Spezzano Training distributed GP ensemble with a selective algorithm based on clustering and pruning for pattern classification IEEE Transactions on Evolutionary Computation 12 4 2008 458 468
16. Y. Freund, R. Shapire, Experiments with a new boosting algorithm, in: Proceedings of the 13th Int. Conference on Machine Learning, 1996, pp. 148-156.
17. N. Friedman, D. Geiger, and M. Goldszmidt Bayesian network classifiers Machine Learning 29 2-3 1997 131 163
18. C. Gagné, M. Sebag, M. Schoenauer, M. Tomassini, Ensemble learning for free with evolutionary algorithms?, in: Proceedings of the 9th Annual Conference on Genetic and evolutionary computation (GECCO 2007), 2007, pp. 1782-1789.
19. G. Giacinto, and F. Roli An approach to the automatic design of multiple classifier systems Pattern Recognition Letters 22 1 2001 25 33
20. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I.H. Witten The WEKA data mining software: an update SIGKDD Explorations 11 1 2009 10 18
21. D. Heckerman, A Tutorial on Learning with Bayesian Networks, Technical Report, Learning in Graphical Models, 1995.
22. D. Heckerman, D. Geiger, and D.M. Chickering Learning Bayesian networks: the combination of knowledge and statistical data Machine Learning 20 3 1995 197 243
23. D. Hernández-Lobato, J. Hernández-Lobato, R. Ruiz-Torrubiano, and Á. Valle Pruning adaptive boosting ensembles by means of a genetic algorithm Intelligent Data Engineering and Automated Learning - IDEAL 2006 322 329
24. H. Iba Bagging, boosting and bloating in genetic programming Proc. of the Genetic and Evolutionary Computation Conference (GECCO 1999) 1999 Morgan Kaufman Orlando, Florida 1053 1060
25. J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas On combining classifiers IEEE Transactions on Pattern Analysis and Machine Intelligence 20 3 1998 226 239
26. L. Kuncheva, C. Shipp, An investigation into how AdaBoost affects classifier diversity, in: Proc. 9th International Conference on Information Processing and Management of Uncertainty (IPMU02), 2002.
27. L. Kuncheva, M. Skurichina, and R.P.W. Duin An experimental study on diversity for bagging and boosting with linear classifiers Information Fusion 3 4 2002 245 258
28. L.I. Kuncheva Combining Pattern Classifiers: Methods and Algorithms 2004 Wiley-Interscience
29. E.L. Lehmann Nonparametrics: Statistical Methods Based on Ranks 2006 Springer
30. Y. Liu, and X. Yao Simultaneous training of negatively correlated neural networks in an ensemble IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 29 1999 716 725
31. Y. Liu, X. Yao, and T. Higuchi Evolutionary ensembles with negative correlation learning IEEE Transactions on Evolutionary Computation 4 4 2000 380 387
32. D. Margineantu, T. Dietterich, Pruning adaptive boosting, in: Proceedings of the International Conference on Machine Learning, 1997, pp. 211-218.
33. G. Martínez-Muñoz, D. Hernández-Lobato, and A. Suárez An analysis of ensemble pruning techniques based on ordered aggregation IEEE Transactions on Pattern Analysis and Machine Intelligence 31 2 2009 245 259
34. J. Meynet, and J.P. Thiran Information theoretic combination of classifiers with application to AdaBoost M. Haindl, J. Kittler, F. Roli, MCS 2007 Lecture Notes in Computer Science vol. 4472 2007 Springer 171 179
35. J. Pearl Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference 1988 Morgan Kaufman
36. A.L. Prodromidis, and S.J. Stolfo Cost complexity-based pruning of ensemble classifiers Knowledge and Information Systems 3 4 2001 449 469
37. J.R. Quinlan C4.5 Programs for Machine Learning 1993 Morgan Kaufman San Mateo, Calif
38. P. Spirtes, C. Glymour, and R. Schienes Causation Prediction and Search 2001 MIT Press
39. G. Tsoumakas, L. Angelis, and I.P. Vlahavas Selective fusion of heterogeneous classifiers Intelligent Data Analysis 9 6 2005 511 525
40. J.H. Zhai, H.Y. Xu, and X.Z. Wang Dynamic ensemble extreme learning machine based on sample entropy Soft Computing 16 9 2012 1493 1502
41. L. Zhang, X.-H. Ling, J.W. Yang, X.Q. Wang, and F.Z. Li Cascaded cluster ensembles International Journal of Machine Learning and Cybernetics 3 4 2012 335 343
42. Y. Zhang, S. Burer, and W. Street Ensemble pruning via semi-definite programming The Journal of Machine Learning Research 7 2006 1315 1338
43. Z. Zhou, J. Wu, and W. Tang Ensembling neural networks: many could be better than all Artificial intelligence 137 1-2 2002 239 263
44. Z.-H. Zhou, and W. Tang Selective ensemble of decision trees G. Wang, Q. Liu, Y. Yao, A. Skowron, Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing Lecture Notes in Computer Science vol. 2639 2003 Springer Berlin, Heidelberg pp. 589-589