Use of multi-objective genetic algorithms to investigate the diversity/accuracy dilemma in heterogeneous ensembles

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2009, Pages 2339-2346

  De Oliveira, Diogo F ^a   Canuto, Anne M P ^a   De Souto, Marcilio C P ^a  

^a FEDERAL UNIVERSITY OF RIO GRANDE DO NORTE   (Brazil)

Author keywords

[No Author keywords available]

Indexed keywords

BASE CLASSIFIERS; CLASSIFIER ENSEMBLES; EMPIRICAL INVESTIGATION; ENSEMBLE PERFORMANCE; ENSEMBLE SYSTEMS; HOMOGENOUS STRUCTURE; INDIVIDUAL CLASSIFIERS; MULTI-OBJECTIVE GENETIC ALGORITHM;

CLASSIFIERS; MULTIOBJECTIVE OPTIMIZATION; NEURAL NETWORKS;

LEARNING SYSTEMS;

EID: 70449407188     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2009.5178758     Document Type: Conference Paper

References (31)

1. M. Aksela. "Comparison of classifier selection methods for improving committee performance". In Workshop on Multiple Classifier Systems, Lecture Notes in Computer Science 2709, pp. 84-93, 2003.
2. R. E. Banfield, L. O. Hall, K. W. Bowyer and W. P. Kegelmeyer. "A new ensemble diversity measure applied to thinning ensembles". 4th Int Workshop on Multiple Classifier Systems, pp. 306-316, 2003.
3. A. Chandra, A. Evolutionary framework for the creation of diverse hybrid ensembles for better generalization. Master thesis, University of Birmingham, School of Computer Science, 2004.
4. A. Chandra and X. Yao. "Evolutionary Framework for the Construction of Diverse Hybrid Ensembles". 13th European Symposium on Artificial Neural Networks, (pp. 253-258), 2005.
5. K. Deb, A. Pratap, S. Agarwal and T. Meyarivan. "A fast and elitist multiobjective genetic algorithm: NSGA-II". IEEE Transactions on Evolutionary Computation, 6 (2), pp. 182-197, 2002.
6. T. G. Dietterich. "An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization". Mach Learning, 40 (2), pp. 139-157, 2000.
7. E. M. dos Santos, R. Sabourin and P. Maupin. " Single and Multi- Objective Genetic Algorithms for the Selection of Ensemble of Classifiers". International Joint Conference on Neural Networks (IJCNN'06), pp. 3070-307, 2006.
8. L. Hansen and P. Salamon. "Neural network ensembles". IEEE T on Pattern Analysis and Machine Intelligence, 12, pp. 993-1001, 1990.
9. J. H. Holland. Adaptation in Nature and Artificial System. Cambridge: MIT Press, 1992.
10. T. Iba, T and Y. Takefuji. "Adaptation of Neural Agent in Dynamic Environment: Hybrid System of Genetic Algorithm and Neural Network". IEEE Inernational Conference on Knowledge-Based Intelligent Eletronic Systems, pp. 21-23, 1998.
11. M. M. Islam, X. Yao and K. Murase. "A constructive algorithm for training cooperative neural network ensembles". IEEE Transactions on Neural Networks, 14 (4), pp. 820-834, 2003.
12. L. I. Kuncheva. Combing Pattern Classifiers. New Jersey: Wiley, 2004.
13. L. I. Kuncheva and C. J. Whitaker. "Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy". Machine Learning, 51 (2), pp. 181-207, 2003.
14. W. B. Langdon, S. J. Barrett and B. F. Buxton. "Combining decision trees and neural networks for drug discovery". Proc of the 5th European Conference on Genetic Programming, pp. 60-70, 2002.
15. Y. Liu, X. Yao and T. Higuchi. "Evolutionary ensembles with negative correlation learning". IEEE Transactions on Evolutionary Computation, 4 (4), p. 380, 2000.
16. D. F. Oliveira, A. M. Canuto and A. M. Campos. "GNeurAge: An Evolutionary Agent-Based System for Classification Tasks". Sixth International Conference on Hybrid Intelligent Systems, 2006.
17. D. Ruta and B. Gabrys. "Classifier Selection for Majority Voting". Information Fusion, 6, pp. 163-168, 2005.
18. J. Sylvester and N. V. Chawla. "Evolutionary Ensemble Creation and Thinning". International Joint Conference on Neural Networks (IJCNN), pp. 5148-5155, 2006.
19. E. K. Tang, P. N. Suganthan and X. Yao. "An analysis of diversity measures". Machine Learning, 65 (1), pp. 247-271, 2006.
20. A. Tsymbal, M. Pechenizkiy and P. Cunningham. "Diversity in search strategies for ensemble feature selection". Information Fusion, 6 (1), pp. 83-98, 2005.
21. G. Valentino. "An experimental bias-variance analysis of SVM ensembles based on resampling techniques". IEEE Transactions on System, Man and Cybernetics - Part B, 35 (5), pp. 1252-1271, 2005.
22. W. Wang, P. Jones and P. Partridge. "Diversity between neural networks and decision trees for building multiple classifier systems'. In F. Roli, J. Kittler, and T. Windeatt (Eds.), Multiple Classifier Systems (Vol. XII, pp. 240-249). Springer, 2000.
23. W. Wang, D. Partridge and J. Etherington. "Hybrid ensembles and coincident failure diversity". Proceedings of the International Joint Conference on Neural Networks. V.4, pp. 2376-2381, 2001.
24. T. Windeatt. "Diversity measures for multiple classifier system analysis and design". Information Fusion, 6 (1), pp. 21-36, 2005.
25. K. Woods, W. P. Kegelmeyer and K. Bowyer. "Combination of multiple classiers using local accuracy estimates". IEEE Trans on Pattern Analysis and Machine Intelligence, v. 19, pp. 405-410, 1997.
26. L. Xuchun, Y. Zhu and E. Sung. "A New Diversity Augmentation Methodology for Handling Diversity/Accuracy Dilemma in Boosting" Submitted to IEEE Transactions on Neural Networks, 2008.
27. W. Yates and D. Partridge. "Use of methodological diversity to improve neural network generalization". Neural Computing and Applications, 4 (2), pp. 114-128, 1996.
28. W. Zhong, J. Liu, M. Xue and L. Jiao. "A multiagent genetic algorithm for global numerical optimization". IEEE Trans on Systems, Man, and Cybernetics - B, 34 (2), pp. 1128- 1141, 2004.
29. C. Blake and C. Merz, "UCI Machine Learning Repository". Retrieved 07 01, 2009, from http://www.ics.uci.edu/~mlearn/MLRepository.html. 1998.
30. J. J. Durillo, A. J. Nebro, F. Luna, B. Dorronsoro and E. Alba. "JMet al. - A Java Framework for Developing Multi-Objective Optimization Metaheuristics". Technical Report, University of Malaga, 2006.
31. K. Deb, Multi-Objective Optimization using Evolutionay Algorithms, England: John Wiley Sons, 2th Edition, 2002.