Ensemble member selection using multi-objective optimization

2009 IEEE Symposium on Computational Intelligence and Data Mining, CIDM 2009 - Proceedings

Volumn , Issue , 2009, Pages 245-251

  Löfström, Tuve ^a   Johansson, Ulf ^a   Boström, Henrik ^b  

^a UNIVERSITY OF BORÅS   (Sweden)

^b UNIVERSITY OF SKÖVDE   (Sweden)

Author keywords

[No Author keywords available]

Indexed keywords

BASE CLASSIFIERS; CLASSIFICATION ,; DATA SETS; EMPIRICAL STUDIES; ENSEMBLE MEMBERS; HIGHLY-CORRELATED; KEY PROBLEMS; LEARNING TASKS; NOVEL TECHNIQUES; OPTIMIZATION CRITERIA; PREDICTIVE MODELS; RANDOM FORESTS; TEST ACCURACY; TEST SETS;

LEARNING ALGORITHMS; MINING; MULTIOBJECTIVE OPTIMIZATION; NEURAL NETWORKS;

SET THEORY;

EID: 67650434708     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CIDM.2009.4938656     Document Type: Conference Paper

References (22)

1. T. G. Dietterich, Machine learning research: four current directions, The AI Magazine, 18: 97-136, 1997. (Pubitemid 127684659)
2. A. Krogh and J. Vedelsby. Neural network ensembles, cross validation, and active learning. Advances in Neural Information Processing Systems, Volume 2, pp. 650-659, San Mateo, CA, Morgan Kaufmann, 1995.
3. L. I. Kuncheva and C. J. Whitaker, Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy, Machine Learning, (51):181-207, 2003.
4. U. Johansson, T. Löfström and L. Niklasson, The Importance of Diversity in Neural Network Ensembles-An Empirical Investigation, The International Joint Conference on Neural Networks, IEEE Press, Orlando, FL, pp. 661-666, 2007.
5. U. Johansson, T. Löfström and H. Boström, The Problem with Ranking Ensembles Based on Training or Validation Performance, The International Joint Conference on Neural Networks, IEEE Press, Hong Kong, China, pp. 3221-3227, 2008.
6. C. M. Fonseca and P. J. Fleming, An Overview of Evolutionary Algorithms in Multiobjective Optimization, Evolutionary computation, Vol. 3, No. 1: 1-16, 1995.
7. L.I. Kuncheva, Combining Pattern Classifiers: Methods and Algorithms, Wiley-Interscience, 2004.
8. G. Giacinto and F. Roli, Design of Effective Neural Network Ensembles for Image Classification Purposes, Image and Vision Computing, vol. 19: 699-707, 2001.
9. D. D. Margineantu and T. G. Dietterich, Pruning Adaptive Boosting, 14th International Conference on Machine Learning, Morgan Kaufmann Publishers, Nashville, TN, pp. 211-218, 1997.
10. G. Giacinto and F. Roli, An Approach to the Automatic Design of Multiple Classifier Systems, Pattern Recognition Letters, vol. 22: 25- 33, 2001.
11. R. E. Banfield, L. O. Hall, K. W. Bowyer and W. P. Kegelmeyer, A New Ensemble Diversity Measure Applied to Thinning Ensembles, International Workshop on Multiple Classifier Systems, Surrey, UK, pp. 306-316, 2003.
12. U. Johansson, T. Löfström and L. Niklasson, Evaluating Standard Techniques for Implicit Diversity, Advances in Knowledge Discovery and Data Mining-12th Pacific-Asia Conference, PAKDD 2008, Springer Verlag, LNAI 5012: 613-622, 2008.
13. R. Kohavi, and D. H. Wolpert, Bias plus variance decomposition for zero-one loss functions. Machine Learning: Proceedings of the Thirteenth International Conference, 1996
14. L. Hansen and P. Salomon, Neural Network Ensembles, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 12:933-1001, 1990,.
15. G. Brown, J. Wyatt, R. Harris and X. Yao, Diversity Creation Methods: A survey and Categorisation, Journal of Information Fusion, 6(1):5-20, 2005.
16. L. Breiman, Random forests, Machine Learning, 45(1):5-32, 2001.
17. J. R. Quinlan, C4.5: Programs for Machine Learning, Morgan Kaufmann, 1993.
18. L. Breiman, J. H. Friedman, R. A. Olshen and C. J. Stone, Classification and Regression Trees, Wadsworth International Group, 1984.
19. L. Breiman, Bagging predictors, Machine Learning, vol. 24, no. 2, pp. 123-140, 1996
20. Compumine, Rule Discovery System (RDS) 2.6; http://www.compumine.se
21. The Mathworks, Genetic Algorithm and Direct Search Toolbox-MATLAB; http://www.mathworks.com/ products/gads/.
22. A. Asuncion and D.J. Newman, UCI machine learning repository, 2007