Investigation on diversity in homogeneous and heterogeneous ensembles

IEEE International Conference on Neural Networks - Conference Proceedings

Volumn , Issue , 2006, Pages 3078-3085

  Bian, Shun ^b   Wang, Wenjia ^a,b  

^a IEEE

^b UNIVERSITY OF EAST ANGLIA   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL EFFICIENCY; DATA REDUCTION; MATHEMATICAL MODELS; PROBLEM SOLVING;

HETEROGENEOUS ENSEMBLES; PERFORMANCE GAIN;

LEARNING ALGORITHMS;

EID: 40649112662     PISSN: 10987576     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. R. P. Duin, "Experiments with classifier combining rules," MCS2000, no. LNCS 1857, 2000.
2. L. I. Kuncheva, Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy. Netherlands: Kluwer Academic Publishers, 2003.
3. M. Skurichina, L. I. Kuncheva, and R. P. Duin, "Bagging and boosting for the nearest mean classifier: Effects of sample size on diversity and accuracy," Lecture Notes in Computer Science, vol. 2364, 2002.
4. G. I. Webb and Z. Zheng, "Multistrategy ensemble learning: Reducing error by combining ensemble learning techniques," IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, vol. 16, no. 8, August 2004.
5. L. I. Kuncheva, "That elusive diversity in classifier ensembles," Lecture Note of Computer Science, vol. 2652, pp. 1126-1138, 2003.
6. W. Wang, P. Jones, and D. Partridge, "Diversity between neural networks and decision trees for building multiple classifier systems journal = Lecture Notes In Computer Science, year = 2000, volume = 1857, pages = 240-249,."
7. G. I. Webb, "Multiboosting: A technique for combining boosting and wagging," Machine Learning, vol. 40.
8. J. D. Wichard, M. Christian, and M. Ogorzalek, "Building ensembles with heterogeneous models," Lecture Notes in Computer Science: Pmceedings of the 7th Course of the International School on Neural Nets IIASS, Salerno, Italy, September 2002.
9. G. Tsoumakas, I. Katakis, and I. Vlahavas, "Effective voting of heterogeneous classifiers," In Proceedings of the 15th European Conference on Machine Learning, 2004.
10. G. Tsoumakas, L. Angelis, and I. Vlahavas, "Selective fusion of heterogeneous classifiers," Intelligent Data Analysis - to appear, vol. 9, no. 6, 2005.
11. S. Diplaris, G. Tsoumakas, P. Mitkas, and I. Vlahavas, "Protein classification with multiple algorithms," In Pmceedings of the 10th Panhellenic Conference on Informatics, PCI2005, 2005.
12. A. Krogh and J. Vedelsby, "Neural network ensembles, cross validation, and active learning," Advances in Neural Information Processing Systems, vol. 7, pp. 231-238, 1995.
13. N. Ueda and R. Nakano, "Generalization error of ensemble estimators," Proceedings of International Conference on Neural Networks, pp. 90-95, 1996.
14. L. Hansen and Salamon, "Neural network ensembles," IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 993-1001, 12 1990.
15. K. Turner and J. Ghosh, "Error correlation and error reduction in ensemble classifiers," Connection Science, vol. 8, no. 34, pp. 385-404, 12 1996.
16. G. Brown, J. Wyatt, R. Harris, and X. Yao, "Diversity creation methods: A survey and categorisation," Information Fusion, vol. 6, no. 1, pp. 5-20, 2005.
17. A. Chandra and X. Yao, "Ensemble learning using multi-objective evolutionary algorithms," Journal of Mathematical Modelling and Algorithms (Springer), 2005.
18. G. I. Webb and Z. Zheng, "Multistrategy ensemble learning: Reducing error by combining ensemble learning techniques," IEEE Transactions on Knowkedge and Data Engineering, vol. 16, no. 8, August 2004.
19. A. Narasimhamurthy, "Evaluation of diversity measrues for binary classifier ensembles," Multiple Classifier System 2005, LNCS, vol. 3541, pp. 267-277, 2005.
20. W. Krzanowski and P. D., Software Diversity: Practical Statistics for its Measurement and Exploitation. Prince of Wales Road, Exeter, EX4 4PT: Department of Computer Science, University of Exeter, 1996.
21. W. Wang, P. Johnes, and D. Partridge, "A comparative study of feature-salience ranking techniques," Neural Computation, The MIT Press, vol. 13, pp. 1603-1623, 2001.
22. P. Melville and R. Mooney, "Constructing diverse classifier ensembles using artificial training examples," Proc.Inter. Joint Conference on Aritificial Intelligence, 2003.
23. M. A. Hall, "Correlation-based feature selection machine learning," Ph.D. dissertation, Department of Computer Science University of Waikato, New Zealand., 1998.
24. R. Dechter and J. Pearl, "Generalized best-first search strategies and the optimality of a*," Journal of the ACM (JACM).
25. L. Breiman, "Random forests - random features," Statistics Department, University of California, Berkeley, Tech. Rep., September 1999.
26. J. C. Piatt, "Using analytic qp and sparseness to speed training of support vector machines," Neural Information Processing Systems 11, 1998.
27. D. Aha, D. Kibler, and M. Albert, "Instance-based learning algorithms," Machine Learning, vol. 6, pp. 37-36, 1991.
28. I. Witten and E. Frank, "Generating accurate rule sets without global optimization," Pmc. of the 15th International Conference on Machine Learning, 1998.
29. R. Kohavi, "The power of decision tables," Pmc. of 8th Eumpean Conference on Machine Learning, Heraclion, ECML-95, Crete, Greece, April 1995.
30. D. H. Wolpert, "Stacked generalization, neural networks," Neural Networks, vol. 5, pp. 241-259, 1992.
31. A. K. Seewald, "How to make stacking better and faster while also taking care of an unknown weakness." Proceedings of the Nineteenth International Conference (ICML 2002), pp. 554-561, 2002.
32. E. Frank, "Weka on http://www.cs.waikato.ac.nz/ml/weka," University of Waikato, 2003.
33. D. Newman, S. Hettich, C Blake, and C Merz, "UCI repository of machine learning databases," University of California, Irvine, Dept. of Information and Computer Sciences, 1998.