Ten measures of diversity in classifier ensembles: Limits for two classifiers

IEE Colloquium (Digest)

Volumn , Issue 50, 2001, Pages 73-82

  Kuncheva, L I ^b   Whitaker, C J ^a  

^a BANGOR UNIVERSITY   (United Kingdom)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; CLASSIFIERS; ERRORS; LEARNING SYSTEMS; MATHEMATICAL MODELS; PROBABILITY; STATISTICAL METHODS;

DATA SETS; TAXONOMY;

CLASSIFICATION (OF INFORMATION);

EID: 6344289532     PISSN: 09633308     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (24)

1. E. Bauer and R. Kohavi. An empirical comparison of voting classification algorithms: Bagging, boosting, and variants. Machine Learning, 36:105-142, 1999.
2. L. Brieman. Combining predictors. In A.J.C. Sharkey, editor, Combining Artificial Neural Nets, pages 31-50. Springer-Verlag, London, 1999.
3. J.L. Fleiss. Statistical Methods for Rates and Proportions. John Wiley & Sons, 1981.
4. G. Giacinto and F. Roli. Design of effective neural network ensembles for image classification processes. Image Vision and Computing Journal, 2000. (to appear).
5. L.K. Hansen and P. Salamon. Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(10):993-1001, 1990.
6. S. Hashem. Treating harmful collinearity in neural network ensembles. In A.J.C. Sharkey, editor, Combining Artificial Neural Nets, pages 101-125. Springer-Verlag, London, 1999.
7. T.K. Ho. The random space method for constructing decision forests. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(8):832-844, 1998.
8. R. Kohavi and D.H. Wolpert. Bias plus variance decomposition for zero-one loss functions. In L. Saitta, editor, Machine Learning: Proc. 13th International Conference, pages 275-283. Morgan Kaufmann, 1996.
9. A. Krogh and J. Vedelsby. Neural network ensembles, cross validation and active learning. In G. Tesauro, D.S. Touretzky, and T.K. Leen, editors, Advances in Neural Information Processing Systems, volume 7, pages 231-238. MIT Press, Cambridge, MA, 1995.
10. L.I. Kuncheva and C.J. Whitaker. Measures of diversity in classifier ensembles. Machine Learning, 2000. (submitted).
11. L.I. Kuncheva, C.J. Whitaker, C.A. Shipp, and R.P.W. Duin. Limits on the majority vote accuracy in classifier fusion, (submitted).
12. L. Lam. Classifier combinations: implementations and theoretical issues. In J. Kittler and F. Roli, editors, Multiple Classifier Systems, volume 1857 of Lecture Notes in Computer Science, pages 78-86, Cagliari, Italy, 2000. Springer.
13. Y. Liu and X. Yao. Ensemble learning via negative correlation. Neural Networks, 12:1399-1404, 1999.
14. S.W. Looney. A statistical technique for comparing the accuracies of several classifiers. Pattern Recognition Letters, 8:5-9, 1988.
15. D. Opitz and J. Shavlik. A genetic algorithm approach for creating neural network ensembles. In A.J.C. Sharkey, editor, Combining Artificial Neural Nets, pages 79-99. Springer-Verlag, London, 1999.
16. D. Partridge and W. Krzanowski. Distinct failure diversity in multiversion software, (personal communication).
17. D. Partridge and W. J. Krzanowski. Software diversity: practical statistics for its measurement and exploitation. Information & Software Technology, 39:707-717, 1997.
18. B.E. Rosen. Ensemble learning using decorrelated neural networks. Connection Science, 8(3/4) :373-383, 1996.
19. A.J.C. Sharkey and N.B. Sharkey. Combining diverse neural nets. The Knowledge Engineering Review, 12(3):231-247, 1997.
20. D.B. Skalak. The sources of increased accuracy for two proposed boosting algorithms. In Proc. American Association for Artificial Intelligence, AAAI-96, Integrating Multiple Learned Models Workshop, 1996.
21. P.H.A. Sneath and R.R. Sokal. Numerical Taxonomy. W.H. Freeman & Co, 1973.
22. K. Turner and J. Ghosh. Error correlation and error reduction in ensemble classifiers. Connection Science, 8(3/4):385-404, 1996.
23. K. Turner and J. Ghosh. Linear and order statistics combiners for pattern classification. In A.J.C. Sharkey, editor, Combining Artificial Neural Nets, pages 127-161. Springer-Verlag, London, 1999.
24. G.U. Yule. On the association of attributes in statistics. Phil. Trans., A, 194:257-319, 1900.