Assessing the predictive accuracy of diversity measures with domain-dependent, asymmetric misclassification costs

Information Fusion

Volumn 6, Issue 1, 2005, Pages 37-48

  Gal Or, Mordechai ^a   May, Jerrold H ^b   Spangler, William E ^a  

^a DUQUESNE UNIVERSITY   (United States)

^b UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

Data mining; Dependency and diversity; Ensemble committee of learners; Multiple classifiers; Unequal misclassification costs

Indexed keywords

COMPUTATIONAL COMPLEXITY; COSTS; DATA MINING; LEARNING SYSTEMS; MARKETING; MATHEMATICAL MODELS; VIDEO RECORDING;

DEPENDENCY AND DIVERSITY; ENSEMBLE/COMMITTEE OF LEARNERS; MULTIPLE CLASSIFIERS; UNEQUAL MISCLASSIFICATION COSTS;

CLASSIFICATION (OF INFORMATION);

EID: 10444289966     PISSN: 15662535     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.inffus.2004.04.006     Document Type: Article

References (36)

1. K.M. Ali, M.J. Pazzani, Error reduction through learning multiple descriptions, Machine Learning 24 (3) (1996) 173-202.
2. R.E. Banfield, L.O. Hall, K.W. Bowyer, W.P. Kegelmeyer. A new ensemble diversity measure applied to thinning ensembles, in: 4th International Workshop on Multiple Classifier Systems, Guildford, UK, 2003.
3. L. Breiman, Bagging predictors, Machine Learning 24 (2) (1996) 123-140.
4. P.K. Chan, S.J. Stolfo, On the accuracy of meta-learning for scalable data mining, Journal of Intelligent Information Systems 8 (1997) 5-28.
5. L. Chunovic, Change ahead for channels, Electronic Media 20 (31) (2001) 1.
6. W.J. Conover, Practical Nonparametric Statistics, third ed., John Wiley & Sons, New York, 1999.
7. P. Cunningham, J. Carney, Diversity versus quality in classification ensembles based on feature selection, in: 11th European Conference on Machine Learning, Barcelona, Spain, 2000.
8. T.H. Davenport, Saving IT's soul: human-centered information management, Harvard Business Review (March-April 1994) 119-131.
9. T.G. Dietterich, Machine learning research: four current directions, AI Magazine 18 (4) (1997) 97-136.
10. T.G. Dietterich, An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization, Machine Learning 40 (2) (2000) 139-157.
11. J. Fleiss, Statistical Methods for Rates and Proportions, John Wiley & Sons, New York, 1981.
12. Y. Freund, R. Schapire, Experiments with a new boosting algorithm, in: 13th International Conference on Machine Learning, Ban, Italy, 1996.
13. G. Giacinto, F. Roli, Design of effective neural network ensembles for image classification purposes, Image Vision and Computing Journal 19 (9-10) (2001) 697-705.
14. D.J. Hand, Construction and Assessment of Classification Rules, John Wiley & Sons, Chichester, 1997.
15. L. Hansen, P. Salamon, Neural network ensembles, IEEE Transactions on Pattern Analysis and Machine Intelligence 12 (10) (1990) 993-1001.
16. J. Kittler, M. Hatef, R.P.W. Duin, J. Matas, On combining classifiers, IEEE Transactions on Pattern Analysis and Machine Intelligence 20 (3) (1998) 226-239.
17. R. Kohavi, D. Wolpert, Bias plus variance decomposition for zero-one loss functions, in: Machine Learning: Proceedings of the Thirteenth International Conference, Morgan Kaufmann, Bari, Italy, 1996, pp. 275-283.
18. A. Krogh, J. Vedelsby, Neural network ensembles cross validation and active learning, in: G. Tesauro, D.S. Touretzky, T.K. Leen (Eds.), Advances in Neural Information Processing Systems, MIT Press, Cambridge, Mass, 1995.
19. L.I. Kuncheva, J. Beezdek, R.P.W. Duin, Decision templates for multiple classifier fusion: an experimental comparison, Pattern Recognition 34 (2) (2001) 299-314.
20. L.I. Kuncheva, M. Skurichina, R.P.W. Duin, An experimental study on diversity for bagging and boosting with linear classifiers, Information Fusion 3 (2) (2002) 245-258.
21. L.I. Kuncheva, C.J. Whitaker, Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy, Machine Learning 51 (2) (2003) 181-207.
22. L.I. Kuncheva, C.J. Whitaker, C.A. Shipp, R.P.W. Duin, Limits on the majority vote accuracy in classifier fusion, Pattern Analysis Applications 6 (2003) 22-31.
23. L. Lam, C.Y. Suen, Optimal combinations of pattern classifiers, Pattern Recognition Letters 16 (1995) 945-954.
24. L. Lam, C.Y. Suen, Application of majority voting to pattern recognition: an analysis of its behavior and performance, IEEE Transactions on Systems, Man and Cybernetics 27 (5) (1997) 553-568.
25. B. Littlewood, D. Miller, Conceptual modeling of coincident failures in multiversion software, IEEE Transactions on Software Engineering 15 (12) (1989) 1596-1614.
26. D. Opitz, R. Maclin, Popular ensemble methods: an empirical study, Journal of Artificial Intelligence Research 11 (1999) 169-198.
27. D. Partridge, W. Krzanowski, Software diversity: practical statistics for its measurement and exploitation, Information and Software Technology 39 (1997) 707-712.
28. E. Pekalska, R.P.W. Duin, Dissimilarity representations allow, for building good classifiers, Pattern Recognition Letters 23 (2002) 943-956.
29. B.E. Rosen, Ensemble learning using decorrelated neural networks, Connection Science 8 (3) (1996) 373-384.
30. D. Ruta, B. Gabrys, New measure of classifier dependency in multiple classifier systems, in: 3rd International Workshop on Multiple Classifier Systems, Cagliari, Sardinia, Italy, 2002, pp. 127-136.
31. R. Schapire, The strength of weak learnability, Machine Learning 5 (2) (1990) 197-227.
32. C.A. Shipp, L.I. Kuncheva, Relationships between combination methods and measures of diversity in combining classifiers, Information Fusion 3 (2) (2002) 135-148.
33. D. Skalak, The sources of increased accuracy for two proposed boosting algorithms, in: Proceedings of the AAAI-96 Integrating Multiple Learned Models Workshop Portland, AAAI Press, Ore., 1996, pp. 120-125.
34. W.E. Spangler, M. Gai-Or, J.H. May, Using data mining to profile television viewers in the digital TV era, Communications of the ACM 46 (4) (2003) 66-72.
35. C.J. Whitaker, L.I. Kuncheva, Examining the relationship between majority vote accuracy and diversity in bagging and boosting, School of Informatics, University of Wales, Bangor, 2003.
36. G.U. Yule, On the association of attributes in statistics, Philosophical Transactions of the Royal Society of London, Series A 194 (1900) 257-319.