On the diversity-performance relationship for majority voting in classifier ensembles

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4472 LNCS, Issue , 2007, Pages 407-420

  Chung, Yun Sheng ^a   Hsu, D Prank ^b   Tang, Chuan Yi ^a  

^a NATIONAL TSING HUA UNIVERSITY   (Taiwan)

^b FORDHAM UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BRANCH AND BOUND METHOD; COMPUTATIONAL COMPLEXITY; DATA REDUCTION; PARAMETER ESTIMATION; PROBLEM SOLVING;

DATA SETS; DIVERSENESS; INDIVIDUAL SYSTEMS; MULTIPLE CLASSIFIER SYSTEMS (MCS);

CLASSIFICATION (OF INFORMATION);

EID: 37249060650     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-72523-7_41     Document Type: Conference Paper

References (34)

1. Ho, T., Hull, J., Srihari, S.: Decision combination in multiple classifier systems. IEEE Transactions on Pattern Analysis and Machine Intelligence 16 (1994) 66-75
2. Ho, T.K.: Multiple classifier combination: Lessons and next steps. In Bunke, H., Kandel, A., eds.: Hybrid Methods in Pattern Recognition. World Scientific (2002) 171-198
3. Kuncheva, L.L: Combining Pattern Classifiers: Methods and Algorithms. John Wiley & Sons, Inc. (2004)
4. Sharkey, A., ed.: Combining Artificial Neural Nets. Springer-Verlag (1999)
5. Dietterich, T.G.: Ensemble methods in machine learning. In Kittler, J., Roli, F., eds.: Multiple Classifier Systems. Volume 1857 of LNCS. (2000) 1-15
6. Kuncheva, L.I., Whitaker, C.J. : Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Machine Learning 51 (2003) 181-207
7. Kuncheva, L.: That elusive diversity in classifier ensembles. In López, F.J.P., Campilho, A.C., de la Blanca, N.P., Sanfeliu, A., eds.: IbPRIA. Volume 2652 of LNCS., Springer (2003) 1126-1138
8. Hansen, L., Salamon, P.: Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence 12(10) (1990) 993-1001
9. Krogh, A., Vedelsby, J.: Neural network ensembles, cross validation, and active learning. In Tesauro, G., Touretzky, D.S., Leen, T.K., eds.: Advances in Neural Information Processing Systems. Volume 7., MIT Press (1995) 231-238
10. Turner, K., Ghosh, J.: Linear and order statistics combiners for pattern classification. In Sharkey, A., ed.: Combining Artificial Neural Nets. Springer-Verlag (1999) 127-162
11. Fumera, G., Roli, F.: A theoretical and experimental analysis of linear combiners and multiple classifier systems. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(6) (2005) 942-956
12. Aksela, M., Laaksonen, J.: Using diversity of errors for selecting members of a committee classifier. Pattern Recognition 39 (2006) 608-623
13. Partridge, D., Krzanowski, W.: Refining multiple classifier system diversity. Technical report, Computer Science Department, University of Exeter, UK (2003)
14. Ruta, D.: Classifier Diversity in Combined Pattern Recognition Systems. PhD thesis, University of Paisley, Scotland, UK (2003)
15. Shipp, C., Kuncheva, L.: Relationships between combination methods and measures of diversity in combining classifiers. Information Fusion 3(2) (2002) 135-148
16. Narasimhamurthy, A.: Evaluation of diversity measures for binary classifier ensembles. In: Multiple Classifier Systems. Volume 3541 of LNCS. (2005) 267-277
17. Hsu, D.F., Chung, Y.S., Kristal, B.S.: Combinatorial fusion analysis: Methods and practices of combining multiple scoring systems. In Hsu, H.H., ed.: Advanced Data Mining Technologies in Bioinformatics. Idea Group Inc. (2006) 32-62
18. Hsu, D.F., Taksa, I.: Comparing rank and score combination methods for data fusion in information retrieval. Information Retrieval 8(3) (2005) 449-480
19. Kuncheva, L.I., Whitaker, C.J., Shipp, CA., Duin, R.P.W.: Limits on the majority vote accuracy in classifier fusion. Pattern Analysis and Applications 6 (2003) 22-31
20. Ruta, D., Gabrys, B.: A theoretical analysis of the majority voting errors for multiple classifier systems. Pattern Analysis and Applications 5 (2002) 333-350
21. Kittler, J., Hatef, M., Duin, R.P., Matas, J.: On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(3) (1998) 226-239
22. Kittler, J., Alkoot, F.: Sum versus vote fusion in multiple classifier systems. IEEE Transactions on Pattern Analysis and Machine Intelligence 25(1) (2003) 110-115
23. Lam, L., Suen, C.Y.: Application of majority voting to pattern recognition: An analysis of its behaviour and performance. IEEE Transactions on Systems, Man, and Cybernetics 27(5) (1997) 533-568
24. Zenobi, G., Cunningham, P.: Using diversity in preparing ensembles of classifiers based on different feature subsets to minimize generalization error. In: European Conference on Machine Learning. Volume 2167 of LNCS., Springer (2001) 576-587
25. Narasimhamurthy, A.: Theoretical bounds of majority voting performance for a binary classification problem. IEEE Transactions on Pattern Analysis and Machine Intelligence 27(12) (2005) 1988-1995
26. Roli, F., Kittler, J.: Fusion of multiple classifiers. Information Fusion 3(4) (2002) 243 Editorial.
27. Kuncheva, L.I.: Diversity in multiple classifier systems. Information Fusion 6(1) (2005) 3-4 Editorial.
28. Breiman, L.: Random forests. Machine Learning 45 (2001) 5-32
29. Matan, O.: On voting ensembles of classifiers. In: Proc. AAAI-96, Integrating Multiple Learned Models Workshop. (1996) 84-88
30. Cover, T.M., Thomas, J.A.: Elements of Information Theory. John Wiley & Sons, Inc. (1991)
31. Kuncheva, L.I.: Fuzzy Classifier Design. Springer-Verlag (2000)
32. Breiman, L.: Arcing classifiers. The Annals of Statistics 26(3) (1998) 801-849
33. Kendall, M., Gibbons, J.D.: Rank Correlation Methods. Edward Arnold (1990)
34. Chung, Y.S., Hsu, D.F., Tang, C.Y.: On the diversity-performance relationship for plurality voting and disagreement diversity in classifier ensembles. (2006) manuscript.