A theoretical analysis of the limits of majority voting errors for multiple classifier systems

Pattern Analysis and Applications

Volumn 5, Issue 4, 2002, Pages 333-350

  Ruta, Dymitr ^a   Gabrys, Bogdan ^a  

^a UNIVERSITY OF THE WEST OF SCOTLAND   (United Kingdom)

Author keywords

Combining classifiers; Error distribution; Generalisation; Majority voting; Margin; Multistage organisations

Indexed keywords

EID: 0036026248     PISSN: 14337541     EISSN: None     Source Type: Journal    
DOI: 10.1007/s100440200030     Document Type: Review

References (23)

1. Sharkey AJC. Combining artificial neural nets: ensemble and modular multi-net systems. Springer-Vorlag, Berlin, 1999
2. Bezdek JC. Fuzzy models and algorithms for pattern recognition and image processing. Kluwer Academic, Boston, 1999
3. Zhilkin PA, Somorjai RL. Application of several methods of classification fusion to magnetic resonance spectra. Connection Science 1996; 8(3,4): 427-442
4. Rogova G. Combining the results of several neural network classifiers. Neural Networks 1994; 7(5): 777-781
5. Sharkey AJC, Sharkey NE. Combining diverse neural nets. The Knowledge Engineering Review 1997; 12(3): 231-247
6. Kittler J. Combining classifiers: a theoretical framework. Pattern Analysis & Applications 1998; 1: 18-27
7. Hashem S. Optimal linear combinations of neural networks. Neural Networks 1997; 10(4): 599-614
8. Granger CWJ. Combining forecasts - twenty years later. Journal of Forecasting 1989; 8(3): 167-173
9. Littlewood B, Miller DR. Conceptual modeling of coincident failures in multiversion software. IEEE Transactions on Software Engineering 1989; 15(12): 1596-1614
10. Geman S, Bienstock E, Doursat R. Neural networks and bias/variance dilemma. Neural Computation 1992, 4: 1-58
11. Partridge D, Griffith N. Strategies for improving neural net generalisation. Neural Computing & Applications 1995; 3: 27-37
12. Partridge D. Network generalization differences quantified. Technical Report 291, Department of Computer Science, University of Exeter, 1994
13. Lam L, Suen CY. A theoretical analysis of the application of majority voting to pattern recognition. In Proceedings of the International Conference on Pattern Recognition, Jerusalem 1994, pp 418-420
14. Lam L, Suen CY. Application of majority voting to pattern recognition: an analysis of its behaviour and performance. IEEE Transactions on Systems, Man, and Cybernetics 1997; 27(5): 553-568
15. Battiti R, Colla AM. Democracy in neural nets: voting schemes for classification. Neural Networks 1994; 7(4): 691-707
16. Kuncheva LI, Whitaker CJ, Shipp CA, Duin RPW. Limits on the majority vote accuracy in classifier fusion. Pattern Analysis and Applications (accepted)
17. Kuncheva LI, Whitaker CJ. Measures of diversity in classifier ensembles (submitted)
18. Schapire RE, Freud Y, Bartlett P, Lee WS. Boosting the Margin: A New Explanation for the Effectiveness of Voting Methods. The Annals of Statistics 1998; 26(5): 1651-1686
19. Wolpert DH, Stacked Generalization. Neural Networks 1992; 5: 241-259
20. Pudil P, Novovicova J, Blaha S, Kittler J. Multistage Pattern Recognition with Rejection Option. In Proceedings of the 11th IAPR International Conference on Pattern Recognition B, II, 1992, pp. 92-95
21. Ho TK, Hull JJ, Srihari SN. Decision combination in multiple classifier systems. IEEE Transactions on Pattern Analysis and Machine Intelligence 1994; 16(1): 66-75
22. Maisel L. Probability, statistics and random processes. Simon and Schuster, New York, 1971
23. Hamburg M. Statistical analysis for decision making. Harcourt Bruce & World, New York, 1970