Combining multiple classifiers by averaging or by multiplying?

Pattern Recognition

Volumn 33, Issue 9, 2000, Pages 1475-1485

  Tax, David M J ^a   Van Breukelen, Martijn ^a   Duin, Robert P W ^a   Josef Kittler, ^b  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

Classifier fusion; Combination of classifiers; Handwritten digits recognition; Neural networks; Pattern recognition

Indexed keywords

DECISION THEORY; ERRORS; GENETIC ALGORITHMS; MATRIX ALGEBRA; NEURAL NETWORKS; PROBABILITY; VECTORS;

CLASSIFIER FUSION; HANDWRITTEN DIGITS RECOGNITION; MEAN COMBINATION RULE;

PATTERN RECOGNITION;

EID: 0033713738     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0031-3203(99)00138-7     Document Type: Article

References (17)

1. A. Sharkey, N. Sharkey, How to improve the reliability of artificial neural networks, Technical Report CS-95-11, Department of Computer Science, University of Sheffield, 1995.
2. Xu L., Kryzak A., Suen C.V. Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Trans. Systems, Man Cybernet. 22(3):1992;418-435.
3. Battiti R., Colla A.M. Democracy in neural nets. voting schemes for classification Neural Networks. 7(4):1994;691-707.
4. K. Tumer, J. Ghosh, Order statistics combiners for neural classifiers, in: Proceedings of the World Congress on Neural Networks, INNS Press, Washington DC, 1995, pp. I:31-34.
5. Jacobs R. Method for combining experts' probability assessments. Neural Comput. 7(5):1995;867-888.
6. Rogova G. Combining the results of several neural network classifiers. Neural Networks. 7(5):1994;777-781.
7. S. Hashem, Optimal linear combinations of neural networks, Neural Networks (1994).
8. Tanigushi M., Tresp V. Averaging regularized estimators, Neural Comput. 9:1997;1163-1178.
9. Benediktsson J.A., Swain P.H. Consensus theoretic classification methods. IEEE Trans. Systems, Man and Cybernet. 22(4):1992;688-704.
10. J. Kittler, M. Hatef, R.P.W. Duin, Combining classifiers, Proceedings of ICPR'96, (1996) 897-901.
11. J. Kittler, A. Hojjatoleslami, T. Windeatt, Weighting factors in multiple expert fusion, in: A.F. Clark, (Ed.), Proceedings of the eighth British Machine Vision Conference, University of Essex Printing Service, 1997, pp. 41-50.
12. D.M.J. Tax, R.P.W. Duin, M. van Breukelen, Comparison between product and mean classifier combination rules, in: P. Pudil, J. Novovicova, J. Grim, (Eds.), First International Workshop on Statistical Techniques in Pattern Recognition, Institute of Information Theory and Automation, June 1997, pp. 165-170.
13. Ruck D.W., Rogers S.K., Kabrisky M., Oxley M.E., Suter B.W. The multilayer perceptron as an approximation to a Bayes optimal discrimination function. IEEE Trans. Neural Networks. 1(4):1990;296-298.
14. C.M. Bishop, Neural Networks for Pattern Recognition, Oxford University Press, Walton Street, Oxford OX2 6DP, 1995.
15. Raudys S., Duin R.P.W. Expected classification error of the fisher linear classifier with pseudo-inverse covariance matrix. Pattern Recognition Lett. 19(5-6):1998;385-392.
16. Geman S., Bienenstock E., Doursat R. Neural networks and the bias/variance dilemma. Neural Comput. 4:1992;1-58.
17. M. van Breukelen, R.P.W. Duin, D.M.J. Tax, Combining classifiers for the recognition of handwritten digits, in: P. Pudil, J. Novovicova, J. Grim, (Eds.), First International Workshop on Statistical Techniques in Pattern Recognition, Institute of Information Theory and Automation, June 1997, pp. 13-18.