Experts' boasting in trainable fusion rules

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 25, Issue 9, 2003, Pages 1178-1182

  Raudys, Sarunas ^a  

^a VILNIUS UNIVERSITY   (Lithuania)

Author keywords

Complexity; Expert classifiers; Fusion rule; Generalization error; Resubstitution error

Indexed keywords

DECISION MAKING; FEATURE EXTRACTION; KNOWLEDGE BASED SYSTEMS; PERFORMANCE; PROBABILITY; VECTORS;

BAYES CLASSIFIERS; FUSION RULE MULTIPLE CLASSIFIER SYSTEMS; KNOWLEDGE SPACE FUSION METHOD;

PATTERN RECOGNITION SYSTEMS;

EID: 0141608767     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2003.1227993     Document Type: Article

References (27)

1. "Multiple Classifier Systems," Lecture Notes in Computer Science, J. Kittler and F. Roli, eds., vols. 1857, 2096, 2364, Springer, 2000, 2001, 2002.
2. J. Kittler, "Combining Classifiers: A Theoretical Framework," Pattern Analysis and Applications, vol. 1, pp. 18-27, Springer, 1998.
3. J. Kittler, "A Framework for Classifier Fusion: Is Still Needed?" Lecture Notes in Computer Science, vol. 1876, pp. 45-56, 2000.
4. J. Gosh, "Multi-Classifier Systems: Back to the Future," Lecture Notes in Computer Science, vol. 2364, pp. 1-15, Springer, 2002.
5. T.K. Ho, "Data Complexity Analysis for Classifier Combination," Lecture Notes in Computer Science, vol. 2096, pp. 53-67, Springer, 2001.
6. S. Raudys, "Multiple Classifier Systems in the Context of Feature Extraction and Selection," Lecture Notes in Computer Science, vol. 2364, pp. 27-41, Springer, 2002.
7. J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas, "On Combining Classifiers," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, pp. 226-239, 1998.
8. L.I. Kuncheva, J.C. Bezdek, and R.P.W. Duin, "Decision Templates for Multiple Classifier Fusion: An Experimental Comparison," Pattern Recognition, vol. 34, pp. 299-314, 2001.
9. L. Yu, A. Krzyzak, and C.Y. Suen, "Methods of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals," IEEE Trans. Systems, Man, and Cybernetics, vol. 22, pp. 418-435, 1992.
10. S. Hashem, "Optimal Linear Combination of Neural Networks," Neural Networks, vol. 19, pp. 599-614, 1997.
11. A. Janeliunas and S. Raudys, "Reduction of Boasting Bias' of Linear Expert," Lecture Notes in Computer Science, vol. 2364, pp. 242-251, Springer, 2002.
12. L. Breiman, "Bagging Predictors," Machine Learning J., vol. 24, pp. 123-140, 1996.
13. L. Breiman, "Arcing Classifiers," Annals of Statistics, vol. 26, pp. 801-849, 1998.
14. Y. Freund and R.E. Schapire, "A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting," J. Computer and Systems Science, vol. 55, pp. 119-139, 1997.
15. M. Jordan and R. Jakobs, "Hierarchical Mixture of Experts and the EM Algorithm," Neural Computation, vol. 6, pp. 181-214, 1994.
16. D. Wolpert, "Stacked Generalization," Neural Networks, vol. 5, pp. 241-260, 1992.
17. F. Roli and G. Fumera, "Analysis of Linear and Order Statistics Combiners for Fusion of Imbalanced Classifiers," Lecture Notes in Computer Science, vol. 2364, pp. 252-261, Springer, 2002.
18. F. Roli, S. Raudys, and G.L. Marcialis, "An Experimental Comparison of Fixed and Trained Rules for Crisp Classifiers Outputs," Lecture Notes in Computer Science, vol. 2364, pp. 232-241, Springer, 2002.
19. C. Güler, B. Sankur, Y. Kahya, M. Skurichina, and S. Raudys, "Classification of Respiratory Sound Patterns by Means of Cooperative Neural Networks," Proc. Eighth European Signal Processing Conf., G. Ramponi, G.L. Sicuranza, S. Carrato, and S. Marsi, eds., 1996.
20. S. Raudys, Statistical and Neural Classifiers: An Integrated Approach to Design, p. 312, London: Springer, 2001.
21. P.A. Lachenbruch and M. Goldstein, "Discriminant Analysis," Biometrics, vol 5, pp. 9-85, 1979.
22. Y.S. Huang and C.Y. Suen, "A Method of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, pp. 90-93, 1998.
23. L.I. Kuncheva and C.J. Whitaker, "Feature Subsets for Classifier Combination: An Enumerative Experiment," Lecture Notes in Computer Science, vol. 2096, pp. 228-237, Springer, 2001.
24. K. Fukunaga, Introduction to Statistical Pattern Recognition, second ed. New York: Academic Press, 1990.
25. R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, second ed. New York: Wiley, 2000.
26. R.P.W. Duin, "Nearest Neighbour Interpolation for Error Estimation and Classifier Optimisation," Proc. Eighth Scandinavian Conf. Image Analysis, K.A. Hogda, B. Braathen, and K. Heia, eds., pp. 5-6, 1993.
27. M. Skurichina, S. Raudys, R.P.W. Duin, "K-Nearest Neighbors Directed Noise Injection in Multilayer Perceptron Training," IEEE Trans. Neural Networks, vol. 11, pp. 504-511, 2000.