Combining classifiers using trained fuser - Analytical and experimental results

Neural Network World

Volumn 20, Issue 7, 2010, Pages 925-934

  Wozniak, Michal ^a   Zmyslony, Marcin ^a  

^a WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

Multiple classifier system; Neural networks; Pattern recognition; Trained fuser

Indexed keywords

BENCHMARK DATASETS; CLASS NUMBERS; COLLECTIVE DECISION; COMBINING CLASSIFIERS; COMPUTATIONAL COSTS; COMPUTER EXPERIMENT; INDIVIDUAL CLASSIFIERS; MULTIPLE CLASSIFIER SYSTEMS; NEURAL COMPUTATIONS; OPTIMIZATION TASK; TRAINED FUSER; VOTING METHOD;

BENCHMARKING; CLASSIFIERS; DECISION MAKING; LEARNING ALGORITHMS; PATTERN RECOGNITION SYSTEMS;

NEURAL NETWORKS;

EID: 79952139706     PISSN: 12100552     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (26)

1. Alexandre L. A., Campilho A. C., Kamel M.: Combining Independent and Unbiased Classifiers Using Weighted Average, Proc. of the 15th Internat. Conf. on Pattern Recognition, vol. 2, 2000, pp. 495-498.
2. Alpaydin E.: Introduction to Machine Learning. 2nd edn. The MIT Press, 2004.
3. Asuncion A., Newman D. J.: UCI ML Repository, Irvine, CA: University of California, School of Information and Computer Science, 2007. [http://www.ics.uci.edu/̄mlearn/MLRepository.html]
4. Biggio B., Fumera G., Roli F.: Bayesian Analysis of Linear Combiners, Lecture Notes in Computer Science, vol. 4472, 2007, pp. 292-301.
5. Bishop Ch. M.: Pattern Recognition and Machine Learning, Springer, 2006.
6. Duin R. P. W.: The Combining Classifier: to Train or Not to Train?, Proc. of the ICPR2002, Quebec City, 2002.
7. Duin R. P. W. et al.: PRTools4, A Matlab Toolbox for Pattern Recognition, Delft University of Technology, 2004.
8. Fumera G., Roli F.: A Theoretical and Experimental Analysis of Linear Combiners for Multiple Classifier Systems, IEEE Trans, on PAMI, 27, 2005, pp. 942-956.
9. Giacinto G.: Design Multiple Classifier Systems, PhD. thesis, Universita Degli Studi di Salerno, 1998.
10. Hansen L. K., Salamon P.: Neural Networks Ensembles, IEEE Trans, on PAMI, Vol. 12, No. 10, 1990, pp. 993-1001.
11. Hashem S.: Optimal linear combinations of neural networks, Neural Networks, 10, 1997, pp. 599-614. (Pubitemid 27357174)
12. Inoue H., Narihisa H.: Optimizing a Multiple Classifier Systems, LNCS, Vol. 2417, 2002, pp. 285-294.
13. Jackobs R. A.: Methods for combining experts' probability assessment, Neural Computation, No. 7, 1995, pp. 867-888.
14. Jordan, M. I., Jacobs R. A.: Hierarchical mixtures of experts and the EM algorithm. Neural Computation, 6, 2, 1994, pp. 181-214.
15. Kohavi, R.: A study of cross-validation and bootstrap for accuracy estimation and model selection. In: Proc. of the 14th Int. Joint Conf. on Artificial Intell., San Mateo, 1995, pp. 1137-1143.
16. Kuncheva L. I., Bezdek J. C., Duin R. P. W.: Decision templates for multiple classifier fusion: an experimental comparison, Pattern Recognition, 34, 2001, pp. 299-314. (Pubitemid 32871876)
17. Kuncheva L. I., Whitaker C. J., Shipp C. A., Duin R. P. W.: Limits on the Majority Vote Accuracy in Classier Fusion, Pattern Analysis and Applications, 6, 2003, pp. 22-31.
18. Kuncheva L. I.: Combining pattern classifiers: Methods and algorithms, Wiley, 2004.
19. Marcialis G. L., Roli F.: Fusion of Face Recognition Algorithms for Video-Based Surveillance Systems. In: Foresti G. L., Regazzoni C., Varshney P. (Eds.), Multisensor Surveillance Systems: The Fusion Perspective, Kluwer Academic Publishers, 2003.
20. Rao N. S. V.: A Generic Sensor Fusion Problem: Classification and Function Estimation, Lecture Notes in Computer Science, Vol. 3077, 2004, pp. 16-30.
21. Raudys S.: Trainable fusion rules. I. Large sample size case, Neural Networks, 19, 2006, pp. 1506-1516. (Pubitemid 44793161)
22. Tumer K., Ghosh J.: Analysis of Decision Boundaries in Linearly Combined Neural Classifiers, Pattern Recognition, 29, pp. 341-348, 1996.
23. Van Erp, Vuurpijl L. G., Schomaker L. R. B.: An overview and comparison of voting methods for pattern recognition, Proc. of IWFHR. 8, Canada, 2002, pp. 195-200.
24. Wolpert D. H.: The supervised learning no-free-lunch theorems, Proceedings of the 6th Online World Conference on Soft Computing in Industrial Applications, 2001.
25. Woods K., Kegelmeyer W. P.: Combination of multiple classifiers using local accuracy estimates, Pattern Analysis and Machine Intelligence, IEEE Transactions, Vol. 19, Issue 4, Apr 1997, pp. 405-410. (Pubitemid 127762896)
26. Wozniak M.: Experiments on linear combiners, In: Pietka E, Kawa J. (Eds.) Information technologies in biomedicine, Springer, 2008, pp. 445-452.