Review of classifier combination methods

Studies in Computational Intelligence

Volumn 90, Issue , 2008, Pages 361-386

  Tulyakov, Sergey ^a,b   Jaeger, Stefan ^b   Govindaraju, Venu ^a,c   Doermann, David ^b  

^a UNIVERSITY AT BUFFALO   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 38049071588     PISSN: 1860949X     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-540-76280-5_14     Document Type: Review

References (61)

1. Cooke, R.: Experts in Uncertainty: Opinion and Subjective Probability in Science. Oxford University Press (1991)
2. Clemen, R., Winkler, R.: Combining probability distributions from experts in risk analysis. Risk Analysis 19 (1999) 187-203
3. Xu, L., Krzyzak, A., Suen, C.Y.: Methods for combining multiple classifiers and their applications to handwriting recognition. IEEE transactions on System, Man, and Cybernetics 23(3) (1992) 418-435
4. Gader, P., Mohamed, M., Keller, J.: Fusion of Handwritten Word Classifiers. Pattern Recognition Letters 17 (1996) 577-584
5. Sirlantzis, K., Hoque, S., Fairhurst, M.C.: Trainable Multiple Classifier Schemes for Handwritten Character Recognition. In: 3rd International Workshop on Multiple Classifier Systems (MCS), Cagliari, Italy, Lecture Notes in Computer Science, Springer-Verlag (2002) 169-178
6. Wang, W., Brakensiek, A., Rigoll, G.: Combination of Multiple Classifiers for Handwritten Word Recognition. In: Proc. of the 8th International Workshop on Frontiers in Handwriting Recognition (IWFHR-8), Niagara-on-the-Lake, Canada (2002) 117-122
7. Lee, D.S.: Theory of Classifier Combination: The Neural Network Approach. Ph.D Thesis, SUNY at Buffalo (1995)
8. Bertolami, R., Bunke, H.: Early feature stream integration versus decision level combination in a multiple classifier system for text line recognition. In: Pattern Recognition, 2006. ICPR 2006. 18th International Conference on. Volume 2. (2006) 845-848
9. Favata, J.: Character model word recognition. In: Fifth International Workshop on Frontiers in Handwriting Recognition, Essex, England (1996) 437-440
10. Ho, T.K., Hull, J.J., Srihari, S.N.: Decision combination in multiple classifier systems. IEEE Trans. on Pattern Analysis and Machine Intelligence 16(1) (1994) 66-75
11. Erp, M.V., Vuurpijl, L.G., Schomaker, L.: An Overview and Comparison of Voting Methods for Pattern Recognition. In: Proc. of the 8th International Workshop on Frontiers in Handwriting Recognition (IWFHR-8), Niagara-onthe-Lake, Canada (2002) 195-200
12. Kang, H.J., Kim, J.: A Probabilistic Framework for Combining Multiple Classifiers at Abstract Level. In: Fourth International Conference on Document Analysis and Recognition (ICDAR), Ulm, Germany (1997) 870-874
13. Kittler, J., Hatef, M., Duin, R., Matas, J.: On combining classifiers. IEEE Trans. on Pattern Analysis and Machine Intelligence (1998) 226-239
14. Tulyakov, S., Govindaraju, V.: Classifier combination types for biometric applications. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2006), Workshop on Biometrics, New York, USA (2006)
15. Jain, A., Ross, A.: Learning user-specific parameters in a multibiometric system. In: International Conference on Image Processing. 2002. Volume 1. (2002) I-57-I-60 vol.1
16. Fierrez-Aguilar, J., Garcia-Romero, D., Ortega-Garcia, J., Gonzalez-Rodriguez, J.: Bayesian adaptation for user-dependent multimodal biometric authentication. Pattern Recognition 38(8) (2005) 1317-1319
17. Auckenthaler, R., Carey, M., Lloyd-Thomas, H.: Score normalization for textindependent speaker verification systems. Digital Signal Processing 10(1-3) (2000) 42-54
18. Tulyakov, S., Govindaraju, V.: Identification model for classifier combinations. In: Biometrics Consortium Conference, Baltimore, MD (2006)
19. Last, M., Bunke, H., Kandel, A.: A feature-based serial approach to classifier combination. Pattern Analysis and Applications 5(4) (2002) 385-398
20. Ho, T.K.: The random subspace method for constructing decision forests. Pattern Analysis and Machine Intelligence, IEEE Transactions on 20 8) (1998) 832-844
21. Kleinberg, E.M.: On the algorithmic implementation of stochastic discrimination. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(5) (2000) 473-490
22. Breiman, L.: Bagging predictors. Machine Learning 24(2) (1996) 123-140
23. Schapire, R.: The strength of weak learnability. Machine Learning 5 (1990) 197-227
24. Freund, Y., Schapire, R.: Experiments with a New Boosting Algorithm. In: Proc. of 13th Int. Conf. on Machine Learning, Bari, Italy (1996) 148-156
25. Wolpert, D.H.: Stacked generalization. Neural Networks 5(2) (1992) 241-260
26. Vapnik, V.: The Nature of Statistical Learning Theory. Springer-Verlag, New York (1995)
27. Vapnik, V.: Statistical Learning Theory. Wiley, New York (1998)
28. Schapire, R., Freund, Y., Bartlett, P., Lee, W.S.: Boosting the margin: A new explanation for the effectiveness of voting methods. The Annals of Statistics 26(5) (1998) 1651-1686
29. Kleinberg, E.M.: Stochastic discrimination. Annals of Mathematics and Artificial Intelligence 1(1990)
30. Kong, E., Dietterich, T.: Error-correcting output coding corrects bias and variance. In: 12th International Conference on Machine Learning. (1995) 313-321
31. Tibshirani, R.: Bias, variance and prediction error for classification rules. Technical Report 41, Department of Statistics, University of Toronto (1996)
32. Tumer, K., Ghosh, J.: Linear and order statistics combiners for pattern classification. In Sharkey, A.J., ed.: Combining Artificial Neural Nets: Ensembles and Multi-Net Systems. Springer-Verlag, London (1999) 127-162
33. Kuncheva, L.: A theoretical study on six classifier fusion strategies. Pattern Analysis and Machine Intelligence, IEEE Transactions on 24 2) (2002) 281-286
34. Kuncheva, L.I.: Combining Pattern Classifiers: Methods and Algorithms. Wiley InterScience (2004)
35. Fumera, G., Roli, F.: Performance analysis and comparison of linear combiners for classifier fusion. In: SSPR/SPR. (2002) 424-432
36. Fumera, G., Roli, F.: Analysis of error-reject trade-off in linearly combined multiple classifiers. Pattern Recognition 37(6) (2004) 1245-1265
37. Alkoot, F.M., Kittler, J.: Experimental evaluation of expert fusion strategies. Pattern Recognition Letters 20(11-13) (1999) 1361-1369
38. Freund, Y., Schapire, R.: A Short Introduction to Boosting. Journal of Japanese Society for Artificial Intelligence 14(5) (1999) 771-780
39. Guenter, S., Bunke, H.: New Boosting Algorithms for Classification Problems with Large Number of Classes Applied to a Handwritten Word Recognition Task. In: 4th International Workshop on Multiple Classifier Systems (MCS), Guildford, UK, Lecture Notes in Computer Science, Springer-Verlag (2003) 326-335
40. Huber, P.J.: Robust Statistics. Wiley, New York (1981)
41. Jain, A., Nandakumar, K., Ross, A.: Score Normalization in Multimodal Biometric Systems. Pattern Recognition 38(12) (2005) 2270-2285
42. Cappelli, R., Maio, D., Maltoni, D.: Combining Fingerprint Classifiers. In: First Int. Workshop on Multiple Classifier Systems. (2000) 351-361
43. Hampel, F.R., Rousseeuw, P.J., Ronchetti, E., Stahel, W.: Robust Statistics: The Approach Based on Influence Functions. Wiley, New York (1986)
44. Velek, O., Jaeger, S., Nakagawa, M.: A New Warping Technique for Normalizing Likelihood of Multiple Classifiers and its Effectiveness in Combined On-Line/Off-Line Japanese Character Recognition. In: 8th International Workshop on Frontiers in Handwriting Recognition (IWFHR), Niagara-on-the-Lake, Canada (2002) 177-182
45. Velek, O., Jaeger, S., Nakagawa, M.: Accumulated-Recognition-Rate Normalization for Combining Multiple On/Off-line Japanese Character Classifiers Tested on a Large Database. In: 4th International Workshop on Multiple Classifier Systems (MCS), Guildford, UK, Lecture Notes in Computer Science, Springer-Verlag (2003) 196-205
46. Jaeger, S.: Informational Classifier Fusion. In: Proc. of the 17th Int. Conf. on Pattern Recognition, Cambridge, UK (2004) 216-219
47. Jaeger, S.: Using Informational Confidence Values for Classifier Combination: An Experiment with Combined On-Line/Off-Line Japanese Character Recognition. In: Proc. of the 9th Int.Workshop on Frontiers in Handwriting Recognition, Tokyo, Japan (2004) 87-92
48. Jaeger, S., Ma, H., Doermann, D.: Identifying Script on Word-Level with Informational Confidence. In: Int. Conf. on Document Analysis and Recognition (ICDAR), Seoul, Korea (2005) 416-420
49. Shannon, C.E.: A Mathematical Theory of Communication. Bell System Tech. J. 27(623-656) (1948) 379-423
50. Dempster, A.P.: A Generalization of Bayesian Inference. Journal of the Royal Statistical Society 30 (1968) 205-247
51. Shafer, G.: A Mathematical Theory of Evidence. Princeton University Press (1976)
52. Mandler, E., Schuermann, J.: Combining the Classification Results of Independent Classifiers Based on the Dempster/Shafer Theory of Evidence. In E.S. Gelsema, L.K., ed.: Pattern Recognition and Artificial Intelligence. (1988) 381-393
53. Huang, Y., Suen, C.: A Method of Combining Multiple Experts for Recognition of Unconstrained Handwritten Numerals. IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI) 17(1) (1995) 90-94
54. Ianakiev, K., Govindaraju, V.: Architecture for Classifier Combination Using Entropy Measures. In: 1st International Workshop on Multiple Classifier Systems (MCS), Cagliari, Italy, Lecture Notes in Computer Science, Springer-Verlag (2000) 340-350
55. Ianakiev, K., Govindaraju, V.: Deriving pseudo-probabilities of correctness given scores. In Chen, D., Cheng, X., eds.: Pattern Recognition and String Matching,. Kluwer Publishers (2002)
56. Woods, K., Kegelmeyer, W.P., J., Bowyer, K.: Combination of multiple classifiers using local accuracy estimates. Pattern Analysis and Machine Intelligence, IEEE Transactions on 19(4) (1997) 405-410
57. Giacinto, G., Roli, F.: Dynamic classifier selection based on multiple classifier behaviour. Pattern Recognition 34(9) (2001) 1879-1881 TY - JOUR.
58. Kuncheva, L.: Clustering-and-selection model for classifier combination. In: Knowledge-Based Intelligent Engineering Systems and Allied Technologies, 2000. Proceedings. Fourth International Conference on. Volume 1. (2000) 185-188 vol. 1
59. Govindaraju, V., Slavik, P., Xue, H.: Use of lexicon density in evaluating word recognizers. Pattern Analysis and Machine Intelligence, IEEE Transactions on 24(6) (2002) 789-800
60. Colombi, J., Reider, J., Campbell, J.: Allowing good impostors to test. In: Signals, Systems & Computers, 1997. Conference Record of the Thirty-First Asilomar Conference on. Volume 1. (1997) 296-300 vol. 1
61. Rosenberg, A., Parthasarathy, S.: Speaker background models for connected digit password speaker verification. In: Acoustics, Speech, and Signal Processing, 1996. ICASSP-96. Conference Proceedings., 1996 IEEE International Conference on. Volume 1. (1996) 81-84 vol. 1