Soft combination of neural classifiers: A comparative study

Pattern Recognition Letters

Volumn 20, Issue 4, 1999, Pages 429-444

  Verikas, Antanas ^a,b   Lipnickas, Arunas ^b   Malmqvist, Kerstin ^a   Bacauskiene, Marija ^b   Gelzinis, Adas ^b  

^a HALMSTAD UNIVERSITY   (Sweden)

^b KAUNAS UNIVERSITY OF TECHNOLOGY   (Lithuania)

Author keywords

Classification; Decision fusion; Fuzzy integral; Neural network

Indexed keywords

CALCULATIONS; FUZZY SETS; INTEGRAL EQUATIONS; NEURAL NETWORKS;

DECISION FUSION; FUZZY INTEGRAL; NEURAL CLASSIFIERS;

PATTERN RECOGNITION;

ARTIFICIAL NEURAL NETWORK; FUZZY MATHEMATICS; MATHEMATICAL METHOD;

EID: 0033117452     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-8655(99)00012-4     Document Type: Article

References (51)

1. Amari, S., Murata, N., Muller, K.-R., Finke, M., Yang, H., 1996. Statistical theory of overtraining - Is cross-validation asymptotically effective?. In: Touretzky, D.S., Mozer, M.C., Hasselmo, M.E. (Eds.), Advances in Neural Information Processing Systems 8. MIT Press, Cambridge, pp. 176-182.
2. Battiti R., Colla M. Democracy in neural nets: Voting schemes for classification. Neural Networks. 7(4):1994;691-707.
3. Ceccarelli M., Petrosino A. Multi-feature adaptive classifiers for SAR image segmentation. Neurocomputing. 14:1997;345-363.
4. Chen, W., Gader, P.D., Shi, H., 1997. Improved dynamic programming-based handwritten word recognition using optimal order statistics. In: Proc. of the Internat. Conf. Statistical and Stochastic Methods in Image Processing II. San Diego, pp. 246-256.
5. Chi, Z., Yan, H., Pham, T.D., 1996. Fuzzy Algorithms: With Applications to Image Processing and Pattern Recognition. World Scientific, Singapore.
6. Cho S.B., Kim J.H. Combining multiple neural networks by fuzzy integral for robust classification. IEEE Transactions on System, Man, and Cybernetics. 25(2):1995;380-384.
7. Denoeux T. A k-nearest neighbor classification rule based on Dempster-Shafer theory. IEEE Transactions on System, Man and Cybernetics - Part B. 25(5):1995;804-813.
8. Efron, B., Tibshirani, R., 1993. An Introduction to the Bootstrap. Chapman and Hall, London.
9. Filev D., Yager R.R. A generalized defuzzification method under BADD distributions. International Journal of Intelligent Systems. 6:1991;687-697.
10. Gader P.D., Mohamed M.A., Keller J.M. Fusion of handwritten word classifiers. Pattern Recognition Letters. 17:1996;577-584.
11. Grabisch M. Fuzzy integral in multicriteria decision making. Fuzzy Sets and Systems. 69:1995;279-298.
12. Grabisch M. The representation of importance and interaction of features by fuzzy measures. Pattern Recognition Letters. 17:1996;567-575.
13. Grabisch M., Nicolas J.-M. Classification by fuzzy integral: Performance and tests. Fuzzy Sets and Systems. 65:1994;255-271.
14. Hashem S. Optimal linear combinations of neural networks. Neural Networks. 10(4):1997;599-614.
15. Heskes, T., 1997. Balancing between bagging and bumping. In: Mozer, M.C., Jordan, M.I., Petsche, T. (Eds.), Advances in Neural Information Processing Systems 9. MIT Press, Cambridge, pp. 466-472.
16. Ho T.K., Hull J.J., Srihari S.N. Decision combination in multiple classifier systems. IEEE Transaction on Pattern Analysis and Machine Intelligence. 16(1):1994;66-75.
17. Hocaoglu, A.K., Gader, P.D., 1998. Choquet integral representations of nonlinear filters with applications to LADAR image processing. In: Proceedings of the SPIE Conference Nonlinear Image Processing IX, San Jose, CA, pp. 66-72.
18. Jacobs R.A. Methods for combining experts probability assessments. Neural Computation. 7(5):1995;867-888.
19. Ji, C., Ma, S., 1997. Combined weak classifiers. In: Mozer, M.C., Jordan, M.I., Petsche, T. (Eds.), Advances in Neural Information Processing Systems 9. MIT Press, Cambridge, pp. 494-500.
20. Jutten, C., Guerin-Dugue, A., Aviles-Cruz, C., Voz, J.L., Van Cappel, D., 1995. ESPRIT basic research project number 6891 ELENA, Enhanced learning for evolutive neural architecture.
21. Kang H.-J., Kim K., Kim J.H. Optimal approximation of discrete probability distribution with kth-order dependency and its application to combining multiple classifiers. Pattern Recognition Letters. 18:1997;515-523.
22. Kittler J., Hojjatoleslami A., Windeatt T. Strategies for combining classifiers employing shared and distinct pattern representations. Pattern Recognition Letters. 18:1997;1373-1377.
23. Kittler J., Matas J., Jonsson K., Ramos Sánchez M.U. Combining evidence in personal identity verification systems. Pattern Recognition Letters. 18:1997;845-852.
24. Kittler J., Hatef M., Duin R.P.W., Matas J. On combining classifiers. IEEE Transactions on Pattern Analalysis and Machine Intelligence. 20(3):1998;226-239.
25. Krishnapuram R., Lee J. Fuzzy-set-based hierarchical networks for information fusion in computer vision. Neural Networks. 4:1992;335-350.
26. Krogh, A., Vedelsby, J., 1995. Neural network ensembles, cross validation, and active learning. In: Tesauro, G., Touretzky, D.S., Leen, T.K. (Eds.), Advances in Neural Information Processing Systems 7. MIT Press, Cambridge, pp. 231-238.
27. Kuncheva, L., 1997. An application of OWA operators to the aggregation of multiple classification decisions. In: Yager, R., Kacprzyk, J. (Eds.), The Ordered Weighted Averaging Operators. Theory and Applications. Kluwer Academic Publishers, Dordrecht, pp. 330-343.
28. Kuncheva, L., Bezdek, J., Sutton, M., 1998. On combining multiple classifiers by fuzzy templates. In: Proceedings of the 1998 Annual Meeting of the North American Fuzzy Information Processing Society, NAFIPS'98, Pensacola FL, pp. 193-197.
29. Lam L., Suen C.Y. Optimal combination of pattern classifiers. Pattern Recognition Letters. 16:1995;945-954.
30. Le Hegarat-Mascle S., Bloch I., Vidal-Madjar D. Introduction of neighborhood information in evidence theory and application to data fusion of radar and optical images with partial cloud cover. Pattern Recognition. 31(11):1998;1811-1823.
31. Merz, C.J., Pazzani, M.J., 1997. Combining neural network regresion estimates with regularized linear weights. In: Mozer, M.C., Jordan, M.I., Petsche, T. (Eds.), Advances in Neural Information Processing Systems 9. MIT Press, Cambridge, pp. 564-570.
32. Mirhosseini A.R., Yan H., Lam K.-M., Pham T. Human face recognition: an evidence aggregation approach. Computer Vision and Image Understanding. 71(2):1998;213-230.
33. Munro, P.W., Parmanto, B., 1997. Competition among networks improves committee performance. In: Mozer, M.C., Jordan, M.I., Petsche, T. (Eds.), Advances in Neural Information Processing Systems 9. MIT Press, Cambridge, pp. 592-598.
34. Perrone, M.P., Cooper, L.N., 1993. When networks disagree: Ensamble method for neural networks. In: Mammone, R.J. (Ed.), Neural Networks for Speech and Image Processing. Chapman and Hall, London.
35. Pham, T., Yan, H., 1997. Fusion of handwritten numeral classifiers based on fuzzy and genetic algorithms. In: Proceedings of the 1997 Annual Meeting of the North American Fuzzy Information Processing Society, NAFIPS'97, New York, pp. 257-262.
36. Rogova G. Combining the results of several neural network classifiers. Neural Networks. 7(5):1994;777-781.
37. Shi H., Gader P.D., Chen W. Fuzzy integral filters: Properties and parallel implementation. Real-Time Imaging. 4(4):1998;233-241.
38. Sollich, P., Krogh, A., 1996. Learning with ensembles: How over-fitting can be useful. In: Touretzky, D.S., Mozer, M.C., Hasselmo, M.E. (Eds.), Advances in Neural Information Processing Systems 8. MIT Press, Cambridge, pp. 190-197.
39. Sugeno, M., 1977. Fuzzy measures and fuzzy integrals: A survey. In: Automata and Decision Making. North Holland, Amsterdam, pp. 89-102.
40. Tahani H., Keller J.M. Information fusion in computer vision using the fuzzy integral. IEEE Transactions on Systems, Man and Cybernetics. 20(3):1990;733-741.
41. Taniguchi M., Tresp V. Averaging regularized estimators. Neural Computation. 9:1997;1163-1178.
42. Tresp, V., Taniguchi, M., 1995. Combining estimators using non-constant weighting functions. In: Tesauro, G., Touretzky, D.S., Leen, T.K. (Eds.), Advances in Neural Information Processing Systems 7. MIT Press, Cambridge.
43. Verikas, A., Signahl, M., Malmqvist, K., Bacauskiene, M., 1997. Fuzzy committee of experts for segmentation of colour images. In: Proceedings of Fifth European Congress on Intelligent Techniques and Soft Computing, Aachen, Germany, Vol. 3, pp. 1902-1906.
44. Verikas A., Malmqvist K., Bergman L., Signahl M. Colour classification by neural networks in graphic arts. Neural Computing and Applications. 7:1998;52-64.
45. Wang, L., Chen, K., Chi, H., 1997. Methods of linear combination based on different features. In: Proceedings of the International Conference on Neural Information Processing, Dunedin, New Zealand, Vol. 2, pp. 1088-1091.
46. Waterhouse, S., Cook, G., 1997. Ensemble methods for phoneme classification. In: Mozer, M.C., Jordan, M.I., Petsche, T. (Eds.), Advances in Neural Information Processing Systems 9. MIT Press, Cambridge, pp. 800-806.
47. Woods K., Kegelmeyer W.P., Bowyer K. Combination of multiple classifiers using local accuracy estimates. IEEE Transactions on Pattern Analysis and Machine Intelligence. 19(4):1997;405-410.
48. Xu L., Krzyzak A., Suen C.Y. Methods for combining multiple classifiers and their applications to handwriting recognition. IEEE Transactions on Systems, Man, and Cybernetics. 22(3):1992;418-435.
49. Yager, R.R., Filev, D.P., 1994. On a fexible structure for fuzzy systems models. In: Yager, R.R., Zadeh, L.A. (Eds.), Fuzzy Sets, Neural Networks, and Soft Computing. Van Nostrand Reinhold, New York.
50. Zimmermann H.J., Zysno P. Latent connectives in human decision making. Fuzzy Sets and Systems. 4(1):1980;37-51.
51. Zimmermann H.J., Zysno P. Decisions and evaluations by hierarchical aggregation of information. Fuzzy Sets and Systems. 10(3):1984;243-260.