Classifier combination and score level fusion: Concepts and practical aspects

International Journal of Image and Data Fusion

Volumn 1, Issue 2, 2010, Pages 113-135

  Chitroub, Salim ^a  

^a UNIVERSITY OF SCIENCES AND TECHNOLOGY HOUARI BOUMEDIENE   (Algeria)

Author keywords

Classification; Classifier combination; Data fusion; Image processing; Remote sensing; Score level fusion

Indexed keywords

EID: 79958710628     PISSN: 19479832     EISSN: 19479824     Source Type: Journal    
DOI: 10.1080/19479830903561944     Document Type: Review

References (62)

1. Abidi, M.A. and Gonzalez, R.C., 1992. Data fusion in robotics and machine intelligence. New York: Academic Press.
2. Agresti, A., 1996. An introduction to categorical data analysis. New Jersey: John Wiley.
3. Alkoot, F.M. and Kittler, J., 2000. Multiple expert system design by combined feature selection and probability level fusion. International conference on fusion, Paris, France, 34-41.
4. Arrow, K.J., 1963. Social choice and individual value. 2nd ed. New York: John Wiley and Sons.
5. Battiti, R. and Colla, A.M., 1994. Democracy in neural nets: voting schemes for classification. Neural Networks, 7, 691-707.
6. Bendjebour, A., et al., 2001. Multisensor image segmentation using Dempster-Shafer fusion in Markov fields context. IEEE Transactions on Geoscience and Remote Sensing, 39 (8), 1789-1798.
7. Benediktsson, J.A. and Kanellopoulos, I., 1999. Classification of multisource and hyperspectral data based on decision fusion. IEEE Transactions on Geoscience and Remote Sensing, 37 (3), 1367-1377.
8. Benediktsson, J.A., Sveinsson, J.R., and Swain, P.H., 1997. Hybrid consensus theoretic classification. IEEE Transactions on Geoscience and Remote Sensing, 35 (4), 833-843.
9. Benediktsson, J.A. and Swain, P.H., 1992. Consensus theoretic classification methods. IEEE Transactions on Systems, Man and Cybernetics, 22 (8), 1789-1798.
10. Blum, R.S. and Liu, Z., 2006. Multi-sensor image fusion and its applications. Florida: Taylor and Francis Group, CRC Press.
11. Bonnin, P., et al., 1995. A new way of image data fusion: the multi-spectral co-operative segmentation. Proceedings of IEEE international conference on image processing (ICIP), Washington, 572-575.
12. Briem, G.J., Benediktsson, J.A., and Sveinsson, J.R., 2002. Multiple classifiers applied to multisource remote sensing data. IEEE Transactions on Geoscience and Remote Sensing, 40 (10), 2291-2299.
13. Bunke, H. and Kendel, A., 2002. Hybrid methods in pattern recognition, Volume 47 of Machine perception and artificial intelligence. New Jersey: World Scientific.
14. Chiang, C. and Fu, H., 1994. A divide-and-conquer methodology for modular supervised neural network design. Proceedings of world congress on computational intelligence, Orlando, 119-124.
15. Chitroub, S., 2004. Combinaison de classifieurs: une approche pour l'amélioration de la classification d'images multisources/multidates de télédétection. Revue Télédétection, 4 (3), 289-301.
16. Chitroub, S., Houacine, A., and Sansal, B., 1999. Supervised fusion-classification of multispectral images using fuzzy sets theory. IEE international conference on image processing and its application (IPA'99), 13-17 July 1999 Manchester, 96-97.
17. Chitroub, S., Houacine, A., and Sansal, B., 2000. Bayesian combination method of classifiers for cluster validation problem. Proceedings of SPIE, EUROPTO series, image and signal processing for remote sensing conference, 21-25 September 2000 Barcelona, 325-336.
18. Chitroub, S., Houacine, A., and Sansal, B., 2001. Evidential reasoning-based classification method for remotely sensed images. Proceedings of SPIE, image and signal processing for remote sensing conference, 18-21 September 2001 Toulouse, 340-351.
19. Cho, S. and Kim, J.H., 1995. Combining multiple neural networks by fuzzy integral for robust classification. IEEE Transactions on Systems, Man and Cybernetics, 25, 380-384.
20. Clemen, R.T., 1989. Combining forecasts: a review and annotated bibliography. International Journal of Forecasting, 5, 559-583.
21. Dalponte, M., Bruzzone, L., and Gianelle, D., 2008. Fusion of hyperspectral and LIDAR remote sensing data for classification of complex forest areas. IEEE Transactions on Geoscience and Remote Sensing, 46 (5), 1416-1427.
22. Drucker, H., et al., 1994. Boosting and other ensemble methods. Neural Computation, 6 (6), 1289-1301.
23. Duda, R.O., Hart, P.E., and Stork, D.G., 2001. Pattern classification. New York: John Wiley & Sons.
24. Ennaji, A., 1993. Classification et parallélisme en reconnaissance optique de caractères. Thesis (PhD). Universitéde Rouen.
25. Fauvel, M., Chanussot, J., and Benediktsson, J.A., 2006. Decision fusion for the classification of urban remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 44 (10), 2828-2838.
26. Ghosh, J., 2002. Multiclassifier systems: back to the future. Proceedings of third international workshop on multiple classifier systems, Cagliari, 1-15.
27. Ho, T.K., 2002. Multiple classifier combination: lessons and next Steps. In: H. Brunke and A. Kendel, eds. Hybrid methods in pattern recognition. New Jersey: World Scientific, 171-198.
28. Ho, T.K., Hull, J.J., and Srihari, S.N., 1994. Decision combination in multiple classifier systems. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16 (1), 66-75.
29. Huang, Y.S. and Suen, C.Y., 1995. A method of combining multiple experts for the recognition of unconstrained handwritten numerals. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17, 90-94.
30. Huber, P.J., 1981. Robust statistics. New York: John Wiley and Sons.
31. Iyengar, S.S., Prasad, L., and Min, H., 1995. Advanced in distributed senor technology. Upper Saddle River, NJ: Prentice Hall.
32. Jacobs, R.A., et al., 1991. Adaptive mixtures of local experts. Neural Computation, 3 (1), 79-87.
33. Ji, C. and Ma, S., 1997. Combinations of weak classifiers. IEEE Transactions on Neural Networks, 8, 32-42.
34. Kang, H., Kim, K., and Kim, J.H., 1997. Optimal approximation of discrete probability distribution with kth-order dependency and its application to combining multiple classifiers. Pattern Recognition Letters, 18, 515-523.
35. Kittler, J., 1998. Combining classifiers: a theoretical framework. Pattern Analysis and Application, 1, 18-27.
36. Kittler, J., et al., 1998. On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20 (3), 226-239.
37. Kumar, A. and Zhang, D., 2005. Biometric recognition using feature selection and combination. Proceedings of fifth international conference on audio and video-based biometric person authentication (AVBPA), Rye Brook, 813-822.
38. Kuncheva, L.I., Bezdek, J.C., and Duin, R.P.W., 2001. Decision templates for multiple classifier fusion: an experimental comparison. Pattern Recognition, 34 (2), 299-314.
39. Kuncheva, L.I., et al., 2003. Limits on the majority vote accuracy in classifier fusion. Pattern Analysis and Applications, 6 (1), 22-31.
40. Lam, L. and Suen, C.Y., 1997. Application of majority voting to pattern recognition: an analysis of its behaviour and performance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 553-568.
41. Le Hegarat-Mascle, S., Bloch, I., and Vidal-Madjar, D., 1997. Application of Dempster-Shafer evidence theory to unsupervised classification in multisource remote sensing. IEEE Transactions on Geoscience and Remote Sensing, 35 (4), 1018-1031.
42. Lehmann, E.L. and Romano, J.P., 2005. Testing statistical hypotheses. Berlin: Springer.
43. Milisavljevic, N. and Bloch, I., 2008. Possibilistic versus belief function fusion for antipersonnel mine detection. IEEE Transactions on Geoscience and Remote Sensing, 46 (5), 1488-1498.
44. Minsky, M., 1991. Logical versus analogical, or symbolic versus connectionist, or neat versus scruffy. Artificial Intelligence Magazine, 12 (2), 34-51.
45. Moobed, B., 1996. Combinaison de classifieurs, une nouvelle approche. Thesis (Phd). Ecole Polytechnique LIX, Universitéde Paris Sud UFR Scientifique d'Orsay.
46. Murofushi, T. and Ugeno, M., 1991. A theory of fuzzy measure: representations, the Choquet integral, and null sets. Journal of Mathematical Analysis and Applications, 159, 532-549.
47. Nadal, C., Legault, R., and Suen, C., 1990. Complementary algorithms for the recognition of totally unconstrained handwritten numerals. Proceedings of international conference on pattern recognition, Atlantic City, 443-449.
48. Pearl, J., Geiger, D., and Verma, T., 1989. Conditional independence and its representations. Kybernetika, 25 (2), 33-44.
49. Poh, N. and Bengio, S., 2005. How do correlation and variance of base-experts affect fusion in biometric authentication. IEEE Transactions on Signal Processing, 53 (11), 4384-4396.
50. Rogova, G., 1994. Combining the results of several neural network classifiers. Neural Networks, 7, 777-781.
51. Ross, A. and Govindarajan, R., 2005. Feature level fusion using hand and face niometrics. Proceedings of SPIE conference on biometric technology for human identification II, Orlando, 196-204.
52. Ross, A. and Jain, A.K., 2003. Information fusion in biometrics. Pattern Recognition Letters, 24 (13), 2115-2125.
53. Ross, A.A., Nandakumar, K., and Jain, A.K., 2006. Handbook of multi-biometrics. New York: Springer.
54. Sanderson, C. and Paliwal, K.K., 2002. Information fusion and person verification using speech and face information. Research Paper IDIAP-RR 02-33, IDIAP.
55. Shafer, G., 1976. A mathematical theory of evidence. Princeton, NJ: Princeton University Press.
56. Smets, P., 2000. Data fusion in transferable belief model. Proceedings of the 3rd international conference on information fusion, Paris, France, 21-33.
57. Tahani, H. and Keller, J.M., 1990. Information fusion in computer vision using the fuzzy integral. IEEE Transactions on Systems, Man and Cybernetics, 20, 733-741.
58. Tan, M., 1997. Multi-agent reinforcement learning: independent vs. cooperative learning. In: M.N. Huhns and M.P. Singh, eds. Reading in agents. San Francisco, USA: Morgan Kaufman, 487-494.
59. Wolpert, D.H., 1990. Stacked generalization. Technical Report LA-UR-90-3460. Los Alamos National Laboratory.
60. Woods, K., Bowyer, K., and Kegelmeyer, W.P., 1997. Combination of multiple classifiers using local accuracy estimates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19 (4), 405-410.
61. Xu, L., Krzyzak, A., and Suen, C., 1992. Methods of combining multiple classifiers and their applications to handwriting recognition. IEEE Transactions on Systems, Man, and Cybernetics, 22 (3), 418-435.
62. Zhou, J. and Pavlidis, T., 1994. Discrimination of characters by a multi-stage recognition process. Pattern Recognition, 27, 1539-1549.