Classifier fusion in the Dempster-Shafer framework using optimized t-norm based combination rules

International Journal of Approximate Reasoning

Volumn 52, Issue 3, 2011, Pages 353-374

  Quost, Benjamin ^a   Masson, Marie Hélne ^a   Denœux, Thierry ^a  

^a CNRS   (France)

Author keywords

Belief functions; Cautious rule; Classifier ensemble; Pattern recognition; Theory of evidence; Transferable belief model

Indexed keywords

BELIEF FUNCTION; CAUTIOUS RULE; CLASSIFIER ENSEMBLE; THEORY OF EVIDENCE; TRANSFERABLE BELIEF MODEL;

CLUSTERING ALGORITHMS; MATHEMATICAL OPERATORS; OPTIMIZATION; PATTERN RECOGNITION; UNCERTAINTY ANALYSIS;

CLASSIFIERS;

EID: 79551686194     PISSN: 0888613X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijar.2010.11.008     Document Type: Article

References (64)

1. A. Aregui, and T. Denœux Constructing consonant belief functions from sample data using confidence sets of pignistic probabilities International Journal of Approximate Reasoning 49 3 2008 575 594
2. Y. Bi, J. Guan, and D. Bell The combination of multiple classifiers using an evidential reasoning approach Artificial Intelligence 172 15 2008 1731 1751
3. P. Bonissone, J.M. Cadenas, M.C. Garrido, and R. Andrés Díaz-Valladares A fuzzy random forest International Journal of Approximate Reasoning 51 7 2010 729 747
4. L. Breiman Bagging predictors Machine Learning 24 2 1996 123 140
5. L. Breiman Random forests Machine Learning 45 2001 5 32
6. L. Breiman, J.H. Friedman, R.A. Olshen, and C.J. Stone Classification and Regression Trees 1984 Wadsworth
7. G. Brown, J. Wyatt, R. Harris, and X. Yao Diversity creation methods: a survey and categorisation Information Fusion 6 2005 5 20
8. S. Cho, and J. Kim Combining multiple neural networks by fuzzy integral for robust classification IEEE Transactions on System, Man and Cybernetics 25 2 1995 380 384
9. A.P. Dempster Upper and lower probabilities induced by a multivalued mapping Annals of Mathematical Statistics 38 1967 325 339
10. T. Denœux A k-nearest neighbor classification rule based on Dempster-Shafer theory IEEE Transactions on Systems, Man and Cybernetics 25 05 1995 804 813
11. T. Denœux Analysis of evidence-theoretic decision rules for pattern classification Pattern Recognition 30 7 1997 1095 1107
12. T. Denœux A neural network classifier based on Dempster-Shafer theory IEEE Transactions on System, Man and Cybernetics 30 2 2000 131 150
13. T. Denœux, The cautious rule of combination for belief functions and some extensions, in: Proceedings of the 9th International Conference on Information Fusion, Florence, Italy, 2006.
14. T. Denœux Conjunctive and disjunctive combination of belief functions induced by non-distinct bodies of evidence Artificial Intelligence 172 2008 234 264
15. T. Denœux, and M.-H. Masson EVCLUS: evidential clustering of proximity data IEEE Transactions on Systems, Man and Cybernetics B 34 1 2004 95 109
16. T.G. Dietterich Approximate statistical tests for comparing supervised classification algorithms Neural Computation 10 7 1998 1895 1923
17. T.G. Dietterich Ensemble methods in machine learning Multiple classifier systems LNCS 1857 2000 Springer-Verlag 1 15
18. T.G. Dietterich An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization Machine Learning 40 2000 139 157
19. D. Dubois, and H. Prade A set-theoretic view of belief functions: logical operations and approximations by fuzzy sets International Journal of General Systems 12 3 1986 193 226
20. D. Dubois, H. Prade, and P. Smets A definition of subjective possibility International Journal of Approximate Reasoning 48 2 2008 352 364
21. Z. Elouedi, K. Mellouli, and Ph. Smets Assessing sensor reliability for multisensor data fusion within the Transferable Belief Model IEEE Transactions on Systems, Man and Cybernetics B 34 1 2004 782 787
22. E. Gatnar Cluster and select approach to classifier fusion Advances in Data Analysis 2007 Springer-Verlag Berlin, Heidelberg 59 66
23. H. Guo, W. Shi, and Y. Deng Evaluating sensor reliability in classification problems based on evidence theory IEEE Transactions on Systems, Man and Cybernetics B 36 5 2006 970 981
24. M. Ha-Duong Hierarchical fusion of expert opinions in the Transferable Belief Model, application to climate sensitivity International Journal of Approximate Reasoning 49 3 2008 555 574
25. L.K. Hansen, and P. Salamon Neural network ensembles IEEE Transactions on Pattern Analysis and Machine Intelligence 12 10 1990 993 1000
26. A.K. Jain, and R.C. Dubes Algorithms for Clustering Data 1988 Prentice-Hall Englewood Cliffs, NJ
27. A.-L. Jousselme, D. Grenier, and É. Bossé A new distance between two bodies of evidence Information Fusion 2 2001 91 101
28. A. Kallel, and S. Le Hégarat-Mascle Combination of partially non-distinct beliefs: the cautious-adaptive rule International Journal of Approximate Reasoning 50 7 2009 1000 1021
29. J. Kittler, M. Hatef, R. Duin, and J. Matas On combining classifiers IEEE Transactions on Pattern Analysis and Machine Intelligence 20 3 1998 226 239
30. J. Klein, C. Lecomte, and P. Miché Hierarchical and conditional combination of belief functions induced by visual tracking International Journal of Approximate Reasoning 51 4 2010 410 428
31. E.P. Klement, R. Mesiar, and E. Pap Triangular Norms 2000 Kluwer Academic Publishers Dordrecht
32. L. Kuncheva, J. Bezdek, and R. Duin Decision templates for multiple classifier fusion: an experimental comparison Pattern Recognition 34 2 2001 299 314 (Pubitemid 32871876)
33. L.I. Kuncheva, M. Skurichina, and R.P.W. Duin An experimental study on diversity for bagging and boosting with linear classifiers Information Fusion 3 2002 245 258
34. L.I. Kuncheva, and C.J. Whitaker Measures of diversity in classifier ensembles Machine Learning 51 2003 181 207
35. C.A. Le, V.-N. Huynh, A. Shimazu, and Y. Nakamori Combining classifiers for word sense disembiguation based on Dempster-Shafer theory and OWA operators Data and Knowledge Engineering 63 2 2007 381 396
36. E.J. Mandler, and J. Schurmann Combining the classification results of independent classifiers based on Dempster-Shafer theory of evidence Pattern Recognition and Artificial Intelligence 10 1988 381 393
37. M.-H. Masson, and T. Denoeux RECM: relational evidential c-means algorithm Pattern Recognition Letters 30 11 2009 1015 1026
38. G.J. McLachlan Discriminant Analysis and Statistical Pattern Recognition 1992 John Wiley & Sons New York
39. D. Mercier, G. Cron, T. Denoeux, M. Masson, Fusion of multi-level decision systems using the Transferable Belief Model, in: Proceedings of FUSION'2005, Philadelphia, USA, 2005.
40. D. Mercier, E. Lefvre, F. Delmotte, Belief functions contextual discounting and canonical decompositions, International Journal of Approximate Reasoning, in press.
41. D. Mercier, B. Quost, and T. Denœux Refined modeling of sensor reliability in the belief function framework using contextual discounting Information Fusion 9 2 2008 246 258
42. F. Pichon, T. Denœux, T-norm and uninorm-based combination of belief functions, in: Proceedings of the International Conference of the North American Fuzzy Information Processing Society (NAFIPS '08), 2008, pp. 19-22.
43. F. Pichon, and T. Denœux The unnormalized Dempster's rule of combination: a new justification from the least commitment principle and some extensions Journal of Automated Reasoning 45 1 2010 61 87
44. N.J. Pizzi, W. Pedrycz, Aggregating multiple classification results using fuzzy integration and stochastic feature selection, International Journal of Approximate Reasoning, in press. doi:10.1016/j.ijar.2010.05.003.
45. B. Quost, T. Denœux, and M.-H. Masson Pairwise classifier combination using belief functions Pattern Recognition Letters 28 5 2007 644 653
46. B. Quost, T. Denœux, M.-H. Masson, Adapting a combination rule to non-independent information sources, in: L. Magdalena, M. Ojeda-Aciego, J.L. Verdegay (Eds.), Proceedings of the 12th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems (IPMU'08), Málaga, Spain, 2008, pp. 448-455.
47. B. Quost, M.-H. Masson, T. Denœux, Refined classifier combination using belief functions, in: Proceedings of the 10th International Conference on Information Fusion (Fusion'08), Cologne, Germany, 2008, pp. 776-782.
48. M. Reformat, and R. Yager Building ensemble classifiers using belief functions and OWA operators Soft Computing 12 6 2008 543 558
49. G. Rogova Combining the results of several neural network classifiers Neural Networks 7 5 1994 777 781
50. D. Ruta, and B. Gabrys New measure of classifier dependency in multiple classifier systems Multiple Classifier Systems LNCS 2364 2002 Springer-Verlag Berlin, Heidelberg 127 136
51. D. Ruta, and G. Gabrys Classifier selection for majority voting Information Fusion 6 1 2005 63 81
52. R.E. Schapire, Y. Freund, P. Bartlett, and W.S. Lee Boosting the margin: a new explanation for the effectiveness of voting methods Annals of Statistics 26 5 1998 1651 1686
53. G. Shafer A Mathematical Theory of Evidence 1976 Princeton University Press Princeton, NJ
54. A.J.C. Sharkey, and Noel E. Sharkey Combining diverse neural nets The Knowledge Engineering Review 12 1997 231 247
55. D. Skalak, The sources of increased accuracy for two proposed boosting algorithms, in: Proceedings of the American Association for Artificial Intelligence (AAAI'96), Integrating Multiple Learned Models Workshop, 1996, pp. 120-125.
56. P. Smets The combination of evidence in the Transferable Belief Model IEEE Transactions on Pattern Analysis and Machine Intelligence 12 1990 447 458
57. P. Smets Belief functions: the disjunctive rule of combination and the generalized Bayesian theorem International Journal of Approximate Reasoning 9 1 1993 1 35
58. P. Smets, The canonical decomposition of a weighted belief, in: Proceedings of the International Joint Conferences in Artificial Intelligence, Montréal, Canada, 1995, pp. 1896-1901.
59. P. Smets, and R. Kennes The Transferable Belief Model Artificial Intelligence 66 2 1994 191 234
60. K. Tumer, and J. Ghosh Error correlation and error reduction in ensemble classifiers Connection Science 3-4 8 1996 385 404
61. A. Ulas, M. Semerci, O.T. Yildiz, and E. Alpaydin Incremental construction of classifier and discriminant ensembles Information Sciences 179 2009 1298 1318
62. D.H. Wolpert Stacked generalization Neural Networks 5 1992 241 259
63. L. Xu, A. Krzyzak, and C.Y. Suen Methods of combining multiple classifiers and their applications to handwriting recognition IEEE Transactions on System, Man and Cybernetics 22 1992 418 435
64. C.Y. Suen, Y.S. Huang, and K. Liu The combination of multiple classifiers by a neural network approach International Journal of Pattern Recognition and Artificial Intelligence 9 3 1995 579 597