The impact of diversity on the accuracy of evidential classifier ensembles

International Journal of Approximate Reasoning

Volumn 53, Issue 4, 2012, Pages 584-607

  Bi, Yaxin ^a  

^a UNIVERSITY OF ULSTER   (United Kingdom)

Author keywords

Belief functions; Diversity; Ensemble learning; Triplet evidence structure

Indexed keywords

BELIEF FUNCTION; CLASSIFIER ENSEMBLES; DEMPSTER'S RULE; DEMSPTER'S RULE; DIFFERENT ORDER; DIVERSITY; DIVERSITY MEASURE; ENSEMBLE LEARNING; ENSEMBLE PERFORMANCE; GENERALIZATION ERROR; MASS FUNCTIONS;

ARTIFICIAL INTELLIGENCE; SOFTWARE ENGINEERING;

UNCERTAINTY ANALYSIS;

EID: 84858795085     PISSN: 0888613X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijar.2011.12.011     Document Type: Article

References (37)

1. P.N. Bennett, S.T. Dumais, and E. Horvitz The combination of text classifiers using reliability indicators Journal Information Retrieval 8 1 2005 67 100 (Pubitemid 40965679)
2. P.A. Gislason, J.A. Benediktsson, and J.R. Sveinsson Decision fusion for the classification of urban remote sensing images Pattern Recognition Letters 27 2006 294 300
3. J. Suutala, and J. Roning Methods for person identification on a pressure-sensitive floor: experiments with multiple classifiers and reject option Information Fusion 9 1 2008 21 40 (Pubitemid 47589062)
4. P. Bonissone, J.M. Cadenas, M.C. Garrido, and R. Andrés Díaz-Valladares A fuzzy random forest International Journal of Approximate Reasoning 51 7 2010 729 747
5. P. Monney, M. Chan, and P. Romberg A belief function classifier based on information provided by noisy and dependent features International Journal of Approximate Reasoning 52 3 2011 335 352
6. G. Brown, L.I. Kuncheva, Good and bad diversity in majority vote ensembles, in: International Workshop on Multiple Classifier Systems, 2010.
7. Z.-H. Zhou, N. Li, Multi-information ensemble diversity, in: International Workshop on Multiple Classifier Systems, 2010.
8. L. Kuncheva, and C.J. Whitaker Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy Machine Learning 51 2003 181 207
9. G. Shafer A Mathematical Theory of Evidence 1976 Princeton University Press Princeton, NJ
10. A. Krogh, J. Vedelsby, Neural network ensembles, cross validation, and active learning, in: G. Tesauro, D.S. Touretzky, T.K. Leen (Eds.), Advances in Neural Information Processing Systems 7, NIPS Conference, Denver,Colorado, USA, 1995, pp. 231-238.
11. P. Melville, and R.J. Mooney Creating diversity in ensembles using artificial data Information Fusion 6 2005 99 111
12. E.K. Tang, P.N. Suganthan, and X. Yao An analysis of diversity measures Machine Learning 65 1 2006 247 271 (Pubitemid 44451200)
13. R.E. Schapire, Y. Freund, P. Bartlett, and W.S. Lee Boosting the margin: a new explanation for the effectiveness of voting methods The Annals of Statistics 26 1998 1651 1686 (Pubitemid 128376902)
14. Ph. Smets The combination of evidence in the transferable belief model IEEE Transactions on Pattern Analysis and Machine Intelligence 12 5 1990 447 458 (Pubitemid 20702887)
15. Ph. Smets Analyzing the combination of conflicting belief functions Information Fusion 8 2007 387 412
16. W. Liu Analyzing the degree of conflict among belief functions Artificial Intelligence 170 11 2006 909 924 (Pubitemid 44037538)
17. Y. Bi An efficient triplet-based algorithm for evidential reasoning International Journal of Intelligent Systems 23 4 2008 1 34
18. Y. Bi, J. Guan, and D. Bell The combination of multiple classifiers using an evidential approach Artificial Intelligence 17 2008 1731 1751
19. Y. Bi, D. Bell, H. Wang, G. Guo, and J. Guan Combining multiple classifiers using Dempster's rule for text categorization Applied Artificial Intelligence 21 3 2007 211 239 (Pubitemid 46417501)
20. Y. Bi, and S. Wu Measuring impact of diversity of classifiers on the accuracy of evidential ensemble classifiers IPMU 1 2010 238 247
21. S.S. Anand, D. Bell, and J.G. Hughes EDM: a general framework for data mining based on evidence theory Data Knowledge Engineering 18 3 1996 189 223 (Pubitemid 126375298)
22. R.R. Yager On the Dempster-Shafer framework and new combination rules Information Science 41 1987 93 137
23. D. Dubois, and H. Prade On the unicity of Dempster's rule of combination International Journal Intelligent System 1 1986 133 142
24. L. Zhang Representation, independence, and combination of evidence in the Dempster-Shafer theory R.R. Yager, J. Kacprzyk, M. Fedrizzi, Advances in the Dempster-Shafer Theory of Evidence 1994 John Wiley & Sons New York 51 69
25. J. Gordon, and E.H. Shortliffe A method for managing evidential reasoning in a hierarchical hypothesis space Artificial Intelligence 26 1985 323 357 (Pubitemid 15524384)
26. T. Denoeux Conjunctive and disjunctive combination of belief functions induced by nondistinct bodies of evidence Artificial Intelligence 172 2-3 2008 234 264 (Pubitemid 350256729)
27. B. Quost, M.-H. Masson, and T. Denoeux Classifier fusion in the Dempster-Shafer framework using optimized t-norm based combination rules International Journal of Approximate Reasoning 52 3 2011 353 374
28. E. Lefevre, O. Colot, and P. Vannoorenberghe Belief function combination and conflict management Information Fusion 3 2002 149 162
29. D. Skalak, The sources of increased accuracy for two proposed boosting algorithms, in: Proc. American Association for Artificial Intelligence, AAAI-96, Integrating Multiple Learned Models Workshop, 1996.
30. R. Kohavi, and D. Wolpert Bias plus variance decomposition for zero-one loss functions L. Saitta, Machine Learning: Proc. 13th International Conference 1996 Morgan Kaufman 275 283
31. J.L. Fleiss, and J. Cuzick The reliability of dichotomous judgments: unequal numbers of judgments per subject Applied Psychological Measurement 3 1979 537 542
32. G. Yule On the association of attributes in statistics Philosophical Transactions of the Royal Society A 194 1900 257 319
33. D.D. Margineantu, and T.G. Dietterich Pruning adaptive boosting Proceedings of the 14th International Conference on Machine Learning 1997 Morgan Kaufman
34. T. Ho The random space method for constructing decision forests IEEE Transactions on Pattern Analysis and Machine Intelligence 20 8 1998 832 844 (Pubitemid 128741345)
35. K. Tumer and J. Ghosh, Linear and order statistics combiners for pattern classification, in: A. Sharkey (Ed.), Combining Artificial Neural Nets, 1999, pp. 127-161.
36. C.L. Blake, C.J.E. Keogh, Uci repository of machine learning databases, .
37. I.H. Witten, and E. Frank Data Mining: Practical Machine Learning Tools and Techniques second ed. 2005 Morgan Kaufmann San Francisco