The combination of multiple classifiers using an evidential reasoning approach

Artificial Intelligence

Volumn 172, Issue 15, 2008, Pages 1731-1751

  Bi, Yaxin ^a   Guan, Jiwen ^b   Bell, David ^b  

^a UNIVERSITY OF ULSTER   (United Kingdom)

^b QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

Author keywords

Combination functions; Dempster's rule of combination; Ensemble methods; Evidential reasoning; Evidential structures

Indexed keywords

LEARNING SYSTEMS;

COMBINATION FUNCTIONS; DEMPSTER'S RULE OF COMBINATION; ENSEMBLE METHODS; EVIDENTIAL REASONING; EVIDENTIAL STRUCTURES;

CLASSIFIERS;

EID: 50649109430     PISSN: 00043702     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.artint.2008.06.002     Document Type: Article

References (56)

1. Al-Ani A., and Deriche M. A new technique for combining multiple classifiers using the Dempster-Shafer theory of evidence. J. Artif. Intell. Res. 17 (2002) 333-361
2. J.A. Barnett, Computational methods for a mathematical theory of evidence, in: Proc. of 17th Joint Conference of Artificial Intelligence, 1981, pp. 868-875
3. C.L. Blake, C.J.E. Keogh, UCI repository of machine learning databases, http://www.ics.uci.edu/mlearn/MLRepository.html
4. Y. Bi, D. Bell, J.W. Guan, Combining evidence from classifiers in text categorization, in: Proc. of KES04, 2004, pp. 521-528
5. Y. Bi, Combining multiple classifiers for text categorization using the Dempster-Shafer theory of evidence, PhD thesis, University of Ulster, UK, 2004
6. Bell D., Guan J.W., and Bi Y. On combining classifiers mass functions for text categorization. IEEE Trans. Knowledge Data Engrg. 17 10 (2005) 1307-1319
7. Y. Bi, J.W. Guan, An efficient triplet-based algorithm for evidential reasoning, in: Proc. of the 22nd Conference on Uncertainty in Artificial Intelligence, 2006, pp. 31-38
8. Y. Bi, S.I. McClean, T. Anderson, On combining multiple classifiers using an evidential approach, in: Proc. of the Twenty-First National Conference on Artificial Intelligence (AAAI'06), 2006, pp. 324-329
9. Breiman L. Bagging predictors. Machine Learning 24 2 (1996) 123-140
10. Breiman L. Random forests. Machine Learning 45 1 (2001) 5-32
11. Dietterich T. Machine learning research: Four current directions. AI Magazine 18 4 (1997) 97-136
12. Dietterich T. An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization. Machine Learning 1 22 (1998)
13. T. Dietterich, Ensemble methods in machine learning, in: Proc. 2nd Int. Workshop on Multiple Classifier Systems MCS2000, LNCS, vol. 1857, 2000, pp. 1-15
14. Dempster A.P. Upper and lower probabilities induced by a multivalued mapping. Ann. Math. Stat. 38 (1967) 325-339
15. Denoeux T. Conjunctive and disjunctive combination of belief functions induced by nondistinct bodies of evidence. Artif. Intell. 172 2-3 (2008) 234-264
16. Denoeux T., and Ben Yaghlane A. Approximating the combination of belief functions using the fast Moebius transform in a coarsened frame. Internat. J. Approx. Reason. 31 1-2 (2002) 77-101
17. Denoeux T. A neural network classifier based on Dempster-Shafer theory. IEEE Trans. Systems Man Cybernet. A 30 2 (2000) 131-150
18. Denoeux T. A k-nearest neighbor classification rule based on Dempster-Shafer theory. IEEE Trans. Systems Man Cybern. 25 5 (1995) 804-813
19. R.P.W. Duin, D.M.J. Tax, Experiments with classifier combining rules, in: J. Kittler, F. Roli (Eds.), Multiple Classifier Systems, 2000, pp. 16-29
20. Dzeroski S., and Zenko B. Is combining classifiers with stacking better than selecting the best one?. Machine Learning 54 3 (2004) 255-273
21. Fleiss J.L., and Cuzick J. The reliability of dichotomous judgments: unequal numbers of judgments per subject. Appl. Psycholog. Meas. 3 (1979) 537-542
22. Y. Freund, R. Schapire, Experiments with a new boosting algorithm, in: Machine Learning: Proceedings of the Thirteenth International Conference, 1996, pp. 148-156
23. Guan J.W., and Bell D.A. Evidence Theory and Its Applications, vols. 1-2. Studies in Computer Science and Artificial Intelligence vols. 7-8 (1991-1992), Elsevier, North-Holland
24. J.W. Guan, D.A. Bell, Efficient algorithms for automated reasoning in expert systems, in: The 3rd IASTED International Conference on Robotics and Manufacturing, 1995, pp. 336-339
25. Haenni R. Are alternatives to Dempster's rule of combination real alternatives?: Comments on "about the belief function combination and the conflict management problem" Lefèvre et al. Information Fusion 3 3 (2002) 237-239
26. Hansen L.K., and Salamon P. Neural network ensembles. IEEE Trans. Pattern Anal. Machine Intell. 12 10 (1990) 993-1001
27. Ho T.K. The random subspace method for constructing decision forests. IEEE Trans. Pattern Anal. Machine Intell. 20 8 (1998) 832-844
28. Kittler J., Hatef M., Duin R.P.W., and Matas J. On combining classifiers. IEEE Trans. Pattern Anal. Machine Intell. 20 3 (1998) 226-239
29. L. Kuncheva, Combining classifiers: Soft computing solutions, in: S.K. Pal, A. Pal (Eds.), Pattern Recognition: From Classical to Modern Approaches, 2001, pp. 427-451
30. Kuncheva L., and Whitaker C.J. Measures of diversity in classifier ensembles. Machine Learning 51 (2003) 181-207
31. Jain A.K., Duin R.P.W., and Mao J. Statistical pattern recognition: A review. IEEE Trans. Pattern Anal. Machine Intell. 22 1 (2000) 4-37
32. Lam L., and Suen C.Y. Application of majority voting to pattern recognition: An analysis of its behavior and performance. IEEE Trans. Systems Man Cybernet. 27 5 (1997) 553-568
33. L.S. Larkey, W.B. Croft, Combining classifiers in text categorization, in: Proceedings of SIGIR-96, 19th ACM International Conference on Research and Development in Information Retrieval, 1996, pp. 289-297
34. Liu W., and Hong J. Reinvestigating Dempster's idea on evidence combination. Knowledge Inform. Syst. 2 2 (2000) 223-241
35. Liu W. Analyzing the degree of conflict among belief functions. Artif. Intell. 170 11 (2006) 909-924
36. Mandler E.J., and Schurmann J. Combining the classification results of independent classifiers based on Dempster-Shafer theory of evidence. Pattern Recogn. Artif. Intell. X (1988) 381-393
37. P. Melville, R.J. Mooney, Constructing diverse classifier ensembles using artificial training examples, in: Proc. of IJCAI-03, 2003, pp. 505-510
38. Mitchell T. Machine Learning (1997), McGraw Hill
39. Opitz D. Feature selection for ensembles. Proc. of AAAI-99 (1999), AAAI Press 379-384
40. Quost B., Denoeux T., and Masson M.-H. Pairwise classifier combination using belief functions. Pattern Recogn. Lett. 28 5 (2007) 644-653
41. Sebastiani F. Machine learning in automated text categorization. ACM Comput. Surv. 34 1 (2002) 1-47
42. Rogova G. Combining the results of several neural network classifiers. Neural Networks 7 5 (1994) 777-781
43. Shafer G., and Logan R. Implementing Dempster's rule for hierarchical evidence. Artif. Intell. 33 3 (1987) 271-298
44. Shafer G. Belief functions and possibility measures. In: Bezdek J.C. (Ed). The Analysis of Fuzzy Information, vol. 1: Mathematics and Logic (1987), CRC Press 51-84
45. Shafer G. A Mathematical Theory of Evidence (1976), Princeton University Press, Princeton, NJ
46. Ph. Smets, The combination of evidence in the Transferable Belief Model, IEEE Trans. Pattern Anal. Machine Intell. 12 (5) 447-458
47. Ting K.M., and Witten I.H. Issues in stacked generalization. J. Artif. Intell. Res. (JAIR) 10 (1999) 271-289
48. Tax D.M.J., van Breukelen M., Duin R.P.W., and Kittler J. Combining multiple classifiers by averaging or by multiplying. Pattern Recognition 33 9 (2000) 1475-1485
49. Tumer K., and Robust G.J. Combining of disparate classifiers through order statistics. Pattern Anal. Appl. 6 1 (2002) 41-46
50. Xu L., Krzyzak A., and Suen C.Y. Several methods for combining multiple classifiers and their applications in handwritten character recognition. IEEE Trans. System Man Cybernet. 2 3 (1992) 418-435
51. Zouhal L.M., and Denoeux T. An evidence-theoretic k-NN rule with parameter optimization. IEEE Trans. Systems Man Cybernet. C 28 2 (1998) 263-271
52. Y. Yang, T. Ault, T. Pierce, Combining multiple learning strategies for effective cross validation, in: Proc. of ICML'00, 2000, pp. 1167-1182
53. Voorbraak F. On the justification of Dempster's rule of combination. Artif. Intell. 48 2 (1991) 171-197
54. Webb G.I. MultiBoosting: A technique for combining boosting and wagging. Machine Learning 40 2 (2000) 159-196
55. Wolpert D. Stacked generalization. Neural Networks 5 2 (1992) 241-259
56. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques. second ed. (2005), Morgan Kaufmann, San Francisco