Decision trees as possibilistic classifiers

International Journal of Approximate Reasoning

Volumn 48, Issue 3, 2008, Pages 784-807

  Jenhani, Ilyes ^a   Amor, Nahla Ben ^a   Elouedi, Zied ^a  

^a UNIVERSITÉ DE TUNIS   (Tunisia)

Author keywords

Classification; Decision trees; Non specificity; Possibility theory

Indexed keywords

BUILDINGS; CLASSIFICATION (OF INFORMATION); DECISION THEORY; DECISION TREES; MATHEMATICAL MODELS; STANDARDIZATION; STANDARDS; TREES (MATHEMATICS);

ATTRIBUTE SELECTION; ATTRIBUTE VALUES; CLASSIFICATIO N PROBLEMS; ELSEVIER (CO); FLEXIBLE BUILDING; GAIN RATIOS; IMPERFECT DATA; IN ORDER; NON-SPECIFICITY; PAPER ADDRESSES; POSSIBILITY DISTRIBUTIONS; SHANNON ENTROPIES; STANDARD DECISION TREES;

DECISION MAKING;

EID: 45049085562     PISSN: 0888613X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ijar.2007.12.002     Document Type: Article

References (54)

1. Abellan J., and Moral S. Upper entropy of credal sets. Applications to credal classification. International Journal of Approximate Reasoning 39 2-3 (2005) 235-255
2. N. Ben Amor, S. Benferhat, Z. Elouedi, Qualitative classification and evaluation in possibilistic decision trees, in: Proceedings of the IEEE International Conference on Fuzzy Systems (FUZZ-IEEE'04), Budapest, Hungary, vol. 2, 2004, pp. 653-657.
3. Bezdek J.C., Dubois D., and Prade H. Fuzzy Sets in Approximate Reasoning and Information Systems. The Handbooks of Fuzzy Sets Series (1999), Kluwer Academic Publishers
4. C. Borgelt, J. Gebhardt, R. Kruse, Concepts for probabilistic and possibilistic induction of decision trees on real world data, in: Proceedings of the 4th European Congress on Fuzzy and Intelligent Technologies (EUFIT'96), Aachen, 1996, pp. 1556-1560.
5. Breiman L., Friedman J.H., Olshen R.A., and Stone C.J. Classification and Regression Trees (1984), Wadsworth & Brooks, Monterey, CA
6. Buntine W. Learning classification trees. In: Hand D. (Ed). Artificial Intelligence Frontiers in Statistics (1991), Chapman & Hall publishers, London 182-201
7. Ciampi A., Diday E., Lebbe J., Périnel E., and Vignes R. Growing a tree classifier with imprecise data. Pattern Recognition Letters 21 (2000) 787-803
8. Denoeux T. A k-nearest neighbor classification rule based on Dempster-Shafer theory. IEEE Transactions on Systems, Man and Cybernetics 25 05 (1995) 804-813
9. Denoeux T. A neural network classifier based on Dempster-Shafer theory. IEEE Transactions on Systems, Man, and Cybernetics, Part A 30 2 (2000) 131-150
10. Denoeux T., and Skarstein-Bjanger M. Induction of decision trees from partially classified data. Proceedings of the 2000 IEEE International Conference on Systems, Man and Cybernetics (SMC'00) (2000), IEEE, Nashville, TN 2923-2928
11. Denoeux T., and Zouhal L.M. Handling possibilistic labels in pattern classification using evidential reasoning. Fuzzy Sets and Systems 122 3 (2001) 47-62
12. Dubois D., and Prade H. Unfair coins and necessity measures: towards a possibilistic interpretation of histograms. Fuzzy Sets and Systems 10 1 (1985) 15-20
13. Dubois D., and Prade H. Possibility Theory: An Approach to Computerized Processing of Uncertainty (1988), Plenum Press, New York
14. Dubois D., and Prade H. Representation and combination of uncertainty with belief functions and possibility measures. Computational Intelligence 4 3 (1988) 244-264
15. Z. Elouedi, K. Mellouli, P. Smets, Decision trees using the belief function theory, in: Proceedings of the International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems (IPMU'2000), Madrid, Spain, 2000, pp. 141-148.
16. Elouedi Z., Mellouli K., and Smets P. Belief decision trees: theoretical foundations. International Journal of Approximate Reasoning 28 (2001) 91-124
17. Fayyad U.M., and Irani K.B. On the handling of continuous-valued attributes in decision tree generation. Machine Learning 8 (1992) 87-102
18. J.H. Friedman, R. Kohavi, Y. Yun, Lazy decision trees, in: Proceedings of the 13th National Conference on Artificial Intelligence, 1996, pp. 717-724.
19. J. Gebhardt, R. Kruse, Learning possibilistic networks from data, in: Proceedings of the 5th International Workshop on Artificial Intelligence and Statistics, Fort Lauderdale, 1995, pp. 233-244.
20. D. Harmanec, Measures of uncertainty and information. , 1999.
21. Hartley R.V. Transmission of information. Bell System Technical Journal 7 (1928) 535-563
22. Higashi M., and Klir G.J. Measures of uncertainty and information based on possibility distributions. International Journal of General Systems 9 1 (1983) 43-58
23. E. Hüllermeier, Possibilistic induction in decision tree learning, in: Proceedings of the 13th European Conference on Machine Learning (ECML'02), Helsinki, Finland, 2002, pp. 173-184.
24. Hüllermeier E. Possibilistic instance-based learning. Artificial Intelligence 148 1-2 (2003) 335-383
25. Hüllermeier E. Fuzzy methods in machine learning and data mining: status and prospects. Fuzzy Sets and Systems 156 3 (2005) 387-406
26. Janikow C.Z. Fuzzy decision trees: issues and methods. IEEE Transactions on Systems, Man and Cybernetics-Part B: Cybernetics 28 1 (1998) 1-14
27. I. Jenhani, Z. Elouedi, N. Ben Amor, K. Mellouli, Qualitative inference in possibilistic option decision trees, in: Proceedings of the 8th European Conference in Symbolic and Quantitative Approaches to Reasoning with Uncertainty (ECSQARU'05), Barcelona, Spain, 2005, pp. 944-955.
28. Kaburlasos V.G., Athanasiadis I.N., and Mitkas P.A. Fuzzy lattice reasoning (FLR) classifier and its application for ambient ozone estimation. International Journal of Approximate Reasoning 45 1 (2007) 152-188
29. Klir G.J., and Folger T.A. Fuzzy Sets, Uncertainty, and Information (1988), Prentice-Hall, Englewood Cliffs, NJ
30. G.J. Klir, M.J. Wierman, Uncertainty-Based Information: Elements of Generalized Information Theory, Studies in Fuzziness and Soft Computing, vol. 15, 1998.
31. R. Kohavi, C. Kunz, Option decision trees with majority votes, in: Proceedings of the 14th International Conference on Machine Learning (ICML'97), Nashville, TN, USA, 1997, pp. 161-169.
32. Kruse R., Gebhardt J., and Klawonn F. Foundations of Fuzzy Systems (1994), John Wiley and Sons, Chichester
33. S. Kwan, F. Olken, D. Rotem, Uncertain, incomplete, and inconsistent data in scientific and statistical databases, in: Proceedings of the Workshop on Uncertainty Management in Information Systems: From Needs to Solutions, Mallorca, Spain, 1992, pp. 64-91.
34. Mendonça L.F., Vieira S.M., and Sousa J.M.C. Decision tree search methods in fuzzy modeling and classification. International Journal of Approximate Reasoning 44 2 (2007) 106-123
35. A. Motro, Sources of uncertainty, imprecision and inconsistency in information systems, in: Proceedings of the Workshop on Uncertainty Management in Information Systems: From Needs to Solutions, 1996, pp. 9-34.
36. Moulin H. Axioms for Cooperative Decision-making (1988), Cambridge University Press
37. P.M. Murphy, D.W. Aha, UCI repository of machine learning databases, 1996. .
38. Olaru C., and Wehenkel L. A complete fuzzy decision tree technique. Fuzzy Sets and Systems 138 (2003) 221-254
39. Pedrycz W., and Sosnowski Z.A. The design of decision trees in the framework of granular data and their application to software quality models. Fuzzy Sets and Systems 123 (2001) 271-290
40. Quin Z., and Lawry J. Decision tree learning with fuzzy labels. Information Sciences 172 (2005) 91-129
41. Quinlan J.R. Induction of decision trees. Machine Learning 1 (1986) 81-106
42. J.R. Quinlan, Decision trees as probabilistic classifiers, in: Proceedings of the 4th International Workshop on Machine Learning, 1987, pp. 31-37.
43. Quinlan J.R. C4.5: Programs for Machine Learning (1993), Springer
44. Shannon C.E. The mathematical theory of communication. The Bell system Technical Journal 27 3 (1948) 379-423
45. Smets P., and Kennes R. The transferable belief model. Artificial Intelligence 66 (1994) 191-234
46. Trabelsi S., Elouedi Z., and Mellouli K. Pruning belief decision tree methods in averaging and conjunctive approaches. International Journal of Approximate Reasoning (2007) 10.1016/j.ijar.2007.02.004
47. P. Vannoorenbergue, T. Denoeux, Handling uncertain labels in multiclass problems using belief decision trees, in: Proceedings of the Ninth International Conference on Information processing and Management of Uncertainty in Knowledge-Based systems (IPMU'02), vol. III, Annecy, France, July 2002, pp. 1919-1926.
48. Walley P. Statistical Reasoning with Imprecise Probabilities (1991), Chapman and Hall, New York
49. Weiss S.M., and Kulikovski C.A. Computer Systems that Learn (1991), Morgan Kaufman, San Mateo, CA
50. Witten I.H., and Frank E. Data Mining: Practical Machine Learning Tools and Techniques. second ed. (2005), Morgan Kaufman publishers
51. Yager R.R. On the specificity of a possibility distribution. Fuzzy Sets and Systems 50 (1992) 279-292
52. Yuan Y., and Shaw M.J. Induction of fuzzy decision trees. Fuzzy Sets and Systems 69 (1995) 125-139
53. Zadeh L.A. Fuzzy sets as a basis for a theory of possibility. Fuzzy Sets and Systems 1 (1978) 3-28
54. Zemankova M., and Kandel A. Implementing imprecision in information systems. Information Sciences 37 1-3 (1985) 07-141