Reducing decision tree fragmentation through attribute value grouping: A comparative study

Intelligent Data Analysis

Volumn 4, Issue 3-4, 2000, Pages 255-274

  Ho, K M ^a   Scott, P D ^a  

^a UNIVERSITY OF ESSEX   (United Kingdom)

Author keywords

attribute value grouping; decision tree induction

Indexed keywords

ATTRIBUTE VALUES; CATEGORICAL ATTRIBUTES; CLASSIFICATION ACCURACY; COMPARATIVE STUDIES; DECISION TREE INDUCTION; GLOBAL METHODS; SUBSTANTIAL REDUCTION; TREE CONSTRUCTION;

DECISION TREES;

EID: 84863951803     PISSN: 1088467X     EISSN: 15714128     Source Type: Journal    
DOI: 10.3233/ida-2000-43-407     Document Type: Article

References (31)

1. C.L. Blake and C.J. Merz, UCI Repository of machine learning databases [http://www.ics.uci.edu/̃mlearn/MLRepository. html]. Irvine, CA: University of California, Department of Information and Computer Science, 1998.
2. E. Bloedorn and R.S. Michalski, Data-driven constructive induction, IEEE Expert: Intelligent Systems and their Applications, 1998, pp. 30-37.
3. L. Breiman, J.H. Freidman, R.A. Olshen and C.J. Stone, Classification and Regression Trees,Wadsworth, Pacific Grove, CA, 1984.
4. L.A. Breslow and D.W. Aha, Simplifying decision trees: A Survey, Knowlegde Engineering Review 12 (1997), 1-40.
5. J. Catlett, On changing continuous attributes into ordered discrete attributes, in: European Working Session on Learning: Lecture Notes in Artificial Intelligence 482, Y. Kodratoff, ed., Springer Verlag, 1991, pp. 164-178.
6. B. Cestnik, I. Konoenko and I. Bratko, A knowledge elicitation tool for sophisticated users, in: Progress in Machine Learning, I. Bratko and N. Lavrac, eds., Sigma Press, Wilmslow, UK, 1987.
7. P.A. Chou, Optimal partitioning of decision trees for classification and regression trees, IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(4) (1991), 340-354.
8. P.R. Cohen and D. Jensen, Overfitting explained, in: Proceedings of the Sixth International Workshop on Artificial Intelligence and Statistics, 1997, pp. 115-122.
9. P. Domingos and M. Pazzani, Beyond independence: Conditions for the optimality of of the simple Bayesian classifier, in: Proceedings of the Thirteenth International Conference on Machine Learning, Morgan Kaufmann, Los Altos, CA, 1996, pp. 105-112.
10. J. Dougherty, R. Kohavi and M. Sahami, Supervised and unsupervised discretisation of continuous features, in: Proceedings of the Twelfth International Conference on Machine Learning, Morgan Kaufmann, Los Altos, CA, 1995, pp. 194-202.
11. B.S. Everitt, Cluster Analysis (second ed.), Heinemann, London, 1980.
12. U.M. Fayyad, Branching on attribute values in decision tree generation, in: Proceedings of the Twelfth National Conference on Artificial Intelligence, AAAI Press, 1994, pp. 601-606.
13. U.M. Fayyad and K.B. Irani, The attribute selection problem in decision tree generation, in: Proceedings of the Tenth National Conference on Artificial Intelligence, AAAI Press, 1992, pp. 104-110.
14. U.M. Fayyad and K.B. Irani, Multi-interval discretisation of continuous-valued attributes for classification learning, in: Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence, Morgan Kaufmann, Los Altos, CA, 1993, pp. 1022-1027.
15. B.R. Gaines, Transforming rules and trees into comprehensible knowledge structures, in: Advances in Knowledge Discovery and Data Mining, U.M. Fayyad, G. Piatetsky-Shapiro, P. Smyth and R. Uthurusamy, eds., MIT Press, Cambridge, Massachusetts, 1996.
16. K.M. Ho, Discretisation and Defragmentation for Decision Tree Learning, Doctoral Thesis, University of Essex, Colchester, UK, 1999.
17. R. Kerber, Chimerge: Discretisation of numeric attributes, in: Proceedings of the Tenth National Conference on Artificial Intelligence, MIT Press, Cambridge, Massachusetts, 1992, pp. 123-128.
18. R. Kohavi, Bottom-up induction of oblivious read-once decision graphs, in: Proceedings of the Seventh European Conference on Machine Learning, Springer-Verlag, 1994, pp. 154-169.
19. I. Kononenko, On biases in estimating multi-valued attributes, in: Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, Morgan Kaufmann, Los Altos, CA, 1995.
20. D. Michie, D.J. Spiegelhalter and C.C. Taylor, Machine Learning, Neural and Statistical Classification, Ellis Horwood, New York, 1994.
21. MLC++ Machine Learning Library in C++, SUN MLC++ utilities v2.1, [http://www.sgi.com], Silicon Graphics Inc., 1998.
22. T. Oates and D. Jensen, The effects of training set size on decision tree complexity, in: Proceedings of the Sixth International Workshop on Artificial Intelligence and Statistics, 1997, pp. 379-390.
23. A.L. Oliveira and A.S. Vincentelli, Inferring reduced ordered decision graphs on minimum description length, in: Proceedings of the Twelfth International Conference on Machine Learning, Morgan Kaufmann, Los Altos, CA, 1995, pp. 421-429.
24. J.J. Oliver, Decision graphs: An extension of decision trees, in: Proceedings of the Fourth International Workshop on Artificial Intelligence and Statistics, 1993, pp. 343-350.
25. J.R. Quinlan, Induction of decision trees, Machine Learning 1(1) (1986), 81-106.
26. J.R. Quinlan, Generating production rules form decision trees, in: Proceedings of the Ninth Joint International Conference on Artificial Intelligence, Morgan Kaufmann, Los Altos, CA, 1987, pp. 304-307.
27. J.R. Quinlan, Programs for Machine Learning, Morgan Kaufmann, Los Altos, CA, 1993.
28. J.R. Quinlan, Improved use of continuous attributes in C4.5, Journal of Artificial Intelligence Research 4 (1996), 77-90.
29. P.D. Scott and E.Wilkins, Evaluating data mining procedures: Techniques for generating artificial data sets, Information and Software Technology 41(9) (1999), 579-589.
30. P.D. Scott, R.J. Williams and K.M. Ho, Forming categories in exploratory data analysis and data mining, in: Lecture Notes in Computer Science 1280. Advances in Intelligent Data Analysis, X. Liu, P. Cohen and M. Berthold, eds., Springer Verlag, 1997, pp. 235-246.
31. A. Webb, Statistical Pattern Recognition, Arnold, London, 1999.