Decision Tree Induction Based on Efficient Tree Restructuring

Machine Learning

Volumn 29, Issue 1, 1997, Pages 5-44

  Utgoff, Paul E ^a   Berkman, Neil C ^b   Clouse, Jeffery A ^c  

^a Biologically Inspired Neural and Dynamical Systems Laboratory   (United States)

^b Corvid Corp ^*  (United States)

^c North Carolina Agricultural and Technical State University   (United States)

Author keywords

Binary test; Decision tree; Direct metric; Example incorporation; Incremental induction; Installed test; Missing value; Tree transposition; Update cost; Virtual pruning

Indexed keywords

COMPUTATIONAL COMPLEXITY; TREES (MATHEMATICS);

DECISION TREE; INCREMENTAL TREE INDUCTION (ITI);

DECISION THEORY;

EID: 0031246271     PISSN: 08856125     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1007413323501     Document Type: Article

References (25)

1. Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984). Classification and regression trees. Belmont, CA: Wadsworth International Group.
2. Cockett, J. R. B., & Herrera, J. A. (1990). Decision tree reduction. Journal of the ACM, 37, 815-842.
3. Crawford, S. L. (1989). Extensions to the CART algorithm. International Journal of Man-Machine Studies, 31, 197-217.
4. Fayyad, U. M. (1991). On the induction of decision trees for multiple concept learning. Doctoral dissertation, Computer Science and Engineering, University of Michigan.
5. Fayyad, U. M., & Irani, K. B. (1992). On the handling of continuous-valued attributes in decision tree generation. Machine Learning, 8, 87-102.
6. Fisher, D. (1996). Iterative optimization and simplification of hierarchical clusterings. Journal of Artificial Intelligence Research, 4, 147-178.
7. Kalles, D., & Morris, T. (1996). Efficient incremental induction of decision trees. Machine Learning, 24, 231-242.
8. Kohavi, R. (1995). The power of decision tables. Proceedings of the European Conference on Machine Learning.
9. Lovell, B. C., & Bradley, A. P. (1996). The multiscale classifer. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18, 124-137.
10. Mooney, R., Shavlik, J., Towell, G., & Gove, A. (1989). An experimental comparison of symbolic and connectionist learning algorithms. Proceedings of the Eleventh International Joint Conference on Artificial Intelligence (pp. 775-780). Detroit, Michigan: Morgan Kaufmann.
11. Murphy, P. M., & Aha, D. W. (1994). UCI repository of machine learning databases, Irvine, CA: University of California, Department of Information and Computer Science.
12. Pazzani, M., Merz, C., Murphy, P., Ali, K., Hume, T., & Brunk, C. (1994). Reducing misclassification costs. Machine Learning: Proceedings of the Eleventh International Conference (pp. 217-225). New Brunswick, NJ: Morgan Kaufmann.
13. Quinlan, J. R., & Rivest, R. L. (1989). Inferring decision trees using the minimum description length principle. Information and Computation, 80, 227-248.
14. Quinlan, J. R. (1993). C4.5: Programs for machine learning. San Mateo, CA: Morgan Kaufmann.
15. Rissanen, J. (1978). Modeling by shortest data description. Automatica, 14, 465-471.
16. Schlimmer, J. C., & Fisher, D. (1986). A case study of incremental concept induction. Proceedings of the Fifth National Conference on Artificial Intelligence (pp. 496-501). Philadelpha, PA: Morgan Kaufmann.
17. Steel, R. G. D., & Torrie, J. H. (1960). Principles and procedures of statistics. New York, NY: McGraw-Hill.
18. Tan, M., & Schlimmer, J. C. (1990). Two case studies in cost-sensitive concept acquisition. Proceedings of the Eighth National Conference on Artificial Intelligence (pp. 854-860). Boston, MA: Morgan Kaufmann.
19. Utgoff, P. E. (1989). Incremental induction of decision trees. Machine Learning, 4, 161-186.
20. Utgoff, P. E. (1994). An improved algorithm for incremental induction of decision trees. Machine Learning: Proceedings of the Eleventh International Conference (pp. 318-325). New Brunswick, NJ: Morgan Kaufmann.
21. Utgoff, P. E., & Clouse, J. A. (1996). A Kolmogorov-Smirnoff metric for decision tree induction, (Technical Report 96-3), Amherst, MA: University of Massachusetts, Department of Computer Science.
22. Van de Velde, W. (1990). Incremental induction of topologically minimal trees. Proceedings of the Seventh International Conference on Machine Learning (pp. 66-74). Austin, TX: Morgan Kaufmann.
23. Walpole, R. E. (1974). Introduction to statistics. New York: Macmillan.
24. White, A. P., & Liu, W. Z. (1994). Bias in information-based measures in decision tree induction. Machine Learning, 15, 321-329.
25. Wirth, N. (1976). Algorithms + data structures = programs. Englewood Cliffs, NJ: Prentice-Hall.