Generalization in decision trees and DNF: Does size matter?

Advances in Neural Information Processing Systems

Volumn , Issue , 1998, Pages 259-265

  Golea, Mostefa ^a   Bartlett, Peter L ^a   Lee, Wee Sun ^b   Mason, Llew ^a  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

^b UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

BOOLEAN FUNCTIONS; PROBABILITY DISTRIBUTIONS;

CONVEX COMBINATIONS; DECISION FUNCTIONS; HIGH PROBABILITY; MISCLASSIFICATION PROBABILITY; REAL-VALUED FUNCTIONS; TRAINING DATA; TRAINING EXAMPLE; TWO-LAYER;

DECISION TREES;

EID: 0041494283     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. P. L. Bartlett. For valid generalization, the size of the weights is more important than the size of the network. In Neural Information Processing Systems 9, pages 134-140. Morgan Kaufmann, San Mateo, CA, 1997.
2. L. Breiman, J.H. Friedman, R.A. Olshen, and C.J. Stone. Classification and Regression Trees. Wads worth, Belmont, 1984.
3. A. Ehrenfeucht and D. Haussler. Learning decision trees from random examples. Information and Computation, 82:231-246, 1989.
4. U.M. Fayyad and K.B. Irani. What should be .minimized in a decision tree? In AAAI-90, pages 249-754, 1990.
5. R. C. Holte. Very simple rules perform well on most commonly used databases. Machine learning, 11:63-91, 1993.
6. P.M. Murphy and M.J. Pazzani. Exploring the decision forest: An empirical investigation of Occam's razor in decision tree induction. Journal of Artificial Intelligence Research, 1:257-275, 1994.
7. J.R. Quinlan. C4-5: Programs for Machine Learning. Morgan Kaufmann, 1992.
8. R. E. Schapire, Y. Freund, P. L. Bartlett, and W. S. Lee. Boosting the margin: A new explanation for the effectiveness of voting methods. In Machine Learning: Proceedings of the Fourteenth International Conference, pages 322-330, 1997.
9. J. Shawe-Taylor, P. L. Bartlett, R. C. Williamson, and M. Anthony. A framework for structural risk minimisation. In Proc. 9th COLT, pages 68-76. ACM Press, New York, NY, 1996.
10. G.L. Webb. Further experimental evidence against the utility of Occam's razor. Journal of Artificial Intelligence Research, 4:397-417, 1996.