A note on split selection bias in classification trees

Computational Statistics and Data Analysis

Volumn 45, Issue 3, 2004, Pages 457-466

  Shih, Y S ^a  

^a NATIONAL CHUNG CHENG UNIVERSITY   (Taiwan)

Author keywords

Cram r V2 statistic; Kolmogorov Smirnov statistic; P value; Pearson chi square statistic

Indexed keywords

NUMERICAL METHODS; STATISTICAL METHODS; TREES (MATHEMATICS);

CLASSIFICATION TREES; PREDICTOR VARIABLES;

COMPUTATIONAL METHODS;

STATISTICAL ANALYSIS;

EID: 1842630388     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-9473(03)00064-1     Document Type: Article

References (23)

1. Agresti A. Analysis of Ordinal Categorical Data 1984 Wiley New York
2. Breiman L. Friedman J.H. Olshen R.A. Stone C.J. Classification and Regression Trees 1984 Chapman - Hall New York
3. Dannegger F. Tree stability diagnostics and some remedies for instability Statist. Med. 19 2000 475-491
4. Dobra, A., Gehrke, J., 2001. Bias correction in classification tree construction. Proceedings of the Seventh International Conference of Machine Learning. Morgan Kaufmann, pp. 90-97.
5. Efron B. Tibshirani R. An Introduction to the Bootstrap 1993 Chapman - Hall London
6. Frank, E., Witten, I.H., 1998. Using a permutation test for attribute selection in decision trees. Proceedings of the International Conference of Machine Learning, Morgan Kaufmann, pp. 152-160.
7. Halpern A.L. Minimally selected p and other tests for a single abrupt changepoint in a binary sequence Biometrics 55 1999 1044-1050
8. Hawkins D.M. FIRM: formal inference-based recursive modeling Amer. Statist. 45 1991 155
9. Jensen D. Cohen P. Multiple comparisons in induction algorithms Mach. Learning 38 2000 309-338
10. Kass G.V. An exploratory technique for investigating large quantities of categorical data Appl. Statist. 29 1980 119-127
11. Kim H. Loh W.-Y. Classification trees with unbiased multiway splits J. Amer. Statist. Assoc. 96 2001 589-604
12. Kononenko, I., 1995. On biases in estimating multivalued attributes. Proceedings of the 14th International Joint Conference on Artificial Intelligence, Morgan Kaufmann, pp. 1034-1040.
13. Koziol J.A. On maximally selected chi-square statistics Biometrics 47 1991 1557-1561
14. Liu W.Z. White A.P. The importance of attribute selection measures in decision tree induction Mach. Learning 15 1994 25-41
15. Loh W.-Y. Shih Y.-S. Split selection methods for classification trees Statist. Sinica 7 1997 815-840
16. Martin J.K. An exact probability metric for decision tree splitting and stopping Mach. Learning 28 1997 257-291
17. Miller R. Siegmund D. Maximally selected chi square statistics Biometrics 38 1982 1011-1016
18. Murthy S.K. Automatic construction of decision trees from data: a multi-disciplinary survey Data Mining Knowledge Discovery 2 1998 345-389
19. Nikiforov A.M. Algorithm 288. Exact Smirnov two-sample tests for arbitrary distributions Appl. Statist. 43 1994 265-284
20. Quinlan J. C4.5: Programs for Machine Learning 1993 Morgan Kaufmann San Mateo
21. Shih Y.-S. Families of splitting criteria for classification trees Statist. Comput. 9 1999 309-315
22. Wilcox R.R. Percentage points of a weighted Kolmogorov-Smirnov statistic Commun. Statist. Simulation Comput. 18 1989 237-244
23. Zhou X.J. Dillon T.S. A statistical-heuristic feature selection criterion for decision tree induction IEEE Trans. Pattern Recognition Mach. Intell. 13 1991 834-841