Unbiased recursive partitioning: A conditional inference framework

Journal of Computational and Graphical Statistics

Volumn 15, Issue 3, 2006, Pages 651-674

  Hothorn, Torsten ^a   Hornik, Kurt ^b   Zeileis, Achim ^b  

^a UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

^b VIENNA UNIVERSITY OF ECONOMICS AND BUSINESS   (Austria)

Author keywords

Multiple testing; Multivariate regression trees; Ordinal regression trees; Permutation tests; Variable selection

Indexed keywords

EID: 33749677657     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/106186006X133933     Document Type: Article

References (47)

1. Agresti, A. (2002), Categorical Data Analysis (2nd ed.), Hoboken, NJ: Wiley.
2. Berger, R. L., and Hsu, J. C. (1996), "Bioequivalence Trials, Intersection-Union Tests and Equivalence Confidence Sets" (with discussion), Statistical Science, 11, 283-319.
3. Blake, C., and Merz, C. (1998), "UCI Repository of Machine Learning Databases." Available online at http://www.ics.uci.edu/~mlearn/ MLRepository.html.
4. Breiman, L., Friedman, J. H., Olshen, R. A., and Stone, C. J. (1984), Classification and Regression Trees, Belmont, CA: Wadsworth.
5. De'ath, G. (2002), "Multivariate Regression Trees: A New Technique for Modeling Species-Environment Relationships," Ecology, 83, 1105-1117.
6. Dobra, A., and Gehrke, J. (2001), "Bias Correction in Classification Tree Construction," in Proceedings of the Eighteenth International Conference on Machine Learning, San Francisco: Morgan Kaufmann, pp. 90-97.
7. Fieller, E. C. (1940), "The Biological Standardization of Insulin," Journal of the Royal Statistical Society, Supplement, 7, 1-64.
8. Frank, E., and Witten, I. H. (1998), "Using a Permutation Test for Attribute Selection in Decision Trees," in Proceedings of the Fifteenth International Conference on Machine Learning, San Francisco: Morgan Kaufmann, pp. 152-160.
9. Genz, A. (1992), "Numerical Computation of Multivariate Normal Probabilities," Journal of Computational and Graphical Statistics, 1, 141-149.
10. Goodman, L. A. (1965), "On Simultaneous Confidence Intervals for Multinomial Proportions," Technometrics, 7, 247-254.
11. Hosmer, D. W., and Lemeshow, S. (2000), Applied Logistic Regression (2nd ed.), New York: Wiley.
12. Hothorn, T., Hornik, K., van de Wiel, M. A., and Zeileis, A. (2006), "A Lego System for Conditional Inference," The American Statistician, 60, 257-263.
13. Hothorn, T., Leisch, F., Zeileis, A., and Hornik, K. (2005), "The Design and Analysis of Benchmark Experiments," Journal of Computational and Graphical Statistics, 14, 675-699.
14. Jensen, D. D., and Cohen, P. R. (2000), "Multiple Comparisons in Induction Algorithms," Machine Learning, 38, 309-338.
15. Kass, G. (1980), "An Exploratory Technique for Investigating Large Quantities of Categorical Data," Applied Statistics, 29, 119-127.
16. Kim, H., and Loh, W.-Y. (2001), "Classification Trees with Unbiased Multiway Splits," Journal of the American Statistical Association, 96, 589-604.
17. _ (2003), "Classification Trees with Bivariate Linear Discriminant Node Models," Journal of Computational and Graphical Statistics, 12, 512-530.
18. Lausen, B., Hothorn, T., Bretz, F., and Schumacher, M. (2004), "Assessment of Optimal Selected Prognostic Factors," Diametrical Journal, 46, 364-374.
19. Lausen, B., and Schumacher, M. (1992), "Maximally Selected Rank Statistics," Biometrics, 48, 73-85.
20. LeBlanc, M., and Crowley, J. (1992), "Relative Risk Trees for Censored Survival Data," Biometrics, 48, 411-425.
21. _ (1993), "Survival Trees by Goodness of Split," Journal of the American Statistical Association, 88, 457-467.
22. Loh, W.-Y. (2002), "Regression Trees With Unbiased Variable Selection and Interaction Detection," Statistica Sinica, 12, 361-386.
23. Loh, W.-Y., and Shih, Y.-S. (1997), "Split Selection Methods for Classification Trees," Statistica Sinica, 7, 815-840.
24. Loh, W.-Y., and Vanichsetakul, N. (1988), "Tree-Structured Classification via Generalized Discriminant Analysis" (with discussion), Journal of the American Statistical Association, 83, 715-725.
25. Mardin, C. Y., Hothorn, T., Peters, A., Jünemann, A. G., Nguyen, N. X., and Lausen, B. (2003), "New Glaucoma Classification Method Based on Standard HRT Parameters by Bagging Classification Trees," Journal of Glaucoma, 12, 340-346.
26. Martin, J. K. (1997), "An Exact Probability Metric for Decision Tree Splitting and Stopping," Machine Learning, 28, 257-291.
27. Miller, R., and Siegmund, D. (1982), "Maximally Selected Chi Square Statistics," Biometrics, 38, 1011-1016.
28. Mingers, J. (1987), "Expert Systems - Rule Induction With Statistical Data," Journal of the Operations Research Society, 38, 39-47.
29. Molinaro, A. M., Dudoit, S., and van der Laan, M. J. (2004), "Tree-Based Multivariate Regression and Density Estimation with Right-Censored Data," Journal of Multivariate Analysis, 90, 154-177.
30. Morgan, J. N., and Sonquist, J. A. (1963), "Problems in the Analysis of Survey Data, and a Proposal," Journal of the American Statistical Association, 58, 415-434.
31. Murthy, S. K. (1998), "Automatic Construction of Decision Trees from Data: A Multi-disciplinary Survey," Data Mining and Knowledge Discovery, 2, 345-389.
32. Noh, H. G., Song, M. S., and Park, S. H. (2004), "An Unbiased Method for Constructing Multilabel Classification Trees," Computational Statistics & Data Analysis, 47, 149-164.
33. O'Brien, S. M. (2004), "Cutpoint Selection for Categorizing a Continuous Predictor," Biometrics, 60, 504-509.
34. Peters, A., Hothorn, T., and Lausen, B. (2002), "ipred: Improved Predictors," R News, 2, 33-36. Available online at http://CRAN.R-project. org/doc/Rnews/.
35. Quinlan, J. R. (1993), C4.5: Programs for Machine Learning, San Mateo, CA: Morgan Kaufmann Publishers Inc.
36. R Development Core Team (2004), R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria. Online at http://www.R-project.org.
37. Rasch, D. (1995), Mathematische Statistik, Heidelberg, Leipzig: Johann Ambrosius Barth Verlag.
38. Schumacher, M., Holländer, N., Schwarzer, G., and Sauerbrei, W. (2001), "Prognostic Factor Studies," in Statistics in Clinical Oncology, ed. J. Crowley, New York, Basel: Marcel Dekker, pp. 321-378.
39. Segal, M. R. (1988), "Regression Trees for Censored Data," Biometrics, 44, 35-47.
40. Shih, Y.-S. (1999), "Families of Splitting Criteria for Classification Trees," Statistics and Computing, 9, 309-315.
41. _ (2004), "A Note on Split Selection Bias in Classification Trees," Computational Statistics & Data Analysis, 45, 457-466.
42. Strasser, H., and Weber, C. (1999), "On the Asymptotic Theory of Permutation Statistics," Mathematical Methods of Statistics, 8, 220-250. Preprint available online at http://epub.wu-wien.ac.at/dyn/openURL?id=oai:epub. wu-wien.ac.at:epub-wu-01_94c.
43. Strehl, A., and Ghosh, J. (2003), "Cluster Ensembles - A Knowledge Reuse Framework for Combining Multiple Partitions," Journal of Machine Learning Research, 3, 583-617.
44. Therneau, T. M., and Atkinson, E. J. (1997), "An Introduction to Recursive Partitioning Using the rpart Routine," Technical Report 61, Section of Biostatistics, Mayo Clinic, Rochester. Available online at http://www.mayo.edu/hsr/techrpt/61.pdf.
45. Westfall, P. H., and Young, S. S. (1993), Resampling-Based Multiple Testing, New York: Wiley.
46. White, A. P., and Liu, W. Z. (1994), "Bias in Information-Based Measures in Decision Tree Induction," Machine Learning, 15, 321-329.
47. Zhang, H. (1998), "Classification Trees for Multiple Binary Responses," Journal of the American Statistical Association, 93, 180-193.