Bundling classifiers by bagging trees

Computational Statistics and Data Analysis

Volumn 49, Issue 4, 2005, Pages 1068-1078

  Hothorn, Torsten ^a   Lausen, Berthold ^a  

^a UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

Author keywords

Bagging; Ensemble methods; Error rate estimation; Method selection

Indexed keywords

BENCHMARKING; COMPUTER SOFTWARE; ERROR ANALYSIS; ESTIMATION; INFORMATION ANALYSIS; MATHEMATICAL MODELS; REGRESSION ANALYSIS; VECTORS;

BAGGING; ENSEMBLE-METHODS; ERROR RATE ESTIMATION; LEARNING PROBLEMS;

TREES (MATHEMATICS);

EID: 19044398807     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2004.06.019     Document Type: Article

References (33)

1. A.A. Alizadeh, M.B. Eisen, R.E. Davis, C. Ma, I.S. Lossos, A. Rosenwald, J.C. Boldrick, H. Sabet, T. Tran, X. Yu, J.I. Powell, L. Yang, G.E. Marti, T. Moore, J. Hudson, L. Lu, D.B. Lewis, R. Tibshirani, G. Sherlock, W.C. Chan, T.C. Greiner, D.D. Weisenburger, J.O. Armitage, R. Warnke, R. Levy, W. Wilson, M.R. Grever, J.C. Byrd, D. Botstein, P.O. Brown, and L.M. Staudt Distinct types of diffuse large B-cell lymphoma identified by expression profiling Nature 403 2000 503 511
2. Blake, C., Merz, C., 1998. UCI repository of machine learning databases. URL http://www.ics.uci.edu/ ∼ mlearn/MLRepository.html.
3. L. Breiman Bagging predictors Mach. Learn. 24 2 1996 123 140
4. Breiman, L., 1996b. Out-of-bag estimation. Technical Report, Statistics Department, University of California Berkeley, Berkeley, CA 94708.
5. L. Breiman Stacked regressions Mach. Learn. 24 1996 49 64
6. L. Breiman Arcing classifiers Ann. Statist. 26 3 1998 801 824
7. L. Breiman Random forests Mach. Learn. 45 1 2001 5 32
8. L. Breiman Statistical modeling the two cultures Statist. Sci. 16 3 2001 199 231 (with discussion)
9. L. Breiman, J.H. Friedman, R.A. Olshen, and C.J. Stone Classification and Regression Trees 1984 Wadsworth California
10. P. Bühlmann, and B. Yu Analyzing bagging Ann. Statist. 30 4 2002 927 961
11. S.E. Buttrey, and C. Karo Using k-nearest-neighbor classification in the leaves of a tree Comput. Statist. Data Anal. 40 2002 27 37
12. T. Bylander Estimating generalization error on two-class datasets using out-of-bag estimates Mach. Learn. 48 2002 287 297
13. S. Dudoit, J. Fridlyand, and T.P. Speed Comparison of discrimination methods for the classification of tumors using gene expression data J. Amer. Statist. Assoc. 97 457 2002 77 87
14. B. Efron, and R. Tibshirani Improvements on cross-validation the 0.632+ bootstrap method J. Amer. Statist. Assoc. 92 438 1997 548 560
15. T. Hothorn, and B. Lausen Bagging tree classifiers for laser scanning images data- and simulation-based strategy Artificial Intell. Med. 27 2003 65 79
16. T. Hothorn, and B. Lausen Double-bagging combining classifiers by bootstrap aggregation Pattern Recognition 36 6 2003 1303 1309
17. R. Ihaka, and R. Gentleman R: a language for data analysis and graphics J. Comput. Graphical Statist. 5 1996 299 314
18. H. Kim, and W.-Y. Loh Classification trees with unbiased multiway splits J. Amer. Statist.l Assoc. 96 454 2001 589 604
19. Läuter, J., 1992. Stabile multivariate Verfahren: Diskriminanzanalyse - Regressionsanalyse - Faktoranalyse. Akademie Verlag, Berlin.
20. J. Läuter, E. Glimm, and S. Kropf New multivariate tests for data with an inherent structure Biometrical J. 38 1 1996 5 23
21. J. Läuter, E. Glimm, and S. Kropf Multivariate tests based on left-spherically distributed linear scores Ann. Statist. 26 5 1998 1972 1988 (correction: 1999, vol. 27, p. 1441)
22. M. LeBlanc, and R. Tibshirani Combining estimates in regression and classification J. Amer. Statist. Assoc. 91 436 1996 1641 1650
23. Leisch, F., Dimitriadou, E., 2001. mlbench - a collection for artificial and real-world machine learning benchmarking problems. R package version 0.5-4. URL http://CRAN.R-project.org.
24. A. Liaw, and M. Wiener Classification and regression by randomForest R News 2 3 2002 18 22 URL http://CRAN.R-project.org/doc/Rnews/
25. C.J. Merz Using correspondence analysis to combine classifiers Mach. Learn. 36 1-2 1999 33 58
26. D. Meyer, F. Leisch, and K. Hornik The support vector machine under test Neurocomputing 55 1-2 2003 169 186
27. M. Mojirsheibani A consistent combined classification rule Statist. Probab. Lett. 36 1 1997 43 47
28. M. Mojirsheibani Combining classifiers via discretization J. Amer. Statist. Assoc. 94 446 1999 600 609
29. M. Mojirsheibani An almost sure optimal combined classification rule J. Multivariate Anal. 81 2002 28 46
30. A. Peters, T. Hothorn, and B. Lausen ipred improved predictors R News 2 2 2002 33 36 URL http://CRAN.R-project.org/doc/Rnews/
31. Rao, J.S., Tibshirani, R., 1997. The out-of-bootstrap method for model averaging and selection. Technical Report, Cleveland Clinic, University of Toronto.
32. Y. Yang Adaptive regression by mixing J. Amer. Statist. Assoc. 96 454 2001 574 588
33. Y. Yang Regression with multiple candidate models selection or mixing? Statistica Sinica 13 2003 783 809