Cross-validated bagged learning

Journal of Multivariate Analysis

Volumn 98, Issue 9, 2007, Pages 1693-1704

  Petersen, Maya L ^a   Molinaro, Annette M ^b   Sinisi, Sandra E ^a   van der Laan, Mark J ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b YALE UNIVERSITY   (United States)

Author keywords

Bootstrap aggregation; Data adaptive regression; Deletion Substitution Addition algorithm; Resistant HIV

Indexed keywords

EID: 34548812833     PISSN: 0047259X     EISSN: 10957243     Source Type: Journal    
DOI: 10.1016/j.jmva.2007.07.004     Document Type: Article

References (26)

1. M.D. Birkner, S.E. Sinisi, M.J. van der Laan, Multiple testing and data adaptive regression: an application to HIV-1 sequence data, Statist. Appl. Genetics Molecular Biol. 4 (1), article 8, 2005. URL: 〈http://www.bepress.com/sagmb/vol4/iss1/art8〉.
2. Borra S., and Ciaccio A.D. Improving nonparametric regression methods by bagging and boosting. Comput. Statist. Data Anal. 38 (2002) 407-420
3. Breiman L. Bagging predictors. Mach. Learning 24 2 (1996) 123-140
4. Breiman L. Heuristics of instability and stabilization in model selection. Ann. Statist. 24 (1996) 2350-2383
5. Breiman L. Stacked regressions. Mach. Learning 24 (1996) 49-64
6. Breiman L. Random forests. Mach. Learning 45 (2001) 5-32
7. Breiman L. Using iterated bagging to debias regressions. Mach. Learning 45 (2001) 261-277
8. Breiman L., Friedman J.H., Olshen R.A., and Stone C.J. Classification and Regression Trees, The Wadsworth Statistics/Probability Series (1984), Wadsworth International Group, Belmont, CA
9. A. Buja, W. Stuetzle, Observations on bagging, 2002. URL: 〈http://www-stat.wharton.upenn.edu/∼buja/PAPERS/paper-bag-wxs.pdf〉.
10. Bühlmann P., and Yu B. Analyzing bagging. Ann. Statist. 30 (2002) 927-961
11. Dudoit S., and van der Laan M. Asymptotics of cross-validated risk estimation in estimator selection and performance assessment. Statist. Methodology 2 2 (2005) 131-154
12. Friedman J.H. Multivariate adaptive regression splines. Ann. Statist. 19 1 (1991) 1-141 discussion by A. R. Barron and X. Xiao
13. J.H. Friedman, P. Hall, On bagging and nonlinear estimation, 2000. URL: 〈http://www-stat.stanford.edu/∼jhf/ftp/bag.ps〉.
14. Hall P., and Samworth R.J. Properties of bagged nearest-neighbour classifiers. J. Roy. Statist. Soc. Ser. B 67 3 (2005) 363-379
15. Hothorn T., and Lausen B. Bundling classifiers by bagging trees. Comput. Statist. Data Anal. 49 4 (2005) 1068-1078
16. Ihaka R., and Gentleman R. R: a language for data analysis and graphics. J. Comput. Graphical Statist. 5 (1996) 299-314
17. M.J. van der Laan, S. Dudoit, Unified cross-validation methodology for selection among estimators and a general cross-validated adaptive epsilon-net estimator: finite sample oracle inequalities and examples, Technical Report 130, Division of Biostatistics, University of California, Berkeley, November 2003, URL: 〈www.bepress.com/ucbbiostat/paper130/〉.
18. M.J. van der Laan, S. Dudoit, S. Keleş, Asymptotic optimality of likelihood based cross-validation, Technical Report 125, Division of Biostatistics, University of California, Berkeley, February 2003. URL: 〈www.bepress.com/ucbbiostat/paper125/〉.
19. M.J. van der Laan, S. Dudoit, A.W. van der Vaart, The cross-validated adaptive epsilon-net estimator, Technical Report 142, Division of Biostatistics, University of California, Berkeley, February 2004. URL: 〈www.bepress.com/ucbbiostat/paper142/〉.
20. LeBlanc M., and Tibshirani R. Combining estimates in regression and classification. J. Amer. Statist. Assoc. 91 (1996) 1641-1650
21. A.M. Molinaro, M.J. van der Laan, Cross-validating and bagging partitioning algorithms with variable importance, Technical Report 185, Division of Biostatistics, University of California, Berkeley, November 2005. URL: 〈www.bepress.com/ucbbiostat/paper185/〉.
22. Ruczinski I., Kooperberg C., and LeBlanc M. Logic regression. J. Comput. Graphical Statist. 12 3 (2003) 475-511. http://www.biostat.jhsph.edu/iruczins/publications/publications.html URL: 〈http://www.biostat.jhsph.edu/∼iruczins/publications/publications.html〉
23. S.E. Sinisi, M.J. van der Laan, Deletion/Substitution/Addition algorithm in learning with applications in genomics, Statist. Appl. Genetics and Molecular Biology 3 (1), article 18, 2004. URL: 〈http://www.bepress.com/sagmb/vol3/iss1/art18〉.
24. S.E. Sinisi, E.C. Polley, M.L. Petersen, S.-Y. Rhee, M.J. van der Laan, Super learning: an application to the prediction of HIV-1 drug resistance, Statist. Appl. Genetics 6 (1), article 7. URL: 〈http://www.bepress.com/sagmb/vol6/iss1/art7〉.
25. Skurichina M., and Duin R.P.W. Bagging for linear classifiers. Pattern Recognition 31 (1998) 909-930
26. T. Therneau, E. Atkinson, An introduction to recursive partitioning using the rpart routines, Technical Report 61, Division of Biostatistics, Mayo Clinic, Rochester, November 1997. URL: 〈www.mayo.edu/hsr/techrpt/61.pdf〉.