The importance of knowing when to stop: A sequential stopping rule for component-wise gradient boosting

Methods of Information in Medicine

Volumn 51, Issue 2, 2012, Pages 178-186

  Mayr, A ^a   Hofner, B ^a   Schmid, M ^a  

^a UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

Author keywords

Early stopping; Gradient boosting; Penalized regression; Resampling methods; Variable selection

Indexed keywords

MESSENGER RNA;

ALGORITHM; ARTICLE; COLORECTAL TUMOR; HUMAN; MEDICAL RESEARCH; METHODOLOGY; MICROARRAY ANALYSIS; REGRESSION ANALYSIS; RISK ASSESSMENT; STATISTICAL ANALYSIS; STATISTICAL MODEL; TIME;

ALGORITHMS; BIOMEDICAL RESEARCH; COLORECTAL NEOPLASMS; DATA INTERPRETATION, STATISTICAL; HUMANS; LINEAR MODELS; MICROARRAY ANALYSIS; MODELS, STATISTICAL; REGRESSION ANALYSIS; RISK ASSESSMENT; RNA, MESSENGER; TIME FACTORS;

EID: 84858743801     PISSN: 00261270     EISSN: None     Source Type: Journal    
DOI: 10.3414/ME11-02-0030     Document Type: Article

References (30)

1. Chang YCI, Huang YF, Huang YP. Early stopping in L(2) Boosting. Computational Statistics & Data Analysis 2010; 54 (10): 2203-2213.
2. Barrier A, Boelle PY, Roser F, Gregg J, Tse C, Brault D, et al. Stage II colon cancer prognosis prediction by tumor gene expression profiling. J Clin Oncol 2006; 24 (29): 4685-4691.
3. Freund Y, Schapire R, editors. Experiments with a new boosting algorithm. Proceedings of the Thirteenth International Conference on Machine Learning (ICML); 1996.
4. Friedman JH. Greedy function approximation: A gradient boosting machine. Annals of Statistics 2001; 29 (5): 1189-1232.
5. Bühlmann P, Yu B. Boosting with the L-2 loss: Regression and classification. Journal of the American Statistical Association 2003; 98 (462): 324-339.
6. Bühlmann P, Hothorn T. Boosting algorithms: Regularization, prediction and model fitting. Statistical Science 2007; 22 (4): 477-505.
7. Mease D, Wyner A. Evidence contrary to the statistical view of boosting. Journal of Machine Learning Research 2008; 9: 131-156.
8. Tibshirani R. Regression shrinkage and selection via the Lasso. Journal of the Royal Statistical Society Series B-Methodological 1996; 58 (1): 267-288.
9. Efron B, Hastie T, Johnstone I, Tibshirani R. Least angle regression. Annals of Statistics 2004; 32 (2): 407-451.
10. Efron B. Biased Versus Unbiased Estimation. Advances in Mathematics 1975; 16 (3): 259-277.
11. Copas JB. Regression, Prediction and Shrinkage. Journal of the Royal Statistical Society Series B-Methodological 1983; 45 (3): 311-354.
12. Hastie T, Tibshirani R, Friedman JH. The Elements of Statistical Learning: Springer; 2003.
13. Wyatt JC, Altman DG. Prognostic Models - Clinically Useful or Quickly Forgotten - Commentary. British Medical Journal 1995; 311 (7019): 1539-1541.
14. Andreasen NC, Wilcox MA, Ho BC, Epping E, Ziebell S, Zeien E, et al. Statistical epistasis and progressive brain change in schizophrenia: an approach for examining the relationships between multiple genes. Mol Psychiatry 2011.
15. Schild RL, Maringa M, Siemer J, Meurer B, Hart N, Goecke TW, et al. Weight estimation by threedimensional ultrasound imaging in the small fetus. Ultrasound Obstet Gynecol 2008; 32 (2): 168-175.
16. Stollhoff R, Sauerbrei W, Schumacher M. An experimental evaluation of boosting methods for classification. Methods Inf Med 2010; 49 (3): 219-229.
17. Mayr A, Hothorn T, Fenske N. Prediction intervals for future BMI values of individual children - a non-parametric approach by quantile boosting. BMC Med Res Methodol 2012; 12 (6).
18. Fenske N, Kneib T, Hothorn T. Identifying Risk Factors for Severe Childhood Malnutrition by Boosting Additive Quantile Regression. Journal of the American Statistical Association 2011; 106 (494): 494-510.
19. Akaike H. New Look at Statistical-Model Identification. Ieee Transactions on Automatic Control 1974;Ac19(6):716-23.
20. Hastie TJ. Comment: Boosting Algorithms: Regularization, Prediction and Model Fitting. Statistical Science 2007; 22 (4): 513-515.
21. Greven S, Kneib T. On the behaviour of marginal and conditional AIC in linear mixed models. Biometrika 2010; 97 (4): 773-789.
22. Binder H, Schumacher M. Adapting prediction error estimates for biased complexity selection i n high-dimensional bootstrap samples. Stat Appl Genet Mol Biol 2008; 7 (1): Article 12.
23. Sauerbrei W, Boulesteix AL, Binder H. Stability investigations of multivariable regression models derived from low- and high-dimensional data. J Biopharm Stat 2011; 21 (6): 1206-1231.
24. R Development Core Team: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0. 2011.
25. Hothorn T, Bühlmann P, Kneib T, Schmid M, Hofner B. Model-based Boosting 2.0. Journal of Machine Learning Research 2010; 11: 2109-2113.
26. Bolstad B, Irizarry R, Gautier L, Wu Z. Preprocessing High-density Oligonucleotide Arrays Bioinformatics and Computational Biology Solutions Using R and Bioconductor. In: Gentleman R, Carey VJ, Huber W, Irizarry RA, Dudoit S, editors. New York: Springer; 2005. pp 13-32.
27. Schimek MG. Penalized binary regression for gene expression profiling. Methods Inf Med 2004; 43 (5): 439-444.
28. West M, Blanchette C, Dressman H, Huang E, Ishida S, Spang R, et al. Predicting the clinical status of human breast cancer by using gene expression profiles. Proc Natl Acad Sci USA 2001; 98 (20): 11462-11467.
29. Dettling M, Buhlmann P. Boosting for tumor classification with gene expression data. Bioinformatics 2003; 19 (9): 1061-1069.
30. Mosteller F, Tukey JW. Data analysis, including statistics. In: Lindzey G, Aronson E, editors. Handbook of Social Psychology: Addison-Wesley; 1968.