Model-based boosting in R: A hands-on tutorial using the R package mboost

Computational Statistics

Volumn 29, Issue 1-2, 2014, Pages 3-35

  Hofner, Benjamin ^a   Mayr, Andreas ^a   Robinzonov, Nikolay ^b   Schmid, Matthias ^a  

^a UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

^b UNIVERSITY OF MUNICH   (Germany)

Author keywords

Boosting; Component wise functional gradient descent; Generalized additive models; Tutorial

Indexed keywords

EID: 84893967115     PISSN: 09434062     EISSN: 16139658     Source Type: Journal    
DOI: 10.1007/s00180-012-0382-5     Document Type: Article

References (43)

1. Bates D, Maechler M, Bolker B (2011) lme4: linear mixed-effects models using S4 classes. http://CRAN. R-project. org/package=lme4, R package version 0. 999375-42.
2. Breiman L (1998) Arcing classifiers (with discussion). Ann Stat 26: 801-849.
3. Breiman L (1999) Prediction games and arcing algorithms. Neural Comput 11: 1493-1517.
4. Breiman L (2001) Random forests. Mach Learn 45: 5-32.
5. Bühlmann P (2006) Boosting for high-dimensional linear models. Ann Stat 34: 559-583.
6. Bühlmann P, Hothorn T (2007) Boosting algorithms: regularization, prediction and model fitting (with discussion). Stat Sci 22: 477-522.
7. 2 loss: regression and classification. J Am Stat Assoc 98: 324-338.
8. de Boor C (1978) A practical guide to splines. Springer, New York.
9. Efron B, Hastie T, Johnstone L, Tibshirani R (2004) Least angle regression. Ann Stat 32: 407-499.
10. Eilers PHC, Marx BD (1996) Flexible smoothing with B-splines and penalties (with discussion). Stat Sci 11: 89-121.
11. Fan J, Lv J (2010) A selective overview of variable selection in high dimensional feature space. Statistica Sinica 20: 101-148.
12. Fenske N, Kneib T, Hothorn T (2011) Identifying risk factors for severe childhood malnutrition by boosting additive quantile regression. J Am Stat Assoc 106(494): 494-510.
13. Freund Y, Schapire R (1996) Experiments with a new boosting algorithm. In: Proceedings of the thirteenth international conference on machine learning theory. Morgan Kaufmann, San Francisco, pp 148-156.
14. Friedman JH (2001) Greedy function approximation: a gradient boosting machine. Ann Stat 29: 1189-1232.
15. Friedman JH, Hastie T, Tibshirani R (2000) Additive logistic regression: a statistical view of boosting (with discussion). Ann Stat 28: 337-407.
16. Garcia AL, Wagner K, Hothorn T, Koebnick C, Zunft HJF, Tippo U (2005) Improved prediction of body fat by measuring skinfold thickness, circumferences, and bone breadths. Obes Res 13(3): 626-634.
17. Hastie T (2007) Comment: Boosting algorithms: regularization, prediction and model fitting. Stat Sci 22: 513-515.
18. Hastie T, Tibshirani R (1990) Generalized additive models. Chapman & Hall, London.
19. Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning: data mining, inference, and prediction, 2nd edn. Springer, New York.
20. Hofner B (2011) Boosting in structured additive models. PhD thesis, Department of Statistics, Ludwig-Maximilians-Universität München, Munich.
21. Hofner B, Hothorn T, Kneib T, Schmid M (2011a) A framework for unbiased model selection based on boosting. J Comput Graph Stat 20: 956-971.
22. Hofner B, Müller J, Hothorn T (2011b) Monotonicity-constrained species distribution models. Ecology 92: 1895-1901.
23. Hothorn T, Hornik K, Zeileis A (2006) Unbiased recursive partitioning: a conditional inference framework. J Comput Graph Stat 15: 651-674.
24. Hothorn T, Bühlmann P, Kneib T, Schmid M, Hofner B (2010) Model-based boosting 2. 0. J Mach Learn Res 11: 2109-2113.
25. Hothorn T, Bühlmann P, Kneib T, Schmid M, Hofner B (2012) mboost: model-based boosting. http://CRAN. R-project. org/package=mboost, R package version 2. 1-3.
26. Kneib T, Hothorn T, Tutz G (2009) Variable selection and model choice in geoadditive regression models. Biometrics 65: 626-634. Web appendix accessed at http://www. biometrics. tibs. org/datasets/071127P. htm on 16 Apr 2012.
27. Koenker R (2005) Quantile regression. Cambridge University Press, New York.
28. Mayr A, Fenske N, Hofner B, Kneib T, Schmid M (2012a) Generalized additive models for location, scale and shape for high-dimensional data-a flexible approach based on boosting. J R Stat Soc Ser C (Appl Stat) 61(3): 403-427.
29. Mayr A, Hofner B, Schmid M (2012b) The importance of knowing when to stop-a sequential stopping rule for component-wise gradient boosting. Methods Inf Med 51(2): 178-186.
30. Mayr A, Hothorn T, Fenske N (2012c) Prediction intervals for future BMI values of individual children-a non-parametric approach by quantile boosting. BMC Med Res Methodol 12(6): 1-13.
31. McCullagh P, Nelder JA (1989) Generalized linear models, 2nd edn. Chapman & Hall, London.
32. Meinshausen N (2006) Quantile regression forests. J Mach Learn Res 7: 983-999.
33. Pinheiro J, Bates D (2000) Mixed-effects models in S and S-PLUS. Springer, New York.
34. Pinheiro J, Bates D, DebRoy S, Sarkar D, R Development Core Team (2012) nlme: linear and nonlinear mixed effects models. http://CRAN. R-project. org/package=nlme, R package version 3. 1-103.
35. R Development Core Team (2012) R: a language and Environment for statistical computing. R Foundation for Statistical Computing, Vienna. http://www. R-project. org, ISBN 3-900051-07-0.
36. Ridgeway G (2010) gbm: generalized boosted regression models. http://CRAN. R-project. org/package=gbm, R package version 1. 6-3. 1.
37. Schmid M, Hothorn T (2008a) Boosting additive models using component-wise P-splines. Comput Stat Data Anal 53: 298-311.
38. Schmid M, Hothorn T (2008b) Flexible boosting of accelerated failure time models. BMC Bioinform 9: 269.
39. Schmid M, Potapov S, Pfahlberg A, Hothorn T (2010) Estimation and regularization techniques for regression models with multidimensional prediction functions. Stat Comput 20: 139-150.
40. Schmid M, Hothorn T, Maloney KO, Weller DE, Potapov S (2011) Geoadditive regression modeling of stream biological condition. Environ Ecol Stat 18(4): 709-733.
41. Sobotka F, Kneib T (2010) Geoadditive expectile regression. Comput Stat Data Anal 56(4): 755-767.
42. Tierney L, Rossini AJ, Li N, Sevcikova H (2011) snow: simple network of workstations. http://CRAN. R-project. org/package=snow, R package version 0. 3-7.
43. Urbanek S (2011) multicore: parallel processing of R code on machines with multiple cores or CPUs. http://CRAN. R-project. org/package=multicore, R package version 0. 1-7.