Variable selection in additive models by non-negative garrote

Statistical Modelling

Volumn 11, Issue 3, 2011, Pages 237-252

  Cantoni, Eva ^a   Flemming, Joanna Mills ^b   Ronchetti, Elvezio ^a  

^a UNIVERSITY OF GENEVA   (Switzerland)

^b DALHOUSIE UNIVERSITY   (Canada)

Author keywords

Blue shark logbook data; cross validation; non negative garrote; non parametric regression; shrinkage methods; variable selection

Indexed keywords

EID: 79953659636     PISSN: 1471082X     EISSN: 14770342     Source Type: Journal    
DOI: 10.1177/1471082X1001100304     Document Type: Article

References (31)

1. Avalos M, Grandvalet Y and Ambroise C 2007) Parsimonious additive models. Computational Statistics and Data Analysis, 51, 2851-70.
2. Baum J 2007 Population- and community-level consequences of the exploitation of large predatory marine fishes. PhD thesis, Biology Department, Dalhousie University, Halifax, Canada.
3. Baum JK, Myers RA, Kehler DG, Worm B,et al. 2003 Collapse and conservation of shark populations in the northwest atlantic. Science, 299, 389-92.
4. Bock M and Bowman AW 1999 Comparing bivariate nonparametric regression models. Technical Report 99-1, Department of Statistics, University of Glasgow, Scotland.
5. Breiman L 1995) Better subset regression using the nonnegative garrote. Technometrics, 37, 373-84.
6. Brumback BA, Ruppert D and Wand MP 1999) Comment on 'variable selection and function estimation in additive nonparametric regression using a data-based prior'. Journal of the American Statistical Association, 94, 794-97.
7. Buhlmann P and Yu B 2003) Boosting with the L2 loss: regression and classification. Journal of the American Statistical Association, 98, 324-39.
8. Cantoni E, Flemming J and Ronchetti E 2006 Variable selection in additive models by nonnegative garrote. Technical Report 2006.05, Department of Econometrics, University of Geneva.
9. Cantoni E and Hastie T 2002) Degrees of freedom tests for smoothing splines. Biometrika, 89, 251-63.
10. Cantoni E, Mills Flemming J and Ronchetti E 2005) Variable selection for marginal longitudinal generalized linear models. Biometrics, 61, 507-14.
11. Cantoni E and Ronchetti E 2001) Resistant selection of the smoothing parameter for smoothing splines. Statistics and Computing, 11, 141-46.
12. Efron B, Hastie T, Johnstone I and Tibshirani R 2004) Least angle regression. The Annals of Statistics, 32, 407-51.
13. Furnival GM and Wilson RW 1974) Regression by leaps and bounds. Technometrics, 16, 499-511.
14. Härdle W 1990. Applied nonparametric regression. Cambridge: Cambridge University Press.
15. Hastie T, Tibshirani R and Friedman JH 2001 The elements of statistical learning. New York: Springer.
16. Hastie TJ and Tibshirani RJ 1990 Generalized additive models. London: Chapman & Hall.
17. Lawson C and Hanson R 1974 Solving least squares problems. Englewood Cliffs, NJ: Prentice-Hall.
18. Lin Y and Zhang HH 2006) Component selection and smoothing in multivariate nonparametric regression. Annals of Statistics, 34, 2272-97.
19. Myers RA, Baum JK, Shepherd TD, Powers SP,et al. 2007 Cascading effects of the loss of apex predatory sharks from a coastal ocean. Science, 315, 1846-50.
20. Opsomer JD and Ruppert D 1998) A fully automated bandwidth selection method for fitting additive models. Journal of the American Statistical Association, 93, 605-19.
21. Sardy S and Tseng P 2004) AMlet, RAMlet, GAMlet: automatic nonlinear fitting of additive models, robust and generalized, with wavelets. Journal of Computational and Graphical Statistics, 13, 283-309.
22. Shao J 1993) Linear model selection by cross-validation. Journal of the American Statistical Association, 88, 486-94.
23. Tibshirani R 1996) Regression shrinkage and selection via the LASSO. Journal of the Royal Statistical Society, Series B, Methodological, 58, 267-88.
24. Tutz G and Binder H 2006) Generalized additive modeling with implicit variable selection by likelihood-based boosting. Biometrics, 62, 961-71.
25. Wood SN 2004) Stable and efficient multiple smoothing parameter estimation for generalized additive models. Journal of the American Statistical Association, 99, 673-86.
26. Wood SN 2006 Generalized additive models: an introduction with R. London: Chapman & Hall/CRC.
27. Wood SN and Augustin NH 2002) GAMs with integrated model selection using penalized regression splines and applications to environmental modelling. Ecological Modelling, 157, 157-77.
28. Yuan M 2007 Nonnegative garrote component selection in functional ANOVA models. JMLR: Workshop and Conference Proceedings (AISTATS 2007 Proceedings). Available athttp://jmlr.csail.mit.edu/proceedings/.
29. Yuan M and Lin Y 2006) Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society, Series B, Methodological, 68, 49-67.
30. Yuan M and Lin Y 2007) On the non-negative garrotte estimator. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 69, 143-61.
31. Zou H 2006) The adaptive LASSO and its oracle properties. Journal of the American Statistical Association, 101, 1418-29.