Variable selection and shrinkage: Comparison of some approaches

Statistica Neerlandica

Volumn 55, Issue 1, 2001, Pages 53-75

  Vach, K ^a,b   Sauerbrei, W ^b   Schumacher, M ^b  

^a UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

^b UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Linear regression; Prediction error; Selection bias

Indexed keywords

EID: 0035530909     PISSN: 00390402     EISSN: None     Source Type: Journal    
DOI: 10.1111/1467-9574.00156     Document Type: Review

References (19)

1. ALTMAN, D. G. and P. K. ANDERSEN (1989), Bootstrap investigation of the stability of a Cox regression model, Statistics in Medicine 8, 771-783.
2. BREIMAN, L. (1995), Better subset regression using the nonnegative Garotte, Technometrics 37, 373-384.
3. CHEN, C. and S. L. GEORGE (1985), The bootstrap and identification of prognostic factors via Cox's proportional hazards regression model, Statistics in Medicine 4, 39-46.
4. COOK, R. D. and S. WEISBERG (1982), Residuals and influence in regression, Chapman & Hall, London.
5. COX, D. (1972). Regression models and life tables (with discussion), Journal of the Royal Statistical Society B 74, 187-220.
6. GRUBER, M. (1990), Regression estimators: a comparative study, Academic Press, Boston.
7. HARRELL, F. E., K. L. LEE, D. B. MARK (1996), Multivariable prognostic models: issues on developing models, evaluating assumptions and adequacy, and measuring and reducing errors, Statistics in Medicine 15, 361-387.
8. LAWSON, C. and R. HANSON (1974), Solving least squares problems, Prentice-Hall, Englewood Cliffs, NJ.
9. MCCULLAGH, P. and J. A. NELDER (1989), Generalized linear models, second edition, Chapman & Hall, London.
10. MILLER, A. J. (1990), Subset selection in regression, Chapman & Hall, London.
11. PREGIBON, D. (1981), Logistic regression diagnostics, The Annals of Statistics 9, 705-724.
12. SAUERBREI, W. and M. SCHUMACHER (1992), A bootstrap resampling procedure for model building: application to the Cox regression model, Statistics in Medicine 11, 2093-2109.
13. SAUERBREI, W. (1999), The use of resampling methods to simplify regression models in medical statistics, Applied Statistics 48, 313-329.
14. STONE, M. (1976), An asymptotic equivalence of choice of model by cross-validation and Akaike's criterion, Journal of the Royal Statistical Society B 39, 44-47.
15. TERASVIRTA, T. and I. MELLIN (1986), Model selection criteria and model selection tests in regression models, Scandinavian Journal of Statistics 13, 159-171.
16. TIBSHIRANI, R. (1996), Regression shrinkage and selection via the Lasso, Journal of the Royal Statistical Society B 58, 267-268.
17. VACH, K., W. SAUERBREI and M. SCHUMACHER (2000), A comparative investigation of variable selection and shrinkage methods, FDM-preprint no. 70, Center for Data Analysis and Modelling, University of Freiburg.
18. VAN HOUWELINGEN, J. C. and S. LE CESSIE (1990), Predictive value of statistical models, Statistics in Medicine 9, 1303-1325.
19. VERWEIJ, P. J. M. and J. C. VAN HOUWELINGEN (1993), Cross-validation in survival analysis, Statistics in Medicine 12, 2305-2314.