Application of shrinkage techniques in logistic regression analysis: A case study

Statistica Neerlandica

Volumn 55, Issue 1, 2001, Pages 76-88

  Steyerberg, E W ^a   Eijkemans, M J C ^a   Habbema, J D F ^a  

^a ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

Author keywords

Bias; Logistic models; Prediction; Regression analysis; Variable selection

Indexed keywords

EID: 0035530911     PISSN: 00390402     EISSN: None     Source Type: Journal    
DOI: 10.1111/1467-9574.00157     Document Type: Article

References (21)

1. BREIMAN, L. (1995), Better subset regression using the nonnegative Garotte, Technometrics 37, 373-384.
2. BUCKLAND, S. T., K. P. BURNHAM and N. H. AUGUSTIN (1997), Model selection: an integral part of inference, Biometrics 53, 603-618.
3. CHATFIELD, C. (1995), Model uncertainty, data mining and statistical inference, Journal of the Royal Statistical Society, Series A 158, 419-466.
4. COPAS, J. B. (1983), Regression, prediction and shrinkage, Journal of the Royal Statistical Society, Series B 45, 311-354.
5. EFRON, B. and R. TIBSHIRANI (1993), An introduction to the bootstrap, Monographs on statistics and applied probability, Vol. 57, Chapman & Hall, New York.
6. ENNIS, M., G. HINTON, D. NAYLOR, M. REVOW and R. TIBSHIRANI (1998). A comparison of statistical learning methods on the Gusto database, Statistics in Medicine 17, 2501-2508.
7. GRAY, R. J. (1992), Flexible methods for analyzing survival data using splines, with applications to breast cancer prognosis, Journal of the American Statistical Association 87, 942-951.
8. HARRELL, F. E., Jr., K. L. LEE and D. B. MARK (1996), Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors, Statistics in Medicine 15, 361-387.
9. HILDEN, J., J. D. HABBEMA and B. BJERREGAARD (1978), The measurement of performance in probabilistic diagnosis. II. Trustworthiness of the exact values of the diagnostic probabilities, Methods of Information in Medicine 17, 227-237.
10. HOERL, A. E. and R. W. KENNARD (1970), Ridge regression: biased estimation for nonorthogonal problems, Technometrics 12, 55-67.
11. LE CESSIE, S. and J. C. VAN HOUWELINGEN (1992), Ridge estimators in logistic regression, Applied Statistics - Journal of the Royal Statistical Society, Series C 41, 191-201.
12. LEE, K. L., L. H. WOODLIEF, E. J. TOPOL, W. D. WEAVER, A. BETRIU, J. COL, M. SIMOONS, P. AYLWARD, F. VAN DE WERP and R. M. CALIFF (1995), Predictors of 30-day mortality in the era of reperfusion for acute myocardial infarction. Results from an international trial of 41,021 patients, Circulation 91, 1659-1668.
13. MILLER, M. E., S. L. HUI and W. M. TIERNEY (1991), Validation techniques for logistic regression models, Statistics in Medicine 10, 1213-1226.
14. MUELLER, H. S., L. S. COHEN, E. BRAUNWALD, S. FORMAN, F. FEIT, A. ROSS, M. SCHWEIGER, H. CABIN, R. DAVISON, D. MILLER, R. SOLOMON and G. L. KNATTERUD (1992), Predictors of early morbidity and mortality after thrombolytic therapy of acute myocardial infarction, Circulation 85, 1254-1264.
15. STEYERBERG, E. W, M. J. EIJKEMANS and J. D. HABBEMA (1999), Stepwise selection in small data sets: a simulation study of bias in logistic regression analysis, Journal of Clinical Epidemiology 52, 935-942.
16. STEYERBERG, E. W., M. J. EIJKEMANS, F. E. HARRELL, Jr. and J. D. HABBEMA (2000), Prognostic modelling with logistic regression analysis: a comparison of selection and estimation methods in small data sets, Statistics in Medicine 19, 1059-1079.
17. TIBSHIRANI, R. (1996), Regression and shrinkage via the Lasso, Journal of the Royal Statistical Society, Series B 58, 267-288.
18. VAN HOUWELINGEN, J. C. and S. LE CESSIE (1990), Predictive value of statistical models, Statistics in Medicine 9, 1303-1325.
19. VAN HOUWELINGEN, J. C. (2001), Shrinkage and penalized likelihood as methods to improve predictive accuracy, Statistica Neerlandica 55, 17-34.
20. VERWEIJ, P. J. and H. C. VAN HOUWELINGEN (1994), Penalized likelihood in Cox regression, Statistics in Medicine 13, 2427-2436.
21. YE, J. (1998), On measuring and correcting the effects of data mining and model selection, Journal of the American Statistical Association 93, 120-131.