Using the bootstrap to improve estimation and confidence intervals for regression coefficients selected using backwards variable elimination

Statistics in Medicine

Volumn 27, Issue 17, 2008, Pages 3286-3300

  Austin, Peter C ^a,b  

^a INSTITUTE FOR CLINICAL EVALUATIVE SCIENCES   (Canada)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

Automated variable selection; Backwards variable elimination; Bootstrap; Confidence intervals; Monte Carlo simulations; Regression models

Indexed keywords

ARTICLE; BACKWARDS VARIABLE ELIMINATION; BOOTSTRAPPING; CONFIDENCE INTERVAL; CONTROLLED STUDY; CORRELATION COEFFICIENT; FEMALE; HEART INFARCTION; HUMAN; LEARNING ALGORITHM; LOGISTIC REGRESSION ANALYSIS; MAJOR CLINICAL STUDY; MONTE CARLO METHOD; NONPARAMETRIC TEST; REGRESSION ANALYSIS; STATISTICS;

COMPUTER SIMULATION; CONFIDENCE INTERVALS; DATA INTERPRETATION, STATISTICAL; FEMALE; HUMANS; LOGISTIC MODELS; MALE; MONTE CARLO METHOD; MYOCARDIAL INFARCTION; QUALITY OF HEALTH CARE; RESEARCH DESIGN;

EID: 48249087696     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.3104     Document Type: Article

References (29)

1. Miller AJ. Selection of subsets of regression variables. Journal of the Royal Statistical Society, Series A 1984; 147:389-425.
2. Miller A. Subset Selection in Regression (2nd edn). Chapman & Hall/CRC: Boca Raton, FL, 2002.
3. Hocking RR. The analysis and selection of variables in linear regression. Biometrics 1976; 32:1-49.
4. Derkson S, Keselman HJ. Backward, forward and stepwise automated subset selection algorithms: frequency of obtaining authentic and noise variables. British Journal of Mathematical and Statistical Psychology 1992; 45:265-282.
5. Flack VF, Chang PC. Frequency of selecting noise variables in subset regression analysis: a simulation study. The American Statistician 1987; 14:84-86.
6. Murtaugh PA. Methods of variable selection in regression modeling. Communications in Statistics - Simulation and Computation 1998; 27:711-734.
7. Copas JB, Long T. Estimating the residual variance in orthogonal regression with variable selection. The Statistician 1991; 40:51-59.
8. Austin PC, Tu JV. Automated variable selection methods for logistic regression result in unstable models for predicting AMI mortality. Journal of Clinical Epidemiology 2004; 57:1138-1146.
9. Harrell Jr FE. Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis. Springer: New York, NY, 2001.
10. Hurvich CM, Tsai C-L. The impact of model selection on inference in linear regression. The American Statistician 1990; 44:214-217.
11. Tu JV, Donovan LR, Lee DS, Austin PC, Ko DT, Wang JT, Newman AM. Quality of Cardiac Care in Ontario. Institute for Clinical Evaluative Sciences: Toronto, Ont., 2004.
12. Austin PC. A comparison of classification and regression trees, logistic regression, generalized additive models, and multivariate adaptive regression splines for predicting AMI mortality. Statistics in Medicine 2007; 26:2937-2957.
13. Austin PC, Mamdani MM. A comparison of propensity score methods: a case-study estimating the effectiveness of post-AMI statin use. Statistics in Medicine 2006; 25:2084-2106.
14. Austin PC, Tu JV. Comparing clinical data with administrative data for producing AMI report cards. Journal of the Royal Statistical Society, Series A (Statistics in Society) 2006; 169:115-126.
15. Austin PC, Mamdani MM, Juurlink DN, Alter DA, Tu JV. Missed opportunities in the secondary prevention of myocardial infarction: an assessment of the effects of satin underprescribing on mortality. American Heart Journal 2006; 151:969-975.
16. Austin PC, Mamdani MM, Stukel TA, Anderson GM, Tu JV. The use of the propensity score for estimating treatment effects: administrative versus clinical data. Statistics in Medicine 2005; 24:1563-1578.
17. Efron B, Tibshirani R. An Introduction to the Bootstrap. Chapman & Hall: London, 1993.
18. Steyerberg EW, Eijkemans MJC, Harrell Jr FE, Habbema JDF. Prognostic modeling with logistic regression analysis: a comparison of selection and estimation methods in small datasets. Statistics in Medicine 2000; 19:1059-1079.
19. R Core Development Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing: Vienna, 2005.
20. Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. Journal of Clinical Epidemiology 1996; 49:1373-1379.
21. Sauerbrei W, Schumacher M. A bootstrap resampling procedure for model building: application to the Cox regression model. Statistics in Medicine 1992; 11:2093-2109.
22. Austin PC, Tu JV. Bootstrap methods for developing predictive models in cardiovascular research. The American Statistician 2004; 58:131-137.
23. Sabik JF, Gillinov AM, Blackstone EH et al. Does off-pump coronary surgery reduce morbidity and mortality? Journal of Thoracic and Cardiovascular Surgery 2002; 124:698-707.
24. Koch CG, Khandwala F, Nussmeier N, Blackstone EH. Gender and outcomes after coronary artery bypass grafting: a propensity matched comparison. Journal of Thoracic and Cardiovascular Surgery 2003; 126:2032-2043.
25. Rice TW, Khuntia D, Rybicki LA, Adelstein DJ, Vogelbaum MA, Mason DP, Murthy SC, Blackstone EH. Brain metastases from esophageal cancer: a phenomenon of adjuvant therapy? Annals of Thoracic Surgery 2006; 82(6):2042-2049, 2049, e1-e2.
26. DeCamp MM, Blackstone EH, Naunheim KS, Krasna MJ, Wood DE, Meli YM, McKenna Jr RJ, NETT Research Group. Patient and surgical factors influencing air leak after lung volume reduction surgery: lessons learned from the National Emphysema Treatment Trial. Annals of Thoracic Surgery 2006; 82(1): 197-206.
27. Svensson LG, Blackstone EH, Rajeswaran J, Sabik 3rd JF, Lytle BW, Gonzalez-Stawinski G, Varvitsiotis P, Banbury MK, McCarthy PM, Pettersson GB, Cosgrove DM. Does the arterial cannulation site for circulatory arrest influence stroke risk? Annals of Thoracic Surgery 2004; 78(4):1274-1284.
28. Sabik JF, Nemeh H, Lytle BW, Blackstone EH, Gillinov AM, Rajeswaran J, Cosgrove DM. Cannulation of the axillary artery with a side graft reduces morbidity. Annals of Thoracic Surgery 2004; 77(4):1315-1320.
29. Shishehbor MH, Seshadri N, Aktas M, Acharya N, Gillinov AM, Blackstone EH, Houghtaling PL, Migrino RQ, Ghaffari S. Comparison of outcomes in patients undergoing coronary bypass of patent versus restenosed bare metal sented coronary arteries. American Journal of Cardiology 2005; 96:1416-1419.