What you see may not be what you get: A brief, nontechnical introduction to overfitting in regression-type models

Psychosomatic Medicine

Volumn 66, Issue 3, 2004, Pages 411-421

  Babyak, Michael A ^a  

^a DUKE UNIVERSITY MEDICAL CENTER   (United States)

Author keywords

Dichotomization; Overfitting; Regression; Simulation; Statistical models

Indexed keywords

ARTICLE; COMPUTER SIMULATION; DATA ANALYSIS; PRIORITY JOURNAL; PSYCHOSOMATICS; REGRESSION ANALYSIS; STATISTICAL MODEL; SURVIVAL;

EID: 2442695245     PISSN: 00333174     EISSN: None     Source Type: Journal    
DOI: 10.1097/01.psy.0000127692.23278.a9     Document Type: Article

References (28)

1. Taleb NN. Fooled by randomness. New York: Texere; 2001.
2. Mendes de Leon CF, Babyak MA. Advanced quantitative methods in psychosomatic research. Workshop presented to the Annual Meeting of the American Psychosomatic Society, Phoenix, AZ, 2003.
3. Harrell FE Jr. Regression modeling strategies: with applications to linear models, logistic regression and survival analysis. New York: Springer; 2001.
4. McCullagh P, Nelder J. Generalized linear models. London: Chapman & Hall; 1989.
5. Cox DR. Regression models and life tables. J R Stat Soc B 1972:187-202.
6. Hardin JW, Hilbe JM. Generalized estimating equations. London: Chapman & Hall/CRC; 2003;34.
7. Green SB. How many subjects does it take to do a regression analysis? Multivar Behav Res 1991;26:499-510.
8. Peduzzi PN, Concato J, Holford TR, Feinstein AR. The importance of events per independent variable in multivariable analysis, II: accuracy and precision of regression estimates. J Clin Epidemiol 1995;48:1503-10.
9. Peduzzi PN, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol 1996;49:1373-9.
10. Thompson B. Stepwise regression and stepwise discriminant analysis need not apply here: a guidelines editorial. Ed Psychol Meas 1995;55:525-34.
11. Cohen J. Things I have learned (so far). Am Psychol 1990;45:1304-12.
12. Altman DG, Andersen PK. Bootstrap investigation of the stability of a Cox regression model. Stat Med 2003;8:771-83.
13. Derksen S, Keselman HJ. Backward, forward and stepwise automated subset selection algorithms: frequency of obtaining authentic and noise variables. Br J Math Stat Psychol 1992;45:265-82.
14. Steyerberg EW, Harrell FE, Habbema JD. Prognostic modeling with logistic regression analysis: in search of a sensible strategy in small data sets. Med Decis Making 2001;21:45-56.
15. Roecker EB. Prediction error and its estimation for subset-selected models. Technometrics 1991;33:459-68.
16. Copas JB. Regression, prediction, and shrinkage (with discussion). J R Stat Soc B 1983;45:311-54.
17. Tibshirani R. Regression shrinkage and selection via the lasso. J R Stat Soc B 2003;58:267-88.
18. Cohen J, Cohen P. Applied multiple regression/correlation analysis for the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum Associates; 1983.
19. Grambsch PM, O'Brien PC. The effects of preliminary tests for nonlinearity in regression. Stat Med 1991;10:697-709.
20. Faraway JJ. The cost of data analysis. J Comput Graph Stat 1992;1:213-29.
21. Maxwell SE, Delaney HD. Bivariate median splits and spurious statistical significance. Psychol Bull 1993;113:181-90.
22. D'Hoore W, Sicotte C, Tilquin C. Risk adjustment in out-come assessment: the Charlson Comorbidity Index. Methods Inf Med 1993;32:382-7.
23. Efron B, Tibshirani R. An introduction to the bootstrap. London: Chapman & Hall; 2003.
24. Steyerberg EW, Harrell FE Jr, Borsboom GJ, Eijkemans MJ, Vergouwe Y, Habbema JD. Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol 2001; 54:774-81.
25. Freedman D. Statistical models and shoe leather (with discussion). Soc Methodol 1991;21:291-313.
26. Mulaik SA. The metaphoric origins of objectivity, subjectivity and consciousness in the direct perception of reality. Philos Sci 1995;62:283-303.
27. MacCallum RC, Zhang S, Preacher KJ, Rucker DD. On the practice of dichotomization of quantitative variables. Psychol Methods 2002;7:19-40.
28. McClelland G. Negative consequences of dichotomizing continuous predictor variables. Available at: http://psych.colorado.edu/~mcclella/MedianSplit/.