Model selection bias and Freedman's paradox

Annals of the Institute of Statistical Mathematics

Volumn 62, Issue 1, 2010, Pages 117-125

  Lukacs, Paul M ^a   Burnham, Kenneth P ^b   Anderson, David R ^b  

^a Colorado Division of Wildlife ^*  (United States)

^b Colorado State University ^*  (United States)

Author keywords

Akaike's information criterion; Confidence interval coverage; Freedman's paradox; Model averaging; Model selection bias; Model selection uncertainty; Multimodel inference; Stepwise selection

Indexed keywords

AKAIKE'S INFORMATION CRITERIONS; CONFIDENCE INTERVAL; MODEL AVERAGING; MODEL SELECTION; MULTI-MODEL INFERENCE;

EID: 77950691265     PISSN: 00203157     EISSN: 15729052     Source Type: Journal    
DOI: 10.1007/s10463-009-0234-4     Document Type: Article

References (23)

1. Akaike, H. (1973). Information theory as an extension of themaximum likelihood principle. In B. N. Petrov, F. Csaki (Eds.), Second international symposium on information theory (pp. 267-281). Budapest: Akademiai Kiado.
2. Akaike, H. (1978). On the likelihood of a time series model. The Statistician, 27, 217-235.
3. Akaike, H. (1979). A Bayesian extension of the minimum AIC procedure of autoregressive model fitting. Biometrika, 66, 237-242.
4. Anderson, D. R. (2008). Model based inference in the life sciences: primer on evidence.New York: Springer.
5. Buckland, S. T., Burnham, K. P., Augustin, N. H. (1997). Model selection: An integral part of inference. Biometrics, 53, 603-618.
6. Burnham, K. P., Anderson, D. R. (2002). Model selection and multimodel inference: A practical information-theoretic approach (2nd ed.). New York: Springer.
7. Burnham, K. P., Anderson, D. R. (2004). Multimodel inference: understanding AIC and BIC in model selection. Sociological Methods and Research, 33, 261-304.
8. Claeskens, G., Hjort, N. L. (2008). Model selection and model averaging. New York: Cambridge University Press.
9. Freedman, D. A. (1983). A note on screening regression equations. The American Statistician, 37, 152-155.
10. George, E. I., McCulloch, R. E. (1993). Variable selection via Gibbs sampling. Journal of the American Statistical Association, 88, 881-889.
11. Hoeting, J. A., Madigan, D., Raftery, A. E., Volinsky, C. T. (1999). Bayesian model averaging: a tutorial (with discussion). Statistical Science, 14, 382-417.
12. Hurvich, C. M., Tsai, C.-L. (1989). Regression and time series model selection in small samples. Biometrika, 76, 297-307.
13. Hurvich, C. M., Tsai, C.-L. (1990). The impact of model selection on inference in linear regression. The American Statistician, 44, 214-217.
14. Massart, P. (2007). Concentration inequalities and model selection. Berlin: Springer.
15. McQuarrie, A. D. R., Tsai, C.-L. (1998). Regression and time series model selection. Singapore: World Scientific Publishing Co.
16. Miller, A. J. (2002). Subset selection in regression (2nd ed.). New York: Chapman and Hall.
17. Rawlings, J. O. (1988). Applied regression analysis: a research tool. Belmont: Wadsworth, Inc.
18. Rencher, A. C., Pun, F. C. (1980). Inflation of R2 in best subset regression. Technometrics, 22, 49-53
19. SAS Institute, Inc. (2001). SAS version 8.02, Cary, NC.
20. Sugiura, N. (1978). Further analysis of the data by Akaike's information criterion and the finite corrections. Communications in Statistics, Theory and Methods, A7, 13-26.
21. Wheeler, M. W. (2009). Comparing model averaging with other model selection strategies for benchmark dose estimation. Environmetrics and Ecological Statistics, 16, 37-51.
22. Wheeler,M.W., Bailer, A. J. (2007). Properties of model-averaged BMDLs: a study of model averaging in dichotomous response risk estimation. Risk Analysis, 27, 659-670.
23. Yang, Y. (2007). Prediction/estimation with simple linear models: is it really simple? Econometric Theory, 23, 1-36.