Can the strengths of AIC and BIC be shared? A conflict between model indentification and regression estimation

Biometrika

Volumn 92, Issue 4, 2005, Pages 937-950

  Yang, Yuhong ^a  

^a UNIVERSITY OF MINNESOTA   (United States)

Author keywords

AIC; BIC; Consistency; Minimax rate optimality; Model averaging; Model selection

Indexed keywords

EID: 27944460480     PISSN: 00063444     EISSN: 14643510     Source Type: Journal    
DOI: 10.1093/biomet/92.4.937     Document Type: Article

References (31)

1. AKAIKE, H. (1973). Information theory and an extension of the maximum likelihood principle. In P roc. 2nd Int. Symp. Info. Theory, Ed. B. N. Petrov and F. Csaki, pp. 267-81. Budapest: Akademia Kiado.
2. BARRON, A. R., BIRGÉ, L. & MASSART, P. (1999). Risk bounds for model selection via penalization. Prob. Theory Rel. Fields 113, 301-413.
3. BARRON, A. R., YANG, Y. & Yu, B. (1994). Asymptotically optimal function estimation by minimum complexity criteria. In Proc. 1994 Int. Symp. Info. Theory, p. 38. Trondheim, Norway: IEEE Info. Theory Soc.
4. BERGER, J. O. & PERICCHI, L. R. (2001). Objective Bayesian methods for model selection: introduction and comparison (with Discussion), In Model Selection, Ed. P. Lahiri, pp. 135-207. Institute of Mathematical Statistics Lecture Notes - Monograph Series Volume 38. Beachwood, OH: Inst. Math. Statist.
5. BIRGÉ, L. & MASSART, P. (2001). Gaussian model selection. J. Eur. Math, Soc. 3, 203-68.
6. BOX, G. E. P., JENKINS, G. M. & REINSEL, G. C. (1994). Time Series Analysis: Forecasting and Control. Englewood Cliffs, NJ: Prentice-Hall.
7. BROWN, L. D. & Low, M. G. (1996). A constrained risk inequality with applications to nonparametric functional estimation. Ann. Statist. 24, 2524-35.
8. BROWN, L. D., Low, M. G. & ZHAO, L. H. (1997). Superefficiency in nonparametric function estimation. Ann. Statist. 25, 2607-25.
9. CLYDE, M., DESIMONE, H. & PARMIGIANI, G. (1996). Prediction via orthogonalized model mixing. J. Am. Statist. Assoc. 91, 1197-208.
10. DONOHO, D. L. & JOHNSTONE, I. M. (1998). Minimax estimation via wavelet shrinkage. Ann. Statist. 26, 879-921.
11. FOSTER, D. P. & GEORGE, E. I. (1994). The risk inflation criterion for multiple regression. Ann. Statist. 22, 1947-75.
12. GEORGE, E. I. & FOSTER, D. P. (2000). Calibration and empirical Bayes variable selection. Biometrika 87, 731-47.
13. HAND, D. J. & VINCIOTTI, V. (2003). Local versus global models for classification problems: fitting models where it matters. Am. Statistician 57, 124-31.
14. HANSEN, M. & Yu, B. (1999). Bridging AIC and BIC: an MDL model selection criterion. In Proceedings of IEEE Information Theory Workshop on Detection, Estimation, Classification and Imaging, p. 63. Santa Fe, NM: IEEE Info. Theory Soc.
15. HOETING, J. A., MADIGAN, D., RAFTERY, A. E. & VOLINSKY, C. T. (1999). Bayesian model averaging: A tutorial (with Discussion). Statist. Sci. 14, 382-417.
16. LE CAM, L. (1973). Convergence of estimates under dimensionality restrictions. Ann. Statist. 1, 38-53.
17. LEEB, H. & PÖTSCHER, B. (2005). Model selection and inference: facts and fiction. Economet. Theory 21, 21-59.
18. L, cross-validation and generalized cross-validation: Discrete index set. Ann. Statist. 15, 958-75.
19. p. Technometrics 15, 661-75.
20. MCQUARRIE, A. D. R. & TSAI, C. L. (1998). Regression and Time Series Model Selection. Singapore: World Scientific Publications.
21. NISHII, R. (1084). Asymptotic properties of criteria for selection of variables in multiple regression. Ann. Statist. 12, 758-65.
22. p-test for the orthogonal series estimation of regression. Theory Prob. Applic. 35, 293-306.
23. RAFTERY, A. E. & ZHENG, Y. (2003). Comment on 'The focused information criterion' by Hjort and Claeskens. J. Am. Statist. Assoc. 98, 931-8.
24. RISSANEN, J. (1978). Modeling by shortest data description. Automatica 14, 465-71.
25. SCHWARZ, G. (1978). Estimating the dimension of a model. Ann. Statist. 6, 461-4.
26. SHAO, J. (1997). An asymptotic theory for linear model selection (with Discussion). Statist. Sinica 7, 221-42.
27. SHEN, X. & YE, J. (2002). Adaptive model selection. J. Am. Statist. Assoc. 97, 210-21.
28. SHIBATA, R. (1983). Asymptotic mean efficiency of a selection of regression variables. Ann. Inst. Statist. Math. 35, 415-23.
29. YANG, Y. (1999). Model selection for nonparametric regression. Statist. Sinica 9, 475-99.
30. YANG, Y. (2003). Regression with multiple candidate models: selecting or mixing? Statist. Sinica 13, 783-809.
31. YANG, Y. & BARRON, A. R. (1999). Information-theoretic determination of minimax rates of convergence. Ann. Statist. 27, 1564-99.