On model selection curves

International Statistical Review

Volumn 78, Issue 2, 2010, Pages 240-256

  Müller, Samuel ^a   Welsh, Alan H ^b  

^a UNIVERSITY OF SYDNEY   (Australia)

^b AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

Akaike information criterion (AIC); Bayesian information criterion (BIC); Generalized information criterion (GIC); Linear regression; Model selection; Model selection curves

Indexed keywords

EID: 84855559885     PISSN: 03067734     EISSN: 17515823     Source Type: Journal    
DOI: 10.1111/j.1751-5823.2010.00108.x     Document Type: Article

References (32)

1. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In Proceedings of the Second International Symposium of Information Theory, Eds. B.N. Petrov, F.Csáki, pp. 267-281. Akadémiai Kiadó: Budapest.
2. Bai, Z.D., Krishnaiah, P.R. & Zhao, L.C. (1986). On detection of the number of signals when the noise covariance matrix is arbitrary. J. Multivariate Anal., 20, 26-49.
3. Casella, G. & Consonni, G. (2009). Reconciling model selection and prediction. arXiv:0903.3620v1, 19 pp.
4. Claeskens, G. & Hjort, N.L. (2008). Model selection and model averaging. New York: Cambridge.
5. Flury, B. & Riedwyl, H. (1988). Multivariate statistics. A practical approach. London: Chapman and Hall.
6. Foster, D.P. & George, E.I. (1994). The risk inflation criterion for multiple regression. Ann. Statist., 22, 1947-1975.
7. Gunst, G.P. & Mason, R.L. (1980). Regression analysis and its applications. New York: Marcel Dekker.
8. Hald, A. (1952). Statistical theory with engineering applications. New York: Wiley.
9. Hannan, E.J. & Quinn, B.G. (1979). The determination of the order of an autoregression. J. R. Stat. Soc. Ser. B Stat. Methodol., 41, 190-195.
10. Hastie, T., Tibshirani, R. & Friedman, J. (2001). The elements of statistical learning. New York: Springer-Verlag.
11. Hurvich, C.M. & Tsai, C.-L. (1989). Regression and time series model selection in small samples. Biometrika, 76, 297-307.
12. Konishi, S. & Kitagawa, G. (1996). Generalised information criteria in model selection. Biometrika, 83, 875-890.
13. Li, K.-C. (1987). Asymptotic optimality for Cp, CL, cross-validation and generalized cross-validation: Discrete index set. Ann. Statist., 15, 958-975.
14. Mallows, C.L. (1973). Some comments on Cp. Technometrics, 15, 661-675.
15. Miller, A. (2002). Subset selection in regression, 2nd ed. Boca Raton: Chapman & Hall/CRC.
16. Müller, S. & Welsh, A.H. (2005). Outlier robust model selection in linear regression. J. Amer. Statist. Assoc., 100, 1297-1310.
17. Müller, S. &Welsh, A.H. (2009). Robust model selection in generalized linear models. Statist. Sinica, 19, 1155-1170.
18. Piepel, G. & Redgate, T. (1998). A mixture experiment analysis of the Hald cement data. Amer. Statist., 52, 23-30.
19. Rao, C.F. & Wu, Y. (1989). A strongly consistent procedure for model selection in a regression problem. Biometrika, 76, 369-374.
20. Ronchetti, E., Field, C. & Blanchard, W. (1997). Robust linear model selection by cross-validation. J. Amer. Statist. Assoc., 92, 1017-1023.
21. Ronchetti, E. & Staudte, R.G. (1994). A robust version of Mallows' CP. J. Amer. Statist. Assoc., 89, 550-559.
22. Schwarz, G. (1978). Estimating the dimension of a model. Ann. Statist., 6, 461-464.
23. Shao, J. (1993). Linear model selection by cross-validation. J. Amer. Statist. Soc., 88, 486-494.
24. Shao, J. (1996). Bootstrap model selection. J. Amer. Statist. Assoc., 91, 655-665.
25. Shao, J. (1997). An asymptotic theory for linear model selection (with discussion). Statist. Sinica, 7, 221-264.
26. Shibata, R. (1984). Approximate efficiency of a selection procedure for the number of regression variables. Biometrika, 71, 43-49.
27. Sugiura, N. (1978). Further analysis of the data by Akaike's information criterion and the finite corrections. Comm. Statist. Theory Methods, A7, 13-26.
28. Sugiyama, M. & Ogawa, H. (2001). Subspace information criterion for model selection. Neural Comput., 13, 1863-1889.
29. Takeuchi, K. (1976). Distribution of informational statistics and a criterion of model fitting. Suri-Kagaku, 153, 12-18.
30. Wisnowski, J.W., Simpson, J.R., Montgomery, D.C.&Runger, G.C. (2003). Resamplingmethods for variable selection in robust regression. Comput. Statist. Data Anal., 43, 341-355.
31. Woods, H., Steinour, H.H. & Starke, H.R. (1932). Effect of composition of Portland cement on heat evolved during hardening. Indus. Eng. Chem., 24, 1207-1214.
32. Yang, Y. (2005). Can the strengths of AIC and BIC be shared? A conflict between model indentification and regression estimation. Biometrika, 92, 937-950.