An asymptotic theory for linear model selection

Statistica Sinica

Volumn 7, Issue 2, 1997, Pages 221-264

  Shao, Jun ^a,b  

^a UNIVERSITY OF WISCONSIN   (United States)

^b University of Wisconsin Madison   (United States)

Author keywords

AIC; Asymptotic loss efficiency; BIC; C p; Consistency; Cross validation; GIC; Squared error loss

Indexed keywords

EID: 0642336882     PISSN: 10170405     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (36)

1. Akaike, H. (1970). Statistical predictor identification. Ann. Inst. Statist. Math. 22, 203-217.
2. Allen, D. M. (1974). The relationship between variable selection and data augmentation and a method for prediction. Technometrics 16, 125-127.
3. Burman, P. (1989). A comparative study of ordinary cross-validation, v-fold cross-validation and the repeated learning-testing methods. Biometrika 76, 503-514.
4. Craven, P. and Wahba, G. (1979). Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by the method of generalized cross-validation. Numer. Math. 31, 377-403.
5. Geisser, S. (1975). The predictive sample reuse method with applications. J. Amer. Statist. Assoc. 70, 320-328.
6. Gunst, R. F. and Mason, R. L. (1980). Regression Analysis and Its Application. Marcel Dekker, New York.
7. Hannan, E. J. and Quinn, B. G. (1979). The determination of the order of an autoregression. J. Roy. Statist. Soc. Ser. B 41, 190-195.
8. p, CL, cross-validation and generalized cross-validation: Discrete index set. Ann. Statist. 15, 958-975.
9. p,. Technometrics 15, 661-675.
10. Nishii, R. (1984). Asymptotic properties of criteria for selection of variables in multiple regression. Ann. Statist. 12, 758-765.
11. Pötscher, B. M. (1989). Model selection under nonstationary: autoregressive models and stochastic linear regression models. Ann. Statist. 17, 1257-1274.
12. Rao, C. R. and Wu, Y. (1989). A strongly consistent procedure for model selection in a regression problem. Biometrika 76, 369-374.
13. Rissanen, J. (1986). Stochastic complexity and modeling. Ann. Statist. 14, 1080-1100.
14. Schwarz, G. (1978). Estimating the dimensions of a model. Ann. Statist. 6, 461-464.
15. Shao, J. (1993). Linear model selection by cross-validation. J. Amer. Statist. Assoc. 88, 486-494.
16. Shibata, R. (1981). An optimal selection of regression variables. Biometrika 68, 45-54.
17. Shibata, R. (1984). Approximate efficiency of a selection procedure for the number of regression variables. Biometrika 71, 43-49.
18. Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions. J. Roy. Statist. Soc. Ser. B 36, 111-147.
19. Stone, M. (1979). Comments on model selection criteria of Akaike and Schwarz. J. Roy. Statist. Soc. Ser. B 41, 276-278.
20. Wei, C. Z. (1992). On predictive least squares principles. Ann. Statist. 20, 1-42.
21. Whittle, P. (1960). Bounds for the moments of linear and quadratic forms in independent variables. Theory Probab. Appl. 5, 302-305.
22. Zhang, P. (1993). Model selection via multifold cross validation. Ann. Statist. 21, 299-313.
23. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In 2nd International Symposium on Information Theory (Edited by B. N. Petrov and F. Csáki), 267-281. Akadémiai Kiado, Budapest.
24. Beran, R. and Dümbgen, L. (1996). Modulation estimators and confidence sets. Beiträge zur Statistik 31. Institut für Angewandte Mathematik, Universität Heidelberg.
25. Breiman, L., Friedman, J. H., Olshen, R. A. and Stone, C. J. (1984). Classification and Regression Trees. Wadsworth International Group, Belmont, California.
26. Clementi, S. (1995). Comment: Data analyses or problem formulations? J. Chemometrics 9, 226-228.
27. George, E. I. and Foster, D. P. (1994). The risk inflation criterion for multiple regression. Ann. Statist. 22, 1947-1975.
28. Hsiao, C. (1986). Analysis of Panel Data. Cambridge University Press, New York.
29. James, W. and Stein, C. (1961). Estimation with quadratic loss. In Proc. Fourth Berkeley Symp. on Math. Statist. Prob. 1 (Edited by J. Neyman), 361-380. University of California Press, Berkeley.
30. Pinsker, M. S. (1980). Optimal filtration of square-integrable signals in Gaussian noise. Problems Inform. Transmission 16, 120-133.
31. Rao, J. S. (1994). Adaptive subset selection via cost-optimization using resampling methods in linear regression models. Ph.D. dissertation, University of Toronto.
32. Rice, J. (1984). Bandwidth choice for nonparametric regression. Ann. Statist. 12, 1215-1230.
33. Rissanen, J. (1986b). Order estimation by accumulated prediction errors. J. Appl. Probab. 23, 55-61.
34. Stein, C. (1956). Inadmissibility of the usual estimator for the mean of a multivariate normal distribution. In Proc. Third Berkeley Symp. on Math. Statist. Prob. 1 (Edited by J. Neyman), 107-206. University of California Press, Berkeley.
35. Zhang, P. (1992). On the distributional properties of model selection criteria. J. Amer. Statist. Assoc. 87, 732-737.
36. Zhang, P. (1996). APE and model selection: Linear models for panel data. Technical report, Department of Statistics, University of Pennsylvania.