A jackknife type approach to statistical model selection

Journal of Statistical Planning and Inference

Volumn 142, Issue 1, 2012, Pages 301-311

  Lee, Hyunsook ^a   Jogesh Babu, G ^b   Rao, C R ^b  

^a Korea Institute of Science and Technology Evaluation and Planning (KISTEP)   (South Korea)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Information criterion; Jackknife; Kullback Leibler divergence; Maximum likelihood estimation; Model selection; Unbiased estimation

Indexed keywords

EID: 80052277048     PISSN: 03783758     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jspi.2011.07.017     Document Type: Article

References (39)

1. Adams J.E., Gray H.L., Watkins T.A. An asymptotic characterization of bias reduction by jackknifing. Ann. Math. Statist. 1971, 42(5):1606-1612.
2. Akaike H. Information theory and an extension of the likelihood ratio principle. Proceedings of the Second International Symposium of Information Theory 1973, 257-281. Akademiai Kiado, Budapest. B.N. Petrov, F. Csaki (Eds.).
3. Akaike H. A new look at statistical model identification. IEEE Trans. Automat. Control 1974, 19:716-723.
4. Bai Z.D., Rao C.R., Wu Y. Model selection with data-oriented penalty. J. Statist. Plann. Inference 1999, 77:103-117.
5. Bozdogan H. Akaike's information criterion and recent developments in information complexity. J. Math. Psychol. 2000, 44(1):62-91.
6. Burnham K.P., Anderson D.R. Model Selection and Inference, A practical Information-Theoretic Approach 2002, Springer-Verlag, New York. 2nd ed.
7. Cavanaugh J.E., Shumway R.H. A bootstrap variant of AIC for state-space model selection. Statist. Sinica 1997, 7:473-496.
8. Chung H., Lee K., Koo J. A note on bootstrap model selection criterion. Statist. Probab. Lett. 1996, 26:35-41.
9. Djurić, P.M., 1997. Using the bootstrap to select models. In: ICASSP'97, vol. 5, pp. 3729-3732.
10. Feng Z.D., McCulloch C.E. Using bootstrap likelihood ratios in finite mixture models. J. Roy. Statist. Soc. B 1996, 58:609-617.
11. Firth D. Bias reduction of maximum likelihood estimates. Biometrika 1993, 80(1):27-38.
12. Herzberg A.M., Tsukanov A.V. A note on modifications of the jackknife criterion for model selection. Utilitas Math. 1986, 29:209-216.
13. Herzberg A.M., Tsukanov A.V. The Monte-Carlo comparison of two criteria for the selection of models. J. Statist. Comput. Simul. 1985, 22:113-126.
14. Hjorth J.S.U. Computer Intensive Statistical Methods: Validation, Model Selection and Bootstrap 1994, Chapman & Hall, London.
15. Huber, P.J., 1967. The behavior of maximum likelihood estimates under nonstandard conditions. In: Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability, vol 1, pp. 221-233.
16. Hurvich C.M., Tsai C. Regression and time series model selection in small samples. Biometrika 1989, 76(2):297-307.
17. Ishiguro M., Sakamoto Y., Kitagawa G. Bootstrapping log likelihood and EIC, an extension of AIC. Ann. Inst. Statist. Math. 1997, 49(3):411-434.
18. Konishi, S., Kitagawa, G., 2008. Information Criteria and Statistical Modeling. Springer Series in Statistics, Springer, New York.
19. Konishi S., Kitagawa G. Generalised information criteria in model selection. Biometrika 1996, 83(4):875-890.
20. Kuha J. AIC and BIC. Soc. Meth. Res. 2004, 33(2):188-229.
21. Kullback S., Leibler R.A. On information and sufficiency. Ann. Math. Statist. 1951, 22(1):79-86.
22. LeCam L. On Some Asymptotic Properties of Maximum Likelihood estimates and Related Bayes Estimates. Univ. California Pub. Statist. 1953, 1:277-330.
23. Mallows C.L. Some comments on Cp. Technometrics 1973, 15:661-675.
24. McQuarrie A., Shumway R., Tsai C. The model selection criterion AICu. Statist. Probab. Lett. 1997, 34:285-292.
25. Miller G. The jackknife-a review. Biometrika 1974, 61(1):1-15.
26. Neath A.A., Cavanaugh J.E. A regression model selection criterion based on bootstrap bumping for use with resistant fitting. Comput. Statist. Data Anal. 2000, 35(2):155-169.
27. Nishii R. Maximum likelihood principle and model selection when the true model is unspecified. J. Multivariate Anal. 1988, 27(2):392-403.
28. Protassov R., et al. Statistics handle with care: detecting multiple model components with the likelihood ratio. Astrophys. J. 2002, 571:545-559.
29. Rao C.R., Wu Y. A strongly consistent procedure for model selection in a regression problem. Biometrika 1989, 76:369-374.
30. Shao J. Bootstrap model selection. J. Amer. Statist. Assoc. 1996, 91:655-665.
31. Shao J., Tu D. The Jackknife and Bootstrap 1995, Springer-Verlag, New York.
32. Shao J. Linear model selection by cross-validation. J. Amer. Statist. Assoc. 1993, 88:486-494.
33. Shao J., Wu C.F.J. A general theory for jackknife variance estimation. Ann. Statist. 1989, 17(3):1176-1197.
34. Shibata R. Bootstrap estimate of Kullback-Leibler information for model selection. Statist. Sinica 1997, 7:375-394.
35. Sin C., White H. Information criteria for selecting possibly misspecified parametric models. J. Econometrics 1996, 71:207-225.
36. Spiegelhalter D.J., et al. Bayesian measures of model complexity and fit. J. Roy. Statist. Soc. B 2002, 64(4):583-639.
37. Stone M. An asymptotic equivalence of choice of model by cross-validation and Akaike's criterion. J. Roy. Statist. Soc. B 1977, 39(1):44-47.
38. Takeuchi K. Distribution of information statistics and a criterion of model fitting. Suri-Kagaku 1976, 153:12-18. (in Japanese).
39. Wald A. Note on the consistency of the maximum likelihood estimate. Ann. Math. Statist. 1949, 20(4):595-601.