Asymptotic bootstrap corrections of AIC for linear regression models

Signal Processing

Volumn 90, Issue 1, 2010, Pages 217-224

  Seghouane, Abd Krim ^a  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

AIC; AICc; Bootstrap; Kullback Leibler information; Model selection

Indexed keywords

AIC; AICC; BOOTSTRAP; KULLBACK-LEIBLER INFORMATION; MODEL SELECTION;

LINEAR REGRESSION;

ASYMPTOTIC ANALYSIS;

EID: 69249221267     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2009.06.010     Document Type: Article

References (36)

1. Lee T.C. Segmenting images corrupted by correlated noise. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 (1998) 481-492
2. Krim H., and Schick I.C. Minimax description length for signal denoising and optimized representation. IEEE Transactions on Information Theory 45 (1999) 898-908
3. Liavas A.P., Regalia P.A., and Delmas J.P. Blind channel approximation: effective channel order determination. IEEE Transactions on Signal Processing 47 (1999) 3336-3344
4. Wong K.M., Zhang Q.T., Reilly J.P., and Yip P.C. On information theoretic criteria for determining the number of signals in high resolution array processing. IEEE Transactions on Acoustics, Speech and Signal Processing 38 (1990) 1959-1971
5. Seghouane A.K., and Cichocki A. Bayesian estimation of the number of principal components. Signal Processing 87 (2007) 562-568
6. Clergeot H. Filter order selection in adaptive maximum likelihood estimation. IEEE Transactions on Information Theory 30 (1984) 199-210
7. Akaike H. Information theory and an extension of the maximum likelihood principle. In: Petrov B.N., and Csáki F. (Eds). 2nd International Symposium on Information Theory vol. 30 (1973) 267-281
8. Rissanen J. Modeling by shortest data description. Automatica 14 (1978) 465-471
9. Akaike H. Time series analysis and control through parametric models. In: Findley D.F. (Ed). Applied Time Series Analysis (1978), Academic Press, New York 1-23
10. Schwartz G. Estimating the dimension of a model. Annals of Statistics 6 (1978) 461-464
11. Kullback S., and Leibler R.A. On information and sufficiency. The Annals of Mathematics Statistics 22 (1951) 76-86
12. Akaike H. A new look at the statistical model identification. IEEE Transactions on Automatic and Control 19 (1974) 716-723
13. Akaike H. Statistical predictor identification. Annals of the Institute of Statistical Mathematics 22 (1970) 203-217
14. Mallows C.L. Some comments on Cp. Technometrics 15 (1975) 661-675
15. Jeffreys H. An invariant form of the prior probability in estimation problems. The Journal of Royal Statistical Society A (1946) 453-469
16. Cavanaugh J.E. A large-sample model selection criterion based on Kullback's symmetric divergence. Statistics and Probability Letters 42 (1999) 333-343
17. Shao J. Linear model selection by cross-validation. Journal of the American Statistical Association 88 (1993) 486-494
18. Hurvich C.M., and Tsai C.L. Regression and time series model selection in small samples. Biometrika 76 (1989) 297-307
19. Efron B. Estimating the error rate of a prediction rule: improvement on cross-validation. Journal of the American Statistical Association 78 (1983) 316-331
20. Efron B. How biased is the apparent error rate of a prediction rule?. Journal of the American Statistical Association 81 (1986) 461-470
21. Takeuchi K. Distribution of information statistics and a criterion of model fitting. Suri-Kagaku (Mathematical Sciences) 153 (1976) 12-18 (in Japanese)
22. Shibata R. Statistical aspect of model selection. In: Willems J.C. (Ed). From Data to Model (1989) 215-240
23. Sugiura N. Further analysis of the data by Akaike's information criterion and the finite corrections. Communications in Statistics A7 (1978) 13-26
24. M. Ishiguro, Y. Sakamoto, WIC: an estimation-free information criterion, Research Memorandum of the Institute of Statistical Mathematics, Tokyo, 1991.
25. Ishiguro M., and Morita K. Application of an estimator-free information criterion (WIC) to aperture synthesis. In: Cornwell T.J., and Perley R.A. (Eds). Radio Interferometry: Theory, Techniques and Application (1991), Astronomical Society of the Pacific, San Francisco
26. Stoffer D.S., and Wall K.D. Bootstrapping state-space models: Gaussian maximum likelihood estimation and the Kalman filter. Journal of the American Statistical Association 86 (1991) 1024-1033
27. Cavanaugh J.E., and Shumway R.H. A bootstrap variant of AIC for state space model selection. Statistica Sinica 7 (1997) 473-496
28. Shibata R. Bootstrap estimate of Kullback-Leibler information for model selection. Statistica Sinica 7 (1997) 375-394
29. Shibata R. Selection of the order of an autoregressive model by Akaike's information criterion. Biometrika 63 (1976) 117-126
30. A.K. Seghouane, A novel AIC variant for linear regression models based on a bootstrap correction, in: Proceedings of the IEEE Workshop on Machine Learning for Signal Processing, 2008, pp. 139-144.
31. Seghouane A.K., and Amari S.I. The AIC criterion and symmetrizing the Kullback-Leibler divergence. IEEE Transactions on Neural Networks 18 (2007) 97-106
32. Seghouane A.K., and Bekara M. A small sample model selection criterion based on the Kullback symmetric divergence. IEEE Transactions on Signal Processing 52 (2004) 3314-3323
33. Djuric P.M. Asymptotic MAP criteria for model selection. IEEE Transactions on Signal Processing 46 (1998) 2726-2735
34. McQuarie A., and Tsai C.L. Regression and Time Series Model Selection (1998), World Scientific, Singapore
35. S. Koltz, N.L. Johnson, in: C.B. Read (Ed.), Encyclopedia of Statistical Sciences, vol. 2, Wiley, New York, 1982.
36. Shibata R. Asymptotically efficient selection of the order of the model for estimating parameters of a linear process. Annals of Statistics 80 (1980) 147-164