A note on overfitting properties of KIC and KICc

Signal Processing

Volumn 86, Issue 10, 2006, Pages 3055-3060

  Seghouane, Abd Krim ^a,b  

^a CSIRO   (Australia)

^b AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

AIC; KIC; KICc; Kullback Leibler information; Model selection

Indexed keywords

INFORMATION MANAGEMENT; MATHEMATICAL MODELS; SIGNAL PROCESSING;

AIC; KICC; KULLBACK INFORMATION CRITERION (KIC); KULLBACK-LEIBLER INFORMATION; MODEL SELECTION;

STATISTICAL METHODS;

EID: 33745852805     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2006.01.002     Document Type: Article

References (13)

1. Kullback S., and Leibler R.A. On information and sufficiency. Ann. Math. Statist. 22 (1951) 76-86
2. Akaike H. Information theory and an extension of the maximum likelihood principle. In: Petrov B.N., and Csaki F. (Eds). Proceedings of the 2nd International Symposium on Information Theory (1973), Akademia Kiado, Budapest 267-281
3. Akaike H. A new look at the statistical model identification. IEEE Trans. Automat. Control 19 (1974) 716-723
4. H. Jeffreys, An invariant form of the prior probability in estimation problems, J. Roy. Statist. Soc. A (1946) 453-469.
5. Cavanaugh J.E. A large-sample model selection criterion based on kullback's symmetric divergence. Statist. Probab. Lett. 42 (1999) 333-343
6. Seghouane A.K., and Bekara M. A small sample model selection criterion based on the kullback symmetric divergence. IEEE Trans. Signal Process. 52 (2004) 3314-3323
7. Matsuoka T., and Ulrych T.J. Information theory measures with application to model identification. IEEE Trans. Acoust. Speech Signal Process. 34 (1986) 511-517
8. Hurvich C.M., and Tsai C.L. Regression and time series model selection in small samples. Biometrika 76 (1989) 297-307
9. Seghouane A.K., Bekara M., and Fleury G. A criterion for model selection in the presence of incomplete data based on kullback's symmetric divergence. Signal Process. 85 (2005) 1405-1417
10. H. Shimodaira, A New Criterion for Selecting Models from Partially Observed Data, vol. 89, in: P. Cheenseman, R.W. Oldford (Eds.), Springer, Berlin, 1994.
11. Cavanaugh J.E., and Shumway R.H. An akaike information criterion for model selection in the presence of incomplete data. J. Statist. Plann. Inference 67 (1998) 45-65
12. S. Kotz, N.L. Johnson, C.B. Read (Eds.), Encyclopedia of Statistical Sciences, vol. 2, Wiley, New York, 1982.
13. Ferguson T.S. A Course in Large Sample Theory. first ed. (1996), Chapman & Hall, New York