Criteria for linear model selection based on Kullback's symmetric divergence

Australian and New Zealand Journal of Statistics

Volumn 46, Issue 2, 2004, Pages 257-274

  Cavanaugh, Joseph E ^a  

^a UNIVERSITY OF IOWA   (United States)

Author keywords

AIC; Akaike information criterion; I divergence; J divergence; Kullback :Leibler information; Regression; Relative entropy

Indexed keywords

EID: 3042856494     PISSN: 13691473     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1467-842X.2004.00328.x     Document Type: Article

References (22)

1. AKAIKE, H. (1973). Information theory and an extension of the maximum likelihood principle. In 2nd International Symposium on Information Theory, eds B. N. Petrov & F. Csáki, pp. 267-281. Budapest: Akadémia Kiadó.
2. AKAIKE, H. (1974). A new look at the statistical model identification. IEEE Trans. Automat. Control AC-19, 716-723.
3. AKAIKE, H. (1978). Time series analysis and control through parametric models. In Applied Time Series Analysis, ed. D.F. Findley, pp. 1-23. New York: Academic Press.
4. BERNARDO, J.M. (1976). Psi (digamma) function. Appl. Statist. 25, 315-317.
5. BOZDOGAN, H. (1990). On the information-based measure of covariance complexity and its application to the evaluation of multivariate linear models. Comm. Statist. Theory Methods 19, 221-278.
6. CAVANAUOH, J.E. (1997). Unifying the derivations of the Akaike and corrected Akaike information criteria. Statist. Probab. Lett. 33, 201-208.
7. CAVANAUGH, J.E. ( 1999). A large-sample model selection criterion based on Kullback's symmetric divergence. Statist. Probab. Lett. 44, 333-344.
8. p in multivariate linear regression. Biometrika 84, 707-716.
9. HANNAN, E.J. & QUINN, B.G. (1979). The determination of the order of an autoregression. J. Roy. Statist. Soc. Ser. B 41, 190-195.
10. HURVICH, C.M. & TSAI, C-L. (1989). Regression and time series model selection in small samples. Biometrika 76, 297-307.
11. KOTZ, S. & JOHNSON, N.L. (Eds) (1982). Encyclopedia, of Statistical Sciences, Volume 2. New York: Wiley.
12. KULLBACK, S. (1968). Information Theory and Statistics. New York: Dover.
13. KULLBACK, S. & LEIBLER, R.A. (1951). On information and sufficiency. Ann. Math. Statist. 22, 76-86.
14. LINHART, H. & ZUCCHINI, W. (1986). Model Selection. New York: Wiley.
15. p. Technometrics 15, 661-675.
16. MCQUARRIE, A.D.R. & TSAI, C-L. (1998). Regression and Time Series Model Selection. New Jersey: World Scientific.
17. MCQUARRIE, A., SHUMWAY, R. & TSAI, C-L. (1997). The model selection criterion AICu. Statist. Probab. Lett. 34, 285-292.
18. PARZEN, E. (1974). Some recent advances in time series modeling. IEEE Trans. Automat. Control AC-19, 389-409.
19. RISSANEN, J. (1978). Modeling by shortest data description. Automatica 14, 465-471.
20. SCHWARZ, G. (1978). Estimating the dimension of a model. Ann. Statist. 6, 461-464.
21. SUGIURA, N. (1978). Further analysis of the data by Akaike's information criterion and the finite corrections. Comm. Statist. Theory Methods 7, 13-26.
22. WEI, C.Z. (1992). On predictive least squares principles. Ann. Statist. 20, 1-42.