Akaike's information criterion and recent developments in information complexity

Journal of Mathematical Psychology

Volumn 44, Issue 1, 2000, Pages 62-91

  Bozdogan, Hamparsum ^a  

^a UNIVERSITY OF TENNESSEE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0002996131     PISSN: 00222496     EISSN: None     Source Type: Journal    
DOI: 10.1006/jmps.1999.1277     Document Type: Article

References (69)

1. Akaike H. Information theory and an extension of the maximum likelihood principle. Petrov B. N., Csaki F. Second international symposium on information theory. 1973;267-281 Academiai Kiado, Budapest.
2. Akaike H. A new look at the statistical model identification. IEEE Transactions on Automatic Control. 19:1974;716-723.
3. Akaike H. Likelihood of a model and information criteria. Journal of Econometrics. 16:1981;3-14.
4. Akaike H. Factor analysis and AIC. Psychometrika. 52:1987;317-332.
5. Balasubramanian, V. 1996, A geometric formulation of Occam's razor for inference of parametric distributions. Unpublished paper available as preprint number adap-org/9601001 from, http://xyz.lanl.gov/, and as Princeton University Physics Preprint PUPT-1588, January 1996.
6. Baxter R. A. Minimum message length inference: Theory and applications. 1996;Monash UniversityDepartment of Computer Science, Clayton.
7. Bearse P. M., Bozdogan H. Subset selection in vector autoregressive (VAR) models using the genetic algorithm with informational complexity as the fitness function. Systems Analysis, Modeling, Simulation (SAMS). 31:1998;61-91.
8. Behboodian J. Information for estimating the parameters in mixures of exponential and normal distributions. 1964;Univerisity of MichiganDepartment of Mathematics, Ann Arbor.
9. Bhansali R. J., Downham D. Y. Some properties of the order of an autoregressive model selected by a generalization of Akaike's FPE criterion. Biometrika. 64:1977;547-551.
10. Boltzmann L. Über die Beziehung zwischen dem zweiten Hauptsatze der mechanischen Wärmetheorie und der Wahrscheinlichkeitsrechnung respective den Satzen über das Wärmegleichgewicht. Wiener Berichte. 76:1877;373-435.
11. Bozdogan H. Model selection and Akaike's information criterion (AIC): The general theory and its analytical extensions. Psychometrika. 52:1987a;345-370.
12. Bozdogan H. ICOMP: A new model-selection criterion. Classification and related methods of data analysis. 1987b.
13. Bozdogan H. ICOMP: A new model-selection criterion. Bock Hans H. Classification and related methods of data analysis. 1988a;599-608 Elsevier Science (North-Holland), Amsterdam.
14. Bozdogan H. The theory and applications of information-theoretic measure of complexity (ICOMP) as a new model selection criterion. Unpublished research report. 1988b.
15. Bozdogan H. On the information-based measure of covariance complexity and its application to the evaluation of multivariate linear models. Communications in statistics theory and methods. 19:1990;221-278.
16. Bozdogan H. Theory & methodology of time series analysis. Proceedings of the first US/Japan conference on the frontiers of statistical modeling: An informational approach. 1:1994a.
17. Bozdogan H. Multivariate statistical modeling. Proceedings of the first US/Japan conference on the frontiers of statistical modeling: An informational approach. 2:1994b.
18. Bozdogan H. Engineering & scientific applications of informational modeling. Proceedings of the first US/Japan conference on the frontiers of statistical modeling: An informational approach. 3:1994c.
19. Bozdogan H. Mixture-model cluster analysis using model selection criteria and a new informational measure of complexity. Bozdogan H. Multivariate statistical modeling. Proceedings of the first US/Japan conference on the frontiers of statistical modeling: An informational approach. 2:1994d;69-113 Kluwer Academic, Dordrecht.
20. Bozdogan H. A new informational complexity criterion for model selection: The general theory and its application. 1996.
21. Bozdogan H. Statistical modeling and model evaluation: A new informational approach. 1998a.
22. Bozdogan H. Informational complexity and multivariate statistical modeling. 1998b.
23. Bozdogan H., Bearse P. M. Model selection using informational complexity with appplications to vector autoregressive (VAR) models. Journal of Statistical Planning and Inference. 2000.
24. Bozdogan H., Haughton D. M. A. Informational complexity criteria for regression models. Computational Statistics and Data Analysis. 1998.
25. Chen X. Model selection in nonlinear regression analysis. 1996;The University of TennesseeManagement Science Program, Knoxville.
26. Chen X., Bozdogan H. Model selection in nonlinear regression analysis: A new informational complexity approach. 1998.
27. Chernoff H. Large sample theory: Parametric case. Annals of Mathematical Statistics. 27:1956;1-22.
28. Cover T. M., Gacs P., Gray R. M. Kolmogorov's contributions to information theory and algorithmic complexity. Annals of Probability. 17:1989;840-865.
29. Cox D. R. Effective degrees of freedom and the likelihood ratio test. Biometrika. 71:1984;487-493.
30. Forster M. R. The new science of simplicity. Keuzenkamp H. A., McAleer M., Zellner A. Simplicity, inference, and econometric modeling. 1999;Cambridge University Press, Cambridge.
31. Finn J. D. A general model for multivariate analysis. 1974;Holt Rinehart and Winston, New York.
32. Graham A. Nonnegative matrices and applicable topics in linear algebra. 1987;Halsted Press, New York.
33. Hannan E. J. Remembrance of things past. Gani J. The craft of probabilistic modeling. 1986;Springer-Verlag, New York.
34. Harris C. J. An information theoretic approach to estimation. Gregson M. J. Recent theoretical developments in control. 1978;563-590 Academic Press, London.
35. Hosking J. R. M. Lagrange-multiplier tests of time-series models. Journal of the Royal Statistics Society, (Series B). 42:1980;170-181.
36. Hurvich C. M., Tsai C. L. Regression and time series model selection in small samples. Biometrika. 76:1989;297-307.
37. Kitagawa G., Gersch W. Smoothness priors analysis of time series. 1996;Springer-Verlag, New York.
38. Kolmogorov A. N. Combinatorial foundations of information theory and the calculus of probabilities. Russian Math Surveys. 38:1983;29-40.
39. Konishi S., Kitagawa G. Generalized information criteria in model-selection. Biometrika. 83:1996;875-890.
40. Konishi S. Statistical model evaluation and information criteria. Ghosh S. Multivariate, design and sampling. 1998;Marcel Dekker, New York.
41. Kullback S. Information theory and statistics. 1968;Dover, New York.
42. Kullback S., Leibler R. On information and sufficiency. Annals of Mathematical Statistics. 22:1951;79-86.
43. Li S-C., Lewandowsky S., DeBrunner V. E. Using parameter sensitivity and interdependence to predict model scope and falsifiability. Journal of Experimental Psychology. 125:1996;360-369.
44. Ljung L., Rissanen J. On canonical forms, parameter identifiability and the concept of complexity. Rajbman N. S. Identification and system parameter estimation. 1978;1415-1426 North-Holland, Amsterdam.
45. Lutkepohl H. Introduction to multiple time series analysis. 1993;Springer-Verlag, New York.
46. Magnus J. R., Neudecker H. Matrix differential calculus. 1988;Wiley, New York.
47. Maklad M. S., Nichols T. A new approach to model structure discrimination. IEEE Transactions on Systems, Man, and Cybernetics. 10:1980;78-84.
48. Morgera S. D. Information theoretic covariance complexity and its relation to pattern recognition. IEEE Transactions on Systems, Man, and Cybernetics. 15:1985;608-619.
49. Mustonen S. A measure of total variability in multivariate normal distribution. Computational Statistics and Data Analysis. 23:1997;321-334.
50. Rissanen J. Minmax entropy estimation of models for vector processes. Mehra R. K., Lainiotis D. G. System identification. 1976;97-119 Academic Press, New York.
51. Rissanen J. Modeling by shortest data description. Automatica. 14:1978;465-471.
52. Rissanen J. Stochastic complexity and modeling. Annals of Statistics. 14:1986;1080-1100.
53. Rissanen J. Stochastic complexity (with discussion). Journal of Royal Statistical Society, (Series B). 49:1987;223-239.
54. Rissanen J. Stochastic complexity in statistical inquiry. 1989;World Scientific, Teaneck.
55. Ross G. J. S. The efficient use of function minimization in nonlinear maximum likelihood estimation. Applied Statistics. 19:1970;205-221.
56. Schwarz G. Estimating the dimension of a model. Annals of Statistics. 6:1978;461-464.
57. Sclove S. L. Application of model-selection criteria to some problems in multivariate analysis. Psychometrika. 52:1987;333-343.
58. Seber, G. A. F, &, Wild, C. J. 1989, Nonlinear regression, New York, Wiley.
59. Shannon C. E. A mathematical theory of communication. Bell Systems Technology Journal. 27:1948;379-423.
60. Shibata R. Statistical aspects of model selection. Willems J. C. From data to modeling. 1989;216-240 Springer-Verlag, Berlin.
61. Sugiura N. Further analysis of the data by Akaike's information criterion and the finite corrections. Communications in Statistics, Theory and Methods. A7:1978;13-26.
62. Takeuchi K. Distribution of information statistics and a criterion of model fitting. Suri-Kagaku (Mathematical Sciences). 153:1976;12-18.
63. Theil H., Fiebig D. G. Exploiting continuity: maximum entropy estimation of continuous distributions. 1984;Ballinger, Cambridge.
64. van Emden M. H. An analysis of complexity. 1971;Mathematical Centre Tracts, Amsterdam.
65. Wallace C. S., Freeman P. R. Estimation and inference by compact coding (with discussion). Journal of Royal Statistical Society, (Series B). 49:1987;240-265.
66. Wallace C. S., Dowe D. L. MML estimation of the von Mises concentration parameter. Technical Report. 1993.
67. Watanabe S. Pattern recognition: human and mechanical. 1985;Wiley, New York.
68. White H. Maximum likelihood estimation of misspecified models. Econometrica. 50:1982;1-26.
69. Woodroofe M. On model selection and the arc sine law. Annals of Statistics. 10:1982;1182-1194.