Model Selection using the Minimum Description Length Principle

American Statistician

Volumn 54, Issue 4, 2000, Pages 257-268

  Bryant, Peter G ^a  

^a UNIVERSITY OF COLORADO   (United States)

Author keywords

Data analysis; Information theory; Minimum description length; Model selection; Stochastic complexity

Indexed keywords

EID: 0034556047     PISSN: 00031305     EISSN: 15372731     Source Type: Journal    
DOI: 10.1080/00031305.2000.10474558     Document Type: Article

References (22)

1. Akaike, H. (1973), “Information Theory and an Extension of the Maximum Likelihood Principle,” in Proceedings of the Second International Symposium on Information Theory, eds. B. N. Petrov and F. Csaki, Budapest: Akademia Kiedo, pp. 267-281.
2. Bozdogan, H. (1988), “ICOMP; A New Model-Selection Criterion,” in Classification and Related Methods of Data Analysis, ed. H. H. Bock, Amsterdam: International Federation of Classification Societies, Elsevier Science Publishers (North-Holland), pp. 599-608.
3. Bozdogan, H. (1990), “On the Information-Based Measure of Covariance Complexity and its Application to the Evaluation of Multivariate Linear Models,” Communications in Statistics, Theory, and Methods, 19, 221-278.
4. Bozdogan, H. (1993), “Choosing the Number of Component Clusters in the Mixture-Model Using a New Informational Complexity Criterion of the Inverse Fisher Information Matrix,” in Information and Classification: Concepts, Methods and Applications, eds. O. Opitz, B. Lausen, and R. Klar, number 16 in Studies in Classification, Data Analysis, and Knowledge Organization, Proceedings of the Annual Conference of the Gesellschaft fur Klassifikation, Berlin: Gesellschaft für Klassifikation, Springer-Verlag, pp. 40-54.
5. Bryant, P. G. (1996), “The Minimum Description Length Principle for Gaussian Regression,” Technical Report UCD-CBA Working Paper 1996-08, University of Colorado at Denver, College of Business, Campus Box 165, Denver, Colorado 80217-3364.
6. Bryant, P. G., and Smith, M. A. (1999), Practical Data Analysis: Case Studies in Business Statistics (vols. I, II, and III), Burr Ridge, IL: Richard D. Irwin, Inc.
7. Fano, R. M. (1961), Transmission of Information: A Statistical Theory of Communications, Cambridge, MA: The MIT Press.
8. Fisher, R. A. (1922), “On the Mathematical Foundations of Theoretical Statistics,” Philosophical Transactions of the Royal Society of London, Series A, 222, 309-368.
9. Hansen, M. H., and Yu, B. (1997), “Model Selection and the Principle of Minimum Description Length,” Technical Report, Bell Laboratories, Murray Hill, NJ.
10. Li, M., and Vitanyi, P. (1997), An Introduction to Kolmogorov Complexity and Its Applications (2nd ed.), New York: Springer-Verlag.
11. Montgomery, D. C., and Peck, E. A. (1992), Introduction to Linear Regression Analysis (2nd ed.), New York: Wiley.
12. Neter, J., Kutner, M. H., Nachtsheim, C., and Wasserman, W. (1996), Applied Linear Regression Models (4th ed.), Burr Ridge, IL: Richard D. Irwin, Inc.
13. Qian, G., Gabor, G., and Gupta, R. P. (1994), “Principal Components Selection by the Criterion of the Minimum Mean Difference of Complexity,” Journal of Multivariate Analysis, 49, 55-75.
14. Qian, G., Gabor, G., and Gupta, R. P. (1996a), “Generalised Linear Model Selection by the Predictive Least Quasi-Deviance Criterion,” Biometrika, 83, 41-54.
15. Qian, G., Gupta, R. P., and Gabor, G. (1996b), “Test for Homogeneity of Several Populations by Stochastic Complexity,” Journal of Statistical Planning and Inference, 53, 133-151.
16. Rissanen, J. (1986), “Stochastic Complexity and Modeling,” The Annals of Statistics, 14, 1080-1100.
17. Rissanen, J. (1987), “Stochastic Complexity,” Journal of the Royal Statistical Society, Series B, 49, 223-265.
18. Rissanen, J. (1988), “Minimum Description Length Principle,” in Encyclopedia of Statistical Sciences (vol. 5), eds. S. Kotz and N. Johnsos, New York: Wiley, pp. 523-527.
19. Rissanen, J. (1989), Stochastic Complexity in Statistical Inquiry, Singapore: World Scientific Publishing Company.
20. Schwarz, G. (1978), “Estimating the Dimension of a Model,” The Annals of Statistics, 6, 461-464.
21. Wallace, C. S., and Boulton, D. M. (1968), “An Information Measure for Classification,” The Computer Journal, 11, 185-194.
22. Wallace, C. S., and Freeman, P. R. (1987), “Estimation and Inference by Compact Coding,” Journal of the Royal Statistical Society, Series B, 49, 240-252.