AIC and BIC: Comparisons of assumptions and performance

Sociological Methods and Research

Volumn 33, Issue 2, 2004, Pages 188-229

  Kuha, Jouni ^a  

^a LONDON SCHOOL OF ECONOMICS   (United Kingdom)

Author keywords

Bayesian inference; Kullback Leibler divergence; Mobility tables; Model selection; Parsimony; Prediction

Indexed keywords

EID: 8744255562     PISSN: 00491241     EISSN: None     Source Type: Journal    
DOI: 10.1177/0049124103262065     Document Type: Review

References (47)

1. Akaike, H. 1973. "Information Theory and an Extension of the Maximum Likelihood Principle." Pp. 267-81 in Second International Symposium on Information Theory, edited by B. N. Petrov and F. Csaki. Budapest: Akademiai Kaido. (Reprinted, with an introduction by J. deLeeuw, in Breakthroughs in Statistics, Volume I, edited by Samuel Kotz and Norman L. Johnson. New York: Springer, 1992, pp. 599-624.)
2. Akaike, H. 1973. "Information Theory and an Extension of the Maximum Likelihood Principle." Pp. 267-81 in Second International Symposium on Information Theory, edited by B. N. Petrov and F. Csaki. Budapest: Akademiai Kaido. (Reprinted, with an introduction by J. deLeeuw, in Breakthroughs in Statistics, Volume I, edited by Samuel Kotz and Norman L. Johnson. New York: Springer, 1992, pp. 599-624.)
3. Atkinson, A. C. 1981. "Likelihood Ratios, Posterior Odds and Information Criteria." Journal of Econometrics 16:15-20.
4. Burnham, K. P. and D. R. Anderson. 1998. Model Selection and Inference: A Practical Information-Theoretic Approach. New York: Springer.
5. Carlin, B. P. and T. A. Louis. 1996. Bayes and Empirical Bayes Methods for Data Analysis. London: Chapman & Hall.
6. Chow, G. C. 1981. "A Comparison of the Information and Posterior Probability Criteria for Model Selection." Journal of Econometrics 16:21-33.
7. Cox, D. R. 1995. "The Relation Between Theory and Application in Statistics (With Discussion)." Test 4:207-61.
8. Cox, D. R. and D. V. Hinkley. 1978. Problems and Solutions in Theoretical Statistics. London: Chapman & Hall.
9. Erikson, R. and J. H. Goldthorpe. 1992a. "The CASMIN Project and the American Dream." European Sociological Review 8:283-305.
10. -. 1992b. The Constant Flux: A Study of Class Mobility in Industrial Societies. Oxford, UK: Oxford University Press.
11. Featherman, D. L., F. L. Jones, and R. M. Hauser. 1975. "Assumptions of Social Mobility Research in the U.S.: The Case of Occupational Status." Social Science Research 4:329-60.
12. Gelfand, A. E. and S. K. Ghosh. 1998. "Model Choice: A Minimum Posterior Predictive Loss Approach." Biometrika 85:1-11.
13. German, A., J. B. Carlin, H. S. Stern, and D. B. Rubin. 1995. Bayesian Data Analysis. London: Chapman & Hall.
14. Grusky, D. B. and R. M. Hauser. 1984. "Comparative Social Mobility Revisited: Models of Convergence and Divergence in 16 Countries." American Sociological Review 49:19-38.
15. Hannan, E. J. and B. G. Quinn. 1979. "The Determination of the Order of an Autoregression." Journal of the Royal Statistical Society B 41:190-95.
16. Hazelrigg, L. E. and M. A. Garnier. 1976. "Occupational Mobility in Industrial Societies: A Comparative Analysis of Differential Access to Occupational Ranks in Seventeen Countries." American Sociological Review 41:498-511.
17. Hurvich, C. M. and C.-L. Tsai. 1989. "Regression and Time Series Model Selection in Small Samples." Biometrika 76:297-307.
18. Ishiguro, M., Y. Sakamoto, and G. Kitagawa. 1997. "Bootstrapping Log Likelihood and EIC, an Extension of AIC." Annals of the Institute of Statistical Mathematics 49:411-34.
19. Jeffreys, H. 1961. Theory of Probability. 3d ed. Oxford, UK: Oxford University Press.
20. Kass, R. E. and A. E. Raftery. 1995. "Bayes Factors." Journal of the American Statistical Association 90:773-95.
21. Kass, R. E. and S. K. Vaidyanathan. 1992. "Approximate Bayes Factors and Orthogonal Parameters. With Application to Testing Equality of Two Binomial Proportions." Journal of the Royal Statistical Society B 54:129-44.
22. Kass, R. E. and L. Wasserman. 1995. "A Reference Bayesian Test for Nested Hypotheses and Its Relationship to the Schwarz Criterion." Journal of the American Statistical Association 90:928-34.
23. Laud, P. W. and J. G. Ibrahim. 1995. "Predictive Model Selection." Journal of the Royal Statistical Society B 57:247-62.
24. Lindley, D. V. 1957. "A Statistical Paradox." Biometrika 44:187-92.
25. Lipset, S. M. and H. L. Zetterberg. 1959. "Social Mobility in Industrial Societies." Pp. 11-75 in Social Mobility in Industrial Society, edited by S. M. Lipset and R. Bendix. Berkeley: University of California Press.
26. McQuarrie, A. D. R. and C.-L. Tsai. 1998. Regression and Time Series Model Selection. Singapore: World Scientific.
27. Miller, A. J. 2002. Subset Selection in Regression. 2d ed. London: Chapman & Hall.
28. Murata, N., S. Yoshizawa, and S. Amari. 1991. "A Criterion for Determining the Number of Parameters in an Artificial Neural Network Model." Pp. 9-14 in Artificial Neural Networks: Proceedings of ICANN-91, vol. 1, edited by T. Kohonen, K. Makisara, O. Simula, and J. Kangas. Amsterdam: North Holland.
29. Newton, M. A. and A. E. Raftery. 1994. "Approximate Bayesian Inference With the Weighted Likelihood Bootstrap (With Discussion)." Journal of the Royal Statistical Society B 56:3-48.
30. Nishii, R. 1984. "Asymptotic Properties of Criteria for Selection of Variables in Multiple Regression." Annals of Statistics 12:758-65.
31. O'Hagan, A. 1995. "Fractional Bayes Factors for Model Comparison (With Discussion)." Journal of the Royal Statistical Society B 57:99-138.
32. Raftery, A. E. 1986. "Choosing Models for Cross-Classifications. " American Sociological Review 51:145-46.
33. -. 1995. "Bayesian Model Selection in Social Research (With Discussion)" Pp. 111-63 in Sociological Methodology 1995, edited by P. V. Marsden. Cambridge, MA: Blackwell.
34. Schwarz, G. 1978. "Estimating the Dimension of a Model." Annals of Statistics 6:461-64.
35. Shafer, G. 1982. "Lindley's Paradox (With Discussion)." Journal of the American Statistical Association 77:325-51.
36. Shibata, R. 1976. "Selection of the Order of an Autoregressive Model by Akaike's Information Criterion." Biometrika 63:117-26.
37. -. 1981. "An Optimal Selection of Regression Variables." Biometrika 68:45-54.
38. Smith, A. F. M. and D. J. Spiegelhalter. 1980. "Bayes Factors and Choice Criteria for Linear Models." Journal of the Royal Statistical Society B 42:213-20.
39. Spiegelhalter, D. J., N. G. Best, B. P. Carlin, and A. van der Linde. 2002. "Bayesian Measures of Model Complexity and Fit (With Discussion)." Journal of the Royal Statistical Society B 64:583-639.
40. Stone, M. 1977. "An Asymptotic Equivalence of Choice of Model by Cross-validation and Akaike's Criterion." Journal of the Royal Statistical Society B 39:44-47.
41. -. 1979. "Comments on Model Selection Criteria of Akaike and Schwartz." Journal of the Royal Statistical Society B 41:276-78.
42. Sugiura, N. 1978. "Further Analysis of the Data by Akaike's Information Criterion and the Finite Corrections." Communications in Statistics A (Theory and Methods) A7:13-26.
43. Takeuchi, K. 1976. "Distribution of Informational Statistics and a Criterion of Model Fitting." Suri-Kagaku (Mathematical Sciences) 153:12-18 (in Japanese).
44. Tierney, L. and J. B. Kadane. 1986. "Accurate Approximations for Posterior Moments and Marginal Densities." Journal of the American Statistical Association 81:82-86.
45. Weakliem, D. L. 1999. "A Critique of the Bayesian Information Criterion for Model Selection." Sociological Methods & Research 27:359-97.
46. Wei, C. Z. 1992. "On Predictive Least Squares Principles." Annals of Statistics 20:1-42.
47. Xie, Y. 1992. "The Log-Multiplicative Layer Effect Model for Comparing Mobility Tables." American Sociological Review 57:380-95.