Multimodel inference: Understanding AIC and BIC in model selection

Sociological Methods and Research

Volumn 33, Issue 2, 2004, Pages 261-304

  Burnham, Kenneth P ^a,b,c   Anderson, David R ^a,b,c  

^a U S GEOLOGICAL SURVEY   (United States)

^b Department of Environmental and Radiological Health Sciences   (United States)

^c Division of Biological Resources ^*  (United States)

Author keywords

AIC; BIC; Model averaging; Model selection; Multimodel inference

Indexed keywords

EID: 8744307994     PISSN: 00491241     EISSN: None     Source Type: Journal    
DOI: 10.1177/0049124104268644     Document Type: Review

References (52)

1. Akaike, Hirotugu. 1973. "Information Theory as an Extension of the Maximum Likelihood Principle." 267-81 in Second International Symposium on Information Theory, edited by B. N. Petrov and F. Csaki. Budapest: Akademiai Kiado.
2. -. 1974. "A New Look at the Statistical Model Identification." IEEE Transactions on Automatic Control AC-19:716-23.
3. -. 1981. "Likelihood of a Model and Information Criteria." Journal of Econometrics 16:3-14.
4. -. 1983. "Information Measures and Model Selection." International Statistical Institute 44:277-91.
5. -. 1985. "Prediction and Entropy." Pp. 1-24 in A Celebration of Statistics, edited by Anthony C. Atkinson and Stephen E. Fienberg. New York: Springer-Verlag.
6. Akaike, Hirotugu. 1992. "Information Theory and an Extension of the Maximum Likelihood Principle." Pp. 610-24 in Breakthroughs in Statistics, vol. 1, edited by Samuel Kotz and Norman L. Johnson. London: Springer-Verlag.
7. -. 1994. "Implications of the Informational Point of View on the Development of Statistical Science." Pp. 27-38 in Engineering and Scientific Applications: Vol. 3. Proceedings of the First US/Japan Conference on the Frontiers of Statistical Modeling: An Informational Approach, edited by Hamparsum Bozdogan. Dordrecht, the Netherlands: Kluwer Academic.
8. Andserson, David R. and Kenneth P. Burnham. 2002. "Avoiding Pitfalls When Using Information-Theoretic Methods." Journal of Wildlife Management 66:910-6.
9. Azzalini, Adelchi. 1996. Statistical Inference Based on the Likelihood. London: Chapman & Hall.
10. Boltzmann, Ludwig. 1877. "Uber die Beziehung Zwischen dem Hauptsatze der Mechanischen Warmetheorie und der Wahrscheinlicjkeitsrechnung Respective den Satzen uber das Warmegleichgewicht." Wiener Berichte 76:373-435.
11. Breiman, Leo. 1992. "The Little Bootstrap and Other Methods for Dimensionality Selection in Regression: X-Fixed Prediction Error." Journal of the American Statistical Association 87:738-54.
12. -. 2001. "Statistical Modeling: The Two Cultures." Statistical Science 26:199-231.
13. Buckland, Steven T., Kenneth P. Burnham, and Nicole H. Augustin. 1997. "Model Selection: An Integral Part of Inference." Biometrics 53:603-18.
14. Burnham, Kenneth P. and David R. Anderson. 1998. Model Selection and Inference: A Practical Information-Theoretical Approach. New York: Springer-Verlag.
15. -. 2002. Model Selection and Multimodel Inference: A Practical Information-Theoretical Approach. 2d ed. New York: Springer-Verlag.
16. Cavanaugh, Joseph E. and Andrew A. Neath. 1999. "Generalizing the Derivation of the Schwarz Information Criterion." Communication in Statistics Theory and Methods 28:49-66.
17. Chamberlin, Thomas. [1890] 1965. "The Method of Multiple Working Hypotheses." Science 148:754-9.
18. deLeeuw, Jan. 1992. "Introduction to Akaike (1973) Information Theory and an Extension of the Maximum Likelihood Principle." Pp. 599-609 in Breakthroughs in Statistics, vol. 1, edited by Samuel Kotz and Norman L. Johnson. London: Springer-Verlag.
19. Edwards, Anthony W. F. 1992. Likelihood. Expanded ed. Baltimore: Johns Hopkins University Press.
20. Forster, Malcolm R, 2000. "Key Concepts in Model Selection: Performance and Generalizability." Journal of Mathematical Psychology 44:205-31.
21. -. 2001. "The New Science of Simplicity." Pp. 83-119 in Simplicity, Inference and Modelling: Keeping It Sophisticatedly Simple, edited by Arnold Zellner, Hugo A. Keuzenkamp, and Michael McAleer. Cambridge, UK: Cambridge University Press.
22. Forster, Malcolm R. and Elliott Sober. 1994. "How to Tell Simpler, More Unified, or Less Ad Hoc Theories Will Provide More Accurate Predictions." British Journal of the Philosophy of Science 45:1-35.
23. Gelfand, Alan and Dipak K. Dey. 1994. "Bayesian Model Choice: Asymptotics and Exact Calculations." Journal of the Royal Statistical Society, Series B 56:501-14.
24. Gelman, Andrew, John C. Carlin, Hal S. Stern, and Donald B. Rubin. 1995. Bayesian Data Analysis. New York: Chapman & Hall.
25. Hand, David J. and Veronica Vinciotti. 2003. "Local Versus Global Models for Classification Problems: Fitting Models Where It Matters." The American Statistician 57:124-31.
26. Hansen, Mark H. and Charles Kooperberg. 2002. "Spline Adaptation in Extended Linear Models." Statistical Science 17:2-51.
27. Hoeting, Jennifer A., David Madigan, Adrian E. Raftery, and Chris T. Volinsky. 1999. "Bayesian Model Averaging: A Tutorial (With Discussion)." Statistical Science 14:382-417.
28. Hurvich, Clifford M. and Chih-Ling Tsai. 1989. "Regression and Time Series Model Selection in Small Samples." Biometrika 76:297-307.
29. -. 1995. "Model Selection for Extended Quasi-Likelihood Models in Small Samples." Biometrics 51:1077-84.
30. Johnson, Roger W. 1996. "Fitting Percentage of Body Fat to Simple Body Measurements." Journal of Statistics Education 4(1). Retrieved from www.amstat.org/publications/jse/v4n1/datasets.johnson.html
31. Kass, Robert E. and Adrian E. Raftery. 1995. "Bayes Factors." Journal of the American Statistical Association 90:773-95.
32. Key, Jane T., Luis R. Pericchi, and Adrian F. M. Smith. 1999. "Bayesian Model Choice: What and Why?" Pp. 343-70 in Bayesian Statistics 6, edited by José M. Bernardo, James O. Berger, A. Philip Dawid, and Adrian F. M. Smith. Oxford, UK: Oxford University Press.
33. Kullback, Soloman and Richard A. Leibler. 1951. "On Information and Sufficiency." Annals of Mathematical Statistics 22:79-86.
34. Lahiri, Partha, ed. 2001. Model Selection. Beachwood, OH: Lecture Notes-Monograph Series, Institute of Mathematical Statistics.
35. Lehman, Eric L. 1990. "Model Specification: The Views of Fisher and Neyman, and Later Observations." Statistical Science 5:160-8.
36. Linhart, H. and Walter Zucchini. 1986. Model Selection. New York: John Wiley.
37. McQuarrie, Alan D. R. and Chih-Ling Tsai. 1998. Regression and Time Series Model Selection. Singapore: World Scientific Publishing Company.
38. Meyer, Mary C. and Purushottam W. Laud. 2002. "Predictive Variable Selection in Generalized Linear Models." Journal of the American Statistical Association 97:859-71.
39. Parzen, Emmanuel, Kunio Tanabe, and Genshiro Kitagawa, eds. 1998. Selected Papers of Hirotugu Akaike. New York: Springer-Verlag.
40. Raftery, Adrian E. 1995. "Bayesian Model Selection in Social Research (With Discussion)." Sociological Methodology 25:111-95.
41. -. 1996. "Approximate Bayes Factors and Accounting for Model Uncertainty in Generalized Linear Regression Models." Biometrika 83:251-66.
42. Reschenhofer, Erhard. 1996. "Prediction With Vague Prior Knowledge." Communications in Statistics-Theory and Methods 25:601-8.
43. Royall, Richard M. 1997. Statistical Evidence: A Likelihood Paradigm. London: Chapman & Hall.
44. Stone, Mervyn. 1974. "Cross-Validatory Choice and Assessment of Statistical Predictions (With Discussion)" Journal of the Royal Statistical Society, Series B 39:111-47.
45. -. 1977. "An Asymptotic Equivalence of Choice of Model by Cross-Validation and Akaike's Criterion." Journal of the Royal Statistical Society, Series B 39:44-7.
46. Schwarz, Gideon. 1978. "Estimating the Dimension of a Model." Annals of Statistics 6:461-4.
47. Spiegelhalter, David J., Nicola G. Best, Bradley P. Carlin, and Angelita van der Linde. 2002. "Bayesian Measures of Model Complexity and Fit." Journal of the Royal Statistical Society, Series B 64:1-34.
48. Sugiura, Nariaki. 1978. "Further Analysis of the Data by Akaike's Information Criterion and the Finite Corrections." Communications in Statistics, Theory and Methods A7:13-26.
49. Takeuchi, Kei. 1976. "Distribution of Informational Statistics and a Criterion of Model Fitting" (in Japanese). Suri-Kagaku (Mathematic Sciences) 153:12-18.
50. Wasserman, Larry. 2000. "Bayesian Model Selection and Model Averaging." Journal of Mathematical Psychology 44:92-107.
51. Weakliem, David L. 1999. "A Critique of the Bayesian Information Criterion for Model Selection." Sociological Methods & Research 27:359-97.
52. Williams, David. 2001. Weighing the Odds: A Course in Probability and Statistics. Cambridge, UK: Cambridge University Press.