Multimodel inference in ecology and evolution: Challenges and solutions

Journal of Evolutionary Biology

Volumn 24, Issue 4, 2011, Pages 699-711

  Grueber, C E ^a   Nakagawa, S ^a   Laws, R J ^a   Jamieson, I G ^a  

^a UNIVERSITY OF OTAGO   (New Zealand)

Author keywords

Akaike Information Criterion; Generalized linear mixed models; Inbreeding; Information theory; Lethal equivalents; Model averaging; Random factors; Standardized predictors

Indexed keywords

AKAIKE INFORMATION CRITERION; EVOLUTIONARY BIOLOGY; INBREEDING DEPRESSION; MODELING; STANDARDIZATION; WILD POPULATION;

BIOLOGICAL MODEL; ECOLOGY; EVOLUTION; METHODOLOGY; REVIEW; STATISTICAL ANALYSIS;

BIOLOGICAL EVOLUTION; DATA INTERPRETATION, STATISTICAL; ECOLOGY; MODELS, BIOLOGICAL;

EID: 79952700240     PISSN: 1010061X     EISSN: 14209101     Source Type: Journal    
DOI: 10.1111/j.1420-9101.2010.02210.x     Document Type: Review

References (72)

1. Akaike, H. 1973. Information theory as an extension of the maximum likelihood principle. In: Second International Symposium on Information Theory (B.N. Petrov & F. Csaki, eds), pp. 267-281. Akademiai Kiado, Budapest.
2. Anderson, D.R. & Burnham, K.P. 2002. Avoiding pitfalls when using information-theoretic methods. J. Wildl. Manage. 66: 912-918.
3. Anderson, D.R., Burnham, K.P. & Thompson, W.L. 2000. Null hypothesis testing: problems, prevalence, and an alternative. J. Wildl. Manage. 64: 912-923.
4. Bartoń, K. 2009. MuMIn: multi-model inference. R package, version 0.12.2. Available at:
5. Bates, D. & Maechler, M. 2009. lme4: Linear mixed-effects models using S4 classes. R package, version 0.999375-31. Available at:
6. Bolker, B.M. 2009. Learning hierarchical models: advice for the rest of us. Ecol. Appl. 19: 588-592.
7. Bolker, B.M., Brooks, M.E., Clark, C.J., Geange, S.W., Poulsen, J.R., Stevens, M.H.H. et al. 2009. Generalized linear mixed models: a practical guide for ecology and evolution. Trends Ecol. Evol. 24: 127-135.
8. Bring, J. 1994. How to standardize regression coefficients. Am. Stat. 48: 209-213.
9. Browne, W.J., Subramanian, S.V., Jones, K. & Goldstein, H. 2005. Variance partitioning in multilevel logistic models that exhibit overdispersion. J. R. Stat. Soc. Ser. A-Stat. Soc. 168: 599-613.
10. Burnham, K.P. & Anderson, D.R. 1998. Model Selection and Multimodel Inference. Springer, Berlin.
11. Burnham, K.P. & Anderson, D.R. 2002. Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach, 2nd edn. Springer, Berlin.
12. Carstens, B.C., Stoute, H.N. & Reid, N.M. 2009. An information-theoretical approach to phylogeography. Mol. Ecol. 18: 4270-4282.
13. Claeskens, G. & Hjort, N.L. 2003. The focused information criterion. J. Am. Stat. Assoc. 98: 900-916.
14. Claeskens, G., Croux, C. & Van Kerckhoven, J. 2007. Prediction-focused model selection for autoregressive models. Aus. N. Z. J. Stat. 49: 359-379.
15. Congdon, P. 2006a. Bayesian model choice based on Monte Carlo estimates of posterior model probabilities. Comput. Stat. Data Anal. 50: 346-357.
16. Congdon, P. 2006b. Bayesian Statistical Modelling, 2nd edn. Wiley, West Sussex.
17. Darwin, C. 1876. The Effects of Crossing and Self-fertilization in the Vegetable Kingdom. John Murray, London.
18. Dochtermann, N. & Jenkins, S. 2010. Developing and evaluating multiple hypotheses in behavioral ecology. Behav. Ecol. Sociobiol., doi:
19. Faraway, J.J. 2005. Linear Models with R. CRC Press, Boca Raton.
20. Fisher, R.A. 1948. The Theory of Inbreeding. Oliver and Boyd Ltd, Edinburgh.
21. Forslund, P. & Pärt, T. 1995. Age and reproduction in birds - hypotheses and tests. Trends Ecol. Evol. 10: 374-378.
22. Freckleton, R.P. 2010. Dealing with collinearity in behavioral and ecological data: model averaging and the problems of measurement error. Behav. Ecol. Sociobiol. 65: 91-101.
23. Gelman, A. 2008. Scaling regression inputs by dividing by two standard deviations. Stat. Med. 27: 2865-2873.
24. Gelman, A. & Hill, J. 2007. Data Analysis Using Regression and Multileval/Hierarchical Models. Cambridge University Press, Cambridge.
25. Gelman, A. & Tuerlinckx, F.A. 2000. Type S error rates for classical and Bayesian single and multiple comparison procedures. Comput. Stat. 15: 373-390.
26. Gelman, A., Su, Y.-S., Yajima, M., Hill, J., Pittau, M.G., Kerman, J. et al. 2009. arm: data analysis using regression and multilevel/hierarchical models. R package, version 9.01. Available at:
27. Grueber, C.E. & Jamieson, I.G. 2008. Quantifying and managing the loss of genetic variation through the use of pedigrees in a non-captive endangered species. Conserv. Genet. 9: 645-651.
28. Grueber, C.E., Nakagawa, S., Laws, R.J. & Jamieson, I.G. 2010. Inbreeding depression accumulates across life-history stages of the endangered takahe. Conserv. Biol. 24: 1617-1625.
29. Haldane, J.B.S. 1924. The mathematical theory of natural and artificial selection. Part II: the influence of partial self-fertilization, inbreeding, assortative mating, and selective fertilization on the composition of Mendelian populations, and on natural selection. Proceedings of the Cambridge Philosophical Society 1, 158-163.
30. Harrell, F.E. 2001. Regression Modeling Strategies: With Applications to Linear Models, Logisitic Regression, and Survival Analysis. Springer, New York.
31. Hereford, J., Hansen, T.F. & Houle, D. 2004. Comparing strengths of directional selection: how strong is strong? Evolution 58: 2133-2143.
32. Hurvich, C.M. & Tsai, C.-L. 1989. Regression and time series model selection in small samples. Biometrika 76: 297-307.
33. Jamieson, I.G., Roy, M.S. & Lettink, M. 2003. Sex specific consequences of recent inbreeding in an ancestrally inbred population of New Zealand takahe. Conserv. Biol. 17: 708-716.
34. Jefferys, H. 1961. Theory of Probability, 3rd edn. University of Oxford Press, Oxford.
35. Johnson, J.B. & Omland, K.S. 2004. Model selection in ecology and evolution. Trends Ecol. Evol. 19: 101-108.
36. Keller, L.F. & Waller, D.M. 2002. Inbreeding effects in wild populations. Trends Ecol. Evol. 17: 230-241.
37. Keller, L.F., Reid, J.M. & Arcese, P. 2008. Testing evolutionary models of senescence in a natural population: age and inbreeding effects on fitness components in song sparrows. Proc. R. Soc. B 275: 597-604.
38. King, G. 1986. How not to lie with statistics: avoiding common mistakes in quantitative political science. Am. J. Pol. Sci. 30: 666-687.
39. Konishi, S. & Kitagawa, G. 2008. Information Criteria and Statistical Modeling. Springer, New York.
40. Laws, R.J. & Jamieson, I.G. 2010. Is lack of evidence of inbreeding depression in a threatened New Zealand robin indicative of reduced genetic load? doi:
41. Laws, R.J., Townsend, S.M., Nakagawa, S. & Jamieson, I.G. 2010. Limited inbreeding depression in a bottlenecked population is age but not environment dependent. doi:
42. Lebreton, J.D., Burnham, K.P., Clobert, J. & Anderson, D.R. 1992. Modeling survival and testing biological hypotheses using marked animals - a unified approach with case studies. Ecol. Monogr. 62: 67-118.
43. Liang, H., Wu, H.L. & Zou, G.H. 2008. A note on conditional AIC for linear mixed-effects models. Biometrika 95: 773-778.
44. Link, W.A. & Barker, R.J. 2006. Model weights and the foundations of multimodel inference. Ecology 87: 2626-2635.
45. Lukacs, P.M., Thompson, W.L., Kendall, W.L., Gould, W.R., Doherty, P.F., Burnham, K.P. et al. 2007. Concerns regarding a call for pluralism of information theory and hypothesis testing. J. Appl. Ecol. 44: 456-460.
46. Lukacs, P.M., Burnham, K.P. & Anderson, D.R. 2010. Model selection bias and Freedman's paradox. Ann. Inst. Stat. Math. 62: 117-125.
47. McCarthy, M.A. 2007. Bayesian Methods for Ecology. Cambridge University Press, Cambridge.
48. Morton, N.E., Crow, J.F. & Muller, H.J. 1956. An estimate of the mutational damage in man from data on consanguineous marriages. Proc. Natl. Acad. Sci. USA 42: 855-863.
49. Murtaugh, P.A. 2009. Performance of several variable-selection methods applied to real ecological data. Ecol. Lett. 12: 1061-1068.
50. Nakagawa, S. & Freckleton, R.P. 2010. Model averaging, missing data and multiple imputation: a case study for behavioural ecology. Behav. Ecol. Sociobiol. 65: 103-116.
51. Nakagawa, S. & Schielzeth, H. 2010. Repeatability for Gaussian and non-Gaussian data: a practical guide for biologists. Biol. Rev. 85: 935-936.
52. Paterson, S. & Lello, J. 2003. Mixed models: getting the best use of parasitological data. Trends. Parasitol. 19: 370-375.
53. van de Pol, M.V. & Wright, J. 2009. A simple method for distinguishing within- versus between-subject effects using mixed models. Anim. Behav. 77: 753-758.
54. R Core Development Team 2009. R: a language and environment for statistical computing. version 2.9.0. Available at:
55. Richards, S.A. 2005. Testing ecological theory using the information-theoretic approach: examples and cautionary results. Ecology 86: 2805-2814.
56. Richards, S.A. 2008. Dealing with overdispersed count data in applied ecology. J. Appl. Ecol. 45: 218-227.
57. Richards, S.A., Whittingham, M.J. & Stephens, P.A. 2010. Model selection and model averaging in behavioural ecology: the utility of the IT-AIC framework. Behav. Ecol. Sociobiol. 65: 77-89.
58. Schielzeth, H. 2010. Simple means to improve the interpretability of regression coefficients. Meth. Ecol. Evol. 1: 103-113.
59. Schielzeth, H. & Forstmeier, W. 2009. Conclusions beyond support: overconfident estimates in mixed models. Behav. Ecol. 20: 416-420.
60. Schwarz, G.E. 1978. Estimating the dimension of a model. Ann. Stat. 6: 461-464.
61. Schwarz, C.J. & Seber, G.A.F. 1999. Estimating animal abundance: review III. Stat. Sci. 14: 427-456.
62. Spiegelhalter, D.J., Best, N.G., Carlin, B.R. & van der Linde, A. 2002. Bayesian measures of model complexity and fit. J. R. Stat. Soc. B 64: 583-616.
63. Stephens, P.A., Buskirk, S.W., Hayward, G.D. & Del Rio, C.M. 2005. Information theory and hypothesis testing: a call for pluralism. J. Appl. Ecol. 42: 4-12.
64. Stephens, P.A., Buskirk, S.W., Hayward, G.D. & Del Rio, C.M. 2007. A call for statistical pluralism answered. J. Appl. Ecol. 44: 461-463.
65. Symonds, M.R.E. & Johnson, C.N. 2008. Species richness and evenness in Australian birds. Am. Nat. 171: 480-490.
66. Symonds, M.R.E. & Moussalli, A. 2010. A brief guide to model selection, multimodel inference and model averaging in behavioural ecology using Akaike's information criterion. Behav. Ecol. Sociobiol. 65: 13-21.
67. Tukey, J.W. 1977. Exploratory Data Analysis. Addison Wesley, Reading, PA.
68. Vaida, F. & Blanchard, S. 2005. Conditional Akaike information for mixed-effects models. Biometrika 92: 351-370.
69. Whittingham, M.J., Stephens, P.A., Bradbury, R.B. & Freckleton, R.P. 2006. Why do we still use stepwise modelling in ecology and behaviour? J. Anim. Ecol. 75: 1182-1189.
70. Wright, S. 1922. The effects of inbreeding and crossbreeding on guinea pigs III: crosses between highly inbred families. US Dept. Agric. Bull. 1121: 1-60.
71. Yang, Y. 2005. Can the strengths of AIC and BIC be shared? A conflict between model indentification and regression estimation Biometrika 92: 937-950.
72. Zuur, A.F., Leno, E.N. & Elphick, C.S. 2010. A protocol for data exploration to avoid common statistical problems. Meth. Ecol. Evol. 1: 3-14.