A brief introduction to mixed effects modelling and multi-model inference in ecology

PeerJ

Volumn 2018, Issue 5, 2018, Pages

  Harrison, Xavier A ^a   Donaldson, Lynda ^b,c   Correa Cano, Maria Eugenia ^b   Evans, Julian ^b,d   Fisher, David N ^b,e   Goodwin, Cecily E D ^b   Robinson, Beth S ^b,f   Hodgson, David J ^b   Inger, Richard ^b  

^a INSTITUTE OF ZOOLOGY   (United Kingdom)

^b UNIVERSITY OF EXETER   (United Kingdom)

^c WILDFOWL AND WETLANDS TRUST   (United Kingdom)

^d UNIVERSITY OF OTTAWA   (Canada)

^e UNIVERSITY OF GUELPH   (Canada)

^f Surfside   (United Kingdom)

Author keywords

AIC; Collinearity; GLMM; Mixed effects models; Model averaging; Model selection; Multi model inference; Overdispersion; Random effects; Type I error

Indexed keywords

ACCURACY; ANALYTICAL ERROR; ARTICLE; ECOLOGY; HYPOTHESIS; INFORMATION SCIENCE; LINEAR MIXED EFFECT MODEL; MULTI MODEL INFERENCE; NONHUMAN; PREDICTOR VARIABLE; RANDOM ERROR; SIMULATION; STATISTICAL ANALYSIS; STATISTICAL MODEL; VARIANCE;

EID: 85047520267     PISSN: None     EISSN: 21678359     Source Type: Journal    
DOI: 10.7717/peerj.4794     Document Type: Article

References (95)

1. Aarts E, Dolan CV, Verhage M, Sluis S. 2015. Multilevel analysis quantifies variation in the experimental effect while optimizing power and preventing false positives. BMC Neuroscience 16(1):94 DOI 10.1186/s12868-015-0228-5
2. Allegue H, Araya-Ajoy YG, Dingemanse NJ, Dochtermann NA, Garamszegi LZ, Nakagawa S, Reale D, Schielzeth H, Westneat DF. 2017. Statistical Quantification of Individual Differences (SQuID): an educational and statistical tool for understanding multilevel phenotypic data in linear mixed models. Methods in Ecology and Evolution 8(2):257-267 DOI 10.1111/2041-210x.12659
3. Arnold TW. 2010. Uninformative parameters and model selection using Akaike's information criterion. Journal of Wildlife Management 74(6):1175-1178 DOI 10.1111/j.1937-2817.2010.tb01236.x
4. Austin MP. 2002. Spatial prediction of species distribution: an interface between ecological theory and statistical modelling. Ecological Modelling 157(2-3):101-118 DOI 10.1016/s0304-3800(02)00205-3
5. Barker RJ, Link WA. 2015. Truth, models, model sets, AIC, and multimodel inference: a Bayesian perspective. Journal of Wildlife Management 79(5):730-738 DOI 10.1002/jwmg.890
6. Barr DJ, Levy R, Scheepers C, Tily HJ. 2013. Random effects structure for confirmatory hypothesis testing: keep it maximal. Journal of Memory and Language 68(3):255-278 DOI 10.1016/j.jml.2012.11.001
7. Bartoń K. 2016. MuMIn: multi-model inference. R package Version 1.15.6. Available at https://CRAN.R-project.org/package=MuMIn
8. Bates D, Kliegl R, Vasishth S, Baayen H. 2015a. Parsimonious mixed models. Available at http://arxiv.org/abs/1506.04967
9. Bates D, Maechler M, Bolker B, Walker S. 2015b. Fitting linear mixed-effects models using lme4. Journal of Statistical Software 67(1):1-48 DOI 10.18637/jss.v067.i01
10. Bolker BM, Brooks ME, Clark CJ, Geange SW, Poulsen JR, Stevens MHH, White JSS. 2009. Generalized linear mixed models: a practical guide for ecology and evolution. Trends in Ecology & Evolution 24(3):127-135 DOI 10.1016/j.tree.2008.10.008
11. Breslow NE, Clayton DG. 1993. Approximate inference in generalized linear mixed models. Journal of the American Statistical Association 88(421):9-25 DOI 10.1080/01621459.1993.10594284
12. Brewer MJ, Butler A, Cooksley SL. 2016. The relative performance of AIC, AICC and BIC in the presence of unobserved heterogeneity. Methods in Ecology and Evolution 7(6):679-692 DOI 10.1111/2041-210x.12541
13. Burnham KP, Anderson DR. 2002. Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach. Second Edition. New York: Springer-Verlag
14. Burnham KP, Anderson DR. 2004. Multimodel inference: understanding AIC and BIC in model selection. Sociological Methods & Research 33(2):261-304 DOI 10.1177/0049124104268644
15. Burnham KP, Anderson DR, Huyvaert KP. 2011. AIC model selection and multimodel inference in behavioral ecology: some background, observations, and comparisons. Behavioral Ecology and Sociobiology 65(1):23-35 DOI 10.1007/s00265-010-1029-6
16. Cade BS. 2015. Model averaging and muddled multimodel inferences. Ecology 96(9):2370-2382 DOI 10.1890/14-1639.1
17. Chatfield C. 1995. Model uncertainty, data mining and statistical inference (with discussion). Journal of the Royal Statistical Society. Series A (Statistics in Society) 158(3):419-466 DOI 10.2307/2983440
18. Cox DR, Snell EJ. 1989. The Analysis of Binary Data. Second Edition. London: Chapman and Hall
19. Crawley M. 2013. The R Book. Second Edition. Chichester: Wiley
20. Dochtermann NA, Jenkins SH. 2011. Developing multiple hypotheses in behavioural ecology. Behavioral Ecology and Sociobiology 65(1):37-45 DOI 10.1007/s00265-010-1039-4
21. Dominicus A, Skrondal A, Gjessing HK, Pedersen NL, Palmgren J. 2006. Likelihood ratio tests in behavioral genetics: problems and solutions. Behavior Genetics 36(2):331-340 DOI 10.1007/s10519-005-9034-7
22. Dormann CF, Elith J, Bacher S, Buchmann C, Carl G, Carré G, Marquéz JR, Gruber B, Lafourcade B, Leitão PJ, Münkemüller T, McClean C, Osborne PE, Reineking B, Schröder B, Skidmore AK, Zurell D, Lautenbach S. 2013. Collinearity: a review of methods to deal with it and a simulation study evaluating their performance. Ecography 36(1):27-46 DOI 10.1111/j.1600-0587.2012.07348.x
23. Ellison AM. 2004. Bayesian inference in ecology. Ecology Letters 7(6):509-520 DOI 10.1111/j.1461-0248.2004.00603.x
24. Elston DA, Moss R, Boulinier T, Arrowsmith C, Lambin X. 2001. Analysis of aggregation, a worked example: numbers of ticks on red grouse chicks. Parasitology 122(5):563-569 DOI 10.1017/s0031182001007740
25. Fieberg J, Johnson DH. 2015. MMI: multimodel inference or models with management implications? Journal of Wildlife Management 79(5):708-718 DOI 10.1002/jwmg.894
26. Forstmeier W, Schielzeth H. 2011. Cryptic multiple hypotheses testing in linear models: overestimated effect sizes and the winner's curse. Behavioral Ecology and Sociobiology 65(1):47-55 DOI 10.1007/s00265-010-1038-5
27. Freckleton RP. 2011. Dealing with collinearity in behavioural and ecological data: model averaging and the problems of measurement error. Behavioral Ecology and Sociobiology 65(1):91-101 DOI 10.1007/s00265-010-1045-6
28. Galipaud M, Gillingham MAF, David M, Dechaume-Moncharmont FX. 2014. Ecologists overestimate the importance of predictor variables in model averaging: a plea for cautious interpretations. Methods in Ecology and Evolution 5(10):983-991 DOI 10.1111/2041-210x.12251
29. Galipaud M, Gillingham MAF, Dechaume-Moncharmont FX. 2017. A farewell to the sum of Akaike weights: the benefits of alternative metrics for variable importance estimations in model selection. Methods in Ecology and Evolution 8(12):1668-1678 DOI 10.1111/2041-210X.12835
30. Gelman A. 2008. Scaling regression inputs by dividing by two standard deviations. Statistics in Medicine 27(15):2865-2873 DOI 10.1002/sim.3107
31. Gelman A, Hill J. 2007. Data Analysis Using Regression and Hierarchical/Multilevel Models. New York: Cambridge University Press
32. Gelman A, Pardoe I. 2006. Bayesian measures of explained variance and pooling in multilevel (hierarchical) models. Technometrics 48(2):241-251 DOI 10.1198/004017005000000517
33. Giam X, Olden JD. 2016. Quantifying variable importance in a multimodel inference framework. Methods in Ecology and Evolution 7(4):388-397 DOI 10.1111/2041-210x.12492
34. Graham ME. 2003. Confronting multicollinearity in multiple linear regression. Ecology 84(11):2809-2815 DOI 10.1890/02-3114
35. Grueber CE, Nakagawa S, Laws RJ, Jamieson IG. 2011. Multimodel inference in ecology and evolution: challenges and solutions. Journal of Evolutionary Biology 24(4):699-711 DOI 10.1111/j.1420-9101.2010.02210.x
36. Harrison XA. 2014. Using observation-level random effects to model overdispersion in count data in ecology and evolution. PeerJ 2:e616 DOI 10.7717/peerj.616
37. Harrison XA. 2015. A comparison of observation-level random effect and Beta-Binomial models for modelling overdispersion in Binomial data in ecology & evolution. PeerJ 3:e1114 DOI 10.7717/peerj.1114
38. Halsey LG, Curran-Everett D, Vowler SL, Drummond GB. 2015. The fickle P value generates irreproducible results. Nature Methods 12(3):179-185 DOI 10.1038/nmeth.3288
39. Hegyi G, Garamszegi LZ. 2011. Using information theory as a substitute for stepwise regression in ecology and behaviour. Behavioral Ecology and Sociobiology 65(1):69-76 DOI 10.1007/s00265-010-1036-7
40. Hilbe JM. 2011. Negative Binomial Regression. Cambridge: Cambridge University Press
41. Houslay T, Wilson A. 2017. Avoiding the misuse of BLUP in behavioral ecology. Behavioral Ecology 28(4):948-952 DOI 10.1093/beheco/arx023
42. Ives AR. 2015. For testing the significance of regression coefficients, go ahead and log-transform count data. Methods in Ecology and Evolution 6(7):828-835 DOI 10.1111/2041-210x.12386
43. James FC, McCullugh CF. 1990. Multivariate analysis in ecology and systematics: panacea or Pandora box. Annual Review of Ecology and Systematics 21(1):129-166 DOI 10.1146/annurev.es.21.110190.001021
44. Johnson PCD. 2014. Extension of Nakagawa & Schielzeth's R2 GLMM to random slopes models. Methods in Ecology and Evolution 5(9):944-946 DOI 10.1111/2041-210x.12225
45. Johnson JB, Omland KS. 2004. Model selection in ecology and evolution. Trends in Ecology & Evolution 19(2):101-108 DOI 10.1016/j.tree.2003.10.013
46. Kass RE, Caffo BS, Davidian M, Meng XL, Yu B, Reid N. 2016. Ten simple rules for effective statistical practice. PLOS Computational Biology 12(6):e1004961 DOI 10.1371/journal.pcbi.1004961
47. Kéry M. 2010. Introduction to WinBUGS for Ecologists: Bayesian Approach to Regression, ANOVA, Mixed Models and Related Analyses. Burlington: Academic Press
48. Kuznetsova A, BrockhoffPB, Christensen RHB. 2014. Package 'lmerTest'. Test for random and fixed effects for linear mixed effect models (lmer objects of lme4 package). R package Version 2. Available at https://github.com/runehaubo/lmerTestR
49. Lefcheck JS. 2015. piecewiseSEM: piecewise structural equation modeling in R for ecology, evolution, and systematics. Methods in Ecology and Evolution 7(5):573-579 DOI 10.1111/2041-210x.12512
50. Lindberg MS, Schmidt JH, Walker J. 2015. History of multimodel inference via model selection in wildlife science. Journal of Wildlife Management 79(5):704-707 DOI 10.1002/jwmg.892
51. Low-Décarie E, Chivers C, Granados M. 2014. Rising complexity and falling explanatory power in ecology. Frontiers in Ecology and the Environment 12(7):412-418 DOI 10.1890/130230
52. Lüdecke D. 2017. SjPlot: data visualization for statistics in social science. R package Version 2.4.0. Available at https://CRAN.R-project.org/package=sjPlot
53. Lukacs PM, Burnham KP, Anderson DR. 2010. Model selection bias and Freedman's paradox. Annals of the Institute of Statistical Mathematics 62(1):117-125 DOI 10.1007/s10463-009-0234-4
54. Mundry R. 2011. Issues in information theory-based statistical inference-a commentary from a frequentist's perspective. Behavioral Ecology and Sociobiology 65(1):57-68 DOI 10.1007/s00265-010-1040-y
55. Murtaugh PA. 2007. Simplicity and complexity in ecological data analysis. Ecology 88(1):56-62 DOI 10.1890/0012-9658(2007)88[56:sacied]2.0.co;2
56. Murtaugh PA. 2009. Performance of several variable-selection methods applied to real ecological data. Ecology Letters 12(10):1061-1068 DOI 10.1111/j.1461-0248.2009.01361.x
57. Murtaugh PA. 2014. In defense of P values. Ecology 95(3):611-617 DOI 10.1890/13-0590.1
58. Nagelkerke NJ. 1991. A note on a general definition of the coefficient of determination. Biometrika 78(3):691-692 DOI 10.1093/biomet/78.3.691
59. Nakagawa S. 2015. Missing data: mechanisms, methods and messages. In: Fox GA, Negrete-Yankelevich S, Sosa VJ, eds. Ecological Statistics: Contemporary Theory and Application. Oxford: Oxford University Press, 81-105
60. Nakagawa S, Foster T. 2004. The case against retrospective statistical power analyses with an introduction to power analysis. Acta Ethologica 7(2):103-108 DOI 10.1007/s10211-004-0095-z
61. Nakagawa S, Freckleton RP. 2008. Missing inaction: the dangers of ignoring missing data. Trends in Ecology & Evolution 23(11):592-596 DOI 10.1016/j.tree.2008.06.014
62. Nakagawa S, Freckleton RP. 2011. Model averaging, missing data and multiple imputation: a case study for behavioural ecology. Behavioral Ecology and Sociobiology 65(1):103-116 DOI 10.1007/s00265-010-1044-7
63. Nakagawa S, Johnson PCD, Schielzeth H. 2017. The coefficient of determination R2 and intraclass correlation coefficient from generalized linear mixed-effects models revisited and expanded. Journal of the Royal Society Interface 14(134):20170213 DOI 10.1098/rsif.2017.0213
64. Nakagawa S, Schielzeth H. 2010. Repeatability for Gaussian and non-Gaussian data: a practical guide for biologists. Biological Reviews 85(4):935-956 DOI 10.1111/j.1469-185X.2010.00141.x
65. Nakagawa S, Schielzeth H. 2013. A general and simple method for obtaining R2 from generalized linear mixed-effects models. Methods in Ecology and Evolution 4(2):133-142 DOI 10.1111/j.2041-210x.2012.00261.x
66. Nickerson RS. 2000. Null hypothesis significance testing: a review of an old and continuing controversy. Psychological Methods 5(2):241-301 DOI 10.1037/1082-989x.5.2.241
67. Noble DWA, Nakagawa S. 2017. Planned missing data design: stronger inferences increased research efficiency and improved animal welfare in ecology and evolution. bioRxiv 247064 DOI 10.1101/247064
68. O'Hara RB, Kotze DJ. 2010. Do not log-transform count data. Methods in Ecology and Evolution 1(2):118-122 DOI 10.1111/j.2041-210x.2010.00021.x
69. Peig J, Green AJ. 2009. New perspectives for estimating body condition from mass/length data: the scaled mass index as an alternative method. Oikos 118(12):1883-1891 DOI 10.1111/j.1600-0706.2009.17643.x
70. Peters RH. 1991. A Critique for Ecology. Cambridge: Cambridge University Press
71. Quinn GP, Keough MJ. 2002. Experimental Design and Data Analysis for Biologists. Cambridge: Cambridge University Press
72. R Core Team. 2016. R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing. Available at https://www. R-project.org/
73. Richards SA. 2005. Testing ecological theory using the information-theoretic approach: examples and cautionary results. Ecology 86(10):2805-2814 DOI 10.1890/05-0074
74. Richards SA. 2008. Dealing with overdispersed count data in applied ecology. Journal of Applied Ecology 45(1):218-227 DOI 10.1111/j.1365-2664.2007.01377.x
75. Richards SA, Whittingham MJ, Stephens PA. 2011. Model selection and model averaging in behavioural ecology: the utility of the IT-AIC framework. Behavioral Ecology and Sociobiology 65(1):77-89 DOI 10.1007/s00265-010-1035-8
76. Rousset F, Ferdy JB. 2014. Testing environmental and genetic effects in the presence of spatial autocorrelation. Ecography 37(8):781-790 DOI 10.1111/ecog.00566
77. Rykiel EJ. 1996. Testing ecological models: the meaning of validation. Ecological Modelling 90(3):229-244 DOI 10.1016/0304-3800(95)00152-2
78. Scheipl F, Bolker B. 2016. RLRsim: exact (restricted) likelihood ratio tests for mixed and additive models computational statistics & data analysis. R package Version 3.1-3. Available at https://cran.r-project.org/web/packages/RLRsim/index.html
79. Schielzeth H. 2010. Simple means to improve the interpretability of regression coefficients. Methods in Ecology and Evolution 1(2):103-113 DOI 10.1111/j.2041-210x.2010.00012.x
80. Schielzeth H, Forstmeier W. 2009. Conclusions beyond support: overconfident estimates in mixed models. Behavioral Ecology 20(2):416-420 DOI 10.1093/beheco/arn145
81. Schielzeth H, Nakagawa S. 2013. Nested by design: model fitting and interpretation in a mixed model era. Methods in Ecology Evolution 4(1):14-24 DOI 10.1111/j.2041-210x.2012.00251.x
82. Southwood TRE, Henderson PA. 2000. Ecological Methods. Oxford: John Wiley & Sons
83. Stephens PA, Buskirk SW, Hayward GD, Martinez Del Rio C. 2005. Information theory and hypothesis testing: a call for pluralism. Journal of Applied Ecology 42(1):4-12 DOI 10.1111/j.1365-2664.2005.01002.x
84. Symonds MRE, Moussalli A. 2011. A brief guide to model selection, multimodel inference and model averaging in behavioural ecology using Akaike's information criterion. Behavioral Ecology and Sociobiology 65(1):13-21 DOI 10.1007/s00265-010-1037-6
85. Vaida F, Blanchard S. 2005. Conditional Akaike information for mixed-effects models. Biometrika 92(2):351-370 DOI 10.1093/biomet/92.2.351
86. van de Pol M, Wright J. 2009. A simple method for distinguishing within-versus between-subject effects using mixed models. Animal Behaviour 77(3):753-758 DOI 10.1016/j.anbehav.2008.11.006
87. Verbenke G, Molenberghs G. 2000. Linear Mixed Models for Longitudinal Data. New York: Springer
88. Warton D, Hui F. 2011. The arcsine is asinine: the analysis of proportions in ecology. Ecology 92(1):3-10 DOI 10.1890/10-0340.1
89. Warton DI, Lyons M, Stoklosa J, Ives AR. 2016. Three points to consider when choosing a LM or GLM test for count data. Methods in Ecology and Evolution 7(8):882-890 DOI 10.1111/2041-210x.12552
90. Whittingham MJ, Stephens PA, Bradbury RB, Freckleton RP. 2006. Why do we still use stepwise modelling in ecology and behaviour? Journal of Animal Ecology 75(5):1182-1189 DOI 10.1111/j.1365-2656.2006.01141.x
91. Wilson AJ, RéaleD, ClementsMN, MorrisseyMM, Postma E, Walling CA, Kruuk LEB, NusseyDH. 2010. An ecologist's guide to the animal model. Journal of Animal Ecology 79(1):13-26 DOI 10.1111/j.1365-2656.2009.01639.x
92. Wood SN, Goude Y, Shaw S. 2015. Generalized additive models for large data sets. Journal of the Royal Statistical Society: Series C (Applied Statistics) 64(1):139-155 DOI 10.1111/rssc.12068
93. Zuur AF, Ieno EN. 2016. A protocol for conducting and presenting results of regression-type analyses. Methods in Ecology and Evolution 7(6):636-645 DOI 10.1111/2041-210x.12577
94. Zuur AF, Ieno EN, Elphick CS. 2010. A protocol for data exploration to avoid common statistical problems. Methods in Ecology and Evolution 1(1):3-14 DOI 10.1111/j.2041-210x.2009.00001.x
95. Zuur AF, Ieno EN, Walker NJ, Saveliev AA, Smith GM. 2009. Mixed Effects Models and Extensions in Ecology with R. New York: Springer