Robustness of linear mixed-effects models to violations of distributional assumptions

Methods in Ecology and Evolution

Volumn 11, Issue 9, 2020, Pages 1141-1152

  Schielzeth, Holger ^a   Dingemanse, Niels J ^b   Nakagawa, Shinichi ^c   Westneat, David F ^d   Allegue, Hassen ^e   Teplitsky, Céline ^f   Réale, Denis ^e   Dochtermann, Ned A ^g   Garamszegi, László Zsolt ^h,i   Araya Ajoy, Yimen G ^j  

^a FRIEDRICH SCHILLER UNIVERSITY JENA   (Germany)

^b UNIVERSITY OF MUNICH   (Germany)

^c UNIVERSITY OF NEW SOUTH WALES   (Australia)

^d UNIVERSITY OF KENTUCKY   (United States)

^e UNIVERSITÉ DU QUÉBEC À MONTRÉAL   (Canada)

^f CNRS   (France)

^g NORTH DAKOTA STATE UNIVERSITY   (United States)

^h INSTITUTE OF ECOLOGY AND BOTANY   (Hungary)

ⁱ EÖTVÖS LORÁND UNIVERSITY   (Hungary)

^j NORWEGIAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Norway)

more..

Author keywords

biostatistics; correlated predictors; distributional assumptions; linear mixed effects models; missing random effects; statistical quantification of individual differences (SQuID)

Indexed keywords

EID: 85088038028     PISSN: None     EISSN: 2041210X     Source Type: Journal    
DOI: 10.1111/2041-210X.13434     Document Type: Article

References (52)

1. Allegue, H., Araya-Ajoy, Y. G., Dingemanse, N. J., Dochtermann, N. A., Garamszegi, L. Z., Nakagawa, S., … Westneat, D. F. (2017). Statistical quantification of individual differences (SQuID): An educational and statistical tool for understanding multilevel phenotypic data in linear mixed models. Methods in Ecology and Evolution, 8, 257–267. https://doi.org/10.1111/2041-210X.12659
2. Alonso, A., Litiere, S., & Laenen, A. (2010). A note on the indeterminacy of the random-effects distribution in hierarchical models. The American Statistician, 64, 318–324. https://doi.org/10.1198/tast.2010.09244
3. Arnau, J., Bendayan, R., Blanca, M. J., & Bono, R. (2013). The effect of skewness and kurtosis on the robustness of linear mixed models. Behavior Research Methods, 45, 873–879. https://doi.org/10.3758/s13428-012-0306-x
4. Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67, 1–48.
5. Becker, M., & Klößner, S. (2017). PearsonDS: Pearson distribution system. R package version 1.1. Retrieved from https://cran.r-project.org/web/packages/PearsonDS
6. Bolker, B. (2008). Ecological models and data in R. Princeton, NJ: Princeton University Press.
7. Bolker, B. M., Brooks, M. E., Clark, C. J., Geange, S. W., Poulsen, J. R., Stevens, M. H. H., & White, J.-S.-S. (2009). Generalized linear mixed models: A practical guide for ecology and evolution. Trends in Ecology & Evolution, 24, 127–135. https://doi.org/10.1016/j.tree.2008.10.008
8. Box, G. E. P. (1980). Sampling and Bayes inference in scientific modeling and robustness. Journal of the Royal Statistical Society A, 143, 383–430.
9. Brodie, E. D., Moore, A. J., & Janzen, F. J. (1995). Visualizing and quantifying natural selection. Trends in Ecology & Evolution, 10, 313–318. https://doi.org/10.1016/S0169-5347(00)89117-X
10. Cheng, J., Edwards, L. J., Maldonado-Molina, M. M., Komro, K. A., & Muller, K. E. (2010). Real longitudinal data analysis for real people: Building a good enough mixed model. Statistics in Medicine, 29, 504–520.
11. Cleasby, I. R., & Nakagawa, S. (2011). Neglected biological patterns in the residuals: A behavioural ecologist's guide to co-operating with heteroscedasticity. Behavioral Ecology and Sociobiology, 65, 2361–2372. https://doi.org/10.1007/s00265-011-1254-7
12. Cleasby, I. R., Nakagawa, S., & Schielzeth, H. (2015). Quantifying the predictability of behaviour: Statistical approaches for the study of between-individual variation in the within-individual variance. Methods in Ecology and Evolution, 6, 27–37. https://doi.org/10.1111/2041-210X.12281
13. Demidenko, E., & Stukel, T. A. (2005). Influence analysis for linear mixed-effects models. Statistics in Medicine, 24, 893–909. https://doi.org/10.1002/sim.1974
14. Freckleton, R. P. (2011). Dealing with collinearity in behavioural and ecological data: Model averaging and the problems of measurement error. Behavioral Ecology and Sociobiology, 65, 91–101. https://doi.org/10.1007/s00265-010-1045-6
15. Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models. Cambridge, UK: Cambridge University Press.
16. Grilli, L., & Rampichini, C. (2015). Specification of random effects in multilevel models: A review. Quality & Quantity, 49, 967–976. https://doi.org/10.1007/s11135-014-0060-5
17. Gurka, M. J., Edwards, L. J., & Muller, K. E. (2011). Avoiding bias in mixed model inference for fixed effects. Statistics in Medicine, 30, 2696–2707. https://doi.org/10.1002/sim.4293
18. Gurka, M. J., Edwards, L. J., Muller, K. E., & Kupper, L. L. (2006). Extending the Box-Cox transformation to the linear mixed model. Journal of the Royal Statistical Society A, 169, 273–288. https://doi.org/10.1111/j.1467-985X.2005.00391.x
19. Harrison, X. A., Donaldson, L., Correa-Cano, M. E., Evans, J., Fisher, D. N., Goodwin, C. E. D., … Inger, R. (2018). A brief introduction to mixed effects modelling and multi-model inference in ecology. PeerJ, 6, e4794. https://doi.org/10.7717/peerj.4794
20. Heagerty, P. J., & Kurland, B. F. (2001). Misspecified maximum likelihood estimates and generalised linear mixed models. Biometrika, 88, 973–985. https://doi.org/10.1093/biomet/88.4.973
21. Houle, D., Pelabon, C., Wagner, G. P., & Hansen, T. F. (2011). Measurement and meaning in biology. The Quarterly Review of Biology, 86, 3–34. https://doi.org/10.1086/658408
22. Jacqmin-Gadda, H., Sibillot, S., Proust, C., Molina, J. M., & Thiebaut, R. (2007). Robustness of the linear mixed model to misspecified error distribution. Computational Statistics & Data Analysis, 51, 5142–5154. https://doi.org/10.1016/j.csda.2006.05.021
23. Kenward, M. G., & Roger, J. H. (1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics, 53, 983–997. https://doi.org/10.2307/2533558
24. Kenward, M. G., & Roger, J. H. (2009). An improved approximation to the precision of fixed effects from restricted maximum likelihood. Computational Statistics & Data Analysis, 53, 2583–2595. https://doi.org/10.1016/j.csda.2008.12.013
25. Lee, Y., & Nelder, J. A. (2004). Conditional and marginal models: Another view. Statistical Science, 19, 219–228. https://doi.org/10.1214/088342304000000305
26. Loy, A., & Hofmann, H. (2013). Diagnostic tools for hierarchical linear models. Wiley Interdisciplinary Reviews: Computational Statistics, 5, 48–61. https://doi.org/10.1002/wics.1238
27. Loy, A., & Hofmann, H. (2014). HLMdiag: A suite of diagnostics for hierarchical linear models in R. Journal of Statistical Software, 56, 1–18.
28. Maas, C. J. M., & Hox, J. J. (2004). Robustness issues in multilevel regression analysis. Statistica Neerlandica, 58, 127–137. https://doi.org/10.1046/j.0039-0402.2003.00252.x
29. McCulloch, C. E., & Neuhaus, J. M. (2011). Misspecifying the shape of a random effects distribution: Why getting It wrong may not matter. Statistical Science, 26, 388–402. https://doi.org/10.1214/11-STS361
30. Morrissey, M. B., & Ruxton, G. D. (2018). Multiple regression is not multiple regressions: The meaning of multiple regression and the non-problem of collinearity. Philosophy, Theory, and Practice in Biology, 10, 3. https://doi.org/10.3998/ptpbio.16039257.0010.003
31. Nakagawa, S. (2015). Missing data: Mechanisms, methods, and messages. In G. A. Fox, S. Negrete-Yankelevich, & V. J. Sosa (Eds.), Ecological statistics: Contemporary theory and application (pp. 81–105). Oxford, UK: Oxford University Press.
32. Nakagawa, S., & Freckleton, R. P. (2008). Missing inaction: The dangers of ignoring missing data. Trends in Ecology & Evolution, 23, 592–596. https://doi.org/10.1016/j.tree.2008.06.014
33. Nakagawa, S., & Schielzeth, H. (2010). Repeatability for Gaussian and non-Gaussian data: A practical guide for biologists. Biological Reviews, 85, 935–956. https://doi.org/10.1111/j.1469-185X.2010.00141.x
34. Quinn, G. P., & Keough, M. J. (2002). Experimental design and data analysis for biologists. Cambridge, UK: Cambridge University Press.
35. R Core Team. (2019). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
36. Royall, R. M. (1986). Model robust confidence-intervals using maximum-likelihood estimators. International Statistical Review, 54, 221–226. https://doi.org/10.2307/1403146
37. Royall, R., & Tsou, T. S. (2003). Interpreting statistical evidence by using imperfect models: Robust adjusted likelihood functions. Journal of the Royal Statistical Society B, 65, 391–404. https://doi.org/10.1111/1467-9868.00392
38. Rubin, D. B. (1984). Bayesianly justifiable and relevant frequency calculations for the applied statistician. The Annals of Statistics, 12, 1151–1172. https://doi.org/10.1214/aos/1176346785
39. Santos Nobre, J., & Singer, J. D. (2007). Residual analysis for linear mixed models. Biometrical Journal, 49, 863–875. https://doi.org/10.1002/bimj.200610341
40. Schielzeth, H. (2020). Code for: Robustness of linear mixed-effects models to violations of distributional assumptions. Zenodo, https://doi.org/10.5281/zenodo.3877130
41. Schielzeth, H., & Forstmeier, W. (2009). Conclusions beyond support: Overconfident estimates in mixed models. Behavioral Ecology, 20, 416–420. https://doi.org/10.1093/beheco/arn145
42. Sinharay, S., & Stern, H. S. (2003). Posterior predictive model checking in hierarchical models. Journal of Statistical Planning and Inference, 111, 209–221. https://doi.org/10.1016/S0378-3758(02)00303-8
43. Snijders, T. A. B., & Bosker, R. J. (2011). Multilevel analysis: An introduction to basic and advanced multilevel modelling (2nd ed.). London, UK: Sage.
44. Taylor, J. M. G., Cumberland, W. G., & Sy, J. P. (1994). A stochastic model for analysis of longitudinal AIDS data. Journal of the American Statistical Association, 89, 727–736. https://doi.org/10.1080/01621459.1994.10476806
45. Venzon, D. J., & Moolgavkar, S. H. (1988). A method for computing profile-likelihood-based confidence intervals. Journal of the Royal Statistical Society Series C, 37, 87–94. https://doi.org/10.2307/2347496
46. Verbeke, G., & Lesaffre, E. (1996). A linear mixed-effects model with heterogeneity in the random-effects population. Journal of the American Statistical Association, 91, 217–221. https://doi.org/10.1080/01621459.1996.10476679
47. Verbeke, G., & Lesaffre, E. (1997). The effect of misspecifying the random-effects distribution in linear mixed models for longitudinal data. Computational Statistics & Data Analysis, 23, 541–556. https://doi.org/10.1016/S0167-9473(96)00047-3
48. Warrington, N. M., Tilling, K., Howe, L. D., Paternoster, L., Pennell, C. E., Wu, Y. Y., & Briollais, L. (2014). Robustness of the linear mixed effects model to error distribution assumptions and the consequences for genome-wide association studies. Statistical Applications in Genetics and Molecular Biology, 13, 567–587. https://doi.org/10.1515/sagmb-2013-0066
49. Westneat, D. F., Wright, J., & Dingemanse, N. J. (2015). The biology hidden inside residual within-individual phenotypic variation. Biological Reviews, 90, 729–743. https://doi.org/10.1111/brv.12131
50. Zare, K., & Rasekh, A. (2011). Diagnostic measures for linear mixed measurement error models. Sort-Statistics and Operations Research Transactions, 35, 125–144.
51. Zuur, A. F., Ieno, E. N., & Elphick, C. S. (2010). A protocol for data exploration to avoid common statistical problems. Methods in Ecology and Evolution, 1, 3–14. https://doi.org/10.1111/j.2041-210X.2009.00001.x
52. Zuur, A. F., Ieno, E. N., Walker, N. J., Saveliev, A. A., & Smith, G. M. (2009). Mixed effects models and extensions in ecology with R. London, UK: Springer.