A farewell to the sum of Akaike weights: The benefits of alternative metrics for variable importance estimations in model selection

Methods in Ecology and Evolution

Volumn 8, Issue 12, 2017, Pages 1668-1678

  Galipaud, Matthias ^a   Gillingham, Mark A F ^b   Dechaume Moncharmont, François Xavier ^c  

^a BIELEFELD UNIVERSITY   (Germany)

^b UNIVERSITY OF ULM   (Germany)

^c UNIVERSITÉ BOURGOGNE FRANCHE COMTÉ   (France)

Author keywords

Akaike information criterion; effect size; evidence ratio; model averaging; multi model inferences; standardised parameter estimates; variable criticality; variable ranking

Indexed keywords

EID: 85037054354     PISSN: None     EISSN: 2041210X     Source Type: Journal    
DOI: 10.1111/2041-210X.12835     Document Type: Article

References (35)

1. Akaike, H. (1973). Information theory as an extension of the maximum likelihood principle. In B. N. Petrov & F. Csaki (Eds.), Second international symposium on information theory (pp. 267–281). Budapest: Akaemiai Kiado.
2. Anderson, D. R., Burnham, K. P., Gould, W. R., & Cherry, S. (2001). Concerns about finding effects that are actually spurious. Wildlife Society Bulletin, 29, 311–316.
3. Arnold, T. W. (2010). Uninformative parameters and model selection using Akaike's Information Criterion. Journal of Wildlife Management, 74, 1175–1178.
4. Azen, R., Budescu, D. V., & Reiser, B. (2001). Criticality of predictors in multiple regression. British Journal of Mathematical and Statistical Psychology, 54, 201–225.
5. Budescu, D. V. (1993). Dominance analysis: A new approach to the problem of relative importance of predictors in multiple regression. Psychological Bulletin, 114, 542–551.
6. Burnham, K. (2015). Multimodel inference: Understanding AIC relative variable importance values. Retrieved from https://sites.warnercnr.colostate.edu/kenburnham/wpcontent/uploads/sites/25/2016/08/VARIMP.pdf.
7. Burnham, K. P., & Anderson, D. R. (1998). Model selection and multimodel inference: A practical information-theoretic approach, 1st ed. New York, NY: Springer.
8. Burnham, K. P., & Anderson, D. R. (2002). Model selection and multimodel inference: A practical information-theoretic approach, 2nd ed. New York, NY: Springer.
9. Burnham, K. P., & Anderson, D. R. (2004). Multimodel inference: Understanding AIC and BIC in model selection. Sociological Methods and Research, 33, 261–304.
10. Burnham, K. P., Anderson, D. R., & Huyvaert, K. P. (2011). AIC model selection and multimodel inference in behavioral ecology: Some background, observations, and comparisons. Behavioral Ecology and Sociobiology, 65, 23–35.
11. Cade, B. S. (2015). Model averaging and muddled multimodel inferences. Ecology, 96, 2370–2382.
12. Dochtermann, N. A., & Jenkins, S. H. (2011). Developing multiple hypotheses in behavioral ecology. Behavioral Ecology and Sociobiology, 65, 37–45.
13. Galipaud, M., Gillingham, M. A. F., David, M., & Dechaume-Moncharmont, F. X. (2014). Ecologists overestimate the importance of predictor variables in model averaging: A plea for cautious interpretations. Methods in Ecology and Evolution, 5, 983–991.
14. Garamszegi, L. Z., Calhim, S., Dochtermann, N., Hegyi, G., Hurd, P. L., Jargensen, C., … Nakagawa, S. (2009). Changing philosophies and tools for statistical inferences in behavioral ecology. Behavioral Ecology, 20, 1363–1375.
15. Giam, X., & Olden, J. D. (2016). Quantifying variable importance in a multimodel inference framework. Methods in Ecology and Evolution, 7, 388–397.
16. Grueber, C. E., Nakagawa, S., Laws, R. J., & Jamieson, I. G. (2011). Multimodel inference in ecology and evolution: Challenges and solutions. Journal of Evolutionary Biology, 24, 699–711.
17. Johnson, J. W. (2000). A heuristic method for estimating the relative weight of predictor variables in multiple regression. Multivariate Behavioral Research, 35, 1–19.
18. Johnson, J. W., & LeBreton, J. M. (2004). History and use of relative importance indices in organizational research. Organizational Research Methods, 7, 238–257.
19. Kelly, C. D. (2006). Replicating empirical research in behavioral ecology: How and why it should be done but rarely ever is. The Quarterly Review of Biology, 81, 221–236.
20. Lukacs, P. M., Burnham, K. P., & Anderson, D. R. (2010). Model selection bias and Freedman's paradox. Annals of the Institute of Statistical Mathematics, 62, 117–125.
21. Lukacs, P. M., Thompson, W. L., Kendall, W. L., Gould, W. R., Doherty, P. F., Burnham, K. P., & Anderson, D. R. (2007). Concerns regarding a call for pluralism of information theory and hypothesis testing. Journal of Applied Ecology, 44, 456–460.
22. Mac Nally, R. (2000). Regression and model-building in conservation biology, biogeography and ecology: The distinction between – And reconciliation of – predictive and explanatory models. Biodiversity and Conservation, 9, 655–671.
23. Murray, K., & Conner, M. M. (2009). Methods to quantify variable importance: Implications for the analysis of noisy ecological data. Ecology, 90, 348–355.
24. Nakagawa, S., & Cuthill, I. C. (2007). Effect size, confidence interval and statistical significance: A practical guide for biologists. Biological Reviews, 82, 591–605.
25. Nakagawa, S., & Parker, T. H. (2015). Replicating research in ecology and evolution: Feasibility, incentives, and the cost-benefit conundrum. BMC Biology, 13, 88+.
26. Peduzzi, P., Concato, J., Kemper, E., Holford, T. R., & Feinstein, A. R. (1996). A simulation study of the number of events per variable in logistic regression analysis. Journal of Clinical Epidemiology, 49, 1373–1379.
27. Raftery, A. E. (1995). Bayesian model selection in social research. Sociological Methodology, 25, 111–163.
28. Richards, S. A. (2005). Testing ecological theory using the information theoretic approach: Examples and cautionary results. Ecology, 86, 2805–2814.
29. Richards, S. A., Whittingham, M. J., & Stephens, P. A. (2011). Model selection and model averaging in behavioural ecology: The utility of the IT-AIC framework. Behavioral Ecology Sociobiology, 65, 77–89.
30. Schielzeth, H. (2010). Simple means to improve the interpretability of regression coefficients. Methods in Ecology and Evolution, 1, 103–113.
31. Smith, A., Koper, N., Francis, C. M., & Fahrig, L. (2009). Confronting collinearity: Comparing methods for disentangling the effects of habitat loss and fragmentation. Landscape Ecology, 24, 1271–1285.
32. Stephens, P. A., Buskirk, S. W., Hayward, G. D., & Martínez del Rio, C. (2005). Information theory and hypothesis testing: A call for pluralism. Journal of Applied Ecology, 42, 4–12.
33. Stephens, P. A., Buskirk, S. W., & Martínez del Rio, C. (2007). Inference in ecology and evolution. Trends in Ecology and Evolution, 22, 192–197.
34. Symonds, M. R. E., & Moussalli, A. (2011). A brief guide to model selection, multimodel inference and model averaging in behavioural ecology using Akaike's information criterion. Behavioral Ecology and Sociobiology, 65, 13–21.
35. Whittingham, M. J., Stephens, P. A., Bradbury, R. B., & Freckleton, R. P. (2006). Why do we still use stepwise modeling in ecology and behaviour? Journal of Animal Ecology, 75, 1182–1189.