Using information theory as a substitute for stepwise regression in ecology and behavior

Behavioral Ecology and Sociobiology

Volumn 65, Issue 1, 2011, Pages 69-76

  Hegyi, Gergely ^a   Garamszegi, László Zsolt ^b  

^a EÖTVÖS LORÁND UNIVERSITY   (Hungary)

^b DEPARTMENT OF CONSERVATION BIOLOGY   (Spain)

Author keywords

Akaike's information criterion; Candidate model set; Critical values; Interaction terms; Null hypothesis testing; Overfitting

Indexed keywords

AKAIKE INFORMATION CRITERION; BEHAVIORAL ECOLOGY; ECOLOGICAL MODELING; HYPOTHESIS TESTING; PERFORMANCE ASSESSMENT; REGRESSION ANALYSIS;

EID: 78650788048     PISSN: 03405443     EISSN: None     Source Type: Journal    
DOI: 10.1007/s00265-010-1036-7     Document Type: Review

References (63)

1. Aiken LS, West SG (1991) Multiple regression: testing and interpreting interactions. Sage, Newbury Park.
2. Akaike H (1973) Information theory as an extension of the maximum likelihood principle. In: Petrov BN, Csáki F (eds) Second international symposium on information theory. Akadémiai Kiadó, Budapest, pp 267-281.
3. Anderson DR, Burnham KP, Thompson WL (2000) Null hypothesis testing: problems, prevalence, and an alternative. J Wildl Manage 64: 912-923.
4. Anderson DR, Burnham KP, Gould WR, Cherry S (2001) Concerns about finding effects that are actually spurious. Wildl Soc Bull 29: 311-316.
5. Austin PC (2008a) The large-sample performance of backwards variable elimination. J Appl Stat 35: 1355-1370.
6. Austin PC (2008b) Bootstrap model selection had similar performance for selecting authentic and noise variables compared to backward variable elimination: a simulation study. J Clin Epidemiol 61: 1009-1017.
7. Buckland ST, Burnham KP, Augustin NH (1997) Model selection: an integral part of inference. Biometrics 53: 603-618.
8. Burnham KP, Anderson DR (2002) Model selection and multimodel inference: a practical information-theoretic approach, 2nd edn. Springer, New York.
9. Burnham KP, Anderson DR, Huyvaert K (2010) AICc model selection in ecological and behavioral science: some background, observations, and comparisons. Behav Ecol Sociobiol. doi: 10. 1007/s00265-010-1029-6.
10. Chatfield C (1995) Model uncertainty, data mining and statistical inference. J R Stat Soc A 158: 419-466.
11. Copas JB, Long T (1991) Estimating the residual variance in orthogonal regression with variable selection. Statistician 40: 51-59.
12. Dochtermann NA, Jenkins SH (2010) Developing multiple hypotheses in behavioral ecology. Behav Ecol Sociobiol. doi: 10. 1007/s00265-010-1039-4.
13. Draper D (1995) Assessment and propagation of model uncertainty (with discussion). J R Stat Soc B 57: 45-97.
14. Eberhardt LL (2003) What should we do about hypothesis testing? J Wildl Manage 67: 241-247.
15. Engqvist L (2005) The mistreatment of covariate interaction terms in linear model analyses of behavioural and evolutionary ecology studies. Anim Behav 70: 967-971.
16. Forster MR (2000) Key concepts in model selection: performance and generalizability. J Math Psychol 44: 205-231.
17. Forstmeier W, Schielzeth H (2010) Cryptic multiple hypothesis testing in linear models: overestimated effect sizes and the winner's curse. Behav Ecol Sociobiol. doi: 10. 1007/s00265-010-1038-5.
18. Freckleton RP (2010) Dealing with collinearity in behavioural and ecological data: model averaging and the problems of measurement error. Behav Ecol Sociobiol. doi: 10. 1007/s00265-010-1045-6.
19. Garamszegi LZ (2010) Information-theoretic approaches to statistical analysis in behavioral ecology: an introduction. Behav Ecol Sociobiol. doi: 10. 1007/s00265-010-1028-7.
20. Gelman A, Hill J (2008) Data analysis using regression and multilevel/hierarchical models. Cambridge University Press, Cambridge.
21. Gibbons JM, Crout NMJ, Healey JR (2007) What role should null-hypothesis significance tests have in statistical education and hypothesis falsification? Trends Ecol Evol 22: 445-446.
22. Ginzburg LR, Jensen CXJ (2004) Rules of thumb for judging ecological theories. Trends Ecol Evol 19: 121-126.
23. Grafen A, Hails R (2002) Modern statistics for the life sciences. Oxford University Press, Oxford.
24. Graham MH (2003) Confronting multicollinearity in ecological multiple regression. Ecology 84: 2809-2815.
25. Guthery FS (2007) Deductive and inductive methods of accumulating reliable knowledge in wildlife science. J Wildl Manage 71: 222-225.
26. Guthery FS, Brennan LA, Peterson MJ, Lusk JJ (2005) Information theory in wildlife science: critique and viewpoint. J Wildl Manage 69: 457-465.
27. Harrell FE, Lee KL, Califf RM, Pryor DB, Rosati RA (1984) Regression modeling strategies for improved prognostic prediction. Statist Med 3: 143-152.
28. James FC, McCulloch CE (1990) Multivariate analysis in ecology and systematics: panacea or Pandora's box? Annu Rev Ecol Syst 21: 129-166.
29. Johnson DH (2002) The importance of replication in wildlife research. J Wildl Manage 66: 919-932.
30. Johnson JB, Omland KS (2004) Model selection in ecology and evolution. Trends Ecol Evol 19: 101-108.
31. Link WA, Barker RJ (2006) Model weights and the foundations of multimodel inference. Ecology 87: 2626-2635.
32. Lukacs PM, Thompson WL, Kendall WL, Gould WR, Doherty PF, Burnham KP, Anderson DR (2007) Concerns regarding a call for pluralism of information theory and hypothesis testing. J Appl Ecol 44: 456-460.
33. Lukacs PM, Burnham KP, Anderson DR (2010) Model selection bias and Freedman's paradox. Ann Inst Stat Math 62: 117-125.
34. Martínez-Abrain A (2007) Are there any differences? A non-sensical question in ecology. Acta Oecol 32: 203-206.
35. Martínez del Rio C, Buskirk SW, Stephens PA (2007) Response to Gibbons et al.: Null-hypothesis significance tests in education and inference. Trends Ecol Evol 22: 446.
36. Miller AJ (1992) Subset selection in regression. Chapman and Hall, Boca Raton.
37. Møller AP, Jennions MD (2002) How much variance can be explained by ecologists and evolutionary biologists? Oecologia 132: 492-500.
38. Moonesinghe R, Khoury MJ, Janssens CJW (2007) Most published research findings are false-but a little replication goes a long way. PLoS Med 4: e28.
39. Mundry R (2010) Issues in information theory based statistical inference-a commentary from a frequentist's perspective. Behav Ecol Sociobiol. doi: 10. 1007/s00265-010-1040-y.
40. Murtaugh PA (2009) Performance of several variable-selection methods applied to real ecological data. Ecol Lett 12: 1061-1068.
41. Nakagawa S (2004) A farewell to Bonferroni: the problems of statistical power and publication bias. Behav Ecol 15: 1044-1045.
42. Nakagawa S, Freckleton RP (2010) Model averaging, missing data and multiple imputation: a case study for behavioural ecology. Behav Ecol Sociobiol. doi: 10. 1007/s00265-010-1044-7.
43. Nakagawa S, Ockendon N, Gillespie DOS, Hatchwell BJ, Burke T (2007) Does the badge of status influence parental care and investment in house sparrows? An experimental test. Oecologia 153: 749-760.
44. Pan W (1999) Bootstrapping likelihood for model selection with small samples. J Comput Graph Stat 8: 687-698.
45. Posada D, Crandall KA (2001) Selecting the best-fit model of nucleotide substitution. Syst Biol 50: 580-601.
46. Raffalovich LE, Deane GD, Armstrong D, Tsao H (2008) Model selection procedures in social research: Monte Carlo simulation results. J Appl Stat 35: 1093-1114.
47. Richards SA (2005) Testing ecological theory using the information-theoretic approach: examples and cautionary results. Ecology 86: 2805-2814.
48. Richards SA (2008) Dealing with overdispersed count data in applied ecology. J Appl Ecol 45: 218-227.
49. Richards SA, Whittingham MJ, Stephens PA (2010) Model selection and model averaging in behavioural ecology: the utility of the IT-AIC framework. Behav Ecol Sociobiol. doi: 10. 1007/s00265-010-1035-8.
50. Romesburg HC (1981) Wildlife science: gaining reliable knowledge. J Wildl Manage 45: 293-313.
51. Rosenthal R, Rosnow R, Rubin DB (2000) Contrasts and effect sizes in behavioral research: a correlational approach. Cambridge University Press, Cambridge.
52. Sauerbrei W (1999) The use of resampling methods to simplify regression models in medical statistics. J Roy Stat Soc Ser C 48: 313-329.
53. Seghouane AK (2006) A note on overfitting properties of KIC and KICc. Signal Process 86: 3055-3060.
54. Steidl RJ (2006) Model selection, hypothesis testing, and risks of condemning analytical tools. J Wildl Manage 70: 1497-1498.
55. Stephens PA, Buskirk SW, Hayward GD, Del Rio CM (2005) Information theory and hypothesis testing: a call for pluralism. J Appl Ecol 42: 4-12.
56. Stephens PA, Buskirk SW, Hayward GD, Martínez del Rio C (2007a) A call for statistical pluralism answered. J Appl Ecol 44: 461-463.
57. Stephens PA, Buskirk SW, Martínez del Rio C (2007b) Inference in ecology and evolution. Trends Ecol Evol 22: 192-197.
58. Symonds MRE, Moussalli A (2010) A brief guide to model selection, multimodel inference and model averaging in behavioural ecology using Akaike's information criterion. Behav Ecol Sociobiol. doi: 10. 1007/s00265-010-1037-6.
59. Vaida F, Blanchard S (2005) Conditional Akaike information for mixed-effects models. Biometrika 92: 351-370.
60. Ward EJ (2008) A review and comparison of four commonly used Bayesian and maximum likelihood model selection tools. Ecol Model 211: 1-10.
61. Whittingham MJ, Swetnam RD, Wilson JD, Chamberlain DE, Freckleton RP (2005) Habitat selection by yellowhammers Emberiza citrinella on lowland farmland at two spatial scales: implications for conservation management. J Appl Ecol 42: 270-280.
62. Whittingham MJ, Stephens PA, Bradbury RB, Freckleton RP (2006) Why do we still use stepwise modelling in ecology and behaviour? J Anim Ecol 75: 1182-1189.
63. Williams BK (1997) Logic and science in wildlife biology. J Wildl Manage 61: 1007-1015.