Changing philosophies and tools for statistical inferences in behavioral ecology

Behavioral Ecology

Volumn 20, Issue 6, 2009, Pages 1363-1375

  Garamszegi, László Zsolt ^a   Calhim, Sara ^b   Dochtermann, Ned ^c   Hegyi, Gergely ^d   Hurd, Peter L ^e   Jørgensen, Christian ^f   Kutsukake, Nobuyuki ^g   Lajeunesse, Marc J ^h   Pollard, Kimberly A ⁱ   Schielzeth, Holger ^j   Symonds, Matthew R E ^k   Nakagawa, Shinichi ^l  

^a DEPARTMENT OF CONSERVATION BIOLOGY   (Spain)

^b QUEEN S UNIVERSITY   (Canada)

^c UNIVERSITY OF NEVADA   (United States)

^d EÖTVÖS LORÁND UNIVERSITY   (Hungary)

^e UNIVERSITY OF ALBERTA   (Canada)

^f UNIVERSITY OF BERGEN   (Norway)

^g GRADUATE UNIVERSITY FOR ADVANCED STUDIES   (Japan)

^h NATIONAL EVOLUTIONARY SYNTHESIS CENTER   (United States)

ⁱ UNIVERSITY OF CALIFORNIA   (United States)

^j MAX PLANCK INSTITUTE FOR ORNITHOLOGY   (Germany)

^k UNIVERSITY OF MELBOURNE   (Australia)

^l UNIVERSITY OF OTAGO   (New Zealand)

more..

Author keywords

BeStat; Bonferroni correction; Frequentist approach; Information theoretic approach; Measurement error; Model selection; P value; Prior; Statistical power

Indexed keywords

BAYESIAN ANALYSIS; BEHAVIORAL ECOLOGY; DATA QUALITY; ERROR ANALYSIS; FUTURE PROSPECT; HYPOTHESIS TESTING; PHILOSOPHY;

EID: 70450284470     PISSN: 10452249     EISSN: 14657279     Source Type: Journal    
DOI: 10.1093/beheco/arp137     Document Type: Review

References (104)

1. Adams DC. 2008. Phylogenetic meta-analysis. Evolution. 62:567-572.
2. Adolph SC, Hardin JS. 2007. Estimating phenotypic correlations: correcting for bias due to intraindividual variability. Funct Ecol. 21: 178-184.
3. Allison PD. 2002. Missing data. Thousand Oaks (CA): Sage.
4. American Psychological Association. 2001. Publication manual of the American Psychological Association. 5th ed. Washington (DC): American Psychological Association.
5. Anderson DR. 2008. Model based inference in the life sciences: a primer on evidence. New York: Springer.
6. Anderson DR, Burnham KP, Thompson WL. 2000. Null hypothesis testing: problems, prevalence, and an alternative. J Wildl Manage. 64:912-923.
7. Arnquist G, Wooster D. 1995. Meta-analysis: synthesizing research findings in ecology and evolution. Trends Ecol Evol. 10:236-240.
8. Becker WA. 1984. Manual of quantitative genetics. Pullman (WA): Academic Enterprises.
9. Bell AM, Hankison SJ, Laskowski KL. 2009. The repeatability of behavior: a meta-analysis. Anim Behav. 77:771-783.
10. Biro PA, Dingemanse NJ. 2009. Sampling bias resulting from animal personality. Trends Ecol Evol. 24:66-67.
11. Burnham KP, Anderson DR. 2002. Model selection and multimodel inference: a practical information-theoretic approach. New York: Springer-Verlag.
12. Byers BE. 2007. Extra-pair paternity in chestnut-sided warblers is correlated with consistent vocal performance. Behav Ecol. 18: 130-136.
13. Calhim S, Birkhead TR. 2007. Testes size in birds: quality versus quantity-assumptions, errors, and estimates. Behav Ecol. 18:271-275.
14. Carlin BP, Louis TA. 2000. Bayes and empirical Bayes methods for data analysis. London: Chapman & Hall.
15. Charpentier MJE, Prugnolle F, Gimenez O, Widdig A. 2008. Genetic heterozygosity and sociality in a primate species. Behav Genet. 38:151-158.
16. Claeskens C, Hjort NL. 2008. Model selection and model averaging. Cambridge: Cambridge University Press.
17. Clark JS. 2005. Why environmental scientists are becoming Bayesians. Ecol Lett. 8:2-14.
18. Clark JS, Gelfand AE. 2006. A future for models and data in environmental science. Trends Ecol Evol. 21:375-380.
19. Cockburn A, Sims RA, Osmond HL, Green DJ, Double MC, Mulder RA. 2008. Can we measure the benefits of help in cooperatively breeding birds: the case of superb fairy-wrens Malurus cyaneus? J Anim Ecol. 77:430-438.
20. Cohen J. 1988. Statistical power analysis for the behavioural sciences. 2nd ed. Hillsdale (NJ): Lawrence Erlbaum Associates.
21. Cohen J. 1994. The earth is round (p,.05). Am Psychol. 49: 997-1003
22. CongdonP. 2003. Applied Bayesian modelling. Chichester (UK): Wiley.
23. Congdon P. 2005. Bayesian models for categorical data. Chichester (UK): Wiley.
24. Congdon P. 2006. Bayesian statistical modelling. 2nd ed. Chichester (UK): Wiley. ́ Danchin E, Giraldeau L-A, Cézilly F. 2008. Behavioural ecology: an evolutionary perspective on behaviour. Oxford: Oxford University Press.
25. Dochtermann NA, Jenkins SH. 2007. Behavioural syndromes in Mer-riam's kangaroo rats (Dipodomys merriami): a test of competing hypotheses. Proc R Soc B Biol Sci. 274:2343-2349.
26. Draper NR, Smith H. 1981. Applied regression analysis. 2nd ed. New York: John Wiley.
27. Eberhardt LL. 2003. What should we do about hypothesis testing? J Wildlife Manage. 67:241-247.
28. Efron B, Tibshirani RJ. 1993. An introduction to the bootstrap. Monographs on statistics and applied probability 57. New York: Chapman & Hall.
29. Fan XT. 2003. Two approaches for correcting correlation attenuation caused by measurement error: implications for research practice. Educ Psychol Meas. 63:915-930.
30. Felsenstein J. 1985. Phylogenies and the comparative method. Am Nat. 125:1-15.
31. Felsenstein J. 2008. Comparative methods with sampling error and within-species variation: contrasts revisited and revised. Am Nat. 171:713-725.
32. Forster MR. 2000. Key concepts in model selection: performance and generalizability. J Math Psychol. 44:205-231.
33. Gamerman D, Lopes HF. 2006. Markov chain Monte Carlo: stochastic simulation for Bayesian inference. Boca Raton (FL): CRC.
34. Garamszegi LZ. 2006. Comparing effect sizes across variables: generalization without the need for Bonferroni correction. Behav Ecol. 17:682-687.
35. Garamszegi LZ. Forthcoming 2010. Information-theoretic approaches to statistical analysis in behavioural ecology: an introduction. Behav Ecol Sociobiol.
36. Garamszegi LZ, Eens M, Török J. 2009. Behavioural syndromes and trappability in free-living collared flycatchers, Ficedula albicollis. Anim Behav. 77:803-812.
37. Garamszegi LZ, Hegyi G, Heylen D, Ninni P, de Lope F, Eens M, Møller AP. 2006. The design of complex sexual traits in male barn swallows: associations between signal attributes. J Evol Biol. 19: 2052-2066.
38. Garamszegi LZ, Merino S, Török J, Eens M, Mart́inez J. 2006. Indicators of physiological stress and the elaboration of sexual traits in the collared flycatcher. Behav Ecol. 17:399-404.
39. Garamszegi LZ, Møller AP, Török J, Michl G, Péczely P, Richard M. 2004. Immune challenge mediates vocal communication in a passerine bird: an experiment. Behav Ecol. 15:148-157.
40. Gelman A, Carlin JB, Stern HS, Rubin DB. 1995. Bayesian data analysis. London: Chapman & Hall.
41. Gelman A, Hill J. 2007. Data analysis using regression and multilevel/hierarchical models. Cambridge: Cambridge University Press.
42. Gill J. 2002. Bayesian methods: a social and behavioral sciences approach. Boca Raton (FL): CRC Press.
43. Ginzburg LR, Jensen CXJ. 2004. Rules of thumb for judging ecological theories. Trends Ecol Evol. 19:121-126.
44. Grafen A, Hails RS. 2002. Modern statistics for the life sciences. Oxford: Oxford University Press.
45. Guthery FS, Brennan LA, Peterson MJ, Lusk JJ. 2005. Information theory in wildlife science: critique and viewpoint. J Wildl Manage. 69:457-465.
46. Hadfield JD. 2008. Estimating evolutionary parameters when viability selection is operating. Proc R Soc B Biol Sci. 275:723-734.
47. Haley DB, Rushen J, Duncan IJH, Widowski TM, De Passillé AM. 1998. Butting by calves, Bos taurus, and rate of milk flow. Anim Behav. 56:1545-1551.
48. Harmon LJ, Losos JB. 2005. The effect of intraspecific sample size on type I and type II error rates in comparative studies. Evolution. 59:2705-2710.
49. Harvey PH, Pagel MD. 1991. The comparative method in evolutionary biology. Oxford: Oxford University Press.
50. Hayes JP, Jenkins SH. 1997. Individual variation in mammals. J Mammal. 78:274-293.
51. Hedges LV, Olkin I. 1985. Statistical methods for meta-analysis. London: Academic Press.
52. HilbornR,MangelM.1997.Theecological detective: confronting models with data. Princeton (NJ): Princeton University Press.
53. Ives AR, Midford PE, Garland T. 2007. Within-species variation and measurement error in phylogenetic comparative methods. Syst Biol. 56:252-270.
54. Johnson JB, Omland KS. 2004. Model selection in ecology and evolution. Trends Ecol Evol. 19:101-108.
55. Jovani R, Tella JL. 2006. Parasite prevalence and sample size: misconceptions and solutions. Trends Parasitol. 22:214-218.
56. Popper KR. 1963. Conjectures and refutations. London: Routledge and Keagan Paul.
57. Kelley K. 2005. The effects of nonnormal distributions on confidence intervals around the standardized mean difference: bootstrap and parametric confidence intervals. Educ Psychol Meas. 65: 51-69.
58. Lajeunesse MJ. 2009. Meta-analysis and the comparative phylogenetic method. Am Nat. 174:369-381.
59. Lajeunesse MJ, Forbes MR. 2003. Variable reporting and quantitative reviews: a comparison of three meta-analytical techniques. Ecol Lett. 6:448-454.
60. Lambert D. 1992. Zero-inflated Poisson regression, with an application to defects in manufacturing. Technometrics. 34:1-14.
61. Lessells CM, Boag PT. 1987. Unrepeatable repeatabilities: a common mistake. Auk. 104:116-121.
62. Little RJA, Rubin DB. 2002. Statistical analysis with missing data. 2nd ed. New York: Wiley.
63. Lukacs PM, Thompson WL, Kendall WL, Gould WR, Doherty PF, Burnham KP, Anderson DR. 2007. Concerns regarding a call for pluralism of information theory and hypothesis testing. J Appl Ecol. 44:456-460.
64. Manly BFJ. 1991. Randomization, bootstrap and Monte Carlo methods in biology. New York: Chapman & Hall.
65. Martin RD, Harvey PH. 1985. Brain size allometry: ontogeny and phy-logeny. In: Jungers WL, editor. Size and scaling in primate biology. New York: Plenum Press. p. 147-173.
66. Martin TG, Wintle BA, Rhodes JR, Kuhnert PM, Field SA, Low-Choy SJ, Tyre AJ, Possingham HP. 2005. Zero tolerance ecology: improving ecological inference by modelling the source of zero observations. Ecol Lett. 8:1235-1246.
67. McArdle BH. 2003. Lines, models, and errors: regression in the field. Limnol Oceanogr. 48:1363-1366.
68. McCarthy MA. 2007. Bayesian methods for ecology. Cambridge: Cambridge University Press.
69. Miller AJ. 1992. Subset selection in regression. Boca Raton (FL): Chapman and Hall.
70. Møller AP, Jennions MD. 2001. Testing and adjusting for publication bias. Trends Ecol Evol. 16:580-586.
71. Mundry R, Nunn CL. 2009. Stepwise model fitting and statistical inference: turning noise into signal pollution. Am Nat. 173: 119-123.
72. Murtaugh PA. 2009. Performance of several variable-selection methods applied to real ecological data. Ecol Lett. 12:1061-1068.
73. Nakagawa S. 2004. A farewell to Bonferroni: the problems of low statistical power and publication bias. Behav Ecol. 15: 1044-1045.
74. Nakagawa S, Cuthill IC. 2007. Effect size, confidence interval and statistical significance: a practical guide for biologists. Biol Rev. 82: 591-605.
75. Nakagawa S, Freckleton R. 2008. Missing inaction: the dangers of ignoring missing data. Trends Ecol Evol. 23:592-596.
76. Nakagawa S, Ockendon N, Gillespie DOS, Hatchwell BJ, Burke T. 2007. Assessing the function of house sparrows' bib size using a flexible meta-analysis method. Behav Ecol. 18:831-840.
77. Neter J, Kutner MH, Nachtsheim CJ, Wasserman W. 1996. Applied linear statistical models. Chicago (IL): Irwin.
78. Pagel M, Meade A. 2006. Bayesian analysis of correlated evolution of discrete characters by reversible-jump Markov chain Monte Carlo. Am Nat. 167:808-825.
79. Pagel M, Meade A, Barker D. 2004. Bayesian estimation of ancestral character states on phylogenies. Syst Biol. 53:673-684.
80. Pan W. 1999. Bootstrapping likelihood for model selection with small samples. J Comput Graph Stat. 8:687-698.
81. Quinn GP, Keough MJ. 2002. Experimental design and data analysis for biologists. Cambridge: Cambridge University Press.
82. Richards SA. 2005. Testing ecological theory using the information-theoretic approach: examples and cautionary results. Ecology. 86: 2805-2814.
83. Ronquist F. 2004. Bayesian inference of character evolution. Trends Ecol Evol. 19:475-481.
84. Rosenthal R. 1979. The ''file drawer problem'' and tolerance for null results. Psychol Bull. 86:638-641.
85. Rosenthal R. 1994. Parametric measures of effect size. In: Cooper H, Hedges LV, editors. The handbook of research synthesis. New York: Russell Sage Foundation. p. 231-244.
86. Rushton SP, Ormerod SJ, Kerby G. 2004. New paradigms for modelling species distributions? J Appl Ecol. 41:193-200.
87. Ruxton GD. 2006. The unequal variance t-test is an underused alternative to Student's t-test and the Mann-Whitney U test. Behav Ecol. 17:688-690.
88. Schielzeth H, Forstmeier W. 2009. Conclusions beyond support: overconfident estimates in mixed models. Behav Ecol. 20:416-420.
89. Seghouane AK. 2006. A note on overfitting properties of KIC and KICc. Signal Processing. 86:3055-3060.
90. Sokal RR, Rohlf FJ. 1995. Biometry. 3rd ed. New York: W.H. Freeman & Co.
91. Stephens PA, Buskirk SW, del Rio CM. 2007. Inference in ecology and evolution. Trends Ecol Evol. 22:192-197.
92. Stephens PA, Buskirk SW, Hayward GD, del Rio CM. 2005. Information theory and hypothesis testing: a call for pluralism. J Appl Ecol. 42:4-12.
93. Stephens PA, Buskirk SW, Hayward GD, del Rio CM. 2007. A call for statistical pluralism answered. J Appl Ecol. 44:461-463.
94. Symonds MRE, Johnson CN. 2006. Determinants of local abundance in a major radiation of Australian passerines (Aves: Meliphagoidea). J Biogeogr. 33:794-802.
95. Therrien JF, Cote SD, Festa-Bianchet M, Ouellet JP. 2008. Maternal care in whitetailed deer: trade-off between maintenance and reproduction under food restriction. Anim Behav. 75:235-243.
96. Thompson B. 2002. What future quantitative social science research could look like: confidence intervals for effect sizes. Educ Res. 31: 25-32.
97. van de Pol M, Verhulst S. 2006. Age-dependent traits: a new statistical model to separate within-and between-individual effects. Am Nat. 167:766-773.
98. van de Pol MV, Wright J. 2009. A simple method for distinguishing within-versus between-subject effects using mixed models. Anim Behav. 77:753-758.
99. van Dongen S. 2001. Modelling developmental instability in relation to individual fitness: a fully Bayesian latent variable model approach. J Evol Biol. 14:552-563.
100. Verdú M, Traveset A. 2005. Early emergence enhances plant fitness: a phylogenetically controlled meta-analysis. Ecology. 86:1385-1394.
101. Ward EJ. 2008. A review and comparison of four commonly used Bayesian and maximum likelihood model selection tools. Ecol Model. 211:1-10.
102. Welsh AH, Cunningham RB, Donnelly CF, Lindenmayer DB. 1996. Modelling the abundance of rare species: statistical models for counts with extra zeros. Ecol Model. 88:297-308.
103. Whittingham MJ, Stephens PA, Bradbury RB, Freckleton RP. 2006. Why do we still use stepwise modelling in ecology and behaviour? J Anim Ecol. 75:1182-1189.
104. Wingfield JC, Ball GF, Duffy AMJ, Hegner RE, Ramenofsky M. 1987. Testosterone and agression in birds. Am Sci. 75:602-608.