Strengthening statistical usage in marine ecology

Journal of Experimental Marine Biology and Ecology

Volumn 426-427, Issue , 2012, Pages 97-108

  Beninger, Peter G ^a   Boldina, Inna ^a   Katsanevakis, Stelios ^b  

^a UNIVERSITÉ DE NANTES   (France)

^b JOINT RESEARCH CENTRE   (Italy)

Author keywords

Alternate approaches; Data treatment presentation; NHST; P Values; Statistics misuse

Indexed keywords

DATA SET; ECOLOGICAL APPROACH; LITERATURE REVIEW; MARINE ECOSYSTEM; STATISTICAL ANALYSIS; TESTING METHOD;

EID: 84862753379     PISSN: 00220981     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jembe.2012.05.020     Document Type: Review

References (130)

1. Akaike H. Information theory and an extension of the maximum likelihood principle. Second International Symposium on Information Theory 1973, 267-281. Akademiai Kiado, Budapest. B.N. Petrov, F. Csaki (Eds.).
2. Altman D.G. Statistical reviewing for medical journals. Stat. Med. 1998, 17:2661-2674.
3. Anderson D.R. Model Based Inference in the Life Sciences: A Primer on Evidence 2008, Springer Science+Business Media, New York.
4. Anderson D.R., Link W.A., Johnson D.H., Burnham K.P. Suggestions for presenting the results of data analyses. J. Wildl. Manage. 2001, 65:373-378.
5. Bacchetti P. Peer review of statistics in medical research: the other problem. Br. Med. J. 2002, 324:1271-1273.
6. Bella S., Fidler F., Williams J., Cumming G. Researchers misunderstand confidence intervals and standard error bars. Psychol. Method. 2005, 10:389-396.
7. Beninger P.G., Potter T.M., St-Jean S. Paddle cilia fixation artefacts in pallial organs of adult Mytilus edulis and Placopecten magellanicus (Mollusca, Bivalvia). Can. J. Zool. 1995, 73:610-614.
8. Beninger P.G., St-Jean S., Poussart Y. Labial palps of the blue mussel Mytilus edulis (Bivalvia: Mytilidae). Mar. Biol. 1995, 123:293-303.
9. Beninger P.G., Valdizan A., Decottignies P., Cognie B. Field reproductive dynamics of the invasive slipper limpet, Crepidula fornicata. J. Exp. Mar. Biol. Ecol. 2010, 390:179-187.
10. Beninger P.G., Elner R.W., Morançais M., Decottignies P. Downward trophic shift during breeding migration in the shorebird Calidris mauri (western sandpiper). Mar. Ecol. Prog. Ser. 2011, 428:259-269.
11. Berger J.O., Berry D.A. Statistical analysis and the illusion of objectivity. Am. Sci. 1988, 76:159-165.
12. Berkson J. Tests of significance considered as evidence. Int. J. Epidemiol. 2003, 32:687-691.
13. Beyth-Marom R., Fidler F., Cumming G. Statistical cognition: towards evidence-based practice in statistics and statistics education. Stat. Educ. Res. J. 2008, 7:20-39.
14. Bland R.C. Research methods in psychiatry. Can. J. Psychiatry 1990, 35:614-615.
15. Burnham K.P., Anderson D.R. Model Selection and Multimodel Inference: A Pratical Information-theoretic Approach 2002, Springer-Verlag, New York. second ed.
16. Carver R.P. The case against statistical significance testing. Harv. Educ. Rev. 1978, 48:378-399.
17. Christensen R. Testing Fisher, Neyman, Pearson, and Bayes. Am. Stat. 2005, 59:121-126.
18. Cohen J. Statistical Power Analysis for the Social Sciences 1977, Academic Press, New York.
19. Cohen J. The Earth is round (p<.05). Am. Psychol. 1994, 49:997-1003.
20. Cook R.J., Farewell V.T. Multiplicity considerations in the design and analysis of clinical trials. J. R. Stat. Soc. A 1996, 159:93-110.
21. Cumming G. Inference by eye: reading the overlap of independent confidence intervals. Stat. Med. 2009, 28:205-220.
22. Cumming G., Finch S. Inference by eye: confidence intervals and how to read pictures of data. Am. Psychol. 2005, 60:170-180.
23. Cumming G., Williams J., Fidler F. Replication, and researchers' understanding of confidence intervals and standard error bars. Underst. Stat. 2004, 3:299-311.
24. Dienes Z. Bayesian vs orthodox statistics - which side are you on?. Perspect. Psychol. Sci. 2011, 6:274-290.
25. Dubben H.H., Beck-Bornholdt H.P. Systematic review of publication bias in studies on publication bias. Br. Med. J. 2005, 331:433-434.
26. Dufour S.C., Steiner G., Beninger P.G. Phylogenetic analysis of the peri-hydrothermal vent bivalve Bathypecten vulcani based on 18s rRNA. Malacologia 2006, 48:35-42.
27. Edwards A.W.F. Likelihood 1992, expanded edition, Johns Hopkins University Press, Baltimore, MD.
28. Efron B., Tibshirani R.J. An Introduction to the Bootstrap 1993, Chapman and Hall, New York.
29. Egger M., Smith G.D., Schneider M., Minder C. Bias in meta-analysis detected by a simple, graphical test. Br. Med. J. 1997, 315:629-634.
30. Fairweather P.G. Statistical power and design requirements for environmental monitoring. Aust. J. Mar. Fresh. Res. 1991, 42:555-567.
31. Feise R.J. Do multiple outcome measures require p-value adjustment? BMC Med. Res. Methodol. 2002, 2:8.
32. Fidler F., Cumming G., Thomason N., Pannuzzo D., Smith J., Fyffe P., Edmonds H., Harrington C., Schmitt R. Evaluating the effectiveness of editorial policy to improve statistical practice: the case of the Journal of Consulting and Clinical Psychology. J. Consult. Clin. Psychol. 2005, 73:136-143.
33. Fidler F., Burgman M.A., Cumming G., Buttrose R., Thomason N. Impact of criticism of null hypothesis significance testing on statistical reporting practices in conservation biology. Conserv. Biol. 2006, 20:1539-1544.
34. Fisher R.A. Statistical Methods and Scientific Inference 1959, Oliver and Boyd, Edinburgh. second ed.
35. French S.F., González-Suárez M., Julie K., Young J.K., Durham S., Gerber L.R. Human disturbance influences reproductive success and growth rate in California sea lions (Zalophus californianus). PLoS One 2011, 6(3):e17686.
36. Galindo-Cortes G., De Anda-Montanez J.A., Arreguín-Sánchez F., Salas S., Balarta E.F. How do environmental factors affect the stock-recruitment relationship? The case of the Pacific sardine (Sardinops sagax) of the northeastern Pacific Ocean. Fish. Res. 2010, 102:173-183.
37. Garrett K.A. Use of statistical tests of equivalence (bioequivalence tests) in plant pathology. Phytopathology 1997, 87:372-374.
38. Gelman A. Why we (usually) don't have to worry about multiple comparisons. CPRC Working Paper No. 09-12 2009, 1-31.
39. Gelman A., Stern H. The difference between 'significant' and 'not significant' is not itself statistically significant. Am. Stat. 2006, 60:328-331.
40. George S.L. Statistics in medical journals: a survey of current policies and proposals for editors. Med. Pediatr. Oncol. 1985, 13:109-112.
41. Germano J.D. Ecology, statistics, and the art of misdiagnosis: the need for a paradigm shift. Environ. Rev. 1999, 7:167-190.
42. Gerrodette T. Inference without significance: measuring support for hypotheses rather than rejecting them. Mar. Ecol. 2011, 32:404-418.
43. Gigerenzer G. Mindless statistics. J. Socio-Econom. 2004, 33:587-606.
44. Gigerenzer G., Krauss S., Vitouch O. The null ritual: what you always wanted to know about significance testing but were afraid to ask. The Sage Handbook of Quantitative Methodology for the Social Sciences, Sage Ltd., Thousand Oaks, CA 2004, 391-408. D. Kaplan (Ed.).
45. Givens G.H., Smith D.D., Tweedie R.L. Publication bias in meta-analysis: a Bayesian data-augmentation approach to account for issues exemplified in the passive smoking debate. Stat. Sci. 1997, 12:221-250.
46. Goodman S.N. Toward evidence-based medical statistics. 1: the P value fallacy. Ann. Intern. Med. 1999, 130:995-1004.
47. Goodman S.N. Of P-values and Bayes: a modest proposal. Epidemiology 2001, 12:295-297.
48. Goodman S.N. A dirty dozen: twelve p-value misconceptions. Semin. Hematol. 2008, 45:135-140.
49. Goodman S.N., Altman D.G., George S.L. Statistical reviewing policies of medical journals: caveat lector?. J. Gen. Intern. Med. 1998, 13:753-756.
50. Gould A.L., Kimmerer W.J. Development, growth, and reproduction of the cyclopoid copepod Limnoithona tetraspina in the upper San Francisco Estuary. Mar. Ecol. Prog. Ser. 2010, 412:163-177.
51. Green R.H. Sampling Design and Statistical Methods for Environmental Biologists 1979, Wiley, Chichester.
52. Green R.H. Power analysis and practical strategies for environmental monitoring. Environ. Res. 1989, 50:195-205.
53. Greenland S. Randomization, statistics, and causal inference. Epidemiology 1990, 1:421-429.
54. Greenland S., Robins J.M. Empirical-Bayes adjustments for multiple comparisons are sometimes useful. Epidemiology 1991, 2:244-251.
55. Griffiths S.P., Fry G.C., Manson F.J., Lou D.C. Age and growth of longtail tuna (Thunnus tonggol) in tropical and temperate waters of the central Indo-Pacific. ICES J. Mar. Sci. 2010, 67:125-134.
56. Hall S.A., Wilcox A.J. The fate of epidemiologic manuscripts: a study of papers submitted to Epidemiology. Epidemiology 2007, 18:262-265.
57. Hanley J.A. Confidence limits vs power calculations. Epidemiology 2004, 5:264-266.
58. Harry A.V., Macbeth W.G., Gutteridge A.N., Simpfendorfer C.A. The life histories of endangered hammerhead sharks (Carcharhiniformes, Sphyrnidae) from the east coast of Australia. J. Fish Biol. 2011, 78:2026-2051.
59. Hoover K.D., Siegler M.V. The rhetoric of 'signifying nothing': a rejoinder to Ziliak and McCloskey. J. Econ. Methodol. 2008, 15:57-68.
60. Houle T.B., Penzien D.B. Statistical reviewing for Headache. Headache 2009, 49:159-161.
61. Hubbard R., Bayarri M.J. Confusion over measures of evidence (p's) versus errors (α's) in classical statistical testing. Am. Stat. 2003, 57:171-182.
62. Hubbard, R., Bayarri, M.J., 2005. Christensen, R. 'Testing Fisher, Neyman, Pearson, and Bayes', in The American Statistician 59: 121-126: comment by Hubbard and Bayarri and response. Am. Stat. 59, 353.
63. Huck S.W. Reading Statistics and Research 2011, Addison Wesley Longman, Boston.
64. Hurlbert S.H. Pseudoreplication and the design of ecological field experiments. Ecol. Monogr. 1984, 54:187-211.
65. Hurlbert S.H., Lombardi C.M. Final collapse of the Neyman-Pearson decision theoretic framework and rise of the neoFisherian. Ann. Zool. Fennici. 2009, 46:311-349.
66. Jiao Y., Cortés E., Andrews K., Guo F. Poor-data and data-poor species stock assessment using a Bayesian hierarchical approach. Ecol. Appl. 2011, 21:2691-2708.
67. Johnson D.H. The insignificance of statistical significance testing. J. Wildl. Manage. 1999, 63:763-772.
68. Katsanevakis S. Modelling fish growth: model selection, multi-model inference and model selection uncertainty. Fish. Res. 2006, 81:229-235.
69. Katsanevakis S., Maravelias C.D. Modelling fish growth: multi-model inference as a better alternative to a priori using von Bertalanffy equation. Fish Fish. 2008, 9:178-187.
70. Katsanevakis S., Thessalou-Legaki M. First record of Alicia mirabilis (Anthozoa: Actiniaria) from the Aegean Sea and density assessment with distance sampling in a site of high abundance. Mar. Biol. Res. 2007, 3:468-472.
71. Katsanevakis S., Thessalou-Legaki M., Karlou-Riga C., Lefkaditou E., Dimitriou E., Verriopoulos G. Information-theory approach to allometric growth of marine organisms. Mar. Biol. 2007, 151:949-959.
72. Katsanevakis S., Xanthopoulos J., Protopapas N., Verriopoulos G. Oxygen consumption of the semi-terrestrial crab Pachygrapsus marmoratus in relation to body mass and temperature: an information theory approach. Mar. Biol. 2007, 151:343-352.
73. Katsanevakis S., Salomidi M., Panou A. Modelling distribution patterns and habitat preference of the invasive green alga Caulerpa racemosa in the Saronikos Gulf (Eastern Mediterranean). Aquat. Biol. 2010, 10:57-67.
74. Katsanevakis S., Zenetos A., Mačić V., Beqiraj S., Poursanidis D., Kashta L. Invading the Adriatic: spatial patterns of marine alien species across the Ionian-Adriatic boundary. Aquat. Biol. 2011, 13:107-118.
75. Katz K.A., Crawford G.H., Lu D.W., Kantor J., Margolis D.J. Statistical reviewing policies in dermatology journals: results of a questionnaire survey of editors. J. Am. Acad. Dermatol. 2004, 51:234-240.
76. Kerr N.K. HARKing: hypothesizing after the results are known. Pers. Soc. Psychol. Rev. 1998, 2:196-217.
77. Kruschke J.K. Bayesian data analysis. Wiley Interdiscip. Rev. Cogn. Sci. 2010, 1:658-676.
78. Kruschke J.K. What to believe: Bayesian methods for data analysis. Trends Cogn. Sci. 2010, 14:293-300.
79. Lang J.M., Rothman K.J., Cann C.L. That confounded P-value. Epidemiology 1998, 9:7-8.
80. Lang J.M., Rothman K.J., Cann C.L. The P-value and P-value function. Epidemiology 1999, 10:345-346.
81. Lin Y.J., Tzeng W.N. Modelling the growth of Japanese eel Anguilla japonica in the lower reach of the Kao-Ping River, southern Taiwan: an information theory approach. J. Fish Biol. 2009, 75:100-112.
82. Mapstone B.D. Scalable decision criteria in environmental impact assessment: effect size, type I, and type II errors. Detecting Ecological Impacts: Concepts and Applications in Coastal Habitats 1995, 67-80. Academic Press, New York. R.J. Schmitt, C.W. Osenberg (Eds.).
83. Martίnez-Abraίn A. Are there any differences? A non-sensical question in ecology. Acta Oecol. 2007, 32:203-206.
84. Mercier L., Panfili J., Paillon C., Ndiaye A., Mouillot D., Darnaude A.M. Otolith reading and multi-model inference for improved estimation of age and growth in the gilthead sea bream Sparus aurata (L.). Estuarine Coastal Shelf Sci. 2011, 92:534-545.
85. Miettinen O.S. Book review: Ziliak S T, McCloskey D N. The cult of statistical significance: how the standard error costs us jobs, justice, and lives. Eur. J. Epidemiol. 2009, 24:111-114.
86. Mikkelson P.M., Bieler R., Kappner I., Rawlings T.A. Phylogeny of Veneroidea (Mollusca: Bivalvia) based on morphology and molecules. Zool. J. Linn. Soc. 2006, 148:439-521.
87. Moore J.W., Semmens B.X. Incorporating uncertainty and prior information into stable isotope mixing models. Ecol. Lett. 2008, 11(470):480.
88. Morrison D.E., Henkel R.E. The Significance Test Controversy - A Reader 1970, Aldine Publishing Co, Chicago.
89. Murray G.D. The task of a statistical referee. Br. J. Surg. 1988, 75:664-667.
90. Nakagawa S., Foster T. The case against retrospective statistical power analyses with an introduction to power analysis. Acta. Ethol. 2004, 7:103-108.
91. Palmer M., Balle S., March D., Alós J., Linde M. Size estimation of circular home range from fish mark-release-(single)-recapture data: case study of a small labrid targeted by recreational fishing. Mar. Ecol. Prog. Ser. 2011, 430:87-97.
92. Pernerger T.V. What's wrong with Bonferroni adjustments. Br. Med. J. 1998, 316:1236-1238.
93. Pernerger T.V., Courvoisier D.S. Interpretation of evidence in data by untrained medical students: a scenario-based study. BMC Med. Res. Methodol. 2010, 10:78.
94. Peterman R. Statistical power analysis can improve fisheries research and management. Can. J. Fish. Aquat. Sci. 1990, 47:2-15.
95. Peterson C.H., McDonald L.L., Green R.H., Erickson W.P. Sampling design begets conclusions: the statistical basis for detection of injury to and recovery of shoreline communities after the 'Exxon Valdez' oil spill. Mar. Ecol. Prog. Ser. 2001, 210:255-283.
96. Poole C. Low P-values or narrow confidence intervals: which are more durable?. Epidemiology 2001, 12:291-294.
97. Punt A.E., Hilborn R. Fisheries stock assessment and decision analysis: the Bayesian approach. Rev. Fish Biol. Fish. 1997, 7:35-63.
98. Rabaoui L., Tlig-Zouari S., Katsanevakis S., Ben Hassine O.K. Comparison of absolute and relative growth patterns among five Pinna nobilis populations along the Tunisian coastline: an information theory approach. Mar. Biol. 2007, 152:537-548.
99. Rabaoui L., Tlig-Zouari S., Katsanevakis S., Belgacem W., Ben Hassine O.K. Differences in absolute and relative growth between two shell forms of Pinna nobilis (Mollusca: Bivalvia) along the Tunisian coastline. J. Sea Res. 2011, 66:95-103.
100. Rosenthal R. The "File Drawer Problem" and the tolerance for null results. Psychol. Bull. 1979, 86:638-641.
101. Rothman K.J. No adjustments are needed for multiple comparisons. Epidemiology 1990, 1:43-46.
102. Rothman K.J. Statistics in nonrandomized studies. Epidemiology 1990, 1:417-418.
103. Royall R. Statistical Evidence - A Likelihood Paradigm 1997, Champan & Hall, London.
104. Sarewitz D. Beware the creeping cracks of bias. Nature 2012, 485:149.
105. Sellke T., Bayarri M.J., Berger J.O. Calibration of P-values for testing precise null hypotheses. Am. Stat. 2001, 55:62-71.
106. Silva-Ayçaguer L.C., Suárez-Gil P., Fernández-Somoano A. The null hypothesis significance test in health sciences research (1995-2006): statistical analysis and interpretation. BMC Med. Res. Methodol. 2010, 10:1-9.
107. Smith A.H., Bates M.N. Confidence limit analyses should replace power calculations in the interpretation of epidemiologic studies. Epidemiology 1992, 3:449-452.
108. Song F., Parekh S., Hooper L., Loke Y.K., Ryder J., Sutton A.J., Hing C., Kwok C.S., Pang C., Harvey I. Dissemination and publication of research findings: an updated review of related biases. Health Technol. Assess. 2010, 14:1-236.
109. Spanos A. Review of S. T. Ziliak and D. N. McCloskey's, The cult of statistical significance. Eras. J. Phil. Econ. 2008, 1:154-164.
110. Stang A., Poole C., Kuss O. The ongoing tyranny of statistical significance testing in biomedical research. Eur. J. Epidemiol. 2010, 25:225-230.
111. Stefano J.D., Fidler F., Cumming G. Effect size estimates and confidence intervals: an alternative focus for the presentation and interpretation of ecological data. New Trends in Ecology Research 2005, 71-102. Nova Science Publishers, New York. A.R. Burke (Ed.).
112. Stephens P.A., Buskirk S.W., Hayward G.D., Del Rio C.M. Information theory and hypothesis testing: a call for pluralism. J. Appl. Ecol. 2005, 42:4-12.
113. Stephens P.A., Buskirk S.W., Hayward G.D., Del Rio C.M. Inference in ecology and evolution. Trends Ecol. Evol. 2007, 22:192-197.
114. Sterne J.A.C., Smith G.D. Br. Med. J. 2001, 322:226-231.
115. Stewart-Oaten A. Rules and judgments in statistics: three examples. Ecology 1995, 76:2001-2009.
116. Stoner, D.C., 2011. Ecology and conservation of cougars in the Eastern Great Basin: effects of urbanization, habitat fragmentation, and exploitation. All Graduate Theses and Dissertations. Paper 989. http://digitalcommons.usu.edu/etd/989.
117. Strasak A.M., Zaman Q., Pfeiffer K.P., Göbel G., Ulmer H. Statistical errors in medical research - a review of common pitfalls. Swiss Med. Wkly. 2007, 137:44-49.
118. Streiner D.L. Sample size and power in psychiatric research. Can. J. Psychiatry 1990, 35:616-620.
119. Sullivan K.M., Foster D.A. Use of the confidence interval function. Epidemiology 1990, 1:39-42.
120. Twain M. Chapters from my autobiography. 1996, The Oxford Mark Twain 1907, Oxford University Press. S.F. Fishkin (Ed.).
121. Underwood A.J. Experiments in Ecology: Their Logical Design and Interpretation Using Analysis of Variance 1997, Cambridge Univ. Press, Cambridge.
122. Underwood A.J., Chapman M.G. Power, precaution, type II error and sampling design in assessment of environmental impacts. J. Exp. Mar. Biol. Ecol. 2003, 296:49-70.
123. Vasilakopoulos P., O'Neill F.G., Marshall C.T. Misspent youth: does catching immature fish affect fisheries sustainability?. ICES J Mar. Sci. 2011, 68:1525-1534.
124. Wellek S. Testing Statistical Hypotheses of Equivalence and Noninferiority 2010, Chapman & Hall/CRC, Boca Raton. second ed.
125. Wolfe R., Hanley J. If we're so different, why do we keep overlapping? When 1 plus 1 doesn't make 2. Can. Med. Assoc. J. 2002, 166:65-66.
126. Yoccoz N.G. Use, overuse, and misuse of significance tests in evolutionary biology and ecology. Bull. Ecol. Soc. Am. 1991, 72:106-111.
127. Yokoyama L.Q., Amaral A.C.Z. Allometric growth of a common Nassariidae (Gastropoda) in south-east Brazil. J. Mar. Biol. Ass. UK 2011, 91:1095-1105.
128. Ziliak S.T. Matrixx v. Siracusano and Student v. Fisher: statistical significance on trial. Significance 2011, 8:131-134.
129. Ziliak S.T., McCloskey D.N. The Cult of Statistical Significance: How the Standard Error Costs us Jobs, Justice, and Lives 2008, University of Michigan Press, Ann Arbor.
130. Ziliak S.T., McCloskey D.N. Science is judgment, not only calculation: a reply to Aris Spanos's review of 'The cult of statistical significance'. Eras. J. Phil. Econ. 2008, 1:165-170.