"What exactly are you inferring?" A closer look at hypothesis testing

Environmental Toxicology and Chemistry

Volumn 27, Issue 5, 2008, Pages 1013-1019

  Newman, Michael C ^a  

^a VIRGINIA INSTITUTE OF MARINE SCIENCE   (United States)

Author keywords

Confidence intervals; Experimental design; Power; Statistical significance

Indexed keywords

DECISION MAKING; ENVIRONMENTAL IMPACT; ERROR ANALYSIS; REGULATORY COMPLIANCE;

CONFIDENCE INTERVALS; STATISTICAL SIGNIFICANCE; STATISTICAL TESTING;

TOXICITY;

CHEMISTRY; ECOTOXICOLOGY; ERROR ANALYSIS; EXPERIMENTAL STUDY; HYPOTHESIS TESTING; LITERATURE REVIEW; REGULATORY APPROACH;

BAYES THEOREM; CONSERVATION BIOLOGY; ECOTOXICITY; PRIORITY JOURNAL; REVIEW; STATISTICAL ANALYSIS; STATISTICAL MODEL; THEORETICAL STUDY;

MODELS, THEORETICAL;

EID: 43649101442     PISSN: 07307268     EISSN: None     Source Type: Journal    
DOI: 10.1897/07-373.1     Document Type: Review

References (30)

1. Woodworth GG. 2004. Biostatistics. A Bavesian Introduction. John Wiley, Hoboken, NJ, USA.
2. Goodman SN. 1993. P values, hypothesis tests, and likelihood: Implications for epidemiology of a neglected historical debate. Am J Epidemiol 137:485-496.
3. Sterne JAC, Davey Smith G. 2001. Sifting the evidence - What's wrong with significance tests? BMJ 322:226-230.
4. Wacholder S, Chanock S, Garcia-Closas M, El Ghormli L, Rothman N. 2004. Assessing the probability that a positive report is false: An approach for molecular epidemiology studies. J Natl Cancer Inst 96:434-442.
5. Ioannidis JPA. 2005. Why most published research findings are false. Public Library of Science Medicine 2:e124-e126.
6. Ioannidis JPA, Trikalinos TA. 2005. Early extreme contradictory estimates may appear in published research: The Proteus phenomenon in molecular genetics research and randomized trials. J Clin Epidemiol 58:543-549.
7. Altman M. 2004. Statistical significance, path dependency, and the culture of journal publication. The Journal of Socio-Economics 33:651-663.
8. McCloskey DN. 1995. The insignificance of statistical significance. Am Sci 272:32-33.
9. Ziliak ST, McCloskey DN. 2004. Significance redux. The Journal of Socio-Economics 33:665-675.
10. Cohen J. 1994. The earth is round (p < .05). Am Psychol 49: 997-1003.
11. Cohen J. 1995. The earth is round (p < .05): Rejoinder. Am Psychol 50:1104.
12. Fidler F, Cumming G, Burgman M, Thomason N. 2004. Statistical reform in medicine, psychology, and ecology. The Journal of Socio-Economics 33:615-630.
13. Fidler F, Burgman MA, Cumming G, Buttrose R, Thomason N. 2006. Impact of criticism of null-hypothesis significance testing on statistical reporting practices in conservation biology. Conserv Biol 20:1539-1544.
14. Hoenig JM, Heisey DM. 2001. The abuse of power: The pervasive fallacy of power calculations for data analysis. The American Statistician 55:1-6.
15. Crane M, Newman MC. 2000. What level of effect is a no observed effect? Environ Toxicol Chem 19:516-519.
16. Gigerenzer G. 2004. Mindless statistics. The Journal of Socio-Economics 33:587-606.
17. Fidler F, Thomason N, Cumming G, Finch S, Leeman J. 2004. Editors can lead researchers to confidence intervals, but can't make them think. Psychological Science 15:119-126.
18. Howson C, Urbach P. 1989. Scientific Reasoning. The Bayesian Approach. Open Court, La Salle, IL, USA.
19. Hacking I. 2001. An Introduction to Probability and Inductive Logic. Cambridge University Press, Cambridge, UK.
20. Pedhazur EJ, Pedhazur Schmelkin L. 1991. Measurement, Design, and Analysis. An Integrated Approach. Lawrence Erlbaum Associates, Hillsdale, NJ, USA.
21. Gelman A, Carlin JB, Stern HS, Rubin DB. 1997. Bayesian Data Analysis. Chapman & Hall/CRC, Boca Raton, FL, USA.
22. Nakagawa S. 2004. A farewell to Bonferroni: The problems of low statistical power and publication bias. Behav Ecol 15:1044-1045.
23. Cohen J. 1988. Statistical Power Analysis for the Behavioral Sciences, 2nd ed. Lawrence Erlbaum Associates, Mahwah, NJ, USA.
24. Van der Hoeven N. 1998. Power analysis for the NOEC: What is the probability of detecting small toxic effects on three different species using the appropriate standardized test protocols? Ecotoxicology 7:355-361.
25. Cumming G, Finch S. 2005. Inference by eye. Am Psychol 60: 170-180.
26. Di Stefano J. 2004. A confidence interval approach to data analysis. For Ecol Manag 187:173-183.
27. Altman D, Machin D, Bryant TN, Gardner MJ. 2000. Statistics with Confidence: Confidence Intervals and Statistical Guidelines, 2nd ed. British Medical Journal Books, London, UK.
28. SAS Institute. 2003. SAS Statistical Package, Ver 9.1. Cary, NC, USA.
29. Kraufvelin P. 1998. Model ecosystem replicability challenged by the "soft" reality of a hard bottom mesocosm. J Exp Mar Biol Ecol 222:247-267.
30. Rizak SN, Hrudey SE. 2006. Misinterpretation of drinking water-quality monitoring data with implications for risk management. Environ Sci Technol 40:5244-5250.