The Unreasonable Ineffectiveness of Fisherian “Tests” in Biology, and Especially in Medicine

Biological Theory

Volumn 4, Issue 1, 2009, Pages 44-53

  McCloskey, Deirdre N ^a   Ziliak, Stephen T ^b  

^a UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^b ROOSEVELT UNIVERSITY   (United States)

Author keywords

Bayesian analysis in medicine; biometrics; Fisher; Gosset; Jeffreys; level of p; levels of t; Rothman; statistical power in medical research; statistical significance; tests of significance

Indexed keywords

EID: 84865119333     PISSN: 15555542     EISSN: 15555550     Source Type: Journal    
DOI: 10.1162/biot.2009.4.1.44     Document Type: Article

References (33)

1. Altaian DG (1991) Statistics in medical journals: Developments in the 1980s. Statistics in Medicine 10: 1897–1913. DOI: 10.1002/sim.4780101206
2. American Psychological Association (APA) 1952 to 2001 [revisions] Publication Manual of the American Psychological Association. Washington, DC: APA.
3. Berger JO (2003) Could Fisher, Jeffreys, and Neyman have agreed on testing? Statistical Science 18: 1–32. DOI: 10.1214/ss/1056397485
4. Cohen J (1994) The earth is round (p < 0.05). American Psychologist 49: 997–1003. DOI: 10.1037/0003-066X.49.12.997
5. David FN, ed (1966) Research Papers in Statistics: Festschrift for J. Neyman. London: Wiley.
6. Eisenberger MA, Blumenstein BA, Crawford ED, Miller G, McLeod DG, Loehrer PJ, Wilding G, Sears K, Culkin DJ, Thompson IM, Bueschen AJ, Lowe BA (1998) Bilateral orchiectomy with or without flutamide for metastatic prostate cancer. New England Journal of Medicine 339: 1036–1042. DOI: 10.1056/NEJM199810083391504
7. Fidler F (2002) The fifth edition of the APA Publication Manual: Why its statistics recommendations are so controversial. Educational and Psychological Measurement 62: 749–770. DOI: 10.1177/001316402236876
8. Fidler F, Thomason N, Cumming G, Finch S, Leeman J (2004) Editors can lead researchers to confidence intervals but they can’t make them think: Statistical reform lessons from medicine. Psychological Science 15: 119–126. DOI: 10.1111/j.0963-7214.2004.01502008.x
9. Fisher RA (1922) On the mathematical foundations of theoretical statistics. Philosophical Transactions of the Royal Society A 222: 309–368. DOI: 10.1098/rsta.1922.0009
10. Fisher RA (1926) Bayes’ Theorem. Eugenics Review 18: 32–33.
11. Fisher RA ([1956] 1959) Statistical Methods and Scientific Inference, 2nd ed. New York: Hafner.
12. Fleiss JL (1986) Significance tests do have a role in epidemiological research: Reaction to AA Walker. American Journal of Public Health 76: 559–600. DOI: 10.2105/AJPH.76.5.559
13. Freiman JA, Chalmers T, Smith H, Kuebler RR (1978) The importance of beta, the type II error and sample design in the design and interpretation of the randomized control trial: Survey of 71 negative trials. New England Journal of Medicine 299: 690–694. DOI: 10.1056/NEJM197809282991304
14. Goodman S (1999a) Toward evidence-based medical statistics. 1: The p-value fallacy. Annals of Internal Medicine 130: 995–1004. DOI: 10.7326/0003-4819-130-12-199906150-00008
15. Hoover K, Siegler M (2008) Sound and fury: McCloskey and significance testing in economics. Journal of Economic Methodology 15: 1–37. DOI: 10.1080/13501780801913298
16. International Committee of Medical Journal Editors (ICMJE) (1988) Uniform requirements for … statisticians and biomedical journal editors. Statistics in Medicine 7: 1003–1011. DOI: 10.1002/sim.4780071002
17. Jeffreys H (1963) Review of L. J. Savage, et al., The Foundations of Statistical Inference (Methuen, London and Wiley, New York, 1962). Technometrics 5: 407–410.
18. Klein H, Elifson KW, Sterk CE (2003) Perceived temptation to use drugs and actual drug use among women. Journal of Drug Issues 33: 161–192. DOI: 10.1177/002204260303300312
19. Lang JM, Rothman KJ, Cann CI (1998) That confounded p-value. Epidemiology 9: 7–8. DOI: 10.1097/00001648-199801000-00004
20. Pearson ES (1990) [posthumously published by Plackett RL, Barnard GA, eds] ‘Student’: A Statistical Biography of William Sealy Gosset. Oxford: Clarendon Press.
21. Rennie D (1978) Vive la Difference (p < 0.05). New England Journal of Medicine 299: 828–829. DOI: 10.1056/NEJM197810122991509
22. Rossi J (1990) Statistical power of psychological research: What have we gained in 20 years? Journal of Consulting and Clinical Psychology 58: 646–656. DOI: 10.1037/0022-006X.58.5.646
23. Rothman KJ (1978) A show of confidence. New England Journal of Medicine 299: 1362–1363. DOI: 10.1056/NEJM197812142992410
24. Rothman KJ (1986) Modern Epidemiology. New York: Little, Brown.
25. Rothman KJ (1990) Writing for epidemiology. Epidemiology 9: 333–337. DOI: 10.1097/00001648-199805000-00019
26. Rothman KJ, Johnson ES, Sugano DS (1999) Is flutamide effective in patients with bilateral orchiectomy? Lancet 353: 1184. DOI: 10.1016/S0140-6736(05)74403-2
27. Savitz DA, Tolo K, Poole C (1994) Statistical significance testing in the American Journal of Epidemiology, 1970–1990. American Journal of Epidemiology 139: 1047–1052.
28. Shyrock RH (1961) The history of quantification in medical science. Isis 52: 215–237. DOI: 10.1086/349470
29. Sterne JAC, Davey Smith G (2001) Sifting the evidence—What’s wrong with significance tests? British Medical Journal 322: 226–231. DOI: 10.1136/bmj.322.7280.226
30. Zabell S (1989) R. A. Fisher on the history of inverse probability. Statistical Science 4: 247–263. DOI: 10.1214/ss/1177012488
31. Zellner A (1984) Basic Issues in Econometrics. Chicago: University of Chicago Press.
32. Ziliak ST, Hannon J (2006) Public assistance: Colonial times to the 1920s. In Historical Statistics of the United States. (Carter SB, Gartner SS, Haines MR, Olmstead AL, Sutch R, Wright G, eds). New York: Cambridge University Press.
33. Ziliak ST, McCloskey DN (2008) The Cult of Statistical Significance: How the Standard Error Costs Us Jobs, Justice, and Lives. Ann Arbor, MI: University of Michigan Press.