The abuse of power: The pervasive fallacy of power calculations for data analysis

American Statistician

Volumn 55, Issue 1, 2001, Pages 19-24

  Hoenig, John M ^a   Heisey, Dennis M ^b  

^a VIRGINIA INSTITUTE OF MARINE SCIENCE   (United States)

^b UNIVERSITY OF WISCONSIN SCHOOL OF MEDICINE AND PUBLIC HEALTH   (United States)

Author keywords

Bioequivalence testing; Burden of proof; Observed power; Retrospective power analysis; Statistical power; Type II error

Indexed keywords

EID: 0035644173     PISSN: 00031305     EISSN: None     Source Type: Journal    
DOI: 10.1198/000313001300339897     Document Type: Article

References (41)

1. Anon. (1995), "Journal News," Journal of Wildlife Management, 59, 196-199.
2. _ (1998), "Instructions to Authors," Animal Behavior, 55, i-viii.
3. Berger, R. L., and Hsu, J. C. (1996), "Bioequivalence Trials. Intersection-Union Tests and Equivalence Confidence Sets," Statistical Science, 11, 283-319.
4. Berry, D. A. (1993). "A Case for Bayesianism in Clinical Trials," Statistics in Medicine, 12, 1377-1393.
5. Cohen, J. (1988), Statistical Power Analysis for the Behavioral Sciences (2nd ed.), Hillsdale, NJ: Lawrence Erlbaum Associates.
6. Daly, J. A., and Hexamer, A. (1983), "Statistical Power in Research in English Education," Research in the Teaching of English, 17, 157-164.
7. Dayton, P. K. (1998), "Reversal of the Burden of Proof in Fisheries Management," Science, 279, 821-822.
8. Fagley, N. S. (1985), "Applied Statistical Power Analysis and the Interpretation of Nonsignificant Results by Research Consumers," Journal of Counseling Psychology, 32, 391-396.
9. Fairweather, P. G. (1991), "Statistical Power and Design Requirements for Environmental Monitoring," Australian Journal of Marine and Freshwater Research, 42, 555-567.
10. Freeman, P. R. (1993), "The Role of P values in Analysing Trial Results," Statistics in Medicine, 12, 1443-1452.
11. Gerard, P. D., Smith, D. R., and Weerakkody, G. (1998), "Limits of Retrospective Power Analysis," Journal of Wildlife Management, 62, 801-807.
12. Goodman, S. N. (1999a), "Toward Evidence-Based Medical Statistics. 1: The P Value Fallacy," Annals of Internal Medicine, 130, 995-1004.
13. _ (1999b). "Toward Evidence-Based Medical Statistics 2: The Bayes Factor," Annals of Internal Medicine, 130, 1005-1013.
14. Goodman, S. N., and Berlin, J. A. (1994), "The Use of Predicted Confidence Intervals When Planning Experiments and the Misuse of Power When Interpreting Results," Annals of Internal Medicine, 121, 200-206.
15. Hallahan, M., and Rosenthal, R. (1996), "Statistical Power: Concepts, Procedures, and Applications," Behavioral Research Therapy, 34, 489-499.
16. Hayes, J. P., and Steidl, R. J. (1997), "Statistical Power Analysis and Amphibian Population Trends," Conservation Biology, 11, 273-275.
17. Hauck, W. W., and Anderson, S. (1996), Comment on "Bioequivalence Trials, Intersection-Union Tests and Equivalence Confidence Sets," Statistical Science, 11, 303-304.
18. Hodges, D. C., and Schell, L. M. (1988), "Power Analysis in Biological Anthropology," American Journal of Physical Anthropology, 77, 175-181.
19. Hung, H. M. J., O'Neill, R. T., Bauer, P., and Kohne, K. (1997), "The Behavior of the P Value When the Alternative Hypothesis is True," Biometrics, 53, 11-22.
20. Markel, M. D. (1991), "The Power of a Statistical Test - What Does Insignificance Mean?," Veterinary Surgery, 20, 209-214.
21. McAweeney, M. J., Forchheimer, M., and Tate, D. G. (1997), "Improving Outcome Research in Rehabilitation Psychology: Some Methodological Recommendations," Rehabilitation Psychology, 42, 125-135.
22. Muller, K. E., and Benignus, V. A. (1992), "Increasing Scientific Power With Statistical Power," Neurotoxicology and Teratology, 14, 211-219.
23. Peterman, R. (1989), "Application of Statistical Power Analysis to the Oregon Coho Salmon (Oncorhynchus kisutch) Problem," Canadian Journal of Fisheries and Aquatic Sciences, 46, 1183.
24. _ (1990a), "Statistical Power Analysis Can Improve Fisheries Research and Management," Canadian Journal of Fisheries and Aquatic Sciences, 47, 2-15.
25. _ (1990b), "The Importance of Reporting Statistical Power: the Forest Decline and Acidic Deposition Example," Ecology, 71, 2024-2027.
26. Peterman, R., and M'Gonigle, M. (1992), "Statistical Power Analysis and the Precautionary Principle," Marine Pollution Bulletin, 24, 231-234.
27. Reed, J. M., and Blaustein, A. R. (1995), "Assessment of 'Nondeclining' Amphibian Populations Using Power Analysis," Conservation Biology, 9, 1299-1300.
28. _ (1997), "Biologically Significant Population Declines and Statistical Power," Conservation Biology, 11, 281-282.
29. Rosner, B. (1990). Fundamentals of Biostatistics (3rd ed.), Boston: PWS-Kent Publishing.
30. Rotenberry, J. T., and Wiens, J. A. (1985), "Statistical Power Analysis and Community-Wide Patterns," American Naturalist, 125, 164-168.
31. Schervish, M. J. (1996), "P Values: What They Are and What They Are Not," Journal of the American Statistical Association, 50, 203-206.
32. Schuirmann, D. J. (1987), "A Comparison of the Two One-sided Tests Procedure and the Power Approach for Assessing the Equivalence of Bioavailability," Journal of Pharmacokinetics and Biopharmaceutics, 15, 657-680.
33. Searcy-Bernal, R. (1994), "Statistical Power and Aquacultural Research," Aquaculture, 127, 371-388.
34. Smith, A. D., and Kuhnhenn, G. L. (1983), "A Statistical Note on Power Analysis as Applied to Hypothesis Testing Among Selected Petrographic Point-Count Data," The Compass of Sigma Gamma Epsilon, 61, 22-30.
35. Steidl, R. J., Hayes, J. P., and Schauber, E. (1997), "Statistical Power Analysis in Wildlife Research," Journal of Wildlife Management, 61, 270-279.
36. Thomas, L. (1997), "Retrospective Power Analysis," Conservation Biology, 11, 276-280.
37. Thomas, L., and Juanes, F. (1996), "The Importance of Statistical Power Analysis: An Example from Animal Behaviour," Animal Behavior, 52, 856-859.
38. Thomas, L., and Krebs, C. J. (1997), "A Review of Statistical Power Analysis Software," Bulletin of the Ecological Society of America, 78, 126-139.
39. Toft, C. A., and Shea, P. J. (1983), "Detecting Community-wide Patterns: Estimating Power Strengthens Statistical Inference," American Naturalist, 122, 618-625.
40. Winer, B. J., Brown, D. R., and Michels, K. M. (1991). Statistical Principles in Experimental Design (3rd ed.), New York: McGraw-Hill.
41. Zar, J. H. (1996), Biostatistical Analysis (3rd ed.), Upper Saddle River, NJ: Prentice Hall.