A small p-value from an observed data is not evidence of adequate power for future similar-sized studies: A cautionary note

Contemporary Clinical Trials

Volumn 30, Issue 2, 2009, Pages 155-157

  Atenafu, Eshetu G ^a,b   Hamid, Jemila S ^a   Stephens, Derek ^a,b   To, Teresa ^a,b   Beyene, Joseph ^a,b  

^a HOSPITAL FOR SICK CHILDREN   (Canada)

^b UNIVERSITY OF TORONTO   (Canada)

Author keywords

Bootstrap; Effect size; Power; Re sampling; Sample size

Indexed keywords

ARTICLE; BOOTSTRAPPING; CALCULATION; COMPARATIVE STUDY; DATA ANALYSIS; OUTCOME ASSESSMENT; OUTCOME VARIABLE; RANDOM SAMPLE; SAMPLE SIZE; STATISTICAL SIGNIFICANCE; STATISTICS; CHI SQUARE DISTRIBUTION; CLINICAL TRIAL (TOPIC); HUMAN; METHODOLOGY; PILOT STUDY; STANDARDS; STATISTICS AND NUMERICAL DATA; TIME;

CHI-SQUARE DISTRIBUTION; CLINICAL TRIALS AS TOPIC; HUMANS; PILOT PROJECTS; RESEARCH DESIGN; SAMPLE SIZE; TIME FACTORS;

EID: 60249097348     PISSN: 15517144     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cct.2008.11.005     Document Type: Article

References (18)

1. Archibald C.P., and Lee H.P. Sample size estimation for clinicians. Ann Acad Med Singap 24 (1995) 328-332
2. Lachin J.M. Introduction to sample size determination and power analysis for clinical trials. Control Clin Trials 2 (1981) 93-113
3. Lerman J. Study design in clinical research: sample size estimation and power analysis. Can J Anaesth 1996;43:184-191. Review. Erratum in: Can J Anaesth 1996;43:880.
4. Moineddin R., Matheson F.I., and Glazier R.H. Simulation study of sample size for multilevel logistic regression models. BMC Med Res Method 7 (2007) 34
5. NCSS Statistical Software. PASS 2005. Available at: www.ncss.com/pass.html. Accessed August 3, 2003.
6. Statistical Solutions. nQuery Advisor. Available at: www.statsolusa.com/nquery/nquery.htm. Accessed August 3, 2008.
7. Lenth R. Java applets for power and sample size (August 3, 2008). http://www.cs.uiowa.edu/~rlenth/Power/ Available at: http://www.cs.uiowa.edu/~rlenth/Power/. Accessed
8. Sterne J.A., and Davey Smith G. Sifting the evidence-what's wrong with significance tests?. BMJ 322 (2001) 226-231
9. Goodman S. Commentary: the p-value, devalued. Int J Epidemiol 32 (2003) 699-702
10. Hoenig J.M., and Heisey D.M. The abuse of power: the pervasive fallacy of power calculations for data analysis. Am Stat 55 (2001) 19-24
11. Thomas L. Retrospective power analysis. Conserv Biol 11 (1997) 276-280
12. Zumbo B.D., and Hubley A.M. A note on misconceptions concerning prospective and retrospective power. Statistician 47 (1998) 385-388
13. Thomas L., and Krebs C.J. A review of statistical power analysis software. Bull Ecol Soc Am 78 (1997) 126-139
14. Reed J.M., and Blaustein A.R. Assessment of 'nondeclining' amphibian populations using power analysis. Conserv Biol 9 (1995) 1299-1300
15. Davison A.C., and Hinkley D. Bootstrap methods and their applications. Cambridge: Cambridge Series in Statistical and Probabilistic Mathematics (1997)
16. Modarres R. Bootstrap power of the generalized correlation coefficient. Stat Comput 6 (1996) 139-145
17. Birkett M.A., and Day S.J. Internal pilot studies for estimating sample size. Stats Med 13 23/24 (1994) 2455-2463
18. Kraemer H.C., Mintz J., Noda A., Tinklenberg J., and Yesavage J.A. Caution regarding the use of pilot studies to guide power calculations for study proposals. Arch Gen Psychiatry 63 5 (2006) 484-489