Size of Treatment Effects and Their Importance to Clinical Research and Practice

Biological Psychiatry

Volumn 59, Issue 11, 2006, Pages 990-996

  Kraemer, Helena Chmura ^a   Kupfer, David J ^b  

^a STANFORD UNIVERSITY   (United States)

^b UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

confidence intervals; Effect size; hypothesis testing; meta analysis; power; significance

Indexed keywords

AREA UNDER THE CURVE; CONFIDENCE INTERVAL; DATA ANALYSIS; INFORMATION PROCESSING; MEDICAL RESEARCH; METHODOLOGY; PRIORITY JOURNAL; RANDOMIZATION; REVIEW; RISK; RISK ASSESSMENT; SAMPLING; STATISTICAL SIGNIFICANCE; TREATMENT OUTCOME;

AREA UNDER CURVE; BIOMEDICAL RESEARCH; CONFIDENCE INTERVALS; DATA INTERPRETATION, STATISTICAL; HUMANS; META-ANALYSIS; ODDS RATIO; RANDOMIZED CONTROLLED TRIALS; RESEARCH DESIGN; SAMPLE SIZE;

EID: 33744907008     PISSN: 00063223     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.biopsych.2005.09.014     Document Type: Review

References (45)

1. Acion L, Peterson JJ, Temple S, Anrndt S (in press): Probabilistic index: an intuitive non-parametric approach to measuring the size of treatment effects. Stat Med.
2. Altman D.G., and Andersen K. Calculating the number needed to treat for trials where the outcome is time to an event. Br Med J 319 (1999) 1492-1495
3. Borenstein M. The case for confidence intervals in controlled clinical trials. Control Clin Trials 15 (1994) 411-428
4. Borenstein M. Hypothesis testing and effect size estimation in clinical trials. Ann Allergy Asthma Immunol 78 (1997) 5-16
5. Borenstein M. The shift from significance testing to effect size estimation. In: Bellak A.S., and Hersen M. (Eds). Research and Methods, Comprehensive Clinical Psychology volume 3 (1998), Elsevier Science, Burlington, Maryland 319-349
6. Cliff N. Dominance statistics. Ordinal analyses to answer ordinal questions. Psychol Bull 114 (1993) 494-509
7. Cohen J. The cost of dichotomization. Appl Psychol Measurement 7 (1983) 249-253
8. Cohen J. Statistical Power Analysis for the Behavioral Sciences (1988), Lawrence Erlbaum Associates, Hillsdale, New Jersey
9. Cohen J. The earth is round (p<.05). Am Psychol 49 (1995) 997-1003
10. Cook R.J., and Sackett D.L. The number needed to treat. A clinically useful measure of treatment effect. Br Med J 310 (1995) 452-454
11. Cooper H., and Hedges L.V. The Handbook of Research Synthesis (1994), Russell Sage Foundation, New York
12. Cooper H.M., and Rosenthal R. Statistical versus traditional procedures for summarizing research. Psychol Bull 87 (1980) 442-449
13. Cornfield J. A method of estimating comparative rates from clinical data. Applications to cancer of the lung, breast and cervix. J Natl Cancer Inst 11 (1951) 1269-1275
14. Cornfield J. A statistical problem arising from retrospective studies. In: Neyman J. (Ed). Proceedings of the Third Berkeley Symposium volume IV (1956), University of California Press, Berekely, California 135
15. Dar R., Serlin R.C., and Omer H. Misuse of statistical tests in three decades of psychotherapy research. J Consult Clin Res 62 (1994) 75-82
16. Efron B., and Gong G. A leisurely look at the bootstrap, the jackknife, and cross-validation. Am Statistician 37 (1983) 36-48
17. Efron B., and Tibshirani R. Computer-Intensive Statistical Methods (Technical Report 174) (1995), Division of Biostatistics, Stanford University, Stanford, California
18. Fleiss J.L. On the asserted invariance of the odds ratio. Br J Prev Soc Med 24 (1970) 45-46
19. Grissom R.J., and Kim J.J. Effect Sizes for Research (2005), Lawrence Erlbaum Associates, Mahwah, New Jersey
20. Hedges L.V., and Olkin I. Statistical Methods for Meta-Analysis (1985), Academic Press, Orlando
21. Hsu L.M. Biases of success rate differences shown in binomial effect size displays. Psychol Bull 9 (2004) 183-197
22. Hunter J.E. Needed. A ban on the significance test. Psychol Sci 8 (1997) 3-7
23. Jacobson N.S., and Truax P. Clinical significance. A statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 59 (1991) 12-19
24. Kraemer H.C. Reporting the size of effects in research studies to facilitate assessment of practical or clinical significance. Psychoneuroendocrinology 17 (1993) 527-536
25. Kraemer H.C. Reconsidering the odds ratio as a measure of 2×2 association in a population. Stat Med 23 (2003) 257-270
26. equivalent. Psychol Methods.
27. Kraemer H.C., Kazdin A.E., Offord D.R., Kessler R.C., Jensen P.S., and Kupfer D.J. Measuring the potency of a risk factor for clinical or policy significance. Psychol Methods 4 (1999) 257-271
28. Kraemer H.C., Lowe K.K., and Kupfer D.J. To Your Health. How to Understand What Research Tells Us About Risk (2005), Oxford University Press, Oxford, United Kingdom
29. Kraemer H.C., and O'Hara R. Categorical versus dimensional approaches to diagnosis. Methodological challenges. J Psychiatr Res 38 (2004) 17-25
30. Kraemer H.C., and Thiemann S. How Many Subjects? Statistical Power Analysis in Research (1987), Sage Publications, Newbury Park, California
31. Kraemer H.C., Wilson G.T., Fairburn C.G., and Agras W.S. Mediators and moderators of treatment effects in randomized clinical trials. Arch Gen Psychiatry 59 (2002) 877-883
32. Krantz D.H. The null hypothesis testing controversy in psychology. J Am Stat Assoc 44 (1999) 1372-1381
33. Levine M., and Ensome M. Post hoc power analysis. An idea whose time has passed?. Pharmacotherapy 21 (2001) 405-409
34. MacCallum R.C., Zhang S., Preacher K.J., and Rucker D.D. On the practice of dichotomization of quantitative variables. Psychol Methods 7 (2002) 19-40
35. McGraw K.O., and Wong S.P. A common language effect size statistic. Psychol Bull 111 (1992) 361k-365k
36. Nickerson R.S. Null hypothesis significance testing. A review of an old and continuing controversy. Psychol Methods 5 (2000) 241-301
37. Rosenthal R. Parametric measures of effect size. In: Cooper H., and Hedges L.V. (Eds). The Handbook of Research Synthesis (1994), Russell Sage Foundation, New York 231-244
38. Rosenthal R., Rosnow R.L., and Rubin D.B. Contrasts and Effect Sizes in Behavioral Research (2000), Cambridge University Press, Cambridge, United Kingdom
39. equivalent. A simple effect size indicator. Psychol Methods 8 (2003) 492-496
40. Sackett D.L. Down with the odds ratio!. Evidence Based Med 1 (1996) 164-166
41. Shrout P.E. Should significance tests be banned? Introduction to a special section exploring the pros and cons. Psychol Sci 8 (1997) 1-2
42. Thompson B. Journal editorial policies regarding statistical significance tests. Heat is to fire as p is to importance. Educ Psychol Rev 11 (1999) 157-169
43. Tukey J.W. Tightening the clinical trial. Nonrelevancy of power calculations after the fact (Appendix 1). Control Clin Trials 14 (1993) 266-285
44. Veiel H.O.F. Base-rates, cut-points, and interaction effects. The problem with dichotomized continuous variables. Psychol Med 18 (1988) 703-710
45. Wilkinson L. Statistical methods in psychology journals. Guidelines and explanations. Am Psychol 54 (1999) 594-604