A practitioner's guide to developing critical appraisal skills: What is the difference between clinical and statistical significance?

Journal of the American Dental Association

Volumn 144, Issue 7, 2013, Pages 780-786

  Brignardello Petersen, Romina ^a   Carrasco Labra, Alonso ^a   Shah, Prakeshkumar ^b,c,d   Azarpazhooh, Amir ^b,e  

^a UNIVERSITY OF CHILE   (Chile)

^b UNIVERSITY OF TORONTO   (Canada)

^c UNIVERSITY OF TORONTO   (Canada)

^d MOUNT SINAI HOSPITAL   (Canada)

^e UNIVERSITY OF TORONTO   (Canada)

Author keywords

Clinical significance; Decision making; Epidemiology; Statistical significance; Statistics

Indexed keywords

ARTICLE; CLINICAL SIGNIFICANCE; CONFIDENCE INTERVAL; DECISION MAKING; DENTAL RESEARCH; EPIDEMIOLOGY; HUMAN; METHODOLOGY; PROBABILITY; SAMPLE SIZE; STATISTICAL ANALYSIS; STATISTICAL BIAS; STATISTICAL SIGNIFICANCE; STATISTICS; TREATMENT OUTCOME;

CLINICAL SIGNIFICANCE; DECISION MAKING; EPIDEMIOLOGY; STATISTICAL SIGNIFICANCE; STATISTICS;

BIAS (EPIDEMIOLOGY); CONFIDENCE INTERVALS; DATA INTERPRETATION, STATISTICAL; DECISION MAKING; DENTAL RESEARCH; HUMANS; PROBABILITY; RESEARCH DESIGN; SAMPLE SIZE; TREATMENT OUTCOME;

EID: 84881088496     PISSN: 00028177     EISSN: None     Source Type: Journal    
DOI: 10.14219/jada.archive.2013.0187     Document Type: Article

References (44)

1. De Menezes SA, Cuiy PR. Efficacy of nimesulide versus meloxicam in the control of pain, swelling and trismus following extraction of impacted lower third molar (published online ahead of print April 21, 2010). Int J Oral Maxillofac Surg 2010;39(6):580-584. doi: 10.1016/j.ijom.2010.03.012.
2. Norman G, Streiner D. Elements of statistical inference. In: Norman G, Streiner D, eds. Biostatistics: The Bare Essentials. 3rd ed. Hamilton, Ontario, Canada: B. C. Decker; 2008:46-62.
3. Bhardwaj SS, Camacho F, Derrow A, Fleischer AB Jr, Feldman SR. Statistical significance and clinical relevance: the importance of power in clinical trials in dermatology. Arch Dermatol 2004;140(12):1520-1523.
4. Greenland S, Rothman K. Fundamentals of epidemiologic data analysis. In: Rothman K, Greenland S, Lash T, eds. Modem Epidemiology. 3rd ed. Philadelphia: Lippincott Williams & Wilkins; 2008:213-237.
5. Pagano M, Gauvreau K. Hypothesis testing. In: Pagano M, ed. Principles of Biostatistics. 2nd ed. Pacific Grove, Calif.: Duxbury; 2000:232-258.
6. Gauvreau K, Pagano M. Why 5%? Nutrition 1994;10(1):93-94.
7. Hayat MJ. Understanding statistical significance. Nurs Res 2010;59(3):219-223.
8. Koretz RL. Is statistical significance always significant? Nutr Clin Pract 2005;20(3):303-307.
9. Le Fort SM. The statistical versus clinical significance debate. Image J Nurs Sch 1993;25(1):57-62.
10. Sackett DL. The tactics of performing therapeutic trials. In: Haynes RB, ed. Clinical Epidemiology: How to Do Clinical Practice Research. 3rd ed. Philadelphia: Lippincott Williams & Wilkins; 2006:107.
11. Cleophas TJ. Clinical trials: renewed attention to the interpretation of the P values-review. Am J Ther 2004;11(4):317-322.
12. Jacobson NS, Follette WC, Revenstorf D. Psychotherapy outcome research: methods for reporting variability and evaluating clinical significance. Behav Therapy 1984;15(4):336-352.
13. Hujoel PP, Armitage GC, Garcia RI. A perspective on clinical significance. J Periodontol 2000;71(9):1515-1518.
14. Killoy WJ. The clinical significance of local chemotherapies. J Clin Periodontol 2002;29(suppl 2):22-29.
15. Kingman A. Statistical vs clinical significance in product testing: can they be designed to satisfy equivalence? J Public Health Dent 1992;52(6):353-360.
16. Lindgren BR, Wielinski CL, Finkelstein SM, Warwick WJ. Contrasting clinical and statistical significance within the research setting. Pediatr Pulmonol 1993;16(6):336-340.
17. Greenstein G. Clinical versus statistical significance as they relate to the efficacy of periodontal therapy. JADA 2003;134(5):583-591.
18. Hollon S, Flick S. On the meaning of clinical significance. Behav Assess 1988;10:10.
19. Jaeschke R, Singer J, Guyatt GH. Measurement of health status: ascertaining the minimal clinically important difference. Control Clin Trials 1989;10(4):407-415.
20. Greenstein G, Lamster I. Efficacy of periodontal therapy: statistical versus clinical significance. J Periodontol 2000;71(4):657-662.
21. Allen PF, O'Sullivan M, Locker D. Determining the minimally important difference for the Oral Health Impact Profile-20 (published online ahead of print March 16, 2009). Eur J Oral Sri 2009;117(2):129-134. doi:10.1111/j.1600. 0722.2009.00610.x.
22. Ingram M, Choi YH, Chiu CY, et al. Use of the minimal clinically important difference (MCID) for evaluating treatment outcomes with TMJMD patients: a preliminary study (published online ahead of print Jan. 10, 2012). J Appl Biobehav Res 2011;16(3-4):148-166. doi:10.1111/j.1751-9861.2011.00068.x.
23. Thomson WM. Measuring change in dry-mouth symptoms over time using the Xerostomia Inventory. Gerodontology 2007;24(1):30-35.
24. Tsakos G, Allen PF, Steele JG, Locker D. Interpreting oral health-related quality of life data (published online ahead of print Nov. 10, 2011). Community Dent Oral Epidemiol 2012;40(3):193-200. doi:10.1111/j.1600-0528.2011.00651.x.
25. Tfeakos G, Bemabe E, D'Aiuto F, et al. Assessing the minimally important difference in the oral impact on daily performances index in patients treated for periodontitis (published online ahead of print June 1, 2010). J Clin Periodontol 2010;37(10):903-909. doi:10.1111/j. 1600-051X.2010.01583. X.
26. Blackhall LJ, Murphy ST, Frank G, Michel V, Azen S. Ethnicity and attitudes toward patient autonomy. JAMA 1995;274(10):820-825.
27. Klessig J. The effect of values and culture on life-support decisions. West J Med 1992;157(3):316-322.
28. Ruhnke GW, Wilson SR, Akamatsu T, et al. Ethical decision making and patient autonomy: a comparison of physicians and patients in Japan and the United States. Chest 2000;118(4):1172-1182.
29. Akl EA, Briel M, You JJ, et al. LOST to follow-up Information in Trials (LOST-IT): a protocol on the potential impact. Trials 2009;10:40.
30. Guyatt GH, Oxman AD, Kunz R, et al. GRADE guidelines: 2-framing the question and deciding on important outcomes (published online ahead of print Dec. 30, 2010). J Clin Epidemiol 2011;64(4):395-400. doi: 10.1016/j.clinepi. 2010.09.012.
31. Schunemann HJ, Oxman AD, Fretheim A. Improving the use of research evidence in guideline development: 6-determining which outcomes are important. Health Res Policy Syst 2006;4:18.
32. Itemple RJ. A Regulatory Authority's Opinion about Surrogate Endpoints. New York City: John Wiley & Sons; 1995.
33. Piantadosi S. Objectives and outcomes. In: Clinical Trials: A Methodologic Perspective. 2nd ed. Hoboken, N. J.: Wiley-Interscience; 2005:187-210.
34. Hujoel PP. Endpoints in periodontal trials: the need for an evidence-based research approach. Periodontol 2000 2004;36:196-204.
35. Forgie AH, Paterson M, Pine CM, Pitts NB, Nugent ZJ. A randomised controlled trial of the caries-preventive efficacy of a chlorhexidine-containing varnish in high-caries-risk adolescents. Caries Res 2000;34(5):432-439.
36. Sandham HJ, Brown J, Chan KH, Phillips HI, Burgess RC, Stokl AJ. Clinical trial in adults of an antimicrobial varnish for reducing mutans streptococci. J Dent Res 1991;70(11):1401-1408.
37. Oringer RJ, Al-Shammari KF, Aldredge WA, et al. Effect of locally delivered minocycline microspheres on markers of bone resorption. J Periodontol 2002;73(8):835-842.
38. Vidal F, Figueredo CM, Cordovil I, Fischer RG. Periodontal therapy reduces plasma levels of interleukin-6, C-reactive protein, and fibrinogen in patients with severe periodontitis and refractory arterial hypertension. J Periodontol 2009;80(5):786-791.
39. Pihlstrom BL, Barnett ML. Design, operation, and interpretation of clinical trials (published online ahead of print June 25, 2010). J Dent Res 2010;89(8):759-772. doi:10.1177/0022034510374737.
40. Bucher HC, Kunz R, Cook D, Holbrook A, Guyatt GH. Surrogate outcomes. In: Guyatt GH, Rennie D, Meade MO, Cook D, eds. Users' Guides to the Medical Literature: A Manual for Evidence-Based Clinical Practice. 2nd ed. New York City: McGraw Hill; 2008:317-340.
41. Fethney J. Statistical and clinical significance, and how to use confidence intervals to help interpret both (published online ahead of print March 29, 2010). Aust Crit Care 2010;23(2):93-97. doi:10.1016/j.aucc.2010.03. 001.
42. Piantadosi S. Notation and terminology. In: Piantadosi S, ed. Clinical Trials: A Methodologic Perspective. 2nd ed. Hoboken, N. J.: Wiley-Interscience; 2005:569-585.
43. Guyatt GH, Walter S, Cook D, Wyer P, Jaeschke R. Confidence intervals. In: Guyatt GH, Rennie D, Meade MO, Cook D, eds. Users' Guides to the Medical Literature: A Manual for Evidence-Based Clinical Practice. 2nd ed. New York City: McGraw Hill; 2008:99-107.
44. Braitman LE. Confidence intervals assess both clinical significance and statistical significance. Ann Intern Med 1991;114(6):515-517.