The Fragility of Statistically Significant Findings from Randomized Trials in Sports Surgery: A Systematic Survey

American Journal of Sports Medicine

Volumn 45, Issue 9, 2017, Pages 2164-2170

  Khan, Moin ^a   Evaniew, Nathan ^a   Gichuru, Mark ^a   Habib, Anthony ^a   Ayeni, Olufemi R ^a   Bedi, Asheesh ^b   Walsh, Michael ^a   Devereaux, P J ^a   Bhandari, Mohit ^a  

^a MCMASTER UNIVERSITY   (Canada)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Fragility Index; orthopaedic surgery; randomized control trial; sports medicine

Indexed keywords

ARTHROSCOPY; FEMALE; HUMAN; MALE; QUESTIONNAIRE; RANDOMIZED CONTROLLED TRIAL (TOPIC); SAMPLE SIZE; SPORTS MEDICINE; STANDARDS; STATISTICS AND NUMERICAL DATA;

ARTHROSCOPY; FEMALE; HUMANS; MALE; RANDOMIZED CONTROLLED TRIALS AS TOPIC; SAMPLE SIZE; SPORTS MEDICINE; SURVEYS AND QUESTIONNAIRES;

EID: 85025075195     PISSN: 03635465     EISSN: 15523365     Source Type: Journal    
DOI: 10.1177/0363546516674469     Document Type: Article

References (32)

1. Barber FA, Burns JP, Deutsch A, Labbé MR, Litchfield RB., A prospective, randomized evaluation of acellular human dermal matrix augmentation for arthroscopic rotator cuff repair. Arthroscopy. 2012; 28 (1): 8-15.
2. Bassler D, Briel M, Montori VM, et al. Stopping randomized trials early for benefit and estimation of treatment effects: systematic review and meta-regression analysis. JAMA. 2010; 303 (12): 1180-1187.
3. Bhandari M, Guyatt GH, Lochner H, Sprague S, Tornetta P III,. Application of the Consolidated Standards of Reporting Trials (CONSORT) in the fracture care literature. J Bone Joint Surg Am. 2002; 84 (3): 485-489.
4. Bhandari M, Guyatt GH, Swiontkowski MF., User's guide to the orthopaedic literature: how to use an article about a surgical therapy. J Bone Joint Surg Am. 2001; 83 (6): 916-926.
5. Bhandari M, Montori VM, Schemitsch EH., The undue influence of significant p-values on the perceived importance of study results. Acta Orthop. 2005; 76 (3): 291-295.
6. Bhandari M, Richards RR, Sprague S, Schemitsch EH., The quality of reporting of randomized trials in the Journal of Bone and Joint Surgery from 1988 through 2000. J Bone Joint Surg Am. 2002; 84 (3): 388-396.
7. Chaudhry H, Ayeni OR., The etiology of femoroacetabular impingement: what we know and what we don't. Sports Health. 2014; 6 (2): 157-161.
8. Chess LE, Gagnier J., Risk of bias of randomized controlled trials published in orthopaedic journals. BMC Med Res Methodol. 2013; 13: 76.
9. El-Daly I, Ibraheim H, Rajakulendran K, Culpan P, Bates P., Are patient-reported outcome measures in orthopaedics easily read by patients? Clin Orthop Relat Res. 2016; 474 (1): 246-255.
10. Evaniew N, Files C, Smith C, et al. The fragility of statistically significant findings from randomized trials in spine surgery: a systematic survey. Spine. 2015; 15 (10): 2188-2197.
11. Evaniew N, Madden K, Bhandari M., Cochrane in CORR®: arthroplasties (with and without bone cement) for proximal femoral fractures in adults. Clin Orthop Relat Res. 2014; 472 (5): 1367-1372.
12. Evaniew N, Simunovic N, McKee MD, Schemitsch E., Cochrane in CORR®: surgical versus conservative interventions for treating fractures of the middle third of the clavicle. Clin Orthop Relat Res. 2014; 472 (9): 2579-2585.
13. Farrokhyar F, Karanicolas PJ, Thoma A, et al. Randomized controlled trials of surgical interventions. Ann Surg. 2010; 251 (3): 409-416.
14. Feinstein AR., P-values and confidence intervals: two sides of the same unsatisfactory coin. J Clin Epidemiol. 1998; 51 (4): 355-360.
15. Fleiss JL, Levin B, Paik MC., Statistical Methods for Rates and Proportions. 2nd ed. New York: John Wiley and Sons; 1981.
16. Glanville JM, Lefebvre C, Miles JNV, Camosso-Stefinovic J., How to identify randomized controlled trials in MEDLINE: ten years on. J Med Libr Assoc. 2006; 94 (2): 130-136.
17. Goodman SN., Toward evidence-based medical statistics, 1: the P value fallacy. Ann Intern Med. 1999; 130 (12): 995-1004.
18. Guyatt GH, Oxman AD, Kunz R, et al. GRADE guidelines, 2: framing the question and deciding on important outcomes. J Clin Epidemiol. 2011; 64 (4): 395-400.
19. Harris JD, Cvetanovich G, Erickson BJ, et al. Current status of evidence-based sports medicine. Arthroscopy. 2014; 30 (3): 362-371.
20. Hetaimish BM, Khan M, Crouch S, et al. Consistency of reported outcomes after arthroscopic management of femoroacetabular impingement. Arthroscopy. 2013; 29 (4): 780-787.
21. Higgins JP., Cochrane Handbook for Systematic Reviews of Interventions. Vol 5. 5th ed. Chichester, UK: Wiley-Blackwell; 2008.
22. Ioannidis JPA,. Why most published research findings are false. PLoS Med. 2005; 2 (8): e124.
23. Karanicolas PJ, Bhandari M, Taromi B, et al. Blinding of outcomes in trials of orthopaedic trauma: an opportunity to enhance the validity of clinical trials. J Bone Joint Surg Am. 2008; 90 (5): 1026-1033.
24. Landis JR, Koch GG., The measurement of observer agreement for categorical data. Biometrics. 1977; 33 (1): 159-174.
25. Mundi R, Bhandari M., Cochrane in CORR(®): double-bundle versus single-bundle reconstruction for anterior cruciate ligament rupture in adults (review). Clin Orthop Relat Res. 2016; 474 (5): 1099-1101.
26. Ramkumar PN, Harris JD, Noble PC., Patient-reported outcome measures after total knee arthroplasty: a systematic review. Bone Joint Res. 2015; 4 (7): 120-127.
27. Ridgeon EE, Young PJ, Bellomo R, Mucchetti M, Lembo R, Landoni G., The Fragility Index in multicenter randomized controlled critical care trials. Crit Care Med. 2016; 44 (7): 1278-1284.
28. SPRINT Investigators, Bhandari M, Tornetta P, et al. (Sample) size matters! An examination of sample size from the SPRINT trial study to prospectively evaluate reamed intramedullary nails in patients with tibial fractures. J Orthop Trauma. 2013; 27 (4): 183-188.
29. Sterne JA, Davey Smith G., Sifting the evidence: what's wrong with significance tests? BMJ. 2001; 322 (7280): 226-231.
30. Sung J, Siegel J, Tornetta P, Bhandari M., The orthopaedic trauma literature: an evaluation of statistically significant findings in orthopaedic trauma randomized trials. BMC Musculoskelet Disord. 2008; 9: 14.
31. Walsh M, Srinathan SK, McAuley DF, et al. The statistical significance of randomized controlled trial results is frequently fragile: a case for a Fragility Index. J Clin Epidemiol. 2014; 67 (6): 622-628.
32. Web of Science Citation Index. http://ip-science.thomsonreuters.com/cgi-bin/jrnlst/jloptions.cgi?PC=K. Accessed April 3, 2016.