Very large treatment effects in randomised trials as an empirical marker to indicate whether subsequent trials are necessary: Meta-epidemiological assessment

BMJ (Online)

Volumn 355, Issue , 2016, Pages

  Nagendran, Myura ^a   Pereira, Tiago V ^b   Kiew, Grace ^c   Altman, Douglas G ^d   Maruthappu, Mahiben ^e   Ioannidis, John P A ^f   McCulloch, Peter ^d  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b HOSPITAL ALEMÃO OSWALDO CRUZ   (Brazil)

^c GONVILLE AND CAIUS COLLEGE   (United Kingdom)

^d UNIVERSITY OF OXFORD   (United Kingdom)

^e UNIVERSITY COLLEGE LONDON   (United Kingdom)

^f STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ATTRIBUTABLE RISK; COCHRANE LIBRARY; CONFIDENCE INTERVAL; EFFECT SIZE; HUMAN; OUTCOME ASSESSMENT; PREDICTIVE VALUE; PRIORITY JOURNAL; SAMPLE SIZE; STATISTICAL SIGNIFICANCE; META ANALYSIS; RANDOMIZED CONTROLLED TRIAL (TOPIC); REPRODUCIBILITY; STATISTICAL ANALYSIS; STATISTICS AND NUMERICAL DATA; TREATMENT OUTCOME;

DATA INTERPRETATION, STATISTICAL; HUMANS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REPRODUCIBILITY OF RESULTS; TREATMENT OUTCOME;

EID: 84994017877     PISSN: 09598146     EISSN: 17561833     Source Type: Journal    
DOI: 10.1136/bmj.i5432     Document Type: Article

References (23)

1. Concato J, Shah N, Horwitz RI. Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med 2000;342:1887-92. doi:10. 1056/NEJM200006223422507.
2. Moher D, Hopewell S, Schulz KF, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ 2010;340:c869. doi:10. 1136/bmj. c869.
3. Kurzrock R, Stewart DJ. Equipoise abandoned Randomization and clinical trials. Ann Oncol 2013;24:2471-4. doi:10. 1093/annonc/mdt358.
4. McCulloch P, Kaul A, Wagstaff GF, Wheatcroft J. Tolerance of uncertainty, extroversion, neuroticism and attitudes to randomized controlled trials among surgeons and physicians. Br J Surg 2005;92:1293-7. doi:10. 1002/bjs. 4930.
5. Glasziou P, Chalmers I, Rawlins M, McCulloch P. When are randomised trials unnecessary Picking signal from noise. BMJ 2007;334:349-51. doi:10. 1136/bmj. 39070. 527986. 68.
6. Djulbegovic B, Kumar A, Glasziou P, Miladinovic B, Chalmers I. Medical research: Trial unpredictability yields predictable therapy gains. Nature 2013;500:395-6. doi:10. 1038/500395a
7. Pereira TV, Horwitz RI, Ioannidis JP. Empirical evaluation of very large treatment effects of medical interventions. JAMA 2012;308:1676-84. doi:10. 1001/jama. 2012. 13444.
8. Chalmers I, Glasziou P. Avoidable waste in the production and reporting of research evidence. Lancet 2009;374:86-9. doi:10. 1016/S0140-6736(09)60329-9.
9. Guyatt GH, Oxman AD, Sultan S, et al. GRADE Working Group. GRADE guidelines: 9. Rating up the quality of evidence. J Clin Epidemiol 2011;64:1311-6. doi:10. 1016/j. jclinepi. 2011. 06. 004.
10. Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions Version 5. 1. 0. The Cochrane Collaboration, 2011.
11. Reiczigel J. Abonyi-Tóth Z, Singer J. An exact confidence set for two binomial proportions and exact unconditional confidence intervals for the difference and ratio of proportions. Comput Stat Data Anal 2008;52:5046-53doi:10. 1016/j. csda. 2008. 04. 032.
12. Woolf B. On estimating the relation between blood group and disease. Ann Hum Genet 1955;19:251-3. doi:10. 1111/j. 1469-1809. 1955. tb01348. x.
13. Bulley S, Derry S, Moore RA, McQuay HJ. Single dose oral rofecoxib for acute postoperative pain in adults. Cochrane Database Syst Rev 2009;4:CD004604.
14. Penã-Rosas JP, Viteri FE. Effects and safety of preventive oral iron or iron+folic acid supplementation for women during pregnancy. Cochrane Database Syst Rev 2009;4:CD004736.
15. Schroth RJ, Hitchon CA, Uhanova J, et al. Hepatitis B vaccination for patients with chronic renal failure. Cochrane Database Syst Rev 2004;3:CD003775.
16. Neilson JP, Gyte GM, Hickey M, Vazquez JC, Dou L. Medical treatments for incomplete miscarriage (less than 24 weeks). Cochrane Database Syst Rev 2010;1:CD007223.
17. Ioannidis JP, Greenland S, Hlatky MA, et al. Increasing value and reducing waste in research design, conduct, and analysis. Lancet 2014;383:166-75. doi:10. 1016/S0140-6736(13)62227-8.
18. Iwashyna TJ, Burke JF, Sussman JB, Prescott HC, Hayward RA, Angus DC. Implications of Heterogeneity of Treatment Effect for Reporting and Analysis of Randomized Trials in Critical Care. Am J Respir Crit Care Med 2015;192:1045-51. doi:10. 1164/rccm. 201411-2125CP.
19. IntHout J, Ioannidis JP, Borm GF, Goeman JJ. Small studies are more heterogeneous than large ones: a meta-meta-analysis. J Clin Epidemiol 2015;68:860-9. doi:10. 1016/j. jclinepi. 2015. 03. 017.
20. Ioannidis JP. Contradicted and initially stronger effects in highly cited clinical research. JAMA 2005;294:218-28. doi:10. 1001/jama. 294. 2. 218.
21. Prasad V, Cifu A, Ioannidis JP. Reversals of established medical practices: evidence to abandon ship. JAMA 2012;307:37-8. doi:10. 1001/jama. 2011. 1960.
22. Prasad V, Vandross A, Toomey C, et al. A decade of reversal: an analysis of 146 contradicted medical practices. Mayo Clin Proc 2013;88:790-8. doi:10. 1016/j. mayocp. 2013. 05. 012.
23. Rerkasem K, Rothwell PM. Meta-analysis of small randomized controlled trials in surgery may be unreliable. Br J Surg 2010;97:466-9. doi:10. 1002/bjs. 6988.