Reflections on meta-analyses involving trials stopped early for benefit: Is there a problem and if so, what is it?

Statistical Methods in Medical Research

Volumn 22, Issue 2, 2013, Pages 159-168

  Bassler, Dirk ^a   Montori, Victor M ^b   Briel, Matthias ^c,d   Glasziou, Paul ^e,f   Walter, Stephen D ^d   Ramsay, Tim ^g   Guyatt, Gordon ^d  

^a UNIVERSITY HOSPITAL TÜBINGEN   (Germany)

^b MAYO CLINIC   (United States)

^c UNIVERSITY HOSPITAL BASEL   (Switzerland)

^d MCMASTER UNIVERSITY   (Canada)

^e UNIVERSITY OF OXFORD   (United Kingdom)

^f UNIVERSITY OF OXFORD   (United Kingdom)

^g OTTAWA HOSPITAL RESEARCH INSTITUTE   (Canada)

Author keywords

Clinical trial methodology; overestimation of treatment effects; stopping rules; systematic reviews and meta analyses; truncation of studies

Indexed keywords

ARTICLE; CLINICAL DECISION MAKING; HUMAN; META ANALYSIS (TOPIC); PUBLISHING; RANDOMIZED CONTROLLED TRIAL (TOPIC); RISK; SAMPLE SIZE; SYSTEMATIC REVIEW (TOPIC);

DATA INTERPRETATION, STATISTICAL; DECISION MAKING; EVIDENCE-BASED MEDICINE; HUMANS; META-ANALYSIS AS TOPIC; OUTCOME ASSESSMENT (HEALTH CARE); RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN;

EID: 84876720420     PISSN: 09622802     EISSN: 14770334     Source Type: Journal    
DOI: 10.1177/0962280211432211     Document Type: Article

References (26)

1. Montori VM, Devereaux PJ, Adhikari NK, Burns KE, Eggert CH, Briel M, et al. Randomized trials stopped early for benefit: a systematic review. JAMA. 2005 ; 294: 2203-2209 (Pubitemid 41571138)
2. Bassler D, Ferreira-Gonzalez I, Briel M, Cook DJ, Devereaux PJ, Heels-Ansdell D, et al. Systematic reviewers neglect bias that results from trials stopped early for benefit. J Clin Epidemiol. 2007 ; 60: 869-873 (Pubitemid 47198445)
3. Bassler D, Briel M, Montori VM, Lane M, Glasziou P, Zhou Q, et al. Stopping randomized trials early for benefit and estimation of treatment effects: systematic review and meta-regression analysis. JAMA. 2010 ; 303: 1180-1187
4. Mueller PS, Montori VM, Bassler D, Koenig BA, Guyatt GH. Ethical issues in stopping randomized trials early because of apparent benefit. Ann Intern Med. 2007 ; 146: 878-881 (Pubitemid 351650488)
5. Goodman SN. Stopping at nothing? Some dilemmas of data monitoring in clinical trials. Ann Intern Med. 2007 ; 146: 882-887 (Pubitemid 351650489)
6. Goodman SN. Stopping trials for efficacy: an almost unbiased view. Clin Trials. 2009 ; 6: 133-135
7. Goodman SN. Systematic reviews are not biased by results from trials stopped early for benefit. J Clin Epidemiol. 2008 ; 61: 95-96; author reply 96-98 (Pubitemid 350245733)
8. Emanuel EJ, Wendler D, Grady C. What makes clinical research ethical?. JAMA. 2000 ; 283: 2701-2711 (Pubitemid 30337334)
9. Goodman S, Berry D, Wittes J. Bias and trials stopped early for benefit. JAMA. 2010 ; 304: 157-157
10. Pocock S, White I. Trials stopped early: too good to be true?. Lancet. 1999 ; 353: 943-944 (Pubitemid 29132599)
11. Schulz K, Grimes D. Multiplicity in randomised trials: subgroup and interim analyses. Lancet. 2005 ; 365: 1657-1661 (Pubitemid 40693416)
12. Poldermans D, Boersma E, Bax JJ, Thomson IR, van de Ven LL, Blankensteijn JD, et al. The effect of bisoprolol on perioperative mortality and myocardial infarction in high-risk patients undergoing vascular surgery. Dutch Echocardiographic Cardiac Risk Evaluation Applying Stress Echocardiography Study Group. N Engl J Med. 1999 ; 341: 1789-1794
13. Eagle KA, Berger PB, Calkins H, Chaitman BR, Ewy GA, Fleischmann KE, et al. ACC/AHA guideline update for perioperative cardiovascular evaluation for noncardiac surgery - executive summary: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Committee to Update the 1996 Guidelines on Perioperative Cardiovascular Evaluation for Noncardiac Surgery). J Am Coll Cardiol. 2002 ; 39: 542-553 (Pubitemid 34117516)
14. Fleisher LA, Beckman JA, Brown KA, Calkins H, Chaikof EL, Fleischmann KE, et al. ACC/AHA 2007 guidelines on perioperative cardiovascular evaluation and care for noncardiac surgery: executive summary: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Writing Committee to Revise the 2002 Guidelines on Perioperative Cardiovascular Evaluation for Noncardiac Surgery) developed in collaboration with the American Society of Echocardiography, American Society of Nuclear Cardiology, Heart Rhythm Society, Society of Cardiovascular Anesthesiologists, Society for Cardiovascular Angiography and Interventions, Society for Vascular Medicine and Biology, and Society for Vascular Surgery. J Am Coll Cardiol. 2007 ; 50: 1707-1732
15. POISE Study Group. Effects of extended-release metoprolol succinate in patients undergoing non-cardiac surgery (POISE trial): a randomised controlled trial. Lancet. 2008 ; 371: 1839-1847
16. Poldermans D, Devereaux PJ. The experts debate: perioperative beta-blockade for noncardiac surgery - proven safe or not?. Cleve Clin J Med. 2009 ; 76 (Suppl. 4). 84-92
17. Bangalore S, Wetterslev J, Pranesh S, Sawhney S, Gluud C, Messerli FH. Perioperative beta blockers in patients having non-cardiac surgery: a meta-analysis. Lancet. 2008 ; 372: 1962-1976
18. Green SJ, Fleming TR, Emerson SS. Effects on overviews of early stopping rules for clinical trials. Stat Med. 1987 ; 7: 1231-1242
19. Hughes MD, Freedman LS, Pocock SJ. The impact of stopping rules on heterogeneity of results in overviews of clinical trials. Biometrics. 1982 ; 48: 41-53
20. Todd S. Incorporation of sequential trials into a fixed effects meta-analysis. Stat Med. 1997 ; 16: 2915-2925 (Pubitemid 27520641)
21. Whitehead A. A prospectively planned cumulative meta-analysis applied to a series of concurrent clinical trials. Stat Med. 1997 ; 16: 2901-2913 (Pubitemid 27520640)
22. Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ. 2010 ; 340: c332 - c332
23. Amato MB, Barbas CS, Medeiros DM, Magaldi RB, Schettino GP, Lorenzi-Filho G, et al. Effect of a protective-ventilation strategy on mortality in the acute respiratory distress syndrome. N Engl J Med. 1998 ; 338: 347-354 (Pubitemid 28083906)
24. Stern JM, Simes RJ. Publication bias: evidence of delayed publication in a cohort study of clinical research projects. BMJ. 1997 ; 315: 640-645 (Pubitemid 27387174)
25. Guyatt GH, Oxman AD, Vist G, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. Rating quality of evidence and strength of recommendations GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008 ; 336: 924-926 (Pubitemid 351632017)
26. Guyatt GH, Oxman AD, Kunz R, Vist GE, Falck-Ytter Y, Schünemann HJ, et al. Rating quality of evidence and strength of recommendations: what is "quality of evidence" and why is it important to clinicians?. BMJ. 2008 ; 336: 995-998 (Pubitemid 351656090)