Quantifying over-estimation in early stopped clinical trials and the "freezing effect" on subsequent research

Clinical Trials

Volumn 13, Issue 6, 2016, Pages 621-631

  Wang, Hao ^a   Rosner, Gary L ^a   Goodman, Steven N ^b  

^a JOHNS HOPKINS UNIVERSITY   (United States)

^b STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

"freezing effect"; Bayesian inference; bias; Clinical trial methodology; early stopping; meta analysis; over estimate; treatment effect

Indexed keywords

ARTICLE; BAYESIAN LEARNING; CLINICAL RESEARCH; FREEZING EFFECT; INFORMATION PROCESSING; MATHEMATICAL PARAMETERS; METHODOLOGY; OUTCOME ASSESSMENT; PRACTICE GUIDELINE; PRIORITY JOURNAL; PROCESS DESIGN; SAMPLING BIAS; SIMULATION; BAYES THEOREM; COMPUTER SIMULATION; EARLY TERMINATION OF CLINICAL TRIAL; HUMAN; MEDICAL RESEARCH; ODDS RATIO; RESEARCH ETHICS; TREATMENT OUTCOME;

BAYES THEOREM; BIOMEDICAL RESEARCH; COMPUTER SIMULATION; EARLY TERMINATION OF CLINICAL TRIALS; ETHICS, RESEARCH; HUMANS; ODDS RATIO; TREATMENT OUTCOME;

EID: 85000949459     PISSN: 17407745     EISSN: 17407753     Source Type: Journal    
DOI: 10.1177/1740774516649595     Document Type: Article

References (24)

1. Bassler D, Briel M, Montori VM, et al. Stopping randomized trials early for benefit and estimation of treatment effects. JAMA 2010; 303: 1180-1187.
2. Mueller PS, Montori VM, Bassler D, et al. Ethical issues in stopping randomized trials early because of apparent benefit. Ann Intern Med 2007; 146: 878-881.
3. Bassler D, Ferreira-Gonzalez I, Briel M, et al. Systematic reviewers neglect bias that results from trials stopped early for benefit. J Clin Epidemiol 2007; 60: 869-873.
4. Goodman SN., Stopping at nothing? Some dilemmas of data monitoring in clinical trials. Ann Intern Med 2007; 46: 882-887.
5. Goodman S, Berry D, Wittes J., Bias and trials stopped early for benefit. JAMA 2010; 304: 157.
6. Schou IM, Marschner IC., Meta-analysis of clinical trials with early stopping: an investigation of potential bias. Stat Med 2013; 32: 4859-4874.
7. Korn EL, Freidlin B, Mooney M., Stopping or reporting early for positive results in randomized clinical trials: the National Cancer Institute cooperative group experience from 1990 to 2005. J Clin Oncol 2009; 27: 1712-1721.
8. Goodman SN., Systematic reviews are not biased by results from trials stopped early for benefit. J Clin Epidemiol 2008; 61: 95-96; author reply 96-98.
9. Bassler D, Montori VM, Briel M, et al. Reflections on meta-analyses involving trials stopped early for benefit: is there a problem and if so, what is it? Stat Methods Med Res 2013; 22: 159-168.
10. Montori VM, Devereaux PJ, Adhikari NK, et al. Randomized trials stopped early for benefit: a systematic review. JAMA 2005; 294: 2203-2209.
11. Briel M, Bassler D, Wang AT, et al. The dangers of stopping a trial too early. J Bone Joint Surg Am 2012; 94 (Suppl. 1): 56-60.
12. Prutsky GJ, Domecq JP, Erwin PJ, et al. Initiation and continuation of randomized trials after the publication of a trial stopped early for benefit asking the same study question: sTOPIT-3 study design. Trials 2013; 14: 335.
13. O'Brien PC, Fleming TR., A multiple testing procedure for clinical trials. Biometrics 1979; 35: 549-556.
14. Pocock SJ, Hughes MD., Practical problems in interim analyses, with particular regard to estimation. Control Clin Trials 1989; 10: 209S-221S.
15. Carlin BP, Louis TA., Bayesian methods for data analysis. 3rd ed. Boca Raton, FL: Chapman & Hall/CRC, 2008.
16. Freidlin B, Korn EL., Stopping clinical trials early for benefit: impact on estimation. Clin Trials 2009; 6: 119-125.
17. Tsiatis AA, Rosner GL, Mehta CR., Exact confidence intervals following a group sequential test. Biometrics 1984; 40: 797-803.
18. Whitehead J., On the bias of maximum likelihood estimation following a sequential test. Biometrika 1986; 73: 573-581.
19. Emerson SS, Fleming TR., Parameter estimation following group sequential hypothesis testing. Biometrika 1990; 77: 875-892.
20. Todd S, Whitehead J, Facey KM., Point and interval estimation following a sequential clinical trial. Biometrika 1996; 83: 453-461.
21. Liu A, Troendle JF, Yu KF, et al. Conditional maximum likelihood estimation following a group sequential test. Biom J 2004; 46: 760-768.
22. Pocock SJ, Hughes MD., Estimation issues in clinical trials and overviews. Stat Med 1990; 9: 657-671.
23. USHHS, FDA, CDER and CBER. Guidance for industry: providing clinical evidence of effectiveness for human drugs and biological products., http://www.fda.gov/downloads/Drugs/GuidanceComplianceRegulatoryInformation/Guidances/ucm078749.pdf (1998,. accessed 18 April 2016).
24. Zhang JJ, Blumenthal GM, He K, et al. Overestimation of the effect size in group sequential trials. Clinical Cancer Research 2012; 18 (18): 4872-48766.