An investigation of the shortcomings of the CONSORT 2010 statement for the reporting of group sequential randomised controlled trials: A methodological systematic review

PLoS ONE

Volumn 10, Issue 11, 2015, Pages

  Stevely, Abigail ^a   Dimairo, Munyaradzi ^b   Todd, Susan ^c   Julious, Steven A ^b   Nicholl, Jonathan ^b   Hind, Daniel ^b   Cooper, Cindy L ^b  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b UNIVERSITY OF SHEFFIELD   (United Kingdom)

^c UNIVERSITY OF READING   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CHECKLIST; CONSUMER; CONTROLLED STUDY; HUMAN; MEDLINE; PARALLEL DESIGN; PROTOCOL COMPLIANCE; QUALITY CONTROL; RANDOMIZATION; STATISTICAL BIAS; SYSTEMATIC REVIEW; RANDOMIZED CONTROLLED TRIAL (TOPIC);

HUMANS; RANDOMIZED CONTROLLED TRIALS AS TOPIC;

EID: 84951133315     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0141104     Document Type: Article

References (78)

1. Quinlan J, Gaydos B, Maca J, Krams M (2010) Barriers and opportunities for implementation of adaptive designs in pharmaceutical product development. Clinical trials (London, England) 7: 167-173. doi:10.1177/1740774510361542
2. Todd S (2007) A 25-year review of sequential methodology in clinical studies. Statistics in medicine 26: 237-252. doi:10.1002/sim.2763 PMID: 17139691
3. FDA (2010) Guidance for Industry: Adaptive Design Clinical Trials for Drugs and Biologics.
4. Coffey CS, Levin B, Clark C, Timmerman C, Wittes J, et al. (2012) Overview, hurdles, and future work in adaptive designs: perspectives from a National Institutes of Health-funded workshop. Clinical trials (London, England) 9: 671-680. doi:10.1177/1740774512461859
5. Kairalla J a, Coffey CS, Thomann M a, Muller KE (2012) Adaptive trial designs: a review of barriers and opportunities. Trials 13: 145. doi:10.1186/1745-6215-13-145 PMID: 22917111
6. Elsäßer A, Regnstrom J, Vetter T, Koenig F, Hemmings RJ, et al. (2014) Adaptive clinical trial designs for European marketing authorization: a survey of scientific advice letters from the European Medicines Agency. Trials 15: 383. doi:10.1186/1745-6215-15-383 PMID: 25278265
7. Morgan CC, Huyck S, Jenkins M, Chen L, Bedding a., et al. (2014) Adaptive Design: Results of 2012 Survey on Perception and Use. Therapeutic Innovation & Regulatory Science 48: 473-481.
8. Chang M, Chow S-C, Pong A (2006) Adaptive design in clinical research: issues, opportunities, and recommendations. Journal of biopharmaceutical statistics 16: 299-309; discussion 311-312. doi:10.1080/10543400600609718 PMID: 16724486
9. Chuang-Stein C, Beltangady M (2010) FDA draft guidance on adaptive design clinical trials: Pfizer's perspective. Journal of biopharmaceutical statistics 20: 1143-1149. doi:10.1080/10543406.2010.514456 PMID: 21058110
10. Gaydos B, Anderson KM, Berry D, Burnham N, Chuang-Stein C, et al. (2009) Good Practices for Adaptive Clinical Trials in Pharmaceutical Product Development. Therapeutic Innovation & Regulatory Science 43: 539-556.
11. Liu Q, Chi GYH (2010) Understanding the FDA guidance on adaptive designs: historical, legal, and statistical perspectives. Journal of biopharmaceutical statistics 20: 1178-1219. doi:10.1080/10543406.2010.514462 PMID: 21058114
12. Chow S-C (2014) Adaptive clinical trial design. Annual review of medicine 65: 405-415. doi:10.1146/annurev-med-092012-112310 PMID: 24422576
13. Chow S-C, Chang M (2008) Adaptive design methods in clinical trials - a review. Orphanet journal of rare diseases 3: 11. doi:10.1186/1750-1172-3-11 PMID: 18454853
14. Quinlan J, Krams M (2006) Implementing adaptive designs: logistical and operational considerations. Drug Information Journal 40: 437-444.
15. Dimairo M, Boote J, Julious SA, Nicholl JP, Todd S (2015) Missing steps in a staircase: a qualitative study of the perspectives of key stakeholders on the use of adaptive designs in confirmatory trials. Trials 16: 430. doi:10.1186/s13063-015-0958-9 PMID: 26416387
16. Begg C, Cho M, Eastwood S, Horton R, Moher D, et al. (1996) Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA 276: 637-639. PMID: 8773637
17. Schulz KF, Altman DG, Moher D (2010) CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials. Annals of internal medicine 152: 726-732. doi:10.7326/0003-4819-152-11-201006010-00232 PMID: 20335313
18. Moher D, Schulz KF, Altman DG (2001) The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet 357: 1191-1194. PMID: 11323066
19. Egger M, Jüni P, Bartlett C (2001) Value of flow diagrams in reports of randomized controlled trials. JAMA 285: 1996-1999. PMID: 11308437
20. Moher D, Jones A, Lepage L (2001) Use of the CONSORT Statement and Quality of Reports of Randomized Trials. JAMA 285: 1992. doi:10.1001/jama.285.15.1992 PMID: 11308436
21. Turner L, Shamseer L, Altman DG, Schulz KF, Moher D (2012) Does use of the CONSORT Statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane review. Systematic reviews 1: 60. doi:10.1186/2046-4053-1-60 PMID: 23194585
22. Altman DG, Moher D, Schulz KF (2012) Improving the reporting of randomised trials: the CONSORT Statement and beyond. Statistics in medicine 31: 2985-2997. doi:10.1002/sim.5402 PMID: 22903776
23. Campbell MK, Piaggio G, Elbourne DR, Altman DG (2012) Consort 2010 statement: extension to cluster randomised trials. BMJ (Clinical research ed) 345: e5661. doi:10.1136/bmj.e5661
24. Piaggio G, Elbourne DR, Pocock SJ, Evans SJW, Altman DG (2012) Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement. JAMA 308: 2594-2604. doi:10.1001/jama.2012.87802 PMID: 23268518
25. Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, et al. (2008) Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ (Clinical research ed) 337: a2390. doi:10.1136/bmj.a2390
26. The EQUATOR Network (n.d.) Enhancing the QUAlity and Transparency Of health Research: Reporting guidelines under development. Available: http://www.equator-network.org/library/reportingguidelines-under-development/.Accessed 23 September 2014.
27. Detry M, Lewis R, Broglio K, Connor J (2012) Standards for the Design, Conduct, and Evaluation of Adaptive Randomized Clinical Trials.
28. SAACTD Workshop Committee (2009) Connecting Non-Profits to Adaptive Clinical Trial Designs: Themes and Recommendations from the Scientific Advances in Adaptive Clinical Trial Designs Workshop. Available: https://custom.cvent.com/536726184EFD40129EF286585E55929F/files/2627e73646ce4733a2c03692fab26fff.pdf. Accessed 3 October 2014.
29. U.S. National Institutes of Health (n.d.) ClinicalTrials.gov. Available: https://clinicaltrials.gov/.Accessed 1 June 2014.
30. Stovold E, Beecher D, Foxlee R, Noel-Storr A (2014) Study flow diagrams in Cochrane systematic review updates: an adapted PRISMA flow diagram. Systematic reviews 3: 54. doi:10.1186/2046-4053-3-54 PMID: 24886533
31. Moher D, Liberati A, Tetzlaff J, Altman DG (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS medicine 6: e1000097. doi:10.1371/journal.pmed.1000097 PMID: 19621072
32. Newcombe RG (1998) Two-sided confidence intervals for the single proportion: Comparison of seven methods. Statistics in Medicine 17: 857-872. doi:10.1002/(SICI)1097-0258(19980430)17:8〈857::AID-SIM777〉3.0.CO;2-E PMID: 9595616
33. Efron B (1979) Bootstrap Methods: Another Look at the Jackknife. The Annals of Statistics 7: 1-26.
34. Lan K, DeMets D (1983) Discrete sequential boundaries for clinical trials. Biometrika 70: 659-663.
35. O'Brien P, Fleming T (1979) A multiple testing procedure for clinical trials. Biometrics 35: 549-556. PMID: 497341
36. Pocock SJ (1977) Group Sequential Methods in the Design and Analysis of Clinical Trials. Biometrika 64: 191. doi:10.2307/2335684
37. Haybittle J (1971) Repeated assessment of results in clinical trials of cancer treatment. The British journal of radiology 44: 793-797. PMID: 4940475
38. Peto R, Pike MC, Armitage P, Breslow NE, Cox DR, et al. (1977) Design and analysis of randomized clinical trials requiring prolonged observation of each patient. II. analysis and examples. British journal of cancer 35: 1-39. PMID: 831755
39. Pampallona S, Tsiatis A a. (1994) Group sequential designs for one-sided and two-sided hypothesis testing with provision for early stopping in favor of the null hypothesis. Journal of Statistical Planning and Inference 42: 19-35. doi:10.1016/0378-3758(94)90187-2
40. Hwang IK, Shih WJ, De Cani JS (1990) Group sequential designs using a family of type I error probability spending functions. Statistics in medicine 9: 1439-1445. PMID: 2281231
41. Jennison C, Turnbull BW (2000) Flexible Monitoring: The Error Spending Approach. Group Sequential Methods with Applications to Clinical Trials. Florida, USA: CHAPMAN & HALL/CRC. pp. 148-149.
42. Wang S, Tsiatis A (1987) Approximately optimal one-parameter boundaries for group sequential trials. Biometrics 43: 193-199. PMID: 3567304
43. Fleming TR (1982) One-sample multiple testing procedure for phase II clinical trials. Biometrics 38: 143-151. PMID: 7082756
44. Whitehead J A unified theory for sequential clinical trials. Statistics in medicine 18: 2271-2286. PMID: 10474138
45. Tröger W, Galun D, Reif M, Schumann A, Stanković N, et al. (2013) Viscum album [L.] extract therapy in patients with locally advanced or metastatic pancreatic cancer: a randomised clinical trial on overall survival. European journal of cancer (Oxford, England: 1990) 49: 3788-3797. doi:10.1016/j.ejca.2013.06.043
46. Butts C, Socinski M a, Mitchell PL, Thatcher N, Havel L, et al. (2014) Tecemotide (L-BLP25) versus placebo after chemoradiotherapy for stage III non-small-cell lung cancer (START): a randomised, double-blind, phase 3 trial. The Lancet Oncology 15: 59-68. doi:10.1016/S1470-2045(13)70510-2 PMID: 24331154
47. Middleton G, Silcocks P, Cox T, Valle J, Wadsley J, et al. (2014) Gemcitabine and capecitabine with or without telomerase peptide vaccine GV1001 in patients with locally advanced or metastatic pancreatic cancer (TeloVac): an open-label, randomised, phase 3 trial. The Lancet Oncology 15: 829-840. doi:10.1016/S1470-2045(14)70236-0 PMID: 24954781
48. Pritchett Y, Jemiai Y, Chang Y, Bhan I, Agarwal R, et al. (2011) The use of group sequential, information-based sample size re-estimation in the design of the PRIMO study of chronic kidney disease. Clinical trials (London, England) 8: 165-174. doi:10.1177/1740774511399128
49. Thadhani R, Wenger J, Tamez H, Cannata J, Thompson BT, et al. (2012) Vitamin D Therapy and Cardiac Structure and Function in Patients With Chronic Kidney Disease. 02114.
50. Wolff AC, Lazar AA, Bondarenko I, Garin AM, Brincat S, et al. (2013) Randomized phase III placebo-controlled trial of letrozole plus oral temsirolimus as first-line endocrine therapy in postmenopausal women with locally advanced or metastatic breast cancer. Journal of clinical oncology : official journal of the American Society of Clinical Oncology 31: 195-202. doi:10.1200/JCO.2011.38.3331
51. Mehta RS, Barlow WE, Albain KS, Vandenberg T a, Dakhil SR, et al. (2012) Combination Anastrozole and Fulvestrant in Metastatic Breast Cancer. The New England journal of medicine 367: 435-444. doi:10.1056/NEJMoa1201622 PMID: 22853014
52. Chew EY, Clemons TE, Bressler SB, Elman MJ, Danis RP, et al. (2014) Randomized trial of a home monitoring system for early detection of choroidal neovascularization home monitoring of the Eye (HOME) study. Ophthalmology 121: 535-544. doi:10.1016/j.ophtha.2013.10.027 PMID: 24211172
53. Emerson S, Fleming T (1990) Parameter estimation following group sequential hypothesis testing. Biometrika 77: 875-892.
54. Mascia L, Pasero D, Slutsky AS, Arguis MJ, Berardino M, et al. (2010) Effect of a lung protective strategy for organ donors on eligibility and availability of lungs for transplantation: a randomized controlled trial. JAMA 304: 2620-2627. doi:10.1001/jama.2010.1796 PMID: 21156950
55. Moore MJ, Hamm J, Dancey J, Eisenberg PD, Dagenais M, et al. (2003) Comparison of gemcitabine versus the matrix metalloproteinase inhibitor BAY 12-9566 in patients with advanced or metastatic adenocarcinoma of the pancreas: a phase III trial of the National Cancer Institute of Canada Clinical Trials Group. Journal of clinical oncology: official journal of the American Society of Clinical Oncology 21: 3296-3302. doi:10.1200/JCO.2003.02.098
56. Markman M, Liu PY, Wilczynski S, Monk B, Copeland LJ, et al. (2003) Phase III randomized trial of 12 versus 3 months of maintenance paclitaxel in patients with advanced ovarian cancer after complete response to platinum and paclitaxel-based chemotherapy: a Southwest Oncology Group and Gynecologic Oncology Group trial. Journal of clinical oncology: official journal of the American Society of Clinical Oncology 21: 2460-2465. doi:10.1200/JCO.2003.07.013
57. Yao AC, Khajuria A, Camm CF, Edison E, Agha R (2014) The reporting quality of parallel randomised controlled trials in ophthalmic surgery in 2011: a systematic review. Eye (London, England) 28: 1341-1349. doi:10.1038/eye.2014.206
58. Hurst D (2011) Quality of reporting randomised controlled trials in major dental journals suboptimal. Evidence-based dentistry 12: 52-53. doi:10.1038/sj.ebd.6400796 PMID: 21701551
59. Sjögren P, Halling A (2002) Quality of reporting randomised clinical trials in dental and medical research. British dental journal 192: 100-103. doi:10.1038/sj.bdj.4801304a PMID: 11838001
60. Camm CF, Chen Y, Sunderland N, Nagendran M, Maruthappu M, et al. (2013) An assessment of the reporting quality of randomised controlled trials relating to anti-arrhythmic agents (2002-2011). International journal of cardiology 168: 1393-1396. doi:10.1016/j.ijcard.2012.12.020 PMID: 23298560
61. Mhaskar R, Djulbegovic B, Magazin A, Soares HP, Kumar A (2012) Published methodological quality of randomized controlled trials does not reflect the actual quality assessed in protocols. Journal of clinical epidemiology 65: 602-609. doi:10.1016/j.jclinepi.2011.10.016 PMID: 22424985
62. Montori VM, Devereaux PJ, Adhikari NKJ, Burns KEA, Eggert CH, et al. (2005) Randomized trials stopped early for benefit: a systematic review. JAMA 294: 2203-2209. doi:10.1001/jama.294.17.2203 PMID: 16264162
63. Bassler D, Montori VM, Briel M, Glasziou P, Guyatt G (2008) Early stopping of randomized clinical trials for overt efficacy is problematic. Journal of clinical epidemiology 61: 241-246. doi:10.1016/j.jclinepi.2007.07.016 PMID: 18226746
64. Bassler D, Briel M, Montori VM, Lane M, Glasziou P, et al. (2010) Stopping randomized trials early for benefit and estimation of treatment effects: systematic review and meta-regression analysis. JAMA 303: 1180-1187. doi:10.1001/jama.2010.310 PMID: 20332404
65. Wears RL (2015) Are We There Yet? Early Stopping in Clinical Trials. Annals of Emergency Medicine 65: 214-215. doi:10.1016/j.annemergmed.2014.12.020 PMID: 25601251
66. Zhang JJ, Blumenthal GM, He K, Tang S, Cortazar P, et al. (2012) Overestimation of the effect size in group sequential trials. Clinical cancer research: an official journal of the American Association for Cancer Research 18: 4872-4876. doi:10.1158/1078-0432.CCR-11-3118
67. Wittes J (2012) Stopping a trial early - and then what? Clinical trials (London, England) 9: 714-720. doi:10.1177/1740774512454600
68. Zannad F, Stough WG, McMurray JJ V, Remme WJ, Pitt B, et al. (2012) When to stop a clinical trial early for benefit: Lessons learned and future approaches. Circulation: Heart Failure 5: 294-302. doi:10.1161/CIRCHEARTFAILURE.111.965707 PMID: 22438522
69. Freidlin B, Korn EL (2009) Stopping clinical trials early for benefit: impact on estimation. Clinical trials (London, England) 6: 119-125. doi:10.1177/1740774509102310
70. Kim K (1989) Point estimation following group sequential tests. Biometrics 45: 613-617. PMID: 2765641
71. Todd S, Whitehead J, Facey K (1996) Point and interval estimation following a sequential clinical trial. Biometrika 83: 453-461.
72. Liu A, Hall W (1999) Unbiased estimation following a group sequential test. Biometrika 86: 71-78.
73. Whitehead J (1986) On the bias of maximum likelihood estimation following a sequential test. Biometrika 73: 573-581.
74. Emerson SS (1993) Computation of the uniform minimum variance unbiased estimator of a normal mean following a group sequential trial. Computers and biomedical research, an international journal 26: 68-73. PMID: 8444028
75. Emerson S, Kittelson J (1997) A computationally simpler algorithm for the UMVUE of a normal mean following a group sequential trial. Biometrics 53: 365-369. PMID: 9147601
76. Milanzi E, Molenberghs G, Alonso A, Kenward MG, Tsiatis AA, et al. (2014) Estimation After a Group Sequential Trial. Statistics in Biosciences.
77. Chow S-C, Corey R (2011) Benefits, challenges and obstacles of adaptive clinical trial designs. Orphanet journal of rare diseases 6: 79. doi:10.1186/1750-1172-6-79 PMID: 22129361
78. Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, et al. (2014) Reducing waste from incomplete or unusable reports of biomedical research. Lancet 383: 267-276. doi:10.1016/S0140-6736(13)62228-X PMID: 24411647