Comparison of protocols and registry entries to published reports for randomised controlled trials

Cochrane Database of Systematic Reviews

Volumn 2011, Issue 1, 2011, Pages

  Dwan, Kerry ^a   Altman, Douglas G ^b   Cresswell, Lynne ^a   Blundell, Michaela ^a   Gamble, Carrol L ^a   Williamson, Paula R ^a  

^a UNIVERSITY OF LIVERPOOL   (United Kingdom)

^b WOLFSON COLLEGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CALCULATION; COHORT ANALYSIS; CONTROLLED STUDY; ELIGIBILITY CRITERIA; EMBASE; FOLLOW UP; HUMAN; HUMAN EXPERIMENT; LANGUAGE; MEDLINE; OUTCOME ASSESSMENT; RANDOMIZED CONTROLLED TRIAL (TOPIC); REVIEW; RISK ASSESSMENT; SAMPLE SIZE; SINGLE BLIND PROCEDURE; SYSTEMATIC REVIEW; WEB OF SCIENCE; ARTICLE; CLINICAL PROTOCOL; COMPARATIVE STUDY; DOUBLE BLIND PROCEDURE; METHODOLOGY; PUBLISHING; RANDOMIZATION; REGISTER; STANDARD;

CLINICAL PROTOCOLS; COHORT STUDIES; DOUBLE-BLIND METHOD; PUBLICATION BIAS; RANDOM ALLOCATION; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REGISTRIES;

EID: 79952266571     PISSN: 14651858     EISSN: None     Source Type: Journal    
DOI: 10.1002/14651858.MR000031.pub2     Document Type: Review

References (99)

1. Al-Marzouki S, Roberts I, Evans S, Marshall T. Selective reporting in clinical trials: analysis of trial protocols accepted by The Lancet. Lancet 2008;372(9634):201.
2. Blumle A, Antes G, Schumacher M, Just H, von Elm E. Clinical research projects at a German medical faculty: follow-up from ethical approval to publication and citation by others. Journal of Medical Ethics 2008;34:e20.
3. Blumle A, Meerpohl JJ, Antes G, von Elm E. Reporting of eligibility criteria of participants in randomized trials: comparison between study protocols and journal articles [abstract]. 17th Cochrane Colloquium. Singapore, 2009:49-50.
4. Bourgeois FT, Murthy S, Mandl KD. Outcome Reporting Among Drug Trials Registered in ClinicalTrials.gov. Annals of Internal Medicine 2010;153:158-166.
5. Chan A-W, Hrobjartsson A, Haahr MT, Gotzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. Journal of the American Medical Association 2004a;291:2457-65.
6. Chan AW, Altman D. Discrepancies between protocols and publications: evidence of outcome reporting bias in randomised trials [abstract]. XI Cochrane Colloquium: Evidence, Health Care and Culture. Barcelona, Spain, 2003:9.
7. Chan AW, Hrobjartsson A, Jørgensen KJ, Gøtzsche PC, Altman DG. Discrepancies in sample size calculations and data analysesreported in randomised trials: comparison of publications with protocols. British Medical Journal 2008;337:a2299.
8. Chan AW, Hrobjartsson A, Tendal B, Gotzsche P, Altman D. Pre-specifying sample size calculations and statistical analyses in randomised trials: comparison of protocols to publications [abstract]. XIII Cochrane Colloquium. Melbourne, Australia, 2005:166.
9. Gotzsche P, Hrobjartsson A, Hrobjartsonn A, Haahr M. Constraints on academic freedom in industry-initiated clinical trials [abstract]. XIII Cochrane Colloquium. Melbourne, Australia, 2005:43.
10. Gøtzsche PC, Hrobjartsson A, Johansen KJ, Haahr MT, Altman DG, Chan AW. Constraints on Publication Rights in Industry-Initiated Clinical Trials. Journal of the American Medical Association 2006;295(14):1645-6.
11. Gøtzsche PC, Hro´ bjartsson A, Johansen HK, Haahr MT, Altman DG, Chan AW. Ghost Authorship in Industry-Initiated Randomised Trials. PLoS MEDICINE 2007;4(1):e19.
12. Hrobjartsson A, Chan AW, Haahr MT, Gotzsche PC, Altman DG. Selective reporting of positive outcomes in randomised trials - secondary publication. A comparison of protocols with published reports. Ugeskrift for Laeger 2005;167(34):3189-3191.
13. Hrobjartsson A, Pildal J, Chan A-W, Haarh MT, Altman DG, Gotzsche PC. Comparisons of descriptions of blinding in trial protocols and the published reports [abstract]. 16th Cochrane Colloquium: Evidence in the era of globalisation. Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen. Freiburg, Germany, 2008; Vol. 102:Suppl VI: 8.
14. Hrobjartsson A, Pildal J, Chan AW, Haahr MT, Altman DG, Gøtzsche PC. Reporting on blinding in trial protocols and corresponding publications was often inadequate but rarely contradictory. Journal of Clinical Epidemiology 2009;62(967):e973.
15. Pildal J, Chan AW, Hróbjartsson A, Forfang E, Altman DG, Gøtzsche PC. Comparison of descriptions of allocation concealment in trial protocols and the published reports: cohort study. British Medical Journal 2005;330:1049-52.
16. Chan A-W, Krleza-Jeri K, Schmid I, Altman DG. Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research. Canadian Medical Association Journal 2004;171:735-40.
17. Chan AW, Krleza-Jeric K, Schmid I, Altman D. Outcome reporting bias in government-funded RCTs (comments). Canadian Medical Association Journal 2005;172(7):857.
18. Chan AW, Krleza-Jeric K, Schmid I, Altman D. Selective reporting of results in government-funded randomised trials [abstract]. 12th Cochrane Colloquium: Bridging the Gaps. Ottawa, Ontario, Canada, 2004:94-95.
19. Charles P, Giraudeau B, Dechartres A, Baron G, Ravaud P. Reporting of sample size calculation in randomised controlled trials: review. British Medical Journal 2009;338:b1732.
20. Ewart R, Lausen H, Millian N. Undisclosed changes in outcomes in randomized controlled trials: an observational study. Annals of Family Medicine 2009;7(6):542-6.
21. Gandhi M, Ameli N, Bacchetti P, Sharp GB, French AL, Young M, Gange SJ, Anastos K, Holman S, Levine A, Greenblatt RM. Eligibility criteria for HIV clinical trials and generalizability of results: the gap between published reports and study protocols. AIDS 2005;19(16):1885-96.
22. Hahn S, Williamson PR, Hutton JL. Investigation of within-study selective reporting in clinical research: follow-up of applications submitted to a local research ethics committee. Journal of Evaluations of Clinical Practice 2002;8:353-9.
23. Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P. Comparison of registered and published primary outcomes in randomized controlled trials. Journal of theAMA 2009;302(9):977-84.
24. Pich J, Carne X, Arnaiz JA, Gomez B, Trilla A, Rodes J. Role of a research ethics committee in follow-up and publication of results. Lancet 2003;361:1015-6.
25. Scharf O, Colevas AD. Adverse event reporting in publications compared with sponsor database for cancer clinical trials. Journal of Clinical Oncology 2006;24(24):3933-3938.
26. Shapiro SH, Weijer C, Freedman B. Reporting the study populations of clinical trials: Clear transmission or static on the line?. Journal of Clinical Epidemiology 2000;53:973-979.
27. Soares HP, Daniels S, Kumar A, Clarke M, Scott C, Swann S, Djulbegovic B. Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. British Medical Journal 2004;328:22-25.
28. Vedula SS, Bero L, Scherer RW, Dickersin K. Outcome reporting in industry-sponsored trials of gabapentin for off-label use. New England Journal of Medicine 2009;361(20):1963-71.
29. Vedula SS, Dickersin K. Reporting of trials of gabapentin. New England Journal of Medicine 2010;362(17):1641-2.
30. von Elm E, Rollin A, Blumle A, Senessie C, Low N, Egger M. Selective reporting of outcomes of drug trials? Comparison of study protocols and published articles [abstract]. XIV Cochrane Colloquium. Dublin, Ireland, 2006:47.
31. von Elm E, Röllin A, Blümle A, Huwiler K, Witschi M, Egger M. Publication and non-publication of clinical trials: longitudinal study of applications submitted to a research ethics committee. Swiss Medical Weekly 2008;138:197-203.
32. Barcena L, Pengel L, Morris PJ. Registry of randomized controlled trials in transplantation. Transplantation 2005;80(11):1525-34.
33. Bardy AH. Bias in reporting clinical trials. British Journal of Clinical Pharmacology 1998;46:147-50.
34. Berlin JA, Wacholtz MC. Selective reporting, publication bias and clinical trial registry: an industry perspective. International Journal of Pharmaceutical Medicine 2005;19(5-6):277-284.
35. Chan AW, Altman DG. Identifying outcome reporting bias in randomised trials on PubMed: review of publications and survey of authors. British Medical Journal 2005;330(7494):753.
36. Cooper H, DeNeve K, Charlton K. Finding the missing science: the fate ofstudies submitted for review by a human subjects committee. Psychological Methods 1997;2(4):447-452.
37. Cronin E, Sheldon T. Factors influencing the publication of health research. International Journal of Technology Assessment in Health Care 2004;20:351-5.
38. Decullier E, Lheritier V, Chapuis F. Fate of biomedical research protocolsand publication bias in France: retrospective cohort study. British Medical Journal 2005;331:19-24.
39. Decullier E, Chapuis F. Impact of funding on biomedical research: aretrospective cohort study. BMC public health 2006;6:165.
40. Decullier E, Chapuis F. Oral presentation bias: a retrospective cohort study. Journal of Epidemiology and Community Health 2007;61:190-193.
41. Dickersin K, Min YI, Meinert CL. Factors influencing publication of research results: follow up of applications submitted to two institutional review boards. Journal of the American Medical Association 1992;267:374-8.
42. Dickersin K, Min YI. NIH clinical trials and publication bias. Online Journal of Current Clinical Trials 1993;Doc No. 50(53).
43. Djulbegovic B, Kumar A, Soares H, Hozo I, Bepler G, Clarke M, Bennett C. New cancer treatment successes identified in phase 3 randomised controlled trials conducted by the national cancer institute-sponsored cooperative oncology groups. Archives of Internal Medicine 2008;168(6):632-642.
44. Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias inclinical research. Lancet 1991;337:867-72.
45. Habibzadeh F. Impact of mandatory registration of clinical trials on small medical journals: scenario on emerging bias. Croatian Medical Journal 2006;47(1):181-183.
46. Haidich AB, Ioannidis JP. Effect of early patient enrolment on the time to completion and publication of randomized controlled trials. American Journal of Epidemiology 2001;154:873-80.
47. Hall R, de Antueno C, Webber A. Publication bias in the medical literature: A review by a Canadian Research Ethics Board. Canadian Journal of Anesthesia 2007;54(5):380-388.
48. Ioannidis JPA. Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. Journal of the American Medical Association 1998;279:281-6.
49. Lee HK, Lim KH, Park JH, Park KM, Kim HJ, Kim MY, Lee YS, Kim CJ, Chang JS, Shin SG. A survey of industrial perspectives on the Central Pharmaceutical Affairs Council's review of clinical trial protocols and study reports. Journal of Korean Society for Clinical Pharmacology & Therapeutics 1998;6(1):83-100.
50. Liebeskind DS, Kidwell CS, Saver JL. Empiric evidence of publication bias affecting acute stroke clinical trials. Stroke 1999;30(1):92.
51. Liu XM, Li YP, Wu TX, Liu GJ, Li J. [A survey of the status of funding of registered Chinese trials]. Chinese Journal of Evidence-based Medicine 2008;8(5):305-311.
52. Melander H, Ahlqvist-Rastad, Meijer G, Beermann B. Evidence b(i)ased medicine – selective reporting from studies sponsored by pharmaceutical industry: review of studies in new drug applications. British Medical Journal 2003;326:1171-1173.
53. Menzel S, Uebing B, Hucklenbroich P, Schober O. Evaluation of clinicaltrials following an approval from a research ethics committee. Deutsche Medizinische Wochenschrift 2007;132(44):2313-7.
54. Nurbhai M, Grimshaw J, Moja PL, Liberati A, Chan AW, Dickersin K, Krezla-Jeric K, Moher D. Assessing the quality of information recorded on trial registries [abstract]. XIII Cochrane Colloquium. Melbourne, Australia, 2005:165.
55. Psaty BM, Kronmal RA. Reporting mortality findings in trials of rofecoxib for alzheimer disease or cognitive impairment: a case study based on documents from rofecoxib litigation. Journal of the American Medical Association 2008;299(15):1813-1817.
56. Ramsey S, Scoggins J. Commentary: practicing on the tip of an information iceberg? Evidence of underpublication of registered clinical trials in oncology. Oncologist 2008;13(9):925-9.
57. Rasmussen N, Lee K, Bero L. Association of trial registration with the results and conclusions of published trials of new oncology drugs. Trials 2009;10:116.
58. Rising K, Bacchetti, Bero L. Reporting bias in drug trials submitted to the food and drug administration: review of publication and presentation. PLoS Medicine 2008;5(11):e217.
59. Ross JS, Mulvey GK, Hines EM, Nissen SE, Krumholz HM. Trial publication after registration in ClinicalTrials.Gov: a cross-sectional analysis. PLoS Medicine 2009;6(9):e1000144.
60. Simes RJ. Publication bias: the case for an international registry of clinical trials. Journal of Clinical Oncology 1986;4(10):1529-1541.
61. Stern JM, Simes RJ. Publication bias: evidence of delayed publication in a cohort study of clinical research projects. British Medical Journal 1997;315(7109):640-645.
62. Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. New England Journal of Medicine 2008;358(3):252-60.
63. Chappell L, Alfirevich Z, Chien P, Jarvis S, Thornton JG. A comparison of the published version of randomized controlled trials in a specialist clinical journal with the original trial protocols [abstract]. International Congress on Peer Review and Biomedical Publication. Chicago, Illinois, USA, 2005:27.
64. Djulbegovic B, Kumar A, Magazin A, Soares HP. Quality of randomized controlled trials (RCTS) in hematological malignancies: What was reported versus what was done. Haematologica Conference: 14th Congress of the European Hematology Association. Berlin, Germany, 2009.
65. Djulbegovic B, Kumar A, Magazin A, Schroen AT, Soares H, Hozo I, Clarke M, Sargent DJ, Schell MJ. Optimisim bias leads to inconclusive results - an empirical study. Journal of Clinical Epidemiology 2010 in press.
66. Ghersi D. Issues in the design, conduct and reporting of clinical trials that impact on the quality of decision making. School of Public Health, Faculty of Medicine. University of Sydney 2006.
67. Ghersi D, Clarke M, Simes J. Selective reporting of the primary outcomes of clinical trials: a follow-up study [abstract]. XIV Cochrane Colloquium. Dublin, Ireland, 2006.
68. Jureidini JN, McHenry LB, Mansfield PR. Clinical trials and drug promotion: Selective reporting of study 329. International Journal of Risk & Safety in Medicine 2008;20:73-81.
69. Mhaskar R, Kumar A, Soares H, Gardner B, Djulbegovic B. Treatment related harms: what was planned and what was reported? An analysis of Southwest Oncology Group phase III trials [abstract]. 17th Cochrane Colloquium. Singapore, 2009:49.
70. Smyth RMD, Jacoby A, Altman DG, Gamble C, Kirkham JJ, Williamson PR. Frequency and reasons for outcome reporting bias in clinical trials: interviews with trialists. BMJ 2010 in press.
71. You B, Gan HK, Pond GR, Chen EX. Consistency in reporting of primary endpoints (PEP) from registration to publication for modern randomized oncology phase lll trials. American Society of Clinical Oncology. 2010:454s.
72. personal communication.
73. personal communication.
74. personal communication.
75. personal communication.
76. Chan A-W, Hrobjartsson A, Haahr MT, Gotzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. Journal of the American Medical Association 2004;291:2457-65.
77. Chan AW. Bias, spin and misreporting: time for full access to trial protocols and results. PLoS Medicine 2008;5(11):e230.
78. Chan A, Tetzlaff J, Altman DG, Gotzsche P, Hrobjartsson A, Krleza-Jeric K, Laupacis A, Moher D. The SPIRIT initiative: defining standard protocol items for randomised trials. 16th Cochrane Colloquium, Freiburg, Germany (3-7 October, 2008). German Journal for Evidence and Quality in Health Care. 2008; Vol. 102(Suppl VI):S27.
79. Chan A-W, Hrobjartsson A, Jorgensen KJ, Gotzsche PC, Altman DG. Discrepancies in sample size calculations and data analyses reported in randomised trials: comparison of publications with protocols. British Medical Journal 2008;337:a2299.
80. De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, et al. Clinical trial registration: a statement from the International Committee of Medical Journal Editors. Lancet 2004;364:911-2.
81. Dickersin K, Chan S, Chalmers TC, Sacks HS, Smith H Jr. Publication bias and clinical trials. Controlled Clinical Trials 1987;8:343-53.
82. Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan A-W, Cronin E, et al. Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS ONE 2008;3:e3081.
83. Ghersi D, Pang T. From Mexico to Mali: four years in thehistory of clinical trial registration. Journal of Evidence Based Medicine 2009;2(1):1-7.
84. Gøtzsche PC, Hrobjartsson A, Johansen KJ, Haahr MT, Altman DG, Chan AW. Constraints on Publication Rights in Industry-Initiated Clinical Trials. Journal of the American Medical Association 2006;295(14):1645-6.
85. Gøtzsche PC, Hrobjartsson A, Johansen HK, Haahr MT, Altman DG, Chan AW. Ghost Authorship in Industry-Initiated Randomised Trials. PLoS Medicine 2007;4(1):e19.
86. Hahn S, Williamson PR, Hutton JL, Garner P, Flynn EV. Assessing the potential for bias in meta-analysis due to selective reporting of subgroup analyses within studies. Statistics in Medicine 2000;19:3325-36.
87. Hopewell S, Loudon K, Clarke MJ, Oxman AD, Dickersin K. Publication bias in clinical trials due to statistical significance or direction of trial results. Cochrane Database of Systematic Reviews 2009, Issue 1. [DOI: 10.1002/14651858.MR000006.pub3]
88. Hrobjartsson A, Pildal J, Chan AW, Haahr MT, Altman DG, Gøtzsche PC. Reporting on blinding in trial protocols and corresponding publications was often inadequate but rarely contradictory. Journal of Clinical Epidemiology 2009;62(967):e973.
89. Hutton JL, Williamson PR. Bias in meta-analysis due to outcome variable selection within studies. Applied Statistics 2000;49:359-70.
90. Kirkham JJ, Dwan KM, Altman DG, Gamble C, Dodd S, Smyth RMD, Williamson PR. The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. British Medical Journal 2010;340:c365.
91. Moja LP, Moschetti I, Nurbhai M, Compagnoni A, Liberati A, Grimshaw JM, Chan AW, Dickersin K, Krleza-Jeric K, Moher D, Sim I, Volmink J. Compliance of clinical trial registries with the World Health Organization minimum data set: a survey. Trials 2009;10(56).
92. Pildal J, Chan AW, Hróbjartsson A, Forfang E, Altman DG, Gøtzsche PC. Comparison of descriptions of allocation concealment in trial protocols and the published reports: cohort study. British Medical Journal 2005;330:1049-52.
93. Schulz KF, Altman DG, Moher D, for the CONSORT Group. CONSORT 2010 Statement: Updated Guidelines for Reporting Parallel Group Randomised Trials. PLoS Medicine 2010;7(3):e1000251.
94. Simes RJ. Publication bias: the case for an international registry of clinical trials. Journal of Clinical Oncology 1986;4:1529-41.
95. Tannock IF. False-positive results in clinical trials: multiple significance tests and the problem of unreported comparisons. Journal of the National Cancer Institute 1996;88:206-7.
96. Wang R, Lagakos SW, Ware JH, Hunter DJ, Drazen JM. Statistics in medicine — Reporting of subgroup analyses in clinical trials. New England Journal of Medicine 2007;357(21):2189-2194.
97. World Health Organization. World Health Organization international clinical trials registry platform. New standards for registration of human medical research. http://www.who.int/mediacentre/news/releases/2006/pr25/en/ (Accessed 27 October 2010) 2006.
98. Williamson PR, Gamble C. Identification and impact of outcome selection bias in meta-analysis. Statistics in Medicine 2005;24:1547-61.
99. Williamson PR, Gamble C, Altman DG, Hutton JL. Outcome selection bias in meta-analysis. Statistical Methods in Medical Research 2005;14:515-24.