Barriers to and facilitators of interventions to counter publication bias: Thematic analysis of scholarly articles and stakeholder interviews

BMC Health Services Research

Volumn 14, Issue 1, 2014, Pages

  Kien, Christina ^a   Nußbaumer, Barbara ^a   Thaler, Kylie J ^a   Griebler, Ursula ^a   Van Noord, Megan G ^b   Wagner, Petra ^c   Gartlehner, Gerald ^a,d  

^a DANUBE UNIVERSITY KREMS   (Austria)

^b DUKE UNIVERSITY   (United States)

^c AIT AUSTRIAN INSTITUTE OF TECHNOLOGY   (Austria)

^d RTI INTERNATIONAL   (United States)

Author keywords

Access to information; Medical errors prevention control; Peer review; Publication bias; Randomized controlled trials as topic; Trial registration

Indexed keywords

ACCESS TO INFORMATION; AWARENESS; HUMAN; MEDICAL ERROR; PEER REVIEW; PUBLISHING; REGISTER; SEMI STRUCTURED INTERVIEW; SYSTEMATIC REVIEW; THEMATIC ANALYSIS; MEDICAL RESEARCH; PROSPECTIVE STUDY; QUESTIONNAIRE; RESEARCH; STANDARDS; UNITED KINGDOM;

BIOMEDICAL RESEARCH; HUMANS; PEER REVIEW; PROSPECTIVE STUDIES; PUBLICATION BIAS; PUBLISHING; REGISTRIES; RESEARCH REPORT; SURVEYS AND QUESTIONNAIRES; UNITED KINGDOM;

EID: 84988643621     PISSN: None     EISSN: 14726963     Source Type: Journal    
DOI: 10.1186/s12913-014-0551-z     Document Type: Review

References (96)

1. Rothstein H, Sutton AJ, Borenstein M: Publication bias in meta-analysis: prevention, assessment and adjustments. Chichester, England; Hoboken, NJ: Wiley; 2005.
2. Higgins JPT GSe: Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011], The Cochrane Collaboration, 2011. 2011.
3. Song F, Parekh S, Hooper L, Loke YK, Ryder J, Sutton AJ, Hing C, Kwok CS, Pang C, Harvey I: Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess 2010, 14(8):1-193. iii, ix-xi.
4. Thaler K, Kien C, Nußbaumer B, Van Noord MG, Griebler U, Klerings I, Gartlehner G, and on behalf of the UNCOVER Project Consortium. Inadequate use and regulation of interventions against publication bias decreases their effectiveness: a systematic review. Submitted to J Clin Epidemiol, in press.
5. Jones CW, Handler L, Crowell KE, Keil LG, Weaver MA, Platts-Mills TF: Nonpublication of large randomized clinical trials: cross sectional analysis. BMJ 2013, 347:f6104.
6. Dwan K, Gamble C, Williamson PR, Kirkham JJ: Systematic review of the empirical evidence of study publication bias and outcome reporting bias-an updated review. PLoS One 2013, 8(7):e66844.
7. Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P: Comparison of registered and published primary outcomes in randomized controlled trials. JAMA 2009 Sep 2, 302(9):977-984.
8. Kirkham JJ, Dwan KM, Altman DG, Gamble C, Dodd S, Smyth R, Williamson PR: The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ 2010, 340:c365. http://www.bmj.com/content/340/bmj.c365.long.
9. Clark JF: How to peer review a qualitative manuscript. In Peer Review in Health Sciences. Secondth edition. Edited by Godlee F, Jefferson T. London: BMJ Books; 2003:219-235.
10. Endnote. Endnote. Available from: http://endnote.com/
11. Braun V, Clarke V: Using thematic analysis in psychology. Qual Res Psychol 2006, 3(2):77-101.
12. VERBI Software.Consult.Sozialforschung GmbH. MAXQDA Version 10 [December 5, 2013]. Available from: http://www.maxqda.de/
13. Tong A, Sainsbury P, Craig J: Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care: J Int Soc Qual Health Care/ISQua 2007 Dec, 19(6):349-357.
14. Buchinger E: Stakeholder Map. UNCOVER project deliverable D 1.2 2012 [December 5, 2013]. Available from: http://www.ait.ac.at/departments/innovation-systems/uncover/work-packages/work-package-1/
15. Creswell JW: Research design: Qualitative, quantitative, and mixed methods approcahes. Thousand Oaks: SAGE Publications, Inc.; 2009.
16. Ziebland S, McPherson A: Making sense of qualitative data analysis: an introduction with illustrations from DIPEx (personal experiences of health and illness). Med Educ 2006, 40:405-414.
17. Cohen DJ, Crabtree BF: Evaluative criteria for qualitative research in health care: controversies and recommendations. Ann Fam Med 2008, 6(4):331-339.
18. Morse JM, Barrett M, Mayan M, Olson K, Spiers J: Verification strategies for establishing reliability and validity in qualitative research. Int J Qual Meth 2002, 1(1):13-22.
19. Scherer M, Trelle S: Opinions on registering trial details: a survey of academic researchers. BMC Health Serv Res 2008, 8:18.
20. Calnan M, Davey Smith G, Sterne JAC: The publication process itself was the major cause of publication bias in genetic epidemiology. J Clin Epidemiol 2006, 59(12):1312-1318.
21. Lipworth WL, Kerridge IH, Carter SM, Little M: Journal peer review in context: a qualitative study of the social and subjective dimensions of manuscript review in biomedical publishing. Soc Sci Med 2011, 72(7):1056-1063.
22. Hall R, de Antueno C, Webber A: Publication bias in the medical literature: a review by a Canadian Research Ethics Board. Can J Anesth 2007, 54(5):380-388.
23. Koletsi D, Karagianni A, Pandis N, Makou M, Polychronopoulou A, Eliades T: Are studies reporting significant results more likely to be published? Am J Orthod Dentofacial Orthop 2009, 136(5):632. e1-5; discussion -3.
24. McGee RG, Su M, Kelly PJ, Higgins GY, Craig JC, Webster AC: Trial registration and declaration of registration by authors of randomized controlled trials. Transplantation 2011, 92(10):1094-1100.
25. Rising K, Bacchetti P, Bero L: Reporting bias in drug trials submitted to the food and drug administration: review of publication and presentation. PLoS Med 2008, 5(11):1561-1570.
26. Viergever RF, Ghersi D: The quality of registration of clinical trials. PLoS One 2011, 6(2):e14701.
27. Bourgeois FT, Murthy S, Mandl KD: Outcome reporting among drug trials registered in ClinicalTrials.gov. Ann Intern Med 2010, 153(3):158-166.
28. Newton DP: Quality and peer review of research: an adjudicating role for editors. Account Res 2010 May, 17(3):130-145.
29. Antonelli M, Mercurio G: Reporting, access, and transparency: better infrastructure of clinical trials. Crit Care Med 2009 Jan, 37(1 Suppl):S178-S183.
30. Bonita RE, Adams S, Whellan DJ: Reporting of clinical trials: publication, authorship, and trial registration. Heart Fail Clin 2011 Oct, 7(4):561-567.
31. Dickersin K, Rennie D: Registering clinical trials. JAMA 2003 Jul 23, 290(4):516-523.
32. Seigel D: Clinical trials, epidemiology, and public confidence. Stat Med 2003 Nov 15, 22(21):3419-3425.
33. Strech D: Normative arguments and new solutions for the unbiased registration and publication of clinical trials. J Clin Epidemiol 2012 Mar, 65(3):276-281.
34. Dubben HH, Beck-Bornholdt HP: Systematic review of publication bias in studies on publication bias. Br Med J 2005, 331(7514):433-434.
35. Abaid LN, Grimes DA, Schulz KF: Reducing publication bias of prospective clinical trials through trial registration. Contraception 2007 Nov, 76(5):339-341.
36. Abaid LN, Grimes DA, Schulz KF: Reducing publication bias through trial registration. Obstet Gynecol 2007 Jun, 109(6):1434-1437.
37. Bock O: The peer-review process: accept, revise, or reject? Cortex 2002 Jun, 38(3):419-420.
38. Connor JT: Positive reasons for publishing negative findings. Am J Gastroenterol 2008, 103(9):2181-2183.
39. Gøtzsche PC: Readers as research detectives. Trials 2009, 10:2.
40. Henderson A: The insularity bias. Cortex 2002 Jun, 38(3):421-424.
41. Levy G: Publication bias: its implications for clinical pharmacology. Clin Pharmacol Ther 1992 Aug, 52(2):115-119.
42. Liesegang TJ: Revealing the faults in medical journals. Arch Immunol Ther Exp (Warsz) 2009, 57(2):75-83.
43. Steinbrook R: Public registration of clinical trials. N Engl J Med 2004, 351(4):315-317.
44. Staessen JA, Bianchi G: Registration of trials and protocols. Lancet 2003 Sep 27, 362(9389):1009-1010.
45. Gotzsche PC: Why we need easy access to all data from all clinical trials and how to accomplish it. Trials 2011, 12:249.
46. Deangelis CD, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, Kotzin S, Laine C, Marusic A, Overbeke AJ, Schroeder TV, Sox HC, Van Der Weyden MB: Is this clinical trial fully registered? A statement from the International Committee of Medical Journal Editors. JAMA 2005 Jun 15, 293(23):2927-2929.
47. Joober R, Schmitz N, Annable L, Boksa P: Publication bias: What are the challenges and can they be overcome? J Psychiatr Neurosci: JPN 2012, 37(3):149-152.
48. Laine C, Horton R, DeAngelis CD, Drazen JM, Frizelle FA, Godlee F, Haug C, Hebert PC, Kotzin S, Marusic A, Sahni P, Schroeder TV, Sox HC, Van der Weyden MB, Verheugt FW: Clinical trial registration-looking back and moving ahead. N Engl J Med 2007 Jun 28, 356(26):2734-2736.
49. Phillips JS: Expert bias in peer review. Curr Med Res Opin 2011 Dec, 27(12):2229-2233.
50. Reynolds T: Researchers push for publication, registration of all clinical trials. J Natl Cancer Inst 2003 Jun 4, 95(11):772-774.
51. Somberg J: Clinical trials registries. Am J Ther 2003, 10(5):309-310.
52. Tonks A: Registering clinical trials. BMJ 1999 Dec 11, 319(7224):1565-1568.
53. Glymour MM, Kawachi I: Review of publication bias in studies on publication bias: here's a proposal for editors that may help reduce publication bias. BMJ (Clin Res Ed) 2005, 331(7517):638.
54. Easterbrook P: Reducing publication bias. Br Med J (Clin Res Ed) 1987, 295 (6609):1347.
55. Chalmers I: Lessons for research ethics committees. Lancet 2002 Jan 12, 359(9301):174.
56. Reveiz L, Delgado MB, Urrutia G, Ortiz Z, Dieguez MG, Martí-Carvajal A, Calgua E, Vieyra A, Ciapponi A, Hidalgo R, Pantoja T, Sanchez LM, Pecino FM, Tristan M: The Latin American Ongoing Clinical Trial Register (LATINREC). Rev Panam Salud Publ 2006, 19(6):417-422.
57. Gibbs TG, Wager E: Realities of trial registration: the glaxo wellcome experience. Int J Pharmaceut Med 2000, 14(4):203-205.
58. Wager E, Williams P, Failure OPO: "Hardly worth the effort"? Medical journals' policies and their editors' and publishers' views on trial registration and publication bias: quantitative and qualitative study. BMJ 2013, 347:f5248-Article No.: f.
59. EFPIA (European Federation of Pharmaceutical Industries and Associations) & PHRMA: Principles for responsible clinical trial data sharing. Our commitment to patients and researchers. 2013 [July 24, 2013]. Available from: http://transparency.efpia.eu/uploads/Modules/Documents/datasharing-prin-final.pdf.
60. European Medicines Agency: Draft policy 70: Publication and access to clinical-trial data 2013 [July 24, 2013]. Available from: http://www.ema.europa.eu/docs/en-GB/document-library/Other/2013/06/ WC500144730.pdf
61. European Parliament/Legislative Observatory: Clinical trials on medicinal products for human use 2013 [July 24, 2013]. Available from: http://www. europarl.europa.eu/oeil/popups/ficheprocedure.do?reference=2012/0192% 28COD%29&l=EN.
62. ClinicalTrials.gov: About the results database 2012 [September 3, 2012]. Available from: http://clinicaltrials.gov/ct2/about-site/results.
63. European Medicines Agency: EU Clinical Trials Register 2012 [August 5, 2012]. Available from: https://www.clinicaltrialsregister.eu/
64. World Health Organization: Primary Registries 2014 [September 3, 2012]. Available from: http://www.who.int/ictrp/network/primary/en/.
65. Library of Congress: Trial and Experimental Studies Transparency Act of 2012 2013 [November 4, 2013]. Available from: https://www.govtrack.us/ congress/bills/113/hr2031.
66. Chalmers I: Health Research Authority's great leap forward on UK trial registration. BMJ 2013, 347:f5776.
67. NHS Health Research Authority: The Health Research Authority (HRA) interest in good research conduct. Transparent research. London: Health Research Authority (HRA); 2013 [July 24, 2013]. 32]. Available from: http://www.hra.nhs.uk/hra-news-and-announcements/transparent-1053research/
68. International Committee of Medical Journal Editors: Uniform Requirements for Manuscripts Submitted to Biomedical Journals: Publishing and Editorial Issues Related to Publication in Biomedical Journals: Obligation to Register Clinical Trials 2009 [September 3, 2013]. Available from: http://www.icmje.org/icmje-recommendations.pdf.
69. Zarin DA, Tse T, Ide NC: Trial Registration at ClinicalTrials.gov between May and October 2005. N Engl J Med 2005 Dec 29, 353(26):2779-2787.
70. Shibuya K, Ciecierski C, Guindon E, Bettcher DW, Evans DB, Murray CJ: WHO framework convention on tobacco control: development of an evidence based global public health treaty. BMJ 2003 Jul 19, 327(7407):154-157.
71. AllTrials Campaign: All Trials Registered-All Trials Reported 2013 [July 24, 2013]. Available from: http://www.alltrials.net/
72. Dickersin K, Chalmers I: Recognizing, investigating and dealing with incomplete and biased reporting of clinical research: from Francis Bacon to the WHO. J R Soc Med 2011 Dec, 104(12):532-538.
73. Galsworthy MJ, Hristovski D, Lusa L, Ernst K, Irwin R, Charlesworth K, Wismar M, McKee M: Academic output of 9 years of EU investment into health research. Lancet 2012 Sep 15, 380(9846):971-972.
74. Ioannidis JPA: Why most published research findings are false. PLoS Med 2005, 2(8):0696-0701.
75. Fanelli D, Glanzel W: Bibliometric evidence for a hierarchy of the sciences. PLoS One 2013, 8(6):e66938.
76. Savulescu J, Chalmers I, Blunt J: Are research ethics committees behaving unethically? Some suggestions for improving performance and accountability. BMJ 1996 Nov 30, 313(7069):1390-1393.
77. World Medical Association: World Medical Association Declaration of Helsinki Ethical Principles for Medical Research Involving Human Subjects Helsinki, Finland: World Medical Association. 2008 [July 24, 2013]. 1-5]. Available from: http://www.wma.net/en/30publications/10policies/b3/
78. European Science Foundation: Fostering Research Integrity in Europe Strasbourg, France: European Science Foundation. 2010 [July 24, 2013]. 1-44]. Available from: http://www.esf.org/publications/memberorganisation-fora.html
79. European Science Foundation: Open Access in Biomedical Research. Strasbourg, France: European Science Foundation; 2012.
80. European Medicines Agency: European Medicines Agency publishes final advice from clinical-trial advisory groups 2013 [July 24, 2013]. Available from: http://www.ema.europa.eu/ema/index.jsp?curl=pages/news-and-events/news/2013/04/news-detail-001778.jsp&mid=WC0b01ac058004d5c1.
81. European Medicines Agency: European Medicines Agency agrees policy on publication of clinical trial data with more user-friendly amendments 2014 [June 12, 2014]. Available from: http://www.ema.europa.eu/docs/en-GB/document-library/Press-release/2014/06/WC500168342.pdf.
82. Hrynaszkiewicz I, Norton ML, Vickers AJ, Altman DG: Preparing raw clinical data for publication: guidance for journal editors, authors, and peer reviewers. BMJ 2010, 340:c181.
83. Hrynaszkiewicz I, Altman DG: Towards agreement on best practice for publishing raw clinical trial data. Trials 2009, 10:17.
84. The Institute for Quantitative Social Science (Harvard University): The Dataverse Network (TM) Project. A Web Application for Publishing, Citing, Analyzing and Preserving Research Data. 2013 [September 26, 2013]. Available from: http://thedata.org/
85. Godlee F, Groves T: The new BMJ policy on sharing data from drug and device trials. BMJ 2012, 345:e7888.
86. Bailar JC 3rd, Patterson K: Journal peer review: the need for a research agenda. N Engl J Med 1985 Mar 7, 312(10):654-657.
87. Chan AW, Song F, Vickers A, Jefferson T, Dickersin K, Gotzsche PC, Krumholz HM, Ghersi D, van der Worp HB: Increasing value and reducing waste: addressing inaccessible research. Lancet 2014 Jan 18, 383(9913):257-266.
88. Clinical Study Data Request: Clinical Study Data Request 2014 [August 15, 2014]. Available from: https://clinicalstudydatarequest.com/.
89. Adams B: Johnson & Johnson in "game-changing" data disclosure plan 2014 [January 1, 2014]. Available from: http://www.pharmafile.com/news/182206/updated-jj-game-changing-data-disclosure-plan.
90. Walanj AS: Research ethics committees: need for harmonization at the national level, the global and Indian perspective. Perspect Clin Res 2014 Apr, 5(2):66-70.
91. Krleza-Jeric K, Lemmens T, Reveiz L, Cuervo LG, Bero LA: Prospective registration and results disclosure of clinical trials in the Americas: a roadmap toward transparency. Rev Panam Salud Publ 2011 Jul, 30(1):87-96.
92. European Network of Research Ethics Committees-EUREC: European Network of Research Ethics Committees-EUREC 2014 [August 15,2014]. Available from: http://www.eurecnet.org/index.html.
93. World Health Organization: International standards for clinical trial registries Geneva, Switzerland: World Health Organization. 2012 [July 24, 2013]. 1-48]. Available from: http://apps.who.int/iris/handle/10665/76705.
94. European Commission: Medicinal products for human use 2014 [August 15, 2014]. Available from: http://ec.europa.eu/health/human-use/clinicaltrials/ index-en.htm.
95. European Parliament/News: Clinical trials: clearer rules, better protection for patients 2013 [January 12, 2014]. Available from: http://www.europarl.europa.eu/news/en/news-room/content/20131220IPR31630/html/Clinicaltrials-clearer-rules-better-protection-for-patients.
96. Wolfe N, Gotzsche PC, Bero L: Strategies for obtaining unpublished drug trial data: a qualitative interview study. Syst Rev 2013, 2:31.