Inadequate use and regulation of interventions against publication bias decreases their effectiveness: A systematic review

Journal of Clinical Epidemiology

Volumn 68, Issue 7, 2015, Pages 792-802

  Thaler, Kylie ^a   Kien, Christina ^a   Nussbaumer, Barbara ^a   Van Noord, Megan G ^a   Griebler, Ursula ^a   Klerings, Irma ^a   Gartlehner, Gerald ^a,b  

^a DANUBE UNIVERSITY KREMS   (Austria)

^b RTI INTERNATIONAL   (United States)

Author keywords

Conflict of interest; Geographical bias; Open access; Peer review; Publication bias; Trial registration

Indexed keywords

ARTICLE; CONFLICT OF INTEREST; DATA BASE; FINANCIAL MANAGEMENT; GEOGRAPHIC DISTRIBUTION; HUMAN; LOWEST INCOME GROUP; OUTCOME ASSESSMENT; PEER REVIEW; PRACTICE GUIDELINE; PRIORITY JOURNAL; PUBLICATION; PUBLISHING; RANDOMIZED CONTROLLED TRIAL (TOPIC); REGISTER; REGISTRATION; SYSTEMATIC REVIEW; ACCESS TO INFORMATION; COST BENEFIT ANALYSIS; EVALUATION STUDY; INTERPERSONAL COMMUNICATION; LEGISLATION AND JURISPRUDENCE; PROGRAM EVALUATION; PROSPECTIVE STUDY; STANDARDS; STATISTICS AND NUMERICAL DATA;

ACCESS TO INFORMATION; CONFLICT OF INTEREST; COST-BENEFIT ANALYSIS; DISCLOSURE; PEER REVIEW; PRACTICE GUIDELINES AS TOPIC; PROGRAM EVALUATION; PROSPECTIVE STUDIES; PUBLICATION BIAS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REGISTRIES;

EID: 84930574897     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2015.01.008     Document Type: Review

References (72)

1. F. Song, S. Parekh, L. Hooper, Y.K. Loke, J. Ryder, and A.J. Sutton Dissemination and publication of research findings: an updated review of related biases Health Technol Assess 14 2010 iii, ix-xi, 1-193
2. M.J. Galsworthy, D. Hristovski, L. Lusa, K. Ernst, R. Irwin, and K. Charlesworth Academic output of 9 years of EU investment into health research Lancet 380 2012 971 972
3. A.W. Chan, F. Song, A. Vickers, T. Jefferson, K. Dickersin, and P.C. Gotzsche Increasing value and reducing waste: addressing inaccessible research Lancet 383 2014 257 266
4. J.P.T. Higgins, and S. Green Cochrane handbook for systematic reviews of interventions version 5.1.0 [updated March 2011] 2011 The Cochrane Collaboration Oxford, UK Available at: http://handbook.cochrane.org/ Accessed Oct 3, 2014
5. B. Caldwell, S. Aldington, M. Weatherall, P. Shirtcliffe, and R. Beasley Risk of cardiovascular events and celecoxib: a systematic review and meta-analysis J R Soc Med 99 3 2006 132 140
6. J.S. Ross, D. Madigan, K.P. Hill, D.S. Egilman, Y. Wang, and H.M. Krumholz Pooled analysis of rofecoxib placebo-controlled clinical trial data: lessons for postmarket pharmaceutical safety surveillance Arch Intern Med 169 2009 1976 1985
7. B.M. Psaty, and R.A. Kronmal Reporting mortality findings in trials of rofecoxib for Alzheimer disease or cognitive impairment: a case study based on documents from rofecoxib litigation JAMA 299 2008 1813 1817
8. C.J. Whittington, T. Kendall, P. Fonagy, D. Cottrell, A. Cotgrove, and E. Boddington Selective serotonin reuptake inhibitors in childhood depression: systematic review of published versus unpublished data Lancet 363 2004 1341 1345
9. J.N. Jureidini, L.B. McHenry, and P.R. Mansfield Clinical trials and drug promotion: selective reporting of study 329 Int J Risk Saf Med 20 2008 73 81
10. S.S. Vedula, P.S. Goldman, I.J. Rona, T.M. Greene, and K. Dickersin Implementation of a publication strategy in the context of reporting biases. A case study based on new documents from Neurontin litigation Trials 13 2012 136
11. S.S. Vedula, L. Bero, R.W. Scherer, and K. Dickersin Outcome reporting in industry-sponsored trials of gabapentin for off-label use N Engl J Med 361 2009 1963 1971
12. S.E. Nissen, and K. Wolski Rosiglitazone revisited: an updated meta-analysis of risk for myocardial infarction and cardiovascular mortality Arch Intern Med 170 14 2010 1191 1201
13. T. Jefferson, M.A. Jones, P. Doshi, C.B. Del Mar, C.J. Heneghan, and R. Hama Neuraminidase inhibitors for preventing and treating influenza in healthy adults and children Cochrane Database Syst Rev 2012 CD008965
14. D. Eyding, M. Lelgemann, U. Grouven, M. Harter, M. Kromp, and T. Kaiser Reboxetine for acute treatment of major depression: systematic review and meta-analysis of published and unpublished placebo and selective serotonin reuptake inhibitor controlled trials BMJ 341 2010 c4737
15. P. Macaskill, S.D. Walter, and L. Irwig A comparison of methods to detect publication bias in meta-analysis Stat Med 20 2001 641 654
16. N. Terrin, C.H. Schmid, and J. Lau In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias J Clin Epidemiol 58 2005 894 901
17. T. Greenhalgh, and R. Peacock Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources BMJ 331 2005 1064 1065
18. J.J. Deeks, J. Dinnes, R. D'Amico, A.J. Sowden, C. Sakarovitch, and F. Song Evaluating non-randomised intervention studies Health Technol Assess 7 2003 iii-x, 1-173
19. G.H. Guyatt, A.D. Oxman, R. Kunz, G.E. Vist, Y. Falck-Ytter, and H.J. Schunemann What is "quality of evidence" and why is it important to clinicians? BMJ 336 2008 995 998
20. D.A. Zarin, T. Tse, and N.C. Ide Trial registration at ClinicalTrials.gov between May and October 2005 N Engl J Med 353 2005 2779 2787
21. M. Sekeres, J.L. Gold, A.W. Chan, J. Lexchin, D. Moher, and M.L. Van Laethem Poor reporting of scientific leadership information in clinical trial registers PLoS One 3 2 2008 e1610
22. S. Mathieu, I. Boutron, D. Moher, D.G. Altman, and P. Ravaud Comparison of registered and published primary outcomes in randomized controlled trials JAMA 302 2009 977 984
23. N. Rasmussen, K. Lee, and L. Bero Association of trial registration with the results and conclusions of published trials of new oncology drugs Trials 10 2009 116
24. J.S. Ross, G.K. Mulvey, E.M. Hines, S.E. Nissen, and H.M. Krumholz Trial publication after registration in ClinicalTrials.Gov: a cross-sectional analysis PLoS Med 6 9 2009 e1000144
25. L. Reveiz, A.W. Chan, K. Krleza-Jeric, C.E. Granados, M. Pinart, and I. Etxeandia Reporting of methodologic information on trial registries for quality assessment: a study of trial records retrieved from the WHO search portal PLoS One 5 8 2010 e12484
26. L. Reveiz, M. Cortes-Jofre, C. Asenjo Lobos, G. Nicita, A. Ciapponi, and M. Garcia-Dieguez Influence of trial registration on reporting quality of randomized trials: study from highest ranked journals J Clin Epidemiol 63 2010 1216 1222
27. O.M. Dekkers, D. Soonawala, J.P. Vandenbroucke, and M. Egger Reporting of noninferiority trials was incomplete in trial registries J Clin Epidemiol 64 2011 1034 1038
28. M. Huic, M. Marusic, and A. Marusic Completeness and changes in registered data and reporting bias of randomized controlled trials in ICMJE journals after trial registration policy PLoS One 6 9 2011 e25258
29. R.F. Viergever, and D. Ghersi The quality of registration of clinical trials PLoS One 6 2 2011 e14701
30. D.A. Zarin, T. Tse, R.J. Williams, R.M. Califf, and N.C. Ide The ClinicalTrials.gov results database - update and key issues N Engl J Med 364 2011 852 860
31. C.W. Jones, and T.F. Platts-Mills Quality of registration for clinical trials published in emergency medicine journals Ann Emerg Med 60 4 2012 458 464 e1
32. A.P. Prayle, M.N. Hurley, and A.R. Smyth Compliance with mandatory reporting of clinical trial results on ClinicalTrials.gov: cross sectional study BMJ 344 2012 d7373
33. L. Reveiz, X. Bonfill, D. Glujovsky, C.E. Pinzon, C. Asenjo-Lobos, and M. Cortes Trial registration in Latin America and the Caribbean's: study of randomized trials published in 2010 J Clin Epidemiol 65 2012 482 487
34. J.S. Ross, T. Tse, D.A. Zarin, H. Xu, L. Zhou, and H.M. Krumholz Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis BMJ 344 2012 d7292
35. T. Shamliyan, and R.L. Kane Clinical research involving children: registration, completeness, and publication Pediatrics 129 5 2012 e1291 e1300
36. H.N. Smith, M. Bhandari, N.N. Mahomed, M. Jan, and R. Gandhi Comparison of arthroplasty trial publications after registration in ClinicalTrials.gov J Arthroplasty 27 7 2012 1283 1288
37. F.T. van de Wetering, R.J.P.M. Scholten, T. Haring, M. Clarke, and L. Hooft Trial registration numbers are underreported in biomedical publications PLoS One 7 11 2012 e49599
38. B. Wieseler, M.F. Kerekes, V. Vervoelgyi, N. McGauran, and T. Kaiser Impact of document type on reporting quality of clinical drug trials: a comparison of registry reports, clinical study reports, and journal publications BMJ 344 2012 d8141
39. B. You, H.K. Gan, G. Pond, and E.X. Chen Consistency in the analysis and reporting of primary end points in oncology randomized controlled trials from registration to publication: a systematic review J Clin Oncol 30 2012 210 216
40. G. Hannink, H.G. Gooszen, and M.M. Rovers Comparison of registered and published primary outcomes in randomized clinical trials of surgical interventions Ann Surg 257 5 2013 818 823
41. X.Q. Li, G.L. Yang, K.M. Tao, H.Q. Zhang, Q.H. Zhou, and C.Q. Ling Comparison of registered and published primary outcomes in randomized controlled trials of gastroenterology and hepatology Scand J Gastroenterol 48 12 2013 1474 1483
42. J.P. Liu, M. Han, X.X. Li, Y.J. Mu, G. Lewith, and Y.Y. Wang Prospective registration, bias risk and outcome-reporting bias in randomised clinical trials of traditional Chinese medicine: an empirical methodological study BMJ Open 3 7 2013
43. C. Riveros, A. Dechartres, E. Perrodeau, R. Haneef, I. Boutron, and P. Ravaud Timing and completeness of trial results posted at ClinicalTrials.gov and published in journals PLoS Med 10 12 2013 e1001566
44. R. Rosenthal, and K. Dwan Comparison of randomized controlled trial registry entries and content of reports in surgery journals Ann Surg 257 6 2013 1007 1015
45. P. Tharyan, A.T. George, R. Kirubakaran, and J.P. Barnabas Reporting of methods was better in the Clinical Trials Registry - India than in Indian journal publications J Clin Epidemiol 66 2013 10 22
46. A.S. Babu, S.K. Veluswamy, P.T. Rao, and A.G. Maiya Clinical trial registration in physical therapy journals: a cross-sectional study Phys Ther 94 2014 83 90
47. S. Killeen, P. Sourallous, I.A. Hunter, J.E. Hartley, and H.L. Grady Registration rates, adequacy of registration, and a comparison of registered and published primary outcomes in randomized controlled trials published in surgery journals Ann Surg 259 1 2014 193 196
48. T.A. Shamliyan, and R.L. Kane Availability of results from clinical research: failing policy efforts J Epidemiol Glob Health 4 1 2014 1 12
49. R.F. Viergever, G. Karam, A. Reis, and D. Ghersi The quality of registration of clinical trials: still a problem PLoS One 9 1 2014
50. J.S. Ross, C.P. Gross, M.M. Desai, Y. Hong, A.O. Grant, and S.R. Daniels Effect of blinded peer review on abstract acceptance JAMA 295 2006 1675 1680
51. M. Alam, N.A. Kim, J. Havey, A. Rademaker, D. Ratner, and B. Tregre Blinded vs. unblinded peer review of manuscripts submitted to a dermatology journal: a randomized multi-rater study Br J Dermatol 165 2011 563 567
52. S. Mayer Declaration of patent applications as financial interests: a survey of practice among authors of papers on molecular biology in nature J Med Ethics 32 2006 658 661
53. K. Okike, M.S. Kocher, E.X. Wei, C.T. Mehlman, and M. Bhandari Accuracy of conflict-of-interest disclosures reported by physicians N Engl J Med 361 15 2009 1466 1474
54. A.T. Wang, C.P. McCoy, M.H. Murad, and V.M. Montori Association between industry affiliation and position on cardiovascular risk with rosiglitazone: cross sectional systematic review BMJ 340 2010 1344
55. J. Neuman, D. Korenstein, J.S. Ross, and S. Keyhani Prevalence of financial conflicts of interest among panel members producing clinical practice guidelines in Canada and United States: cross sectional study BMJ 343 2011 5621
56. S.L. Norris, H.K. Holmer, L.A. Ogden, B.U. Burda, and R. Fu Characteristics of physicians receiving large payments from pharmaceutical companies and the accuracy of their disclosures in publications: an observational study BMC Med Ethics 13 2012 24
57. S.S. Liyanage, and C. Raina Macintyre Do financial factors such as author page charges and industry funding impact on the nature of published research in infectious diseases? Health Info Libr J 23 2006 214 222
58. A.M. Link US and non-US submissions. An analysis of reviewer bias JAMA 280 1998 246 247
59. T. Opthof, R. Coronel, and M.J. Janse The significance of the peer review process against the background of bias: priority ratings of reviewers and editors and the prediction of citation, the role of geographical bias Cardiovasc Res 56 2002 339 346
60. J.R. Gilbert, E.S. Williams, and G.D. Lundberg Is there gender bias in JAMA's peer review process? JAMA 272 1994 139 142
61. S. van Rooyen, F. Godlee, S. Evans, R. Smith, and N. Black Effect of blinding and unmasking on the quality of peer review: a randomized trial JAMA 280 1998 234 237
62. S. van Rooyen, F. Godlee, S. Evans, N. Black, and R. Smith Effect of open peer review on quality of reviews and on reviewers' recommendations: a randomised trial BMJ 318 1999 23 27
63. S. Van Rooyen, F. Godlee, S. Evans, R. Smith, and N. Black Effect of blinding and unmasking on the quality of peer review J Gen Intern Med 14 1999 622 624
64. S. Schroter, N. Black, S. Evans, J. Carpenter, F. Godlee, and R. Smith Effects of training on quality of peer review: randomised controlled trial BMJ 328 2004 673 Available at http://onlinelibrary.wiley.com/o/cochrane/clcentral/articles/643/CN-00769643/frame.html
65. J.E. Bekelman, Y. Li, and C.P. Gross Scope and impact of financial conflicts of interest in biomedical research: a systematic review JAMA 289 2003 454 465
66. A.W. Jorgensen, J. Hilden, and P.C. Gotzsche Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: systematic review BMJ 333 2006 782
67. A. Lundh, S. Sismondo, J. Lexchin, A. Busuioc Octavian, and L. Bero Industry sponsorship and research outcome Cochrane Database Syst Rev 2012 MR000033 Available at http://onlinelibrary.wiley.com/doi/10.1002/14651858.MR000033.pub2/abstract Accessed March 15, 2014
68. I. Chalmers, and D. Moher Publication bias Lancet 342 1993 1116
69. K. Dickersin, and Y.I. Min Publication bias: the problem that won't go away Ann N Y Acad Sci 703 1993 135 146 discussion 146-8
70. ClinicalTrials.gov. 2012 [updated August 2012; cited 2012 September 3]. Available at http://clinicaltrials.gov/ct2/about-site/history. Accessed September 3, 2012.
71. P.C. Gotzsche Why we need easy access to all data from all clinical trials and how to accomplish it Trials 12 2011 249
72. C. Kien, B. Nussbaumer, K.J. Thaler, M.G. Van Noord, P. Wagner, and G. Gartlehner Barriers to and facilitators of interventions to counterpublication bias: thematic analysis of scholarly articles and stakeholderinterviews BMC Health Services Research 14 2014 551