Systematic review finds that study data not published in full text articles have unclear impact on meta-analyses results in medical research

PLoS ONE

Volumn 12, Issue 4, 2017, Pages

  Schmucker, Christine M ^a   Blümle, Anette ^a   Schell, Lisa K ^b   Schwarzer, Guido ^c   Oeller, Patrick ^a   Cabrera, Laura ^a   Von Elm, Erik ^d   Briel, Matthias ^e   Meerpohl, Joerg J ^a  

^a UNIVERSITY OF FREIBURG   (Germany)

^b INSTITUTE FOR QUALITY AND EFFICIENCY IN HEALTH CARE IQWIG   (Germany)

^c UNIVERSITY OF FREIBURG   (Germany)

^d UNIVERSITY OF LAUSANNE   (Switzerland)

^e UNIVERSITY HOSPITAL BASEL   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

BIBLIOGRAPHIC DATABASE; CONFIDENCE INTERVAL; CONTROLLED STUDY; EMPIRICAL RESEARCH; HUMAN; LANGUAGE; MEDICAL RESEARCH; META ANALYSIS; PUBLICATION; SYSTEMATIC REVIEW; INFORMATION DISSEMINATION; META ANALYSIS (TOPIC); PROCEDURES; PUBLISHING;

HUMANS; INFORMATION DISSEMINATION; META-ANALYSIS AS TOPIC; PUBLICATION BIAS; PUBLICATIONS;

EID: 85018837274     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0176210     Document Type: Review

References (43)

1. Higgins JPT, Green S. Cochrane handbook for systematic reviews of interventions version 5.1.0 [updated march 2011]. The cochrane collaboration, 2011. www.cochrane-handbook.Org.
2. Sterne JA, Sutton AJ, Ioannidis JP, Terrin N, Jones DR, Lau J, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ. 2011; 343: d4002. https://doi.org/10.1136/bmj.d4002 PMID: 21784880
3. McAuley L, Pham B, Tugwell P, Moher D. Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses? Lancet. 2000; 356: 1228-1231. https://doi.org/ 10.1016/S0140-6736(00)02786-0 PMID: 11072941
4. Song F, Eastwood AJ, Gilbody S, Duley L, Sutton AJ. Publication and related biases. Health Technol Assess. 2000; 4: 1-115.
5. Hopewell S, McDonald S, Clarke MJ, Egger M. Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database Syst Rev. 2007; 2: MR000010.
6. Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008; 358: 252-260. https://doi.org/10.1056/NEJMsa065779 PMID: 18199864
7. Eyding D, Lelgemann M, Grouven U, Harter M, Kromp M, Kaiser T, et al. Reboxetine for acute treatment of major depression: Systematic review and meta-analysis of published and unpublished placebo and selective serotonin reuptake inhibitor controlled trials. BMJ. 2010; 341: c4737. https://doi.org/10.1136/bmj.c4737 PMID: 20940209
8. Driessen E, Hollon SD, Bockting CL, Cuijpers P, Turner EH. Does publication bias inflate the apparent efficacy of psychological treatment for major depressive disorder? A systematic review and meta-analysis of us national institutes of health-funded trials. PLoS One. 2015; 10: e0137864. https://doi.org/10.1371/journal.pone.0137864 PMID: 26422604
9. Cook DJ, Guyatt GH, Ryan G, Clifton J, Buckingham L, Willan A, et al. Should unpublished data be included in meta-analyses? Current convictions and controversies. Jama. 1993; 269: 2749-2753. PMID: 8492400
10. Schmucker C, Schell LK, Portalupi S, Oeller P, Cabrera L, Bassler D, et al. Extent of non-publication in cohorts of studies approved by research ethics committees or included in trial registries. PLoS One. 2014; 9: e114023. https://doi.org/10.1371/journal.pone.0114023 PMID: 25536072
11. Mueller KF, Briel M, Strech D, Meerpohl JJ, Lang B, Motschall E, et al. Dissemination bias in systematic reviews of animal research: A systematic review. PLoS One. 2014; 9: e116016. https://doi.org/10.1371/journal.pone.0116016 PMID: 25541734
12. Mueller KF, Meerpohl JJ, Briel M, Antes G, von Elm E, Lang B, et al. Detecting, quantifying and adjusting for publication bias in meta-analyses: Protocol of a systematic review on methods. Syst Rev. 2013; 2: 60. https://doi.org/10.1186/2046-4053-2-60 PMID: 23885765
13. Portalupi S, von Elm E, Schmucker C, Lang B, Motschall E, Schwarzer G, et al. Protocol for a systematic review on the extent of non-publication of research studies and associated study characteristics. Syst Rev. 2013; 2: 2. https://doi.org/10.1186/2046-4053-2-2 PMID: 23302739
14. Mueller KF, Meerpohl JJ, Briel M, Antes G, von Elm E, Lang B, et al. Methods for detecting, quantifying, and adjusting for dissemination bias in meta-analysis are described. J Clin Epidemiol. 2016; 80: 25-33. https://doi.org/10.1016/j.jclinepi.2016.04.015 PMID: 27502970
15. Schmucker C, Bluemle A, Briel M, Portalupi S, Lang B, Motschall E, et al. A protocol for a systematic review on the impact of unpublished studies and studies published in the gray literature in meta-analyses. Syst Rev. 2013; 2: 24. https://doi.org/10.1186/2046-4053-2-24 PMID: 23634657
16. Scherer RW, Langenberg P, von Elm E. Full publication of results initially presented in abstracts. Cochrane Database Syst Rev. 2007; MR000005. https://doi.org/10.1002/14651858.MR000005.pub3 PMID: 17443628
17. McAuley LM, Moher D, Tugwell P. The role of grey literature in meta-analysis [abstract]. Third International Congress on Biomedical Peer Review and Global Communications; 1997 Sept 18-20; Prague, Czech Republic. 1997.
18. Burdett S, Stewart LA. Publication bias and meta-analysis: A practical example [abstract]. 8th Annual Cochrane Colloquium; 2000 Oct 25-29; Cape Town, South Africa. 2000; 12.
19. Burdett S, Stewart LA, Tierney JF. Publication bias and meta-analyses: A practical example. Int J Technol Assess Health Care. 2003; 19: 129-134. PMID: 12701945
20. Martin JLR, Perez V, Sacristan M, Alvarez E. Is grey literature essential for a better control of publication bias in psychiatry? An example from three meta-analyses fo schizophrenia. European Psychiatry. 2005; 20: 550-553. https://doi.org/10.1016/j.eurpsy.2005.03.011 PMID: 15994063
21. Fergusson D, Laupacis A, Salmi LR, McAlister FA, Huet C. What should be included in meta-analyses? An exploration of methodological issues using the ispot meta-analyses. Int J Technol Assess Health Care. 2000; 16: 1109-1119. PMID: 11155831
22. Egger M, Juni P, Bartlett C, Holenstein F, Sterne J. How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technology Assessment. 2003; 7: 1-76.
23. Hart B, Lundh A, Bero L. Effect of reporting bias on meta-analyses of drug trials: Reanalysis of metaanalyses. BMJ. 2012; 344: d7202. https://doi.org/10.1136/bmj.d7202 PMID: 22214754
24. Golder S, Loke YK, Wright K, Norman G. Reporting of adverse events in published and unpublished studies of health care interventions: A systematic review. PLoS Med. 2016; 13: e1002127. https://doi. org/10.1371/journal.pmed.1002127 PMID: 27649528
25. Golder S, Loke YK, Bland M. Unpublished data can be of value in systematic reviews of adverse effects: Methodological overview. J Clin Epidemiol. 2010; 63: 1071-1081. https://doi.org/10.1016/j.jclinepi. 2010.02.009 PMID: 20457510
26. Lundh A, Sismondo S, Lexchin J, Busuioc OA, Bero L. Industry sponsorship and research outcome. Cochrane Database Syst Rev. 2012; 12: Mr000033. https://doi.org/10.1002/14651858.MR000033. pub2 PMID: 23235689
27. Hopewell S. Impact of grey literature on systematic reviews of randomized trials [phd thesis]. Oxford: Wolfson College, University of Oxford. 2004.
28. Sterne JA, Juni P, Schulz KF, Altman DG, Bartlett C, Egger M. Statistical methods for assessing the influence of study characteristics on treatment effects in 'meta-epidemiological' research. Stat Med. 2002; 21: 1513-1524. https://doi.org/10.1002/sim.1184 PMID: 12111917
29. Rennie D. Fair conduct and fair reporting of clinical trials. Jama. 1999; 282: 1766-1768. PMID: 10568651
30. Scherer RW, Ugarte-Gil C, Schmucker C, Meerpohl JJ. Authors report lack of time as main reason for unpublished research presented at biomedical conferences: A systematic review. J Clin Epidemiol. 2015; 68: 803-810. https://doi.org/10.1016/j.jclinepi.2015.01.027 PMID: 25797837
31. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. Grade: An emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008; 336: 924-926. https://doi.org/10.1136/bmj.39489.470347.AD PMID: 18436948
32. Clarke M, Hopewell S, Chalmers I. Clinical trials should begin and end with systematic reviews of relevant evidence: 12 years and waiting. Lancet. 2010; 376: 20-21. https://doi.org/10.1016/S0140-6736 (10)61045-8 PMID: 20609983
33. MacLean CH, Morton SC, Ofman JJ, Roth EA, Shekelle PG. How useful are unpublished data from the food and drug administration in meta-analysis? J Clin Epidemiol. 2003; 56: 44-51. PMID: 12589869
34. Kepes S, Banks G, McDaniel M, Whetzel D. Publication bias in the organizational sciences. Organizational Research Methods. 2012; 15: 624-662.
35. Langhorne P. Bias in meta-analysis detected by a simple, graphical test. Prospectively identified trials could be used for comparison with meta-analyses. BMJ. 1998; 316: 471.
36. David SP, Ware JJ, Chu IM, Loftus PD, Fusar-Poli P, Radua J, et al. Potential reporting bias in fmri studies of the brain. PLoS One. 2013; 8: e70104. https://doi.org/10.1371/journal.pone.0070104 PMID: 23936149
37. Loder E, Tovey D, Godlee F. The tamiflu trials. BMJ. 2014; 348: g2630. https://doi.org/10.1136/bmj. g2630 PMID: 24811414
38. Chan AW, Song F, Vickers A, Jefferson T, Dickersin K, Gotzsche PC, et al. Increasing value and reducing waste: Addressing inaccessible research. Lancet. 2014; 383: 257-266. https://doi.org/10.1016/ S0140-6736(13)62296-5 PMID: 24411650
39. Meerpohl JJ, Schell LK, Bassler D, Gallus S, Kleijnen J, Kulig M, et al. Evidence-informed recommendations to reduce dissemination bias in clinical research: Conclusions from the open (overcome failure to publish negative findings) project based on an international consensus meeting. BMJ Open. 2015; 5: e006666. https://doi.org/10.1136/bmjopen-2014-006666 PMID: 25943371
40. Boutron I, Dechartres A, Baron G, Li J, Ravaud P. Sharing of data from industry-funded registered clinical trials. Jama. 2016; 315: 2729-2730. https://doi.org/10.1001/jama.2016.6310 PMID: 27367768
41. Miller JE, Korn D, Ross JS. Clinical trial registration, reporting, publication and fdaaa compliance: A cross-sectional analysis and ranking of new drugs approved by the fda in 2012. BMJ Open. 2015; 5: e009758. https://doi.org/10.1136/bmjopen-2015-009758 PMID: 26563214
42. Cohen D. Dabigatran: How the drug company withheld important analyses. BMJ. 2014; 349: g4670. https://doi.org/10.1136/bmj.g4670 PMID: 25055829
43. Maund E, Tendal B, Hrobjartsson A, Jorgensen KJ, Lundh A, Schroll J, et al. Benefits and harms in clinical trials of duloxetine for treatment of major depressive disorder: Comparison of clinical study reports, trial registries, and publications. BMJ. 2014; 348: g3510. https://doi.org/10.1136/bmj.g3510 PMID: 24899650