Increasing value and reducing waste in biomedical research: Who's listening?

The Lancet

Volumn 387, Issue 10027, 2016, Pages 1573-1586

  Moher, David ^a,b   Glasziou, Paul ^c   Chalmers, Iain ^d   Nasser, Mona ^e   Bossuyt, Patrick M M ^f   Korevaar, Daniël A ^f   Graham, Ian D ^a,b   Ravaud, Philippe ^g   Boutron, Isabelle ^g  

^a OTTAWA HOSPITAL RESEARCH INSTITUTE   (Canada)

^b UNIVERSITY OF OTTAWA   (Canada)

^c BOND UNIVERSITY   (Australia)

^d James Lind Initiative   (United Kingdom)

^e PLYMOUTH UNIVERSITY PENINSULA SCHOOLS OF MEDICINE AND DENTISTRY   (United Kingdom)

^f UNIVERSITY OF AMSTERDAM   (Netherlands)

^g PARIS DESCARTES UNIVERSITY   (France)

Author keywords

[No Author keywords available]

Indexed keywords

CLINICAL PROTOCOL; FUNDING; INVESTMENT; MEDICAL RESEARCH; PRIORITY JOURNAL; REVIEW; COOPERATION; HUMAN; METHODOLOGY; PERSONNEL; STANDARDS;

BIOMEDICAL RESEARCH; COOPERATIVE BEHAVIOR; HUMANS; RESEARCH DESIGN; RESEARCH PERSONNEL;

EID: 84945577445     PISSN: 01406736     EISSN: 1474547X     Source Type: Journal    
DOI: 10.1016/S0140-6736(15)00307-4     Document Type: Review

References (79)

1. E Hemminki Study of information submitted by drug companies to licensing authorities BMJ 280 1980 833 836
2. RJ Simes Publication bias: the case for an international registry of clinical trials J Clin Oncol 4 1986 1529 1541
3. SJ Chapman, B Shelton, H Mahmood, JE Fitzgerald, EM Harrison, A Bhangu Discontinuation and non-publication of surgical randomised controlled trials: observational study BMJ 349 2014 g6870
4. KL Hudson, FS Collins Sharing and reporting the results of clinical trials JAMA 313 2015 355 356
5. ES Sena, HB van der Worp, PM Bath, DW Howells, MR Macleod Publication bias in reports of animal stroke studies leads to major overstatement of efficacy PLoS Biol 8 2010 e1000344
6. A Liberati An unfinished trip through uncertainties BMJ 328 2004 531
7. C De Angelis, JM Drazen, FA Frizelle the International Committee of Medical Journal Editors Clinical trial registration: a statement from the International Committee of Medical Journal Editors CMAJ 171 2004 606 607
8. DA Zarin, T Tse, NC Ide Trial Registration at ClinicalTrials.gov between May and October 2005 N Engl J Med 353 2005 2779 2787
9. CA Emdin, A Odutayo, AJ Hsiao et al. Association between randomised trial evidence and global burden of disease: cross sectional study (Epidemiological Study of Randomized Trials-ESORT) BMJ 350 2015 h117
10. S Mathieu, I Boutron, D Moher, DG Altman, P Ravaud Comparison of registered and published primary outcomes in randomized controlled trials JAMA 302 2009 977 984
11. S Ramagopalan, AP Skingsley, L Handunnetthi et al. Prevalence of primary outcome changes in clinical trials registered on ClinicalTrials.gov: a cross-sectional study F1000 Res 3 2014 1 10
12. Institute of Medicine Discussion framework for clinical trial data sharing: guiding principles, elements, and activities http://www.iom.edu/Reports/2014/Discussion-Framework-for-Clinical-Trial-Data-Sharing.aspx (accessed Feb 14, 2015).
13. I Chalmers, P Glasziou Avoidable waste in the production and reporting of research evidence Lancet 374 2009 86 89
14. S Crowe, M Fenton, M Hall, K Cowan, I Chalmers Patients', clinicians' and the research communities' priorities for treatment research: there is an important mismatch Res Involv Engagem 1 2015 1 10
15. Y Yordanov, A Dechartres, R Porcher, I Boutron, DG Altman, P Ravaud Avoidable waste of research related to inadequate methods in clinical trials BMJ 350 2015 h809
16. JA Hirst, J Howick, JK Aronson et al. The need for randomization in animal trials: an overview of systematic reviews PLoS One 9 2014 e98856
17. A Blümle, JJ Meerpohl, M Schumacher, E von Elm Fate of clinical research studies after ethical approval - follow-up of study protocols until publication PLoS One 9 2014 e87184
18. Grant SP1 E Mayo-Wilson, GJ Melendez-Torres, P Montgomery Reporting quality of social and psychological intervention trials: a systematic review of reporting guidelines and trial publications PLoS One 8 2013 e65442
19. DW Light, AF Maturo Good Pharma: the public-health model of the Mario Negri Institute 2015 Palgrave Macmillan New York
20. C Leaf The truth in small doses: why we're losing the war on cancer - and how to win it 2013 Simon and Schuster New York
21. National Institute for Health Research Adding value in research quality improvement template http://www.nets.nihr.ac.uk/-data/assets/pdf-file/0008/77219/Quality-Improvement-Template-September-2013.pdf (accessed March 5, 2015).
22. National Institute for Health Research Guidance notes for applicants that ensure all primary research is informed by a review of the existing literature http://www.nets.nihr.ac.uk/-data/assets/pdf-file/0006/77217/Guidance-notes
23. I Chalmers, MB Bracken, B Djulbegovic et al. How to increase value and reduce waste when research priorities are set Lancet 383 2014 156 165
24. JP Ioannidis, S Greenland, MA Hlatky et al. Increasing value and reducing waste in research design, conduct, and analysis Lancet 383 2014 166 175
25. R Al-Shahi Salman, E Beller, J Kagan et al. Increasing value and reducing waste in biomedical research regulation and management Lancet 383 2014 176 185
26. AW Chan, F Song, A Vickers et al. Increasing value and reducing waste: addressing inaccessible research Lancet 383 2014 257 266
27. P Glasziou, DG Altman, P Bossuyt et al. Reducing waste from incomplete or unusable reports of biomedical research Lancet 383 2014 267 276
28. S Kleinert, R Horton How should medical science change? Lancet 383 2014 197 198
29. Symposium on the Lancet Series on Research: Increasing value, reducing waste http://www.profbriefings.co.uk/dhlancet2013 (accessed March 5, 2015).
30. L Frank, E Basch, JV Selby the Patient-Centered Outcomes Research Institute The PCORI perspective on patient-centered outcomes research JAMA 312 2014 1513 1514
31. P Williamson, D Altman, J Blazeby, M Clarke, E Gargon Driving up the quality and relevance of research through the use of agreed core outcomes J Health Serv Res Policy 17 2012 1 2
32. PS Tugwell, LJ Maxwell, DE Beaton et al. Deliberative dialogue on developing consensus on measurement and presentation of patient important outcomes in systematic reviews: a preconference meeting at OMERACT 12 J Rheumatol 2015 10.3899/jrheum.141430 published online Feb 1.
33. N Kuhrt Systemkritik: Wissenschaftselite beklagt zu viel Forschungsmüll http://www.spiegel.de/wissenschaft/medizin/lancet-spezial-fuer-mehr-qualitaet-in-der-wissenschaft-a-942328.html (accessed March 5, 2015).
34. Abridged Index Medicus (AIM or "Core Clinical") Journal Titles http://www.nlm.nih.gov/bsd/aim.html (accessed March 5, 2015).
35. The Times Higher Education World University Rankings http://www.timeshighereducation.co.uk/world-university-rankings/2013-14/world-ranking (accessed March 5, 2015).
36. KW Boyack, R Klavans, AA Sorensen, JP Ioannidis A list of highly influential biomedical researchers, 1996-2011 Eur J Clin Invest 43 2013 1339 1365 (PMID: 24134636).
37. EQUATOR Network Scientific Meeting: Improving reporting to decrease the waste of research http://www.equator-network.org/2014/08/06/scientific-meeting-improving-reporting-to-decrease-the-waste-of-research (accessed March 5, 2015)
38. Institut National de la Santé et de la Recherche Médicale Plan Stratégique Inserm 2016-2020 http://reunions-inserm2015.com/uploads/event-member/103354/4leplanstrategique20152020.pdf.pp2-6 (accessed March 5, 2015).
39. Opening Session Increasing value, reducing waste. In National Health and Medical Research Council. 3rd Annual NHMRC Symposium on Research Translation https://www.nhmrc.gov.au/-files-nhmrc/file/media/events/2014/3rd-annual-research-translation-symposium-141112.pdf Nov 12-13, 2014 (accessed Sept 17, 2015).
40. CG Begley, JPA Ioannidis Reproducibility in science: improving the standard for basic and preclinical research Circ Res 116 2015 116 126
41. National Centre for the Replacement Refinement & Reduction of Animals in Research NC3Rs publication bias workshop http://www.nc3rs.org.uk/events/nc3rs-publication-bias-workshop (accessed March 5, 2015).
42. Open Science Collaboration Psychology. Estimating the reproducibility of psychological science Science 28 2015 349 aac4716.
43. N Janz Leading journal verifies articles before publication so far all replications failed https://politicalsciencereplication.wordpress.com/2015/05/04/leading-journal-verifies-articles-before-publication-so-far-all-replications-failed (accessed Sept 11, 2015).
44. LP Freedman, IM Cockburn, TS Simcoe The economics of reproducibility in preclinical research PLoS Biol 13 2015 e1002165
45. National Institute for Health Research Policy and standards http://www.nihr.ac.uk/policy-and-standards/publishing-research-findings.htm July 9, 2014 (accessed Sept 21, 2015).
46. Canadian Institutes of Health Research Tri-agency open access policy on publications http://www.cihr-irsc.gc.ca/e/32005.html (accessed Sept 15, 2015).
47. Panel on Research Ethics Government of Canada. TCPS 2 (2014) - the latest edition of Tri-Council Policy Statement: ethical conduct for research involving humans http://www.pre.ethics.gc.ca/eng/policy-politique/initiatives/tcps2-eptc2/Default (accessed Sept 15, 2015).
48. D Kyte, H Duffy, B Fletcher et al. Systematic evaluation of the patient-reported outcome (PRO) content of clinical trial protocols PLoS One 9 2014 e110229
49. Health Research Authority Guidance: specific questions that need answering when considering the design of clinical trials. p 1-23 http://www.hra.nhs.uk/documents/2014/05/guidance-questions-considerations-clinical-trials.pdf (accessed March 5, 2015).
50. Academy of Medical Sciences A new pathway for the regulation and governance of health research http://www.acmedsci.ac.uk/policy/policy-projects/a-new-pathway-for-the-regulation-and-governance-of-health-research (accessed March 5, 2015).
51. I Chalmers Health Research Authority's great leap forward on UK trial registration BMJ 347 2013 f5776
52. European Medicines Agency Guide on access to unpublished documents http://www.ema.europa.eu/docs/en-GB/document-library/Other/2014/11/WC500177739.pdf (accessed Sept 24, 2015).
53. S Kleinert, L Benham, D Collingridge, W Summerskill, R Horton Further emphasis on research in context Lancet 384 2014 2176 2177
54. BA Nosek, G Alter, GC Banks et al. Scientific standards. Promoting an open research culture Science 348 2015 1422 1425
55. P Glasziou The role of open access in reducing waste in medical research PLoS Med 11 2014 e1001651
56. L Chan, AW Heinemann, J Roberts Elevating the quality of disability and rehabilitation research: mandatory use of the reporting guidelines Arch Phys Med Rehabil 95 2014 415 417
57. PA Clavien, KD Lillemoe A new policy to implement CONSORT guidelines for surgical randomized controlled trials Ann Surg 260 2014 947 948
58. L Turner, L Shamseer, DG Altman et al. Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals Cochrane Database Syst Rev 11 2012 MR000030
59. A Hirst, DG Altman Are peer reviewers encouraged to use reporting guidelines? A survey of 116 health research journals PLoS One 7 2012 e35621
60. JM Duff, H Leather, EO Walden, KD LaPlant, TJ George Jr Adequacy of published oncology randomized controlled trials to provide therapeutic details needed for clinical application J Natl Cancer Inst 102 2010 702 705
61. JE Dancey From quality of publication to quality of care: translating trials to practice J Natl Cancer Inst 102 2010 670 671
62. FT van de Wetering, RJ Scholten, T Haring, M Clarke, L Hooft Trial registration numbers are underreported in biomedical publications PLoS One 7 2012 e49599
63. F Song, S Parekh, L Hooper et al. Dissemination and publication of research findings: an updated review of related biases Health Technol Assess 14 2010 1 193
64. AP Prayle, MN Hurley, AR Smyth Compliance with mandatory reporting of clinical trial results on ClinicalTrials.gov: cross sectional study BMJ 344 2012 d7373
65. ER Dorsey, J de Roulet, JP Thompson et al. Funding of US biomedical research, 2003-2008 JAMA 303 2010 137 143
66. I Chalmers, M Nylenna A new network to promote evidence-based research Lancet 384 2014 1903 1904
67. S Treweek Trial forge: a systematic approach to making trials more efficient Trials 14 suppl 1 2013 O121
68. P Tenaerts, L Madre, P Archdeacon, RM Califf The Clinical Trials Transformation Initiative: innovation through collaboration Nat Rev Drug Discov 13 2014 797 798
69. National Archives and Record Administration United States. Federal policy for the protection of human subjects https://www.federalregister.gov/articles/2015/09/08/2015-21756/federal-policy-for-the-protection-of-human-subjects (accessed Sept 11, 2015).
70. K Loudon, S Treweek, F Sullivan et al. The PRECIS-2 tool: designing trials that are fit for purpose BMJ 350 2015 h2147
71. C Kilkenny, N Parsons, E Kadyszewski et al. Survey of the quality of experimental design, statistical analysis and reporting of research using animals PLoS One 4 2009 e7824
72. EA McGlynn, SM Asch, J Adams et al. The quality of health care delivered to adults in the United States N Engl J Med 348 2003 2635 2645
73. M Eccles, J Grimshaw, A Walker, M Johnston, N Pitts Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings J Clin Epidemiol 58 2005 107 112
74. National Institute of Health Research Responsible conduct of research training https://oir.nih.gov/sourcebook/ethical-conduct/research-ethics/committee-scientific-conduct-ethics-csce/responsible-conduct-research-training (accessed Sept 21, 2015).
75. American Psychological Association Responsible conduct of research http://apa.org/research/responsible/index.aspx (accessed Sept 21, 2015).
76. D Moher, DG Altman Four proposals to help improve the medical research literature PLoS Med 12 2015 e1001864 10.1371/journal.pmed.1001864
77. C Barnes, I Boutron, B Giraudeau et al. Impact of an online writing aid tool for writing a randomized trial report: the COBWEB (Consort-based WEB tool) randomized controlled trial BMC Med 13 2015 221
78. JP Ioannidis How to make more published research true PLoS Med 11 2014 e1001747
79. JP Ioannidis, MJ Khoury Assessing value in biomedical research: the PQRST of appraisal and reward JAMA 312 2014 483 484