Reproducible research practices, transparency, and open access data in the biomedical literature, 2015–2017

PLoS Biology

Volumn 16, Issue 11, 2018, Pages

  Wallach, Joshua D ^a,b   Boyack, Kevin W ^c   Ioannidis, John P A ^d,e  

^a YALE UNIVERSITY   (United States)

^b YALE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c SciTech Strategies Inc   (United States)

^d STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^e STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CONFLICT OF INTEREST; FUNDING; HUMAN; MEDLINE; RANDOM SAMPLE; REPRODUCIBILITY; ACCESS TO INFORMATION; ECONOMICS; ETHICS; INFORMATION DISSEMINATION; INTERPERSONAL COMMUNICATION; MEDICAL RESEARCH; PROCEDURES; PUBLICATION; STANDARDS;

ACCESS TO INFORMATION; BIOMEDICAL RESEARCH; CONFLICT OF INTEREST; DISCLOSURE; HUMANS; INFORMATION DISSEMINATION; PUBLICATIONS; REPRODUCIBILITY OF RESULTS;

EID: 85056803821     PISSN: 15449173     EISSN: 15457885     Source Type: Journal    
DOI: 10.1371/journal.pbio.2006930     Document Type: Article

References (42)

1. Baker M, 1,500 scientists lift the lid on reproducibility. Nature. 2016;533(7604):452–4. doi: 10.1038/533452a pmid: 27225100
2. Munafò MR, Nosek BA, Bishop DVM, Button KS, Chambers CD, Percie du Sert N, et al. A manifesto for reproducible science. Nature human behavior. 2017;1(0021)
3. Wallach JD, Gonsalves GS, Ross JS, Research, regulatory, and clinical decision-making: the importance of scientific integrity. J Clin Epidemiol. 2017. Epub 2017/10/16. doi: 10.1016/j.jclinepi.2017.08.021 pmid: 29042327
4. Ioannidis JP, How to make more published research true. PLoS Med. 2014;11(10):e1001747. doi: 10.1371/journal.pmed.1001747 pmid: 25334033; PubMed Central PMCID: PMC4204808
5. Ioannidis JP, Greenland S, Hlatky MA, Khoury MJ, Macleod MR, Moher D, et al. Increasing value and reducing waste in research design, conduct, and analysis. Lancet. 2014;383(9912):166–75. doi: 10.1016/S0140-6736(13)62227-8 pmid: 24411645; PubMed Central PMCID: PMC4697939
6. Nosek BA, Alter G, Banks GC, Borsboom D, Bowman SD, Breckler SJ, et al. SCIENTIFIC STANDARDS. Promoting an open research culture. Science. 2015;348(6242):1422–5. doi: 10.1126/science.aab2374 pmid: 26113702; PubMed Central PMCID: PMC4550299
7. Iqbal SA, Wallach JD, Khoury MJ, Schully SD, Ioannidis JP, Reproducible Research Practices and Transparency across the Biomedical Literature. PLoS Biol. 2016;14(1):e1002333. doi: 10.1371/journal.pbio.1002333 pmid: 26726926; PubMed Central PMCID: PMC4699702
8. Institute of Medicine (IOM)Sharing Clinical Trial Data: Maximizing Benefits, Minimizing Risks. Washington, DC: The National Academies Press. 2015
9. Taichman DB, Backus J, Baethge C, Bauchner H, de Leeuw PW, Drazen JM, et al. Sharing Clinical Trial Data—A Proposal from the International Committee of Medical Journal Editors. N Engl J Med. 2016;374(4):384–6. Epub 2016/01/20. doi: 10.1056/NEJMe1515172 pmid: 26786954
10. Taichman DB, Sahni P, Pinborg A, Peiperl L, Laine C, James A, et al. Data Sharing Statements for Clinical Trials: A Requirement of the International Committee of Medical Journal Editors. JAMA. 2017;317(24):2491–2492. PubMed Central doi: 10.1001/jama.2017.6514 pmid: 28586895
11. Naudet F, Sakarovitch C, Janiaud P, Cristea I, Fanelli D, Moher D, et al. Data sharing and reanalysis of randomized controlled trials in leading biomedical journals with a full data sharing policy: survey of studies published in. BMJ. 2018;360:k400. Epub 2018/02/13. doi: 10.1136/bmj.k400 pmid: 29440066; PubMed Central PMCID: PMC5809812
12. Goodman SN, Fanelli D, Ioannidis JP, What does research reproducibility mean?Sci Transl Med. 2016;8(341):341ps12. doi: 10.1126/scitranslmed.aaf5027 pmid: 27252173
13. Open Science CollaborationEstimating the reproducibility of psychological science. Science. 2015;349(6251):aac4716. doi: 10.1126/science.aac4716 pmid: 26315443
14. Nosek BA, Errington TM, Making sense of replications. Elife. 2017;6. Epub 2017/01/19. doi: 10.7554/eLife.23383 pmid: 28100398; PubMed Central PMCID: PMC5245957
15. Ioannidis JPA, The Reproducibility Wars: Successful, Unsuccessful, Uninterpretable, Exact, Conceptual, Triangulated, Contested Replication. Clin Chem. 2017;63(5):943–5. Epub 2017/03/15. doi: 10.1373/clinchem.2017.271965 pmid: 28298413
16. McDougall JA, Ferucci ED, Glover J, Fraenkel L, Telerheumatology: A Systematic Review. Arthritis Care Res (Hoboken). 2017;69(10):1546–57. Epub 2017/08/22. doi: 10.1002/acr.23153 pmid: 27863164; PubMed Central PMCID: PMC5436947
17. Mortuaire G, Leroy X, Vandenhende-Szymanski C, Chevalier D, Thisse AS, Comparison of endoscopic and external resections for sinonasal instestinal-type adenocarcinoma. Eur Arch Otorhinolaryngol. 2016;273(12):4343–50. Epub 2016/06/30. doi: 10.1007/s00405-016-4181-4 pmid: 27363404
18. Riechelmann RP, Wang L, O'Carroll A, Krzyzanowska MK, Disclosure of conflicts of interest by authors of clinical trials and editorials in oncology. J Clin Oncol. 2007;25(29):4642–7. doi: 10.1200/JCO.2007.11.2482 pmid: 17925561
19. Jagsi R, Sheets N, Jankovic A, Motomura AR, Amarnath S, Ubel PA, Frequency, nature, effects, and correlates of conflicts of interest in published clinical cancer research. Cancer. 2009;115(12):2783–91. doi: 10.1002/cncr.24315 pmid: 19434666
20. Bekelman JE, Li Y, Gross CP, Scope and impact of financial conflicts of interest in biomedical research: a systematic review. JAMA. 2003;289(4):454–65. pmid: 12533125
21. NIHConflict of Interest in Medical Research, Education, and Practice. Washington (DC): National Academies Press (US); 2009
22. Soler L, Labas V, Thélie A, Teixeira-Gomes AP, Grasseau I, Bouguereau L, et al. Data on endogenous chicken sperm peptides and small proteins obtained through Top-Down High Resolution Mass Spectrometry. Data Brief. 2016;8:1421–5. Epub 2016/08/16. doi: 10.1016/j.dib.2016.07.050 pmid: 27617276; PubMed Central PMCID: PMC5007419
23. PLoS ONE. Data Availability. Available from: http://journals.plos.org/plosone/s/data-availability., PLoS ONE. Data Availability. Available from: http://journals.plos.org/plosone/s/data-availability
24. Federer LM, Belter CW, Joubert DJ, Livinski A, Lu YL, Snyders LN, et al. Data sharing in PLoS ONE: An analysis of Data Availability Statements. PLoS ONE. 2018;13(5):e0194768. doi: 10.1371/journal.pone.0194768 pmid: 29719004
25. Kidwell MC, Lazarević LB, Baranski E, Hardwicke TE, Piechowski S, Falkenberg LS, et al. Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method for Increasing Transparency. PLoS Biol. 2016;14(5):e1002456. doi: 10.1371/journal.pbio.1002456 pmid: 27171007; PubMed Central PMCID: PMC4865119
26. National Institutes of Health. Plan for Increasing Access to Scientific Publications and Digital Scientific Data from NIH Funded Scientific Research. February 2015
27. Silagy CA, Middleton P, Hopewell S, Publishing protocols of systematic reviews: comparing what was done to what was planned. JAMA. 2002;287(21):2831–4. pmid: 12038926
28. Page MJ, Altman DG, Shamseer L, McKenzie JE, Ahmadzai N, Wolfe D, et al. Reproducible research practices are underused in systematic reviews of biomedical interventions. J Clin Epidemiol. 2018;94:8–18. Epub 2017/11/04. doi: 10.1016/j.jclinepi.2017.10.017 pmid: 29113936
29. Ioannidis JP, Why most published research findings are false. PLoS Med. 2005;2(8):e124. doi: 10.1371/journal.pmed.0020124 pmid: 16060722; PubMed Central PMCID: PMC1182327
30. Small H, Tseng H, Patek M, Discovering discoveries: Identifying biomedical discoveries using citation contexts. Journal of Informetrics. 2017;11(1)
31. Chavalarias D, Wallach JD, Li AH, Ioannidis JP, Evolution of Reporting P Values in the Biomedical Literature, 1990–2015. JAMA. 2016;315(11):1141–8. doi: 10.1001/jama.2016.1952 pmid: 26978209
32. Nosek BA, Spies JR, Motyl M, Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth Over Publishability. Perspect Psychol Sci. 2012;7(6):615–31. doi: 10.1177/1745691612459058 pmid: 26168121
33. BMC Research Notes. Aims and scope. https://bmcresnotes.biomedcentral.com/
34. de Weerd-Wilson D, Gunn W, How Elsevier is breaking down barriers to reproducibility. 2017
35. Ioannidis JP, Why replication has more scientific value than original discovery. Behavioral and Brain Sciences. 2018;41:e137
36. U.S. National Library of Medicine. Funding Support (Grant) Information in MEDLINE/PubMed. 2018. Available from: https://www.nlm.nih.gov/bsd/funding_support.html., U.S. National Library of Medicine. Funding Support (Grant) Information in MEDLINE/PubMed. 2018. Available from: https://www.nlm.nih.gov/bsd/funding_support.html
37. U.S. National Library of Medicine. Grant Number Information Found in the GR Field in MEDLINE/PubMed. 2018. Available from: https://www.nlm.nih.gov/bsd/grant_acronym.html., U.S. National Library of Medicine. Grant Number Information Found in the GR Field in MEDLINE/PubMed. 2018. Available from: https://www.nlm.nih.gov/bsd/grant_acronym.html
38. Chiu K, Grundy Q, Bero L, 'Spin' in published biomedical literature: A methodological systematic review. PLoS Biol. 2017;15(9):e2002173. doi: 10.1371/journal.pbio.2002173 pmid: 28892482; PubMed Central PMCID: PMC5593172
39. Börner K, Klavans R, Patek M, Zoss AM, Biberstine JR, Light RP, et al. Design and update of a classification system: the UCSD map of science. PLoS ONE. 2012;7(7):e39464. doi: 10.1371/journal.pone.0039464 pmid: 22808037; PubMed Central PMCID: PMC3395643
40. Klavans R, Koyack BW, Research portfolio analysis and topic prominence. Journal of Informetrics. 2017;11(4)
41. Boyack KW, Van Eck NJ, Colavizza G, Waltman L, Characterizing in-text citations in scientific articles: A large-scale analysis. Journal of Informetrics. 2018;12(1):59–73
42. Ioannidis JPA, The Proposal to Lower P Value Thresholds to.005. JAMA. 2018;319(14):1429–30. doi: 10.1001/jama.2018.1536 pmid: 29566133