Toward Reproducible Computational Research: An Empirical Analysis of Data and Code Policy Adoption by Journals

PLoS ONE

Volumn 8, Issue 6, 2013, Pages

  Stodden, Victoria ^a   Guo, Peixuan ^a   Ma, Zhaokun ^b  

^a Och Spine at New York Presbyterian Hospitals   (United States)

^b NONE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCESS TO INFORMATION; ALGORITHM; ARTICLE; CODE POLICY; CODING; COMPUTER PROGRAM; DATA ANALYSIS; MATHEMATICAL COMPUTING; POLICY; PUBLICATION; PUBLISHING; REPRODUCIBILITY; SCIENTIFIC LITERATURE; BIOLOGY; ETHICS; MEDICAL ETHICS; THEORETICAL MODEL;

CODES OF ETHICS; COMPUTATIONAL BIOLOGY; MODELS, THEORETICAL; PERIODICALS AS TOPIC; REPRODUCIBILITY OF RESULTS;

EID: 84879254020     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0067111     Document Type: Article

References (23)

1. Donoho D, Maleki A, Ur Rahman I, Shahram M, Stodden V (2009) Reproducible research in computational harmonic analysis. Computing in Science and Engineering 11: 1 8-18. http://www.computer.org/csdl/mags/cs/2009/01/mcs2009010008-abs.html (last accessed May 8, 2013).
2. King G, (1995) Replication, replication. Political Science and Politics 28: 443-499 http://gking.harvard.edu/files/abs/replication-abs.shtml (last accessed May 8, 2013).
3. Mesirov J, (2010) Accessible reproducible research. Science 327: 5964 http://www.sciencemag.org/content/327/5964/415 (last accessed May 8, 2013).
4. Alsheikh-Ali A, Qureshi W, Al-Mallah M, Ioannidis JPA, (2011) Public availability of published research data in high-impact journals. PLoS ONE 6: 9 http://www.plosone.org/article/info:doi%2F10.1371%2Fjournal.pone.0024357 (last accessed May 8, 2013).
5. Wicherts J, Bakker M, Mlenar D, (2011) Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results. PLoS ONE 6: 11 http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0026828 (last accessed May 8, 2013).
6. Nosek B, Bar-Anan Y (2012) Scientific utopia: I. Opening scientific communication. Psychological Inquiry: An International Journal for the Advancement of Psychological Theory, Sept. http://dx.doi.org/10.1080/1047840X.2012.692215 (last accessed May 8, 2013).
7. Nosek B, Spies J, Motyl M, (2012) Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability. Perspectives on Psychological Science 7: 6 http://pps.sagepub.com/content/7/6/615.abstract (last accessed May 8, 2013).
8. Vandewalle P (2012) Code sharing is associated with research impact in image processing. Computing in Science and Engineering 14: 4 42-7. http://www.computer.org/csdl/mags/cs/2012/04/mcs2012040042-abs.html (last accessed May 8, 2013).
9. Reproducible Research. Special Issue, Computing in Science and Engineering 14: 4 11-56. http://ieeexplore.ieee.org/xpl/tocresult.jsp?reload=true&snumber=6241356&punumber=5992 (last accessed May 8, 2013).
10. Stodden V, Mitchell I, LeVeque R (2012) Reproducible research for scientific computing: Tools and strategies for changing the culture. Computing in Science and Engineering 14: 4 13-17. http://www.computer.org/csdl/mags/cs/2012/04/mcs2012040013-abs.html (last accessed May 8, 2013).
11. Yale Roundtable Participants, (2010) Reproducible research: Addressing the need for data and code sharing in computational science. Computing in Science and Engineering 12: 5 http://dx.doi.org/10.1109/MCSE.2010.113 (last accessed May 8, 2013).
12. Nature editorial, (2011) Devil in the details. Nature 470: 305-306 http://www.nature.com/nature/journal/v470/n7334/full/470305b.html (last accessed May 8, 2013).
13. Hanson B, Sugden A, Alberts B (2011) Making data maximally available. Science 331: 6018. http://www.sciencemag.org/content/331/6018/649.short (last accessed May 8, 2013). For the full Science policy see http://www.sciencemag.org/site/feature/contribinfo/prep/gen_info.xhtml#dataavail (last accessed May 8, 2013).
14. Merali Z, (2010) Computational science: error. Nature 467: 775-777 http://www.nature.com/news/2010/101013/full/467775a.html (last accessed May 8, 2013).
15. Barnes N, (2010) Publish your computer code: it is good enough. Nature 467: 753 http://www.nature.com/news/2010/101013/full/467753a.html (last accessed May 8, 2013).
16. Committee on Responsibilities of Authorship in the Biological Sciences, National Research Council (2003) Sharing publication-related data and materials: Responsibilities of authorship in the life sciences. National Academies Press, Washington D.C., U S A. http://www.nap.edu/openbook.php?record_id=10613&page=27 (last accessed May 8, 2013).
17. Toronto International Data Release Workshop Authors (2009) Prepublication data sharing. Nature 461: 10 168-70. http://www.nature.com/nature/journal/v461/n7261/full/461168a.html (last accessed May 8, 2013).
18. Brazma A, Hingamp P, Quackenbush J, Sherlock G, Spellman P, et al. (2001) Minimum information about a microarray experiment (MIAME)-toward standards for microarray data. Nature Genetics 29: 365-371.
19. Ferry G, Sulston J (2002) The common thread: A story of science, politics, ethics and the human genome. Joseph Henry Press, Washington, D. C., U S A. http://www.nap.edu/catalog.php?record_id=10373 (last accessed May 8, 2013).
20. The Economist. (2011) An array of errors. The Economist, Sept 10. http://www.economist.com/node/21528593 (last accessed May 8, 2013).
21. Institute of Medicine Committee Report (2012) Evolution of translational omics: Lessons learned and the path forward. National Academies Press, Washington, D.C., U S A. http://iom.edu/Reports/2012/Evolution-of-Translational-Omics.aspx (last accessed May 8, 2013).
22. Editorial (1998) The gatekeepers. Nature Structural Biology 5: 3 164. http://www.nature.com/nsmb/wilma/v5n3.892130820.html (last accessed May 8, 2013).
23. Oak Ridge National Laboratory, Policies on release of human genomic sequence data. Human Genome Project Information, Oak Ridge National Laboratory. http://www.ornl.gov/sci/techresources/Human_Genome/research/bermuda.shtml (last accessed May 8, 2013).