Digital open science—Teaching digital tools for reproducible and transparent research

PLoS Biology

Volumn 16, Issue 7, 2018, Pages

  Toelch, Ulf ^a,b   Ostwald, Dirk ^b,c  

^a BERLIN INSTITUTE OF HEALTH   (Germany)

^b FREIE UNIVERSITÄT BERLIN   (Germany)

^c MAX PLANCK INSTITUTE FOR HUMAN DEVELOPMENT   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COURSE CONTENT; HUMAN; REPRODUCIBILITY; SCIENTIST; STUDENT; TEACHING; WORKFLOW; BIOMEDICINE; CURRICULUM; EDUCATION; PROGRAM EVALUATION; RESEARCH;

BIOLOGICAL SCIENCE DISCIPLINES; CURRICULUM; PROGRAM EVALUATION; REPRODUCIBILITY OF RESULTS; RESEARCH;

EID: 85051297400     PISSN: 15449173     EISSN: 15457885     Source Type: Journal    
DOI: 10.1371/journal.pbio.2006022     Document Type: Article

References (42)

1. Roche DG, Kruuk LEB, Lanfear R, Binning SA, Public Data Archiving in Ecology and Evolution: How Well Are We Doing?PLoS Biol. 2015;13: e1002295. doi: 10.1371/journal.pbio.1002295 pmid: 26556502
2. Womack RP, Research Data in Core Journals in Biology, Chemistry, Mathematics, and Physics. PLoS ONE. 2015;10: e0143460. doi: 10.1371/journal.pone.0143460 pmid: 26636676
3. Morin A, Urban J, Adams PD, Foster I, Sali A, Baker D, et al. Shining Light into Black Boxes. Science. 2012;336: 159–160. doi: 10.1126/science.1218263 pmid: 22499926
4. Howe A, Howe M, Kaleita AL, Raman DR, Imagining tomorrow’s university in an era of open science. F1000Research. 2017;6. doi: 10.12688/f1000research.11232.2 pmid: 28580128
5. Ioannidis JPA, Greenland S, Hlatky MA, Khoury MJ, Macleod MR, Moher D, et al. Increasing value and reducing waste in research design, conduct, and analysis. Lancet Lond Engl. 2014;383: 166–175. doi: 10.1016/S0140-6736(13)62227-8 pmid: 24411645
6. Avey MT, Moher D, Sullivan KJ, Fergusson D, Griffin G, Grimshaw JM, et al. The Devil Is in the Details: Incomplete Reporting in Preclinical Animal Research. PLoS ONE. 2016;11: e0166733. doi: 10.1371/journal.pone.0166733 pmid: 27855228
7. Begley CG, Ioannidis JPA, Reproducibility in Science: Improving the Standard for Basic and Preclinical Research. Circ Res. 2015;116: 116–126. doi: 10.1161/CIRCRESAHA.114.303819 pmid: 25552691
8. Stodden V, Guo P, Ma Z, Toward Reproducible Computational Research: An Empirical Analysis of Data and Code Policy Adoption by Journals. PLoS ONE. 2013;8: e67111. doi: 10.1371/journal.pone.0067111 pmid: 23805293
9. Baker M, Dutch agency launches first grants programme dedicated to replication. Nat News. doi: 10.1038/nature.2016.20287
10. Collins FS, Tabak LA, NIH plans to enhance reproducibility. Nature. 2014;505: 612–613. pmid: 24482835
11. Providing researchers with the skills and competencies they need to practise Open Science—Report of the Working Group on Education and Skills under Open Science [Internet]. [cited 19 Oct 2017]. https://www.rri-tools.eu/-/providing-researchers-with-the-skills-and-competencies-they-need-to-practise-open-science-report-of-the-working-group-on-education-and-skills-under-op
12. Schmidt B, Orth A, Franck G, Kuchma I, Knoth P, Carvalho J, Stepping up Open Science Training for European Research. Publications. 2016;4: 16. doi: 10.3390/publications4020016
13. Teal TK, Cranston KA, Lapp H, White E, Wilson G, Ram K, et al. Data Carpentry: Workshops to Increase Data Literacy for Researchers. Int J Digit Curation. 2015;10: 135–143. doi: 10.2218/ijdc.v10i1.351
14. Nosek BA, Alter G, Banks GC, Borsboom D, Bowman SD, Breckler SJ, et al. Promoting an open research culture. Science. 2015;348: 1422–1425. doi: 10.1126/science.aab2374 pmid: 26113702
15. Nosek BA, Lakens D, Registered Reports. Soc Psychol. 2014;45: 137–141. doi: 10.1027/1864-9335/a000192 pmid: 28280547
16. Head ML, Holman L, Lanfear R, Kahn AT, Jennions MD, The Extent and Consequences of P-Hacking in Science. PLoS Biol. 2015;13: e1002106. doi: 10.1371/journal.pbio.1002106 pmid: 25768323
17. Kerr NL, HARKing: Hypothesizing After the Results are Known. Personal Soc Psychol Rev. 1998;2: 196–217. doi: 10.1207/s15327957pspr0203_4 pmid: 15647155
18. Munafò MR, Nosek BA, Bishop DVM, Button KS, Chambers CD, du Sert NP, et al. A manifesto for reproducible science. Nat Hum Behav. 2017;1: s41562-016-0021–016. doi: 10.1038/s41562-016-0021
19. Tukey JW, We Need Both Exploratory and Confirmatory. Am Stat. 1980;34: 23–25. doi: 10.1080/00031305.1980.10482706
20. Berman H, Henrick K, Nakamura H, Announcing the worldwide Protein Data Bank. Nat Struct Mol Biol. 2003;10: 980–980. doi: 10.1038/nsb1203-980 pmid: 14634627
21. Poldrack RA, Gorgolewski KJ, OpenfMRI: Open sharing of task fMRI data. NeuroImage. 2017;144, Part B: 259–261. doi: 10.1016/j.neuroimage.2015.05.073 pmid: 26048618
22. Wilkinson MD, Dumontier M, Aalbersberg IjJ, Appleton G, Axton M, Baak A, et al. The FAIR Guiding Principles for scientific data management and stewardship. Sci Data. 2016;3. doi: 10.1038/sdata.2016.18 pmid: 26978244
23. Perkel J, Democratic databases: science on GitHub. Nat News. 2016;538: 127–129. doi: 10.1038/538127a pmid: 27708327
24. Eglen SJ, Marwick B, Halchenko YO, Hanke M, Sufi S, Gleeson P, et al. Toward standard practices for sharing computer code and programs in neuroscience. Nat Neurosci. 2017;20: 770–773. doi: 10.1038/nn.4550 pmid: 28542156
25. Marwick B, Computational Reproducibility in Archaeological Research: Basic Principles and a Case Study of Their Implementation. J Archaeol Method Theory. 2017;24: 424–450. doi: 10.1007/s10816-015-9272-9
26. Perez-Riverol Y, Gatto L, Wang R, Sachsenberg T, Uszkoreit J, Leprevost F da V, et al. Ten Simple Rules for Taking Advantage of Git and GitHub. PLoS Comput Biol. 2016;12: e1004947. doi: 10.1371/journal.pcbi.1004947 pmid: 27415786
27. Shen C, Björk B-C, ‘Predatory’ open access: a longitudinal study of article volumes and market characteristics. BMC Med. 2015;13: 230. doi: 10.1186/s12916-015-0469-2 pmid: 26423063
28. Björk B-C, Laakso M, Welling P, Paetau P, Anatomy of green open access. J Assoc Inf Sci Technol. 2014;65: 237–250. doi: 10.1002/asi.22963
29. Harnad S, Brody T, Vallières F, Carr L, Hitchcock S, Gingras Y, et al. The Access/Impact Problem and the Green and Gold Roads to Open Access: An Update. Ser Rev. 2008;34: 36–40. doi: 10.1080/00987913.2008.10765150
30. Laakso M, Welling P, Bukvova H, Nyman L, Björk B-C, Hedlund T, The Development of Open Access Journal Publishing from 1993 to 2009. PLoS ONE. 2011;6: e20961. doi: 10.1371/journal.pone.0020961 pmid: 21695139
31. Preregistration Challenge [Internet]. [cited 26 Feb 2018]. https://cos.io/prereg/
32. Nosek BA, Ebersole CR, DeHaven A, Mellor D, The Preregistration Revolution. Open Sci Framew. 2017; doi: 10.17605/OSF.IO/2DXU5
33. Gorgolewski KJ, Auer T, Calhoun VD, Craddock RC, Das S, Duff EP, et al. The brain imaging data structure, a format for organizing and describing outputs of neuroimaging experiments. Sci Data. 2016;3: sdata201644. doi: 10.1038/sdata.2016.44 pmid: 27326542
34. Brew A, Teaching and Research: New relationships and their implications for inquiry-based teaching and learning in higher education. High Educ Res Dev. 2003;22: 3–18. doi: 10.1080/0729436032000056571
35. Healey M, Linking Research and Teaching to Benefit Student Learning. J Geogr High Educ. 2005;29: 183–201. doi: 10.1080/03098260500130387
36. Robertson J, Beyond the ‘research/teaching nexus’: exploring the complexity of academic experience. Stud High Educ. 2007;32: 541–556. doi: 10.1080/03075070701476043
37. Hawkins RXD, Smith EN, Au C, Arias JM, Catapano R, Hermann E, et al. Improving the Replicability of Psychological Science Through Pedagogy. Adv Methods Pract Psychol Sci. 2018; 2515245917740427. doi: 10.1177/2515245917740427
38. Ostwald D, Porcaro C, Mayhew SD, Bagshaw AP, EEG-fMRI Based Information Theoretic Characterization of the Human Perceptual Decision System. PLoS ONE. 2012;7: e33896. doi: 10.1371/journal.pone.0033896 pmid: 22485152
39. Georgie YK, Porcaro C, Mayhew S, Bagshaw AP, Ostwald D, A perceptual decision making EEG/fMRI data set. bioRxiv. 2018; 253047. doi: 10.1101/253047
40. For Authors | Scientific Data [Internet]. [cited 26 Feb 2018]. https://www.nature.com/sdata/publish/for-authors#aims-scope
41. The Open Science training handbook—FOSTER Book Sprint,. In: FOSTER FACILITATE OPEN SCIENCE TRAINING FOR EUROPEAN RESEARCH [Internet]. [cited 26 Feb 2018]. https://www.fosteropenscience.eu/node/2097
42. Open Science MOOC. In: Open Science MOOC [Internet]. [cited 26 Feb 2018]. https://opensciencemooc.eu/