Our path to better science in less time using open data science tools

Nature Ecology and Evolution

Volumn 1, Issue 6, 2017, Pages

  Lowndes, Julia S Stewart ^a   Best, Benjamin D ^b   Scarborough, Courtney ^a   Afflerbach, Jamie C ^a   Frazier, Melanie R ^a   O'Hara, Casey C ^a   Jiang, Ning ^a   Halpern, Benjamin S ^a,c,d  

^a NATIONAL CENTER FOR ECOLOGICAL ANALYSIS AND SYNTHESIS   (United States)

^b EcoQuants LLC   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85028755501     PISSN: None     EISSN: 2397334X     Source Type: Journal    
DOI: 10.1038/s41559-017-0160     Document Type: Article

References (79)

1. Baker, M. Over half of psychology studies fail reproducibility test. Nature News http://dx. doi. org/10. 1038/nature. 2015. 18248 (2015).
2. Baker, M. & Dolgin, E. Cancer reproducibility project releases first results. Nature News http://dx. doi. org/10. 1038/541269a (2017).
3. Open Science Collaboration. Estimating the reproducibility of psychological science. Science 349, aac4716 (2015).
4. Baker, M. 1, 500 scientists lift the lid on reproducibility. Nature 533, 452-454 (2016).
5. Aschwanden, C. Science isn't broken. FiveThirtyEight http://go. nature. com/2qaz0Tz (19 August 2015)
6. Buck, S. Solving reproducibility. Science 348, 1403-1403 (2015).
7. Frew, J. & Dozier, J. Environmental informatics. Annu. Rev. Environ. Resources 37, 449-472 (2012).
8. Jones, M. B., Schildhauer, M. P., Reichman, O. J. & Bowers, S. The new bioinformatics: Integrating ecological data from the gene to the biosphere. Annu. Rev. Ecol. Evol. Syst. 37, 519-544 (2006).
9. Michener, W. K. & Jones, M. B. Ecoinformatics: Supporting ecology as a data-intensive science. Trends Ecol. Evol. 27, 85-93 (2012).
10. Check Hayden, E. Mozilla plan seeks to debug scientific code. Nature News http://dx. doi. org/10. 1038/501472a (2013).
11. Boettiger, C., Chamberlain, S., Hart, E. & Ram, K. Building software, building community: Lessons from the rOpenSci project. J. Open Res. Softw. 3, e8 (2015).
12. Wilson, G. et al. Good enough practices in scientific computing. Preprint at https://arxiv. org/abs/1609. 00037 (2016).
13. Wilson, G. V. Where's the real bottleneck in scientific computing? Am. Sci. 94, 5-6 (2006).
14. Baker, M. Scientific computing: Code alert. Nature 541, 563-565 (2017).
15. Barone, L., Williams, J. & Micklos, D. Unmet needs for analyzing biological big data: A survey of 704 NSF principal investigators. Preprint at bioRxiv https://doi. org/10. 1101/108555 (2017).
16. Wolkovich, E. M., Regetz, J. & O'Connor, M. I. Advances in global change research require open science by individual researchers. Global Change Biol. 18, 2102-2110 (2012).
17. Nosek, B. A. et al. Promoting an open research culture. Science 348, 1422-1425 (2015).
18. Reichman, O. J., Jones, M. B. & Schildhauer, M. P. Challenges and opportunities of open data in ecology. Science 331, 703-705 (2011).
19. Shade, A. & Teal, T. K. Computing workflows for biologists: A roadmap. PLoS Biol. 13, e1002303 (2015).
20. Goodman, A. et al. Ten simple rules for the care and feeding of scientific data. PLoS Comput. Biol. 10, e1003542 (2014).
21. Sandve, G. K., Nekrutenko, A., Taylor, J. & Hovig, E. Ten simple rules for reproducible computational research. PLoS Comput. Biol. 9, e1003285 (2013).
22. White, E. P. et al. Nine simple ways to make it easier to (re)use your data. Ideas Ecol. Evol. http://doi. org/10. 4033/iee. 2013. 6b. 6. f (2013).
23. Kervin, K., Michener, W. & Cook, R. Common errors in ecological data sharing. J. eScience Librarianship http://dx. doi. org/10. 7191/jeslib. 2013. 1024 (2013).
24. Lewandowsky, S. & Bishop, D. Research integrity: don't let transparency damage science. Nature News http://dx. doi. org/10. 1038/529459a (2016).
25. Michener, W. K. Ten simple rules for creating a good data management plan. PLoS Comput. Biol. 11, e1004525 (2015).
26. Mislan, K. A. S., Heer, J. M. & White, E. P. Elevating the status of code in ecology. Trends Ecol. Evol. 31, 4-7 (2016).
27. Kratz, J. & Strasser, C. Data publication consensus and controversies. F1000Research http://dx. doi. org/10. 12688/f1000research. 3979. 3 (2014).
28. Munafò, M. R. et al. A manifesto for reproducible science. Nat. Hum. Behav. 1, 0021 (2017).
29. Martinez, C. et al. Reproducibility in Science: A Guide to Enhancing Reproducibility in Scientific Results and Writing http://ropensci. github. io/ reproducibility-guide/ (2014).
30. Tuyl, S. V. & Whitmire, A. L. Water, water, everywhere: defining and assessing data sharing in academia. PLoS ONE 11, e0147942 (2016).
31. Baker, M. Why scientists must share their research code. Nature News http://dx. doi. org/10. 1038/nature. 2016. 20504 (2016).
32. Kidwell, M. C. et al. Badges to acknowledge open practices: A simple, low-cost, effective method for increasing transparency. PLoS Biol. 14, e1002456 (2016).
33. Wickham, H. & Grolemund, G. R for Data Science (O'Reilly, 2016); http://r4ds. had. co. nz/
34. Lowndes, J. S. S. et al. Best practices for assessing ocean health in multiple contexts using tailorable frameworks. PeerJ 3, e1503 (2015).
35. Lowndes, J. A biography of the ocean health index. ohi-science http://ohi-science. org/news/Biography-OHI (13 January 2017).
36. Halpern, B. S. et al. An index to assess the health and benefits of the global ocean. Nature 488, 615-620 (2012).
37. Halpern, B. S. et al. Patterns and emerging trends in global ocean health. PLoS ONE 10, e0117863 (2015).
38. Five years of global ocean health index assessments. ohi-science http://ohi-science. org/ohi-global (2016).
39. Goldfuss, C. & Holdren, J. P. The nation's first ocean plans. The White House https://obamawhitehouse. archives. gov/blog/2016/12/07/nations-first-ocean-plans (7 December 2016).
40. Hampton, S. E. et al. The tao of open science for ecology. Ecosphere 6, art120 (2015).
41. Mills, B. Introducing mozilla science study groups. Mozilla https://science. mozilla. org/blog/introducing-mozilla-science-study-groups (22 April 2015).
42. R Core Team R: A Language and Environment for Statistical Computing (R Foundation for Statistical Computing, 2016); https://www. R-project. org/
43. RStudio Team RStudio: Integrated Development for R (RStudio, 2016); www. rstudio. com
44. Git Team Git Version Control System (Git, 2016); https://git-scm. com/
45. GitHub: A Collaborative Online Platform To Build Software (GitHub, 2016); https://github. com
46. Wilson, G. V. Software carpentry: getting scientists to write better code by making them more productive. Comput. Sci. Eng. 8, 66-69 (2006).
47. Broman, K. Initial steps toward reproducible research. http://kbroman. org/ steps2rr/ (2016).
48. McKiernan, E. C. et al. How open science helps researchers succeed. eLife 5, e16800 (2016).
49. Seltenrich, N. Scaling the heights of data science. Breakthroughs https://nature. berkeley. edu/breakthroughs/opensci-data (2016).
50. Wilson, G. et al. Best practices for scientific computing. PLoS Biol. 12, e1001745 (2014).
51. Haddock, S. H. & Dunn, C. W. Practical Computing for Biologists (Sinauer Associates, 2011).
52. Barnes, N. Publish your computer code: it is good enough. Nature 467, 753 (2010).
53. Frazier, M., Longo, C. & Halpern, B. S. Mapping uncertainty due to missing data in the global ocean health index. PLoS ONE 11, e0160377 (2016).
54. ESRI ArcGIS Platform (2016); http://www. esri. com/software/arcgis
55. The QGIS Team QGIS Project (2016); http://www. qgis. org
56. The Python Team Python (2016); https://www. python. org/
57. Wickham, H. Tidy data. J. Stat. Softw. 59, 1-23 (2014).
58. Wickham, H. Tidyverse Tidyweb (accessed 29 January 2017); http://tidyverse. org/
59. Wickham, H. Tidyverse: Easily Install and Load 'tidyverse' Packages (2016); https://CRAN. R-project. org/package=tidyverse
60. Fischetti, T. How dplyr replaced my most common r idioms. StatsBlogs http://www. onthelambda. com/2014/02/10/how-dplyr-replaced-my-most-common-r-idioms/ (10 February 2014).
61. RStudio Team R Markdown (2016); http://rmarkdown. rstudio. com/
62. Allaire, J. J. et al. R Markdown: Dynamic Documents for R (2016); https://CRAN. R-project. org/package=rmarkdown
63. Ocean Health Index ohicore Package (Ocean Health Index Team, 2016).
64. Wickham, H. R Packages (O'Reilly, 2015); http://r-pkgs. had. co. nz/
65. Wickham, H. & Chang, W. Devtools: Tools to Make Developing R Packages Easier (2016); https://CRAN. R-project. org/package=devtools
66. Wickham, H., Danenberg, P. & Eugster, M. Roxygen2: In-Source Documentation for R (2015); https://CRAN. R-project. org/package=roxygen2
67. Ram, K. Git can facilitate greater reproducibility and increased transparency in science. Source Code Biol. Med. 8, 7 (2013).
68. Blischak, J. D., Davenport, E. R. & Wilson, G. A quick introduction to version control with git and GitHub. PLoS Comput. Biol. 12, e1004668 (2016).
69. Perez-Riverol, Y. et al. Ten simple rules for taking advantage of Git and GitHub. PLoS Comput. Biol. 12, e1004947 (2016).
70. Duhigg, C. What Google learned from its quest to build the perfect team. The New York Times (25 February 2016).
71. Perkel, J. Democratic databases: Science on GitHub. Nature 538, 127-128 (2016).
72. Casadevall, A. & Fang, F. C. Reproducible science. Infect. Immun. 78, 4972-4975 (2010).
73. Wilson, G. Software carpentry: lessons learned. F1000Research http://dx. doi. org/10. 12688/f1000research. 3-62. v2 (2016).
74. Hampton, S. E. et al. Big data and the future of ecology. Front. Ecol. Environ. 11, 156-162 (2013).
75. Lohr, S. For big-data scientists, 'janitor work' is key hurdle to insights. The New York Times (17 August 2014).
76. FitzJohn, R., Pennell, M., Zanne, A. & Cornell, W. Reproducible research is still a challenge. ROpenSci https://ropensci. org/blog/2014/06/09/reproducibility/ (9 June 2014).
77. Boland, M. R., Karczewski, K. J. & Tatonetti, N. P. Ten simple rules to enable multi-site collaborations through data sharing. PLoS Comput. Biol. 13, e1005278 (2017).
78. Perkel, J. M. Scientific writing: the online cooperative. Nature 514, 127-128 (2014).
79. How Twitter improved my ecological model. R-bloggers https://www. r-bloggers. com/how-twitter-improved-my-ecological-model/ (26 February 2015).