Sustainable computational science: The ReScience Initiative

PeerJ Computer Science

Volumn 2017, Issue 12, 2017, Pages

  Rougier, Nicolas P ^a   Hinsen, Konrad ^b   Alexandre, Frédéric ^a   Arildsen, Thomas ^c   Barba, Lorena A ^d   C Y Benureau, Abien ^a   Brown, C Titus ^e   deBuy, Pierre ^f   Caglayan, Ozan ^g   Davison, Andrew P ^h   Delsuc, Marc André ⁱ   Detorakis, Georgios ^j   Diem, Alexandra K ^k   Drix, Damien ^l   Enel, Pierre ^m   Girard, Benoît ⁿ   Guest, Olivia ^o   Hall, Matt G ^p   Henriques, Rafael N ^q   Hinaut, Xavier ^a   Jaron, Kamil S ^r   Khamassi, Mehdi ⁿ   Klein, Almar ^s   Manninen, Tiina ^t   Marchesi, Pietro ^u   McGlinn, Daniel ^v   Metzner, Christoph ^w   Petchey, Owen ^x   Plesser, Hans Ekkehard ^y   Poisot, Timothée ^z   Ram, Karthik ^aa   Ram, Yoav ^ab   Roesch, Etienne ^ac   Rossant, Cyrille ^ad   Rostami, Vahid ^ae   Shifman, Aaron ^af   Stachelek, Joseph ^ag   Stimberg, Marcel ^ah   Stollmeier, Frank ^ai   Vaggi, Federico ^aj   Viejo, Guillaume ⁿ   Vitay, Julien ^ak   Vostinar, Anya E ^al   Yurchak, Roman ^am   Zito, Tiziano ^an   more..

^a INRIA   (France)

^b CENTRE DE BIOPHYSIQUE MOLÉCULAIRE   (France)

^c AALBORG UNIVERSITY   (Denmark)

^d George Washington University   (United States)

^e UNIVERSITY OF CALIFORNIA   (United States)

^f UNIVERSITY OF LEUVEN   (Belgium)

^g UNIVERSITÉ DU MAINE   (France)

^h Unite de Neurosciences Integratives et Computationnelles   (France)

ⁱ INSTITUT DE GÉNÉTIQUE ET DE BIOLOGIE MOLÉCULAIRE ET CELLULAIRE   (France)

^j UNIVERSITY OF CALIFORNIA   (United States)

^k UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^l HUMBOLDT UNIVERSITY   (Germany)

^m MOUNT SINAI SCHOOL OF MEDICINE   (United States)

ⁿ UNIVERSITÉ PIERRE ET MARIE CURIE   (France)

^o UNIVERSITY COLLEGE LONDON   (United Kingdom)

^p UNIVERSITY COLLEGE LONDON   (United Kingdom)

^q CHAMPALIMAUD CENTRE FOR THE UNKNOWN   (Portugal)

^r UNIVERSITY OF LAUSANNE   (Switzerland)

^s Independent scholar   (Netherlands)

^t TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

^u UNIVERSITY OF AMSTERDAM   (Netherlands)

^v School of Business   (United States)

^w UNIVERSITY OF HERTFORDSHIRE   (United Kingdom)

^x UNIVERSITY OF ZURICH   (Switzerland)

^y NORWEGIAN UNIVERSITY OF LIFE SCIENCES   (Norway)

^z UNIVERSITÉ DE MONTRÉAL   (Canada)

^aa UNIVERSITY OF CALIFORNIA   (United States)

^ab STANFORD UNIVERSITY   (United States)

^ac UNIVERSITY OF READING   (United Kingdom)

^ad UNIVERSITY COLLEGE LONDON   (United Kingdom)

^ae FORSCHUNGSZENTRUM JÜLICH   (Germany)

^af UNIVERSITY OF OTTAWA   (Canada)

^ag MICHIGAN STATE UNIVERSITY   (United States)

^ah INSTITUT DE LA VISION   (France)

^ai MAX PLANCK INSTITUTE FOR DYNAMICS AND SELF ORGANIZATION   (Germany)

^aj AMAZON   (United States)

^ak CHEMNITZ UNIVERSITY OF TECHNOLOGY   (Germany)

^al GRINNELL COLLEGE   (United States)

^am Symerio   (France)

^an UNIVERSITY OF TÜBINGEN   (Germany)

more..

Author keywords

Computational science; GitHub; Open peer review; Open science; Publication; Replicable; Reproducible; Sustainable

Indexed keywords

CODES (SYMBOLS); REVIEWS; SOFTWARE TESTING;

COMPUTATIONAL SCIENCE; GITHUB; OPEN SCIENCE; PEER REVIEW; PUBLICATION; REPLICABLE; REPRODUCIBLE; SUSTAINABLE;

OPEN SOURCE SOFTWARE;

EID: 85040188790     PISSN: None     EISSN: 23765992     Source Type: Journal    
DOI: 10.7717/peerj-cs.142     Document Type: Article

References (31)

1. Anaconda Inc. 2017. Conda. Available at https:// conda.io/.
2. Baker M. 2016. 1, 500 scientists lift the lid on reproducibility. Nature 533(7604):452-454 DOI 10.1038/533452a.
3. Colberg C, Proebsting TA. 2016. Repeatability in computer systems research. Communi- cations of the ACM 59(3):62-69 DOI 10.1145/2812803.
4. Coudert F-X. 2017. Reproducible research in computational chemistry of materials. Chemistry of Materials 29(7):2615-2617 DOI 10.1021/acs.chemmater.7b00799.
5. Courtès L, Wurmus R. 2015. Reproducible and user-controlled software environments in HPC with Guix. In: Hunold S, Costan A, Giménez D, Iosup A, Ricci L, Requena MEG, Scarano V, Varbanescu AL, Scott SL, Lankes S, Weidendorfer J, Alexander M, eds. Euro-Par 2015: parallel processing workshops. Lecture notes in computer science, vol. 9523. Cham: Springer.
6. Crook SM, Davison AP, Plesser HE. 2013. 20 years of computational neuroscience. In: Bower MJ, ed. Chap. Learning from the past: approaches for reproducibility in computational neuroscience. New York: Springer New York, 73-102.
7. Davison AP. 2012. Automated capture of experiment context for easier reproducibility in computational research. Computing in Science and Engineering 14:48-56 DOI 10.1109/MCSE.2012.41.
8. Docker Inc. 2017. Docker. Available at https:// www.docker.com/.
9. Donoho DL, Maleki A, Rahman IU, Shahram M, Stodden V. 2009. Reproducible research in computational harmonic analysis. Computing in Science Engineering 11(1):8-18 DOI 10.1109/MCSE.2009.15.
10. Guo PJ, Engler D. 2011. CDE: using system call interposition to automatically create portable software packages. In: Proceedings of the 2011 USENIX annual technical conference, USENIX'11. Portland: USENIX Association. Available at http:// dl.acm. org/ citation.cfm?id=2002181.2002202.
11. Halchenko YO, Hanke M. 2015. Four aspects to make science open ``by design'' and not as an after-thought. GigaScience 4(1) DOI 10.1186/s13742-015-0072-7.
12. Hinsen K. 2015. Writing software specifications. Computing in Science & Engineering 17(3):54-61 DOI 10.1109/mcse.2015.64.
13. Ioannidis JPA. 2005. Why most published research findings are false. PLOS Medicine 2(8):e124 DOI 10.1371/journal.pmed.0020124.
14. Iqbal SA, Wallach JD, Khoury MJ, Schully SD, Ioannidis JPA. 2016. Reproducible research practices and transparency across the biomedical literature. PLOS Biology 14(1):e1002333 DOI 10.1371/journal.pbio.1002333.
15. Janz N. 2015. Bringing the gold standard into the class room: replication in university teaching. International Studies Perspectives Epub ahead of print Mar 9 2015 DOI 10.1111/insp.12104.
16. Kitzes J, Turek D, Deniz F (eds.) 2017. The practice of reproducible research: case studies and lessons from the data-intensive sciences. Oakland: University of California Press.
17. Lindholm T, Yellin F. 1999. Java virtual machine specification. Second Edition. Boston: Addison-Wesley Longman Publishing Co., Inc.
18. Manninen T, Havela R, Linne M-L. 2017. Reproducibility and comparability of computational models for astrocyte calcium excitability. Frontiers in Neuroinformatics 11:11 DOI 10.3389/fninf.2017.00011.
19. Mesnard O, Barba LA. 2017. Reproducible and replicable CFD: it's harder than you think. IEEE/AIP Computing in Science and Engineering 19(4):44-55 DOI 10.1109/mcse.2017.3151254.
20. Munafò MR, Nosek BA, Bishop DVM, Button KS, Chambers CD, Du Sert NP, Simon- sohn U, Wagenmakers E-J, Ware JJ, Ioannidis JPA. 2017. A manifesto for reproducible science. Nature Human Behaviour 1(1):0021 DOI 10.1038/s41562-016-0021.
21. Murta L, Braganholo V, Chirigati F, Koop D, Freire J. 2015. noWorkflow: capturing and analyzing provenance of scripts. In: Provenance and annotation of data and processes. Lecture notes in computer science, vol. 8628. Berlin: Springer International Publishing, 71-83.
22. Open Science Collaboration. 2015. Estimating the reproducibility of psychological science. Science 349(6251):aac4716-aac4716 DOI 10.1126/science.aac4716. Perkel J. 2016. Democratic databases: science on GitHub. Nature 538(7623):127-128 DOI 10.1038/538127a.
23. Perkel J. 2016. Democratic databases: science on GitHub. Nature 538(7623):127-128 DOI 10.1038/538127a.
24. Sandve GK, Nekrutenko A, Taylor J, Hovig E. 2013. Ten simple rules for reproducible computational research. PLOS Compututational Biology 9(10):e1003285 DOI 10.1371/journal.pcbi.1003285.
25. Smith AM, Niemeyer KE, Katz DS, Barba LA, Githinji G, Gymrek M, Huff KD, Madan CR, Cabunoc Mayes A, Moerman KM, Prins P, Ram K, Rokem A, Teal TK, VallsGuimera R, Vanderplas JT. 2017. Journal of Open Source Software (JOSS): design and first-year review. ArXiv preprint. arXiv:1707.02264.
26. Stachelek J. 2016. [Re] least-cost modelling on irregular landscape graphs. ReScience 2(1) DOI 10.5281/zenodo.45852.
27. Topalidou M, Leblois A, Boraud T, Rougier NP. 2015. A long journey into reproducible computational neuroscience. Frontiers in Computational Neuroscience 9:30 DOI 10.3389/fncom.2015.00030.
28. Topalidou M, Rougier NP. 2015. [Re] interaction between cognitive and motor corticobasal ganglia loops during decision making: a computational study. ReScience 1(1) DOI 10.5281/zenodo.47146.
29. Viejo G, Girard B, Khamassi M. 2016. [Re] speed/accuracy trade-off between the habitual and the goal-directed process. ReScience 2(1) DOI 10.5281/zenodo.27944. Wilson G. 2016. Software carpentry: lessons learned. F1000Research 3:62 DOI 10.12688/f1000research.3-62.v2.
30. Wilson G. 2016. Software carpentry: lessons learned. F1000Research 3:62 DOI 10.12688/f1000research.3-62.v2.
31. Wilson G, Aruliah DA, Brown CT, Hong NPC, Davis M, Guy RT, Haddock SHD, Huff KD, Mitchell IM, Plumbley MD, Waugh B, White EP, Wilson P. Best practices for scientific computing. PLOS Biology 12(1):e1001745 DOI 10.1371/journal.pbio.1001745.