Singularity: Scientific containers for mobility of compute

PLoS ONE

Volumn 12, Issue 5, 2017, Pages

  Kurtzer, Gregory M ^a   Sochat, Vanessa ^b   Bauer, Michael W ^a,c,d  

^a LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

^b STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF MICHIGAN   (United States)

^d GSI HELMHOLTZZENTRUM FÜR SCHWERIONENFORSCHUNG GMBH   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; COMPUTER INTERFACE; COMPUTER SECURITY; COMPUTER SYSTEM; INFORMATION SYSTEM; MACHINE LEARNING; MATHEMATICAL COMPUTING; REPRODUCIBILITY; SOFTWARE; SOFTWARE DESIGN; SOFTWARE VALIDATION; WORKFLOW; COMPUTER;

COMPUTERS; SOFTWARE; USER-COMPUTER INTERFACE;

EID: 85018864588     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0177459     Document Type: Article

References (59)

1. Ceruzzi PE. A History of Modern Computing. History of computing. MIT Press; 2003.
2. Google. Python Runtime Environment;. https://cloud.google.com/appengine/docs/python/.
3. Furlani JL, Osel PW. Abstract Yourself With Modules. In: Proceedings of the 10th USENIX Conference on System Administration. LISA'96. Berkeley, CA, USA: USENIX Association; 1996. p. 193-204.
4. Smith JE, Nair R. Virtual Machines: Versatile Platforms for Systems and Processes. The Morgan Kaufmann Series in Computer Architecture and Design Series. Morgan Kaufmann Publishers; 2005.
5. Vagrant;. https://www.vagrantup.com/.
6. Wikipedia contributors. Comparison of file systems; 2016. https://en.wikipedia.org/w/index.php?title= Comparison-of-file-systems&oldid=751048657.
7. Wikipedia contributors. Privilege (computing); 2016. https://en.wikipedia.org/w/index.php?title= Privilege-(computing)&oldid=724513784.
8. Warewulf;. http://warewulf.lbl.gov/trac.
9. Wikipedia contributors. List of build automation software; 2016. https://en.wikipedia.org/w/index.php? title=List-of-build-automation-software&oldid=745372506.
10. Slurm Workload Manager;. https://slurm.schedmd.com/plugins.html.
11. SGE Manual Pages;. http://gridscheduler.sourceforge.net/htmlman/manuals.html.
12. Wallis JC, Rolando E, Borgman CL. If we share data, will anyone use them? Data sharing and reuse in the long tail of science and technology. PLoS One. 2013; 8(7):e67332. https://doi.org/10.1371/journal. pone.0067332 PMID: 23935830
13. Taming the Long Tail of Science; 2012. https://www.hpcwire.com/2012/10/15/taming-the-long-tail-of-science/.
14. Unwinding the'Long Tail' of Science | Computation Institute;. https://www.ci.uchicago.edu/blog/unwinding-long-tail-science.
15. What is Docker?; 2015. https://www.docker.com/what-docker.
16. Overview of Docker Compose;. https://docs.docker.com/compose/.
17. Hale JS, Li L, Richardson CN, Wells GN. Containers for portable, productive and performant scientific computing. 2016;.
18. Baker M. Over half of psychology studies fail reproducibility test. Nature News;.
19. Open Science Collaboration. PSYCHOLOGY. Estimating the reproducibility of psychological science. Science. 2015; 349(6251):aac4716. https://doi.org/10.1126/science.aac4716 PMID: 26315443
20. Science is in a reproducibility crisis: How do we resolve it?;. http://phys.org/news/2013-09-sciencecrisis.html.
21. Ali AA, El-Kalioby M, Abouelhoda M. The Case for Docker in Multicloud Enabled Bioinformatics Applications. Conference on Bioinformatics and. ⋯ 2016; p. 587-601.
22. Belmann P, Dröge J, Bremges A, McHardy AC, Sczyrba A, Barton MD. Bioboxes: standardised containers for interchangeable bioinformatics software. Gigascience. 2015; 4:47. https://doi.org/10.1186/s13742-015-0087-0 PMID: 26473029
23. Gorgolewski KJ, Alfaro-Almagro F, Auer T, Bellec P, Capota M, Chakravarty M, et al. BIDS Apps: Improving ease of use, accessibility and reproducibility of neuroimaging data analysis methods; 2016.
24. Boettiger C. An introduction to Docker for reproducible research, with examples from the R environment. 2014;.
25. Hosny A, Vera-Licona P, Laubenbacher R, Favre T. AlgoRun: a Docker-based packaging system for platform-agnostic implemented algorithms. Bioinformatics. 2016; 32(15):2396-2398. https://doi.org/10.1093/bioinformatics/btw120 PMID: 27153722
26. Size doesn't matter: Scientific Data;. http://blogs.nature.com/scientificdata/2014/10/13/size-doesntmatter/.
27. Big Data Segmentation and the Power of Small Data Analysis; 2016. http://converge.xyz/big-datasegmentation-power-small-data-analysis/.
28. The Power of Small Data: Defend against data-doubting critics by exploring all angles;. http://www.centerforhealthjournalism.org/2016/04/12/power-small-data-defend-against-data-doubting-criticsexploring-all-angles.
29. JupyterHub-JupyterHub 0.8.0.dev documentation;. https://jupyterhub.readthedocs.io/en/latest/.
30. Priedhorsky R, Randles TC. Charliecloud: Unprivileged containers for user-defined software stacks in HPC. Los Alamos National Lab. (LANL), Los Alamos, NM (United States); 2016. LA-UR-16-22370.
31. Shifter: User Defined Images;. http://www.nersc.gov/research-and-development/user-defined-images/.
32. Leading Genome Research Center Catalyzes Technology Partnership Between DNAnexus and Microsoft to Support Data Management and Genomic Analysis | Business Wire; 2016. http://www.businesswire.com/news/home/20161115005482/en/Leading-Genome-Research-Center-Catalyzes-Technology-Partnership.
33. Cloud-Enabled Innovation in Personalized Medical Treatment;. https://aws.amazon.com/blogs/publicsector/cloud-enabled-innovation-in-personalized-medical-treatment/.
34. Broad Institute GATK on Google Genomics | Genomics | Google Cloud Platform;. https://cloud.google.com/genomics/v1alpha2/gatk.
35. Compute Engine-IaaS | Google Cloud Platform;. https://cloud.google.com/compute/.
36. Cloud AEC. Amazon web services. Retrieved November. 2011; 9:2011.
37. Wilder B. Cloud architecture patterns: using microsoft azure. "O'Reilly Media, Inc."; 2012.
38. Docker Hub;. https://hub.docker.com/.
39. Contributors G. GNU's advanced distro and transactional package manager-GuixSD;. https://www.gnu.org/software/guix/.
40. NixOS Linux;. https://nixos.org/.
41. Rushby JM. Design and Verification of Secure Systems. Oper Syst Rev. 1981; 15(5):12-21. https://doi.org/10.1145/1067627.806586
42. IT Security-Hyperjacking;. http://itsecurity.telelink.com/hyperjacking/.
43. Hyde D. A Survey on the Security of Virtual Machines;. http://www.cse.wustl.edu/jain/cse571-09/ftp/vmsec/index.html.
44. Wikipedia contributors. InfiniBand; 2016. https://en.wikipedia.org/w/index.php?title=InfiniBand&oldid= 739956837.
45. Jacobsen DM, Canon RS. Contain this, unleashing docker for hpc. Proceedings of the Cray User Group. 2015;.
46. Merkel D. Docker: Lightweight Linux Containers for Consistent Development and Deployment. Linux J. 2014; 2014(239).
47. Sklavos N, Koufopavlou O. On the hardware implementations of the SHA-2 (256, 384, 512) hash functions. In: Circuits and Systems, 2003. ISCAS'03. Proceedings of the 2003 International Symposium on. vol. 5; 2003. p. V-153-V-156 vol.5.
48. CIRCULAR A-110 REVISED 11/19/93 As Further Amended 9/30/99;. https://www.whitehouse.gov/OMB/circulars-a110.
49. Wikipedia contributors. Operating-system-level virtualization; 2016. https://en.wikipedia.org/w/index. php?title=Operating-system-level-virtualization&oldid=750140871.
50. singularityware. singularityware/singularity;. https://github.com/singularityware/singularity.
51. Docker-based solutions to reproducibility in science-Seven Bridges; 2015. https://blog.sbgenomics.com/docker-based-solutions-to-reproducibility-in-science/.
52. Bockelman B. per; 2017. personal communication.
53. San Diego Supercomputer Center;. http://www.sdsc.edu/.
54. HOME-Texas Advanced Computing Center;. https://www.tacc.utexas.edu/.
55. GSI Helmholtzzentrum für Schwerionenforschung; 2011. https://www.gsi.de/en/about-us.htm.
56. Layton J. A Container for HPC in ADMIN Magazine;. http://www.admin-magazine.com/HPC/Articles/Singularity-A-Container-for-HPC.
57. Layton J. Interview with the Developer of Singularity in ADMIN Magazine;. http://www.admin-magazine.com/HPC/Articles/Interview-with-Gregory-Kurtzer-Developer-of-Singularity.
58. Container App'Singularity' Eases Scientific Computing; 2016. https://www.hpcwire.com/2016/10/20/singularity-containers-easing-scientific-computing/.
59. HPCwire Reveals Winners of the 2016 Readers' and Editors' Choice Awards at SC16 Conference in Salt Lake City;. https://www.hpcwire.com/off-the-wire/hpcwire-reveals-winners-2016-readers-editorschoice-awards-sc16-conference-salt-lake-city/.