Experiences building Globus Genomics: A next-generation sequencing analysis service using Galaxy, Globus, and Amazon Web Services

Concurrency and Computation: Practice and Experience

Volumn 26, Issue 13, 2014, Pages 2266-2279

  Madduri, Ravi K ^a   Sulakhe, Dinanath ^a   Lacinski, Lukasz ^a   Liu, Bo ^a   Rodriguez, Alex ^a   Chard, Kyle ^a   Dave, Utpal J ^a   Foster, Ian T ^a  

^a ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

Cloud; HPC; HTC; NGS; workflows

Indexed keywords

CLOUDS; DIGITAL STORAGE; GALAXIES; GENES; LARGE DATASET; PIPELINE PROCESSING SYSTEMS; PIPELINES; SCHEDULING; SEARCH ENGINES;

AMAZON WEB SERVICES; COMPUTING INFRASTRUCTURES; EFFICIENT SCHEDULING; FILE TRANSFER SYSTEMS; NEXT-GENERATION SEQUENCING; SOFTWARE INSTALLATIONS; WORK-FLOW SYSTEMS; WORK-FLOWS;

WEB SERVICES;

EID: 84905110197     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.3274     Document Type: Conference Paper

References (29)

1. Bo L, Sotomayor B, Madduri R, Chard K, Foster I,. Deploying bioinformatics workflows on clouds with Galaxy and Globus provision. in High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion:, 2012, pp. 1087-1095.
2. Madduri RK, Dave P, Sulakhe D, Lacinski L, Liu B, Foster IT,. Experiences in building a next-generation sequencing analysis service using galaxy, Globus online and Amazon web service, presented at the Proceedings of the Conference on Extreme Science and Engineering Discovery Environment: Gateway to Discovery, San Diego, California, 2013.
3. Bamshad MJ, Ng SB, Bigham AW, Tabor HK, Emond MJ, Nickerson DA, et al., Exome sequencing as a tool for Mendelian disease gene discovery. Nature Reviews Genetics 2011; 12: 745-755.
4. Meyerson M, Gabriel S, Getz G,. Advances in understanding cancer genomes through second-generation sequencing. Nature Reviews Genetics 2010; 11: 685-696.
5. Stein LD,. The case for cloud computing in genome informatics. Genome Biology 2010; 11: 207.
6. Goecks J, Nekrutenko A, Taylor J,. Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. Genome Biology 2010; 11: R86.
7. Foster I,. Globus online: accelerating and democratizing science through cloud-based services. IEEE Internet Computing 2011; 15 (3): 70-73, doi: 10.1109/MIC.2011.64.
8. Allen B, Bresnahan J, Childers L, Foster I, Kandaswamy G, Kettimuthu R, et al., Software as a service for data scientists. Communications of the ACM 2012; 55: 81-88.
9. Ananthakrishnan R, Bryan J, Chard K, Foster I, Howe T, Lidman M, et al,. Globus nexus: an identity, profile, and group management platform for science gateways and other collaborative science applications. in Science Gateway Institute Workshop, co-located with IEEE Cluster, 2013.
10. Amazon. 2013. Amazon Web Services. Available: http://www.aws.amazon.com
11. Afgan E, Baker D, Coraor N, Goto H, Paul IM, Makova KD, et al., Harnessing cloud computing with Galaxy Cloud. Nature Biotechnology 2011; 29: 972-974.
12. Thain D, Tannenbaum T, Livny M,. Distributed computing in practice: the Condor experience: Research Articles. Concurrency and Computation: Practice and Experience 2005; 17: 323-356.
13. Krampis K, Booth T, Chapman B, Tiwari B, Bicak M, Field D, et al., Cloud BioLinux: pre-configured and on-demand bioinformatics computing for the genomics community. BMC Bioinformatics 2012; 13: 42.
14. Sulakhe D, Kettimuthu R, Dave U,. High-performance data management for genome sequencing centers using Globus Online: a case study. In E-Science (e-Science), in 2012 IEEE 8th International Conference on, pp. 1-6, 2012, 2012.
15. Wang Z, Gerstein M, Snyder M,. RNA-Seq: a revolutionary tool for transcriptomics. Nature Reviews Genetics 2009; 10: 57-63.
16. Schatz MC,. CloudBurst: highly sensitive read mapping with MapReduce. Bioinformatics 2009; 25: 1363-1369.
17. Johnson DS, Mortazavi A, Myers RM, Wold B,. Genome-wide mapping of in vivo protein-DNA interactions. Science 2007; 316: 1497-1502.
18. Langmead B, Hansen KD, Leek JT,. Cloud-scale RNA-sequencing differential expression analysis with Myrna. Genome Biology 2010; 11: R83.
19. Li H, Handsaker B, Wysoker A, Fennell T, Ruan J, Homer N, et al., The Sequence Alignment/Map format and SAMtools. Bioinformatics 2009; 25: 2078-2079.
20. Zhang Y, Liu T, Meyer CA, Eeckhoute J, Johnson DS, Bernstein BE, et al., Model-based analysis of ChIP-Seq (MACS). Genome Biology 2008; 9: R137.
21. Miller MA, Pfeiffer W, Schwartz T,. The CIPRES science gateway: a community resource for phylogenetic analyses, presented at the Proceedings of the 2011 TeraGrid Conference: Extreme Digital Discovery, Salt Lake City, Utah, 2011.
22. Foster I, Vasiliadis V, Tuecke S,. Software as a Service as a path to software sustainability. 2013. Available: http://dx.doi.org/10.6084/m9.figshare. 791604
23. Qiu X, Ekanayake J, Beason S, Gunarathne T, Fox G, Barga R, et al,. Cloud technologies for bioinformatics applications. in 2nd Workshop on Many-Task Computing on Grids and Supercomputers 2009, p. 6.
24. Grossman RL, Gu Y, Mambretti J, Sabala M, Szalay A, White K,. An overview of the open science data cloud. in 19th ACM International Symposium on High Performance Distributed Computing, 2010, pp. 377-384.
25. Chard K, Russell M, Lussier YA, Mendonça EA, Silverstein JC,. Scalability and cost of a cloud-based approach to medical NLP. presented at the 24th international Symposium on Computer-Based Medical Systems, Bristol UK, 2011.
26. Langmead B, Schatz MC, Lin J, Pop M, Salzberg SL,. Searching for SNPs with cloud computing. Genome Biology 2009; 10: R134.
27. Ekanayake J, Gunarathne T, Qiu J,. Cloud technologies for bioinformatics applications. Parallel and Distributed Systems, IEEE Transactions on 2011; 22: 998-1011.
28. Zhao S, Prenger K, Smith L, Messina T, Fan H, Jaeger E, et al., Rainbow: a tool for large-scale whole-genome sequencing data analysis using cloud computing. BMC Genomics 2013; 14: 425.
29. Evani U, Challis D, Yu J, Jackson A, Paithankar S, Bainbridge M, et al., Atlas2 Cloud: a framework for personal genome analysis in the cloud. BMC genomics 2012; 13: S19.