Cloud-based bioinformatics workflow platform for large-scale next-generation sequencing analyses

Journal of Biomedical Informatics

Volumn 49, Issue , 2014, Pages 119-133

  Liu, Bo ^a   Madduri, Ravi K ^b,c   Sotomayor, Borja ^b   Chard, Kyle ^b   Lacinski, Lukasz ^b   Dave, Utpal J ^b   Li, Jianqiang ^d   Liu, Chunchen ^a   Foster, Ian T ^b,c  

^a NEC Laboratories China   (China)

^b UNIVERSITY OF CHICAGO   (United States)

^c ARGONNE NATIONAL LABORATORY   (United States)

^d BEIJING UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Bioinformatics; Cloud computing; Galaxy; Scientific workflow; Sequencing analyses

Indexed keywords

CLOUD COMPUTING; DIGITAL STORAGE; ECONOMICS; GALAXIES; GENES; INFORMATION MANAGEMENT; SEMANTICS;

AUTOMATIC DEPLOYMENTS; BIOMEDICAL ANALYSIS; MANAGEMENT CAPABILITIES; NEXT-GENERATION SEQUENCING; SCIENTIFIC WORKFLOWS; SEMANTIC VERIFICATION; SEQUENCING ANALYSIS; STORAGE REQUIREMENTS;

BIOINFORMATICS;

ARTICLE; BIOINFORMATICS; CLOUD BASED BIOINFORMATIC; COMPUTER INTERFACE; COMPUTER PROGRAM; DATA PROCESSING; FEASIBILITY STUDY; INFORMATION PROCESSING; LARGE SCALE NEXT GENERATION SEQUENCING ANALYSIS; PRIORITY JOURNAL; QUANTITATIVE ANALYSIS; RESOURCE ALLOCATION; SEQUENCE ANALYSIS; WORKFLOW; BIOLOGY; DEVICES; INFORMATION RETRIEVAL; VALIDATION STUDY;

COMPUTATIONAL BIOLOGY; INFORMATION STORAGE AND RETRIEVAL; SEQUENCE ANALYSIS;

EID: 84902553652     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2014.01.005     Document Type: Article

References (40)

1. Driscoll A.O., Daugelaite J., Sleator R.D. 'Big Data', Hadoop and Cloud computing in genomics. J Biomed Inform 2013, 46:774-781.
2. Krampis K., Booth T., Chapman B., Tiwari B., Bicak M., Field D., et al. Cloud Biolinux: pre-configured and on-demand bioinformatics computing for the genomics community. BMC Bioinformatics 2012, 13:42.
3. Gentleman R.C., Carey V.J., Bates D.M., Bolstad B., Dettling M., Dudoit S., et al. Bioconductor: open software development for computational biology and bioinformatics. Genome Biol 2004, 5:R80.
4. Stajich J.E., Block D., Boulez K., Brenner S.E., Chervitz S.A., Dagdigian C., et al. The Bioperl toolkit: Perl modules for the life sciences. Genome Res 2002, 12:1611-1618.
5. Rice P., Longden I., Bleasby A. Emboss: the European molecular biology open software suite. Trends Genet 2000, 16:276-277.
6. Rosenthal A., Mork P., Li M.H., Stanford J., Koester D., Reynolds P. Cloud computing: a new business paradigm for biomedical information sharing. J Biomed Inform 2010, 43:342-353.
7. Liu B, Sotomayor B, Madduri R, Chard K, Foster I. Deploying Bioinformatics Workflows on Clouds with Galaxy and Globus Provision. In: Proceedings of SC Companion: High Performance Computing, Networking Storage and Analysis, 2012, 1087-95.
8. Thain D., Tannenbaum T., Livny M. Distributed computing in practice: the Condor experience. Concurr Comput Pract Exper 2005, 17:323-356.
9. Foster I. Globus online: accelerating and democratizing science through Cloud-based services. IEEE Internet Comput 2011, 15:70-73.
10. Allen B., Bresnahan J., Childers L., Foster I., et al. Globus online: radical simplification of data movement Via Saas, preprint CI-PP-5-0611 2011, Computation Institute, The University of Chicago.
11. Cummerbund. http://compbio.mit.edu/cummeRbund/.
12. Wang Z., Gerstein M., Snyder M. RNA-Seq: a revolutionary tool for transcriptomics. Nat Rev Genet 2009, 10:57-63.
13. Goecks J., Nekrutenko A., Taylor J. Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. Genome Biol 2010, 11:R86.
14. Globus Online. https://www.globus.org/.
15. Bresnahan J., Link M., Khanna G., Imani Z., Kettimuthu R., Foster I. Globus Gridftp: what's new in 2007. Proceedings of the first international conference on networks for grid applications 2007, 1-5. Lyon, France.
16. R Project. http://www.r-project.org/.
17. Amazon EC2. http://aws.amazon.com/ec2/.
18. Globus Provision. http://globus.org/provision/.
19. Basney J., Humphrey M., Welch V. The Myproxy online credential repository. Software Pract Exper 2005, 35:801-816.
20. Chef. http://www.opscode.com/chef/.
21. Amazon Elastic Block Store. http://aws.amazon.com/ebs/.
22. Amazon Simple Storage Service. http://aws.amazon.com/s3/.
23. Amazon EC2 Spot Instances. http://aws.amazon.com/ec2/spot-instances/.
24. Getting Started with Aws Free Usage Tier. http://s3.amazonaws.com/awsdocs/gettingstarted/latest/awsgsg-freetier.pdf.
25. Juve G., Deelman E., Vahi K., Mehta G., Berriman B., Berman B.P., et al. Scientific workflow applications on Amazon Ec2. Workshop on Cloud-based services and applications in conjunction with 5th IEEE international conference on e-Science (e-Science 2009) 2009, 59-66. Oxford, UK.
26. Simmhan Y, Barga R, Ingen CV, Lazowska E, Szalay A. Building the trident scientific workflow workbench for data management in the Cloud. In: Third international conference on advanced engineering computing and applications in sciences. 2009, 41-50.
27. Hoffa C, Mehta G, Freeman T, Deelman E, Keahey K, Berriman B, et al. On the use of Cloud computing for scientific workflows. In: IEEE international conference on eScience. 2008, 640-45.
28. Dornemann T, Juhnke E, Freisleben B. On-demand resource provisioning for BPEL workflows using Amazon's Elastic Compute Cloud. In: IEEE/ACM international symposium on cluster computing and the grid. 2009. 140-47.
29. Puppet. http://puppetlabs.com/.
30. Nurmi D, Wolski R, Grzegorczyk C, Obertelli G, Soman S, Youseff L, et al. The Eucalyptus open-source Cloud-computing system. In: 9th IEEE/ACM international symposium on cluster computing and the grid, 2009, 124-31.
31. Mvelase P, Dlodlo N, Makitla I, Sibiya G, Adigun M. An architecture based on SOA and virtual enterprise principles: Opennebula for Cloud deployment. In: Proceedings of the international conference on information management & evaluation; 2012, 214-22.
32. Yuan D, Yang Y, Liu X, Chen JJ. A cost-effective strategy for intermediate data storage in scientific Cloud workflow systems. In: 2010 IEEE international symposium on parallel & distributed processing (IPDPS); 2010, 1-12.
33. Wu Z., Liu X., Ni Z., Yuan D., Yang Y. A market-oriented hierarchical scheduling strategy in Cloud workflow systems. J Supercomput 2011, 63:256-293.
34. Zhang C., Sterck H.D. Cloud WF: a computational workflow system for Clouds based on Hadoop. Cloud Comput, Lecture Notes in Computer Science, 2009, 5931:393-404.
35. Langmead B., Schatz M.C., Lin J., Pop M., Salzberg S.L. Searching for SNPs with Cloud computing. Genome Biol 2009, 10:R134.
36. Zhao S., Prenger K., Smith L., Messina T., Fan H., Jaeger E., et al. Rainbow: a tool for large-scale whole-genome sequencing data analysis using Cloud computing. BMC Genomics 2013, 14:425.
37. Minevich G., Park D.S., Blankenberg D., Poole R.J., Hobert O. Cloudmap: a Cloud-based pipeline for analysis of mutant genome sequences. Genetics 2012, 192:1249-1269.
38. Schatz M.C. Cloudburst: highly sensitive read mapping with Mapreduce. Bioinformatics 2009, 25:1363-1369.
39. Wall D.P., Kudtarkar P., Fusaro V.A., Pivovarov R., Patil P., Tonellato P.J. Cloud computing for comparative genomics. BMC Bioinformatics 2010, 11:259.
40. Afgan E., Baker D., Coraor N., Chapman B., Nekrutenko A., Taylor J. Galaxy Cloudman: delivering Cloud compute clusters. BMC Bioinformatics 2010, 11(Suppl. 12):S4.