A case study for cloud based high throughput analysis of NGS data using the globus genomics system

Computational and Structural Biotechnology Journal

Volumn 13, Issue , 2015, Pages 64-74

  Bhuvaneshwar, Krithika ^a   Sulakhe, Dinanath ^b,c   Gauba, Robinder ^a   Rodriguez, Alex ^b   Madduri, Ravi ^b,c   Dave, Utpal ^b,c   Lacinski, Lukasz ^b,c   Foster, Ian ^b,c   Gusev, Yuriy ^a   Madhavan, Subha ^a  

^a GEORGETOWN UNIVERSITY   (United States)

^b UNIVERSITY OF CHICAGO   (United States)

^c Globus Genomics   (United States)

Author keywords

Cloud computing; Galaxy; Next generation sequencing; Translational research

Indexed keywords

MICRORNA;

ARTICLE; BIOINFORMATICS; CASE STUDY; CLOUD COMPUTING; COMPUTER PROGRAM; DATA ANALYSIS; GENE DOSAGE; GENOMICS; GLOBUS GENOMICS SYSTEM; HIGH THROUGHPUT SEQUENCING; HUMAN; INFORMATION PROCESSING; MAJOR CLINICAL STUDY; NEXT GENERATION SEQUENCING; PRIORITY JOURNAL; RNA SEQUENCE; TRANSLATIONAL RESEARCH;

EID: 84948743761     PISSN: None     EISSN: 20010370     Source Type: Journal    
DOI: 10.1016/j.csbj.2014.11.001     Document Type: Article

References (74)

1. S.C. Schuster Next-generation sequencing transforms today's biology Nat Methods 5 2008 16 18
2. D.C. Koboldt, K.M. Steinberg, D.E. Larson, R.K. Wilson, and E.R. Mardis The next-generationsequencing revolution and its impact on genomics Cell 155 2013 27 38
3. J.Y. Park, L.J. Kricka, and P. Fortina Next-generation sequencing in the clinic Nat Biotechnol 31 2013 990 992
4. M. Baker Next-generation sequencing: adjusting to data overload Nat Methods 7 2010 495 499
5. P. Church, and A. Goscinski A survey of cloud-based service computing solutions for mammalian genomics IEEE Trans Serv Comput 1-1 2014
6. Amazon web services http://aws.amazon.com/ June 30 2014
7. Google cloud platform https://cloud.google.com/ Oct. 10 2014
8. Microsoft Azure https://azure.microsoft.com/en-us/ Oct. 10 2014
9. L.D. Stein The case for cloud computing in genome informatics Genome Biol 11 2010 207
10. Answers to genome analysis may be in the clouds http://www.genome.gov/27538886 Oct. 21 2014
11. AWS case study - Harvard Medical School http://aws.amazon.com/solutions/case-studies/harvard/ Oct. 8 2014
12. AWS use case - Genomic Medicine Institute, Seoul National University College of Medicine, Korea http://aws.amazon.com/solutions/case-studies/gmi/ Oct. 8 2014
13. AWS case study - Icahn School of Medicine at Mount Sinai http://aws.amazon.com/solutions/case-studies/mt-sinai/ Oct. 8 2014
14. AWS case study: New York University Langone Medical Center http://aws.amazon.com/solutions/case-studies/new-york-university/ Oct. 8 2014
15. AWS case study: Penn State Biological Engineering Department http://aws.amazon.com/solutions/case-studies/penn-state/ Oct. 8 2014
16. AWS case study: University of California Berkeley AMP Lab's Genomics Research Project http://aws.amazon.com/solutions/case-studies/university-of-california-berkeley-amp-lab-genomics-research/ Oct. 8 2014
17. J.T. Dudley, Y. Pouliot, R. Chen, A.A. Morgan, and A.J. Butte Translational bioinformatics in the cloud: an affordable alternative Genome Med 2 2010 51
18. D. Sulakhe, A. Rodriguez, N. Prozorovsky, N. Kavthekar, R. Madduri, A. Parikh, and et al. Distributed tools deployment and management for multiple galaxy instances in globus, genomics 2013 106 111
19. Cloud computing service models http://en.wikipedia.org/wiki/Cloud-computing#Service-models Oct. 10 2014
20. J.G. Reid, A. Carroll, N. Veeraraghavan, M. Dahdouli, A. Sundquist, A. English, and et al. Launching genomics into the cloud: deployment of Mercury, a next generation sequence analysis pipeline BMC Bioinforma 15 2014 30
21. DNAnexus https://www.dnanexus.com/ June 30 2014
22. R.K. Madduri, D. Sulakhe, L. Lacinski, B. Liu, A. Rodriguez, K. Chard, and et al. Experiences building Globus Genomics: a next-generation sequencing analysis service using Galaxy, Globus, and Amazon Web Services 2014 Concurrency and Computation: Practice and Experience: n/a-n/a
23. Partek Flow for NGS Analysis http://www.partek.com/ June 30 2014
24. CLC Genomics Workbench http://www.clcbio.com/products/clc-genomics-workbench/ June 30 2014
25. DNASTAR Lasergene Genomics Suite http://www.dnastar.com/t-nextgenhome.aspx June 30 2014
26. Maverix Biomics http://www.maverixbio.com/ June 30 2014
27. Seven Bridges Genomics https://www.sbgenomics.com/ June 30 2014
28. Golden Helix SNP & Variation Suite 8 http://www.goldenhelix.com/SNP-Variation/index.html June 30 2014
29. D. Blankenberg, A. Gordon, G. Von Kuster, N. Coraor, J. Taylor, A. Nekrutenko, and et al. Manipulation of FASTQ data with Galaxy Bioinformatics 26 2010 1783 1785
30. D. Blankenberg, and J. Hillman-Jackson Analysis of next-generation sequencing data using Galaxy Methods Mol Biol 1150 2014 21 43
31. Galaxy tool shed https://wiki.galaxyproject.org/Toolshed June 30 2014
32. Galaxy https://usegalaxy.org/ June 30 2014
33. E. Afgan, D. Baker, N. Coraor, B. Chapman, A. Nekrutenko, and et al. Galaxy CloudMan: delivering cloud compute clusters BMC Bioinforma 11 Suppl. 12 2010 S4
34. Ravi K. Madduri, Paul Dave, Dinnanath Sulakhe, Lukasz Lacinski, Bo Liu, and Ian T. Foster Experiences in building a next-generation sequencing analysis service using galaxy, globus online and Amazon web service 2013 ACM New York
35. Amazon instance types http://aws.amazon.com/ec2/instance-types/ June 30 2014
36. V. Marx Genomics in the clouds Nat Methods 10 2013 941 945
37. H. Li, and R. Durbin Fast and accurate short read alignment with Burrows-Wheeler transform Bioinformatics 25 2009 1754 1760
38. Amazon spot instances http://aws.amazon.com/ec2/purchasing-options/spot-instances/
39. Autoscaling.
40. B. Liu, B. Sotomayor, R. Madduri, K. Chard, and I. Foster Deploying bioinformatics workflows on clouds with Galaxy and Globus Provision High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion 2012 1087 1095
41. Bryce Allen, John Bresnahan, Lisa Childers, Ian Foster, Gopi Kandaswamy, Raj Kettimuthu, and et al. Software as a service for data scientists 2012 Communications of the ACM: ACM
42. J. Ananthakrishnan RB, K. Chard, I. Foster, T. Howe, M. Lidman, and S. Tuecke Globus Nexus: an identity, profile, and group management platform for science gateways and other collaborative science applications Sep.23-27 2013 IEEE
43. W. Allcock, J. Bresnahan, R. Kettimuthu, and M. Link The Globus striped GridFTP framework and server 2005 [54-54]
44. W. Allcock GridFTP: Protocol Extensions to FTP for the Grid Global Grid Forum GFD-R-P.020 2003
45. P. Brightwell High performance file transfer over IP networks EBU Tech Rev 2010 [(http://tech.ebu.ch/techreview): BBC http://downloads.bbc.co.uk/rd/pubs/whp/whp-pdf-files/WHP183.pdf ]
46. C.A. Mattmann, S. Kelly, D.J. Crichton, J.S. Hughes, S. Hardman, P. Ramirez, and et al. A classification andevaluation of data movement technologies for the delivery of highly voluminous scientific data products NASA/IEE Conference on Mass Storage Systems and Technologies (MST 2006) 2006 Jet Propulsion Laboratory, National Aeronautics and Space Administration Pasadena, CA
47. R. Esposito, PM, G. Tortone, and F.M. Taurino Standard FTP and GridFTP protocols for international data transfer in Pamela Satellite Space Experiment; Computing in High Energy and Nuclear Physics 2003 Conference Proceedings 2003 24-28 March La Jolla San Diego, California
48. The Extreme Science and Engineering Discovery Environment (XSEDE) https://www.xsede.org/overview June 30 2014
49. KBase http://kbase.us/about/about/ June 30 2014
50. Users of Globus for data movement https://www.globus.org/case-studies Oct. 10 2014
51. The 1000 Genomes project now offers their FTP site as data transfer point through the Globus Transfer service http://www.1000genomes.org/announcements/1000-genomes-ftp-site-now-available-through-globus-online-2014-06-17 Oct. 17 2014
52. FAQ: Can I access 1000 genomes data with Globus Online? http://www.1000genomes.org/faq/can-i-access-1000-genomes-data-globus-online Oct. 17 2014
53. Read data through Globus GridFTP 2014 http://www.ebi.ac.uk/about/news/service-news/read-data-through-globus-gridftp
54. A. Dubey, and D. Wagle Delivering software as a service 1-12 May 2007 The McKinsey Quarterly Web Exclusive
55. C. Trapnell, L. Pachter, and S.L. Salzberg TopHat: discovering splice junctions with RNA-Seq Bioinformatics 25 2009 1105 1111
56. C. Trapnell, B.A. Williams, G. Pertea, A. Mortazavi, G. Kwan, M.J. van Baren, and et al. Transcript assembly and quantification by RNA-Seq reveals unannotated transcripts and isoform switching during cell differentiation Nat Biotechnol 28 2010 511 515
57. B. Li, and C.N. Dewey RSEM: accurate transcript quantification from RNA-Seq data with or without a reference genome BMC Bioinforma 12 2011 323
58. A. McKenna, M. Hanna, E. Banks, A. Sivachenko, K. Cibulskis, A. Kernytsky, and et al. The Genome Analysis Toolkit: a MapReduce framework for analyzing next-generationDNA sequencing data Genome Res 20 2010 1297 1303
59. H. Li, B. Handsaker, A. Wysoker, T. Fennell, J. Ruan, N. Homer, and et al. The Sequence Alignment/Map format and SAMtools Bioinformatics 25 2009 2078 2079
60. S. Pabinger, A. Dander, M. Fischer, R. Snajder, M. Sperk, M. Efremova, and et al. A survey of tools for variant analysis of next-generation genome sequencing data Brief Bioinform 15 2014 256 278
61. C. Del Fabbro, S. Scalabrin, M. Morgante, and F.M. Giorgi An extensive evaluation of read trimming effects on Illumina NGS data analysis PLoS One 8 2013 e85024
62. Sickle - Windowed Adaptive Trimming for fastq files using quality https://github.com/najoshi/sickle June 30 2014
63. B. Langmead, and S.L. Salzberg Fast gapped-read alignment with Bowtie 2 Nat Methods 9 2012 357 359
64. Picard http://picard.sourceforge.net
65. P. Danecek, A. Auton, G. Abecasis, C.A. Albers, E. Banks, M.A. DePristo, and et al. The variant call format and VCFtools Bioinformatics 27 2011 2156 2158
66. Lung Cancer Sequencing Project Exome sequencing of lung adenocarcinomas and their normal counterparts ERP001575 http://www.ebi.ac.uk/ena/data/view/ERP001575 July 1 2014
67. Amazon EBS http://aws.amazon.com/ebs/ July 1 2014
68. Cancer Genomics Hub https://cghub.ucsc.edu/ June 30 2014
69. V. Trubetskoy, A. Rodriguez, U. Dave, N. Campbell, E.L. Crawford, E.H. Cook, and et al. Consensus Genotyper for Exome Sequencing (CGES): improving the quality of exome variant genotypes Bioinformatics 2014
70. Y. Zheng TW, F. Yoshimatsu, M. Lee, S. Gulsuner, S. Casadei, A. Rodriguez, and et al. A profileof inherited predisposition to breast cancer among Nigerian women 64thAnnual Meeting of the American Society of Human Genetics 2014 SanDiego Convention Center (SDCC) in San Diego California
71. Pediatric brain research laboratory uses Globus Genomics to overcome IT hurdles https://www.globus.org/genomics/resources/case-study-dobyns-pediatric-brain-research-lab.pdf Oct. 10 2014
72. D.V. Rama Raghavan, and Brooke L. Fridley Globus Genomics: A medical center's bioinformatics core perspective 2014 Globus World Chicago
73. Globus Genomics NGS Analysis http://www.bumc.bu.edu/gsi/next-generation-sequencing/globus-genomics/ Oct. 10 2014
74. M.J. Litzkow, M. Livny, and M.W. Mutka Condor - a hunter of idle workstations 8th International Conference on Distributed Computing Systems 1988 104 111