From scripted HPC-based NGS pipelines to workflows on the cloud

Proceedings - 14th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2014

Volumn , Issue , 2014, Pages 694-700

  Cała, Jacek ^a   Xu, Yaobo ^b   Wijaya, Eldarina Azfar ^a   Missier, Paolo ^a  

^a NEWCASTLE UNIVERSITY   (United Kingdom)

^b NEWCASTLE UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DATA FLOW ANALYSIS; GRID COMPUTING;

COMPLETE SYSTEM; CURRENT STATUS; DATAFLOW MODEL; REPRODUCIBILITIES; RUNNING-IN; WORK-FLOWS;

PIPELINES;

EID: 84904575197     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGrid.2014.128     Document Type: Conference Paper

References (28)

1. L. D. Stein, "The case for cloud computing in genome informatics." Genome biology, vol. 11, no. 5, p. 207, Jan. 2010.
2. S. B. Ng, E. H. Turner, P. D. Robertson, S. D. Flygare, A. W. Bigham, C. Lee, T. Shaffer, M. Wong, A. Bhattacharjee, E. E. Eichler, M. Bamshad, D. A. Nickerson, and J. Shendure, "Targeted capture and massively parallel sequencing of 12 human exomes." Nature, vol. 461, no. 7261, pp. 272-6, Sep. 2009.
3. A. Sifrim, J. K. Van Houdt, L.-C. Tranchevent, B. Nowakowska, R. Sakai, G. A. Pavlopoulos, K. Devriendt, J. R. Vermeesch, Y. Moreau, and J. Aerts, "Annotate-it: a Swiss-knife approach to annotation, analysis and interpretation of single nucleotide variation in human disease." Genome medicine, vol. 4, no. 9, p. 73, Sep. 2012.
4. A. Sifrim, D. Popovic, L.-C. Tranchevent, A. Ardeshirdavani, R. Sakai, P. Konings, J. R. Vermeesch, J. Aerts, B. De Moor, and Y. Moreau, "eXtasy: variant prioritization by genomic data fusion." Nature methods, vol. 10, no. 11, pp. 1083-4, Nov. 2013.
5. S. Pabinger, A. Dander, M. Fischer, R. Snajder, M. Sperk, M. Efremova, B. Krabichler, M. R. Speicher, J. Zschocke, and Z. Trajanoski, "A survey of tools for variant analysis of next-generation genome sequencing data." Briefings in bioinformatics, pp. bbs086-, Jan. 2013.
6. I. B. Blanquer, G. Brasche, J. Cała, F. Gagliardi, D. Gannon, H. Hiden, H. Soncu, K. Takeda, A. Tomás, and S. Woodman, "Supporting NGS Pipelines in the cloud," EMBnet.journal, vol. 19, pp. 14-16, 2013.
7. S. Woodman, H. Hiden, P. Watson, and P. Missier, "Achieving Re-producibility by Combining Provenance with Service and Workflow Versioning," in Procs. WORKS 2011, Seattle, WA, USA, 2011.
8. L. Moreau, B. Clifford, J. Freire, J. Futrelle, Y. Gil, P. Groth, N. Kwas-nikowska, S. Miles, P. Missier, J. Myers, B. Plale, Y. Simmhan, E. Stephan, and J. Van Den Bussche, "The Open Provenance Model - Core Specification (v1.1)," Future Generation Computer Systems, vol. 7, no. 21, pp. 743-756, 2011.
9. P. Missier, S. Woodman, H. Hiden, and P. Watson, "Provenance and data differencing for workflow reproducibility analysis," Concurrency and Computation: Practice and Experience, vol. in Press, pp. n/a-n/a, 2013.
10. Y.-C. Lin, C.-S. Yu, and Y.-J. Lin, "Enabling large-scale biomedical analysis in the cloud." BioMed research international, vol. 2013, p. 185679, Jan. 2013.
11. E. S. Torstenson, B. Li, and C. Li, "ASAP: an environment for automated preprocessing of sequencing data." BMC research notes, vol. 6, no. 1, p. 5, Jan. 2013.
12. J. Goecks, A. Nekrutenko, and J. Taylor, "Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences." Genome biology, vol. 11, no. 8, p. R86, Jan. 2010.
13. E. Afgan, D. Baker, N. Coraor, H. Goto, I. M. Paul, K. D. Makova, A. Nekrutenko, and J. Taylor, "Harnessing cloud computing with Galaxy Cloud." Nature biotechnology, vol. 29, no. 11, pp. 972-4, Nov. 2011.
14. E. Afgan, B. Chapman, and J. Taylor, "CloudMan as a platform for tool, data, and analysis distribution." BMC bioinformatics, vol. 13, no. 1, p. 315, Jan. 2012.
15. P. Missier, S. Soiland-Reyes, S. Owen, W. Tan, A. Nenadic, I. Dunlop, A. Williams, T. Oinn, and C. Goble, "Taverna, reloaded," in Procs. SSDBM 2010, M. Gertz, T. Hey, and B. Ludaescher, Eds., Heidelberg, Germany, 2010. [Online]. Available: http://www.ssdbm2010.org/
16. M. Abouelhoda, S. A. Issa, and M. Ghanem, "Tavaxy: integrating Taverna and Galaxy workflows with cloud computing support." BMC bioinformatics, vol. 13, p. 77, Jan. 2012.
17. R. K. Madduri, P. Dave, D. Sulakhe, L. Lacinski, B. Liu, and I. T. Foster, "Experiences in building a next-generation sequencing analysis service using galaxy, globus online and Amazon web service," Proceedings of the Conference on Extreme Science and Engineering Discovery Environment Gateway to Discovery-XSEDE '13, p. 1, 2013.
18. S. Lampa, M. Dahlö, P. I. Olason, J. Hagberg, and O. Spjuth, "Lessons learned from implementing a national infrastructure in Sweden for storage and analysis of next-generation sequencing data." GigaScience, vol. 2, no. 1, p. 9, Jan. 2013.
19. M. El-Kalioby, M. Abouelhoda, J. Krüger, R. Giegerich, A. Sczyrba, D. P. Wall, and P. Tonellato, "Personalized cloud-based bioinformatics services for research and education: use cases and the elasticHPC package." BMC bioinformatics, vol. 13 Suppl 1, no. Suppl 17, p. S22, Jan. 2012.
20. S. Schönherr, L. Forer, H. Weiß ensteiner, F. Kronenberg, G. Specht, and A. Kloss-Brandstätter, "Cloudgene: a graphical execution platform for MapReduce programs on private and public clouds." BMC bioin-formatics, vol. 13, no. 1, p. 200, Jan. 2012.
21. A. ODriscoll, J. Daugelaite, and R. D. Sleator, "Big data, Hadoop and cloud computing in genomics," Journal of Biomedical Informatics, vol. 46, no. 5, pp. 774-781, 2013.
22. A. McKenna, M. Hanna, E. Banks, A. Sivachenko, K. Cibulskis, A. Kernytsky, K. Garimella, D. Altshuler, S. Gabriel, M. Daly, and M. a. DePristo, "The Genome Analysis Toolkit: a MapReduce framework for analyzing next-generation DNA sequencing data." Genome research, vol. 20, no. 9, pp. 1297-303, Sep. 2010.
23. H. Hiden, S. Woodman, P. Watson, and J. Cała, "Developing cloud applications using the e-Science Central platform," Philosophical transactions. Series A, Mathematical, physical, and engineering sciences, vol. 371, no. 1983, jan 2013.
24. J. Cała, H. Hiden, S. Woodman, and P. Watson, "Cloud computing for fast prediction of chemical activity," Future Generation Computer Systems, Feb. 2013.
25. E. Deelman, D. Gannon, M. Shields, and I. Taylor, "Workflows and e-science: An overview of workflow system features and capabilities," Future Generation Computer Systems, vol. 25, no. 5, pp. 528-540, may 2009.
26. S. Ostermann, A. Iosup, N. Yigitbasi, R. Prodan, T. Fahringer, and D. Epema, "A Performance Analysis of EC2 Cloud Computing Services for Scientific Computing," in Cloud Computing, 2010, pp. 115-131.
27. E. Walker, "benchmarking Amazon EC2 for high-performance scientific computing," ;login:, vol. 33, no. 5, pp. 18-23, 2008.
28. A. Marathe, R. Harris, D. K. Lowenthal, B. R. de Supinski, B. Rountree, M. Schulz, and X. Yuan, "A comparative study of high-performance computing on the cloud," Proceedings of the 22nd international sympo-sium on High-performance parallel and distributed computing-HPDC '13, p. 239, 2013.