Deploying bioinformatics workflows on clouds with galaxy and globus provision

Proceedings - 2012 SC Companion: High Performance Computing, Networking Storage and Analysis, SCC 2012

Volumn , Issue , 2012, Pages 1087-1095

  Liu, Bo ^a,b   Sotomayor, Borja ^c   Madduri, Ravi ^a,b   Chard, Kyle ^a,b   Foster, Ian ^a,b  

^a UNIVERSITY OF CHICAGO   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

^c THE UNIVERSITY OF CHICAGO   (United States)

Author keywords

Cloud computing; Galaxy; Globus provision; Scientific workflow

Indexed keywords

BIOINFORMATICS WORKFLOWS; CLOUD ENVIRONMENTS; DATA-INTENSIVE APPLICATION; DEPLOYMENT AND CONFIGURATION; GLOBUS PROVISION; HIGH-SPEED DATA TRANSFER; RESOURCE UTILIZATIONS; SCIENTIFIC WORKFLOWS;

CLOUD COMPUTING; DATA TRANSFER; GALAXIES;

BIOINFORMATICS;

EID: 84876561822     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.Companion.2012.131     Document Type: Conference Paper

References (31)

1. Y. Zhao, I. Raicu, and I. T. Foster:, "Scientific workflow systems for 21st century, new bottle or new wine?," in 2008 IEEE Congress on Services, Honolulu, Hawaii, USA, 2008, pp. 467-471.
2. I. J. Taylor, E. Deelman, D. B. Gannon, and M. Shields, Eds., Workflows for e-Science: Scientific Workflows for Grids. Springer, New York, Secaucus, NJ, USA., 2007.
3. W. Tan, R. Madduri, A. Nenadic, S. Soiland-Reyes, D. Sulakhe, I. Foster, and C. A. Goble, "CaGrid Workflow Toolkit: a Taverna based workflow tool for cancer grid," BMC Bioinformatics, vol. 11, p. 542, 2010.
4. G. Juve, E. Deelman, K. Vahi, G. Mehta, B. Berriman, B. P. Berman, and P. Maechling, "Scientific workflow applications on Amazon EC2," in Workshop on Cloud-based Services and Applications in conjunction with 5th IEEE International Conference on e-Science (e-Science 2009), Oxford UK, 2009, pp. 59-66.
5. Y. Simmhan, R. Barga, C. van Ingen, E. Lazowska, and A. Szalay, "Building the trident scientific workflow workbench for data management in the cloud," in Third International Conference on Advanced Engineering Computing and Applications in Sciences, 2009, pp. 41-50.
6. C. Hoffa, G. Mehta, T. Freeman, E. Deelman, K. Keahey, B. Berriman, and J. Good, "On the use of cloud computing for scientific workflows," in IEEE International Conference on eScience, 2008, pp. 640-645.
7. T. Dornemann, E. Juhnke, and B. Freisleben, "On-demand resource provisioning for BPEL workflows using Amazon's elastic compute cloud," in IEEE/ACM International Symposium on Cluster Computing and the Grid, 2009, pp. 140-147.
8. Amazon EC2. Available: http://aws.amazon.com/ec2/
9. J. Goecks, A. Nekrutenko, and J. Taylor, "Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences," Genome Biol, vol. 11, p. R86, 2010.
10. B. Allen, J. Bresnahan, L. Childers, I. Foster, G. Kandaswamy, R. Kettimuthu, J. Kordas, M. Link, S. Martin, K. Pickett, and S. Tuecke, "Software as a service for data scientists," Commun. ACM, vol. 55, pp. 81-88, 2012.
11. R project. Available: http://www.r-project.org/
12. Galaxy. Available: http://en.wikipedia.org/wiki/Galaxy-(computational- biology)
13. Globus Provision. Available: http://globus.org/provision/
14. J. Bresnahan, M. Link, G. Khanna, Z. Imani, R. Kettimuthu, and I. Foster, "Globus GridFTP: what's new in 2007," presented at the Proceedings of the first international conference on Networks for grid applications, Lyon, France, 2007.
15. J. Basney, M. Humphrey, and V. Welch, "The MyProxy online credential repository," Software: Practice and Experience, vol. 35, pp. 801-816, 2005.
16. D. Thain, T. Tannenbaum, and M. Livny, "Distributed computing in practice: the Condor experience: Research Articles," Concurr.comput.: Pract. Exper., vol. 17, pp. 323-356, 2005.
17. Chef. Available: http://www.opscode.com/chef/
18. E. Afgan, D. Baker, N. Coraor, B. Chapman, A. Nekrutenko, and J. Taylor, "Galaxy CloudMan: delivering cloud compute clusters," BMC Bioinformatics, vol. 11 Suppl 12, p. S4, 2010.
19. Globus Online. Available: https://www.globusonline.org
20. I. Foster, "Globus Online: Accelerating and Democratizing Science through Cloud-Based Services," Internet Computing, IEEE, vol. 15, pp. 70-73, 2011.
21. Globus Connect. Available: https://www.globusonline.org/globus-connect/
22. R. L. Winslow, J. Saltz, and I. Foster, "The CardioVascular Research Grid (CVRG) Project," AMIA Summit on Translational Bioinformatics: San Francisco, CA, 2011.
23. CVRG Galaxy portal. Available: https://portal.cvrgrid.org/
24. Puppet. Available: http://puppetlabs.com/
25. D. Nurmi, R. Wolski, C. Grzegorczyk, G. Obertelli, S. Soman, L. Youseff, and D. Zagorodnov, "The Eucalyptus Open-Source Cloud-Computing System," in Cluster Computing and the Grid, 2009. CCGRID '09. 9th IEEE/ACM International Symposium on, 2009, pp. 124-131.
26. P. Marshall, H. M. Tufo, K. Keahey, D. L. Bissoniere, and M. Woitaszek, "Architecting a Large-scale Elastic Environment-Recontextualization and Adaptive Cloud Services for Scientific Computing," in ICSOFT, 2012, pp. 409-418.
27. OpenStack: The open source, open standards cloud. Available: http://openstack.org/
28. P. Mvelase, N. Dlodlo, I. Makitla, G. Sibiya, and M. Adigun, "An Architecture Based on SOA and Virtual Enterprise Principles: OpenNebula for Cloud Deployment," Proceedings of the International Conference on Information Management & Evaluation, pp. 214-222, 2012.
29. Y. Dong, Y. Yun, L. Xiao, and C. Jinjun, "A cost-effective strategy for intermediate data storage in scientific cloud workflow systems," in Parallel & Distributed Processing (IPDPS), 2010 IEEE International Symposium on, 2010, pp. 1-12.
30. Z. Wu, X. Liu, Z. Ni, D. Yuan, and Y. Yang. (2011, 1.10.2012). A Market-Oriented Hierarchical Scheduling Strategy in Cloud Workflow Systems. Available: http://www.springerlink.com/content/t7t8823l8g88l827/fulltext.pdf
31. C. Zhang and H. De Sterck, "CloudWF: A Computational Workflow System for Clouds Based on Hadoop." vol. 5931, M. Jaatun, et al., Eds., ed: Springer Berlin /Heidelberg, 2009, pp. 393-404.