Experiences using cloud computing for a scientific workflow application

ScienceCloud'11 - Proceedings of the 2nd International Workshop on Scientific Cloud Computing

Volumn , Issue , 2011, Pages 15-24

  Vöckler, Jens Sönke ^a   Juve, Gideon ^a   Deelman, Ewa ^a   Rynge, Mats ^a   Berriman, Bruce ^b  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

cross cloud computing; EC2; eucalyptus; experience; futuregrid; magellan; nimbus; pegasus; periodigrams; sky computing; workflow

Indexed keywords

CROSS CLOUD COMPUTING; EC2; EUCALYPTUS; EXPERIENCE; FUTUREGRID; MAGELLAN; NIMBUS; PEGASUS; PERIODIGRAMS; SKY COMPUTING; WORKFLOW;

CLOUDS; COMPUTER SYSTEMS; EARTH (PLANET); MANAGEMENT; NASA; WORK SIMPLIFICATION;

CLOUD COMPUTING;

EID: 79961079167     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1996109.1996114     Document Type: Conference Paper

References (24)

1. J. S. Chase, D. E. Irwin, L. E. Grit, J. D. Moore, and S. E. Sprenkle. Dynamic virtual clusters in a grid site manager. In In Proceedings of the Twelfth International Symposium on High Performance Distributed Computing (HPDC-12), 2003.
2. E. Deelman, G. Singh, M. Livny, B. Berriman, and J. Good. The cost of doing science on the cloud: the Montage example. In Proceedings of the 2008 ACM/IEEE conference on Supercomputing, SC '08, pages 50:1-50:12, Piscataway, NJ, USA, 2008. IEEE Press.
3. E. Deelman, G. Singh, M.-H. Su, J. Blythe, and Y. e. a. Gil. Pegasus: A framework for mapping complex scientific workflows onto distributed systems. Sci. Program., 13:219-237, July 2005.
4. C. Evangelinos and C. Hill. Cloud Computing for Parallel Scientific HPC Applications: Feasibility of Running Coupled Atmosphere-Ocean Climate Models on Amazon's EC2. In Proceedings of the first workshop on cloud Computing and its Applications (CCA08), 2008.
5. R. J. Figueiredo, P. A. Dinda, and J. A. B. Fortes. A Case For Grid Computing On Virtual Machines. In Proceedings of the 23rd International Conference on Distributed Computing Systems, ICDCS '03, pages 550-, Washington, DC, USA, 2003. IEEE Computer Society.
6. C. Hoffa, G. Mehta, T. Freeman, E. Deelman, et al. On the Use of Cloud Computing for Scientific Workflows. In Proceedings of the 2008 Fourth IEEE International Conference on eScience, pages 640-645, Washington, DC, USA, 2008. IEEE Computer Society.
7. W. Huang, J. Liu, B. Abali, and D. K. Panda. A case for high performance computing with virtual machines. In Proceedings of the 20th annual international conference on Supercomputing, ICS '06, pages 125-134, New York, NY, USA, 2006. ACM.
8. K. R. Jackson, L. Ramakrishnan, K. Muriki, S. Canon, et al. Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud. In CloudCom, pages 159-168. IEEE, 2010.
9. G. Juve and E. Deelman. Wrangler: Virtual Cluster Provisioning for the Cloud. In HPDC, 2011.
10. G. Juve, E. Deelman, K. Vahi, and G. Mehta. Data Sharing Options for Scientific Workflows on Amazon EC2. In Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, SC '10, pages 1-9, Washington, DC, USA, 2010. IEEE Computer Society.
11. G. Juve, E. Deelman, K. Vahi, G. Mehta, et al. Scientific workflow applications on amazon ec2. In E-Science Workshops, 2009 5th IEEE International Conference on, pages 59 -66, Dec. 2009.
12. K. Keahey, I. Foster, T. Freeman, and X. Zhang. Virtual workspaces: Achieving quality of service and quality of life in the Grid. Sci. Program., 13:265-275, October 2005.
13. K. Keahey and T. Freeman. Contextualization: Providing One-Click Virtual Clusters. In eScience, 2008. eScience '08. IEEE Fourth International Conference on, pages 301 -308, dec. 2008.
14. K. Keahey, M. Tsugawa, A. Matsunaga, and J. Fortes. Sky Computing. IEEE Internet Computing, 13:43-51, 2009.
15. J. Napper and P. Bientinesi. Can cloud computing reach the top500? In Proceedings of the combined workshops on UnConventional high performance computing workshop plus memory access workshop, UCHPC-MAW '09, pages 17-20, New York, NY, USA, 2009. ACM.
16. S. Ostermann, A. Iosup, N. Yigitbasi, R. Prodan, et al. A Performance Analysis of EC2 Cloud Computing Services for Scientific Computing. In 1st International Conference on Cloud Computing. ICST Press, 2009.
17. P. Plavchan, M. Jura, J. D. Kirkpatrick, R. M. Cutri, and S. C. Gallagher. Near-Infrared Variability in the 2MASS Calibration Fields: A Search for Planetary Transit Candidates. The Astrophysical Journal Supplement Series, 175(1):191, 2008.
18. G. Singh et al. Workflow task clustering for best effort systems with Pegasus. In Proceedings of the 15th ACM Mardi Gras conference., MG '08, pages 9:1-9:8, New York, NY, USA, 2008. ACM.
19. C. Vecchiola, S. Pandey, and R. Buyya. High-Performance Cloud Computing: A View of Scientific Applications. In International Symposium on Parallel Architectures, Algorithms, and Networks, 2009.
20. G. von Laszewski, G. C. Fox, F. Wang, A. Younge, A. Kulshrestha, et al. Design of the FutureGrid Experiment Management Framework. In The International Conference for High Performance Computing, Networking, Storage and Analysis (SC10), pages 1-10, New Orleans, LA, 11/2010 2010. IEEE.
21. J. Vöckler, G. Mehta, Y. Zhao, E. Deelman, and M. Wilde. Kickstarting Remote Applications. The 2nd Workshop on Grid Computing Environments (OGCE06) [unpublished], 11 2006.
22. E. Walker. Benchmarking Amazon EC2 for High-Performance Scientific Computing. In USENIX Login, pages 18-23, 2008.
23. L. Youseff, R. Wolski, B. Gorda, and R. Krintz. Paravirtualization for HPC Systems. In In Proc. Workshop on Xen in High-Performance Cluster and Grid Computing, pages 474-486. Springer, 2006.
24. W. Yu and J. S. Vetter. Xen-Based HPC: A Parallel I/O Perspective. In "Proceedings of the 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid", pages 154-161, Washington, DC, USA, 2008. IEEE Computer Society.