Scientific workflow applications on amazon EC2

e-science 2009 - Proceedings of the 2009 5th IEEE International Conference on e-Science Workshops

Volumn , Issue , 2009, Pages 59-66

  Juve, Gideon ^a   Deelman, Ewa ^a   Vahi, Karan ^a   Mehta, Gaurang ^a   Berman, Benjamin P ^b   Berriman, Bruce ^c   Maechling, Phil ^d  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^c USC Epigenome Center   (United States)

^d Southern California Earthquake Center   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLOUD COMPUTING; HARDWARE RESOURCES; ON-DEMAND; PAY AS YOU GO; SCIENTIFIC APPLICATIONS; SCIENTIFIC COMPUTING; SCIENTIFIC WORKFLOWS; VIRTUALIZATIONS; WORK-FLOWS;

CLOUDS; COST REDUCTION;

MANAGEMENT;

EID: 77950143591     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ESCIW.2009.5408002     Document Type: Conference Paper

References (37)

1. Amazon.com, "Elastic Block Store (EBS)"; http://aws.amazon.com/ ebs.
2. Amazon.com, "Elastic Compute Cloud (EC2)"; http://aws.amazon. com/ec2.
3. Amazon.com, "Simple Storage Service (S3)"; http://aws.amazon. com/s3.
4. M. Armbrust et al., Above the Clouds: A Berkeley View of Cloud Computing, white paper, UC Berkeley, 2009.
5. P. Barham et al., "Xen and the Art of Virtualization," 19th ACM Symposium on Operating Systems Principles (SOSP'03), 2003.
6. CondorTeam, "DAGMan"; http://cs.wisc.edu/condor/dagman.
7. "Corral"; http://pegasus.isi.edu/glidein/latest.
8. E. Deelman et al., "The Cost of Doing Science on the Cloud: The Montage Example," ACM/IEEE conference on Supercomputing (SC'08), 2008.
9. E. Deelman et al., "Pegasus: A framework for mapping complex scientific workflows onto distributed systems," Scientific Programming, vol. 13, 2005, pp. 219-237.
10. C. Evangelinos et al., "Cloud Computing for Parallel Scientific HPC Applications: Feasibility of Running Coupled Atmosphere-Ocean Climate Models on Amazon's EC2," Cloud Computing and Its Applications (CCA 2008), 2008.
11. R.J. Figueiredo et al., "A case for grid computing on virtual machines," 23rd International Conference on Distributed Computing Systems, 2003, pp. 550-559.
12. "FlexiScale"; http://www.flexiscale.com.
13. I. Foster et al., "Cloud Computing and Grid Computing 360-Degree Compared," Grid Computing Environments Workshop (GCE '08), 2008.
14. I. Foster, "Globus Toolkit Version 4: Software for Service-Oriented Systems," 2006.
15. J. Frey et al., "Condor-G: A Computation Management Agent for Multi-Institutional Grids," Cluster Computing, vol. 5, 2002, pp. 237-246.
16. L. Gilbert et al., "Performance Implications of Virtualization and Hyper-Threading on High Energy Physics Applications in a Grid Environment," 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05), 2005.
17. "GoGrid"; http://www.gogrid.com.
18. C. Hoffa et al., "On the Use of Cloud Computing for Scientific Workflows," 3rd International Workshop on Scientific Workflows and Business Workflow Standards in e-Science (SWBES '08), 2008.
19. W. Huang et al., "A Case for High Performance Computing with Virtual Machines," 20th International Conference on Supercomputing, 2006.
20. Hyperic, Inc., "CloudStatus"; http://www.cloudstatus.com.
21. D.S. Katz et al., "A comparison of two methods for building astronomical image mosaics on a grid," International Conference on Parallel Processing (ICPP'05), 2005, pp. 85-94.
22. H. Li et al., "Mapping short DNA sequencing reads and calling variants using mapping quality scores," Genome Research, vol. 18, 2008, pp. 1851-1858.
23. M.J. Litzkow et al., "Condor: A Hunter of Idle Workstations," 8th International Conference on Distributed Computing Systems, 1988, pp. 104-111.
24. J. Napper et al., "Can Cloud Computing Reach the Top500?," Combined Workshops on UnConventional high performance computing workshop plus memory access, 2009.
25. National Center for Supercomputing Applications (NCSA), "Intel 64 Cluster Abe"; http://www.ncsa.illinois.edu/UserInfo/Resources/Ha rdware/Intel64Cluster.
26. "Nimbus"; http://workspace.globus.org.
27. D. Nurmi et al., "The Eucalyptus Open-source Cloud-computing System," IEEE International Symposium on Cluster Computing and the Grid (CCGrid '09), 2009.
28. "OpenNebula"; http://www.opennebula.org.
29. M.R. Palankar et al., "Amazon S3 for science grids: a viable solution?," International workshop on Data-aware distributed computing, 2008.
30. Southern California Earthquake Center, "Community Modeling Environment (CME)"; http://www.scec.org/cme.
31. "USC Epigenome Center"; http://epigenome.usc.edu.
32. E. Walker, "Benchmarking Amazon EC2 for High-Performance Scientific Computing," Login, vol. 33, pp. 18-23.
33. P. Watson et al., "Cloud Computing for e-Science with CARMEN," IBERGRID 2008, 2008.
34. L. Youseff et al., "Toward a Unified Ontology of Cloud Computing," Grid Computing Environments Workshop (GCE '08), 2008.
35. L. Youseff et al., "The impact of paravirtualized memory hierarchy on linear algebra computational kernels and software," 17th international symposium on High performance distributed computing, 2008.
36. L. Youseff et al., "Paravirtualization for HPC Systems," Workshop on Xen in High-Performance Cluster and Grid Computing, 2006.
37. J. Yu et al., "A Taxonomy of Workflow Management Systems for Grid Computing," Journal of Grid Computing, vol. 3, 2005.