On the use of cloud computing for scientific workflows

Proceedings - 4th IEEE International Conference on eScience, eScience 2008

Volumn , Issue , 2008, Pages 640-645

  Hoffa, Christina ^a   Mehta, Gaurang ^b   Freeman, Timothy ^c   Deelman, Ewa ^b   Keahey, Kate ^c   Berriman, Bruce ^d   Good, John ^d  

^a INDIANA UNIVERSITY   (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^c ARGONNE NATIONAL LABORATORY   (United States)

^d CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLOUD COMPUTING; LOCAL ENVIRONMENTS; RESOURCE-SCHEDULING; RUNNING-IN; RUNTIMES; SCIENTIFIC WORKFLOW; SCIENTIFIC WORKFLOWS; VIRTUAL ENVIRONMENTS; WIDE-AREA COMMUNICATIONS; WIDE-AREA NETWORKS;

LOCAL AREA NETWORKS; MANAGEMENT; VIRTUAL REALITY;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 62749085711     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/eScience.2008.167     Document Type: Conference Paper

References (34)

1. S. Lohr, "Google and IBM Join in Cloud Computing Research," New York Times, 2007.
2. A. Ricadela, "Computing Heads for the Clouds," in Business Week, November 16, 2007.
3. I. Foster and C. Kesselman, "The Grid: Blueprint for a New Computing Infrastructure," Morgan Kaufmann 1999.
4. I. Foster, C. Kesselman, et al., "The Anatomy of the Grid: Enabling Scalable Virtual Organizations," IJHPCAs, 2001.
5. "Amazon Elastic Compute Cloud," http://aws.amazon.com/ec2/.
6. http://workspace.globus.org/, Virtual Workspaces
7. I. Foster, T. Freeman, et al., "Virtual Clusters for Grid Communities," CCGRID, 2006.
8. I. Foster, R. Figueiredo, et al., "A case for grid computing on virtual machines," ICDCS 2003.
9. K. Keahey, K. Doering, et al., "From sandbox to playground: dynamic virtual environments in the grid," 2004, pp. 34-42.
10. G. B. Berriman, E. Deelman, et al., "Montage: A Grid Enabled Engine for Delivering Custom Science-Grade Mosaics On Demand," in SPIE Conference 5487: 2004.
11. E. Deelman, G. Mehta, et al., "Pegasus: Mapping Large-Scale Workflows to Distributed Resources," in Workflows in e-Science, I. Taylor, E. Deelman, et al., Eds.: Springer, 2006.
12. E. Deelman, G. Singh, et al., "Pegasus: a Framework for Mapping Complex Scientific Workflows onto Distributed Systems," SciProg Journal, vol. 13, pp. 219-237, 2005.
13. "Nimbus Science Cloud," http://workspace.globus.org/clouds/ nimbus.html.
14. E. Deelman, G. Singh, et al., "The Cost of Doing Science on the Cloud: The Montage Example," in SC'08 Austin, TX2008.
15. P. Barham, B. Dragovic, et al., "Xen and the art of virtualization," ACMSOSP, pp. 164-177, 2003.
16. B. Clark, T. Deshane, et al., "Xen and the art of repeated research," USENIX Annual Technical Conference, FREENIX Track, pp. 135-144, 2004.
17. A. Norton, D. Vanderster, et al., "Evaluation of Virtual Machines for HEP Grids," Computing in HEP, 2006.
18. VMWare, "A Performance Comparison of Hypervisors, "http://www.vmware.com/pdf/hypervisor performance.pdf
19. "Globus." http://wwwglobus.org.
20. M. Litzkow and M. Livny, "Experience With The Condor Distributed Batch System," in IEEE Workshop on Experimental Distributed Systems, 1990.
21. "DAGMAN (Directed Acyclic Graph Manager)," http://www.cs.wisc. edu/condor/dagman/, 2004.
22. J. Frey, T. Tannenbaum, et al., "Condor-G: A Computation Management Agent for Multi-Institutional Grids," HPDC 01.
23. D. A. Brown, P. R. Brady, et al., "A Case Study on the Use of Workflow Technologies for Scientific Analysis: Gravitational Wave Data Analysis," in Workflows for e-Science, 2006.
24. P. Maechling, E. Deelman, et al., "SCEC CyberShake Workflows - Automating Probabilistic Seismic Hazard Analysis Calculations," in Workflows for e-Science, 2006.
25. V. Nefedova, R. Jacob, et al., "Automating Climate Science: Large Ensemble Simulations on the TeraGrid with the GriPhyN Virtual Data System," in e-Science, 2006.
26. W. Allcock, J. Bester, et al., "Data Management and Transfer in High-Performance Computational Grid Environments," Parallel Computing, 2001.
27. M. Feller, I. Foster, et al., "GT4 GRAM: A Functionality and Performance Study," TeraGrid Conference, 2007.
28. A. Ramakrishnan, G. Singh, et al., "Scheduling Data - Intensive Workflows onto Storage-Constrained Distributed Resources," in CCGrid 2007.
29. G. Singh, K. Vahi, et al., "Optimizing Workflow Data Footprint" Scientific Programming Journal, vol. 15, 2007
30. M. Rosenblum and T. Garfinkel, "Virtual Machine Monitors: Current Technology and Future Trends," Computer, 2005.
31. A. Whitaker, M. Shaw, et al., "Denali: Lightweight virtual machines for distributed and networked applications," 2002.
32. J. Xenidis, "rHype: IBM Research Hypervisor," IBM Research, 2005.
33. L. Youseff, R. Wolski, et al., "Paravirtualization for HPC Systems," ISPA, vol. 4331, p. 474, 2006.
34. G. Singh, M. H. Su, et al., "Workflow task clustering for best effort systems with Pegasus," Proceedings of the 15th ACM Mardi Gras conference, 2008.