Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters

Proc. 18th ACM International Symposium on High Performance Distributed Computing, HPDC 09, Co-located with the 2009 International Symposium on High Performance Distributed Computing Conf., HPDC'09

Volumn , Issue , 2009, Pages 141-150

  De Assunção, Marcos Dias ^a   Di Costanzo, Alexandre ^a   Buyya, Rajkumar ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

C.2.4 computer communication networks : Distributed systems; D.4.7 operating systems : Organization and design Distributed systems; Design; Management; Performance

Indexed keywords

CLOUD COMPUTING; COMPUTER COMMUNICATION NETWORKS; COMPUTING CAPACITY; DISTRIBUTED SYSTEMS; LOCAL CLUSTER; OPERATING SYSTEMS; OVERALL COSTS; REMOTE RESOURCES; RESPONSE TIME; SCHEDULING STRATEGIES; VIRTUAL MACHINE TECHNOLOGY; VIRTUAL MACHINES;

COMPUTER SCIENCE; COST REDUCTION; DESIGN; DIE CASTING; DISTRIBUTED COMPUTER SYSTEMS; RESPONSE TIME (COMPUTER SYSTEMS); SCHEDULING;

COMPUTER OPERATING SYSTEMS;

EID: 70449646932     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1551609.1551635     Document Type: Conference Paper

References (38)

1. Amazon Inc. Amazon Elastic Compute Cloud (Amazon EC2). http://aws.amazon.com/ec2.
2. M. Armbrust, A. Fox, R. Griffith, A. D. Joseph, R. H. Katz, A. Konwinski, G. Lee, D. A. Patterson, A. Rabkin, I. Stoica, and M. Zaharia. Above the clouds: A Berkeley view of Cloud computing. Technical report UCB/EECS-2009-28, Electrical Engineering and Computer Sciences, University of California at Berkeley, Berkeley, USA, February 2009.
3. M. Balazinska, H. Balakrishnan, and M. Stonebraker. Contract-based load management in federated distributed systems. In 1st Symposium on Networked Systems Design and Implementation (NSDI), pages 197-210, San Francisco, USA, March 2004. USENIX Association.
4. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In 19th ACM Symposium on Operating Systems Principles (SOSP '03), pages 164-177, New York, NY, USA, 2003. ACM Press.
5. R. Buyya and M. Murshed. GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for Grid computing. Concurrency and Computation: Practice and Experience (CPE), 14(13-15):1175-1220, November-December 2002.
6. J. S. Chase, D. E. Irwin, L. E. Grit, J. D. Moore, and S. E. Sprenkle. Dynamic virtual clusters in a Grid site manager. In 12th IEEE International Symposium on High Performance Distributed Computing (HPDC 2003), page 90, Washington, DC, USA, 2003. IEEE Computer Society.
7. T. H. Cormen, C. E. Leiserson, R. L. Rivest, and C. Stein. Introduction to Algorithms. MIT Press / McGraw-Hill, Cambridge, Massachusetts, 2nd edition, 2001.
8. M. D. de Assunção, R. Buyya, and S. Venugopal. InterGrid: A case for internetworking islands of Grids. Concurrency and Computation: Practice and Experience (CCPE), 20(8):997-1024, June 2008.
9. E. Deelman, G. Singh, M. Livny, B. Berriman, and J. Good. The cost of doing science on the Cloud: The montage example. In 2008 ACM/IEEE Conference on Supercomputing (SC 2008), pages 1-12, Piscataway, NJ, USA, 2008. IEEE Press.
10. W. Emeneker, D. Jackson, J. Butikofer, and D. Stanzione. Dynamic virtual clustering with Xen and Moab. In Frontiers of High Performance Computing and Networking with ISPA 2006, volume 4331 of LNCS, pages 440-451, Berlin/Heidelberg, November 2006. Springer.
11. D. England and J. B. Weissman. Costs and bene ts of load sharing in the computational Grid. In 10th International Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP '04), volume 3277 of LNCS, pages 160-175, New York, USA, 2004. Springer Berlin Heidelberg.
12. D. G. Feitelson, L. Rudolph, U. Schwiegelshohn, K. C. Sevcik, and P. Wong. Theory and practice in parallel job scheduling. In Job Scheduling Strategies for Parallel Processing (IPPS '97), pages 1-34, London, UK, 1997. Springer-Verlag.
13. J. Fontán, T. Vázquez, L. Gonzalez, R. S. Montero, and I. M. Llorente. OpenNEbula: The open source virtual machine manager for cluster computing. In Open Source Grid and Cluster Software Conference - Book of Abstracts, San Francisco, USA, May 2008.
14. I. Foster, T. Freeman, K. Keahey, D. Scheftner, B. Sotomayor, and X. Zhang. Virtual clusters for Grid communities. In 6th IEEE International Symposium on Cluster Computing and the Grid (CCGRID 2006), pages 513-520, Washington, DC, USA, May 2006. IEEE Computer Society.
15. C. Grimme, J. Lepping, and A. Papaspyrou. Prospects of collaboration between compute providers by means of job interchange. In Job Scheduling Strategies for Parallel Processing, volume 4942 of Lecture Notes in Computer Science, pages 132-151, Berlin / Heidelberg, April 2008. Springer.
16. L. Grit, D. Inwin, A. Yumerefendi, and J. Chase. Virtual machine hosting for networked clusters: Building the foundations for 'autonomic' orchestration. In 1st International Workshop on Virtualization Technology in Distributed Computing (VTDC 2006), Tampa, Florida, November 2006.
17. A. Iosup, D. H. J. Epema, T. Tannenbaum, M. Farrellee, and M. Livny. Inter-operating Grids through delegated matchmaking. In 2007 ACM/IEEE Conference on Supercomputing (SC 2007), pages 1-12, New York, USA, November 2007. ACM Press.
18. D. Irwin, J. Chase, L. Grit, A. Yumerefendi, D. Becker, and K. G. Yocum. Sharing networked resources with brokered leases. In USENIX Annual Technical Conference, pages 199-212, Berkeley, USA, June 2006. USENIX Association.
19. M. Islam, P. Balaji, P. Sadayappan, and D. K. Panda. QoPS: A QoS based scheme for parallel job scheduling. In 9th International Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP '03), volume 2862 of LNCS, pages 252-268, Seattle, WA, USA, 2003. Springer.
20. K. Keahey, I. Foster, T. Freeman, and X. Zhang. Virtual workspaces: Achieving quality of service and quality of life in the Grids. Scientific Programming, 13(4):265-275, 2006.
21. D. A. Lifka. The ANL/IBM SP scheduling system. In Workshop on Job Scheduling Strategies for Parallel Processing (IPPS'95), pages 295-303, London, UK, 1995. Springer-Verlag.
22. U. Lublin and D. G. Feitelson. The workload on parallel supercomputers: Modeling the characteristics of rigid jobs. Journal of Parallel and Distributed Computing, 63(11):1105-1122, 2003.
23. R. S. Montero, E. Huedo, and I. M. Llorente. Dynamic deployment of custom execution environments in Grids. In 2nd International Conference on Advanced Engineering Computing and Applications in Sciences (ADVCOMP '08), pages 33-38, Valencia, Spain, September/October 2008. IEEE Computer Society.
24. A. W. Mu'alem and D. G. Feitelson. Utilization, predictability, workloads, and user runtime estimates in scheduling the IBM SP2 with backfilling. IEEE Transactions on Parallel and Distributed Systems, 12(6):529-543, 2001.
25. D. Nurmi, R. Wolski, C. Crzegorczyk, G. Obertelli, S. Soman, L. Youseff, and D. Zagorodnov. Eucalyptus: a technical report on an elastic utility computing architecture linking your programs to useful systems. Technical Report 2008-10, Department of Computer Science, University of California, Santa Barbara, California, USA, 2008.
26. M. R. Palankar, A. Iamnitchi, M. Ripeanu, and S. Garfinkel. Amazon S3 for science Grids: a viable solution? In International Workshop on Data-aware Distributed Computing (DADC'08) in conjunction with HPDC 2008, pages 55-64, New York, NY, USA, 2008. ACM.
27. L. Ramakrishnan, D. Irwin, L. Grit, A. Yumerefendi, A. Iamnitchi, and J. Chase. Toward a doctrine of containment: Grid hosting with adaptive resource control. In 2006 ACM/IEEE Conference on Supercomputing (SC 2006), page 101, New York, NY, USA, 2006. ACM Press.
28. A. Rubio-Montero, E. Huedo, R. Montero, and I. Llorente. Management of virtual machines on globus Grids using GridWay. In IEEE International Parallel and Distributed Processing Symposium (IPDPS 2007), pages 1-7, Long Beach, USA, March 2007. IEEE Computer Society.
29. P. Ruth, P. McGachey, and D. Xu. VioCluster: Virtualization for dynamic computational domain. In IEEE International on Cluster Computing (Cluster 2005), pages 1-10, Burlington, USA, September 2005. IEEE.
30. A. Shoykhet, J. Lange, and P. Dinda. Virtuoso: A system for virtual machine marketplaces. Technical Report NWU-CS-04-39, Electrical Engineering and Computer Science Department, Northwestern University, Evanston/Chicago, IL, July 2004.
31. G. Singh, C. Kesselman, and E. Deelman. Adaptive pricing for resource reservations in shared environments. In 8th IEEE/ACM International Conference on Grid Computing (Grid 2007), pages 74-80, Austin, USA, September 2007. ACM/IEEE.
32. B. Sotomayor, K. Keahey, and I. Foster. Combining batch execution and leasing using virtual machines. In 17th International Symposium on High performance Distributed Computing (HPDC 2008), pages 87-96, New York, NY, USA, 2008. ACM.
33. S. Srinivasan, R. Kettimuthu, V. Subramani, and P. Sadayappan. Selective reservation strategies for backfill job scheduling. In 8th International Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP '02), volume 2537 of LNCS, pages 55-71, London, UK, 2002. Springer Berlin Heidelberg.
34. S. Surana, B. Godfrey, K. Lakshminarayanan, R. Karp, and I. Stoica. Load balancing in dynamic structured peer-to-peer systems. Performance Evaluation, 63(3):217-240, 2006.
35. M. Tatezono, N. Maruyama, and S. Matsuoka. Making wide-area, multi-site MPI feasible using Xen VM. In Workshop on Frontiers of High Performance Computing and Networking (held with ISPA 2006), volume 4331 of LNCS, pages 387-396, Berlin/Heidelberg, 2006. Springer.
36. Y.-T. Wang and R. J. T. Morris. Load sharing in distributed systems. IEEE Transactions on Computers, C-34(3):204-217, March 1985.
37. A. Weiss. Computing in the Clouds. netWorker, 11(4):16-25, December 2007.
38. R. Wolski, J. S. Plank, J. Brevik, and T. Bryan. Analyzing market-based resource allocation strategies for the computational Grid. The International Journal of High Performance Computing Applications, 15(3):258-281, Fall 2001.