Hybrid Computing-Where HPC meets grid and Cloud Computing

Future Generation Computer Systems

Volumn 27, Issue 5, 2011, Pages 440-453

  Mateescu, Gabriel ^a   Gentzsch, Wolfgang ^b   Ribbens, Calvin J ^c  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b Open Grid Forum   (United States)

^c State University   (United States)

Author keywords

Cloud bursting; Cloud computing; Distributed hash table; Distributed systems; HPC; Scheduling; Statistical reservation; Virtualization

Indexed keywords

DISTRIBUTED HASH TABLE; DISTRIBUTED SYSTEMS; HPC; STATISTICAL RESERVATION; VIRTUALIZATIONS;

ARCHITECTURE; CLUSTER COMPUTING; COMPUTER SYSTEMS; DISTRIBUTED DATABASE SYSTEMS; FAULT TOLERANCE; GRID COMPUTING; QUALITY ASSURANCE; SCHEDULING; SYSTEMS ANALYSIS; TELECOMMUNICATION NETWORKS;

CLOUD COMPUTING;

EID: 79951850492     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2010.11.003     Document Type: Article

References (46)

1. E. Deelman, D. Gannon, M. Shields, and I. Taylor Workflows and e-science: an overview of workflow system features and capabilities Future Generation Computer Systems 25 5 2009 528 540 10.1016/j.future.2008.06.012
2. I. Foster, C. Kesselman, and S. Tuecke The anatomy of the grid: enabling scalable virtual organizations International Journal of Supercomputer Applications 15 3 2001
3. I. Foster, and C. Kesselman Globus: a metacomputing infrastructure toolkit The International Journal of Supercomputer Applications and High Performance Computing 11 2 1997 115 128 (Pubitemid 127673968)
4. Globus Alliance, Globus Project, December 2010. URL: http://www.globus. org/.
5. A. Streit, UNICORE: getting to the heart of grid technologies, in: UNICORE Project, 2010.
6. TeraGrid, TeraGrid project, December 2010. URL: http://www.teragrid.org/.
7. R. Buyya, C.S. Yeo, S. Venugopal, J. Broberg, and I. Brandic Cloud computing and emerging it platforms: vision, hype, and reality for delivering computing as the 5th utility Future Generation Computer Systems 25 6 2009 599 616 10.1016/j.future.2008.12.001
8. Amazon.com., Amazon Elastic Compute Cloud (EC2), December 2010. URL: http://aws.amazon.com/ec2/.
9. Amazon.com, Amazon Simple Storage Service (S3), December 2010. URL: http://aws.amazon.com/s3/.
10. I. Foster, Y. Zhao, I. Raicu, S. Lu, Cloud computing and grid computing 360-degree compared, in: Grid Computing Environments Workshop, 2008, GCE-08, 2008, pp. 110. doi:10.1109/GCE.2008.4738445.
11. G. Mateescu, A. Agarwal, R. Sobie, and B. Arnaud GridX1: a Canadian computational grid Future Generation Computer Systems 23 5 2007 680 687 10.1016/j.future.2006.12.006 (Pubitemid 46412509)
12. E. Huedo, R. Montero, and I. Llorente The gridway framework for adaptive scheduling and execution on grids Scalable ComputingPractice and Experience 6 3 2005 1 8
13. K. Keahey, M. Tsugawa, A. Matsunaga, and J. Fortes Sky computing IEEE Internet Computing 13 5 2009 43 51 10.1109/MIC.2009.94
14. R. Moreno-Vozmediano, R.S. Montero, I.M. Llorente, Elastic management of cluster-based services in the cloud, in: First Workshop on Automated Control for Datacenters and Clouds, 2009, pp. 1924. doi:10.1145/1555271.1555277.
15. E. Walker Benchmarking Amazon EC2 for high-performance scientific computing Login 33 5 2008 18 23
16. Univa, resources, December 2010. URL: http://www.univa.com.
17. Oracle, Oracle Grid Engine, December 2010. URL: http://www.sun.com/sge.
18. Cluster resources. Torque, December 2010. URL: http://www. clusterresources.com/torque.
19. T. Tannenbaum, D. Wright, K. Miller, and M. Livny Condora distributed job scheduler T. Sterling, Beowulf Cluster Computing with Linux 2001 MIT Press
20. B. Sotomayor, R. Montero, I. Llorente, and I. Foster Virtual infrastructure management in private and hybrid clouds IEEE Internet Computing 13 5 2009 14 22 10.1109/MIC.2009.119
21. VMware, vCenter Server, December 2010. URL: http://www.vmware.com/ products/vcenter-server/.
22. E. Ford, From clusters to clouds: xCAT 2 is Out Of The Bag, November 2010. URL: http://www.linux-mag.com/id/7230.
23. I. Foster, K. Keahey, C. Kesselman, E. Laure, M. Livny, S. Martin, M. Rynge, G. Singh, Embedding community-specific resource managers in general-purpose grid infrastructure, Tech. Rep. ANL/MCS-P1318-0106, Argonne National Laboratory, January 2006.
24. G. Singh, C. Kesselman, E. Deelman, Application-level resource provisioning on the grid, in: IEEE International Conference on e-Science and Grid Computing, 2006, p. 83. doi:10.1109/E-SCIENCE.2006.25.
25. Y. Kee, D. Nurmi, G. Singh, A. Mutz, C. Kesselman, R. Wolski, VGES: the next generation of virtualized grid provisioning, in: IEEE/IFIP International Workshop on End-to-End Virtualization and Grid Management, IEEE, 2007.
26. J. Brevik, D. Nurmi, R. Wolski, Predicting bounds on queuing delay for batch-scheduled parallel machines, in: ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPoPP'06, 2006, pp. 110118. doi:10.1145/1122971.1122989. (Pubitemid 44758681)
27. B. Allcock, J. Bester, J. Bresnahan, A. Chervenak, I. Foster, C. Kesselman, S. Meder, V. Nefedova, D. Quesnel, and S. Tuecke Data management and transfer in high-performance computational grid environments Parallel Computing 28 5 2002 749 771 (Pubitemid 34801987)
28. W. Allcock, J. Bresnahan, R. Kettimuthu, M. Link, C. Dumitrescu, I. Raicu, I. Foster, The globus striped gridFTP framework and server, in: Proceedings of SuperComputing 2005, SC05, Seattle, WA, USA, 2005.
29. Leibniz supercomputing center, 2009 Annual Report, Garching, Germany, December 2010. URL: http://www.lrz.de/wir/berichte/JB/JBer2009.pdf.
30. D. Thain, and M. Livny Building reliable clients and services I. Foster, C. Kesselman, The Grid: Blueprint for a New Computing Infrastructure 2004 Morgan Kaufmann
31. SourceForge, Filesystem in Userspace, November 2010. URL: http://fuse.sourceforge.net/.
32. SourceForge, SSH Filesystem, November 2010. URL: http://fuse.sourceforge. net/sshfs.html.
33. R. Butler, D. Engert, I. Foster, C. Kesselman, S. Tuecke, J. Volmer, and V. Welch A national-scale authentication infrastructure Computer 33 12 2000 60 66 10.1109/2.889094
34. H. Balakrishnan, F.M. Kaashoek, D. Karger, R. Morris, and I. Stoica Looking up data in p2p systems Communications of the ACM 46 2 2003 43 48 10.1145/606272.606299
35. C. Mastroianni, D. Talia, and O. Verta A super-peer model for resource discovery services in large-scale grid Future Generation Computer Systems 21 8 2005 1235 1248 (Pubitemid 41214588)
36. S. Ratnasamy, P. Francis, M. Handley, R. Karp, and S. Shenker A scalable content-addressable network ACM SIGCOMM Computer Communication Review 31 4 2001 161 172 10.1145/964723.383072 (Pubitemid 32981962)
37. P. Marshall, K. Keahey, T. Freeman, Elastic site: using clouds to elastically extend site resources, in: IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid, Melbourne, Australia, 2010. doi:10.1109/CCGRID.2010.80.
38. L. Ramakrishnan, C. Koelbel, Y.S. Kee, R. Wolski, D. Nurmi, D. Gannon, G. Obertelli, A. YarKhan, A. Mandal, T.M. Huang, K. Thyagaraja, D. Zagorodnov, VGrADS: enabling e-science workflows on grids and clouds with fault tolerance, in: SuperComputing, 2009. doi:10.1145/1654059.1654107.
39. B. Sotomayor, K. Keahey, I. Foster, Combining batch execution and leasing using virtual machines, in: International Symposium on High Performance Distributed Computing, HPDC, 2008.
40. The Condor Team, Condor Manual: Virtual Machine Applications, December 2010. URL: http://www.cs.wisc.edu/condor/manual/.
41. Y.S. Kee, C. Kesselman, D. Nurmi, R. Wolski, Enabling personal clusters on demand for batch resources using commodity software, in: Intl. Symp. Parallel and Distributed Processing, IPDPS, 2008, pp. 17. doi:10.1109/IPDPS.2008. 4536167.
42. I. Foster Globus toolkit version 4: software for service-oriented systems Journal of Computer Science and Technology 21 4 2006 513 520 10.1007/s11390-006-0513-y (Pubitemid 46224406)
43. J. Chase, D. Irwin, L. Grit, J. Moore, S. Sprenkle, Dynamic virtual clusters in a grid site manager, in: IEEE International Symposium on High Performance Distributed Computing, HPDC, 2003, pp. 90103. doi:10.1109/HPDC.2003. 1210019.
44. P. Anedda, S. Leo, S. Manca, M. Gaggero, and G. Zanetti Suspending, migrating and resuming HPC virtual clusters Future Generation Computer Systems 26 8 2010 1063 1072 10.1016/j.future.2010.05.007
45. M. de Assuno, A. di Constanzo, and R. Buyya A cost-benefit analysis of using cloud computing to extend the capacity of clusters Cluster Computing 13 3 2010 335 347 10.1007/s10586-010-0131-x
46. Y.C. Lee, and A.Y. Zomaya Rescheduling for reliable job completion with the support of clouds Future Generation Computer Systems 26 8 2010 1192 1199 10.1016/j.future.2010.02.010