From meta-computing to interoperable infrastructures: A review of meta-schedulers for HPC, grid and cloud

Proceedings - International Conference on Advanced Information Networking and Applications, AINA

Volumn , Issue , 2012, Pages 874-883

  Sotiriadis, Stelios ^a   Bessis, Nik ^a   Xhafa, Fatos ^b   Antonopoulos, Nick ^a  

^a UNIVERSITY OF DERBY   (United Kingdom)

^b UNIVERSITAT POLITÈCNICA DE CATALUNYA   (Spain)

Author keywords

Clouds; Grids; Inter clouds; Inter enterprises; Meta scheduling

Indexed keywords

GRID AND CLOUD COMPUTING; GRIDS; INTER-CLOUDS; INTER-ENTERPRISES; META-COMPUTING; META-SCHEDULERS; META-SCHEDULING; RESEARCH TOPICS; RESOURCE MANAGEMENT; RESOURCE MANAGEMENT SYSTEMS; RESOURCE PROVIDERS; USER DEMANDS;

CLOUDS; NATURAL RESOURCES MANAGEMENT; RESOURCE ALLOCATION; SCHEDULING;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 84860742807     PISSN: 1550445X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/AINA.2012.15     Document Type: Conference Paper

References (47)

1. Anand, L., Ghose, D., and Mani V., ELISA: an estimated load information scheduling algorithm for distributed computing systems. Computers & Mathematics with Applications, 37(8):57-85, 1999.
2. Andrade, N., Cirne, W., Brasileiro, F., and Roisenberg, P. (2003). OurGrid: An approach to easily assemble grids with equitable resource sharing. In JSSPP'03: Proceedings of the 9th Workshop on Job Scheduling Strategies for Parallel Processing. LNCS, Springer, Berlin/Heidelberg, Germany.
3. Auyoung, A., Chun, B., Snoeren, A., and Vahdat, A. (2004). Resource allocation in federated distributed computing infrastructures. In OASIS '04: 1st Workshop on Operating System and Architectural Support for the On-demand IT Infrastructure, Boston, MA, October, 2004.
4. Bessis, N., Sotiriadis, S., Cristea, V., Pop, F., Towards inter-cloud schedulers: Modelling Requirements for Enabling Meta-Scheduling in Inter-Clouds and Inter-Enterprises, Third International Conference on Intelligent Networking and Collaborative Systems (INCOS 2011), Nov 30 - Dec 2 2011, Fukuoka, Japan.
5. Bessis, N., Sotiriadis, S., Cristea, V., and Pop, F., Towards intercloud schedulers: Modelling Requirements for Enabling Meta-Scheduling in Inter-Clouds and Inter-Enterprises, Third International Conference on Intelligent Networking and Collaborative Systems (INCOS 2011), Nov 30 - Dec 2 2011, Fukuoka, Japan .
6. Bitten, C., Gehring, J., Schwiegelshohn, U., and Yahyapour, R., 2000. The NRW-Metacomputer-Building Blocks for A Worldwide Computational Grid. In Proceedings of the 9th Heterogeneous Computing Workshop (HCW '00). IEEE Computer Society, Washington, DC, USA, 31.
7. Braun, T.D., Siegel, J.H., Beck, N., Lasislau Boloni, L., Maheswaran, M., Reuther, I.A., Robertson, P.J., Theys, D.M., Yao,B., Hensgen, D., and Freund, F.R., 2001. A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J. Parallel Distrib. Comput. 61, 6 (June 2001), 810-837.
8. Butt, A. R., Zhang, R., and Hu, Y. C. (2003). A self-organizng flock of condors. In SC '03: Proceedings of the 2003 ACM/IEEE conference on Supercomputing. IEEE Computer Society, Los Alamitos, CA, USA.
9. Buyya, R., Ranjan, R., and Calheiros, R. N., (2010) InterCloud: Utility-Oriented Federation of Cloud Computing Environments for Scaling of Application Services, Algorithms and Architectures for Parallel Processing (2010), Volume: 6081/2010, Issue: LNCS 6081, Publisher: Springer, Pages: 13-31.
10. Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J. and Brandic, I., Cloud computing and emerging it platforms: vision, hype, and reality for delivering computing as the 5th utility, Future Generation Computer Systems 25 (6) (2009), pp. 599-616 10.1016/j.future.2008.12.001.
11. Carroll, T.E. and Grosu, D., "An Incentive-Compatible Mechanism for Scheduling Non-Malleable Parallel Jobs with Individual Deadlines," Parallel Processing, 2008. ICPP '08. 37th International Conference on, vol., no., pp.107-114, 9-12 Sept. 2008.
12. Christodoulopoulos, K., Sourlas, V., Mpakolas, I., and Varvarigos, E., A comparison of centralized and distributed meta-scheduling architectures for computation and communication tasks in Grid networks, Computer Communications, Volume 32, Issues 7-10, 28 May 2009, Pages 1172-1184, ISSN 0140-3664.
13. De Assuncao, M., Buyya, R., and Venugopal, S., InterGrid: A case for internetworking islands of Grids, Concurrency and Computation: Practice and Experience 20 (8) (2008) 997-1024.
14. De Assuncao, M., Costanzo, A., and Buyya, B., (2010). A costbenefit analysis of using cloud computing to extend the capacity of clusters. Cluster Computing, Volume 13, Issue 3, September 2010, Pages 335-347 ISSN: 1386-7857.
15. De Assuncao, M.D. and Buyya, R., Performance analysis of allocation policies for interGrid resource provisioning. Information and Software Technology, 51(1):42-55, 2009.
16. Feigenbaum, J. and Shenker, S. (2002). Distributed algorithmic mechanism design: recent results and future directions. In DIALM '02: Proceedings of the 6th international workshop on Discrete algorithms and methods for mobile computing and communications, Atlanta, Georgia, USA, pages 1-13. ACM Press, New York, NY, USA.
17. Feitelson, D.G., and Rudolph, L., 1995. Parallel Job Scheduling: Issues and Approaches. In Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing (IPPS '95), Dror G. Feitelson and Larry Rudolph (Eds.). Springer-Verlag, London, UK, 1-18. Approaches," in Job Scheduling Strategies for Parallel Processing (JSSPP), 1995, pp. 1-18, LNCS 949.
18. Folling, A., Grimme, C., Lepping, J., and Papaspyrou, A., Decentralized grid scheduling with evolutionary fuzzy systems. In Job Scheduling Strategies for Parallel Processing, pages 16-36. Springer, 2009.
19. Frerot, C. D., Lacroix, M., and Guyennet, H. (2000a). Federation of resource traders in objects-oriented distributed systems. (PARELEC'00) August 27-30, Quebec, Canada.
20. Freund, R. F., Gherrity, M., Ambrosius, S., Campbell, M., Halderman, M., Hensgen, D., Keith, E., Kidd, T., Kussow, M., Lima, J. D., Mirabile, F., Moore, L., Rust, B., and Siegel, H. J. 1998. Scheduling Resources in Multi-User, Heterogeneous, Computing Environments with SmartNet. In Proceedings of the Seventh Heterogeneous Computing Workshop (HCW '98). IEEE Computer Society, Washington, DC, USA.
21. Fu, Y., Chase, J., Chun, B., Schwab, S., and Vahdat, A. (2003). SHARP: an architecture for secure resource peering. In SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles, Bolton Landing, NY, USA, pages 133-148. ACM Press, New York, NY, USA.
22. Globus website: http://www.globus.org/toolkit/, Accessed 10 November 2011.
23. Grosu, D. and Chronopoulos, T. (2004). Algorithmic mechanism design for load balancing in distributed systems. In IEEE Transactions on Systems Man and Cybernetics Part B, pages 77-84. IEEE Computer Society, Los Alamitos, CA, USA.
24. Guim F., and Corbalan, J., 2007. A job self-scheduling policy for HPC infrastructures. In Proceedings of the 13th international conference on Job scheduling strategies for parallel processing (JSSPP'07), Eitan Frachtenberg and Uwe Schwiegelshohn (Eds.). Springer-Verlag, Berlin, Heidelberg, 51-75.
25. Hamscher, V., Schwiegelshohn, U., Streit, A., and Yahyapour, R., 2000. Evaluation of Job-Scheduling Strategies for Grid Computing. In Proceedings of the First IEEE/ACM International Workshop on Grid Computing (GRID '00), Rajkumar Buyya and Mark Baker (Eds.). Springer-Verlag, London, UK, 191-202.
26. Ibarra, H. O., and Kim, E., C., 1977. Heuristic Algorithms for Scheduling Independent Tasks on Nonidentical Processors. J. ACM 24, 2 (April 1977), 280-289.
27. Iosup, A., Tannenbaum, T., Farrellee, M., Epema, D., and Livny, M., Inter-operating grids through delegated matchmaking. Scientific Programming, 16(2):233-253, 2008.
28. Jackson, D., Snell, Q., and Clement, M., Core algorithms of the Maui scheduler. In Job Scheduling Strategies for Parallel Processing, pages 87-102. Springer, 2001.
29. Kertesz, A., Farkas, Z., Kacsuk, P., and Kiss, T., Grid Interoperability by Multiple Broker Utilization and Meta-Broking. Grid Enabled Remote Instrumentation, pages 303-312, 2009.
30. Kertesz, A., Rodero, I., and Guim, F., Meta-Brokering requirements and research directions in state-of-the-art Grid Resource Management". In Proceedings of the CoreGRID Integration Workshop 2008, pages 371-382, April 2008.
31. Lai, K., Huberman, B. A., and Fine, L. (2004). Tycoon: an Implementation of a Distributed market-based resource allocation system. Technical Report, HP Labs, 2004.
32. Leal, K., Huedo, E., and Llorente, I.M., A decentralized model for scheduling independent tasks in federated grids. Future Generation Computer Systems, 25(8):840-852, 2009. 21, 27.
33. Mateescu, G., Gentzsch, W., and Ribbens, J.C., Hybrid Computing-Where HPC meets grid and Cloud Computing, Future Generation Computer Systems, Volume 27, Issue 5, May 2011, Pages 440-453, ISSN 0167-739X.
34. Pinchak, C., Lu, P., and Goldenberg, M., 2002. Practical Heterogeneous Placeholder Scheduling in Overlay Metacomputers: Early Experiences. In Revised Papers from the 8th International Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP '02), Dror G. Feitelson, Larry Rudolph, and Uwe Schwiegelshohn (Eds.). Springer-Verlag, London, UK, UK, 205-228.
35. Rodero, I., Guim, F., and Corbalan, J., 2009. Evaluation of Coordinated Grid Scheduling Strategies. In Proceedings of the 2009 11th IEEE International Conference on High Performance Computing and Communications (HPCC '09). IEEE Computer Society, Washington, DC, USA, 1-10.
36. Rodero, I., Guim, F., Corbalan, J., Fong, L., and Sadjadi S. M., Grid broker selection strategies using aggregated resource information. Future Generation Computer Systems, 26(1):72-86, 2010. 21, 26.
37. Schwiegelshohn, U., and Yahyapour, R., Resource allocation and scheduling in metasystems. In High-Performance Computing and Networking, pages 851-860. Springer, 1999.
38. Shah, R., Veeravalli, B., and Misra, M., On the design of adaptive and decentralized load balancing algorithms with load estimation for computational grid environments. IEEE Transactions on parallel and distributed systems, 18(12):1675-1686, 2007.
39. Sotiriadis, S., Bessis, N., and Antonopoulos, N., Towards inter-cloud schedulers: A survey of meta- scheduling approaches, Sixth International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, Oct 26-28 2011, Barcelona, Spain.
40. Snell, Q., Clement, J. M., Jackson, D. B. and Gregory, C., 2000. The Performance Impact of Advance Reservation Meta-scheduling. In Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing (IPDPS '00/JSSPP '00), Dror G. Feitelson and Larry Rudolph (Eds.). Springer-Verlag, London, UK, 137-153.
41. Subramani, V., Kettimuthu, R., Srinivasan, S., and Sadayappan, P. (2002). Distributed job scheduling on computational grids using multiple simultaneous requests. In 11th IEEE International Symposium on High Performance Distributed Computing (HPDC-11), 23-26 July. IEEE Computer Society, Los Alamitos, CA, USA.
42. Teo, Y. M., Wang, X., and Gozali, J. P., 2004. A Compensation-based Scheduling Scheme for Grid Computing. In Proceedings of the High Performance Computing and Grid in Asia Pacific Region, Seventh International Conference (HPCASIA '04). IEEE Computer Society, Washington, DC, USA, 334-342.
43. Weissman, J. B. and Grimshaw, A. (1996). Federated model for scheduling in widearea systems. HPDC'96: Proceedings of the Fifth IEEE International Symposium on High Performance Distributed Computing, pages 542-550, August 1996.
44. Xu, B., Zhao, C., Hu, E., and Hu, B., Job scheduling algorithm based on Berger model in cloud environment, Advances in Engineering Software, Volume 42, Issue 7, July 2011, Pages 419-425, ISSN 0965-9978.
45. Yue, J., Global backfilling scheduling in Multiclusters, Lecture Notes in Computer Science, Applied Computing, pages 232-239, vol. 3285 2004.
46. Wang, C.M., Chen, H.M., Hsu, C.C., and Lee, J., Dynamic resource selection heuristics for a non-reserved bidding-based Grid environment. Future Generation Computer Systems, 26(2):183-197, 2010.
47. Huang, Y., Bessis, N., Norrington, P., Kuonen, P., and Hirsbrunner, B., Exploring decentralized dynamic scheduling for grids and clouds using the community-aware scheduling algorithm, Future Generation Computer Systems, In Press, Accepted Manuscript, Available online 13 May 2011, ISSN 0167-739X.