Resource co-allocation for large-scale distributed environments

Proc. 18th ACM International Symposium on High Performance Distributed Computing, HPDC 09, Co-located with the 2009 International Symposium on High Performance Distributed Computing Conf., HPDC'09

Volumn , Issue , 2009, Pages 131-140

  Castillo, Claris ^a   Rouskas, George N ^b   Harfoush, Khaled ^b  

^a IBM RESEARCH   (United States)

^b NORTH CAROLINA STATE UNIVERSITY   (United States)

Author keywords

Advance reservation; Resource co allocation; Scheduling

Indexed keywords

ADVANCE RESERVATION; BATCH-SCHEDULING; CO-ALLOCATION; CO-ALLOCATION SCHEDULING; COMPARATIVE ANALYSIS; DISTRIBUTED ENVIRONMENTS; LARGE SCALE DISTRIBUTED COMPUTING; MULTIPLE RESOURCES; ON-LINE ALGORITHMS; ONLINE SCHEDULING ALGORITHM; QOS GUARANTEE; RANGE SEARCH; TEMPORAL AVAILABILITY; TIME SENSITIVE APPLICATIONS;

COMPUTER SCIENCE; DATA STRUCTURES; DIE CASTING; DISTRIBUTED COMPUTER SYSTEMS; QUALITY OF SERVICE; TELECOMMUNICATION NETWORKS;

SCHEDULING ALGORITHMS;

EID: 70449652436     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1551609.1551634     Document Type: Conference Paper

References (36)

1. Google and IBM look to next generation of programmers. http://www.ibm.com/ibm/ideasfromibm/us/google/index.shtml.
2. Hadoop Virtual Cluster Appliance. http://www.grid-appliance.org/.
3. Parallel Workload Archive. www.cs.huji.ac.il/labs/parallel/workload.
4. S. Averitt, M. Bugaev, A. Peeler, H. Scha&ffer, E. Sills, S. Stein, J. Thompson, and M. Vouk. The virtual computing lab. In International Conference on Virtual Computing Initiative, pages 1-16, Research Triangle Park, NC, May 2007.
5. A. Ballier, E. Caron, D. Epema, and H. Mohamed. Stimulating grid schedulers with deadlines and co-allocation. INRIA Technical Report, January 2006.
6. T. Beyene, Y. Xin, M. Turabi, and K. Raza. PCE based grid networking. In IEEE Symposium on Computers and Communications, pages 769-774, Aveiro, Portugal, July 2007.
7. B. Bode, D. M. Halstead, R. Kendall, Z. Lei, and D. Jackson. The portable batch scheduler and the Maui scheduler on Linux clusters. In ALS'00: Proceedings of the 4th. Annual Linux Showcase & Conference, Atlanta, pages 27-27, Berkeley, CA, US, 2000. USENIX Association.
8. C. Castillo, G. N. Rouskas, and K. Harfoush. E±cient QoS resource management for heterogeneous Grids. In 22nd. IEEE International Parallel and Distributed Processing Symposium (IPDPS'08), Miami, Florida, US, April 2008.
9. C. Castillo, G. N. Rouskas, and K. Harfoush. On the design of online scheduling algorithms for advance reservations and QoS in Grids. In 21sts IEEE International Parallel and Distributed Processing Symposium (IPDPS'07), pages 1-10, Long Beach, California, US, April 2007.
10. K. Czajkowski, I. Foster, and C. Kesselman. Resource co-allocation in computational Grids. In 8th. IEEE International Symposium on High Performance Distributed Computing, pages 219-228, Redondo Beach, 1999.
11. J. Dean and S. Ghemawat. Mapreduce: simplified data processing on large clusters. Commun. ACM, 51(1):107-113, 2008.
12. J. Decker and J. Schneider. Heuristic scheduling of grid workflows supporting co-allocation and advance reservation. In CCGRID '07: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid, pages 335-342, Washington, DC, US, 2007. IEEE Computer Society.
13. E. Deelman, C. Kesselman, G. Mehta, L. Meshkat, L. Pearlman, K. Blackburn, P. Ehrens, A. Lazzarini, R. Williams, and S. Koranda. GriPhyN and LIGO, building a virtual data Grid for gravitational wave scientists. In 11th IEEE International Symposium on High Performance Distributed Computing, pages 225-255, Edinburgh, Scotland, 2002.
14. C. Dynamic Multi-Terabit Core Optical Networks: Architecture, Protocols and M. (CORONET). http://www.darpa.mil/STO/solicitations/CORONET/index.htm.
15. L. Eyraud-Dubois, G. Mounie, and D. Trystram1. Analysis of scheduling algorithms with reservations. In IEEE International Parallel and Distributed Processing Symposium, March 2007.
16. A. Farrel, J. P. Vasseur, and J. Ash. A path computation element PCE-based architecture. http://tools.ietf.org/html/rfc4655, August 2006.
17. D. G. Feitelson. Packing schemed for gang scheduling. In Revised Papers from the International Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP '96), 1996.
18. D. G. Feitelson, L. Rudolph, and U. Schwiegelshohn. Parallel job scheduling - a status report. In International Workshop on Job Scheduling Strategies for Parallel Processing, Lectures Notes in Computer Science, Springer, pages 1-16, Cambridge, MA, US, 2004. Springer Berlin / Heidelberg.
19. D. G. Feitelson, L. Rudolph, U. Schwiegelshohn, K. C. Sevcik, and P. Wong. Theory and practice in parallel job scheduling. In International Workshop on Job Scheduling Strategies for Parallel Processing, volume 1294 of Lecture Notes in Computer Science, pages 1-34, London, UK, April 1997. Springer-Verlag.
20. Global Grid Forum. Advance Reservations: State of the art. www.ggf.org, June 2003.
21. L. He, S. A. Jarvis, D. P. Spooner, X. Chen, and G. R. Nudd. Dynamic scheduling of parallel jobs with qos demands in multiclusters and grids. In Proceedigs of the Fifth IEEE/ACM International Workshop on Grid Computing (GRID'04), pages 402-409, London, UK, 2004. Springer-Verlag.
22. X. He, X. Sun, and G. von Laszewski. Qos guided Min-Min heuristic for grid task scheduling. Journal of Computer Science and Technology, 18(4):442-451, 2003.
23. D. S. Katz, J. C. Jacob, G. B. Berriman, J. Good, A. C. Laity, E. Deelman, C. Kesselman, and G. Singh. A comparison of two methods for building astronomical image mosaics on a Grid. In International Conference on Parallel Processing Workshops (ICPP), pages 85-94, Oslo, Norway, June 2005. IEEE Computer Society.
24. D. A. Lifka. The ANL/IBM SP scheduling system. In IPPS '95: Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing, pages 295-303, London, UK, 1995. Springer-Verlag.
25. M. J. Litzkow, M. Livny, and M. W. Mutka. Condor - A hunter of idle workstations. In IEEE 8th International Conference on Distributed Computing Systems, pages 104-111, June 1988.
26. P. Maechling, H. Chalupsky, M. Dougherty, E. Deelman, Y. Gil, S. Gullapalli, V. Gupta, C. Kesselman, J. Kim, G. Mehta, B. Mendenhall, T. Russ, G. Singh, M. Spraragen, G. Staples, and K. Vahi. Simplifying construction of complex workflows for non-expert users of the Southern California Earthquake Center Community modeling environment. ACM SIGMOD Record, 34(3):24-30, 2005.
27. R. Manager Torque. http://www.clusterresources.com/pages/products/torque- resource-manager.php.
28. H. on Demand. http://hadoop.apache.org/core/docs/r0.16.4/hod.html.
29. Phosphorus. http://www.fz-juelich.de/jsc/grid/PHOSPHORUS/.
30. Platform Computing Corporation. LSF. http://www.platform.com.
31. M. K. Ramamurthy and K. K. Droegemeier. Linked Environments for Atmospheric Discovery (LEAD): A cyberinfrstructure for mesoscale meteorology research and education. In Proceedings of the Conference of Interactive Information Processing Systems for Meteorology, Ocenoegraphy and Hydrology, 2004.
32. M. Siddiqui, A. Villazón, and T. Fahringer. Grid capacity planning with negotiation-based advance reservation for optimized qos. In ACM/IEEE Conference on Supercomputing, page 103, New York, NY, US, 2006. ACM.
33. W. Smith, I. Foster, and V. Taylor. Scheduling with advance reservations. In 14th. IEEE International Parallel and Distributed Processing Symposium, pages 127-132, Cancun, Mexico, May 2000.
34. S. Srinivasan, R. Kettimuthu, V. Subramani, and P. Sadayappan. Selective reservation strategies for backfill job scheduling. In Revised Papers from the 8th International Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP '02), pages 55-71, London, UK, 2002. Springer-Verlag.
35. D. Talby and D. G. Feitelson. Supporting priorities and improving utilization of the ibm sp scheduler using slack-based backfilling. In IPPS '99/SPDP '99: Proceedings of the 13th International Symposium on Parallel Processing and the 10th Symposium on Parallel and Distributed Processing, page 513, Washington, DC, US, 1999. IEEE Computer Society.
36. W. Zhanga, A. M. K. Chengb, and M. Hu. Multisite co-allocation algorithms for computational Grids. In 20st. International Parallel and Distributed Processing Symposium, pages 1-8, Rhodes Island, Greece, April 2006.