Predictive space- and time-resource allocation in parallel job scheduling for clusters, grids, clouds

Proceedings of the International Conference on Parallel Processing Workshops

Volumn , Issue , 2010, Pages 313-322

  Sodan, A ^a  

^a UNIVERSITY OF WINDSOR   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

AVERAGE RESPONSE TIME; BATCH-SCHEDULING; BLACK BOXES; DIFFERENTIATED QOS; JOB SCHEDULER; LOCAL CLUSTER; M/G/1 QUEUING MODELS; MODEL FITTING; PARALLEL JOB SCHEDULING; PRE-EMPTIVE SCHEDULER; QUEUING MODELS; RESOURCE PROVISIONING; RESPONSE TIME; SPACE PARTITIONING; SUPERCOMPUTING CENTERS; TIME-SHARING; USER SATISFACTION;

COMPUTER RESOURCE MANAGEMENT; QUEUEING NETWORKS; SCHEDULING;

SCHEDULING ALGORITHMS;

EID: 78649902891     PISSN: 15302016     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPPW.2010.51     Document Type: Conference Paper

References (28)

1. J. Brevic, D. Nurmi, and R. Wolski, "Predicting Bounds on Queuing Delay in Space-Shared Computing Environments", Proc. ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP), 2006.
2. S.-H. Chiang and M.K. Vernon, "Dynamic vs. Static Quantum-Based Parallel Processor Allocation", Proc. Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP), Springer, LNCS 1162, May 1996.
3. W. Cirne and F. Berman, "When the Herd is Smart- Aggregate Behavior in the Selection of Job Request", IEEE Trans. on Par. and Distr. Systems, 14(2), Feb. 2003.
4. W. Cirne and F. Berman, "A Comprehensive Model of the Supercomputer Workload", Proc. Ann. Workshop on Workload Characterization, Dec 2001.
5. A. Deshmeh, J. Machina, and A.C. Sodan, "ADEPT Scalability Predictor in Support of Adaptive Resource Allocation", Proc. IEEE IPDPS, Atlanta, Georgia, April 2010.
6. A. Downey, "A Model for Speedup of Parallel Programs", Technical Report CSD-97-933, Univ. of California Berkeley, Jan. 1997.
7. B. Esbaugh and A.C. Sodan, "Coarse-grain Time Slicing with Resource-share Control in Parallel-job Scheduling", Proc. High Performance Computing and Communication (HPCC)", Houston, Springer, LNCS 4782, Sept. 2007.
8. Feitelson Workload Archive. http://www.cs.huji.ac.il/labs/ parallel/workload/logs.html, May 2007.
9. D.G. Feitelson and M.A. Jette, "Improved Utilization and Responsiveness with Gang Scheduling", Proc. Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP), Springer, LNCS 1291, April 1997.
10. D. G. Feitelson, "Packing Schemes for Gang Scheduling", Proc. Job Scheduling Strategies for Parallel Processing (JSSPP)", Springer, LNCS 1162, 1996.
11. D. Jackson, Q. Snell, and M. Clement, "Core Algorithms of the Maui Scheduler", Proc. Workshop on Job Scheduling Strategies for Parallel Processing (JSSPP), LNCS 2221, Springer, 2001.
12. R. Kettimuthu, V. Subramani, S. Srinivasan, and T. Gopalasamy, "Selective Preemption Strategies for Parallel Job Scheduling", Proc. Int. Conf. on Par. Proc. (ICPP), 2002.
13. H. Li, J. Chen, Y. Tao, D. Groep, and L. Wolters, "Improving a Local Learning Technique for Queue Wait Time Prediction", Proc. Int. Symp. on Cluster Computing and the Grid (CCGrid), Singapore, May 2006.
14. L. Li, "An Optimistic Differentiated Service Job Scheduling System for Cloud Computing", Proc. Internat. Conf. on Multimedia and Ubiquitous Engineering, 2009.
15. U. Lublin and D.G. Feitelson, "The Workload on Parallel Supercomputers-Modelling the Characteristics of Rigid Jobs", Journal of Parallel and Distributed Computing, 63(11), Nov. 2003, pp. 1105-1122.
16. C. McCann and J. Zahorjan, "Processor Allocation Policies for Message Passing Parallel Computers", Proc. SIGMETRICS, May 1994.
17. V.K. Naik, S.K. Setia, and M.K. Squillante, "Processor Allocation in Multiprogrammed Distributed-Memory Parallel Computer Systems", Journal of Parallel and Distributed Computing, 46(1), 1997, pp. 28-47.
18. R. Nelson, "Probability, Stochastic Processes, and Queuing Theory", Springer, New York, 1995.
19. J. Riley, "StarCluster Brings HPC to the Amazon Cloud", Proc. High Performance Computing (HPC) in the Cloud, May 2010.
20. S. Setia, M. Squillante, and V.K. Naik, "The Impact of Job Memory Requirements on Gang-scheduling Performance", Performance Evaluation Review, 26(4), 1999, pp. 30-39.
21. A.C. Sodan, "Autonomic Share Allocation and Bounded Prediction of Response Times in Parallel Job Scheduling for Grids", Proc. IEEE NCA Workshop on Adaptive Grid Computing, Cambridge, 2008.
22. A.C. Sodan, "Adaptive Scheduling for QoS Virtual Machines under Different Resource Allocation-Performance Effects and Predictability", Proc. JSSPP Workshop, Springer, LNCS 5798, 2009.
23. A.C. Sodan, "Predictive Space- and Time-Resource Allocation in Parallel Job Scheduling for Clusters, Grids, and Clouds", Technical Report 10-005, Univ. of Windsor, CS, March 2010.
24. A.C. Sodan, "Service Prediction and Service Control with the Preemptive Parallel Job Scheduler Scojo-PECT", Technical Report 10-003, Univ. of Windsor, CS, Feb. 2010.
25. A.C. Sodan, "Loosely Coordinated Coscheduling in the Context of other Dynamic Approaches for Job Scheduling- A Survey", J. Concurrency & Computation: Practice & Experience, 17(15), Dec. 2005, 1725-1781.
26. B. Sotomayor, K. Keahey, and I. Foster, "Combining Batch Execution and Leasing Using VMs", Proc. HPDC 2008.
27. B. van Houten, F. Ciesielski, G. Brebner, G. de Jacquelot, M. Riedmann, and H. Strauss, "Advanced Cluster Software for Meteorology", ECMWF workshop on Use of HPC in Meteorology, Reading/UK, Nov. 2006, available at http://www.ecmwf.int/newsevents/meetings/workshops/2006/ high-performance- computing-12th/pdf/Henry-Strauss.pdf.
28. K. Xiong, "Multiple Priority Customer Service Guarantees in Cluster Computing", Proc. IEEE IPDPS, Rome, May 2009.